-- Logs begin at Thu 2022-05-19 03:29:22 UTC, end at Thu 2022-05-19 06:13:37 UTC. -- May 19 04:20:31.010791 n-d-766726-30 systemd[1]: Starting Devstack devstack@n-api.service... May 19 04:20:31.019136 n-d-766726-30 devstack@n-api.service[103831]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 04:20:31 2022] *** May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: nodename: n-d-766726-30 May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: machine: x86_64 May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: clock source: unix May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: pcre jit disabled May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: detected number of CPU cores: 4 May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: current working directory: / May 19 04:20:31.021175 n-d-766726-30 devstack@n-api.service[103831]: detected binary path: /usr/bin/uwsgi-core May 19 04:20:31.022355 n-d-766726-30 devstack@n-api.service[103831]: your processes number limit is 47680 May 19 04:20:31.022355 n-d-766726-30 devstack@n-api.service[103831]: your memory page size is 4096 bytes May 19 04:20:31.022355 n-d-766726-30 devstack@n-api.service[103831]: detected max file descriptor number: 2048 May 19 04:20:31.022355 n-d-766726-30 devstack@n-api.service[103831]: lock engine: pthread robust mutexes May 19 04:20:31.022355 n-d-766726-30 devstack@n-api.service[103831]: thunder lock: enabled May 19 04:20:31.022355 n-d-766726-30 devstack@n-api.service[103831]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 04:20:31.022355 n-d-766726-30 devstack@n-api.service[103831]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 04:20:31.066092 n-d-766726-30 devstack@n-api.service[103831]: Python main interpreter initialized at 0x561467f7f9c0 May 19 04:20:31.066092 n-d-766726-30 devstack@n-api.service[103831]: python threads support enabled May 19 04:20:31.066092 n-d-766726-30 devstack@n-api.service[103831]: your server socket listen backlog is limited to 100 connections May 19 04:20:31.066092 n-d-766726-30 devstack@n-api.service[103831]: your mercy for graceful operations on workers is 90 seconds May 19 04:20:31.066421 n-d-766726-30 devstack@n-api.service[103831]: mapped 403077 bytes (393 KB) for 2 cores May 19 04:20:31.066506 n-d-766726-30 devstack@n-api.service[103831]: *** Operational MODE: preforking *** May 19 04:20:31.066751 n-d-766726-30 devstack@n-api.service[103831]: *** uWSGI is running in multiple interpreter mode *** May 19 04:20:31.066751 n-d-766726-30 devstack@n-api.service[103831]: spawned uWSGI master process (pid: 103831) May 19 04:20:31.066940 n-d-766726-30 systemd[1]: Started Devstack devstack@n-api.service. May 19 04:20:31.069207 n-d-766726-30 devstack@n-api.service[103831]: spawned uWSGI worker 1 (pid: 103832, cores: 1) May 19 04:20:31.069207 n-d-766726-30 devstack@n-api.service[103831]: spawned uWSGI worker 2 (pid: 103833, cores: 1) May 19 04:20:31.069207 n-d-766726-30 devstack@n-api.service[103831]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 04:20:32.284032 n-d-766726-30 devstack@n-api.service[103833]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 04:20:32.288946 n-d-766726-30 devstack@n-api.service[103832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 04:20:33.015029 n-d-766726-30 devstack@n-api.service[103832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 04:20:33.015029 n-d-766726-30 devstack@n-api.service[103832]: from cryptography.utils import int_from_bytes May 19 04:20:33.015358 n-d-766726-30 devstack@n-api.service[103832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 04:20:33.015358 n-d-766726-30 devstack@n-api.service[103832]: from cryptography.utils import int_from_bytes May 19 04:20:33.017847 n-d-766726-30 devstack@n-api.service[103833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 04:20:33.017847 n-d-766726-30 devstack@n-api.service[103833]: from cryptography.utils import int_from_bytes May 19 04:20:33.018171 n-d-766726-30 devstack@n-api.service[103833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 04:20:33.018171 n-d-766726-30 devstack@n-api.service[103833]: from cryptography.utils import int_from_bytes May 19 04:20:35.632379 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 04:20:35.632990 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 04:20:35.633178 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 04:20:35.633536 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 04:20:35.633789 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 04:20:35.634171 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.634491 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.634586 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 04:20:35.634976 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 04:20:35.635066 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.635152 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.635279 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 04:20:35.635422 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.635640 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 04:20:35.635742 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.635894 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 04:20:35.636038 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.636280 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.636378 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.636604 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.636693 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.636905 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.637004 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.637239 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.637348 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.637562 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-766726-30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.637662 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.637869 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.637963 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.638168 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.638267 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.638473 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.638619 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.638787 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.638883 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.639052 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.639147 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.639364 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.639458 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.639679 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.639772 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-766726-30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.639999 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.640167 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.640306 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.640603 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.640719 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.640907 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.641032 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.641235 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.641366 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.641558 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.641689 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.641862 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.641951 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.642163 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.642359 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.642464 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.642670 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.642765 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.642975 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.643073 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.643285 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.643373 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.643621 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.643746 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-766726-30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.643933 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.644059 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.644238 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.644369 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.644560 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.644680 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.644866 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.645106 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.645219 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.645664 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.645759 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.645972 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.646144 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-766726-30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.646314 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.646485 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.646633 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.646796 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.646936 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.647110 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.647258 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.647518 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.647622 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.647827 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.647922 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.648136 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.648234 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.648454 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.648558 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.648754 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.648840 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.649058 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.649173 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.649402 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.649505 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.649705 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.649800 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.650005 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.650094 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.650253 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.650360 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.650555 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.650645 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.650872 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.650959 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.651190 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.651285 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.651508 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.651603 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.651754 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.651854 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.652001 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.652100 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.652314 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.652408 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.652632 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.652728 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.652936 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.653030 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.653269 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.653358 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.653574 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.653672 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.653828 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.653920 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.654076 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.654171 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.654393 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.654482 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.654716 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.654804 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.655021 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.655109 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.655327 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.655421 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.655633 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.655727 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.655940 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.656036 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.656244 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.656337 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.656547 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.656634 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.656851 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.656938 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.657179 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.657274 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.657490 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.657578 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.657801 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.657899 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.658122 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.658218 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.658423 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.658509 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.658736 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.658902 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.659055 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.659144 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.659361 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.659449 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.659663 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.659769 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.659963 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.660057 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.660281 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.660370 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.660599 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.660697 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.660897 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.660995 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.661167 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.661267 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.661467 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.661557 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.661767 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.661856 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.662105 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.662194 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.662408 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.662503 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.662709 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.662797 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.663010 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.663111 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.663291 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.663386 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.663590 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.663687 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.663890 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.663977 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.664190 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.664287 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.664491 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.664584 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.664790 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.664886 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.665103 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.665195 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.665406 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.665509 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.665707 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.665805 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.666007 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.666100 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.666311 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.666414 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.666615 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.666714 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.666913 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.667006 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.667213 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.667301 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.667513 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.667611 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.667814 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.667909 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.668113 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.668207 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.668415 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.668513 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.668715 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.668799 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.669026 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.669136 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.669358 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.669460 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.669653 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.669739 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.669954 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.670042 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.670255 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.670351 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.670555 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.670649 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.670857 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.670948 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.671151 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.671249 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.671450 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.671538 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.671754 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.671852 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.672054 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.672152 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.672354 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.672442 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.672651 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.672737 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.672949 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.673045 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.673270 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.673359 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.673569 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.673658 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.673866 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.673950 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.674164 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.674252 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.674458 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.674552 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.674762 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.674850 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.675062 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.675150 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.675362 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.675450 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.675660 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.675748 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.675957 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.676045 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.676258 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.676362 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.676556 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.676644 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.676870 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.676957 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.677215 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.677342 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.678053 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.678150 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.678362 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.678455 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.678668 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.678772 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.678989 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:20:35.679098 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.679306 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.679394 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.679616 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.679706 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.679938 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.680026 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.680245 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.680333 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.680552 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.680641 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.680861 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.680950 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.681202 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.681292 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.681517 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.681607 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.681839 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.681934 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.682147 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.682235 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.682461 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.682550 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.682770 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.682869 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.683075 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.683162 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.683386 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.683476 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.683701 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.683796 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.684012 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.684099 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.684319 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.684415 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.684638 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.684727 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.684957 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.685055 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.685298 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.685399 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.685613 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.685702 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.685927 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.686023 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.686237 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.686336 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.686548 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.686647 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.686851 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.686947 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.687169 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.687257 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.687497 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.687586 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.687805 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.687902 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.688118 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.688214 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.688426 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.688514 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.688734 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.688833 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.689040 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.689184 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.689371 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.689459 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.689679 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.689778 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.689996 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.690092 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.690308 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.690396 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.690617 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.690715 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.690922 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.691009 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.691232 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.691330 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.691536 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.691625 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.691842 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.691937 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.692147 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.692236 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.692449 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.692547 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.692749 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.692838 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.693048 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.693799 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.693897 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.693985 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.694197 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.694287 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.694512 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.694614 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.694829 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.694923 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.695130 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.695218 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.695434 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.695531 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.695739 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.695836 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.696042 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.696138 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.696345 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.696445 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.696653 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.696740 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.696954 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.697043 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.697285 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.697377 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.697592 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.697683 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.697892 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.697981 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.698206 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.698295 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.698512 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.698611 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.698813 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.698902 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.699116 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.699204 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.699416 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.699509 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.699717 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.699806 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.700021 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.700118 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.700324 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.700417 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.700632 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.700729 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.700933 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.701020 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.701260 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.701348 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.701579 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.701680 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.701883 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.701970 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.702186 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.702281 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.702494 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.702590 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.702806 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.702895 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.703111 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.703198 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.703418 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.703514 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.703735 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.703821 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.704047 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.704144 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.704346 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.704434 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.704651 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.704738 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.704952 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.705049 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.705276 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.705363 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.705576 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.705664 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.705880 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.705976 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.706181 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.706272 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.706484 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.706572 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.706783 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.706871 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.707083 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.707173 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.707381 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.707476 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.707695 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.707790 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.707999 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.708086 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.708299 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.708388 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.708598 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.708765 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.708927 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.709016 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.709256 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.709346 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.709562 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.709663 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.709884 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.709979 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.710193 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.710282 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.710499 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.710600 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.710804 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.710893 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.711107 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.711205 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.711431 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.711519 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.711739 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.712047 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.712356 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.712662 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.712977 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.713178 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.713315 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.713558 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.713646 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.713911 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.714008 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.714229 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.714306 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.714535 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.714612 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.714851 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.714937 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.715153 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.715230 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.715465 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.715802 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.716129 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.716444 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.716764 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.717071 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.717291 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.717402 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.717650 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.717740 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.717986 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.718080 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.718297 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.718394 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.718602 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.718692 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.718916 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.719222 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.719309 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.719536 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.719681 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.719843 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.720010 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.720162 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.720350 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.720469 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.720677 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.720782 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.721010 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.721105 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.721356 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.721452 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.721685 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.721770 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.722026 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.722113 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.722333 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.722429 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.722675 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.722753 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.722993 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.723070 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.723301 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.723388 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.723608 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.723694 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.723914 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.723993 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.724215 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.724301 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.724557 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.724633 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.724863 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.724939 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.725196 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.725290 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.725504 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.725593 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.725809 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.725905 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.726108 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.726198 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.726417 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.726504 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.726724 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.726813 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.727024 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.727102 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.727322 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.727408 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.727628 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.727717 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.727945 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.728043 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.728249 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.728336 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.728566 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.728654 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.728879 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.728967 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.729198 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.729298 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.729500 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.729600 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.729817 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.729895 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.730121 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.730200 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.730418 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.730515 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.730717 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.730805 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.731014 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.731110 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.731326 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.731418 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.731638 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.731737 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.731934 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.732030 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.732240 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.732336 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.732549 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.732626 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.732851 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.732928 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.733174 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.733267 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.733478 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.733567 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.733781 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.733869 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.734096 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.734186 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.734403 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.734491 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.734703 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.734789 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.735008 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.735097 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.735311 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.735407 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.735612 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.735712 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.735913 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.736014 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.736228 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.736316 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.736530 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.736625 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.736831 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.736917 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.737153 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.737242 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.737454 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.737552 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.737758 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.737845 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.738068 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.738157 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.738392 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.738630 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.738719 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.738955 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.739042 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.739264 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.739353 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.739578 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.739668 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.739890 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.739978 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.740730 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.740831 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.741043 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.741152 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.741379 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.741463 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.741690 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.741789 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.741998 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.742098 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.742303 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.742400 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.742605 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.742700 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.742906 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.742995 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.743209 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.743297 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.743506 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.743593 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.743805 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.743894 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.744102 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.744197 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.744406 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.744494 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.744706 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.744803 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.745004 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.745292 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.745383 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.745610 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.745699 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.745917 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.746005 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.746216 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.746304 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.746528 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.746618 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.746829 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.746924 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.747148 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.747244 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.747453 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.747542 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.747751 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.747847 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.748049 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.748152 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.748347 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.748444 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.748682 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.748770 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.748982 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.749071 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.749316 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.749417 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.749621 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.749716 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.749925 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.750014 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.750229 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.750335 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.750537 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.750634 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.750839 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.750926 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.751139 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.751228 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.751439 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.751529 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.751734 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.751828 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.752037 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.752127 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.752338 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.752426 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.752635 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.752729 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.752936 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.753026 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.753260 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.753350 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.753566 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.753655 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.753869 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.753967 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.754166 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.754255 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.754465 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.754563 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.754762 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.754848 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.755070 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.755158 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.755373 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.755470 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.756207 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.756308 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.756524 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.756614 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.756828 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.756929 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.757152 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.757261 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.757454 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.757550 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.757758 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.757861 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.758057 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.758152 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.758369 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.758458 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.758670 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.758760 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.758969 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.759057 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.759268 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.759363 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.759573 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.759662 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.759876 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.759965 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.760174 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.760268 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.760480 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.760569 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.760782 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.760869 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.761120 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.761211 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.761402 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.761492 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.761708 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.761795 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.762009 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.762111 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.762307 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.762396 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.762607 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.762694 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.762918 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.763016 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.763224 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.763319 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.763519 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.763613 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.763822 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.763997 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.764119 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.764208 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.764418 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.764505 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.764717 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.764814 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.765017 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.765135 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.765336 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.765424 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.765633 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.765731 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.765931 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.766021 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.766229 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.766319 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.766531 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.766621 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.766848 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.766938 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.767151 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.767243 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.767447 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.767536 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.767745 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.767842 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.768043 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.768138 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.768348 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.768437 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.768659 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.768756 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.768981 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.769099 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.769321 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.769411 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.769625 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.769712 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.769936 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.770033 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.770237 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.770325 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.770792 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.770880 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.771096 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.771196 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.771419 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.771508 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.771719 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.771802 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.772020 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.772119 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.772319 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.772407 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.772614 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.772701 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.772911 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.773014 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.773247 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.773337 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.773554 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.773641 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.773854 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.773951 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.774155 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.774243 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.774456 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.774543 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.774775 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.774863 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.775074 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.775170 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.775375 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.775463 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.775678 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.775774 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.775978 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.776066 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.776279 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.776376 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.776586 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.776674 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.776889 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.776976 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.777212 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.777317 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.777517 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.777605 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.777820 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.777909 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.778123 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.778223 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.778421 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.778509 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.778722 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.778812 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.779022 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.779117 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.779318 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.779412 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.779635 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.779723 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.779938 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.780035 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.780237 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.780326 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.780538 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.780633 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.780835 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.780924 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.781157 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.781258 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.781460 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.781551 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.781782 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.781867 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.782091 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.782179 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.782400 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.782488 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.782710 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.782800 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.783020 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.783119 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.783323 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.783409 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.783631 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.783720 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.783934 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.784022 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.784232 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.784328 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.784535 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.784643 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.784843 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.784938 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.785173 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.785279 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.785480 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.785570 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.785801 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.785893 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.786109 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.786212 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.786412 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.786506 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.786718 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.786805 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.787045 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.787134 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.787343 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.787431 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.787640 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.787727 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.787955 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.788044 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.788253 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.788367 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.788569 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.788669 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.788966 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.789055 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.789294 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.789392 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.789596 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.789684 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.789906 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.790002 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.790218 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.790301 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.790523 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.790620 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.790893 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.790980 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.791210 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.791297 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.791528 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.791624 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.791829 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.791924 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.792130 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.792218 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.792431 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.792593 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.792741 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.792831 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.793058 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.793157 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.793384 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.793489 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.793685 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.793772 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.793982 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.794076 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.794299 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.794397 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.794599 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.794688 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.794909 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.795029 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.795225 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.795323 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.795624 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.795721 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.795931 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.796019 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.796231 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.796345 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.796550 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.796648 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.796868 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.796957 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.797197 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.797290 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.797498 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.797589 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.797801 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.797899 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.798100 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.798189 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.798402 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.798498 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.798721 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.798811 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.799023 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.799114 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.799330 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.799420 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.799633 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.799720 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.799935 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.800037 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.800232 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.800323 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.800531 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.800620 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.800848 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.800947 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.801172 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.801263 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.801492 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.801592 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.801800 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.801958 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.802115 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.802282 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.802430 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.803115 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.803284 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.803438 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.803560 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.803765 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.803862 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.804074 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.804177 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.804380 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.804470 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.804690 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.804779 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.804994 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.805143 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.805325 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.805415 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.805649 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.805738 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.805956 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.806055 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.806266 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.806357 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.806575 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.806664 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.806884 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.806974 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.807187 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.807275 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.807491 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.807579 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.807806 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.807894 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.808108 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.808195 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.808412 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.808507 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.808714 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.808805 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.809017 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.809125 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.809341 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.809441 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.809643 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.809732 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.809944 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.810033 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.810246 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.810347 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.810544 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.810633 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.810842 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.810939 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.811142 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.811238 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.811457 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.811545 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.811756 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.811844 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.812074 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.812171 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.812379 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.812467 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.812678 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.812767 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.812978 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.813102 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.813307 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.813396 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.813645 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.813734 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.813946 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.814037 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.814266 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.814354 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.814575 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.814667 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.814883 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.814981 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.815187 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.815283 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.815492 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.815580 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.815793 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.815882 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.816099 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.816183 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.816402 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.816499 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.816709 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.816806 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.817013 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.817152 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.817342 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.817443 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.817644 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.817733 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.817953 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.818040 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.818800 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.818915 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.819121 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.819217 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.819430 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.819527 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.819735 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.819833 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.820039 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.820252 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.820341 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.820582 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.820679 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.820895 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.820986 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.821227 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.821320 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.821540 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.821646 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.821851 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.821940 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.822160 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.822255 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.822470 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.822569 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.822778 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.822874 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.823085 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.823174 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.823391 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.823490 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.823715 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.823805 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.824033 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.824122 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.824345 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.824442 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.824660 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.824750 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.824972 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.825060 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.825303 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.825393 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.825612 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.825700 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.825921 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.826008 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.826239 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.826329 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.826570 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.826757 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.826875 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.827087 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.827184 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.827401 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.827491 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.827713 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.827803 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.828028 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.828118 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.828341 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.828429 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.828654 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.828744 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.828961 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.829049 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.829291 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.829381 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.829597 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.829685 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.829907 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.829996 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.830214 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.830310 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.830533 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.830633 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.830860 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.830950 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.831174 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.831263 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.831485 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.831588 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.831797 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.831888 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.832108 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.832202 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.832424 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.832620 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.832779 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.832932 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.833110 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.833292 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.833423 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.833618 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.833758 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.833975 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.834064 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.834290 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.834393 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.834606 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.834695 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.834931 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.835021 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.835235 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.835325 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.835540 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.835629 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.835850 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.835938 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.836158 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.836248 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.836470 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.836559 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.836782 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.836876 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.837122 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.837214 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.837415 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.837512 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.837732 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.837832 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.838041 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.838130 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.838353 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.838568 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.838656 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.838913 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.839181 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.839270 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.839498 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.839587 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.839833 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.839934 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.840148 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.840236 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.840454 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.840550 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.840773 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.840871 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.841084 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.841173 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.841400 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.841489 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.841712 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.841802 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.842020 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.842109 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.842322 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.842410 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.842624 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.842713 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.842928 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.843024 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.843231 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.843326 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.843532 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.843623 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.843838 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.843927 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.844138 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.844227 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.844456 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.844545 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.844756 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.844987 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.845093 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.845369 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.845459 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.845676 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.845771 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.845976 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.846066 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.846275 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.846365 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.846585 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.846675 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.846886 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.847015 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.847195 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.847288 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.847495 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.847584 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.847801 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.847897 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.848101 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.848192 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.848407 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.848494 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.848708 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.848811 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.849012 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.849167 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.849394 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.849501 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.849689 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.849789 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.849996 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.850092 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.850294 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.850388 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.850599 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.850698 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.850905 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.850993 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.851220 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.851307 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.851526 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.851623 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.851832 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.851921 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.852143 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.852239 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.852448 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.852538 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.852752 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.852986 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.853092 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.853347 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.853449 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.853670 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.853759 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.853973 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.854061 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.854283 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.854385 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.854588 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.854678 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.854899 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.854987 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.855202 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.855299 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.855508 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.855596 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.855821 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.855909 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.856131 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.856222 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.856439 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.856534 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.856749 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.856838 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.857057 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.857177 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.857384 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.857485 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.857692 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.857782 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.857998 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.858096 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.858302 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.858391 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.858606 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.858697 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.858908 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.858999 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.859212 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.859467 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.859556 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.859802 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.859899 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.860121 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.860210 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.860444 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.860532 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.860759 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.860857 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.861068 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.861176 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.861397 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.861485 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.861720 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.861812 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.862029 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.862119 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.862336 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.862434 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.862648 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.862741 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.862956 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.863043 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.863266 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.863365 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.863571 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.863686 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.863880 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.863980 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.864187 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.864286 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.864494 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.864583 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.864801 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.864889 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.865641 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.865736 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.865953 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.866054 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.866262 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.866352 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.866574 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.866672 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.866913 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.867009 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.867229 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.867326 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.867545 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.867644 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.867861 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.867950 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.868175 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.868275 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.868486 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.868576 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.868787 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.868882 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.869101 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.869208 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.869408 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.869499 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.869713 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.869803 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.870024 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.870123 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.870328 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.870417 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.870630 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.870721 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.870931 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.871034 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.871235 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.871324 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.871536 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.871624 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.871835 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.871949 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.872134 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.872259 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.872433 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.872580 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.872738 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.872902 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.873038 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.873235 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.873365 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.873552 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.873654 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.873862 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.873953 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.874190 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.874279 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.874519 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.874616 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.874824 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.874913 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.875122 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.875211 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.875423 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.875513 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.875720 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.875810 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.876019 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.876115 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.876317 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.876414 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.876629 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.876728 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.876936 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.877038 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.877267 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.877366 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.877569 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.877659 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.877877 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.877975 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.878178 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.878269 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.878481 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.878568 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.878781 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.878878 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.879083 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.879172 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.879393 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.879482 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.879693 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.879798 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.879994 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.880084 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.880294 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.880383 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.880608 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.881247 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.881463 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.881553 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.881770 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.881859 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.882075 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.882173 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.882378 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.882514 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.882681 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.882779 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.882984 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.883074 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.883285 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.883373 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.883586 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.883674 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.883910 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.884000 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.884226 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.884318 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.884536 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.884637 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.884838 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.884933 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.885174 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.885266 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.885479 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.885579 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.885784 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.885880 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.886095 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.886184 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.886399 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.886496 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.886704 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.886793 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.887009 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.887098 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.887318 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.887417 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.887634 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.887730 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.887942 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.888030 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.888246 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.888342 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.888549 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.888638 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.888854 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.888951 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.889183 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.889276 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.889522 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.889610 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.889846 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.889934 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.890151 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.890256 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.890467 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.890556 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.890776 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.890944 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.891080 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.891175 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.891319 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 04:20:35.891405 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.891686 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.892015 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.892324 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.892633 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.892945 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.893294 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.893606 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.893920 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.894233 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.894557 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.894879 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.895184 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.895763 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.896090 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.896462 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.896775 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.897135 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.897467 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.897783 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.898094 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.898400 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:20:35.898643 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 04:20:35.950523 n-d-766726-30 devstack@n-api.service[103832]: INFO dbcounter [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Registered counter for database nova_api May 19 04:20:35.957624 n-d-766726-30 devstack@n-api.service[103833]: INFO dbcounter [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Registered counter for database nova_api May 19 04:20:35.970373 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_db.sqlalchemy.engines [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:20:35.977302 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writer thread running {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:20:35.977938 n-d-766726-30 devstack@n-api.service[103833]: DEBUG oslo_db.sqlalchemy.engines [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:20:35.984262 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writer thread running {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:20:36.036421 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.context [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) {{(pid=103832) load_cells /opt/stack/nova/nova/context.py:464}} May 19 04:20:36.042431 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:20:36.044001 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:20:36.044460 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.context [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) {{(pid=103833) load_cells /opt/stack/nova/nova/context.py:464}} May 19 04:20:36.044790 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:20:36.046763 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:20:36.048715 n-d-766726-30 devstack@n-api.service[103832]: INFO dbcounter [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Registered counter for database nova_cell0 May 19 04:20:36.049948 n-d-766726-30 devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:20:36.051545 n-d-766726-30 devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:20:36.052355 n-d-766726-30 devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:20:36.053376 n-d-766726-30 devstack@n-api.service[103832]: INFO dbcounter [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Registered counter for database nova_cell1 May 19 04:20:36.054959 n-d-766726-30 devstack@n-api.service[103833]: DEBUG oslo_concurrency.lockutils [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:20:36.056923 n-d-766726-30 devstack@n-api.service[103833]: INFO dbcounter [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Registered counter for database nova_cell0 May 19 04:20:36.060474 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_db.sqlalchemy.engines [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:20:36.061162 n-d-766726-30 devstack@n-api.service[103833]: INFO dbcounter [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Registered counter for database nova_cell1 May 19 04:20:36.061793 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_db.sqlalchemy.engines [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:20:36.067229 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writer thread running {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:20:36.067869 n-d-766726-30 devstack@n-api.service[103833]: DEBUG oslo_db.sqlalchemy.engines [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:20:36.069930 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writer thread running {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:20:36.071871 n-d-766726-30 devstack@n-api.service[103833]: DEBUG oslo_db.sqlalchemy.engines [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:20:36.073685 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writer thread running {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:20:36.211905 n-d-766726-30 devstack@n-api.service[103832]: INFO dbcounter [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Registered counter for database nova_cell0 May 19 04:20:36.213881 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writer thread running {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:20:36.220564 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_db.sqlalchemy.engines [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:20:36.222571 n-d-766726-30 devstack@n-api.service[103833]: INFO dbcounter [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Registered counter for database nova_cell0 May 19 04:20:36.225377 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writer thread running {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:20:36.231647 n-d-766726-30 devstack@n-api.service[103833]: DEBUG oslo_db.sqlalchemy.engines [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:20:36.235802 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writer thread running {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:20:36.557960 n-d-766726-30 devstack@n-api.service[103832]: WARNING keystonemiddleware.auth_token [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 04:20:36.565228 n-d-766726-30 devstack@n-api.service[103832]: WARNING keystonemiddleware.auth_token [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 04:20:36.566609 n-d-766726-30 devstack@n-api.service[103833]: WARNING keystonemiddleware.auth_token [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 04:20:36.574634 n-d-766726-30 devstack@n-api.service[103833]: WARNING keystonemiddleware.auth_token [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 04:20:36.905810 n-d-766726-30 devstack@n-api.service[103832]: WARNING keystonemiddleware.auth_token [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 04:20:36.911912 n-d-766726-30 devstack@n-api.service[103832]: WARNING keystonemiddleware.auth_token [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 04:20:36.917215 n-d-766726-30 devstack@n-api.service[103832]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561467f7f9c0 pid: 103832 (default app) May 19 04:20:36.918878 n-d-766726-30 devstack@n-api.service[103833]: WARNING keystonemiddleware.auth_token [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 04:20:36.919246 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:20:36.920399 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001685 May 19 04:20:36.920809 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Thu May 19 04:20:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:20:36.925015 n-d-766726-30 devstack@n-api.service[103833]: WARNING keystonemiddleware.auth_token [None req-71a5639a-ffe7-4454-b077-7f5f8419b8b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 04:20:36.930397 n-d-766726-30 devstack@n-api.service[103833]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561467f7f9c0 pid: 103833 (default app) May 19 04:21:54.604343 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:21:54.605539 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 May 19 04:21:54.606038 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:21:54.622075 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_api:SELECT=3 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:21:54.624578 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_cell0:SELECT=3 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:21:54.626136 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_cell1:SELECT=3 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:21:54.628224 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:21:55.059160 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-2afc1943-97d5-406a-a87a-553bd605bf33 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:21:55.088493 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-2afc1943-97d5-406a-a87a-553bd605bf33 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.474772 May 19 04:21:55.099358 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 19 04:21:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:21:57.355727 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:21:57.356718 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-0f78c24d-dbd3-401b-bd9c-e785f6d082da None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 19 04:21:57.357425 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:21:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:21:57.419134 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-b268abe1-266f-48ff-bd7c-a215c21a582e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "swap": 0, "name": "cirros256", "disk": 1, "vcpus": 1}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:21:57.437397 n-d-766726-30 devstack@n-api.service[103833]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:21:57.437397 n-d-766726-30 devstack@n-api.service[103833]: warnings.warn(msg) May 19 04:21:57.466708 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-b268abe1-266f-48ff-bd7c-a215c21a582e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103434 May 19 04:21:57.467573 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:21:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:21:57.685215 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-a3e59aca-de2e-4300-bfb6-eca13f982d0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:21:57.687628 n-d-766726-30 devstack@n-api.service[103832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:21:57.687628 n-d-766726-30 devstack@n-api.service[103832]: warnings.warn(msg) May 19 04:21:57.690296 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_api:SELECT=3 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:21:57.691092 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_cell1:SELECT=3 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:21:57.692259 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_cell0:SELECT=3 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:21:57.693017 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:21:57.756638 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-a3e59aca-de2e-4300-bfb6-eca13f982d0a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280614 May 19 04:21:57.757246 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 19 04:21:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:22:00.019888 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-b268abe1-266f-48ff-bd7c-a215c21a582e admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:00.021408 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-b268abe1-266f-48ff-bd7c-a215c21a582e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 May 19 04:22:00.021807 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:00.152900 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-da79c87a-3bb0-4e8a-8cc1-ee9f59c2e4b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "ds512M"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:00.171104 n-d-766726-30 devstack@n-api.service[103832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:22:00.171104 n-d-766726-30 devstack@n-api.service[103832]: warnings.warn(msg) May 19 04:22:00.189998 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-da79c87a-3bb0-4e8a-8cc1-ee9f59c2e4b3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.162406 May 19 04:22:00.190548 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:22:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:22:00.202426 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-bf8f0f47-8169-481e-a529-aa520ebae683 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:00.203917 n-d-766726-30 devstack@n-api.service[103833]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:22:00.203917 n-d-766726-30 devstack@n-api.service[103833]: warnings.warn(msg) May 19 04:22:00.236638 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-bf8f0f47-8169-481e-a529-aa520ebae683 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037845 May 19 04:22:00.237159 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 19 04:22:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:22:02.612024 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-da79c87a-3bb0-4e8a-8cc1-ee9f59c2e4b3 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:02.613271 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-da79c87a-3bb0-4e8a-8cc1-ee9f59c2e4b3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 May 19 04:22:02.613972 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:22:02.686532 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-7a3f4974-e2af-4e9c-8926-473f0e59bc11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "name": "ds1G", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:02.713294 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-7a3f4974-e2af-4e9c-8926-473f0e59bc11 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.092018 May 19 04:22:02.717367 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:22:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:22:02.728183 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-5aa6eed2-46a9-4d33-ad93-83c3c6d874d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:02.756782 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-5aa6eed2-46a9-4d33-ad93-83c3c6d874d7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033702 May 19 04:22:02.765430 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 19 04:22:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:22:05.225652 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-7a3f4974-e2af-4e9c-8926-473f0e59bc11 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:05.226688 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-7a3f4974-e2af-4e9c-8926-473f0e59bc11 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 19 04:22:05.227228 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:05.290433 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-4c164e57-5891-422e-9364-87dc12d8d53c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "ram": 2048, "swap": 0}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:05.315513 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-4c164e57-5891-422e-9364-87dc12d8d53c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081857 May 19 04:22:05.316760 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:22:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:22:05.328702 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-389179ec-cb55-4427-8931-15db453d1a0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:05.379888 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-389179ec-cb55-4427-8931-15db453d1a0b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054888 May 19 04:22:05.380898 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 19 04:22:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:22:07.730714 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-4c164e57-5891-422e-9364-87dc12d8d53c admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:07.731727 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-4c164e57-5891-422e-9364-87dc12d8d53c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 19 04:22:07.732389 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:07.792898 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-0f867ef9-b1cf-4f54-bc97-0f76ce95e798 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "swap": 0}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:07.813196 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-0f867ef9-b1cf-4f54-bc97-0f76ce95e798 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074912 May 19 04:22:07.814147 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:22:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:22:07.825447 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-dd5d2d3f-fe34-470e-9185-7309db95a2d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:07.850340 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-dd5d2d3f-fe34-470e-9185-7309db95a2d4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028451 May 19 04:22:07.851043 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 19 04:22:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:22:10.190698 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-0f867ef9-b1cf-4f54-bc97-0f76ce95e798 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:10.191986 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-0f867ef9-b1cf-4f54-bc97-0f76ce95e798 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001759 May 19 04:22:10.193013 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:10.257523 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-f9cc2566-08a5-40c3-bd8a-bc16c48d96a3 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:10.280525 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-f9cc2566-08a5-40c3-bd8a-bc16c48d96a3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080930 May 19 04:22:10.289275 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 19 04:22:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:22:12.681923 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-0f867ef9-b1cf-4f54-bc97-0f76ce95e798 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:12.683541 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-0f867ef9-b1cf-4f54-bc97-0f76ce95e798 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 May 19 04:22:12.684421 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:12.746144 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-9629b8f6-36c4-4c54-b8c9-d4129261c414 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:12.767138 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-9629b8f6-36c4-4c54-b8c9-d4129261c414 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077112 May 19 04:22:12.778323 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:22:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:22:12.781463 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-100d54b5-1f07-4573-8900-43f9cfc50667 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:12.811649 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-100d54b5-1f07-4573-8900-43f9cfc50667 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034580 May 19 04:22:12.825172 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 19 04:22:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:22:15.162057 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-9629b8f6-36c4-4c54-b8c9-d4129261c414 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:15.163698 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-9629b8f6-36c4-4c54-b8c9-d4129261c414 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002697 May 19 04:22:15.174264 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:15.233396 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-e0fb18bd-a508-40e2-837a-5421329457b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "disk": 20, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:15.259324 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-e0fb18bd-a508-40e2-837a-5421329457b2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088831 May 19 04:22:15.260502 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:22:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:22:15.273168 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-0317bb11-757b-488d-b49d-177736418c5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:15.302322 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-0317bb11-757b-488d-b49d-177736418c5c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032703 May 19 04:22:15.318234 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 19 04:22:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:22:17.778242 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-e0fb18bd-a508-40e2-837a-5421329457b2 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:17.779451 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-e0fb18bd-a508-40e2-837a-5421329457b2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001846 May 19 04:22:17.780190 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:17.844784 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-a51b53ec-8b37-4c55-b107-e3042e1eb5ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:17.865557 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-a51b53ec-8b37-4c55-b107-e3042e1eb5ea admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079427 May 19 04:22:17.867180 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:22:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:22:17.879098 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-529bef7b-c603-4e4a-b736-428d86c7c894 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:17.904981 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-529bef7b-c603-4e4a-b736-428d86c7c894 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029670 May 19 04:22:17.905544 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 19 04:22:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:22:20.182087 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-a51b53ec-8b37-4c55-b107-e3042e1eb5ea admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:20.183110 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-a51b53ec-8b37-4c55-b107-e3042e1eb5ea admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 19 04:22:20.183576 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:20.243200 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-f567065a-7139-4bab-97b9-4ff85ef0be19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "disk": 80, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:20.263065 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-f567065a-7139-4bab-97b9-4ff85ef0be19 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073636 May 19 04:22:20.263624 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:22:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:22:20.275359 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-c8bb8433-cfe1-4545-a9ed-fd72d6926d6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:20.306572 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-c8bb8433-cfe1-4545-a9ed-fd72d6926d6a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034500 May 19 04:22:20.307845 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 19 04:22:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:22:22.662785 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-f567065a-7139-4bab-97b9-4ff85ef0be19 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:22.663776 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-f567065a-7139-4bab-97b9-4ff85ef0be19 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 19 04:22:22.664163 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:22.720657 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-070299b6-ccfb-48ee-90ee-870d2822d574 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:22.737756 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-070299b6-ccfb-48ee-90ee-870d2822d574 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.067953 May 19 04:22:22.738296 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 19 04:22:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:22:22.749991 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-c2bfed2b-b35f-4046-aea1-d217b0108f5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:22.772902 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-c2bfed2b-b35f-4046-aea1-d217b0108f5e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026663 May 19 04:22:22.773493 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 19 04:22:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:22:52.128836 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-070299b6-ccfb-48ee-90ee-870d2822d574 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:52.129862 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-070299b6-ccfb-48ee-90ee-870d2822d574 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 19 04:22:52.130253 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:22:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:52.140717 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:22:52.189405 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-60b36100-b606-41c0-8aa6-79657a137c21 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:52.205871 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-60b36100-b606-41c0-8aa6-79657a137c21 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069645 May 19 04:22:52.206394 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 19 04:22:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:22:53.218094 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-070299b6-ccfb-48ee-90ee-870d2822d574 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:53.219093 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-070299b6-ccfb-48ee-90ee-870d2822d574 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 19 04:22:53.219491 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:22:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:53.421265 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-0fd68054-e770-4295-b0c3-432a789bd5fe admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:53.427547 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.wsgi [None req-0fd68054-e770-4295-b0c3-432a789bd5fe admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-0fd68054-e770-4295-b0c3-432a789bd5fe admin admin] Request method failure captured: May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: Accept: application/json May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: Accept-Encoding: gzip, deflate May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: Connection: keep-alive May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: Content-Length: 0 May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: Host: 10.222.0.58 May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: Openstack-Api-Version: compute 2.90 May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: Openstack-System-Scope: None May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: User-Agent: python-novaclient May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Auth-Token: gAAAAABihcYdeOWg1OH-caM-AkN6gDemsbWPt1UcukaYvFdCkHiklHld2cUuO1okGJ-ERCc0eqlTO3LYFS6ozcRQTCQrySMNk-VoSfk9D6IPSqJMmnHUzxzFD7aM0smr1F7c8pJscvROTgJkHsNPkvv_eOK1mQSS7xv5mJprtF-Ikt7k9PLNUlg May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Domain-Id: None May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Domain-Name: None May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Identity-Status: Confirmed May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Is-Admin-Project: True May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Openstack-Nova-Api-Version: 2.90 May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Domain-Id: default May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Domain-Name: Default May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Name: admin May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Role: reader,member,admin May 19 04:22:53.430946 n-d-766726-30 devstack@n-api.service[103833]: X-Roles: reader,member,admin May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_350678a25a304c5fa64149df6a0babdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: X-Tenant: admin May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: X-Tenant-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: X-Tenant-Name: admin May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: X-User: admin May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: X-User-Domain-Id: default May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: X-User-Domain-Name: Default May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: X-User-Id: e5e49be21336450790d50481f8a7a54a May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: X-User-Name: admin May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: method: > May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: exception: Flavor 42 could not be found. May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: action_args: {'id': '42'} May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:22:53.432572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:53.433701 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:53.435244 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-0fd68054-e770-4295-b0c3-432a789bd5fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:22:53.436538 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-0fd68054-e770-4295-b0c3-432a789bd5fe admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061687 May 19 04:22:53.436538 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:22:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 04:22:53.441823 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-fb34332f-3ef9-455d-9632-f2333e2ad8de admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:53.444663 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:22:53.463766 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-fb34332f-3ef9-455d-9632-f2333e2ad8de admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025530 May 19 04:22:53.464294 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 19 04:22:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:22:53.483921 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-d6215297-06d3-4e63-af82-ea21b1a4e239 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:53.505430 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-d6215297-06d3-4e63-af82-ea21b1a4e239 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025060 May 19 04:22:53.505952 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 19 04:22:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:22:53.515055 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-b7d284d6-86db-4d07-94a1-ee1713cd9722 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:53.521570 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.wsgi [None req-b7d284d6-86db-4d07-94a1-ee1713cd9722 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-b7d284d6-86db-4d07-94a1-ee1713cd9722 admin admin] Request method failure captured: May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: Accept: application/json May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: Accept-Encoding: gzip, deflate May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: Connection: keep-alive May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: Content-Length: 0 May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: Host: 10.222.0.58 May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: Openstack-Api-Version: compute 2.90 May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: Openstack-System-Scope: None May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: User-Agent: python-novaclient May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Auth-Token: gAAAAABihcYdeOWg1OH-caM-AkN6gDemsbWPt1UcukaYvFdCkHiklHld2cUuO1okGJ-ERCc0eqlTO3LYFS6ozcRQTCQrySMNk-VoSfk9D6IPSqJMmnHUzxzFD7aM0smr1F7c8pJscvROTgJkHsNPkvv_eOK1mQSS7xv5mJprtF-Ikt7k9PLNUlg May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Domain-Id: None May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Domain-Name: None May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Identity-Status: Confirmed May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Is-Admin-Project: True May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Openstack-Nova-Api-Version: 2.90 May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Domain-Id: default May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Domain-Name: Default May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Name: admin May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Role: reader,member,admin May 19 04:22:53.524816 n-d-766726-30 devstack@n-api.service[103832]: X-Roles: reader,member,admin May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_350678a25a304c5fa64149df6a0babdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: X-Tenant: admin May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: X-Tenant-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: X-Tenant-Name: admin May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: X-User: admin May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: X-User-Domain-Id: default May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: X-User-Domain-Name: Default May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: X-User-Id: e5e49be21336450790d50481f8a7a54a May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: X-User-Name: admin May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: method: > May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: exception: Flavor 42 could not be found. May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: action_args: {'id': '42'} May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:22:53.526463 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:53.527423 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:53.528779 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-b7d284d6-86db-4d07-94a1-ee1713cd9722 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:22:53.530108 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-b7d284d6-86db-4d07-94a1-ee1713cd9722 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014710 May 19 04:22:53.530108 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:22:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 04:22:54.409616 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-d6215297-06d3-4e63-af82-ea21b1a4e239 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:54.410762 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-d6215297-06d3-4e63-af82-ea21b1a4e239 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 May 19 04:22:54.411179 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:54.601333 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-dd0baa09-250b-434c-8cf0-6c6dd9801614 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:54.607166 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.wsgi [None req-dd0baa09-250b-434c-8cf0-6c6dd9801614 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-dd0baa09-250b-434c-8cf0-6c6dd9801614 admin admin] Request method failure captured: May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: Accept: application/json May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: Accept-Encoding: gzip, deflate May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: Connection: keep-alive May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: Content-Length: 0 May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: Host: 10.222.0.58 May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: Openstack-Api-Version: compute 2.90 May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: Openstack-System-Scope: None May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: User-Agent: python-novaclient May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Auth-Token: gAAAAABihcYeNf76PeJlBwv22g4ER10LfisNOqfabWCbd5V__GH6oA04MGabz2efS0-zJ2Zk5rF84Lu-ORu0xi9Yg52RS9ivvoIpHTgrNdDNYLjOYQZnvn7bNlPvtryhk5RtjpP247DOxgNSaTmuUOLhfhp4dlGc5-0bWlDil79x2QImkZIjD0o May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Domain-Id: None May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Domain-Name: None May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Identity-Status: Confirmed May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Is-Admin-Project: True May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Openstack-Nova-Api-Version: 2.90 May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Domain-Id: default May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Domain-Name: Default May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Name: admin May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Role: reader,member,admin May 19 04:22:54.608676 n-d-766726-30 devstack@n-api.service[103832]: X-Roles: reader,member,admin May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_350678a25a304c5fa64149df6a0babdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: X-Tenant: admin May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: X-Tenant-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: X-Tenant-Name: admin May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: X-User: admin May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: X-User-Domain-Id: default May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: X-User-Domain-Name: Default May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: X-User-Id: e5e49be21336450790d50481f8a7a54a May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: X-User-Name: admin May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: method: > May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: exception: Flavor 84 could not be found. May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: action_args: {'id': '84'} May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:22:54.610247 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:54.611394 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:54.614581 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-dd0baa09-250b-434c-8cf0-6c6dd9801614 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:22:54.617756 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-dd0baa09-250b-434c-8cf0-6c6dd9801614 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063035 May 19 04:22:54.617756 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:22:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 04:22:54.620856 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-a435b53e-6cc2-4505-94f3-7aa07651a503 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:54.634571 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-a435b53e-6cc2-4505-94f3-7aa07651a503 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017735 May 19 04:22:54.635103 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 19 04:22:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:22:54.644390 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-c471fcd0-47e4-4407-83de-0062da195c49 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:54.658076 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-c471fcd0-47e4-4407-83de-0062da195c49 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017180 May 19 04:22:54.658618 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 19 04:22:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:22:54.667432 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1c02d910-7825-434b-8d30-86eed261d9ad admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:54.672779 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.wsgi [None req-1c02d910-7825-434b-8d30-86eed261d9ad admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1c02d910-7825-434b-8d30-86eed261d9ad admin admin] Request method failure captured: May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: Accept: application/json May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: Accept-Encoding: gzip, deflate May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: Connection: keep-alive May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: Content-Length: 0 May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: Host: 10.222.0.58 May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: Openstack-Api-Version: compute 2.90 May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: Openstack-System-Scope: None May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: User-Agent: python-novaclient May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Auth-Token: gAAAAABihcYeNf76PeJlBwv22g4ER10LfisNOqfabWCbd5V__GH6oA04MGabz2efS0-zJ2Zk5rF84Lu-ORu0xi9Yg52RS9ivvoIpHTgrNdDNYLjOYQZnvn7bNlPvtryhk5RtjpP247DOxgNSaTmuUOLhfhp4dlGc5-0bWlDil79x2QImkZIjD0o May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Domain-Id: None May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Domain-Name: None May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Identity-Status: Confirmed May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Is-Admin-Project: True May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Openstack-Nova-Api-Version: 2.90 May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Domain-Id: default May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Domain-Name: Default May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Name: admin May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Role: reader,member,admin May 19 04:22:54.674305 n-d-766726-30 devstack@n-api.service[103833]: X-Roles: reader,member,admin May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_350678a25a304c5fa64149df6a0babdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: X-Tenant: admin May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: X-Tenant-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: X-Tenant-Name: admin May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: X-User: admin May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: X-User-Domain-Id: default May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: X-User-Domain-Name: Default May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: X-User-Id: e5e49be21336450790d50481f8a7a54a May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: X-User-Name: admin May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: method: > May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: exception: Flavor 84 could not be found. May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: action_args: {'id': '84'} May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:22:54.676413 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:54.677293 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:54.678572 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1c02d910-7825-434b-8d30-86eed261d9ad admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:22:54.679912 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1c02d910-7825-434b-8d30-86eed261d9ad admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011724 May 19 04:22:54.679912 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:22:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 19 04:22:55.562207 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-c471fcd0-47e4-4407-83de-0062da195c49 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:55.563197 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-c471fcd0-47e4-4407-83de-0062da195c49 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 19 04:22:55.563598 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:22:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:55.751222 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-817ecee9-ef27-4709-bfc5-b0ce23f67be0 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:55.758882 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.wsgi [None req-817ecee9-ef27-4709-bfc5-b0ce23f67be0 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-817ecee9-ef27-4709-bfc5-b0ce23f67be0 admin admin] Request method failure captured: May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: Accept: application/json May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: Accept-Encoding: gzip, deflate May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: Connection: keep-alive May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: Content-Length: 0 May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: Host: 10.222.0.58 May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: Openstack-Api-Version: compute 2.90 May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: Openstack-System-Scope: None May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: User-Agent: python-novaclient May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Auth-Token: gAAAAABihcYfqkxzSPiRpngyN6-YWPLdJ_vG6wtI2PqriOvhuADwd0msXz4eEi8-9vyiuHagznRgsKZHUBiY6IR7R7-4gOyhltUR1fx840_4jef15DIhD43e9WhFSuxTUfO7mDJwdnA-cTVJAnf25VKtIIR8wu6-Vf4cjfXEeEriotWLVSozQpk May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Domain-Id: None May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Domain-Name: None May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Identity-Status: Confirmed May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Is-Admin-Project: True May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Openstack-Nova-Api-Version: 2.90 May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Domain-Id: default May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Domain-Name: Default May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Project-Name: admin May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Role: reader,member,admin May 19 04:22:55.760369 n-d-766726-30 devstack@n-api.service[103833]: X-Roles: reader,member,admin May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_350678a25a304c5fa64149df6a0babdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: X-Tenant: admin May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: X-Tenant-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: X-Tenant-Name: admin May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: X-User: admin May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: X-User-Domain-Id: default May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: X-User-Domain-Name: Default May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: X-User-Id: e5e49be21336450790d50481f8a7a54a May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: X-User-Name: admin May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: method: > May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: exception: Flavor 451 could not be found. May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: action_args: {'id': '451'} May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:22:55.761957 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:55.762824 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: ERROR nova.api.openstack.wsgi May 19 04:22:55.763946 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-817ecee9-ef27-4709-bfc5-b0ce23f67be0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:22:55.764998 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-817ecee9-ef27-4709-bfc5-b0ce23f67be0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060378 May 19 04:22:55.764998 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:22:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 04:22:55.772138 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-a7c47b28-1e3a-4f99-9ffe-ca3ed37f1705 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:55.785538 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-a7c47b28-1e3a-4f99-9ffe-ca3ed37f1705 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017865 May 19 04:22:55.786070 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 19 04:22:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:22:55.795119 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:55.808457 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016762 May 19 04:22:55.809006 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 19 04:22:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:22:55.818206 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-48ca3e39-3f01-470d-9e1e-51edb2b39648 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:55.823416 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.wsgi [None req-48ca3e39-3f01-470d-9e1e-51edb2b39648 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-48ca3e39-3f01-470d-9e1e-51edb2b39648 admin admin] Request method failure captured: May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: Accept: application/json May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: Accept-Encoding: gzip, deflate May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: Connection: keep-alive May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: Content-Length: 0 May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: Host: 10.222.0.58 May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: Openstack-Api-Version: compute 2.90 May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: Openstack-System-Scope: None May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: User-Agent: python-novaclient May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Auth-Token: gAAAAABihcYfqkxzSPiRpngyN6-YWPLdJ_vG6wtI2PqriOvhuADwd0msXz4eEi8-9vyiuHagznRgsKZHUBiY6IR7R7-4gOyhltUR1fx840_4jef15DIhD43e9WhFSuxTUfO7mDJwdnA-cTVJAnf25VKtIIR8wu6-Vf4cjfXEeEriotWLVSozQpk May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Domain-Id: None May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Domain-Name: None May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Identity-Status: Confirmed May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Is-Admin-Project: True May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Openstack-Nova-Api-Version: 2.90 May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Domain-Id: default May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Domain-Name: Default May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Project-Name: admin May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Role: reader,member,admin May 19 04:22:55.824898 n-d-766726-30 devstack@n-api.service[103832]: X-Roles: reader,member,admin May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/350678a25a304c5fa64149df6a0babdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_350678a25a304c5fa64149df6a0babdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: X-Tenant: admin May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: X-Tenant-Id: 350678a25a304c5fa64149df6a0babdd May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: X-Tenant-Name: admin May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: X-User: admin May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: X-User-Domain-Id: default May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: X-User-Domain-Name: Default May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: X-User-Id: e5e49be21336450790d50481f8a7a54a May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: X-User-Name: admin May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: method: > May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: exception: Flavor 451 could not be found. May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: action_args: {'id': '451'} May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:22:55.826315 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:55.827128 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: ERROR nova.api.openstack.wsgi May 19 04:22:55.828842 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-48ca3e39-3f01-470d-9e1e-51edb2b39648 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:22:55.830133 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-48ca3e39-3f01-470d-9e1e-51edb2b39648 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011992 May 19 04:22:55.830133 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:22:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 04:22:56.711358 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:56.712364 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 19 04:22:56.712748 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:56.900281 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-faf5b6af-d9d5-4f03-80b2-c551bea6118e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:56.918959 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-faf5b6af-d9d5-4f03-80b2-c551bea6118e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069366 May 19 04:22:56.919496 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Thu May 19 04:22:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:22:57.799470 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:57.800496 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 19 04:22:57.800891 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:22:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:57.992175 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-f024c660-9efa-4eae-8763-a448f23c4ed7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:58.019969 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-f024c660-9efa-4eae-8763-a448f23c4ed7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.078407 May 19 04:22:58.020792 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Thu May 19 04:22:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:22:58.917740 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:22:58.918757 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 19 04:22:58.919143 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:22:59.111342 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-3e889f8a-cb5c-460a-99bc-f82553e68576 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:22:59.129120 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-3e889f8a-cb5c-460a-99bc-f82553e68576 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068829 May 19 04:22:59.129595 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Thu May 19 04:22:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:23:00.008748 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:23:00.009772 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 19 04:23:00.010165 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:23:00.198139 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-24c90905-60ac-44cd-9af4-c009afab99c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:23:00.215377 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-24c90905-60ac-44cd-9af4-c009afab99c6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068071 May 19 04:23:00.215910 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Thu May 19 04:23:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:23:01.119309 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:23:01.120336 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 19 04:23:01.120726 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:23:01.305940 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-2e0d893f-d2a3-4770-801c-d2f7bb4ae3d9 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:23:01.325099 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-2e0d893f-d2a3-4770-801c-d2f7bb4ae3d9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068994 May 19 04:23:01.325648 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Thu May 19 04:23:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:24:03.232838 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:24:03.233861 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1414dd9c-e5c8-47ed-a259-7ab8068f0012 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 19 04:24:03.234252 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 19 04:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:24:03.241875 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:24:03.299565 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-a3884174-c7b2-4a7a-a2e8-11fe75e95dbd admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:24:03.318929 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-a3884174-c7b2-4a7a-a2e8-11fe75e95dbd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078475 May 19 04:24:03.319452 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 19 04:24:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:24:03.339667 n-d-766726-30 devstack@n-api.service[103833]: DEBUG dbcounter [-] [103833] Writing DB stats nova_api:SELECT=14 {{(pid=103833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:24:03.343665 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-e1e6a834-8f89-498f-a127-f3dd939e3bae admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:24:03.351956 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-e1e6a834-8f89-498f-a127-f3dd939e3bae admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013711 May 19 04:24:03.352467 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1282 bytes} [Thu May 19 04:24:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:24:03.363555 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-b81bcd28-41a3-4ff0-9a1c-6baee1798bf3 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:24:03.371044 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-b81bcd28-41a3-4ff0-9a1c-6baee1798bf3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011088 May 19 04:24:03.371542 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1285 bytes} [Thu May 19 04:24:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:24:03.381996 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1549a4fd-9280-46ff-a0bd-f9bd00434512 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:24:03.389284 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1549a4fd-9280-46ff-a0bd-f9bd00434512 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010659 May 19 04:24:03.389769 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1285 bytes} [Thu May 19 04:24:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:24:03.401223 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-db025b98-a78a-4b2d-bd68-65e04e9d4b33 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:24:03.408548 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-db025b98-a78a-4b2d-bd68-65e04e9d4b33 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010864 May 19 04:24:03.409052 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1282 bytes} [Thu May 19 04:24:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:29:44.833964 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1549a4fd-9280-46ff-a0bd-f9bd00434512 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:29:44.834968 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1549a4fd-9280-46ff-a0bd-f9bd00434512 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 19 04:29:44.835360 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:29:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:29:44.989512 n-d-766726-30 devstack@n-api.service[103832]: DEBUG dbcounter [-] [103832] Writing DB stats nova_api:SELECT=6 {{(pid=103832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:29:45.100922 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-66cea2f6-e18e-4805-b550-2d24707fa761 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:29:45.102114 n-d-766726-30 devstack@n-api.service[103832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:29:45.102114 n-d-766726-30 devstack@n-api.service[103832]: warnings.warn(msg) May 19 04:29:45.103323 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-66cea2f6-e18e-4805-b550-2d24707fa761 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:29:45.103755 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-66cea2f6-e18e-4805-b550-2d24707fa761 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:29:45.104528 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-66cea2f6-e18e-4805-b550-2d24707fa761 admin admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:29:45.104954 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-66cea2f6-e18e-4805-b550-2d24707fa761 admin admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:29:45.145471 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-66cea2f6-e18e-4805-b550-2d24707fa761 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.157592 May 19 04:29:45.146024 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:29:44 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:29:46.045322 n-d-766726-30 devstack@n-api.service[103833]: DEBUG nova.api.openstack.wsgi [None req-1549a4fd-9280-46ff-a0bd-f9bd00434512 admin admin] Calling method '>' {{(pid=103833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:29:46.046346 n-d-766726-30 devstack@n-api.service[103833]: INFO nova.api.openstack.requestlog [None req-1549a4fd-9280-46ff-a0bd-f9bd00434512 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 19 04:29:46.046739 n-d-766726-30 devstack@n-api.service[103833]: [pid: 103833|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 19 04:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:29:46.245139 n-d-766726-30 devstack@n-api.service[103832]: DEBUG nova.api.openstack.wsgi [None req-b58c370e-968a-4017-864d-34eed3c60cd8 admin admin] Calling method '>' {{(pid=103832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:29:46.246306 n-d-766726-30 devstack@n-api.service[103832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:29:46.246306 n-d-766726-30 devstack@n-api.service[103832]: warnings.warn(msg) May 19 04:29:46.247490 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-b58c370e-968a-4017-864d-34eed3c60cd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:29:46.247933 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-b58c370e-968a-4017-864d-34eed3c60cd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:29:46.248717 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-b58c370e-968a-4017-864d-34eed3c60cd8 admin admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:29:46.249176 n-d-766726-30 devstack@n-api.service[103832]: DEBUG oslo_concurrency.lockutils [None req-b58c370e-968a-4017-864d-34eed3c60cd8 admin admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:29:46.272501 n-d-766726-30 devstack@n-api.service[103832]: INFO nova.api.openstack.requestlog [None req-b58c370e-968a-4017-864d-34eed3c60cd8 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.078531 May 19 04:29:46.272979 n-d-766726-30 devstack@n-api.service[103832]: [pid: 103832|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:29:46 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:30:34.364045 n-d-766726-30 systemd[1]: Stopping Devstack devstack@n-api.service... May 19 04:30:34.364996 n-d-766726-30 devstack@n-api.service[103831]: Thu May 19 04:30:34 2022 - graceful shutdown triggered... May 19 04:30:34.365543 n-d-766726-30 devstack@n-api.service[103832]: Gracefully killing worker 1 (pid: 103832)... May 19 04:30:34.365921 n-d-766726-30 devstack@n-api.service[103833]: Gracefully killing worker 2 (pid: 103833)... May 19 04:30:35.365186 n-d-766726-30 devstack@n-api.service[103831]: worker 1 buried after 1 seconds May 19 04:30:35.365186 n-d-766726-30 devstack@n-api.service[103831]: worker 2 buried after 1 seconds May 19 04:30:35.365186 n-d-766726-30 devstack@n-api.service[103831]: goodbye to uWSGI. May 19 04:30:35.366635 n-d-766726-30 systemd[1]: devstack@n-api.service: Succeeded. May 19 04:30:35.367189 n-d-766726-30 systemd[1]: Stopped Devstack devstack@n-api.service. May 19 04:30:35.369963 n-d-766726-30 systemd[1]: Starting Devstack devstack@n-api.service... May 19 04:30:35.385169 n-d-766726-30 devstack@n-api.service[124751]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 04:30:35 2022] *** May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: nodename: n-d-766726-30 May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: machine: x86_64 May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: clock source: unix May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: pcre jit disabled May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: detected number of CPU cores: 4 May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: current working directory: / May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: detected binary path: /usr/bin/uwsgi-core May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: your processes number limit is 47680 May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: your memory page size is 4096 bytes May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: detected max file descriptor number: 2048 May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: lock engine: pthread robust mutexes May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: thunder lock: enabled May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 04:30:35.402555 n-d-766726-30 devstack@n-api.service[124751]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 04:30:35.453370 n-d-766726-30 devstack@n-api.service[124751]: Python main interpreter initialized at 0x55caa849b9c0 May 19 04:30:35.453370 n-d-766726-30 devstack@n-api.service[124751]: python threads support enabled May 19 04:30:35.453370 n-d-766726-30 devstack@n-api.service[124751]: your server socket listen backlog is limited to 100 connections May 19 04:30:35.453370 n-d-766726-30 devstack@n-api.service[124751]: your mercy for graceful operations on workers is 90 seconds May 19 04:30:35.453831 n-d-766726-30 devstack@n-api.service[124751]: mapped 403077 bytes (393 KB) for 2 cores May 19 04:30:35.453831 n-d-766726-30 devstack@n-api.service[124751]: *** Operational MODE: preforking *** May 19 04:30:35.454135 n-d-766726-30 devstack@n-api.service[124751]: *** uWSGI is running in multiple interpreter mode *** May 19 04:30:35.454135 n-d-766726-30 devstack@n-api.service[124751]: spawned uWSGI master process (pid: 124751) May 19 04:30:35.454339 n-d-766726-30 systemd[1]: Started Devstack devstack@n-api.service. May 19 04:30:35.457765 n-d-766726-30 devstack@n-api.service[124751]: spawned uWSGI worker 1 (pid: 124818, cores: 1) May 19 04:30:35.457765 n-d-766726-30 devstack@n-api.service[124751]: spawned uWSGI worker 2 (pid: 124819, cores: 1) May 19 04:30:35.457765 n-d-766726-30 devstack@n-api.service[124751]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 04:30:36.730917 n-d-766726-30 devstack@n-api.service[124819]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 04:30:36.737589 n-d-766726-30 devstack@n-api.service[124818]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 04:30:37.568650 n-d-766726-30 devstack@n-api.service[124818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 04:30:37.568650 n-d-766726-30 devstack@n-api.service[124818]: from cryptography.utils import int_from_bytes May 19 04:30:37.569166 n-d-766726-30 devstack@n-api.service[124818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 04:30:37.569166 n-d-766726-30 devstack@n-api.service[124818]: from cryptography.utils import int_from_bytes May 19 04:30:37.611454 n-d-766726-30 devstack@n-api.service[124819]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 04:30:37.611454 n-d-766726-30 devstack@n-api.service[124819]: from cryptography.utils import int_from_bytes May 19 04:30:37.611844 n-d-766726-30 devstack@n-api.service[124819]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 04:30:37.611844 n-d-766726-30 devstack@n-api.service[124819]: from cryptography.utils import int_from_bytes May 19 04:30:40.017780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 04:30:40.018304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 04:30:40.018478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 04:30:40.018840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 04:30:40.019099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 04:30:40.019487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.019812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.020133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.020453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.020786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.021124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.021451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.021771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.022104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.022367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.022682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.023006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-766726-30 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.023327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.023635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.023947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.024270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.024577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.024898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.025230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.025725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.026176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.026511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.026972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.027165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.027478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.027791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.028112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.028422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.028746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.029056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.029477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-766726-30 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.029796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.030109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.030422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.030838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.031148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.031458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.031779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.032104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.032414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.032739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.033056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.033397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.033716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.034020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.034328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.034636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.034954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.035264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.035568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.035818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.036140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.036447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.036765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.037100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.037361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.037610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.037927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.038246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.038554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.038860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.039168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.039477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.039783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.040088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.040393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.040698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.041014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.041357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.041680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.041994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.042339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.042734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.042985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.043291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.043626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.043943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.044250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.044566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.044884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.045215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.045526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.045831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.046149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.046473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.046778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.047027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.047327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.047629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.047944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.048246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.048553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.048858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.049178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.049487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.049791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.050095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.050398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.050702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.051007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.051312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.051617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.051926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.052241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.052556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.052861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.053256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.053562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.053867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.054183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.054485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.054789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.055106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.055413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.055718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.056031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.056353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.056639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.056953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.057283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.057585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.058434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.058740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.059043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.059346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.059648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.059951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.060253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.060554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.060856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.061175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.061492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.061809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.062116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.062426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.062728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.063043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.063378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.063706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.064046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.064361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.064690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.065019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.065364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.065675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.065990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.066315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.066629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.066943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.067255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.067575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.067892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.068221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.068542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.068860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.069201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.069515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.069831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.070155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.070476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.070788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.071127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.071468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.071782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.072105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.072429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.072740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.073053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.074032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.074360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.074690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.075047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.075319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.075633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.075951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.076262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.076579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.076886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.077246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.077566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.077883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.078194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.078511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.078821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.079131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.079439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.079743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.080048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.080354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.080663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.080966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.081311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.081639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.081945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.082276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.082589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.082901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.083213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.083526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.083834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.084145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.084455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.084760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.085185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.085432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.085722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.086065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.086347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.086653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.086968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.087280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.087594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.087906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.088216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.088538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.088852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.089217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.089554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.089885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.090191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.090514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.090839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.091155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.091453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 04:30:40.091894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.091991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 04:30:40.092087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.092087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.092240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 04:30:40.092336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.092591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 04:30:40.092685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.092852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 04:30:40.092952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.093258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.093367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.093567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.093661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.093872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.093965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.094178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.094272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.094480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.094581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.094800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.094892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.095109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.095212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.095415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.095513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.095722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.095829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.096013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.096125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.096333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.096428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.096649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.096761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-766726-30 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.096978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.097138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.097300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.097403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.097617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.097865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.098015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.098113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.098237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.098330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.098559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.098661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.098869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.098969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.099177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.099375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.099491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.099687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.099781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.099996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.100096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.100311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.100416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.100649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.100743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.100968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.101068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.101306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.101421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.101628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.101722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.101938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.102044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.102240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.102342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.102562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.102662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.102902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.103005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-766726-30 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.103233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.103333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.103548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.103649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.103868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.103973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.104177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.104269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.104494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.104609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.104829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.104937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.105164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.105276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.105478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.105579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.105789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.105889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.106109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.106203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.106422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.106518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.106740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.106845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.107051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.107190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.107373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.107475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.107681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.107785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.108001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.108147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.108304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.108407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.108615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.108718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.108925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.109020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.109204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.109307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.109519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.109626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.109847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.109940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.110172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.110273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.110484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.110591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.110738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.110841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.110990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.111128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.111311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.111449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.111634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.111771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.111945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.112049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.112259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.112363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.112568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.112670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.112877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.113054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.113202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.113309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.113512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.113605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.113822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.113928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.114127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.114227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.114430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.114532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.114742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.114850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.115061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.115162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.115370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.115462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.115689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.115796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.116008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.116102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.116313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.116413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.116613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.116711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.116934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.117026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.117270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.117364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.117574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.117669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.117879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.117981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.118181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.118277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.118496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.118596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.118805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.118903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.119110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.119216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.119428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.119529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.119746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.119846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.120053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.120645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.120833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.120939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.121162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.121273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.121472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.121577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.121794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.121887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.122104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.122199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.122411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.122512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.122720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.122814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.123022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.123122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.123329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.123456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.123635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.123730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.123945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.124076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.124253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.124384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.124684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.124775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.124850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.125066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.125274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.125396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.125498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.125581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.125778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.125893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.126083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.126333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.126555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.126669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.126761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.127038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.127282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.127282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.127509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.127676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.127782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.127871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.127954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.128182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.128285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.128489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.128595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.128814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.128923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.129146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.129259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.129459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.129553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.129776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.129882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.130080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.130174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.130385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.130481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.130686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.130799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.130988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.131085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.131291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.131386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.131601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.131708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.131904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.131999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.132208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.132302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.132512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.132608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.132814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.132906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.133148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.133245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.133708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.133827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.134013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.134105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.134315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.134407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.134614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.134708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.134935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.135072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.135239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.135383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.135541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.135637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.135902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.136571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.136713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.136889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.137056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 04:30:40.137233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.137409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.137550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.137676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.137779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.138020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.138123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.138339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.138464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.138658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.138772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.138978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.139080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.139281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.139387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.139585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.139679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.139889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.139988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.140198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.140292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.140507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.140608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.140810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.140926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.141143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.141260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.141454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.141549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.141766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.141873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.142079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.142251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.142420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.142574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.142718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.142876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.143020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.143172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.143320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.143485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.143635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.143786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.143927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.144084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.144232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.144372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.144518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.144659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.144809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.144962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.145128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.145267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.145408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.145548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.145697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.145882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.146054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.146204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.146346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.146511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.146663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.146820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.146980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.147145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.147340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.147435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.147552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.147695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.147813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.148018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.148125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.148327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.148435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.148632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.148784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.148936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.149138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.149270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.149380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.149576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.149673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.149878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.149974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.150189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.150285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.150511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.150613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.150830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.150924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.151135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.151283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.151478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.151575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.151786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.151899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.152090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.152232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.152394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.152541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.152702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.152799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.153007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.153122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.153346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.153451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.153649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.153756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.153952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.154054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.154258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.154351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.154581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.154685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.154890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.154982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.155193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.155293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.155500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.155608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.155803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.155897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.156128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.156266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.156440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.156579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.156747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.156883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.157062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.157243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.157386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.157478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.157695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.157811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.158026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.158131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.158333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.158449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.158642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.158753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.158942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.159044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.159258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.159356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.159563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.159663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.159873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.159966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.160188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.160329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.160469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.160613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.160787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.160930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.161116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.161227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.161433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.161530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.161750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.161919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.162069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.162170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.162389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.162489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.162694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.162838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.163007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.163101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.163314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.163415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.163623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.163731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.163931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.164033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.164239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.164345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.164548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.164651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.164855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.164955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.165186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.165293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.165495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.165596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.165803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.165906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.166109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.166265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.166456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.166548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.166711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.166816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.167017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.167125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.167351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.167445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.167660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.167762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.167964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.168081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.168274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.168388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.168575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.168691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.168882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.168999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.169205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.169312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.169550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.169642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.169895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.169997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.170234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.170345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.170531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.170626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.170840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.170947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.171149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.171252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.171463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.171558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.171776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.171882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.172079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.172175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.172393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.172521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.172710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.172841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.173022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.173185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.173364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.173462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.173687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.173789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.174002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.174101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.174313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.174445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.174627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.174729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.174928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.175029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.175232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.175344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.175536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.175638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.175856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.175953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.176161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.176270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.176481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.176582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.176815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.176915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.177153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.177269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.177478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.177573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.177793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.177916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.178110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.178218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.178428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.178541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.178741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.178837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.179065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.179178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.179378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.179474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.179702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.179804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.180017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.180114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.180336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.180430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.180648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.180749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.180971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.181087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.181301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.181396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.181615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.181717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.181919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.182015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.182239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.182340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.182559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.183165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.183405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.183624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.183717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.183812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.184031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.184135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.184347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.184449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.184663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.184757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.184976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.185129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.185311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.185406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.185628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.185731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.185949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.186056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.186265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.186368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.186568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.186662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.186875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.186971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.187191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.187292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.187494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.187587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.187802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.187935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.188108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.188210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.188419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.188625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.188728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.188821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.189021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.189152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.189382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.189486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.189678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.189832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.190000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.190124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.190305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.190434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.190626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.190747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.190938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.191043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.191242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.191344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.191548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.191649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.191855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.191952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.192160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.192264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.192466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.192560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.192770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.192864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.193131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.193242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.193443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.193545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.193761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.193856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.194080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.194188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.194392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.194488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.194706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.194798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.195026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.195121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.195345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.195447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.195659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.195759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.195970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.196065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.196285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.196380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.196588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.196689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.196893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.196998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.197228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.197325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.197535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.197683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.197841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.197942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.198147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.198331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.198995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.199117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.199313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.199419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.199634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.199729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.199939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.200210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.200306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.200551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.200654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.200872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.201022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.201208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.201313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.201515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.201610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.201822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.201926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.202135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.202238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.202469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.202572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.202775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.202877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.203109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.203217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.203428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.203568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.203746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.203874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.204057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.204150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.204373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.204475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.204679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.204779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.204988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.205111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.205321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.205417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.205637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.205732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.205947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.206049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.206256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.206366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.206565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.206665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.206873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.206968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.207182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.207277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.207489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.207583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.207802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.207903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.208107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.208219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.208434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.208634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.208751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.208966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.209146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.209308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.209473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.209625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.209719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.209939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.210035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.210253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.210355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.210565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.210658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.210877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.211014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.211190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.211328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.211502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.211606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.211814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.211946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.212143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.212237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.212467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.212576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.212781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.212882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.213162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.213261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.213429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.213539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.213744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.213879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.214076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.214183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.214391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.214492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.214703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.214797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.215017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.215113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.215332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.215427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.215639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.215741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.215951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.216046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.216257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.216353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.216567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.216667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.216878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.216981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.217206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.217316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.217514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.217617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.217825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.217919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.218133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.218233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.218440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.218548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.218754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.218848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.219058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.219151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.219376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.219489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.219684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.219780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.219993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.220094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.220301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.220404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.220615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.220725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.220928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.221164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.221272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.221485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.221583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.221819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.221913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.222147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.222271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.222500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.222602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.222818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.222946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.223152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.223250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.223485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.223570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.223796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.223882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.224120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.224214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.224435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.224519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.224747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.224838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.225051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.225207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.225399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.225489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.225709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.225793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.226013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.226098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.226323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.226417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.226627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.226751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.226936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.227203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.227308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.227510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.227605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.228621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.228905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.228988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.229062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.229178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.229261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.229341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.229426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.229508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.230091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.230165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.230243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.230325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.230424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.230644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.230735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.231013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.231108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.231329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.231424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.231649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.231740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.231955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.232054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.232265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.232418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.232577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.232672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.232881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.232975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.233216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.233326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.233522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.233616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.233848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.233950 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.234159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.234254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.234466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.234568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.234770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.234873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.235082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.235183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.235386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.235479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.235691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.235794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.235994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.236089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.236297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.236513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.236642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.236767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.236909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.237007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.237226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.237378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.237534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.237631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.237845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.237982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.238148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.238252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.238457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.238561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.238779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.238873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.239096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.239198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.239413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.239517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.239718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.239821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.240031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.240124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.240343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.240484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.240659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.240754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.240973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.241113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.241306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.241401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.241634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.241736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.241948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.242056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.242257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.242481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.242594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.242816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.242919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.243138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.243241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.243465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.243588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.243795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.243906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.244110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.244218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.244418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.244531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.244729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.244836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.245053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.245246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.245969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.246066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.246288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.246393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.246605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.246707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.246915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.247017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.247261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.247375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.247575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.247681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.247889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.247992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.248268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.248383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.248519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.248622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.248832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.248935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.249170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.249270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.249482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.249584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.249795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.249890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.250104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.250200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.250411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.250514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.250758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.250897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.251095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.251206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.251417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.251555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.251731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.251890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.252056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.252208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.252385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.252521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.252699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.252924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.253055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.253265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.253388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.253585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.253719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.253911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.254042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.254235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.254364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.254562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.254683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.254872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.255002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.255189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.255655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.255803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.255929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.256043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.256138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.256225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.256446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.256549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.256764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.256868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.257108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.257221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.257535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.257862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.258182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.258767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.259195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.259345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.259581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.259696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.259897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.260243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.260585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.260778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.260955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.261294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.261625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.261947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.262276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.262772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.263029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.263412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.263749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.264090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.264503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.264847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.265323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.265655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.266697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.266697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.266697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.267393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.267744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.267939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.268097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.268265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.268413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.268538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.268748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.268857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.269094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.269204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.269439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.269534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.269780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.269889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.270106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.270199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.270426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.270528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.270744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.270840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.271065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.271169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.271383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.271551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.271698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.271796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.272012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.272116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.272327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.272436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.272642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.272738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.272960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.273065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.273316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.273431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.273674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.273779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.274050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.274145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.274385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.274489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.274727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.274831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.275045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.275139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.275373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.275476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.275702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.275842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.276031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.276135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.276351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.276468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.276710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.276816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.277026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.277227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.277373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.277476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.277688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.277789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.278004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.278108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.278314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.278455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.278628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.278728 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.278939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.279054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.279255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.279351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.279567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.279661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.279880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.279989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.280195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.280302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.280519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.280614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.280830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.280948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.281167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.281266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.281490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.281624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.281803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.281899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.282114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.282209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.282425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.282528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.282738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.282841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.283053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.283149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.283372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.283490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.283694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.283799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.284022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.284117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.284351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.284458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.284666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.284769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.284994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.285102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.285344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.285453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.285668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.285763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.285992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.286087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.286338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.286479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.286683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.286777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.287005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.287144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.287319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.287453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.287636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.287773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.287897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 04:30:40.288018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.288334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.288663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.289465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.289662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.289905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.290272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.290542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.290895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.291178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.291499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.291818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.292661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.294649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.295021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.295864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.296187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.296735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.298054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.298416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.298767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.299115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.299500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.299843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.300285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.300650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.301307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.301307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.301633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.302034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.302815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.302815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.303033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.303358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.303684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.304013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.304351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.304755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.305248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.305443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.306269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.306269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.306876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.307656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.307656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.308525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.308712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.309214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.309575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.310227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.310227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.310569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.310904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.311242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.311560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.311894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.312218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.312533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.312863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.313207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.313754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.314111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.314440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.314863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.315108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.315434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.315751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.316083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.316400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.316717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.317042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.317387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.317699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.318012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.318331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.318648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.318960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.319287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.319597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.319933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.320245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.320556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.320866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.321206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.321520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.321829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.322139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.322449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.322767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.323079 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.323426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.323740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.324102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.324363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.324681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.325047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.325402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.325718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.326025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.326399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.326717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.327357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.327357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.327628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.327968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.328465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.329483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.329483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.329953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.329953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.330333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.330545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.330879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.331118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.331473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.331847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.332090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.332510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.332807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.335465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.335465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.335465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.335465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.335465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.335465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.335465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.335465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.338218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.338218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.338218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.338218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.338218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.338218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.338218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.338218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.339497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.339497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.339497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.339497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.339497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.340327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.340327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.340637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.340787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.341113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.342537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.342883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.343228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.343559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.343900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.344228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.344573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.344932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.345315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.345708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.345970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.346290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.346606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.346928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.347347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.347566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.347862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.348233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.348553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.348977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.350979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.350979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.351517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.351517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.351958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.352137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.352324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.352794 n-d-766726-30 devstack@n-api.service[124818]: INFO dbcounter [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Registered counter for database nova_api May 19 04:30:40.352930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.353279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.353571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.353901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.354238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.355266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.355496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.355846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.356134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.356478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.356984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.357489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.357972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.358474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.359000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.359318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.359656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.359990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.360527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.360856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.361230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.361556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.361880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.362204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.362526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.362847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.363169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.363508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.363843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.364160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.364495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.364821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.365176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.365508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.365830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.366167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.366489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.366813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.367139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.367456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.367835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.368204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.368419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.368755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.369707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.369707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.369985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.370105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.371062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.371389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.371796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.372138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.373317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.373317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.373317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 04:30:40.373587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 04:30:40.375093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_db.sqlalchemy.engines [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:30:40.383157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writer thread running {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:30:40.433856 n-d-766726-30 devstack@n-api.service[124819]: INFO dbcounter [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Registered counter for database nova_api May 19 04:30:40.440390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.context [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) {{(pid=124818) load_cells /opt/stack/nova/nova/context.py:464}} May 19 04:30:40.444865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:30:40.446496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:30:40.447314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:30:40.449342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:30:40.453053 n-d-766726-30 devstack@n-api.service[124818]: INFO dbcounter [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Registered counter for database nova_cell0 May 19 04:30:40.454249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_db.sqlalchemy.engines [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:30:40.455525 n-d-766726-30 devstack@n-api.service[124818]: INFO dbcounter [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Registered counter for database nova_cell1 May 19 04:30:40.462462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writer thread running {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:30:40.463038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_db.sqlalchemy.engines [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:30:40.465669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_db.sqlalchemy.engines [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:30:40.469891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writer thread running {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:30:40.475896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writer thread running {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:30:40.527171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.context [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) {{(pid=124819) load_cells /opt/stack/nova/nova/context.py:464}} May 19 04:30:40.531663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:30:40.533318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:30:40.534123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:30:40.536110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:30:40.538161 n-d-766726-30 devstack@n-api.service[124819]: INFO dbcounter [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Registered counter for database nova_cell0 May 19 04:30:40.542823 n-d-766726-30 devstack@n-api.service[124819]: INFO dbcounter [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Registered counter for database nova_cell1 May 19 04:30:40.549862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_db.sqlalchemy.engines [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:30:40.553196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_db.sqlalchemy.engines [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:30:40.560544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writer thread running {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:30:40.562629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writer thread running {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:30:40.628872 n-d-766726-30 devstack@n-api.service[124818]: INFO dbcounter [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Registered counter for database nova_cell0 May 19 04:30:40.636360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_db.sqlalchemy.engines [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:30:40.640719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writer thread running {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:30:40.711667 n-d-766726-30 devstack@n-api.service[124819]: INFO dbcounter [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Registered counter for database nova_cell0 May 19 04:30:40.718901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_db.sqlalchemy.engines [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 04:30:40.723250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writer thread running {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 04:30:40.974429 n-d-766726-30 devstack@n-api.service[124818]: WARNING keystonemiddleware.auth_token [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 04:30:40.982834 n-d-766726-30 devstack@n-api.service[124818]: WARNING keystonemiddleware.auth_token [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 04:30:41.051223 n-d-766726-30 devstack@n-api.service[124819]: WARNING keystonemiddleware.auth_token [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 04:30:41.059659 n-d-766726-30 devstack@n-api.service[124819]: WARNING keystonemiddleware.auth_token [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 04:30:41.338409 n-d-766726-30 devstack@n-api.service[124818]: WARNING keystonemiddleware.auth_token [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 04:30:41.344706 n-d-766726-30 devstack@n-api.service[124818]: WARNING keystonemiddleware.auth_token [None req-705fa2e6-373b-4986-85cb-534ee04f82cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 04:30:41.350060 n-d-766726-30 devstack@n-api.service[124818]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caa849b9c0 pid: 124818 (default app) May 19 04:30:41.413955 n-d-766726-30 devstack@n-api.service[124819]: WARNING keystonemiddleware.auth_token [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 04:30:41.420815 n-d-766726-30 devstack@n-api.service[124819]: WARNING keystonemiddleware.auth_token [None req-e734bb6f-a8d3-4110-9d79-02edc7e9b008 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 04:30:41.426183 n-d-766726-30 devstack@n-api.service[124819]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caa849b9c0 pid: 124819 (default app) May 19 04:31:27.662394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:27.663249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:27.667038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:27.673238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:28.118743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:28.119615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:28.120794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:28.121775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:28.803847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41c8a9aa-849e-463d-b8aa-2609d86e7b97 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Action: 'create', calling method: .version_select at 0x7fd3185ff700>, body: {"keypair": {"name": "tempest-keypair-588623664", "type": "ssh", "user_id": "05326c78c9e8406e86ba1eb3213c19e2", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCjGi4gBojAyDPtdYxcLm/8PvpmAWwd0r4L5MO/bYIAbj4kABIxJAm4x8kIWCI6DsCJeGtzYk0sVmxnBO1H2ZkhyphJWJ/Q6ARLQOtYgC+9Bikon8S7KAnTC+p0Nzfd+g=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:28.850013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-41c8a9aa-849e-463d-b8aa-2609d86e7b97 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Getting quotas for project 79b764a66b5d4a8abd3508a2eb77cced. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:31:28.858026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-41c8a9aa-849e-463d-b8aa-2609d86e7b97 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Getting quotas for user d4e4bd8a7f51435996179e3eb3b1beb7 and project 79b764a66b5d4a8abd3508a2eb77cced. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:31:28.920688 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-41c8a9aa-849e-463d-b8aa-2609d86e7b97 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 1.271288 May 19 04:31:28.921738 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1/1] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 19 04:31:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1274 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 04:31:29.060745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-857c22c3-abc3-42a4-b564-6ea5c3a51127 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Calling method '.version_select at 0x7fd3185ffdc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:29.062920 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:29.062920 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:29.069358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-857c22c3-abc3-42a4-b564-6ea5c3a51127 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) {{(pid=124818) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 19 04:31:29.070251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-857c22c3-abc3-42a4-b564-6ea5c3a51127 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:29.071298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-857c22c3-abc3-42a4-b564-6ea5c3a51127 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:29.072589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-721caaf5-37ae-4a4b-a9c6-cd84d73f1565 tempest-AZAdminNegativeTestJSON-270771967 tempest-AZAdminNegativeTestJSON-270771967-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:29.074030 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:29.074030 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:29.075120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-721caaf5-37ae-4a4b-a9c6-cd84d73f1565 tempest-AZAdminNegativeTestJSON-270771967 tempest-AZAdminNegativeTestJSON-270771967-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '22b725a53f3b4a0b97985db8ce2f236d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e8890f9d94c1f8223da93393f2f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-721caaf5-37ae-4a4b-a9c6-cd84d73f1565 tempest-AZAdminNegativeTestJSON-270771967 tempest-AZAdminNegativeTestJSON-270771967-project] Request method failure captured: May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcgdtnjt4bSHs8BndXU8TjFnbZIPsqUOHXH5LbaaQrRf1OFMnHmDajeZwriKMonESw3Cypv6mS-wsFSYZSppLTaZeGndHkwG6wJPZ4hlyModTdfqH1qZV2n3vqfuQg3s4hWh7qdNeQ2-SJ56FxAeK_9AZWUqlvVtaTyfaWzooVlWFnc May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a41e8890f9d94c1f8223da93393f2f7c May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AZAdminNegativeTestJSON-270771967 May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:31:29.087484 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a41e8890f9d94c1f8223da93393f2f7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a41e8890f9d94c1f8223da93393f2f7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a41e8890f9d94c1f8223da93393f2f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a41e8890f9d94c1f8223da93393f2f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AZAdminNegativeTestJSON-270771967 May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a41e8890f9d94c1f8223da93393f2f7c May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-270771967 May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AZAdminNegativeTestJSON-270771967-project May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 22b725a53f3b4a0b97985db8ce2f236d May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AZAdminNegativeTestJSON-270771967-project May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 19 04:31:29.088819 n-d-766726-30 devstack@n-api.service[124819]: action_args: {} May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:29.089612 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:29.090551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-721caaf5-37ae-4a4b-a9c6-cd84d73f1565 tempest-AZAdminNegativeTestJSON-270771967 tempest-AZAdminNegativeTestJSON-270771967-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:29.091354 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-721caaf5-37ae-4a4b-a9c6-cd84d73f1565 tempest-AZAdminNegativeTestJSON-270771967 tempest-AZAdminNegativeTestJSON-270771967-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.976647 May 19 04:31:29.091354 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1/2] 10.222.0.58 () {58 vars in 1184 bytes} [Thu May 19 04:31:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 979 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 19 04:31:29.100317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-857c22c3-abc3-42a4-b564-6ea5c3a51127 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:29.100767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-857c22c3-abc3-42a4-b564-6ea5c3a51127 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:29.114513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-857c22c3-abc3-42a4-b564-6ea5c3a51127 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:29.115165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-857c22c3-abc3-42a4-b564-6ea5c3a51127 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:29.121825 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-857c22c3-abc3-42a4-b564-6ea5c3a51127 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.198781 May 19 04:31:29.122689 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1207 bytes} [Thu May 19 04:31:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:29.288048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9de57a0f-da67-465a-bde6-6669e9cfdfb9 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-444528294", "ram": 512, "vcpus": 1, "disk": 10, "id": 1858457694, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:29.306073 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:29.306073 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:29.346976 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9de57a0f-da67-465a-bde6-6669e9cfdfb9 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.255710 May 19 04:31:29.347989 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2/4] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:29 2022] POST /compute/v2.1/flavors => generated 415 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:29.469383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-354a08c5-de7d-4ddd-b009-89f0e500ecc5 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '.version_select at 0x7fd317ca2310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:29.470523 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:29.470523 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:29.471846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-354a08c5-de7d-4ddd-b009-89f0e500ecc5 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:29.472390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-354a08c5-de7d-4ddd-b009-89f0e500ecc5 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:29.489936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-354a08c5-de7d-4ddd-b009-89f0e500ecc5 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:29.490649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-354a08c5-de7d-4ddd-b009-89f0e500ecc5 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:29.501328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-354a08c5-de7d-4ddd-b009-89f0e500ecc5 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:29.501872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-354a08c5-de7d-4ddd-b009-89f0e500ecc5 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:29.508220 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-354a08c5-de7d-4ddd-b009-89f0e500ecc5 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.384389 May 19 04:31:29.508905 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1166 bytes} [Thu May 19 04:31:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:29.513522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c5861d71-0c68-449c-a7da-20d16525687c tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Action: 'create', calling method: .version_select at 0x7fd317c5f670>, body: {"keypair": {"name": "tempest-keypair-507834309", "type": "ssh", "user_id": "05326c78c9e8406e86ba1eb3213c19e2", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp7e4k58s6q48LJmcCQbxy6A85CCkYV0JOqLLQ09x6ej/c9pY2f7prhYoUXoc3ai41rKyVLX+PgjVuB4Ppkwqsacu/zQOZOcYEO3mK+SS0gn6Cf2nOELruhf8U54H2reA=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:29.528580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c5861d71-0c68-449c-a7da-20d16525687c tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Getting quotas for project 79b764a66b5d4a8abd3508a2eb77cced. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:31:29.533032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c5861d71-0c68-449c-a7da-20d16525687c tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Getting quotas for user d4e4bd8a7f51435996179e3eb3b1beb7 and project 79b764a66b5d4a8abd3508a2eb77cced. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:31:29.559848 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c5861d71-0c68-449c-a7da-20d16525687c tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.049740 May 19 04:31:29.560448 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 4/6] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 19 04:31:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 04:31:29.644809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-04ea864c-3af7-4204-a682-12200d5f0836 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-608148707", "id": 220376961, "os-flavor-access:is_public": "False"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:29.669425 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-04ea864c-3af7-4204-a682-12200d5f0836 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.320298 May 19 04:31:29.670689 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3/7] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:29 2022] POST /compute/v2.1/flavors => generated 427 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:29.676409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ec2c83e-8874-4be9-a72f-882f6881fff8 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1497943799"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:29.678961 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:29.678961 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:29.680628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-9ec2c83e-8874-4be9-a72f-882f6881fff8 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Generated uuid d351cdf1-3f6e-4f68-ba8e-752e26a863c4 for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:31:29.774683 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ec2c83e-8874-4be9-a72f-882f6881fff8 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.101795 May 19 04:31:29.775887 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 4/8] 10.222.0.58 () {62 vars in 1204 bytes} [Thu May 19 04:31:29 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:29.786415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17e3d23e-7f4e-4450-9f8d-34712792e56e tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:29.788109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-534938545", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:29.788316 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:29.788316 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:29.869375 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17e3d23e-7f4e-4450-9f8d-34712792e56e tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1858457694/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.092067 May 19 04:31:29.870044 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 5/9] 10.222.0.58 () {60 vars in 1223 bytes} [Thu May 19 04:31:29 2022] POST /compute/v2.1/flavors/1858457694/os-extra_specs => generated 66 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:29.876300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-52327bac-a17f-49db-9ee6-9bf80d3d2908 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Calling method '.version_select at 0x7fd3185289d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:29.888949 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-52327bac-a17f-49db-9ee6-9bf80d3d2908 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-588623664?user_id=05326c78c9e8406e86ba1eb3213c19e2" status: 200 len: 511 microversion: 2.10 time: 0.017158 May 19 04:31:29.893208 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 6/10] 10.222.0.58 () {60 vars in 1336 bytes} [Thu May 19 04:31:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-588623664?user_id=05326c78c9e8406e86ba1eb3213c19e2 => generated 511 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:29.903893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b06d1c6-79c1-4eb0-b82f-65a0f121d0af tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ba70f22439af4704be5144b466ffeaba"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:29.905376 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:29.905376 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:30.150300 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5b06d1c6-79c1-4eb0-b82f-65a0f121d0af tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/220376961/action" status: 200 len: 96 microversion: 2.1 time: 0.254393 May 19 04:31:30.155627 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 7/11] 10.222.0.58 () {60 vars in 1196 bytes} [Thu May 19 04:31:29 2022] POST /compute/v2.1/flavors/220376961/action => generated 96 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:30.156330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d9e5dca4-f22e-4653-a796-58ed874e485a tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-647862221"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:30.227320 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:30.227320 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:30.271974 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d9e5dca4-f22e-4653-a796-58ed874e485a tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.118994 May 19 04:31:30.278356 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 8/12] 10.222.0.58 () {62 vars in 1209 bytes} [Thu May 19 04:31:30 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:30.396100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:31:30.462258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6487440b-b890-42cc-be70-d7eeae274d43 tempest-FlavorsExtraSpecsTestJSON-1783421873 tempest-FlavorsExtraSpecsTestJSON-1783421873-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:30.481532 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6487440b-b890-42cc-be70-d7eeae274d43 tempest-FlavorsExtraSpecsTestJSON-1783421873 tempest-FlavorsExtraSpecsTestJSON-1783421873-project] 10.222.0.58 "GET /compute/v2.1/flavors/1858457694/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.206658 May 19 04:31:30.482166 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 9/13] 10.222.0.58 () {58 vars in 1202 bytes} [Thu May 19 04:31:30 2022] GET /compute/v2.1/flavors/1858457694/os-extra_specs => generated 66 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:30.487551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d128dce-1690-4855-b53b-8e0bb4a24752 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Action: 'create', calling method: .version_select at 0x7fd316bb28b0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-378751680", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4c8r2tNDJDeiVVTH21fGiMx2W+MpL0bmBzYGUKA72oHqW8jCxhntHg//UTguemCquFRRewGvr8VYFwF0HIR/USLiYN+/tXGB6THKR4PauSUfuz3AoOguLx3McgF4ASOg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:30.517237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-5d128dce-1690-4855-b53b-8e0bb4a24752 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Getting quotas for project 79b764a66b5d4a8abd3508a2eb77cced. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:31:30.525750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-5d128dce-1690-4855-b53b-8e0bb4a24752 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Getting quotas for user d4e4bd8a7f51435996179e3eb3b1beb7 and project 79b764a66b5d4a8abd3508a2eb77cced. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:31:30.577178 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5d128dce-1690-4855-b53b-8e0bb4a24752 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.093616 May 19 04:31:30.577921 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 10/14] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 19 04:31:30 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 04:31:30.753442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:31:30.754156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:31:30.754633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:31:30.755223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:31:30.755642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:31:30.767981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:30.768724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:30.769568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:30.770004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:30.773287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bf669c0c-e3ab-4d21-a034-a3b67f0acbf3 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:30.775208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf669c0c-e3ab-4d21-a034-a3b67f0acbf3 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:30.775827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf669c0c-e3ab-4d21-a034-a3b67f0acbf3 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:30.776625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf669c0c-e3ab-4d21-a034-a3b67f0acbf3 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:30.777057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf669c0c-e3ab-4d21-a034-a3b67f0acbf3 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:30.794007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Getting quotas for project 35e5b8a1fce545b88a7405cf7b310a22. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:31:30.798130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Getting quotas for user dd403ce37c3d4ccc8853779a33902f95 and project 35e5b8a1fce545b88a7405cf7b310a22. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:31:30.813636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:31:30.816801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:31:30.817027 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bf669c0c-e3ab-4d21-a034-a3b67f0acbf3 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.227656 May 19 04:31:30.817979 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 11/15] 10.222.0.58 () {58 vars in 1163 bytes} [Thu May 19 04:31:30 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:30.902841 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b86ad089-f69f-4127-bdcc-41bfd234db28 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.340687 May 19 04:31:30.911012 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 5/16] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:31:30.917639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-42e418ce-be67-4499-bca2-5a81cedf5daf tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:30.918782 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:30.918782 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:30.943056 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-42e418ce-be67-4499-bca2-5a81cedf5daf tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.030603 May 19 04:31:30.948951 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 6/17] 10.222.0.58 () {60 vars in 1189 bytes} [Thu May 19 04:31:30 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:30.948951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-30156e4a-00b7-4d28-bd95-015292c4dccc tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:30.950690 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:30.950690 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:30.980236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8476de10-9103-4840-967a-78b7b28c44a6 tempest-FlavorsAccessTestJSON-476499152 tempest-FlavorsAccessTestJSON-476499152-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:30.999095 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-30156e4a-00b7-4d28-bd95-015292c4dccc tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1858457694/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054152 May 19 04:31:30.999866 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 7/18] 10.222.0.58 () {60 vars in 1223 bytes} [Thu May 19 04:31:30 2022] POST /compute/v2.1/flavors/1858457694/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:31.004918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-56a612f2-fbcb-41cd-a005-d2ad7363b3f2 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Calling method '.version_select at 0x7fd317b78d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:31.008154 n-d-766726-30 devstack@n-api.service[124818]: WARNING oslo_db.sqlalchemy.utils [None req-56a612f2-fbcb-41cd-a005-d2ad7363b3f2 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. May 19 04:31:31.015455 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-56a612f2-fbcb-41cd-a005-d2ad7363b3f2 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs?user_id=05326c78c9e8406e86ba1eb3213c19e2" status: 200 len: 724 microversion: 2.10 time: 0.014349 May 19 04:31:31.016193 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 8/19] 10.222.0.58 () {60 vars in 1258 bytes} [Thu May 19 04:31:30 2022] GET /compute/v2.1/os-keypairs?user_id=05326c78c9e8406e86ba1eb3213c19e2 => generated 724 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:31.022681 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8476de10-9103-4840-967a-78b7b28c44a6 tempest-FlavorsAccessTestJSON-476499152 tempest-FlavorsAccessTestJSON-476499152-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.196428 May 19 04:31:31.024626 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 12/20] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:30 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:31.026215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-139b294e-1cd4-42bc-839b-8450d00c64e0 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:31.027176 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:31.027176 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:31.028785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-139b294e-1cd4-42bc-839b-8450d00c64e0 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:31.029182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bab2618a-9242-4a05-9d1e-5fdea174e81b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:31.029803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-139b294e-1cd4-42bc-839b-8450d00c64e0 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:31.029918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bab2618a-9242-4a05-9d1e-5fdea174e81b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:31.030991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-139b294e-1cd4-42bc-839b-8450d00c64e0 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:31.031584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-139b294e-1cd4-42bc-839b-8450d00c64e0 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:31.076218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-139b294e-1cd4-42bc-839b-8450d00c64e0 tempest-AZAdminV2TestJSON-717415939 tempest-AZAdminV2TestJSON-717415939-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.058700 May 19 04:31:31.076846 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 9/21] 10.222.0.58 () {58 vars in 1184 bytes} [Thu May 19 04:31:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:31.084077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2f26dcd4-3f82-4148-8fc4-a5ccfdedb7f6 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:31.084077 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:31.084077 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:31.092906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f26dcd4-3f82-4148-8fc4-a5ccfdedb7f6 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:31.093390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f26dcd4-3f82-4148-8fc4-a5ccfdedb7f6 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:31.828325 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2f26dcd4-3f82-4148-8fc4-a5ccfdedb7f6 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 0.750127 May 19 04:31:31.835714 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 10/22] 10.222.0.58 () {62 vars in 1231 bytes} [Thu May 19 04:31:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:31.851264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c7e5543-6d0c-492f-89cb-e364e594a267 tempest-FlavorsExtraSpecsTestJSON-1783421873 tempest-FlavorsExtraSpecsTestJSON-1783421873-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:31.873358 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c7e5543-6d0c-492f-89cb-e364e594a267 tempest-FlavorsExtraSpecsTestJSON-1783421873 tempest-FlavorsExtraSpecsTestJSON-1783421873-project] 10.222.0.58 "GET /compute/v2.1/flavors/1858457694/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.035030 May 19 04:31:31.874355 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 11/23] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:31:31 2022] GET /compute/v2.1/flavors/1858457694/os-extra_specs/hw:numa_nodes => generated 22 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:31.884129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bab2618a-9242-4a05-9d1e-5fdea174e81b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:31.892029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c5b728f-ca25-47b5-af46-c502fbe7cb65 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Calling method '.version_select at 0x7fd316ab1af0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:31.902160 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bab2618a-9242-4a05-9d1e-5fdea174e81b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1219 microversion: 2.1 time: 0.876416 May 19 04:31:31.903334 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 13/24] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:31 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1219 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:31.909219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da0b15d9-62c3-4983-befd-3d66cc61317f tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ba70f22439af4704be5144b466ffeaba"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:31.911371 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:31.911371 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:31.959730 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1c5b728f-ca25-47b5-af46-c502fbe7cb65 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-378751680" status: 204 len: 0 microversion: 2.10 time: 0.078782 May 19 04:31:31.964484 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 12/25] 10.222.0.58 () {60 vars in 1321 bytes} [Thu May 19 04:31:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-378751680 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:31:31.970900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d64e39ab-7f2f-4c1a-a021-279eb28493b3 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-766726-30"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:31.978577 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:31.978577 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:31.999581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d64e39ab-7f2f-4c1a-a021-279eb28493b3 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:32.000304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d64e39ab-7f2f-4c1a-a021-279eb28493b3 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:32.146588 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d64e39ab-7f2f-4c1a-a021-279eb28493b3 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.180320 May 19 04:31:32.154947 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 13/26] 10.222.0.58 () {62 vars in 1231 bytes} [Thu May 19 04:31:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:32.161986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1dae2bad-4fe8-427a-a577-7034c2d59d14 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:32.163850 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.163850 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:32.189414 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1dae2bad-4fe8-427a-a577-7034c2d59d14 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1858457694/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032756 May 19 04:31:32.190030 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 14/27] 10.222.0.58 () {60 vars in 1223 bytes} [Thu May 19 04:31:32 2022] POST /compute/v2.1/flavors/1858457694/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:32.203135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7423358-4399-4ce7-943f-c85feaef3756 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Calling method '.version_select at 0x7fd316af6e50>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.210048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:32.231461 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7423358-4399-4ce7-943f-c85feaef3756 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507834309?user_id=05326c78c9e8406e86ba1eb3213c19e2" status: 204 len: 0 microversion: 2.10 time: 0.040307 May 19 04:31:32.232397 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 15/28] 10.222.0.58 () {60 vars in 1339 bytes} [Thu May 19 04:31:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507834309?user_id=05326c78c9e8406e86ba1eb3213c19e2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:31:32.237976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0d34fa9-bc00-453d-8e9b-84012d4f44e9 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.239385 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.239385 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:32.279444 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0d34fa9-bc00-453d-8e9b-84012d4f44e9 tempest-AggregatesAdminTestV241-2076521637 tempest-AggregatesAdminTestV241-2076521637-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.045483 May 19 04:31:32.280612 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 16/29] 10.222.0.58 () {60 vars in 1192 bytes} [Thu May 19 04:31:32 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:32.288585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f5f2f402-407c-403c-937a-62df0e7931cf tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.297840 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f5f2f402-407c-403c-937a-62df0e7931cf tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1858457694/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015355 May 19 04:31:32.302729 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 17/30] 10.222.0.58 () {58 vars in 1202 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/flavors/1858457694/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:32.304240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99c7bc44-52ce-4a8d-b1ba-ef188333c262 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] Calling method '.version_select at 0x7fd316af6e50>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.329130 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99c7bc44-52ce-4a8d-b1ba-ef188333c262 tempest-KeyPairsV210TestJSON-235083275 tempest-KeyPairsV210TestJSON-235083275-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588623664?user_id=05326c78c9e8406e86ba1eb3213c19e2" status: 204 len: 0 microversion: 2.10 time: 0.028111 May 19 04:31:32.330444 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 18/31] 10.222.0.58 () {60 vars in 1339 bytes} [Thu May 19 04:31:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588623664?user_id=05326c78c9e8406e86ba1eb3213c19e2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:31:32.341309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d425e563-09e3-496f-a386-a79d346b770c tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:32.342899 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.342899 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:32.377819 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d425e563-09e3-496f-a386-a79d346b770c tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1858457694/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.045837 May 19 04:31:32.378935 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 19/32] 10.222.0.58 () {60 vars in 1264 bytes} [Thu May 19 04:31:32 2022] PUT /compute/v2.1/flavors/1858457694/os-extra_specs/hw:numa_nodes => generated 22 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:32.388916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4f7ceb31-99bc-493a-be7f-7fbaaaacadfe tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1197463533", "name": "tempest-test_aggregate-436134049"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:32.411197 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.411197 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:32.412474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.aggregate [None req-4f7ceb31-99bc-493a-be7f-7fbaaaacadfe tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Generated uuid af74132d-e928-4342-85b6-a93b7eec6f92 for aggregate {{(pid=124818) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:31:32.422538 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da0b15d9-62c3-4983-befd-3d66cc61317f tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/220376961/action" status: 200 len: 21 microversion: 2.1 time: 0.517740 May 19 04:31:32.423638 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 14/33] 10.222.0.58 () {60 vars in 1196 bytes} [Thu May 19 04:31:31 2022] POST /compute/v2.1/flavors/220376961/action => generated 21 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:32.429927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7a2346e3-b95a-451b-8aed-cb4869b7313c tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.443475 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7a2346e3-b95a-451b-8aed-cb4869b7313c tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1858457694/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018592 May 19 04:31:32.444159 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 15/34] 10.222.0.58 () {58 vars in 1202 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/flavors/1858457694/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:32.450490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c179db7b-7211-48dc-88ab-f463b30af726 tempest-FlavorsAccessTestJSON-476499152 tempest-FlavorsAccessTestJSON-476499152-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.479195 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4f7ceb31-99bc-493a-be7f-7fbaaaacadfe tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.094129 May 19 04:31:32.481244 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 20/35] 10.222.0.58 () {60 vars in 1164 bytes} [Thu May 19 04:31:32 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:32.487293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e9295aa-7ffc-4b93-97d0-e607ac385325 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.487713 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.487713 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:32.500291 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c179db7b-7211-48dc-88ab-f463b30af726 tempest-FlavorsAccessTestJSON-476499152 tempest-FlavorsAccessTestJSON-476499152-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.053807 May 19 04:31:32.512768 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 16/36] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:32.519565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-deea217c-415f-401d-ade5-b3c3a30220cd tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.520543 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.520543 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:32.525729 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e9295aa-7ffc-4b93-97d0-e607ac385325 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1858457694/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.042899 May 19 04:31:32.529429 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 21/37] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:31:32 2022] DELETE /compute/v2.1/flavors/1858457694/os-extra_specs/hw:numa_nodes => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:31:32.536694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-133232eb-136e-45f2-9655-1b3481fbf4c0 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.537915 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.537915 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:32.538855 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-deea217c-415f-401d-ade5-b3c3a30220cd tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.024523 May 19 04:31:32.539797 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 17/38] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:32.551045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ab976bb-da7b-412f-a618-4106a49ffbbf tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.552007 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.552007 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:32.578715 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-133232eb-136e-45f2-9655-1b3481fbf4c0 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/220376961" status: 202 len: 0 microversion: 2.1 time: 0.045235 May 19 04:31:32.585984 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 22/39] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:31:32 2022] DELETE /compute/v2.1/flavors/220376961 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:32.586155 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ab976bb-da7b-412f-a618-4106a49ffbbf tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1858457694/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.035972 May 19 04:31:32.589553 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 18/40] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:31:32 2022] DELETE /compute/v2.1/flavors/1858457694/os-extra_specs/hw:cpu_policy => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:31:32.591999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-459df7bd-6d1f-4ed9-b42e-3cade07a077e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:32.593235 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.593235 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:32.596163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ad98446a-251d-4739-8f71-d630989f8967 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.616689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-459df7bd-6d1f-4ed9-b42e-3cade07a077e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:32.617174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-459df7bd-6d1f-4ed9-b42e-3cade07a077e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:32.671950 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ad98446a-251d-4739-8f71-d630989f8967 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.082789 May 19 04:31:32.675150 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 19/41] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:32.686567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6bfe61bb-ac7e-4530-ae7a-bb7b357bc678 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.709863 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6bfe61bb-ac7e-4530-ae7a-bb7b357bc678 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1858457694/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029291 May 19 04:31:32.715963 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 20/42] 10.222.0.58 () {58 vars in 1202 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/flavors/1858457694/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:32.721654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5f7a2d29-053a-4236-9251-817014b9bb60 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-811966699", "id": 133764237, "os-flavor-access:is_public": "False"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:32.723226 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.723226 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:32.740705 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5f7a2d29-053a-4236-9251-817014b9bb60 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.023362 May 19 04:31:32.741407 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 21/43] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:32 2022] POST /compute/v2.1/flavors => generated 427 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:32.748463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-651928f8-8df5-4219-8612-0f4ac3b3f282 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.749793 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.749793 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:32.798139 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-651928f8-8df5-4219-8612-0f4ac3b3f282 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1858457694" status: 202 len: 0 microversion: 2.1 time: 0.054207 May 19 04:31:32.802268 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 22/44] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:31:32 2022] DELETE /compute/v2.1/flavors/1858457694 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:32.808391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6697e27-95bd-4c53-972a-52f7578d2951 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.809718 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:32.809718 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:32.822358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:32.824453 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6697e27-95bd-4c53-972a-52f7578d2951 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/133764237/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.020721 May 19 04:31:32.825288 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 23/45] 10.222.0.58 () {58 vars in 1205 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/flavors/133764237/os-flavor-access => generated 21 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:32.832481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-651b8fa2-fd72-4633-81af-e32add202ab8 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.854942 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-651b8fa2-fd72-4633-81af-e32add202ab8 tempest-FlavorsExtraSpecsTestJSON-1364378261 tempest-FlavorsExtraSpecsTestJSON-1364378261-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028513 May 19 04:31:32.857604 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 24/46] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:32.866327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4254e9e0-0f10-4edf-8928-615d91aa730e tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.893159 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4254e9e0-0f10-4edf-8928-615d91aa730e tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/133764237" status: 202 len: 0 microversion: 2.1 time: 0.033773 May 19 04:31:32.893884 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 25/47] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:31:32 2022] DELETE /compute/v2.1/flavors/133764237 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:32.904267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-01995319-b41a-4368-b231-00aba63b2af2 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.907877 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-459df7bd-6d1f-4ed9-b42e-3cade07a077e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.323400 May 19 04:31:32.908683 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 23/48] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:31:32 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:32.930014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5af62360-04c4-44e9-a08d-6b5d42177be4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:32.931277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5af62360-04c4-44e9-a08d-6b5d42177be4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:32.945768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5af62360-04c4-44e9-a08d-6b5d42177be4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:32.946462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5af62360-04c4-44e9-a08d-6b5d42177be4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:32.947433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5af62360-04c4-44e9-a08d-6b5d42177be4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:32.948221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5af62360-04c4-44e9-a08d-6b5d42177be4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:32.950048 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-01995319-b41a-4368-b231-00aba63b2af2 tempest-FlavorsAccessTestJSON-2066515596 tempest-FlavorsAccessTestJSON-2066515596-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051712 May 19 04:31:32.951438 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 26/49] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:33.105030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5af62360-04c4-44e9-a08d-6b5d42177be4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:33.121633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5af62360-04c4-44e9-a08d-6b5d42177be4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1293 microversion: 2.1 time: 0.196238 May 19 04:31:33.122260 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 24/50] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:32 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1293 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:33.954654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2027016304", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "availability_zone": "tempest-test_az-1197463533"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:33.969384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:33.970066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:33.971192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:33.971643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:34.060303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:31:34.140224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43dd699f-e9c5-483d-bead-8e32211f7649 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:34.140655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43dd699f-e9c5-483d-bead-8e32211f7649 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:34.147222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43dd699f-e9c5-483d-bead-8e32211f7649 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:34.149222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43dd699f-e9c5-483d-bead-8e32211f7649 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:34.150771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43dd699f-e9c5-483d-bead-8e32211f7649 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:34.151218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43dd699f-e9c5-483d-bead-8e32211f7649 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:34.313786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-43dd699f-e9c5-483d-bead-8e32211f7649 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:34.331775 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43dd699f-e9c5-483d-bead-8e32211f7649 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1299 microversion: 2.1 time: 0.196139 May 19 04:31:34.337122 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 25/51] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:34 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1299 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:34.791088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:31:34.791949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:31:34.792929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:31:34.793830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:31:34.794898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:31:34.835897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:34.837326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:34.838293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:34.846111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:34.937610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Getting quotas for project 217d5eae52bd48c09310b4bbd9372d15. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:31:34.959109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Getting quotas for user 36a7e252b3bf40da89469e42cb668ee0 and project 217d5eae52bd48c09310b4bbd9372d15. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:31:34.986808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:31:34.994525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:31:35.127698 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-44ec1703-b364-4760-8f5f-1a90bcda8614 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.794875 May 19 04:31:35.131953 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:31:35.143654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a6ced355-323f-433f-a4ab-71865de5c581 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:35.145215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a6ced355-323f-433f-a4ab-71865de5c581 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:35.353895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-09f484f0-94e4-44f3-bb0f-906b65075633 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:35.354552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-09f484f0-94e4-44f3-bb0f-906b65075633 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:35.363463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09f484f0-94e4-44f3-bb0f-906b65075633 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:35.364317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09f484f0-94e4-44f3-bb0f-906b65075633 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:35.365739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09f484f0-94e4-44f3-bb0f-906b65075633 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:35.366648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09f484f0-94e4-44f3-bb0f-906b65075633 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:35.383661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a6ced355-323f-433f-a4ab-71865de5c581 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:35.449279 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a6ced355-323f-433f-a4ab-71865de5c581 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1243 microversion: 2.1 time: 0.310466 May 19 04:31:35.461155 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 26/53] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:35 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1243 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:36.039763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-09f484f0-94e4-44f3-bb0f-906b65075633 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:36.059250 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-09f484f0-94e4-44f3-bb0f-906b65075633 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 0.713473 May 19 04:31:36.060219 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 28/54] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:35 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:31:36.437112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-91bcfa95-be0b-4190-93e1-d5a2315e4f96 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1490892477", "id": 2012810704, "os-flavor-access:is_public": "True"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:36.439789 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:36.439789 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:36.473822 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-91bcfa95-be0b-4190-93e1-d5a2315e4f96 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.754963 May 19 04:31:36.481659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7a0f9ecd-a881-47aa-aea5-6c2a29d60b96 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:36.483521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7a0f9ecd-a881-47aa-aea5-6c2a29d60b96 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:36.484326 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 27/55] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:35 2022] POST /compute/v2.1/flavors => generated 430 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:36.500544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c927b3e1-654e-4818-862a-bf0f67c847d7 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:36.501967 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:36.501967 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:36.550530 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c927b3e1-654e-4818-862a-bf0f67c847d7 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/2012810704" status: 202 len: 0 microversion: 2.1 time: 0.064631 May 19 04:31:36.551320 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 28/56] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:31:36 2022] DELETE /compute/v2.1/flavors/2012810704 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:36.561304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5202944a-18c7-445c-8b3b-fa626cabb85f tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:36.602215 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5202944a-18c7-445c-8b3b-fa626cabb85f tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044842 May 19 04:31:36.615010 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 29/57] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:36.625121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82664f31-2da0-4af2-b057-3d220225b55a tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-470643564", "id": 1067359219, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:36.650085 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82664f31-2da0-4af2-b057-3d220225b55a tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.033392 May 19 04:31:36.657923 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 30/58] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:36 2022] POST /compute/v2.1/flavors => generated 416 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:36.666344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51564a37-87d3-4ca6-83c2-b41c0b2c2901 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:36.671940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7a0f9ecd-a881-47aa-aea5-6c2a29d60b96 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:36.683338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7a0f9ecd-a881-47aa-aea5-6c2a29d60b96 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1243 microversion: 2.1 time: 0.219077 May 19 04:31:36.689098 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 29/59] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:36 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1243 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:36.698633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51564a37-87d3-4ca6-83c2-b41c0b2c2901 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.038753 May 19 04:31:36.699536 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 31/60] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:36 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:36.714889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87807915-79ab-47e1-9d7f-52aa81bd295f tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:36.715497 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:36.715497 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:36.759651 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87807915-79ab-47e1-9d7f-52aa81bd295f tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1067359219" status: 202 len: 0 microversion: 2.1 time: 0.048819 May 19 04:31:36.762511 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 30/61] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:31:36 2022] DELETE /compute/v2.1/flavors/1067359219 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:36.774249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c6bcda7-36d2-478e-9413-3293ef27ecc3 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:36.846685 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c6bcda7-36d2-478e-9413-3293ef27ecc3 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078628 May 19 04:31:36.849119 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 32/62] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:36.863979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da9c8f28-f7f4-4f47-9328-d811700f052f tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1864658235", "id": 1816398348, "os-flavor-access:is_public": "True"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:36.865925 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:36.865925 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:36.903539 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da9c8f28-f7f4-4f47-9328-d811700f052f tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.033095 May 19 04:31:36.916420 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 31/63] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:36 2022] POST /compute/v2.1/flavors => generated 429 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:36.920545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ed0c58f-c275-4351-a7bf-d0a4af8e354b tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:36.960132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=14,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:36.970362 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ed0c58f-c275-4351-a7bf-d0a4af8e354b tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1816398348" status: 202 len: 0 microversion: 2.1 time: 0.053293 May 19 04:31:36.974186 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 33/64] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:31:36 2022] DELETE /compute/v2.1/flavors/1816398348 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:31:36.983061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dab230b8-fcd7-475e-a1b5-dc9d1048a70f tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:37.047283 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dab230b8-fcd7-475e-a1b5-dc9d1048a70f tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068032 May 19 04:31:37.060866 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 32/65] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:37.077996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-971ceaf4-74d0-4925-a3b1-da3811085d9d tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1956743089", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:37.081920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9dfe98b5-7bad-4ffd-b033-bc6d2ac3f289 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:37.082548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9dfe98b5-7bad-4ffd-b033-bc6d2ac3f289 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:37.095896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9dfe98b5-7bad-4ffd-b033-bc6d2ac3f289 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:37.096322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9dfe98b5-7bad-4ffd-b033-bc6d2ac3f289 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:37.102895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9dfe98b5-7bad-4ffd-b033-bc6d2ac3f289 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:37.103608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9dfe98b5-7bad-4ffd-b033-bc6d2ac3f289 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:37.117017 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-971ceaf4-74d0-4925-a3b1-da3811085d9d tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.042721 May 19 04:31:37.136139 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 33/66] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:37 2022] POST /compute/v2.1/flavors => generated 507 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:37.159973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4028428a-37f7-4b7a-94ed-ad892da7e4f7 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:37.226861 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4028428a-37f7-4b7a-94ed-ad892da7e4f7 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/465110e7-d876-48ad-bba3-0c3df08c2aa6" status: 202 len: 0 microversion: 2.1 time: 0.079542 May 19 04:31:37.227716 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 34/67] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:31:37 2022] DELETE /compute/v2.1/flavors/465110e7-d876-48ad-bba3-0c3df08c2aa6 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:37.240650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5a9ba02c-a9ca-48c6-ba47-5e63452d47d0 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:37.322412 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5a9ba02c-a9ca-48c6-ba47-5e63452d47d0 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089342 May 19 04:31:37.325737 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 35/68] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:31:37.340432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6b430975-bdcb-44d2-aafd-39e7c5870c3a tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-731935562", "id": "fdd9918d-d56a-4bc4-8d71-1ce43949094e", "os-flavor-access:is_public": "True"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:37.394471 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6b430975-bdcb-44d2-aafd-39e7c5870c3a tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.057566 May 19 04:31:37.395834 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 36/69] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:37 2022] POST /compute/v2.1/flavors => generated 506 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:37.406629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-032b6fa3-16af-4376-bc8e-cd3ce5112b6d tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:37.447055 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-032b6fa3-16af-4376-bc8e-cd3ce5112b6d tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/fdd9918d-d56a-4bc4-8d71-1ce43949094e" status: 202 len: 0 microversion: 2.1 time: 0.043558 May 19 04:31:37.449428 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 37/70] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:31:37 2022] DELETE /compute/v2.1/flavors/fdd9918d-d56a-4bc4-8d71-1ce43949094e => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:31:37.458231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-27ec460d-624d-4eb0-9742-52994516de75 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:37.509743 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-27ec460d-624d-4eb0-9742-52994516de75 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053423 May 19 04:31:37.510300 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 38/71] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:37.526378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-26bd2510-c39d-4e35-83c7-baf26e023338 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-702924817", "id": 1124181279, "os-flavor-access:is_public": "True"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:37.567780 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-26bd2510-c39d-4e35-83c7-baf26e023338 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.044085 May 19 04:31:37.572324 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 39/72] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:37 2022] POST /compute/v2.1/flavors => generated 413 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:37.582321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-53939ed3-1113-4216-a917-0d3dc4f69edd tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:37.599392 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-53939ed3-1113-4216-a917-0d3dc4f69edd tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1124181279" status: 200 len: 413 microversion: 2.1 time: 0.022450 May 19 04:31:37.603408 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 40/73] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:31:37 2022] GET /compute/v2.1/flavors/1124181279 => generated 413 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:31:37.736944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9dfe98b5-7bad-4ffd-b033-bc6d2ac3f289 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:37.758932 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9dfe98b5-7bad-4ffd-b033-bc6d2ac3f289 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 0.685149 May 19 04:31:37.763292 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 34/74] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:37 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:37.779483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f765094-790e-4cd4-85c8-b37e1d3771b9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:37.781201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f765094-790e-4cd4-85c8-b37e1d3771b9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:37.814715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f765094-790e-4cd4-85c8-b37e1d3771b9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:37.815382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f765094-790e-4cd4-85c8-b37e1d3771b9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:37.821294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f765094-790e-4cd4-85c8-b37e1d3771b9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:37.822064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f765094-790e-4cd4-85c8-b37e1d3771b9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:38.002334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f765094-790e-4cd4-85c8-b37e1d3771b9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:38.011434 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f765094-790e-4cd4-85c8-b37e1d3771b9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1235 microversion: 2.1 time: 0.246756 May 19 04:31:38.024039 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 35/75] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:37 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1235 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:38.745265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b7759922-f4a0-4736-91e6-95e1f5a68341 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:38.783257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-20af21d7-330a-4852-b212-8e6dcee58985 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:38.785486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-20af21d7-330a-4852-b212-8e6dcee58985 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:38.809052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20af21d7-330a-4852-b212-8e6dcee58985 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:38.809816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20af21d7-330a-4852-b212-8e6dcee58985 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:38.811995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20af21d7-330a-4852-b212-8e6dcee58985 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:38.812735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20af21d7-330a-4852-b212-8e6dcee58985 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:38.823654 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b7759922-f4a0-4736-91e6-95e1f5a68341 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 1.209709 May 19 04:31:38.837020 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 41/76] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:37 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:38.843668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c0ad9355-c190-475b-8577-ddb2a3d7bf3e tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:38.872109 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c0ad9355-c190-475b-8577-ddb2a3d7bf3e tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1124181279" status: 202 len: 0 microversion: 2.1 time: 0.032817 May 19 04:31:38.879583 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 42/77] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:31:38 2022] DELETE /compute/v2.1/flavors/1124181279 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:38.890534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49d36961-0248-4491-832f-6000d3859c50 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:38.939344 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49d36961-0248-4491-832f-6000d3859c50 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058146 May 19 04:31:38.946767 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 43/78] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:38.966176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-096fb8fe-5b77-4fbb-870a-de948f917f38 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1840247903", "id": 1184663165, "os-flavor-access:is_public": "False"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:38.998119 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-096fb8fe-5b77-4fbb-870a-de948f917f38 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.042468 May 19 04:31:38.999396 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 44/79] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:38 2022] POST /compute/v2.1/flavors => generated 430 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:39.017941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c13aee2-66c3-4b73-92e3-546b0c7e3a78 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "1184663165"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:39.047491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=15,nova_api:INSERT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:39.054242 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-8c13aee2-66c3-4b73-92e3-546b0c7e3a78 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] HTTP exception thrown: Flavor 1184663165 could not be found. May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c13aee2-66c3-4b73-92e3-546b0c7e3a78 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] Request method failure captured: May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 107 May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcgln8fmEqHDGWb6cR5lioPiiZf6oesAT_pW1gwCpopRgIxWpGZ1MpodohMQ7FVVUdoQetkYJyFZFfPMggk1AxySMavVbD7HwiPEQbczij_VBHZHEWYWqlSO3g_17w4Z8Jf9V4Xckom_hFPss30Hxxy0Rux8HWScfL4ygy0XeiOj_W4 May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: b99e5124fecd4fc4a1611c37540981ee May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FlavorsAdminTestJSON-1197732672 May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:31:39.067125 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b99e5124fecd4fc4a1611c37540981ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b99e5124fecd4fc4a1611c37540981ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b99e5124fecd4fc4a1611c37540981ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b99e5124fecd4fc4a1611c37540981ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FlavorsAdminTestJSON-1197732672 May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: b99e5124fecd4fc4a1611c37540981ee May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1197732672 May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FlavorsAdminTestJSON-1197732672-project May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 61716df8d7f34f31940ddd0bd8ab80e8 May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FlavorsAdminTestJSON-1197732672-project May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "test", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "1184663165"}} May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:31:39.077823 n-d-766726-30 devstack@n-api.service[124819]: exception: Flavor 1184663165 could not be found. May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '1184663165'}}} May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 780, in create May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1184663165 could not be found. May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:39.080178 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1184663165 could not be found. May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:39.081671 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:39.083370 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:39.083370 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:31:39.083370 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:31:39.083370 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1184663165 could not be found. May 19 04:31:39.083370 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:39.083370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c13aee2-66c3-4b73-92e3-546b0c7e3a78 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] Returning 400 to user: Flavor 1184663165 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:39.083370 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c13aee2-66c3-4b73-92e3-546b0c7e3a78 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.066860 May 19 04:31:39.083370 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 45/80] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:39 2022] POST /compute/v2.1/servers => generated 81 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 04:31:39.103345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f94383b7-10fb-4205-b0b6-7b2c9a579d38 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.103345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f94383b7-10fb-4205-b0b6-7b2c9a579d38 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:39.112948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f94383b7-10fb-4205-b0b6-7b2c9a579d38 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:39.115078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f94383b7-10fb-4205-b0b6-7b2c9a579d38 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:39.116255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f94383b7-10fb-4205-b0b6-7b2c9a579d38 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:39.120376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f94383b7-10fb-4205-b0b6-7b2c9a579d38 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:39.208179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-20af21d7-330a-4852-b212-8e6dcee58985 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:39.225323 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-20af21d7-330a-4852-b212-8e6dcee58985 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 0.448416 May 19 04:31:39.226312 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 36/81] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:38 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:39.231017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-428ba16d-2331-4278-bf47-5cf7c2a8efe9 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.244463 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:39.244463 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:39.307695 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-428ba16d-2331-4278-bf47-5cf7c2a8efe9 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1184663165" status: 202 len: 0 microversion: 2.1 time: 0.080047 May 19 04:31:39.308293 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 37/82] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:31:39 2022] DELETE /compute/v2.1/flavors/1184663165 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:39.317888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-70fa098b-fa88-47cf-94b1-b38a5940d18d tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.371506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f94383b7-10fb-4205-b0b6-7b2c9a579d38 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:39.387592 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f94383b7-10fb-4205-b0b6-7b2c9a579d38 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1291 microversion: 2.1 time: 0.311068 May 19 04:31:39.390203 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 46/83] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1291 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:39.401859 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-70fa098b-fa88-47cf-94b1-b38a5940d18d tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089154 May 19 04:31:39.411690 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 38/84] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:39.427399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b22719d-aa65-4002-875f-593e21ce531c tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1720735943", "id": 1758092802, "os-flavor-access:is_public": "False"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:39.431405 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:39.431405 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:39.477553 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1b22719d-aa65-4002-875f-593e21ce531c tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.062261 May 19 04:31:39.482410 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 47/85] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:39 2022] POST /compute/v2.1/flavors => generated 415 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:39.518119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e3960d6-0710-49d3-9569-fd38e0773943 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1968178645", "id": 828645929, "os-flavor-access:is_public": "True"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:39.531264 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:39.531264 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:39.586987 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e3960d6-0710-49d3-9569-fd38e0773943 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.099676 May 19 04:31:39.588312 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 39/86] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:39 2022] POST /compute/v2.1/flavors => generated 411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:39.603563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-283a3923-2a43-43ec-aa9f-3760523c7445 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.673585 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-283a3923-2a43-43ec-aa9f-3760523c7445 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.075717 May 19 04:31:39.683089 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 48/87] 10.222.0.58 () {58 vars in 1168 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:39.687945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ef59e17-1e13-45c8-ad3c-8c24b7f93ebe tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.730318 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ef59e17-1e13-45c8-ad3c-8c24b7f93ebe tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.048245 May 19 04:31:39.732428 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 40/88] 10.222.0.58 () {58 vars in 1176 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:31:39.746306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aaffb1cf-c4ed-456b-86ef-c29438504e8e tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.780892 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aaffb1cf-c4ed-456b-86ef-c29438504e8e tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.039160 May 19 04:31:39.784559 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 49/89] 10.222.0.58 () {58 vars in 1170 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:39.796330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-44364efb-ff39-4700-99b5-2115d861fc7b tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.817220 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-44364efb-ff39-4700-99b5-2115d861fc7b tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.024768 May 19 04:31:39.834104 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 41/90] 10.222.0.58 () {58 vars in 1168 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:39.841150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1f95f6ff-5830-45ef-8806-c8fae3890cc4 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.868376 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1f95f6ff-5830-45ef-8806-c8fae3890cc4 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.030967 May 19 04:31:39.871519 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 50/91] 10.222.0.58 () {58 vars in 1168 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:39.889421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-78ec02ca-d685-4068-93ea-0518eb595caf tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.917113 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-78ec02ca-d685-4068-93ea-0518eb595caf tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.031183 May 19 04:31:39.937611 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 42/92] 10.222.0.58 () {58 vars in 1174 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:39.958523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-88c3b579-124f-427d-bc3f-226cebba3c18 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:39.989294 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-88c3b579-124f-427d-bc3f-226cebba3c18 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.038841 May 19 04:31:39.990116 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 51/93] 10.222.0.58 () {58 vars in 1172 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:40.005839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a124604-b39b-4139-9a4e-7a94934321b4 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.106186 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a124604-b39b-4139-9a4e-7a94934321b4 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.104507 May 19 04:31:40.112440 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 43/94] 10.222.0.58 () {58 vars in 1168 bytes} [Thu May 19 04:31:39 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:40.133430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f89fba50-33b3-43b7-b0ad-f38698056673 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.134205 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:40.134205 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:40.201258 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f89fba50-33b3-43b7-b0ad-f38698056673 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/828645929" status: 202 len: 0 microversion: 2.1 time: 0.077348 May 19 04:31:40.202877 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 52/95] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:31:40 2022] DELETE /compute/v2.1/flavors/828645929 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:40.212287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99a0382e-a1a1-4270-8392-5768029d3ad6 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.243531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5bdf723b-6fc7-4b33-9a36-d53119c31c6a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.244163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5bdf723b-6fc7-4b33-9a36-d53119c31c6a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:40.282047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bdf723b-6fc7-4b33-9a36-d53119c31c6a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:40.282601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bdf723b-6fc7-4b33-9a36-d53119c31c6a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:40.283467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bdf723b-6fc7-4b33-9a36-d53119c31c6a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:40.292988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bdf723b-6fc7-4b33-9a36-d53119c31c6a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:40.304435 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99a0382e-a1a1-4270-8392-5768029d3ad6 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.096863 May 19 04:31:40.317564 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 44/96] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:40.328096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a2d63d51-9fab-4652-b100-1ff5cb990133 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.379931 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a2d63d51-9fab-4652-b100-1ff5cb990133 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1758092802" status: 202 len: 0 microversion: 2.1 time: 0.058675 May 19 04:31:40.386499 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 45/97] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:31:40 2022] DELETE /compute/v2.1/flavors/1758092802 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:40.411091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bb70dffc-c3ce-4906-95cc-7541bf828f7e tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.471367 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bb70dffc-c3ce-4906-95cc-7541bf828f7e tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081513 May 19 04:31:40.488068 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 46/98] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:40.499192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-917851fd-7094-4e65-acd6-13beddf9edbe tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.503154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-917851fd-7094-4e65-acd6-13beddf9edbe tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:40.521691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-917851fd-7094-4e65-acd6-13beddf9edbe tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:40.527606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-917851fd-7094-4e65-acd6-13beddf9edbe tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:40.529102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-917851fd-7094-4e65-acd6-13beddf9edbe tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:40.531065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-917851fd-7094-4e65-acd6-13beddf9edbe tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:40.769495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-917851fd-7094-4e65-acd6-13beddf9edbe tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:40.778198 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-917851fd-7094-4e65-acd6-13beddf9edbe tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1297 microversion: 2.1 time: 0.287384 May 19 04:31:40.793454 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 47/99] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:40 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1297 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:40.805346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-75843457-ab78-4afb-a7c2-34ca39f2f3a6 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-713885815", "id": 1559448230, "os-flavor-access:is_public": "False"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:40.807727 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:40.807727 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:40.835579 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-75843457-ab78-4afb-a7c2-34ca39f2f3a6 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.040651 May 19 04:31:40.837408 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 48/100] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:40 2022] POST /compute/v2.1/flavors => generated 414 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:40.848508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99b3a014-0e5d-4067-ad8d-35686cd87993 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.891045 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99b3a014-0e5d-4067-ad8d-35686cd87993 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046983 May 19 04:31:40.904061 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 49/101] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:31:40.909374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d496abd7-e972-4e08-b6e3-eb9e33919cb2 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.946662 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d496abd7-e972-4e08-b6e3-eb9e33919cb2 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041133 May 19 04:31:40.957055 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 50/102] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:40.962934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d8cf403-8788-47dc-9f8d-2db71f99e957 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:40.964034 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:40.964034 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:40.995968 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d8cf403-8788-47dc-9f8d-2db71f99e957 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1559448230" status: 202 len: 0 microversion: 2.1 time: 0.037375 May 19 04:31:40.997289 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 51/103] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:31:40 2022] DELETE /compute/v2.1/flavors/1559448230 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:41.011189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a6003ee6-ebd8-481d-a49a-f9638476ecde tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:41.042350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:41.060865 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a6003ee6-ebd8-481d-a49a-f9638476ecde tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059022 May 19 04:31:41.062009 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 52/104] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:41.105379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5bb8afea-14b2-425e-ae1c-8697b5c735d9 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1496004192", "id": 1273316586, "os-flavor-access:is_public": "True"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:41.144187 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5bb8afea-14b2-425e-ae1c-8697b5c735d9 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.057940 May 19 04:31:41.155501 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 53/105] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:41 2022] POST /compute/v2.1/flavors => generated 414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:31:41.165260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e65f5536-fa24-49f9-a7ab-d1d84222cfa9 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:41.211696 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e65f5536-fa24-49f9-a7ab-d1d84222cfa9 tempest-FlavorsAdminTestJSON-1197732672 tempest-FlavorsAdminTestJSON-1197732672-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.051889 May 19 04:31:41.223700 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 54/106] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:41 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:41.233735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d0edb32b-6f9d-4ee5-9624-e7fa77a3e6d8 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:41.277049 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d0edb32b-6f9d-4ee5-9624-e7fa77a3e6d8 tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1273316586" status: 202 len: 0 microversion: 2.1 time: 0.051400 May 19 04:31:41.281162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 55/107] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:31:41 2022] DELETE /compute/v2.1/flavors/1273316586 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:41.287434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-16aff81d-c1b2-42f4-ba3b-fe4dfb86e2ef tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:41.358742 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-16aff81d-c1b2-42f4-ba3b-fe4dfb86e2ef tempest-FlavorsAdminTestJSON-1959185374 tempest-FlavorsAdminTestJSON-1959185374-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075265 May 19 04:31:41.362570 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 56/108] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:41.700958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5bdf723b-6fc7-4b33-9a36-d53119c31c6a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:41.717240 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5bdf723b-6fc7-4b33-9a36-d53119c31c6a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 1.478541 May 19 04:31:41.718057 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 53/109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:40 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:41.798384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-720a6ce4-1843-4f75-91e5-b31fd076977f tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:41.799508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-720a6ce4-1843-4f75-91e5-b31fd076977f tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:41.812689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-720a6ce4-1843-4f75-91e5-b31fd076977f tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:41.815226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-720a6ce4-1843-4f75-91e5-b31fd076977f tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:41.817503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-720a6ce4-1843-4f75-91e5-b31fd076977f tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:41.818956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-720a6ce4-1843-4f75-91e5-b31fd076977f tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:42.182626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-720a6ce4-1843-4f75-91e5-b31fd076977f tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:42.192836 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-720a6ce4-1843-4f75-91e5-b31fd076977f tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1297 microversion: 2.1 time: 0.400128 May 19 04:31:42.198259 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 57/110] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:41 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1297 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:42.736241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f657f158-9937-4669-9358-f207eee55bce tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:42.736948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f657f158-9937-4669-9358-f207eee55bce tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:42.766540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f657f158-9937-4669-9358-f207eee55bce tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:42.781244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f657f158-9937-4669-9358-f207eee55bce tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:42.782376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f657f158-9937-4669-9358-f207eee55bce tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:42.786452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f657f158-9937-4669-9358-f207eee55bce tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:43.834365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f657f158-9937-4669-9358-f207eee55bce tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:43.856268 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f657f158-9937-4669-9358-f207eee55bce tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 1.125436 May 19 04:31:43.870341 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 54/111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:42 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:43.875325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:43.875984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:43.905100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:43.905563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:43.906498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:43.906966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:44.015356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-56f17470-45f1-49fa-beff-a39cd6da2da7 req-8deb67b8-ac11-4734-aef9-7d5084a8d163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422f36f8-5f4c-4e68-a1ed-cedb6551b55e", "tag": "75359c8f-2454-45d6-bd5c-dde5ad05e3eb"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:44.056268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-56f17470-45f1-49fa-beff-a39cd6da2da7 req-8deb67b8-ac11-4734-aef9-7d5084a8d163 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:44.056705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-56f17470-45f1-49fa-beff-a39cd6da2da7 req-8deb67b8-ac11-4734-aef9-7d5084a8d163 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:44.148664 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-56f17470-45f1-49fa-beff-a39cd6da2da7 req-8deb67b8-ac11-4734-aef9-7d5084a8d163 service nova] Creating event network-changed:75359c8f-2454-45d6-bd5c-dde5ad05e3eb for instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e on n-h2-766726-30 May 19 04:31:44.150907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-56f17470-45f1-49fa-beff-a39cd6da2da7 req-8deb67b8-ac11-4734-aef9-7d5084a8d163 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:31:44.160535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-081df4d0-1f97-47c7-9778-f7036b508959 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:44.161233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-081df4d0-1f97-47c7-9778-f7036b508959 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:44.165844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-081df4d0-1f97-47c7-9778-f7036b508959 None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:44.169733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-081df4d0-1f97-47c7-9778-f7036b508959 None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:44.225249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.rpcapi [None req-081df4d0-1f97-47c7-9778-f7036b508959 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 04:31:44.226833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-081df4d0-1f97-47c7-9778-f7036b508959 None None] Releasing lock "compute-rpcapi-router" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:31:44.288080 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-081df4d0-1f97-47c7-9778-f7036b508959 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.103019 May 19 04:31:44.290229 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 58/112] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:44.875462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82d6d380-9bf0-4516-be6f-1d47a206c4d9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:44.876362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82d6d380-9bf0-4516-be6f-1d47a206c4d9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:44.900996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82d6d380-9bf0-4516-be6f-1d47a206c4d9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:44.904149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:44.905871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82d6d380-9bf0-4516-be6f-1d47a206c4d9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:44.912551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82d6d380-9bf0-4516-be6f-1d47a206c4d9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:44.915780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82d6d380-9bf0-4516-be6f-1d47a206c4d9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:45.435074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=16 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:45.689268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:45.698155 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1339 microversion: 2.1 time: 1.826816 May 19 04:31:45.699678 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 55/113] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:43 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1339 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:45.876674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:45.879723 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2022481e-a290-4194-bd1c-9317bcd80f6b tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003400 May 19 04:31:45.885129 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 56/114] 10.222.0.58 () {56 vars in 885 bytes} [Thu May 19 04:31:45 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 04:31:46.676565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=14 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:46.775234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82d6d380-9bf0-4516-be6f-1d47a206c4d9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:46.802981 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82d6d380-9bf0-4516-be6f-1d47a206c4d9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 1.931118 May 19 04:31:46.803675 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 59/115] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:44 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:31:46.841135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-01eb60d7-2b8a-48f1-9e62-126054c296e6 tempest-FlavorsV255TestJSON-1570783194 tempest-FlavorsV255TestJSON-1570783194-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1622146289", "id": 682606044, "os-flavor-access:is_public": "True"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:46.843240 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:46.843240 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:46.866213 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-01eb60d7-2b8a-48f1-9e62-126054c296e6 tempest-FlavorsV255TestJSON-1570783194 tempest-FlavorsV255TestJSON-1570783194-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.953017 May 19 04:31:46.874138 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 57/116] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:31:45 2022] POST /compute/v2.1/flavors => generated 446 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:31:46.879638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6a8cebfe-1304-4a6f-81ab-afc8835f3a68 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:46.880504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6a8cebfe-1304-4a6f-81ab-afc8835f3a68 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:46.905450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a8cebfe-1304-4a6f-81ab-afc8835f3a68 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:46.905982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a8cebfe-1304-4a6f-81ab-afc8835f3a68 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:46.907192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a8cebfe-1304-4a6f-81ab-afc8835f3a68 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:46.910621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a8cebfe-1304-4a6f-81ab-afc8835f3a68 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:47.020682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-276bca26-7fc5-4c35-961c-b8da0964b7f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1815618532", "ram": 512, "vcpus": 1, "disk": 10, "id": 116950847, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:47.022471 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:47.022471 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:47.045351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-276bca26-7fc5-4c35-961c-b8da0964b7f3 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.230281 May 19 04:31:47.049145 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 60/117] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:31:46 2022] POST /compute/v2.1/flavors => generated 413 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:47.119048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4d0efb02-3bde-4ee3-837a-0f2f1f4dd173 req-63755f35-7a7a-4b6a-b01a-5385b9e8e273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef878e1-99c8-4dd5-ad5b-cdcd2535def1", "tag": "a8cde90f-7fb4-417a-926d-405ce878484e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:47.130154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4d0efb02-3bde-4ee3-837a-0f2f1f4dd173 req-63755f35-7a7a-4b6a-b01a-5385b9e8e273 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:47.130846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4d0efb02-3bde-4ee3-837a-0f2f1f4dd173 req-63755f35-7a7a-4b6a-b01a-5385b9e8e273 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:47.149159 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4d0efb02-3bde-4ee3-837a-0f2f1f4dd173 req-63755f35-7a7a-4b6a-b01a-5385b9e8e273 service nova] Creating event network-changed:a8cde90f-7fb4-417a-926d-405ce878484e for instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 on n-h2-766726-30 May 19 04:31:47.154981 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4d0efb02-3bde-4ee3-837a-0f2f1f4dd173 req-63755f35-7a7a-4b6a-b01a-5385b9e8e273 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106766 May 19 04:31:47.156842 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 61/118] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:47.287076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7797dfc8-e73e-4efa-81c7-dbf2d758d105 tempest-FlavorsV255TestJSON-1368137785 tempest-FlavorsV255TestJSON-1368137785-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.298947 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7797dfc8-e73e-4efa-81c7-dbf2d758d105 tempest-FlavorsV255TestJSON-1368137785 tempest-FlavorsV255TestJSON-1368137785-project] 10.222.0.58 "GET /compute/v2.1/flavors/682606044" status: 200 len: 446 microversion: 2.55 time: 0.140035 May 19 04:31:47.307043 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 62/119] 10.222.0.58 () {60 vars in 1195 bytes} [Thu May 19 04:31:47 2022] GET /compute/v2.1/flavors/682606044 => generated 446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:47.438565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd2019e0-4012-4eda-be8a-3cdfd3574c6e tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.448724 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-bd2019e0-4012-4eda-be8a-3cdfd3574c6e tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] HTTP exception thrown: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd2019e0-4012-4eda-be8a-3cdfd3574c6e tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Request method failure captured: May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/flavors/116950847/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcguf4drdV6PPiT9vPncnIauuGtetZYw4GeS8JqDp5W2WFlvStprukK_7tfgi32uCA2A413qf2gx4o8MSs-oA8pKVzkd-DE_bT56i2CORl6xSzKw-5_BlgS7TdXlbZu_eYi72Jaa0BLnRnXeIKnZ8vBeQMYMRezPsmh8G3YYmZ28C0Q May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a59bae5ae6534ca0afcedb2488f693a3 May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:31:47.451262 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a59bae5ae6534ca0afcedb2488f693a3 May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 8caca84f5142426fa0c40d1bc7a76404 May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:31:47.452730 n-d-766726-30 devstack@n-api.service[124818]: exception: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'flavor_id': '116950847', 'id': 'hw:cpu_thread_policy'} May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.453488 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.454806 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.454806 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.454806 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.454806 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:31:47.454806 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:31:47.454806 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. May 19 04:31:47.454806 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.457794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd2019e0-4012-4eda-be8a-3cdfd3574c6e tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Returning 404 to user: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:47.459188 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bd2019e0-4012-4eda-be8a-3cdfd3574c6e tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] 10.222.0.58 "GET /compute/v2.1/flavors/116950847/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.150772 May 19 04:31:47.459838 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 63/120] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:31:47 2022] GET /compute/v2.1/flavors/116950847/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:47.466024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-837f1123-07c9-4f56-a6a6-17625f3a5709 tempest-FlavorsV255TestJSON-1570783194 tempest-FlavorsV255TestJSON-1570783194-project-admin] Action: 'update', calling method: .version_select at 0x7fd318e07f70>, body: {"flavor": {"description": "new"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:47.475974 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:47.475974 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:47.503430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:47.533443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6a8cebfe-1304-4a6f-81ab-afc8835f3a68 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:47.534016 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-837f1123-07c9-4f56-a6a6-17625f3a5709 tempest-FlavorsV255TestJSON-1570783194 tempest-FlavorsV255TestJSON-1570783194-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/682606044" status: 200 len: 447 microversion: 2.55 time: 0.061754 May 19 04:31:47.541857 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 64/121] 10.222.0.58 () {62 vars in 1215 bytes} [Thu May 19 04:31:47 2022] PUT /compute/v2.1/flavors/682606044 => generated 447 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:47.546928 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6a8cebfe-1304-4a6f-81ab-afc8835f3a68 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1339 microversion: 2.1 time: 0.677839 May 19 04:31:47.548706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ddebc3e-bcae-4c39-bf17-38bdc72dbc53 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:47.549767 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 58/122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:46 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1339 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:47.550596 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:47.550596 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:47.551759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2ddebc3e-bcae-4c39-bf17-38bdc72dbc53 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '8caca84f5142426fa0c40d1bc7a76404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59bae5ae6534ca0afcedb2488f693a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:47.555546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30f3ca94-51d0-4fca-bf25-ac0a9e7b9c15 tempest-FlavorsV255TestJSON-1368137785 tempest-FlavorsV255TestJSON-1368137785-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ddebc3e-bcae-4c39-bf17-38bdc72dbc53 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Request method failure captured: May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/flavors/116950847/os-extra_specs HTTP/1.1 May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 66 May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcguf4drdV6PPiT9vPncnIauuGtetZYw4GeS8JqDp5W2WFlvStprukK_7tfgi32uCA2A413qf2gx4o8MSs-oA8pKVzkd-DE_bT56i2CORl6xSzKw-5_BlgS7TdXlbZu_eYi72Jaa0BLnRnXeIKnZ8vBeQMYMRezPsmh8G3YYmZ28C0Q May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a59bae5ae6534ca0afcedb2488f693a3 May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:31:47.556033 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a59bae5ae6534ca0afcedb2488f693a3 May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 8caca84f5142426fa0c40d1bc7a76404 May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} May 19 04:31:47.557366 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'flavor_id': '116950847', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:47.558156 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 19 04:31:47.559102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.561908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ddebc3e-bcae-4c39-bf17-38bdc72dbc53 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:47.563909 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ddebc3e-bcae-4c39-bf17-38bdc72dbc53 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] 10.222.0.58 "POST /compute/v2.1/flavors/116950847/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020321 May 19 04:31:47.565339 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 65/123] 10.222.0.58 () {60 vars in 1220 bytes} [Thu May 19 04:31:47 2022] POST /compute/v2.1/flavors/116950847/os-extra_specs => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:47.575812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-54bfb5c4-7a3e-4c08-add5-ec724cedf893 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:47.611938 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-54bfb5c4-7a3e-4c08-add5-ec724cedf893 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/116950847/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041584 May 19 04:31:47.613765 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 66/124] 10.222.0.58 () {60 vars in 1220 bytes} [Thu May 19 04:31:47 2022] POST /compute/v2.1/flavors/116950847/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:31:47.623463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99701d2f-f7a1-44a5-ad22-6baebf849a1a tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.624412 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:47.624412 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:47.625619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99701d2f-f7a1-44a5-ad22-6baebf849a1a tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '8caca84f5142426fa0c40d1bc7a76404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59bae5ae6534ca0afcedb2488f693a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99701d2f-f7a1-44a5-ad22-6baebf849a1a tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Request method failure captured: May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes HTTP/1.1 May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcguf4drdV6PPiT9vPncnIauuGtetZYw4GeS8JqDp5W2WFlvStprukK_7tfgi32uCA2A413qf2gx4o8MSs-oA8pKVzkd-DE_bT56i2CORl6xSzKw-5_BlgS7TdXlbZu_eYi72Jaa0BLnRnXeIKnZ8vBeQMYMRezPsmh8G3YYmZ28C0Q May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a59bae5ae6534ca0afcedb2488f693a3 May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:31:47.627368 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a59bae5ae6534ca0afcedb2488f693a3 May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 8caca84f5142426fa0c40d1bc7a76404 May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:31:47.628691 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'flavor_id': '116950847', 'id': 'hw:numa_nodes'} May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:47.629441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 19 04:31:47.630641 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.635671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99701d2f-f7a1-44a5-ad22-6baebf849a1a tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:47.636783 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99701d2f-f7a1-44a5-ad22-6baebf849a1a tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] 10.222.0.58 "DELETE /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017460 May 19 04:31:47.643386 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 67/125] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:31:47 2022] DELETE /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:47.650819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b94a6b6d-203d-4159-8ccc-356fc9e0ea91 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:47.680157 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-30f3ca94-51d0-4fca-bf25-ac0a9e7b9c15 tempest-FlavorsV255TestJSON-1368137785 tempest-FlavorsV255TestJSON-1368137785-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6146 microversion: 2.55 time: 0.128623 May 19 04:31:47.680668 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b94a6b6d-203d-4159-8ccc-356fc9e0ea91 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/116950847/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035029 May 19 04:31:47.683067 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 59/126] 10.222.0.58 () {60 vars in 1186 bytes} [Thu May 19 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 6146 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:47.685121 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 68/127] 10.222.0.58 () {60 vars in 1220 bytes} [Thu May 19 04:31:47 2022] POST /compute/v2.1/flavors/116950847/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:47.709501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea3b5dfb-5d5a-486f-a7b5-4906cb540498 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:47.713722 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:47.713722 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:47.715760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-04c1f751-31cf-4631-856b-6667f3f86e06 tempest-FlavorsV255TestJSON-1368137785 tempest-FlavorsV255TestJSON-1368137785-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.719536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ea3b5dfb-5d5a-486f-a7b5-4906cb540498 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '8caca84f5142426fa0c40d1bc7a76404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59bae5ae6534ca0afcedb2488f693a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea3b5dfb-5d5a-486f-a7b5-4906cb540498 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Request method failure captured: May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: request: PUT /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes HTTP/1.1 May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 22 May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcguf4drdV6PPiT9vPncnIauuGtetZYw4GeS8JqDp5W2WFlvStprukK_7tfgi32uCA2A413qf2gx4o8MSs-oA8pKVzkd-DE_bT56i2CORl6xSzKw-5_BlgS7TdXlbZu_eYi72Jaa0BLnRnXeIKnZ8vBeQMYMRezPsmh8G3YYmZ28C0Q May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a59bae5ae6534ca0afcedb2488f693a3 May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:31:47.721936 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a59bae5ae6534ca0afcedb2488f693a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a59bae5ae6534ca0afcedb2488f693a3 May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 8caca84f5142426fa0c40d1bc7a76404 May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: {"hw:numa_nodes": "1"} May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:31:47.723069 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'flavor_id': '116950847', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:47.723788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 19 04:31:47.726304 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.734311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea3b5dfb-5d5a-486f-a7b5-4906cb540498 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:47.735392 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ea3b5dfb-5d5a-486f-a7b5-4906cb540498 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596 tempest-FlavorsExtraSpecsNegativeTestJSON-195316596-project] 10.222.0.58 "PUT /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.040448 May 19 04:31:47.737769 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 69/128] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:31:47 2022] PUT /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:47.748416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-992196df-879d-4820-8806-945b12330490 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.760371 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-992196df-879d-4820-8806-945b12330490 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] HTTP exception thrown: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-992196df-879d-4820-8806-945b12330490 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Request method failure captured: May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/flavors/116950847/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcgxC0VgopTORUENFGLXDORLxaZwL_tC34qTZKBac8uzcZivnYT2ofrGQ2t1_eeu0QzDLiqvzptVZPsKjpMku_xHxJC5M9iSSsTYMrD07g-k1lG5zW3xNSphn33N1x9zrhpjzeCP72C1-evRZh0wQs1uw0Kmr14KM2kLrtd9kECfVCE May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 550a2e3754584acfb2726deb9f3d5635 May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:31:47.763079 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 550a2e3754584acfb2726deb9f3d5635 May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 51d62ade2a834a36a913dc96573d5533 May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:31:47.764477 n-d-766726-30 devstack@n-api.service[124818]: exception: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'flavor_id': '116950847', 'id': 'hw:cpu_thread_policy'} May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.765276 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.766659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.766659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.766659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.766659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:31:47.766659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:31:47.766659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. May 19 04:31:47.766659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.771227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-992196df-879d-4820-8806-945b12330490 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Returning 404 to user: Flavor 116950847 has no extra specs with key hw:cpu_thread_policy. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:47.773717 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-992196df-879d-4820-8806-945b12330490 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/116950847/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.028840 May 19 04:31:47.775018 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 70/129] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:31:47 2022] DELETE /compute/v2.1/flavors/116950847/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:47.787328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-10cc6be5-310a-457e-a453-be67edb322e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:47.793335 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-04c1f751-31cf-4631-856b-6667f3f86e06 tempest-FlavorsV255TestJSON-1368137785 tempest-FlavorsV255TestJSON-1368137785-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3404 microversion: 2.55 time: 0.090406 May 19 04:31:47.794930 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 60/130] 10.222.0.58 () {60 vars in 1165 bytes} [Thu May 19 04:31:47 2022] GET /compute/v2.1/flavors => generated 3404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:47.796256 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-10cc6be5-310a-457e-a453-be67edb322e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] HTTP exception thrown: Request body and URI mismatch May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-10cc6be5-310a-457e-a453-be67edb322e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Request method failure captured: May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: request: PUT /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes HTTP/1.1 May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 27 May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcgxC0VgopTORUENFGLXDORLxaZwL_tC34qTZKBac8uzcZivnYT2ofrGQ2t1_eeu0QzDLiqvzptVZPsKjpMku_xHxJC5M9iSSsTYMrD07g-k1lG5zW3xNSphn33N1x9zrhpjzeCP72C1-evRZh0wQs1uw0Kmr14KM2kLrtd9kECfVCE May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 550a2e3754584acfb2726deb9f3d5635 May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:31:47.800220 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 550a2e3754584acfb2726deb9f3d5635 May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 51d62ade2a834a36a913dc96573d5533 May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: {"hw:cpu_policy": "shared"} May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:31:47.801831 n-d-766726-30 devstack@n-api.service[124818]: exception: Request body and URI mismatch May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'flavor_id': '116950847', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.802578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.805201 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:31:47.805201 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:31:47.805201 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch May 19 04:31:47.805201 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.805201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-10cc6be5-310a-457e-a453-be67edb322e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:47.805853 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-10cc6be5-310a-457e-a453-be67edb322e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.020859 May 19 04:31:47.810677 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 71/131] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:31:47 2022] PUT /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes => generated 73 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 04:31:47.816002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d98c01bf-f8a8-4d8e-a1ce-ab37a78ffc58 tempest-FlavorsV255TestJSON-1570783194 tempest-FlavorsV255TestJSON-1570783194-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.816962 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:47.816962 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:47.825119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c8af45e-7808-4f62-a0cb-dbad8ff2976a tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:47.840521 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d98c01bf-f8a8-4d8e-a1ce-ab37a78ffc58 tempest-FlavorsV255TestJSON-1570783194 tempest-FlavorsV255TestJSON-1570783194-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/682606044" status: 202 len: 0 microversion: 2.55 time: 0.029979 May 19 04:31:47.841447 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 61/132] 10.222.0.58 () {60 vars in 1198 bytes} [Thu May 19 04:31:47 2022] DELETE /compute/v2.1/flavors/682606044 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:31:47.848600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1959a57a-bda7-494e-9b71-5af1eee70b4f tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.849874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1959a57a-bda7-494e-9b71-5af1eee70b4f tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:47.858714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1959a57a-bda7-494e-9b71-5af1eee70b4f tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:47.859175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1959a57a-bda7-494e-9b71-5af1eee70b4f tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c8af45e-7808-4f62-a0cb-dbad8ff2976a tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Request method failure captured: May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: request: PUT /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes HTTP/1.1 May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 49 May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcgxC0VgopTORUENFGLXDORLxaZwL_tC34qTZKBac8uzcZivnYT2ofrGQ2t1_eeu0QzDLiqvzptVZPsKjpMku_xHxJC5M9iSSsTYMrD07g-k1lG5zW3xNSphn33N1x9zrhpjzeCP72C1-evRZh0wQs1uw0Kmr14KM2kLrtd9kECfVCE May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 550a2e3754584acfb2726deb9f3d5635 May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:31:47.859486 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_550a2e3754584acfb2726deb9f3d5635"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 550a2e3754584acfb2726deb9f3d5635 May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 51d62ade2a834a36a913dc96573d5533 May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} May 19 04:31:47.860610 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'flavor_id': '116950847', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'minProperties': 1, May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'type': ['string', May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'number']}}, May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance: May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} May 19 04:31:47.861667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.862850 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:47.865231 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:47.865231 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:47.865231 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:31:47.865231 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:31:47.865231 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 19 04:31:47.865231 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:47.865231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c8af45e-7808-4f62-a0cb-dbad8ff2976a tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:47.868229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1959a57a-bda7-494e-9b71-5af1eee70b4f tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:47.868229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1959a57a-bda7-494e-9b71-5af1eee70b4f tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:47.868637 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c8af45e-7808-4f62-a0cb-dbad8ff2976a tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.046949 May 19 04:31:47.868637 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 72/133] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:31:47 2022] PUT /compute/v2.1/flavors/116950847/os-extra_specs/hw:numa_nodes => generated 117 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:31:47.871864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6849cfb3-5802-45a2-a61e-5c4bfd131c2c tempest-FlavorsV255TestJSON-1570783194 tempest-FlavorsV255TestJSON-1570783194-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.917053 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6849cfb3-5802-45a2-a61e-5c4bfd131c2c tempest-FlavorsV255TestJSON-1570783194 tempest-FlavorsV255TestJSON-1570783194-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5709 microversion: 2.55 time: 0.053725 May 19 04:31:47.918306 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 73/134] 10.222.0.58 () {60 vars in 1186 bytes} [Thu May 19 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 5709 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:47.938527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f481666e-fdac-4d86-92d8-367509923223 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:47.940672 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:47.940672 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:47.975586 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f481666e-fdac-4d86-92d8-367509923223 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/116950847" status: 202 len: 0 microversion: 2.1 time: 0.056033 May 19 04:31:47.976770 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 74/135] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:31:47 2022] DELETE /compute/v2.1/flavors/116950847 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:31:47.984588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fa2529a1-a6e0-467b-8ec3-299e75b570cc tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:48.016678 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fa2529a1-a6e0-467b-8ec3-299e75b570cc tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264 tempest-FlavorsExtraSpecsNegativeTestJSON-1631759264-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035493 May 19 04:31:48.028015 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 75/136] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:31:48.082189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1959a57a-bda7-494e-9b71-5af1eee70b4f tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:48.093761 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1959a57a-bda7-494e-9b71-5af1eee70b4f tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 0.250983 May 19 04:31:48.095146 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 62/137] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:47 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:48.563395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-591c95c6-fe30-478b-b827-91843d909697 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:48.564123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-591c95c6-fe30-478b-b827-91843d909697 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:48.577862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-591c95c6-fe30-478b-b827-91843d909697 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:48.589793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-591c95c6-fe30-478b-b827-91843d909697 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:48.590870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-591c95c6-fe30-478b-b827-91843d909697 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:48.591455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-591c95c6-fe30-478b-b827-91843d909697 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:49.112466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-313d0a4b-e631-42c8-b61a-4868887a8587 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:49.113208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-313d0a4b-e631-42c8-b61a-4868887a8587 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:49.124775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-313d0a4b-e631-42c8-b61a-4868887a8587 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:49.125348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-313d0a4b-e631-42c8-b61a-4868887a8587 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:49.126480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-313d0a4b-e631-42c8-b61a-4868887a8587 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:49.127224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-313d0a4b-e631-42c8-b61a-4868887a8587 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:49.420252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-591c95c6-fe30-478b-b827-91843d909697 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:49.432457 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-591c95c6-fe30-478b-b827-91843d909697 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1339 microversion: 2.1 time: 0.871511 May 19 04:31:49.433094 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 76/138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:48 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1339 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:49.760478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-313d0a4b-e631-42c8-b61a-4868887a8587 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:49.776527 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-313d0a4b-e631-42c8-b61a-4868887a8587 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 0.662721 May 19 04:31:49.778920 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 63/139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:49 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:50.450463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ab3dd2d0-24c3-4774-954e-947c517d8d00 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:50.451097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ab3dd2d0-24c3-4774-954e-947c517d8d00 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:50.463723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab3dd2d0-24c3-4774-954e-947c517d8d00 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:50.464192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab3dd2d0-24c3-4774-954e-947c517d8d00 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:50.464991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab3dd2d0-24c3-4774-954e-947c517d8d00 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:50.465458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab3dd2d0-24c3-4774-954e-947c517d8d00 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:50.794949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-863ee676-d201-4c06-a059-f17ed10b08d7 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:50.796417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-863ee676-d201-4c06-a059-f17ed10b08d7 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:50.818476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-863ee676-d201-4c06-a059-f17ed10b08d7 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:50.819851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-863ee676-d201-4c06-a059-f17ed10b08d7 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:50.822346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-863ee676-d201-4c06-a059-f17ed10b08d7 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:50.825111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-863ee676-d201-4c06-a059-f17ed10b08d7 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:51.360813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab3dd2d0-24c3-4774-954e-947c517d8d00 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:51.375471 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ab3dd2d0-24c3-4774-954e-947c517d8d00 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1339 microversion: 2.1 time: 0.929644 May 19 04:31:51.380466 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 77/140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:50 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1339 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:51.650855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-863ee676-d201-4c06-a059-f17ed10b08d7 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:51.665153 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-863ee676-d201-4c06-a059-f17ed10b08d7 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 0.874351 May 19 04:31:51.670140 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 64/141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:50 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:52.397525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bbbda27c-217b-41d3-bbf2-e5cb55f7c8ad tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:52.398723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bbbda27c-217b-41d3-bbf2-e5cb55f7c8ad tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:52.405191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bbbda27c-217b-41d3-bbf2-e5cb55f7c8ad tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:52.405645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bbbda27c-217b-41d3-bbf2-e5cb55f7c8ad tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:52.417806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bbbda27c-217b-41d3-bbf2-e5cb55f7c8ad tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:52.418303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bbbda27c-217b-41d3-bbf2-e5cb55f7c8ad tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:52.683360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f89ba2b8-64f6-41d3-88b4-f64d6f4bce3e tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:52.683997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f89ba2b8-64f6-41d3-88b4-f64d6f4bce3e tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:52.696325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f89ba2b8-64f6-41d3-88b4-f64d6f4bce3e tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:52.697317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f89ba2b8-64f6-41d3-88b4-f64d6f4bce3e tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:52.698171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f89ba2b8-64f6-41d3-88b4-f64d6f4bce3e tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:52.700486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f89ba2b8-64f6-41d3-88b4-f64d6f4bce3e tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:52.779538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bbbda27c-217b-41d3-bbf2-e5cb55f7c8ad tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:52.783577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:52.822577 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bbbda27c-217b-41d3-bbf2-e5cb55f7c8ad tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1339 microversion: 2.1 time: 0.396276 May 19 04:31:52.834149 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 78/142] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:52 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1339 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:53.421671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f89ba2b8-64f6-41d3-88b4-f64d6f4bce3e tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:53.431063 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f89ba2b8-64f6-41d3-88b4-f64d6f4bce3e tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 0.752335 May 19 04:31:53.443420 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 65/143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:52 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:53.474049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1721964164", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "61be5a1b-718f-4838-b8d3-c8b42b1b073f"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:53.547646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] validate_networks() for [('61be5a1b-718f-4838-b8d3-c8b42b1b073f', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:31:54.065554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d058440b-f530-463f-ab07-3641d01e2729 req-dca9ae96-0b3e-4154-a5de-6280828bda31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422f36f8-5f4c-4e68-a1ed-cedb6551b55e", "name": "network-vif-plugged", "status": "completed", "tag": "75359c8f-2454-45d6-bd5c-dde5ad05e3eb"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:54.078692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d058440b-f530-463f-ab07-3641d01e2729 req-dca9ae96-0b3e-4154-a5de-6280828bda31 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:54.079140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d058440b-f530-463f-ab07-3641d01e2729 req-dca9ae96-0b3e-4154-a5de-6280828bda31 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:54.101705 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d058440b-f530-463f-ab07-3641d01e2729 req-dca9ae96-0b3e-4154-a5de-6280828bda31 service nova] Creating event network-vif-plugged:75359c8f-2454-45d6-bd5c-dde5ad05e3eb for instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e on n-h2-766726-30 May 19 04:31:54.102238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d058440b-f530-463f-ab07-3641d01e2729 req-dca9ae96-0b3e-4154-a5de-6280828bda31 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:31:54.103526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-647a88dd-fbb2-4848-bb03-ade4da248a8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:54.104141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-647a88dd-fbb2-4848-bb03-ade4da248a8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:54.105137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-647a88dd-fbb2-4848-bb03-ade4da248a8a None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:54.105761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-647a88dd-fbb2-4848-bb03-ade4da248a8a None None] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:54.115179 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.compute.rpcapi [None req-647a88dd-fbb2-4848-bb03-ade4da248a8a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 04:31:54.116274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-647a88dd-fbb2-4848-bb03-ade4da248a8a None None] Releasing lock "compute-rpcapi-router" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:31:54.135113 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-647a88dd-fbb2-4848-bb03-ade4da248a8a None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359927 May 19 04:31:54.135929 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 66/144] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:31:54.145754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0010de42-5704-4c77-ad53-33b62ae16dda tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:54.146607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0010de42-5704-4c77-ad53-33b62ae16dda tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:54.153375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0010de42-5704-4c77-ad53-33b62ae16dda tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:54.154098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0010de42-5704-4c77-ad53-33b62ae16dda tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:54.154873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0010de42-5704-4c77-ad53-33b62ae16dda tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:54.155575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0010de42-5704-4c77-ad53-33b62ae16dda tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:54.206668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:54.343115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0010de42-5704-4c77-ad53-33b62ae16dda tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:54.354235 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0010de42-5704-4c77-ad53-33b62ae16dda tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1339 microversion: 2.1 time: 0.215841 May 19 04:31:54.355470 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 67/145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:54 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1339 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:54.786776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a691486e-c0f6-426e-a0bf-fb58e8422c5f tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Calling method '.version_select at 0x7fd316a04940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:54.788101 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:54.788101 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:54.789351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a691486e-c0f6-426e-a0bf-fb58e8422c5f tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:54.789862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a691486e-c0f6-426e-a0bf-fb58e8422c5f tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:54.790645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a691486e-c0f6-426e-a0bf-fb58e8422c5f tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:54.792675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a691486e-c0f6-426e-a0bf-fb58e8422c5f tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:54.821231 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a691486e-c0f6-426e-a0bf-fb58e8422c5f tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.399745 May 19 04:31:54.822097 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 68/146] 10.222.0.58 () {58 vars in 1127 bytes} [Thu May 19 04:31:54 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:54.826978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-85ce20bd-9edd-4c60-8752-122045eaac65 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:54.827898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-85ce20bd-9edd-4c60-8752-122045eaac65 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:54.834220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85ce20bd-9edd-4c60-8752-122045eaac65 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:54.834843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85ce20bd-9edd-4c60-8752-122045eaac65 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:54.836222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85ce20bd-9edd-4c60-8752-122045eaac65 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:54.836656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85ce20bd-9edd-4c60-8752-122045eaac65 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:55.053352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-85ce20bd-9edd-4c60-8752-122045eaac65 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:55.070172 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-85ce20bd-9edd-4c60-8752-122045eaac65 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 0.245895 May 19 04:31:55.071844 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 69/147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:54 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:55.180842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:31:55.182267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:31:55.182977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:31:55.183926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:31:55.184773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:31:55.195538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:55.196265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:55.197558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:55.197643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:55.216584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Getting quotas for project 6d01f77aa473464b8e32d47e9b9d2a98. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:31:55.221205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Getting quotas for user 249e284f0cfe4ecda820efeb5956701f and project 6d01f77aa473464b8e32d47e9b9d2a98. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:31:55.239400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:31:55.243361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:31:55.293755 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b464c5da-cfd9-4beb-9552-1a79d7620c86 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.162501 May 19 04:31:55.295533 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 79/148] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:31:55.473284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3229e9bf-cd79-4b4e-ab3c-c182f871bf4b tempest-FlavorMetadataValidation-83400102 tempest-FlavorMetadataValidation-83400102-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-705652769", "id": 550715112, "os-flavor-access:is_public": "True"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:55.474801 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:55.474801 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:55.502925 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3229e9bf-cd79-4b4e-ab3c-c182f871bf4b tempest-FlavorMetadataValidation-83400102 tempest-FlavorMetadataValidation-83400102-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.428079 May 19 04:31:55.506781 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 70/149] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:31:55 2022] POST /compute/v2.1/flavors => generated 467 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:55.524978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c03feb8-97d1-47a2-b853-c07186fa1610 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:55.526465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c03feb8-97d1-47a2-b853-c07186fa1610 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:55.635482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c03feb8-97d1-47a2-b853-c07186fa1610 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:55.643419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c03feb8-97d1-47a2-b853-c07186fa1610 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:55.644927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c03feb8-97d1-47a2-b853-c07186fa1610 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:55.646341 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c03feb8-97d1-47a2-b853-c07186fa1610 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1262 microversion: 2.25 time: 0.135679 May 19 04:31:55.646625 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 71/150] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:31:55 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1262 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:55.661601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-51e3f935-930f-4a79-b7f2-8b657eb32de0 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:55.672594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-51e3f935-930f-4a79-b7f2-8b657eb32de0 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:55.688408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51e3f935-930f-4a79-b7f2-8b657eb32de0 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:55.691028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51e3f935-930f-4a79-b7f2-8b657eb32de0 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:55.692264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51e3f935-930f-4a79-b7f2-8b657eb32de0 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:55.692931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51e3f935-930f-4a79-b7f2-8b657eb32de0 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:55.984980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-51e3f935-930f-4a79-b7f2-8b657eb32de0 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:55.999731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bbe5cc16-8ef7-45c9-9ee3-c7a9efdd8f9c tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Calling method '.version_select at 0x7fd3168fb4c0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:56.003755 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:56.003755 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:56.006707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bbe5cc16-8ef7-45c9-9ee3-c7a9efdd8f9c tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'afa6b18286ac49e38d7f7456996bd301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66940bdf4f624a57a7e57777d22b4534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:56.015108 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-51e3f935-930f-4a79-b7f2-8b657eb32de0 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1339 microversion: 2.1 time: 0.360551 May 19 04:31:56.017438 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 72/151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:55 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1339 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:56.023956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c41b5d5d-6f48-40ba-9361-095b11728736 tempest-FlavorMetadataValidation-83400102 tempest-FlavorMetadataValidation-83400102-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:56.025628 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:56.025628 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bbe5cc16-8ef7-45c9-9ee3-c7a9efdd8f9c tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Request method failure captured: May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-hosts HTTP/1.1 May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcg3VtZ3-UlKRo_nSIcZqZmBrG3nDhxJyrSo0EZPKKYkW_jq5EvzQlAHS6SsTJfesppfg_l3pLSk9wkPLk_N3DOV1MWiUAwJQtYOEUMMhL5C8o7MnZsSymH870etTeymMRcDh1M0qjbt3IDiumu55keLP2HhX1sOsywAGN4HuUCLkJg May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:31:56.028903 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: afa6b18286ac49e38d7f7456996bd301 May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: action_args: {} May 19 04:31:56.030283 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:56.031376 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 19 04:31:56.032599 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.033566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bbe5cc16-8ef7-45c9-9ee3-c7a9efdd8f9c tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:56.033566 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bbe5cc16-8ef7-45c9-9ee3-c7a9efdd8f9c tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.734689 May 19 04:31:56.033566 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 80/152] 10.222.0.58 () {58 vars in 1127 bytes} [Thu May 19 04:31:55 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 736 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:56.043306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7f9dfd89-8492-451f-850e-e7d9a2746844 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Calling method '.version_select at 0x7fd318d281f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:56.045438 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:56.045438 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:56.047235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7f9dfd89-8492-451f-850e-e7d9a2746844 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'afa6b18286ac49e38d7f7456996bd301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66940bdf4f624a57a7e57777d22b4534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7f9dfd89-8492-451f-850e-e7d9a2746844 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Request method failure captured: May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-hosts/n-d-766726-30/reboot HTTP/1.1 May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcg3VtZ3-UlKRo_nSIcZqZmBrG3nDhxJyrSo0EZPKKYkW_jq5EvzQlAHS6SsTJfesppfg_l3pLSk9wkPLk_N3DOV1MWiUAwJQtYOEUMMhL5C8o7MnZsSymH870etTeymMRcDh1M0qjbt3IDiumu55keLP2HhX1sOsywAGN4HuUCLkJg May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:31:56.049132 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: afa6b18286ac49e38d7f7456996bd301 May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'n-d-766726-30'} May 19 04:31:56.050350 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:56.051170 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 19 04:31:56.052295 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.054079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7f9dfd89-8492-451f-850e-e7d9a2746844 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:56.055067 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7f9dfd89-8492-451f-850e-e7d9a2746844 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-766726-30/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016522 May 19 04:31:56.056078 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 81/153] 10.222.0.58 () {58 vars in 1190 bytes} [Thu May 19 04:31:56 2022] GET /compute/v2.1/os-hosts/n-d-766726-30/reboot => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:56.071478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6adba1a0-1c4e-4ee7-abd1-18c46b2700d7 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Calling method '.version_select at 0x7fd3168fb9d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:56.092338 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-6adba1a0-1c4e-4ee7-abd1-18c46b2700d7 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6adba1a0-1c4e-4ee7-abd1-18c46b2700d7 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Request method failure captured: May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcg6GPucEly2SuXBgY_iG4L7fCvhvySWQ4Wsu2F9_LXwJDirSXKtwEEv4bqhfRCdjNvCTqLbZ2gaIYEc6d4n2Sbx2IylhwOKdL08enSPf-aHMV7F27XV-VwN3DqEPaa84EAqVtWjfwYmpNexAELGBvktajoFOcf3uJvXfwxz6vHnWRc May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:31:56.124051 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 6572612605dd42da86f00e26e768d676 May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'nonexistent_hostname'} May 19 04:31:56.125225 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:31:56.125911 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 19 04:31:56.126943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.128682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:56.131690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6adba1a0-1c4e-4ee7-abd1-18c46b2700d7 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:56.133710 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6adba1a0-1c4e-4ee7-abd1-18c46b2700d7 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.069099 May 19 04:31:56.135162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 82/154] 10.222.0.58 () {58 vars in 1211 bytes} [Thu May 19 04:31:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:31:56.156882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-973bd031-dbb0-493d-869f-ded1bfa3949b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:56.160763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-973bd031-dbb0-493d-869f-ded1bfa3949b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:56.176478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-973bd031-dbb0-493d-869f-ded1bfa3949b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:56.176952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-973bd031-dbb0-493d-869f-ded1bfa3949b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:56.180807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-973bd031-dbb0-493d-869f-ded1bfa3949b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:56.181296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-973bd031-dbb0-493d-869f-ded1bfa3949b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:56.446732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c41b5d5d-6f48-40ba-9361-095b11728736 tempest-FlavorMetadataValidation-83400102 tempest-FlavorMetadataValidation-83400102-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/550715112/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.427546 May 19 04:31:56.452557 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 73/155] 10.222.0.58 () {62 vars in 1261 bytes} [Thu May 19 04:31:56 2022] POST /compute/v2.1/flavors/550715112/os-extra_specs => generated 62 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:56.479226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b4b1cff4-18ac-418f-9487-6c6ec62e1694 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Calling method '.version_select at 0x7fd3169ca1f0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:56.480176 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:56.480176 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:56.487034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b4b1cff4-18ac-418f-9487-6c6ec62e1694 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'afa6b18286ac49e38d7f7456996bd301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66940bdf4f624a57a7e57777d22b4534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b4b1cff4-18ac-418f-9487-6c6ec62e1694 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Request method failure captured: May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hosts/n-d-766726-30 HTTP/1.1 May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg3VtZ3-UlKRo_nSIcZqZmBrG3nDhxJyrSo0EZPKKYkW_jq5EvzQlAHS6SsTJfesppfg_l3pLSk9wkPLk_N3DOV1MWiUAwJQtYOEUMMhL5C8o7MnZsSymH870etTeymMRcDh1M0qjbt3IDiumu55keLP2HhX1sOsywAGN4HuUCLkJg May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:31:56.493461 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: afa6b18286ac49e38d7f7456996bd301 May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'n-d-766726-30'} May 19 04:31:56.494817 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:56.495642 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 19 04:31:56.496826 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:56.499257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b4b1cff4-18ac-418f-9487-6c6ec62e1694 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:56.502256 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b4b1cff4-18ac-418f-9487-6c6ec62e1694 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-766726-30" status: 403 len: 109 microversion: 2.1 time: 0.046478 May 19 04:31:56.510401 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 74/156] 10.222.0.58 () {58 vars in 1169 bytes} [Thu May 19 04:31:56 2022] GET /compute/v2.1/os-hosts/n-d-766726-30 => generated 109 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:56.518418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0b2b886e-6e47-41a4-8b9d-1f2f49717163 req-33a01d49-b1dd-4741-b934-3d5142958c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef878e1-99c8-4dd5-ad5b-cdcd2535def1", "name": "network-vif-plugged", "status": "completed", "tag": "a8cde90f-7fb4-417a-926d-405ce878484e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:56.526069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:56.532572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0b2b886e-6e47-41a4-8b9d-1f2f49717163 req-33a01d49-b1dd-4741-b934-3d5142958c06 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:56.533985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0b2b886e-6e47-41a4-8b9d-1f2f49717163 req-33a01d49-b1dd-4741-b934-3d5142958c06 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:56.547078 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0b2b886e-6e47-41a4-8b9d-1f2f49717163 req-33a01d49-b1dd-4741-b934-3d5142958c06 service nova] Creating event network-vif-plugged:a8cde90f-7fb4-417a-926d-405ce878484e for instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 on n-h2-766726-30 May 19 04:31:56.555839 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0b2b886e-6e47-41a4-8b9d-1f2f49717163 req-33a01d49-b1dd-4741-b934-3d5142958c06 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040271 May 19 04:31:56.559164 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 75/157] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:56.571490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-222ccd1c-9203-4c20-8190-c7621e407ef4 tempest-FlavorMetadataValidation-83400102 tempest-FlavorMetadataValidation-83400102-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:56.572744 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:56.572744 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:56.643737 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-222ccd1c-9203-4c20-8190-c7621e407ef4 tempest-FlavorMetadataValidation-83400102 tempest-FlavorMetadataValidation-83400102-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/550715112" status: 202 len: 0 microversion: 2.86 time: 0.081126 May 19 04:31:56.645250 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 76/158] 10.222.0.58 () {60 vars in 1198 bytes} [Thu May 19 04:31:56 2022] DELETE /compute/v2.1/flavors/550715112 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:31:56.661167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ffed2d58-08f5-4bc5-abda-fcaba36a5931 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Calling method '.version_select at 0x7fd3168ed550>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:56.663142 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:56.663142 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:56.685202 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-ffed2d58-08f5-4bc5-abda-fcaba36a5931 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ffed2d58-08f5-4bc5-abda-fcaba36a5931 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Request method failure captured: May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg6GPucEly2SuXBgY_iG4L7fCvhvySWQ4Wsu2F9_LXwJDirSXKtwEEv4bqhfRCdjNvCTqLbZ2gaIYEc6d4n2Sbx2IylhwOKdL08enSPf-aHMV7F27XV-VwN3DqEPaa84EAqVtWjfwYmpNexAELGBvktajoFOcf3uJvXfwxz6vHnWRc May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:31:56.688894 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 6572612605dd42da86f00e26e768d676 May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'nonexistent_hostname'} May 19 04:31:56.690297 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.691110 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:56.692075 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:56.697890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ffed2d58-08f5-4bc5-abda-fcaba36a5931 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:56.698783 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ffed2d58-08f5-4bc5-abda-fcaba36a5931 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.052196 May 19 04:31:56.703645 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 77/159] 10.222.0.58 () {58 vars in 1190 bytes} [Thu May 19 04:31:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:31:56.711884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d9a6cee-1867-41aa-9961-2b50ad58ae6c tempest-FlavorMetadataValidation-83400102 tempest-FlavorMetadataValidation-83400102-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:56.752478 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d9a6cee-1867-41aa-9961-2b50ad58ae6c tempest-FlavorMetadataValidation-83400102 tempest-FlavorMetadataValidation-83400102-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.051846 May 19 04:31:56.753446 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 78/160] 10.222.0.58 () {60 vars in 1186 bytes} [Thu May 19 04:31:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:56.763900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:56.765106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:56.776080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:56.777860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:56.779819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:56.781654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:56.955527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:56.985430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:56.996829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:56.999580 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0d4108cd-8cdb-4650-b2b9-21d3e0fa6967 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1314 microversion: 2.25 time: 0.244312 May 19 04:31:57.013131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-973bd031-dbb0-493d-869f-ded1bfa3949b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:57.028975 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 79/161] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:31:56 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:57.035690 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-973bd031-dbb0-493d-869f-ded1bfa3949b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1341 microversion: 2.1 time: 0.893695 May 19 04:31:57.041308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b576aa2f-c5ae-46c1-b2d2-30fe2d6f258f tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Calling method '.version_select at 0x7fd316926160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:57.043736 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 83/162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:56 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1341 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:57.048750 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:57.048750 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:57.053338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b576aa2f-c5ae-46c1-b2d2-30fe2d6f258f tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'afa6b18286ac49e38d7f7456996bd301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66940bdf4f624a57a7e57777d22b4534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b576aa2f-c5ae-46c1-b2d2-30fe2d6f258f tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Request method failure captured: May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hosts/n-d-766726-30/shutdown HTTP/1.1 May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg3VtZ3-UlKRo_nSIcZqZmBrG3nDhxJyrSo0EZPKKYkW_jq5EvzQlAHS6SsTJfesppfg_l3pLSk9wkPLk_N3DOV1MWiUAwJQtYOEUMMhL5C8o7MnZsSymH870etTeymMRcDh1M0qjbt3IDiumu55keLP2HhX1sOsywAGN4HuUCLkJg May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:31:57.065297 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: afa6b18286ac49e38d7f7456996bd301 May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'n-d-766726-30'} May 19 04:31:57.066430 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:57.067108 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 19 04:31:57.068058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.071719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b576aa2f-c5ae-46c1-b2d2-30fe2d6f258f tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:57.072772 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b576aa2f-c5ae-46c1-b2d2-30fe2d6f258f tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-766726-30/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.042321 May 19 04:31:57.073881 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 80/163] 10.222.0.58 () {58 vars in 1196 bytes} [Thu May 19 04:31:57 2022] GET /compute/v2.1/os-hosts/n-d-766726-30/shutdown => generated 113 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:57.087068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b95f6864-ce31-458d-ac3e-7f32675d710c tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:57.088044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b95f6864-ce31-458d-ac3e-7f32675d710c tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:57.104611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b95f6864-ce31-458d-ac3e-7f32675d710c tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:57.105633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b95f6864-ce31-458d-ac3e-7f32675d710c tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:57.114186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b95f6864-ce31-458d-ac3e-7f32675d710c tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:57.114923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b95f6864-ce31-458d-ac3e-7f32675d710c tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:57.119885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:31:57.512357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b95f6864-ce31-458d-ac3e-7f32675d710c tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:57.526050 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b95f6864-ce31-458d-ac3e-7f32675d710c tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1339 microversion: 2.1 time: 0.450524 May 19 04:31:57.526875 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 81/164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:57 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1339 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:57.541470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e48946d-b265-48a2-b314-c460c744171b tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Calling method '.version_select at 0x7fd31694e820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:57.554083 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:57.554083 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:57.594553 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-7e48946d-b265-48a2-b314-c460c744171b tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e48946d-b265-48a2-b314-c460c744171b tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Request method failure captured: May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg6GPucEly2SuXBgY_iG4L7fCvhvySWQ4Wsu2F9_LXwJDirSXKtwEEv4bqhfRCdjNvCTqLbZ2gaIYEc6d4n2Sbx2IylhwOKdL08enSPf-aHMV7F27XV-VwN3DqEPaa84EAqVtWjfwYmpNexAELGBvktajoFOcf3uJvXfwxz6vHnWRc May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:31:57.609448 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 6572612605dd42da86f00e26e768d676 May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'nonexistent_hostname'} May 19 04:31:57.610598 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:31:57.611284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 19 04:31:57.612239 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e48946d-b265-48a2-b314-c460c744171b tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e48946d-b265-48a2-b314-c460c744171b tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.073904 May 19 04:31:57.613251 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 82/165] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:31:57 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:31:57.631650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b8f42c7e-cb2e-499f-903d-36fd5e317185 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Calling method '.version_select at 0x7fd3167de700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:57.633004 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:57.633004 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:57.654657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b8f42c7e-cb2e-499f-903d-36fd5e317185 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'afa6b18286ac49e38d7f7456996bd301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66940bdf4f624a57a7e57777d22b4534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b8f42c7e-cb2e-499f-903d-36fd5e317185 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Request method failure captured: May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hosts/n-d-766726-30/startup HTTP/1.1 May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg3VtZ3-UlKRo_nSIcZqZmBrG3nDhxJyrSo0EZPKKYkW_jq5EvzQlAHS6SsTJfesppfg_l3pLSk9wkPLk_N3DOV1MWiUAwJQtYOEUMMhL5C8o7MnZsSymH870etTeymMRcDh1M0qjbt3IDiumu55keLP2HhX1sOsywAGN4HuUCLkJg May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:31:57.656748 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: afa6b18286ac49e38d7f7456996bd301 May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'n-d-766726-30'} May 19 04:31:57.658386 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:57.659060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 19 04:31:57.660233 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.668533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b8f42c7e-cb2e-499f-903d-36fd5e317185 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:57.682036 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b8f42c7e-cb2e-499f-903d-36fd5e317185 tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-766726-30/startup" status: 403 len: 110 microversion: 2.1 time: 0.054247 May 19 04:31:57.682647 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 83/166] 10.222.0.58 () {58 vars in 1193 bytes} [Thu May 19 04:31:57 2022] GET /compute/v2.1/os-hosts/n-d-766726-30/startup => generated 110 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:57.722239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70507cfa-f0df-43f1-9918-cf74fb61f6da tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Calling method '.version_select at 0x7fd3167de160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:57.748412 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-70507cfa-f0df-43f1-9918-cf74fb61f6da tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70507cfa-f0df-43f1-9918-cf74fb61f6da tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Request method failure captured: May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg6GPucEly2SuXBgY_iG4L7fCvhvySWQ4Wsu2F9_LXwJDirSXKtwEEv4bqhfRCdjNvCTqLbZ2gaIYEc6d4n2Sbx2IylhwOKdL08enSPf-aHMV7F27XV-VwN3DqEPaa84EAqVtWjfwYmpNexAELGBvktajoFOcf3uJvXfwxz6vHnWRc May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:31:57.750275 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 6572612605dd42da86f00e26e768d676 May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'nonexistent_hostname'} May 19 04:31:57.751500 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:31:57.752219 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 19 04:31:57.753235 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70507cfa-f0df-43f1-9918-cf74fb61f6da tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-70507cfa-f0df-43f1-9918-cf74fb61f6da tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.063332 May 19 04:31:57.754253 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 84/167] 10.222.0.58 () {58 vars in 1214 bytes} [Thu May 19 04:31:57 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 19 04:31:57.811631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cda8b2eb-c5d4-4128-8667-178715d9c2d8 tempest-FlavorsV261TestJSON-1223871929 tempest-FlavorsV261TestJSON-1223871929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-401675817", "id": 1772422086, "os-flavor-access:is_public": "True"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:57.813347 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:57.813347 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:57.861741 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cda8b2eb-c5d4-4128-8667-178715d9c2d8 tempest-FlavorsV261TestJSON-1223871929 tempest-FlavorsV261TestJSON-1223871929-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.816553 May 19 04:31:57.863793 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 84/168] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:31:57 2022] POST /compute/v2.1/flavors => generated 467 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:57.873855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f95dfdb1-9234-4be2-b1d7-57ecd1bfba89 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Action: 'update', calling method: .version_select at 0x7fd3167e1940>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f95dfdb1-9234-4be2-b1d7-57ecd1bfba89 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Request method failure captured: May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: request: PUT /compute/v2.1/os-hosts/n-d-766726-30 HTTP/1.1 May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 51 May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcg6GPucEly2SuXBgY_iG4L7fCvhvySWQ4Wsu2F9_LXwJDirSXKtwEEv4bqhfRCdjNvCTqLbZ2gaIYEc6d4n2Sbx2IylhwOKdL08enSPf-aHMV7F27XV-VwN3DqEPaa84EAqVtWjfwYmpNexAELGBvktajoFOcf3uJvXfwxz6vHnWRc May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:31:57.890983 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 6572612605dd42da86f00e26e768d676 May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: {"status": "enable", "maintenance_mode": "invalid"} May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:31:57.892402 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'n-d-766726-30', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'disable', May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'Enable', May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'Disable', May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'ENABLE', May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance: May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'invalid' May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.893311 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:57.894953 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:57.896254 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:57.896254 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:31:57.896254 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:31:57.896254 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 04:31:57.896254 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:31:57.901336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f95dfdb1-9234-4be2-b1d7-57ecd1bfba89 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:57.905267 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f95dfdb1-9234-4be2-b1d7-57ecd1bfba89 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-766726-30" status: 400 len: 199 microversion: 2.1 time: 0.037931 May 19 04:31:57.909411 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 85/169] 10.222.0.58 () {60 vars in 1189 bytes} [Thu May 19 04:31:57 2022] PUT /compute/v2.1/os-hosts/n-d-766726-30 => generated 199 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:31:57.971518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d72b6a3d-03dc-454f-9d11-a89053f48955 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Calling method '.version_select at 0x7fd3167de940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:57.972942 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:57.972942 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:57.975424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d72b6a3d-03dc-454f-9d11-a89053f48955 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:57.976040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d72b6a3d-03dc-454f-9d11-a89053f48955 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:57.976928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d72b6a3d-03dc-454f-9d11-a89053f48955 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:57.977480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d72b6a3d-03dc-454f-9d11-a89053f48955 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.043227 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d72b6a3d-03dc-454f-9d11-a89053f48955 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.289939 May 19 04:31:58.044015 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 85/170] 10.222.0.58 () {58 vars in 1127 bytes} [Thu May 19 04:31:57 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:58.057851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-41d4c33d-40f9-43d3-9fcc-9b81ad3b76a6 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Action: 'update', calling method: .version_select at 0x7fd3169ca790>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-41d4c33d-40f9-43d3-9fcc-9b81ad3b76a6 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Request method failure captured: May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/os-hosts/n-d-766726-30 HTTP/1.1 May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 51 May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg6GPucEly2SuXBgY_iG4L7fCvhvySWQ4Wsu2F9_LXwJDirSXKtwEEv4bqhfRCdjNvCTqLbZ2gaIYEc6d4n2Sbx2IylhwOKdL08enSPf-aHMV7F27XV-VwN3DqEPaa84EAqVtWjfwYmpNexAELGBvktajoFOcf3uJvXfwxz6vHnWRc May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:31:58.065193 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 6572612605dd42da86f00e26e768d676 May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: {"status": "invalid", "maintenance_mode": "enable"} May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:58.066765 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'n-d-766726-30', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'disable', May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'Enable', May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'Disable', May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'ENABLE', May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance: May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'invalid' May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.067629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.068911 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:58.071001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:58.071001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:31:58.071001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:31:58.071001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 04:31:58.071001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.072596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-41d4c33d-40f9-43d3-9fcc-9b81ad3b76a6 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:58.074750 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-41d4c33d-40f9-43d3-9fcc-9b81ad3b76a6 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-766726-30" status: 400 len: 189 microversion: 2.1 time: 0.026606 May 19 04:31:58.077373 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 86/171] 10.222.0.58 () {60 vars in 1189 bytes} [Thu May 19 04:31:58 2022] PUT /compute/v2.1/os-hosts/n-d-766726-30 => generated 189 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:31:58.093881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:58.095097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:58.112120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.112946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.113939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.115960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.146640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d71257bd-4a14-4271-81af-dacb1090170e tempest-FlavorsV261TestJSON-645916795 tempest-FlavorsV261TestJSON-645916795-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:58.179611 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d71257bd-4a14-4271-81af-dacb1090170e tempest-FlavorsV261TestJSON-645916795 tempest-FlavorsV261TestJSON-645916795-project] 10.222.0.58 "GET /compute/v2.1/flavors/1772422086" status: 200 len: 467 microversion: 2.61 time: 0.268839 May 19 04:31:58.186970 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 86/172] 10.222.0.58 () {60 vars in 1198 bytes} [Thu May 19 04:31:57 2022] GET /compute/v2.1/flavors/1772422086 => generated 467 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:58.191882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8a449b31-722a-40ab-9d6d-c1a8d818f566 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Calling method '.version_select at 0x7fd3167e1af0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:58.193516 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:58.193516 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:58.195174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a449b31-722a-40ab-9d6d-c1a8d818f566 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.195747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a449b31-722a-40ab-9d6d-c1a8d818f566 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.196922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a449b31-722a-40ab-9d6d-c1a8d818f566 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.197626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a449b31-722a-40ab-9d6d-c1a8d818f566 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.227341 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8a449b31-722a-40ab-9d6d-c1a8d818f566 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.039089 May 19 04:31:58.228426 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 87/173] 10.222.0.58 () {58 vars in 1138 bytes} [Thu May 19 04:31:58 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:31:58.233683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1eac457-6161-46c3-b274-44b5fa58d0e4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:58.234621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1eac457-6161-46c3-b274-44b5fa58d0e4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:58.241143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1eac457-6161-46c3-b274-44b5fa58d0e4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.241902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1eac457-6161-46c3-b274-44b5fa58d0e4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.242974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1eac457-6161-46c3-b274-44b5fa58d0e4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.243608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1eac457-6161-46c3-b274-44b5fa58d0e4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.280311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:58.294715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:58.296235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:58.297391 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fef87b54-e4e6-46ca-b737-ea0f525f0177 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1320 microversion: 2.25 time: 0.217572 May 19 04:31:58.308844 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 87/174] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:31:58 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:58.313937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5463706e-862e-44a9-a938-b6798ac2ca3b tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Action: 'update', calling method: .version_select at 0x7fd31694eaf0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:58.315444 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:58.315444 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:58.316560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5463706e-862e-44a9-a938-b6798ac2ca3b tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'afa6b18286ac49e38d7f7456996bd301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66940bdf4f624a57a7e57777d22b4534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5463706e-862e-44a9-a938-b6798ac2ca3b tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Request method failure captured: May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/os-hosts/n-d-766726-30 HTTP/1.1 May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 50 May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg3VtZ3-UlKRo_nSIcZqZmBrG3nDhxJyrSo0EZPKKYkW_jq5EvzQlAHS6SsTJfesppfg_l3pLSk9wkPLk_N3DOV1MWiUAwJQtYOEUMMhL5C8o7MnZsSymH870etTeymMRcDh1M0qjbt3IDiumu55keLP2HhX1sOsywAGN4HuUCLkJg May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:31:58.318444 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66940bdf4f624a57a7e57777d22b4534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 66940bdf4f624a57a7e57777d22b4534 May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1953095008 May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: afa6b18286ac49e38d7f7456996bd301 May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1953095008-project May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: {"status": "enable", "maintenance_mode": "enable"} May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 19 04:31:58.320201 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'n-d-766726-30', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:58.321124 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 19 04:31:58.322203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.323263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5463706e-862e-44a9-a938-b6798ac2ca3b tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:58.323263 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5463706e-862e-44a9-a938-b6798ac2ca3b tempest-HostsAdminNegativeTestJSON-1953095008 tempest-HostsAdminNegativeTestJSON-1953095008-project] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-766726-30" status: 403 len: 111 microversion: 2.1 time: 0.010356 May 19 04:31:58.325952 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 88/175] 10.222.0.58 () {60 vars in 1189 bytes} [Thu May 19 04:31:58 2022] PUT /compute/v2.1/os-hosts/n-d-766726-30 => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:31:58.331376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd690e7a-9d80-4687-8d46-d1e686269e47 tempest-FlavorsV261TestJSON-1223871929 tempest-FlavorsV261TestJSON-1223871929-project-admin] Action: 'update', calling method: .version_select at 0x7fd318e05f70>, body: {"flavor": {"description": "new"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:58.346107 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:58.346107 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:58.390433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd690e7a-9d80-4687-8d46-d1e686269e47 tempest-FlavorsV261TestJSON-1223871929 tempest-FlavorsV261TestJSON-1223871929-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1772422086" status: 200 len: 468 microversion: 2.61 time: 0.063007 May 19 04:31:58.391483 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 89/176] 10.222.0.58 () {62 vars in 1218 bytes} [Thu May 19 04:31:58 2022] PUT /compute/v2.1/flavors/1772422086 => generated 468 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:31:58.395908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2104719-bc69-4fc0-90d9-ea9413151b53 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Calling method '.version_select at 0x7fd31694e280>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:58.397245 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:58.397245 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:58.399325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2104719-bc69-4fc0-90d9-ea9413151b53 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.399785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2104719-bc69-4fc0-90d9-ea9413151b53 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.400595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2104719-bc69-4fc0-90d9-ea9413151b53 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.401034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2104719-bc69-4fc0-90d9-ea9413151b53 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.428125 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b2104719-bc69-4fc0-90d9-ea9413151b53 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.035561 May 19 04:31:58.434226 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 90/177] 10.222.0.58 () {58 vars in 1144 bytes} [Thu May 19 04:31:58 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:31:58.439638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-968d485d-5aa3-412a-ae1f-d7bfe6df08e5 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Action: 'update', calling method: .version_select at 0x7fd31694e040>, body: {"status": null, "maintenance_mode": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-968d485d-5aa3-412a-ae1f-d7bfe6df08e5 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Request method failure captured: May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/os-hosts/n-d-766726-30 HTTP/1.1 May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 42 May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg6GPucEly2SuXBgY_iG4L7fCvhvySWQ4Wsu2F9_LXwJDirSXKtwEEv4bqhfRCdjNvCTqLbZ2gaIYEc6d4n2Sbx2IylhwOKdL08enSPf-aHMV7F27XV-VwN3DqEPaa84EAqVtWjfwYmpNexAELGBvktajoFOcf3uJvXfwxz6vHnWRc May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:31:58.442743 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 6572612605dd42da86f00e26e768d676 May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: {"status": null, "maintenance_mode": null} May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 19 04:31:58.443893 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'n-d-766726-30', 'body': {'status': None, 'maintenance_mode': None}} May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'disable', May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'Enable', May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'Disable', May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'ENABLE', May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance: May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi None May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:58.445334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:58.446678 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:58.447666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:31:58.447666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:31:58.447666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 19 04:31:58.447666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.447666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-968d485d-5aa3-412a-ae1f-d7bfe6df08e5 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:58.447666 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-968d485d-5aa3-412a-ae1f-d7bfe6df08e5 tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-766726-30" status: 400 len: 127 microversion: 2.1 time: 0.009360 May 19 04:31:58.451925 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 91/178] 10.222.0.58 () {60 vars in 1189 bytes} [Thu May 19 04:31:58 2022] PUT /compute/v2.1/os-hosts/n-d-766726-30 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:31:58.455679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afab28d0-57a3-496d-be72-02c08af3a23e tempest-FlavorsV261TestJSON-645916795 tempest-FlavorsV261TestJSON-645916795-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:58.485205 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afab28d0-57a3-496d-be72-02c08af3a23e tempest-FlavorsV261TestJSON-645916795 tempest-FlavorsV261TestJSON-645916795-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.033578 May 19 04:31:58.486399 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 92/179] 10.222.0.58 () {60 vars in 1186 bytes} [Thu May 19 04:31:58 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:58.491005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d04048e-7f36-4208-a640-b3e48a5dfebe tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Action: 'update', calling method: .version_select at 0x7fd31695f310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:31:58.492248 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:58.492248 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:31:58.492985 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.hosts [None req-6d04048e-7f36-4208-a640-b3e48a5dfebe tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Enabling host nonexistent_hostname. May 19 04:31:58.510673 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-6d04048e-7f36-4208-a640-b3e48a5dfebe tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d04048e-7f36-4208-a640-b3e48a5dfebe tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Request method failure captured: May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 50 May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg6GPucEly2SuXBgY_iG4L7fCvhvySWQ4Wsu2F9_LXwJDirSXKtwEEv4bqhfRCdjNvCTqLbZ2gaIYEc6d4n2Sbx2IylhwOKdL08enSPf-aHMV7F27XV-VwN3DqEPaa84EAqVtWjfwYmpNexAELGBvktajoFOcf3uJvXfwxz6vHnWRc May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:31:58.512646 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee0bc37f2fab4f999e0847798bb4e598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ee0bc37f2fab4f999e0847798bb4e598 May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-886136655 May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 6572612605dd42da86f00e26e768d676 May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HostsAdminNegativeTestJSON-886136655-project-admin May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: {"status": "enable", "maintenance_mode": "enable"} May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:58.514342 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 04:31:58.516227 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:31:58.517767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:31:58.520535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d04048e-7f36-4208-a640-b3e48a5dfebe tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:31:58.523155 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d04048e-7f36-4208-a640-b3e48a5dfebe tempest-HostsAdminNegativeTestJSON-886136655 tempest-HostsAdminNegativeTestJSON-886136655-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.026628 May 19 04:31:58.523155 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 93/180] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 19 04:31:58 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:31:58.551094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3fda9af5-d830-45c5-bdec-6ade4e800ed6 tempest-FlavorsV261TestJSON-645916795 tempest-FlavorsV261TestJSON-645916795-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:58.592765 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3fda9af5-d830-45c5-bdec-6ade4e800ed6 tempest-FlavorsV261TestJSON-645916795 tempest-FlavorsV261TestJSON-645916795-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.076271 May 19 04:31:58.594068 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 94/181] 10.222.0.58 () {60 vars in 1165 bytes} [Thu May 19 04:31:58 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:58.599482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d93a3134-4945-41a3-a6ab-8ad3140812ff tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:58.602013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d93a3134-4945-41a3-a6ab-8ad3140812ff tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:58.615429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d93a3134-4945-41a3-a6ab-8ad3140812ff tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.616136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d93a3134-4945-41a3-a6ab-8ad3140812ff tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.627130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d93a3134-4945-41a3-a6ab-8ad3140812ff tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:58.631650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d93a3134-4945-41a3-a6ab-8ad3140812ff tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:58.688797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1eac457-6161-46c3-b274-44b5fa58d0e4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:58.704091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1eac457-6161-46c3-b274-44b5fa58d0e4 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1490 microversion: 2.1 time: 0.471781 May 19 04:31:58.706653 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 88/182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:58 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1490 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:58.723753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-46278e30-f805-4388-95de-33591c2c289b tempest-FlavorsV261TestJSON-1223871929 tempest-FlavorsV261TestJSON-1223871929-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:58.728820 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:31:58.728820 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:31:58.766710 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-46278e30-f805-4388-95de-33591c2c289b tempest-FlavorsV261TestJSON-1223871929 tempest-FlavorsV261TestJSON-1223871929-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1772422086" status: 202 len: 0 microversion: 2.61 time: 0.058561 May 19 04:31:58.768565 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 89/183] 10.222.0.58 () {60 vars in 1201 bytes} [Thu May 19 04:31:58 2022] DELETE /compute/v2.1/flavors/1772422086 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:31:59.019644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d93a3134-4945-41a3-a6ab-8ad3140812ff tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:59.040932 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d93a3134-4945-41a3-a6ab-8ad3140812ff tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1339 microversion: 2.1 time: 0.438684 May 19 04:31:59.041882 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 95/184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:58 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1339 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:31:59.066821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c75cd5e-7123-44ae-8b33-00c920128e4f tempest-FlavorsV261TestJSON-1223871929 tempest-FlavorsV261TestJSON-1223871929-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:59.182573 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c75cd5e-7123-44ae-8b33-00c920128e4f tempest-FlavorsV261TestJSON-1223871929 tempest-FlavorsV261TestJSON-1223871929-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.136189 May 19 04:31:59.197780 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 96/185] 10.222.0.58 () {60 vars in 1186 bytes} [Thu May 19 04:31:59 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:59.319012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:59.323478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:59.327563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-02557bef-6ed5-4db0-a100-816cf6a3e843 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:59.329962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-02557bef-6ed5-4db0-a100-816cf6a3e843 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:59.339164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:59.341733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:59.362905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:59.365315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:59.410090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02557bef-6ed5-4db0-a100-816cf6a3e843 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:59.410712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02557bef-6ed5-4db0-a100-816cf6a3e843 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:59.412517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02557bef-6ed5-4db0-a100-816cf6a3e843 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:59.416302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02557bef-6ed5-4db0-a100-816cf6a3e843 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:59.616468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:59.626700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:59.628552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:31:59.632654 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-899afaab-3c1d-43f8-ba63-a5b57154ef62 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1320 microversion: 2.25 time: 0.319510 May 19 04:31:59.637021 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 97/186] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:31:59 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:31:59.659497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-02557bef-6ed5-4db0-a100-816cf6a3e843 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:31:59.935017 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-02557bef-6ed5-4db0-a100-816cf6a3e843 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 204 len: 0 microversion: 2.1 time: 1.164955 May 19 04:31:59.940058 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 90/187] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:31:58 2022] DELETE /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 0 bytes in 1167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:31:59.945668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62a64187-bc40-44de-aa54-97ab8ac1ed02 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:31:59.946289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62a64187-bc40-44de-aa54-97ab8ac1ed02 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:31:59.957480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62a64187-bc40-44de-aa54-97ab8ac1ed02 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:59.957928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62a64187-bc40-44de-aa54-97ab8ac1ed02 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:31:59.958712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62a64187-bc40-44de-aa54-97ab8ac1ed02 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:31:59.959178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62a64187-bc40-44de-aa54-97ab8ac1ed02 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:00.067222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e818a664-5395-41c4-a13c-dec6e70fb5be tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:00.067952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e818a664-5395-41c4-a13c-dec6e70fb5be tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:00.078625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e818a664-5395-41c4-a13c-dec6e70fb5be tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:00.088775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e818a664-5395-41c4-a13c-dec6e70fb5be tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:00.092671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e818a664-5395-41c4-a13c-dec6e70fb5be tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:00.094540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e818a664-5395-41c4-a13c-dec6e70fb5be tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:00.537037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e818a664-5395-41c4-a13c-dec6e70fb5be tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:00.543421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-62a64187-bc40-44de-aa54-97ab8ac1ed02 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:00.558853 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e818a664-5395-41c4-a13c-dec6e70fb5be tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1489 microversion: 2.1 time: 0.493917 May 19 04:32:00.560350 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-62a64187-bc40-44de-aa54-97ab8ac1ed02 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1496 microversion: 2.1 time: 0.618120 May 19 04:32:00.561837 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 91/188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:00 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1489 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:00.562670 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 98/189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:31:59 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1496 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:00.579762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66d7a128-d3a0-4dbd-8ad4-da65c11fbf2e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:00.586826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66d7a128-d3a0-4dbd-8ad4-da65c11fbf2e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:00.599121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66d7a128-d3a0-4dbd-8ad4-da65c11fbf2e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:00.599570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66d7a128-d3a0-4dbd-8ad4-da65c11fbf2e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:00.600738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66d7a128-d3a0-4dbd-8ad4-da65c11fbf2e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:00.601395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66d7a128-d3a0-4dbd-8ad4-da65c11fbf2e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:00.652394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:00.653258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:00.660100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:00.660930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:00.662089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:00.662746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:00.909864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:00.919723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:00.930299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:00.932584 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f7e881dd-5ec7-4518-8f6e-b48bb453482b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1320 microversion: 2.25 time: 0.284161 May 19 04:32:00.933426 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 99/190] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:00 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:32:01.522957 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66d7a128-d3a0-4dbd-8ad4-da65c11fbf2e tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1642 microversion: 2.1 time: 0.946442 May 19 04:32:01.538662 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 92/191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:00 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1642 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:01.557857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-34b1264b-77e4-4d18-bc5c-3bf8f6c4dadb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:01.558760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-34b1264b-77e4-4d18-bc5c-3bf8f6c4dadb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:01.565812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34b1264b-77e4-4d18-bc5c-3bf8f6c4dadb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:01.570248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34b1264b-77e4-4d18-bc5c-3bf8f6c4dadb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:01.572368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34b1264b-77e4-4d18-bc5c-3bf8f6c4dadb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:01.579673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b8c6271-ac68-464d-a89f-5328154e75a5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:01.580733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4b8c6271-ac68-464d-a89f-5328154e75a5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:01.590959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34b1264b-77e4-4d18-bc5c-3bf8f6c4dadb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:01.596028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b8c6271-ac68-464d-a89f-5328154e75a5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:01.598349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b8c6271-ac68-464d-a89f-5328154e75a5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:01.599391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b8c6271-ac68-464d-a89f-5328154e75a5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:01.607333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b8c6271-ac68-464d-a89f-5328154e75a5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:01.681509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-34b1264b-77e4-4d18-bc5c-3bf8f6c4dadb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:32:01.727403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=79,nova_api:SAVEPOINT=4,nova_api:INSERT=6,nova_api:RELEASE=4,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:01.963895 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-34b1264b-77e4-4d18-bc5c-3bf8f6c4dadb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 204 len: 0 microversion: 2.1 time: 0.414174 May 19 04:32:01.965648 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 100/192] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:32:01 2022] DELETE /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:32:01.983256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:01.983979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:02.015712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:02.016178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:02.017070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:02.017552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:02.213998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:02.222928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:02.227569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:02.234420 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a67852e2-9674-49de-a62e-b8fcf1163da5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1320 microversion: 2.25 time: 0.266917 May 19 04:32:02.235689 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 101/193] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:01 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:02.244545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21b1a51b-0521-4ef3-ab8c-013817730894 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:02.257317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-21b1a51b-0521-4ef3-ab8c-013817730894 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:02.269385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21b1a51b-0521-4ef3-ab8c-013817730894 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:02.276704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21b1a51b-0521-4ef3-ab8c-013817730894 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:02.282034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21b1a51b-0521-4ef3-ab8c-013817730894 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:02.282573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21b1a51b-0521-4ef3-ab8c-013817730894 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:02.552967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4b8c6271-ac68-464d-a89f-5328154e75a5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:02.563429 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4b8c6271-ac68-464d-a89f-5328154e75a5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1496 microversion: 2.1 time: 0.988147 May 19 04:32:02.564028 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 93/194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:01 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1496 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:02.575116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b6d8c98e-a4ac-4299-8a89-7afc9a94d7f5 req-52df209c-8fef-411b-8816-de8934d5147c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422f36f8-5f4c-4e68-a1ed-cedb6551b55e", "name": "network-vif-deleted", "tag": "75359c8f-2454-45d6-bd5c-dde5ad05e3eb"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:02.585524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b6d8c98e-a4ac-4299-8a89-7afc9a94d7f5 req-52df209c-8fef-411b-8816-de8934d5147c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:02.586344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b6d8c98e-a4ac-4299-8a89-7afc9a94d7f5 req-52df209c-8fef-411b-8816-de8934d5147c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:02.600914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b6d8c98e-a4ac-4299-8a89-7afc9a94d7f5 req-52df209c-8fef-411b-8816-de8934d5147c service nova] Creating event network-vif-deleted:75359c8f-2454-45d6-bd5c-dde5ad05e3eb for instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e on n-h2-766726-30 May 19 04:32:02.607680 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b6d8c98e-a4ac-4299-8a89-7afc9a94d7f5 req-52df209c-8fef-411b-8816-de8934d5147c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036392 May 19 04:32:02.608483 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 94/195] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:02.834667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-21b1a51b-0521-4ef3-ab8c-013817730894 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:02.842526 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21b1a51b-0521-4ef3-ab8c-013817730894 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1495 microversion: 2.1 time: 0.604583 May 19 04:32:02.847171 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 102/196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:02 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1495 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:03.254046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:03.255003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:03.265389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:03.275387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:03.276537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:03.278896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:03.423454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:03.433837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:03.435431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:03.437134 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c374121b-74e5-4b9b-a7ca-e53f3223de55 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1320 microversion: 2.25 time: 0.187931 May 19 04:32:03.438017 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 95/197] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:03 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:03.581647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:03.582645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:03.594256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:03.596910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:03.598849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:03.601840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:03.695449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:03.696823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:03.697481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lazy-loading 'fault' on Instance uuid 422f36f8-5f4c-4e68-a1ed-cedb6551b55e {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:32:03.862324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d4d5df60-f5f9-4e13-b574-7c2a2fdb14d9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:03.863834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d4d5df60-f5f9-4e13-b574-7c2a2fdb14d9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:03.876880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4d5df60-f5f9-4e13-b574-7c2a2fdb14d9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:03.877871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4d5df60-f5f9-4e13-b574-7c2a2fdb14d9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:03.882836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4d5df60-f5f9-4e13-b574-7c2a2fdb14d9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:03.883987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4d5df60-f5f9-4e13-b574-7c2a2fdb14d9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:04.099414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:04.107574 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c478253-76b4-4cb8-9fa7-8a505c4b5f4a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 200 len: 1331 microversion: 2.1 time: 0.531211 May 19 04:32:04.112040 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 103/198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:03 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 1331 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:04.455507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:04.456142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:04.463610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:04.464061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:04.471428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:04.472138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:04.593262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:04.603010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:04.608593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:04.611801 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c78b1586-cb88-45a9-9558-046788a5f445 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1320 microversion: 2.25 time: 0.160174 May 19 04:32:04.613886 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 104/199] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:04 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:32:04.684765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d4d5df60-f5f9-4e13-b574-7c2a2fdb14d9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a7e252b3bf40da89469e42cb668ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217d5eae52bd48c09310b4bbd9372d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:04.700676 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d4d5df60-f5f9-4e13-b574-7c2a2fdb14d9 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 200 len: 1495 microversion: 2.1 time: 0.842082 May 19 04:32:04.714467 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 96/200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:03 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 1495 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:05.131987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:05.133526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:05.143812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:05.144705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:05.146134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:05.146735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:05.199299 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] HTTP exception thrown: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Request method failure captured: May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e HTTP/1.1 May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcgeWgYHvCt5BN10qwAgM0gT5UO6O_jwo4dK9QFgKnofa7WPBHyxAVkm0s7_0EVdfIvn1v87lbsnRQBPYPe7rNVkDAvTcO6xxKXyvU3c2KiEd4TJu8cXOD-YXVL1VLWxoSVZXL4Q5LsiwDtUAZ3gXw1S3IIIynLUEW5v0k2zN1grz88 May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:05.204033 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd403ce37c3d4ccc8853779a33902f95 May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:05.205549 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '422f36f8-5f4c-4e68-a1ed-cedb6551b55e'} May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:05.206225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:05.207394 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:05.208405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Returning 404 to user: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:05.211623 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-90c7cbab-78ac-458d-a835-41483112541b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 404 len: 111 microversion: 2.1 time: 0.084054 May 19 04:32:05.212432 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 105/201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:05 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:05.285986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-34a5eb59-c96f-4b72-9f5d-3bfc60ba483a req-6a252476-e852-4960-8007-ff33088caed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef878e1-99c8-4dd5-ad5b-cdcd2535def1", "name": "network-vif-deleted", "tag": "a8cde90f-7fb4-417a-926d-405ce878484e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:05.300662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:05.305368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-34a5eb59-c96f-4b72-9f5d-3bfc60ba483a req-6a252476-e852-4960-8007-ff33088caed3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:05.307713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-34a5eb59-c96f-4b72-9f5d-3bfc60ba483a req-6a252476-e852-4960-8007-ff33088caed3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:05.372689 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-34a5eb59-c96f-4b72-9f5d-3bfc60ba483a req-6a252476-e852-4960-8007-ff33088caed3 service nova] Creating event network-vif-deleted:a8cde90f-7fb4-417a-926d-405ce878484e for instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 on n-h2-766726-30 May 19 04:32:05.382347 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-34a5eb59-c96f-4b72-9f5d-3bfc60ba483a req-6a252476-e852-4960-8007-ff33088caed3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103055 May 19 04:32:05.387055 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 97/202] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:05.453113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-614094776", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:05.572026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:32:05.633955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:05.639891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:05.642268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:05.669454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:05.670652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:05.671823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:05.674359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:06.286962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:32:06.287528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:32:06.288745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:32:06.289721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:32:06.290539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:32:06.326851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:06.337121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:06.343503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:06.348801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:06.351287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:06.351886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:06.366338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:06.384578 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60977f1b-995a-4ebc-afed-663bd3837105 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1362 microversion: 2.25 time: 0.751239 May 19 04:32:06.400892 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 98/203] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:05 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1362 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:06.400892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:06.400892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:06.411041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:06.411490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:06.412466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:06.413696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:06.429527 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] HTTP exception thrown: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Request method failure captured: May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 HTTP/1.1 May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcge_tUTYQdGhswkyefSG0Lg9memkNh2qdf2TAKiEEyUiidHfcCgVaLU57z6pd6nFO-dgOQFHWTCnJk8BD4DKZK9QilOLTCLVBLmeVyBw8HK5QQCfaqqGqMBIUlKGTco1zrDD0RWRGHNL9ll_N2kI6VuThaiNyWGyLyP-1Y7dOY5DdQ May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 217d5eae52bd48c09310b4bbd9372d15 May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AggregatesAdminTestJSON-1277962820 May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:06.432939 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AggregatesAdminTestJSON-1277962820 May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 217d5eae52bd48c09310b4bbd9372d15 May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1277962820 May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AggregatesAdminTestJSON-1277962820-project May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 36a7e252b3bf40da89469e42cb668ee0 May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AggregatesAdminTestJSON-1277962820-project May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:06.434170 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2ef878e1-99c8-4dd5-ad5b-cdcd2535def1'} May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:06.434837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:06.436372 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:06.439241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Returning 404 to user: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:06.441865 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-566b2375-1fc1-4f9f-b87d-5f6e0d04f5cb tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 404 len: 111 microversion: 2.1 time: 0.051770 May 19 04:32:06.443257 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 99/204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:06 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:06.503100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Getting quotas for project 35e5b8a1fce545b88a7405cf7b310a22. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:06.518367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Getting quotas for user dd403ce37c3d4ccc8853779a33902f95 and project 35e5b8a1fce545b88a7405cf7b310a22. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:06.562149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:32:06.568740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:32:06.648430 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-624cb448-161f-487e-96a2-92ab6dda9471 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200933 May 19 04:32:06.653149 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 106/205] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:32:06.660965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-78896e50-db5b-4c2e-baaa-9f42835e35c2 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:06.663599 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:06.663599 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:06.698143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78896e50-db5b-4c2e-baaa-9f42835e35c2 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:06.698840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78896e50-db5b-4c2e-baaa-9f42835e35c2 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:06.748527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-274d3c93-a7b6-4557-ae3e-ba005cf9f29d tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Calling method '.version_select at 0x7fd3168fb550>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:06.911524 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-274d3c93-a7b6-4557-ae3e-ba005cf9f29d tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/934af36716c449dfb25b4545e288a8b6" status: 200 len: 371 microversion: 2.1 time: 0.466874 May 19 04:32:06.913105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 100/206] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 04:32:06 2022] GET /compute/v2.1/os-quota-sets/934af36716c449dfb25b4545e288a8b6 => generated 371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:07.235681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c85d450-fc19-442a-8949-75b64d4f8910 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Calling method '.version_select at 0x7fd316747d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:07.236589 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:07.236589 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:07.238198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c85d450-fc19-442a-8949-75b64d4f8910 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '6cbc106af0e249e08238dae70563362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0b48ea9d3e4241a666f08f945f0236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c85d450-fc19-442a-8949-75b64d4f8910 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Request method failure captured: May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchFiKgy1BgbK0D7Bk8Mqa1I6mrIaEo55Z4NrNWbQP1NgNVk0cJ3qhPY8w917mWPH3QI46__kL37Dqud0LfXwP08m0d90PB9icMvgGn3_fsc7egVa0Z1t8TZgLeY8HsQ30nVMZ3SLCalgKQi1JxbAEtM1NkDka1IF-OAyMr9TLi-Eko May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:07.246888 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 6cbc106af0e249e08238dae70563362a May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: action_args: {} May 19 04:32:07.248151 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._detail(req) May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:07.249060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 19 04:32:07.251677 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:07.253631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c85d450-fc19-442a-8949-75b64d4f8910 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:07.253631 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c85d450-fc19-442a-8949-75b64d4f8910 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.336652 May 19 04:32:07.257525 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 101/207] 10.222.0.58 () {58 vars in 1166 bytes} [Thu May 19 04:32:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 344 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:07.265446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad898e5b-4bcc-486f-ac51-fe4fdebd1802 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:07.266072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ad898e5b-4bcc-486f-ac51-fe4fdebd1802 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:07.394454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:07.427912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ad898e5b-4bcc-486f-ac51-fe4fdebd1802 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:07.436867 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-78896e50-db5b-4c2e-baaa-9f42835e35c2 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.782394 May 19 04:32:07.443984 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 107/208] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:32:06 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:07.457319 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad898e5b-4bcc-486f-ac51-fe4fdebd1802 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1219 microversion: 2.1 time: 0.197871 May 19 04:32:07.458554 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 102/209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:07 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1219 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:07.458981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66ed8f22-944d-419f-be81-43f56e2f4cd0 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Action: 'update', calling method: .version_select at 0x7fd3167558b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:07.464235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cda9482b-e71d-4496-a6f7-de72f61830b3 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Calling method '.version_select at 0x7fd3168fb790>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:07.485273 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:07.485273 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:07.487140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cda9482b-e71d-4496-a6f7-de72f61830b3 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '6cbc106af0e249e08238dae70563362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0b48ea9d3e4241a666f08f945f0236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cda9482b-e71d-4496-a6f7-de72f61830b3 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Request method failure captured: May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchFiKgy1BgbK0D7Bk8Mqa1I6mrIaEo55Z4NrNWbQP1NgNVk0cJ3qhPY8w917mWPH3QI46__kL37Dqud0LfXwP08m0d90PB9icMvgGn3_fsc7egVa0Z1t8TZgLeY8HsQ30nVMZ3SLCalgKQi1JxbAEtM1NkDka1IF-OAyMr9TLi-Eko May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:07.502110 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 6cbc106af0e249e08238dae70563362a May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: action_args: {} May 19 04:32:07.503623 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._index(req) May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:07.504997 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 19 04:32:07.507333 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:07.509621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cda9482b-e71d-4496-a6f7-de72f61830b3 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:07.509751 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cda9482b-e71d-4496-a6f7-de72f61830b3 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.049642 May 19 04:32:07.512615 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 103/210] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:07 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:07.522494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:07.523108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:07.530307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:07.530757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:07.531546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:07.531976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:07.607930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66ed8f22-944d-419f-be81-43f56e2f4cd0 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:07.608380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66ed8f22-944d-419f-be81-43f56e2f4cd0 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:07.609258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66ed8f22-944d-419f-be81-43f56e2f4cd0 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:07.612475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66ed8f22-944d-419f-be81-43f56e2f4cd0 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:07.708380 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-66ed8f22-944d-419f-be81-43f56e2f4cd0 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/934af36716c449dfb25b4545e288a8b6" status: 200 len: 328 microversion: 2.1 time: 0.259695 May 19 04:32:07.720960 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 108/211] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:32:07 2022] PUT /compute/v2.1/os-quota-sets/934af36716c449dfb25b4545e288a8b6 => generated 328 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:07.729186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-147698b5-688f-46a4-a7ef-f2fc52eec2c1 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:07.729742 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:07.729742 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:07.760517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:07.767769 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-147698b5-688f-46a4-a7ef-f2fc52eec2c1 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.045685 May 19 04:32:07.770878 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 109/212] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:07 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:07.776370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1bbb2a1-0a47-4fdb-90d0-b07b2f0c7578 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Calling method '.version_select at 0x7fd31668e040>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:07.777578 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:07.777578 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:07.778927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f1bbb2a1-0a47-4fdb-90d0-b07b2f0c7578 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '6cbc106af0e249e08238dae70563362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0b48ea9d3e4241a666f08f945f0236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1bbb2a1-0a47-4fdb-90d0-b07b2f0c7578 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Request method failure captured: May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchFiKgy1BgbK0D7Bk8Mqa1I6mrIaEo55Z4NrNWbQP1NgNVk0cJ3qhPY8w917mWPH3QI46__kL37Dqud0LfXwP08m0d90PB9icMvgGn3_fsc7egVa0Z1t8TZgLeY8HsQ30nVMZ3SLCalgKQi1JxbAEtM1NkDka1IF-OAyMr9TLi-Eko May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:07.781720 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 6cbc106af0e249e08238dae70563362a May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: action_args: {} May 19 04:32:07.782997 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:07.783785 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 19 04:32:07.784910 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:07.787479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1bbb2a1-0a47-4fdb-90d0-b07b2f0c7578 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:07.789373 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f1bbb2a1-0a47-4fdb-90d0-b07b2f0c7578 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.017567 May 19 04:32:07.790378 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 110/213] 10.222.0.58 () {58 vars in 1178 bytes} [Thu May 19 04:32:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:07.795860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d5896ca-3fc9-45ab-9453-d088cd130d50 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:07.802184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:07.805331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:07.807502 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-55ebcb6e-9c06-4601-bdd3-b89d6f84bb37 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1362 microversion: 2.25 time: 0.293446 May 19 04:32:07.808593 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 104/214] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:07 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:07.812621 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d5896ca-3fc9-45ab-9453-d088cd130d50 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-quota-sets/934af36716c449dfb25b4545e288a8b6" status: 202 len: 0 microversion: 2.1 time: 0.020189 May 19 04:32:07.814006 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 111/215] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:32:07 2022] DELETE /compute/v2.1/os-quota-sets/934af36716c449dfb25b4545e288a8b6 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:32:07.822494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c6f5623a-cf88-49b6-b0e6-9d9d34b8cb72 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-830064942"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:07.824378 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:07.824378 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:07.835582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-c6f5623a-cf88-49b6-b0e6-9d9d34b8cb72 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Generated uuid be57bad0-cd4e-4006-a309-dc164c159aea for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:07.870021 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c6f5623a-cf88-49b6-b0e6-9d9d34b8cb72 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053527 May 19 04:32:07.871594 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 112/216] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:07.877668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-46ad1d2f-ea49-440d-a026-b91b9359bcbe tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Calling method '.version_select at 0x7fd3166a1430>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.007909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bccd5331-9aa3-4163-896b-7f48b4dec9f5 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Calling method '.version_select at 0x7fd3168c41f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.008730 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:08.008730 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:08.009956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bccd5331-9aa3-4163-896b-7f48b4dec9f5 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.010399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bccd5331-9aa3-4163-896b-7f48b4dec9f5 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.036598 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-46ad1d2f-ea49-440d-a026-b91b9359bcbe tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/934af36716c449dfb25b4545e288a8b6" status: 200 len: 371 microversion: 2.1 time: 0.162531 May 19 04:32:08.040116 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 113/217] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 04:32:07 2022] GET /compute/v2.1/os-quota-sets/934af36716c449dfb25b4545e288a8b6 => generated 371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:08.052267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bccd5331-9aa3-4163-896b-7f48b4dec9f5 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.054025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bccd5331-9aa3-4163-896b-7f48b4dec9f5 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.058923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5a82f8ab-e884-4970-9e5b-8c994a29b0d6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:08.064732 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:08.064732 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:08.092272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bccd5331-9aa3-4163-896b-7f48b4dec9f5 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.095164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a82f8ab-e884-4970-9e5b-8c994a29b0d6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.098136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bccd5331-9aa3-4163-896b-7f48b4dec9f5 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.101944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a82f8ab-e884-4970-9e5b-8c994a29b0d6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.120597 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bccd5331-9aa3-4163-896b-7f48b4dec9f5 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.296452 May 19 04:32:08.123643 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 105/218] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:08.142902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c9f4606-8a82-46f8-b5ca-191e9143bc68 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Calling method '.version_select at 0x7fd31665a9d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.148292 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:08.148292 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:08.157042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6c9f4606-8a82-46f8-b5ca-191e9143bc68 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '6cbc106af0e249e08238dae70563362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0b48ea9d3e4241a666f08f945f0236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c9f4606-8a82-46f8-b5ca-191e9143bc68 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Request method failure captured: May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchFiKgy1BgbK0D7Bk8Mqa1I6mrIaEo55Z4NrNWbQP1NgNVk0cJ3qhPY8w917mWPH3QI46__kL37Dqud0LfXwP08m0d90PB9icMvgGn3_fsc7egVa0Z1t8TZgLeY8HsQ30nVMZ3SLCalgKQi1JxbAEtM1NkDka1IF-OAyMr9TLi-Eko May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:08.165818 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 6cbc106af0e249e08238dae70563362a May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '1'} May 19 04:32:08.167347 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:08.169360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 19 04:32:08.171877 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.176590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c9f4606-8a82-46f8-b5ca-191e9143bc68 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:08.180190 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6c9f4606-8a82-46f8-b5ca-191e9143bc68 tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.050313 May 19 04:32:08.183080 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 106/219] 10.222.0.58 () {58 vars in 1172 bytes} [Thu May 19 04:32:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:08.210703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3f6c4ea6-12dd-4421-99db-71e661ecfb94 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Calling method '.version_select at 0x7fd316747160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.234319 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-3f6c4ea6-12dd-4421-99db-71e661ecfb94 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] HTTP exception thrown: Hypervisor with ID 'ad1055af-487f-4851-8bc3-f3151b7915a4' could not be found. May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3f6c4ea6-12dd-4421-99db-71e661ecfb94 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Request method failure captured: May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-hypervisors/ad1055af-487f-4851-8bc3-f3151b7915a4/uptime HTTP/1.1 May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchGStmp0FAvJeb6RIeswb3RJKXX1b58-_5BgFwNZzPt_3agiP893fuuS5SIp8PeQKJyYjUALJG-GnyS8-3skFTszBvH_qx3qfWTTbQx7i2wgA3jgFzbfQDRza1JYM9inzHF-qiqcPEd5OgEV763UnSE3n_ZOoRSzWHor5DUKffMMs8 May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 5526a747e4e84361be02e8a379806d15 May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2095191283 May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:32:08.261424 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5526a747e4e84361be02e8a379806d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5526a747e4e84361be02e8a379806d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5526a747e4e84361be02e8a379806d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5526a747e4e84361be02e8a379806d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2095191283 May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 5526a747e4e84361be02e8a379806d15 May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2095191283 May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b96cfc9ab48546d6ab00d92037dff3ea May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: exception: Hypervisor with ID 'ad1055af-487f-4851-8bc3-f3151b7915a4' could not be found. May 19 04:32:08.262776 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'ad1055af-487f-4851-8bc3-f3151b7915a4'} May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ad1055af-487f-4851-8bc3-f3151b7915a4' May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 19 04:32:08.263474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ad1055af-487f-4851-8bc3-f3151b7915a4' could not be found. May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.265459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.268228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.268228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:08.268228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:08.268228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:08.268228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:08.268228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ad1055af-487f-4851-8bc3-f3151b7915a4' could not be found. May 19 04:32:08.268228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.268228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3f6c4ea6-12dd-4421-99db-71e661ecfb94 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Returning 404 to user: Hypervisor with ID 'ad1055af-487f-4851-8bc3-f3151b7915a4' could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:08.268228 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3f6c4ea6-12dd-4421-99db-71e661ecfb94 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/ad1055af-487f-4851-8bc3-f3151b7915a4/uptime" status: 404 len: 123 microversion: 2.1 time: 0.071354 May 19 04:32:08.274318 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 107/220] 10.222.0.58 () {58 vars in 1277 bytes} [Thu May 19 04:32:08 2022] GET /compute/v2.1/os-hypervisors/ad1055af-487f-4851-8bc3-f3151b7915a4/uptime => generated 123 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:08.289667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27de12a6-c2e9-47a6-a9e6-c91c373daf35 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Calling method '.version_select at 0x7fd3168fb310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.297229 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:08.297229 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:08.308533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27de12a6-c2e9-47a6-a9e6-c91c373daf35 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.309434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27de12a6-c2e9-47a6-a9e6-c91c373daf35 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.314357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:08.331657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27de12a6-c2e9-47a6-a9e6-c91c373daf35 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.333132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27de12a6-c2e9-47a6-a9e6-c91c373daf35 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.353626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27de12a6-c2e9-47a6-a9e6-c91c373daf35 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.354517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27de12a6-c2e9-47a6-a9e6-c91c373daf35 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.364401 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27de12a6-c2e9-47a6-a9e6-c91c373daf35 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.081829 May 19 04:32:08.365678 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 108/221] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:08.373668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a00b8e5-e155-48c3-adac-3f45e9137a09 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Calling method '.version_select at 0x7fd31665ab80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.472340 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5a82f8ab-e884-4970-9e5b-8c994a29b0d6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.423693 May 19 04:32:08.480758 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 114/222] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:32:08 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:08.489606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-08798460-b428-4e0c-a04b-d2e48d74e12d tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Calling method '.version_select at 0x7fd3166a14c0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.494000 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:08.494000 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:08.497363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-08798460-b428-4e0c-a04b-d2e48d74e12d tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '6cbc106af0e249e08238dae70563362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0b48ea9d3e4241a666f08f945f0236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-08798460-b428-4e0c-a04b-d2e48d74e12d tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Request method failure captured: May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchFiKgy1BgbK0D7Bk8Mqa1I6mrIaEo55Z4NrNWbQP1NgNVk0cJ3qhPY8w917mWPH3QI46__kL37Dqud0LfXwP08m0d90PB9icMvgGn3_fsc7egVa0Z1t8TZgLeY8HsQ30nVMZ3SLCalgKQi1JxbAEtM1NkDka1IF-OAyMr9TLi-Eko May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:08.502026 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec0b48ea9d3e4241a666f08f945f0236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ec0b48ea9d3e4241a666f08f945f0236 May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-860420078 May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 6cbc106af0e249e08238dae70563362a May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-860420078-project May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '1'} May 19 04:32:08.503450 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:08.504249 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 19 04:32:08.505869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:08.508866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-08798460-b428-4e0c-a04b-d2e48d74e12d tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:08.511342 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-08798460-b428-4e0c-a04b-d2e48d74e12d tempest-HypervisorAdminNegativeTestJSON-860420078 tempest-HypervisorAdminNegativeTestJSON-860420078-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.027848 May 19 04:32:08.514972 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 115/223] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:08.528015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-03763cfc-3ce1-455e-ad00-7819dab9078c req-9980f37f-a1b7-4e91-a4eb-75208a99eea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99310c06-abbf-4e4f-b3c4-4b686b2f6139", "tag": "bd629c36-b208-4288-ae36-bf8a28f018d8"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:08.548238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-03763cfc-3ce1-455e-ad00-7819dab9078c req-9980f37f-a1b7-4e91-a4eb-75208a99eea8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.551204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-03763cfc-3ce1-455e-ad00-7819dab9078c req-9980f37f-a1b7-4e91-a4eb-75208a99eea8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.575591 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-03763cfc-3ce1-455e-ad00-7819dab9078c req-9980f37f-a1b7-4e91-a4eb-75208a99eea8 service nova] Creating event network-changed:bd629c36-b208-4288-ae36-bf8a28f018d8 for instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 on n-h1-766726-30 May 19 04:32:08.597888 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-03763cfc-3ce1-455e-ad00-7819dab9078c req-9980f37f-a1b7-4e91-a4eb-75208a99eea8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080048 May 19 04:32:08.604258 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 116/224] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:08.618636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-034c9d82-d001-4b65-a3da-86aa7a59a8e5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.624565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-034c9d82-d001-4b65-a3da-86aa7a59a8e5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:08.636484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-034c9d82-d001-4b65-a3da-86aa7a59a8e5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.637619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-034c9d82-d001-4b65-a3da-86aa7a59a8e5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.640443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-034c9d82-d001-4b65-a3da-86aa7a59a8e5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:08.641199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-034c9d82-d001-4b65-a3da-86aa7a59a8e5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:08.686484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:08.812731 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a00b8e5-e155-48c3-adac-3f45e9137a09 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/40094da3c6c04d88bfcd57962a9a5230/defaults" status: 200 len: 371 microversion: 2.1 time: 0.445230 May 19 04:32:08.813372 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 109/225] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:32:08 2022] GET /compute/v2.1/os-quota-sets/40094da3c6c04d88bfcd57962a9a5230/defaults => generated 371 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:08.833639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-258214e9-648b-4d40-9f76-af3d957495e6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.835218 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:08.835218 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:08.854217 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-258214e9-648b-4d40-9f76-af3d957495e6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.030869 May 19 04:32:08.855866 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 110/226] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:32:08 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:08.868416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b2210267-0e13-4746-93bf-5b6907b571f8 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Calling method '.version_select at 0x7fd3168c4b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:08.870174 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:08.870174 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:08.875219 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b2210267-0e13-4746-93bf-5b6907b571f8 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] HTTP exception thrown: Hypervisor with ID 'e6db83a5-fe32-427c-b515-2961ed4adf10' could not be found. May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b2210267-0e13-4746-93bf-5b6907b571f8 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Request method failure captured: May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-hypervisors/e6db83a5-fe32-427c-b515-2961ed4adf10 HTTP/1.1 May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchGStmp0FAvJeb6RIeswb3RJKXX1b58-_5BgFwNZzPt_3agiP893fuuS5SIp8PeQKJyYjUALJG-GnyS8-3skFTszBvH_qx3qfWTTbQx7i2wgA3jgFzbfQDRza1JYM9inzHF-qiqcPEd5OgEV763UnSE3n_ZOoRSzWHor5DUKffMMs8 May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 5526a747e4e84361be02e8a379806d15 May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2095191283 May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:32:08.880092 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5526a747e4e84361be02e8a379806d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5526a747e4e84361be02e8a379806d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5526a747e4e84361be02e8a379806d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5526a747e4e84361be02e8a379806d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2095191283 May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 5526a747e4e84361be02e8a379806d15 May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2095191283 May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b96cfc9ab48546d6ab00d92037dff3ea May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: exception: Hypervisor with ID 'e6db83a5-fe32-427c-b515-2961ed4adf10' could not be found. May 19 04:32:08.882569 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'e6db83a5-fe32-427c-b515-2961ed4adf10'} May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e6db83a5-fe32-427c-b515-2961ed4adf10' May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 19 04:32:08.883628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:32:08.884994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e6db83a5-fe32-427c-b515-2961ed4adf10' could not be found. May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e6db83a5-fe32-427c-b515-2961ed4adf10' could not be found. May 19 04:32:08.887965 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:08.891858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b2210267-0e13-4746-93bf-5b6907b571f8 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] Returning 404 to user: Hypervisor with ID 'e6db83a5-fe32-427c-b515-2961ed4adf10' could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:08.894793 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b2210267-0e13-4746-93bf-5b6907b571f8 tempest-HypervisorAdminNegativeTestJSON-2095191283 tempest-HypervisorAdminNegativeTestJSON-2095191283-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/e6db83a5-fe32-427c-b515-2961ed4adf10" status: 404 len: 123 microversion: 2.1 time: 0.032986 May 19 04:32:08.898523 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 111/227] 10.222.0.58 () {58 vars in 1256 bytes} [Thu May 19 04:32:08 2022] GET /compute/v2.1/os-hypervisors/e6db83a5-fe32-427c-b515-2961ed4adf10 => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:09.018692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-034c9d82-d001-4b65-a3da-86aa7a59a8e5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:09.028932 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-034c9d82-d001-4b65-a3da-86aa7a59a8e5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1289 microversion: 2.1 time: 0.421049 May 19 04:32:09.032462 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 117/228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:08 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1289 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:09.048653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:09.051078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:09.067206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:09.069919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:09.070883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:09.072390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:09.342975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-78108fc9-c28e-4e8c-b3e0-ba44997ddaa1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:09.361565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:09.367037 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-78108fc9-c28e-4e8c-b3e0-ba44997ddaa1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.465022 May 19 04:32:09.377973 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 112/229] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:32:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:09.379460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:09.381550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:09.383422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-88e22ab4-8306-4b18-9e48-96fe980e5379 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1362 microversion: 2.25 time: 0.347950 May 19 04:32:09.386182 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 118/230] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:09 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:09.398350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b6b069d1-a858-490b-bf10-e67974627daf tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-766726-30"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:09.399744 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:09.399744 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:09.425910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6b069d1-a858-490b-bf10-e67974627daf tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:09.426352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6b069d1-a858-490b-bf10-e67974627daf tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:09.660224 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b6b069d1-a858-490b-bf10-e67974627daf tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.276794 May 19 04:32:09.661308 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 113/231] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:32:09 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:09.672663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7f59e337-8cab-495f-b534-de536664fdcf tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:09.673911 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:09.673911 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:09.704527 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7f59e337-8cab-495f-b534-de536664fdcf tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.036070 May 19 04:32:09.712411 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 114/232] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:09 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:09.719112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-85b18039-9d3a-4227-9d1b-852f1dc6d647 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2036502007"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:09.722805 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:09.722805 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:09.726577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.aggregate [None req-85b18039-9d3a-4227-9d1b-852f1dc6d647 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Generated uuid 89d79cb9-f177-4601-8eb0-38b80651985f for aggregate {{(pid=124818) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:09.804658 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-85b18039-9d3a-4227-9d1b-852f1dc6d647 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090657 May 19 04:32:09.811791 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 115/233] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:09.824195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a316fdf-2052-4509-a201-f7ab93a3ebca tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:09.826737 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:09.826737 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:09.850369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a316fdf-2052-4509-a201-f7ab93a3ebca tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:09.851106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a316fdf-2052-4509-a201-f7ab93a3ebca tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:09.911247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:10.015493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce2f01d8-82fe-4002-92d4-96fb78611221 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1427455851", "id": 1987996585, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:10.017334 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:10.017334 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:10.051292 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a316fdf-2052-4509-a201-f7ab93a3ebca tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.237499 May 19 04:32:10.058849 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 116/234] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:32:09 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:10.065277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51e537f5-cdb6-4651-899e-c9841fd8ff5d tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Action: 'update', calling method: .version_select at 0x7fd3168fbc10>, body: {"quota_set": {"ram": "5120"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:10.065459 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce2f01d8-82fe-4002-92d4-96fb78611221 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.677041 May 19 04:32:10.073676 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 119/235] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:32:09 2022] POST /compute/v2.1/flavors => generated 425 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:10.081112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33360b64-499c-41c9-8912-87fd3d2a04cc tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:10.082142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33360b64-499c-41c9-8912-87fd3d2a04cc tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:10.093631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33360b64-499c-41c9-8912-87fd3d2a04cc tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:10.094617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33360b64-499c-41c9-8912-87fd3d2a04cc tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:10.096327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33360b64-499c-41c9-8912-87fd3d2a04cc tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:10.097053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33360b64-499c-41c9-8912-87fd3d2a04cc tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:10.219912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51e537f5-cdb6-4651-899e-c9841fd8ff5d tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:10.220620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51e537f5-cdb6-4651-899e-c9841fd8ff5d tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:10.221737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51e537f5-cdb6-4651-899e-c9841fd8ff5d tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:10.222399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51e537f5-cdb6-4651-899e-c9841fd8ff5d tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:10.361671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51e537f5-cdb6-4651-899e-c9841fd8ff5d tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/e44abfb335c24870ad280fffa0e39fe7" status: 200 len: 328 microversion: 2.1 time: 0.278583 May 19 04:32:10.364110 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 117/236] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:32:10 2022] PUT /compute/v2.1/os-quota-sets/e44abfb335c24870ad280fffa0e39fe7 => generated 328 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:10.375673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-20338d68-d8f9-4865-976d-2c9d10dc29b8 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:10.376429 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:10.376429 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:10.392047 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-20338d68-d8f9-4865-976d-2c9d10dc29b8 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.025242 May 19 04:32:10.402402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 118/237] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:32:10 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:10.406611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e5f412e-a38d-4c71-81e7-e0617ed9a2a0 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:10.411279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-33360b64-499c-41c9-8912-87fd3d2a04cc tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:10.426079 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-33360b64-499c-41c9-8912-87fd3d2a04cc tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1319 microversion: 2.1 time: 0.351105 May 19 04:32:10.428761 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 120/238] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:10 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:10.438440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-978fe7a2-02f7-4f39-a1a4-28829b1fc5ec tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Calling method '.version_select at 0x7fd31668e310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:10.446856 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e5f412e-a38d-4c71-81e7-e0617ed9a2a0 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.052577 May 19 04:32:10.453537 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 119/239] 10.222.0.58 () {58 vars in 1181 bytes} [Thu May 19 04:32:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:10.461361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:10.461986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:10.481488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:10.486050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:10.486921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:10.487375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:10.610309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-978fe7a2-02f7-4f39-a1a4-28829b1fc5ec tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:10.610908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-978fe7a2-02f7-4f39-a1a4-28829b1fc5ec tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:10.611700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-978fe7a2-02f7-4f39-a1a4-28829b1fc5ec tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:10.612426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-978fe7a2-02f7-4f39-a1a4-28829b1fc5ec tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:10.668505 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-978fe7a2-02f7-4f39-a1a4-28829b1fc5ec tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/e44abfb335c24870ad280fffa0e39fe7/detail" status: 200 len: 916 microversion: 2.1 time: 0.236897 May 19 04:32:10.672447 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 121/240] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:32:10 2022] GET /compute/v2.1/os-quota-sets/e44abfb335c24870ad280fffa0e39fe7/detail => generated 916 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:10.690763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-439091d3-1ae9-4d2b-a7bd-bce8a6c6f53c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:10.695519 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:10.695519 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:10.714852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-439091d3-1ae9-4d2b-a7bd-bce8a6c6f53c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:10.716479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-439091d3-1ae9-4d2b-a7bd-bce8a6c6f53c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:10.882394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:10.914461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:10.919240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:10.920410 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-05bd1ac9-9d93-4046-8237-d39842398d59 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1362 microversion: 2.25 time: 0.465886 May 19 04:32:10.926853 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 120/241] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:10 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1362 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:10.952574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6249c3ba-8f5d-47f0-a531-be3d2060c627 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1117810109", "id": 649022310, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:10.958537 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:10.958537 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:11.004173 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6249c3ba-8f5d-47f0-a531-be3d2060c627 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.075973 May 19 04:32:11.007147 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 121/242] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:32:10 2022] POST /compute/v2.1/flavors => generated 422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:11.018019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f12feda6-3ea9-4d85-b735-0d5ec57de177 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:11.019871 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-439091d3-1ae9-4d2b-a7bd-bce8a6c6f53c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.345920 May 19 04:32:11.021603 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 122/243] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:32:10 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:11.032160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-730f9a65-f99a-4def-940f-8b260f208056 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:11.032934 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:11.032934 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:11.041443 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f12feda6-3ea9-4d85-b735-0d5ec57de177 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023534 May 19 04:32:11.042896 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 122/244] 10.222.0.58 () {58 vars in 1181 bytes} [Thu May 19 04:32:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:11.057031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-557ae28b-b0ce-4916-bbbe-e2a4d472180d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Action: 'create', calling method: .version_select at 0x7fd316574af0>, body: {"keypair": {"name": "tempest-keypair-908441147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrtifPFf8hWQEhgsJhPy2n6tHycRBt+CXp1HePapfdrsP7mr0YXsw8SurZgdbbYxKFrIVSp3Tj14Zbzyx93/8jVy+WxHx3hFXjbw2L646LXohXiIlhSCcjqnjfbN56zSw=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:11.079993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-557ae28b-b0ce-4916-bbbe-e2a4d472180d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Getting quotas for project e9f7c96b0d5a45aaa70f0a09bdea144c. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:11.092003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-557ae28b-b0ce-4916-bbbe-e2a4d472180d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Getting quotas for user f659bfc9046342629cd0c35e08871246 and project e9f7c96b0d5a45aaa70f0a09bdea144c. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:11.109727 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-730f9a65-f99a-4def-940f-8b260f208056 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.081446 May 19 04:32:11.111509 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 123/245] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:11 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:11.143355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Action: 'update', calling method: .version_select at 0x7fd31668e670>, body: {"quota_set": {"ram": "2048"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:11.148374 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-557ae28b-b0ce-4916-bbbe-e2a4d472180d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096845 May 19 04:32:11.149667 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 123/246] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:32:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:32:11.160585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba6c31c3-97ec-4d77-9469-c5006422d046 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Calling method '.version_select at 0x7fd316574dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:11.162842 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:11.162842 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:11.164365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba6c31c3-97ec-4d77-9469-c5006422d046 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.164892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba6c31c3-97ec-4d77-9469-c5006422d046 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.166106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba6c31c3-97ec-4d77-9469-c5006422d046 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.166664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba6c31c3-97ec-4d77-9469-c5006422d046 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.182924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:11.207411 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba6c31c3-97ec-4d77-9469-c5006422d046 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.055790 May 19 04:32:11.208883 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 124/247] 10.222.0.58 () {58 vars in 1127 bytes} [Thu May 19 04:32:11 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:11.218275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b09897b2-8cc5-4f82-ab9e-ee8dab8c9e1b tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Calling method '.version_select at 0x7fd3166928b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:11.223767 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:11.223767 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:11.227780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b09897b2-8cc5-4f82-ab9e-ee8dab8c9e1b tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.234679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b09897b2-8cc5-4f82-ab9e-ee8dab8c9e1b tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.235688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b09897b2-8cc5-4f82-ab9e-ee8dab8c9e1b tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.236247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b09897b2-8cc5-4f82-ab9e-ee8dab8c9e1b tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.256924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.257408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.258489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.259085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.296544 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b09897b2-8cc5-4f82-ab9e-ee8dab8c9e1b tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.078331 May 19 04:32:11.304102 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 125/248] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:11 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:11.317935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f7520dd-5faa-426b-98bb-10a8d4ebf3c1 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Calling method '.version_select at 0x7fd3166920d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:11.320127 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:11.320127 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:11.321415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7520dd-5faa-426b-98bb-10a8d4ebf3c1 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.321871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7520dd-5faa-426b-98bb-10a8d4ebf3c1 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.323371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7520dd-5faa-426b-98bb-10a8d4ebf3c1 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.323820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7520dd-5faa-426b-98bb-10a8d4ebf3c1 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.361781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.365241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.366885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.369833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.372246 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f7520dd-5faa-426b-98bb-10a8d4ebf3c1 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.057882 May 19 04:32:11.377319 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 126/249] 10.222.0.58 () {58 vars in 1127 bytes} [Thu May 19 04:32:11 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:11.388523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88368118-0657-4218-9f8b-b516866a7f7c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1867352301"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:11.390164 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:11.390164 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:11.391081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.aggregate [None req-88368118-0657-4218-9f8b-b516866a7f7c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Generated uuid 2fd247e8-f948-4e8e-ba67-b9234256f0ad for aggregate {{(pid=124818) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:11.439401 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88368118-0657-4218-9f8b-b516866a7f7c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064824 May 19 04:32:11.440356 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 127/250] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:11.446986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b25247b8-111f-4968-989e-b1af07f69fae tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Calling method '.version_select at 0x7fd316747d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:11.453875 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:11.453875 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:11.461585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b25247b8-111f-4968-989e-b1af07f69fae tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.462030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b25247b8-111f-4968-989e-b1af07f69fae tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.487871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b25247b8-111f-4968-989e-b1af07f69fae tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.490942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b25247b8-111f-4968-989e-b1af07f69fae tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.564580 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b25247b8-111f-4968-989e-b1af07f69fae tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h2-766726-30" status: 200 len: 471 microversion: 2.1 time: 0.123187 May 19 04:32:11.574428 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 128/251] 10.222.0.58 () {58 vars in 1172 bytes} [Thu May 19 04:32:11 2022] GET /compute/v2.1/os-hosts/n-h2-766726-30 => generated 471 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:11.580575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-958a5741-d384-4901-87a9-b0a23ec2894b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:11.592599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-958a5741-d384-4901-87a9-b0a23ec2894b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:11.602137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-958a5741-d384-4901-87a9-b0a23ec2894b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.604072 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a22147b5-6af4-4e42-93f3-34eac4f0a54e tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/e44abfb335c24870ad280fffa0e39fe7?user_id=64e5823ee9e94614b6367cef3c19d80c" status: 200 len: 328 microversion: 2.1 time: 0.485472 May 19 04:32:11.604259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-958a5741-d384-4901-87a9-b0a23ec2894b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.605111 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 124/252] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:32:11 2022] PUT /compute/v2.1/os-quota-sets/e44abfb335c24870ad280fffa0e39fe7?user_id=64e5823ee9e94614b6367cef3c19d80c => generated 328 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:11.605603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-958a5741-d384-4901-87a9-b0a23ec2894b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.606345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-958a5741-d384-4901-87a9-b0a23ec2894b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.619286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-38e29be7-f9ba-4698-8ef5-8213aafd3a82 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:11.621899 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:11.621899 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:11.645186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38e29be7-f9ba-4698-8ef5-8213aafd3a82 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.645647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38e29be7-f9ba-4698-8ef5-8213aafd3a82 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.681517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:11.886961 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-38e29be7-f9ba-4698-8ef5-8213aafd3a82 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.277836 May 19 04:32:11.888743 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 125/253] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:32:11 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:11.899034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5793f209-ad2b-4cf5-b26a-9e99f5dfe646 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Calling method '.version_select at 0x7fd31668eee0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:11.899887 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:11.899887 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:11.915381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5793f209-ad2b-4cf5-b26a-9e99f5dfe646 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.915835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5793f209-ad2b-4cf5-b26a-9e99f5dfe646 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:11.979682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5793f209-ad2b-4cf5-b26a-9e99f5dfe646 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:11.980137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5793f209-ad2b-4cf5-b26a-9e99f5dfe646 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:12.058006 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5793f209-ad2b-4cf5-b26a-9e99f5dfe646 tempest-HostsAdminTestJSON-95470526 tempest-HostsAdminTestJSON-95470526-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h1-766726-30" status: 200 len: 471 microversion: 2.1 time: 0.168107 May 19 04:32:12.065541 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 126/254] 10.222.0.58 () {58 vars in 1172 bytes} [Thu May 19 04:32:11 2022] GET /compute/v2.1/os-hosts/n-h1-766726-30 => generated 471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:12.072360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-911690c9-cf72-42d1-be20-32d4507cf737 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Calling method '.version_select at 0x7fd316727f70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:12.239920 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-911690c9-cf72-42d1-be20-32d4507cf737 tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/e44abfb335c24870ad280fffa0e39fe7?user_id=64e5823ee9e94614b6367cef3c19d80c" status: 200 len: 370 microversion: 2.1 time: 0.172897 May 19 04:32:12.244176 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 127/255] 10.222.0.58 () {58 vars in 1322 bytes} [Thu May 19 04:32:12 2022] GET /compute/v2.1/os-quota-sets/e44abfb335c24870ad280fffa0e39fe7?user_id=64e5823ee9e94614b6367cef3c19d80c => generated 370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:12.267184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-633572ca-ca3e-427a-9d73-fe6413e65e7b tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:12.276859 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:12.276859 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:12.318238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-633572ca-ca3e-427a-9d73-fe6413e65e7b tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:12.333680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-633572ca-ca3e-427a-9d73-fe6413e65e7b tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:12.387635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-958a5741-d384-4901-87a9-b0a23ec2894b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:12.404555 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-958a5741-d384-4901-87a9-b0a23ec2894b tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1319 microversion: 2.1 time: 0.820357 May 19 04:32:12.405792 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 129/256] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:11 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1319 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:12.410831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:12.411831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:12.430871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:12.431566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:12.432574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:12.435942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:12.634126 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-633572ca-ca3e-427a-9d73-fe6413e65e7b tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.382093 May 19 04:32:12.644818 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 128/257] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:32:12 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:12.665363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-27e40fd7-2ea4-42ca-868c-45d67f0146f6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:12.667419 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:12.667419 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:12.753535 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-27e40fd7-2ea4-42ca-868c-45d67f0146f6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.103355 May 19 04:32:12.758672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 129/258] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:12 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:12.773456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ecb2d8f-ee3f-43db-89cf-1849f3628411 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-533286933"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:12.780477 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:12.780477 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:12.784808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-9ecb2d8f-ee3f-43db-89cf-1849f3628411 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Generated uuid d26152db-7c75-470e-abc3-cb6fc702500a for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:12.822972 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ecb2d8f-ee3f-43db-89cf-1849f3628411 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.062259 May 19 04:32:12.823946 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 130/259] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:12 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:12.844357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ddc884b-d6eb-4a46-9984-e66c15a8974a tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:12.848914 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:12.848914 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:12.911452 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ddc884b-d6eb-4a46-9984-e66c15a8974a tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.081153 May 19 04:32:12.922379 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 131/260] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:12.930470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-024fa41b-6203-445d-8713-cc33f1b96ed7 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:12.931301 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:12.931301 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:12.954954 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-024fa41b-6203-445d-8713-cc33f1b96ed7 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] HTTP exception thrown: Aggregate 6 could not be found. May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-024fa41b-6203-445d-8713-cc33f1b96ed7 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Request method failure captured: May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcggdqmtssIWLy_1VoEMQN4-_Wst7iLlUvX6iH7PUHNQjDOroS10CD7QeWiqMnjk-H5prsYcXq1HaAyuhQEjjoMG89IfQ8flkrEqucK2PUkEIG_66q5mUzM2p6ogdUNro7hU2j6dRi0QP9eQZOpB2tiVgeTdPBZu2M4mSF7ZHCQbprE May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 726808c782464c31961c4dbca7f5adc0 May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:12.965314 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_726808c782464c31961c4dbca7f5adc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 726808c782464c31961c4dbca7f5adc0 May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminTestJSON-1960329480-project-admin May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f997ccbc587c40fc83231423be790fec May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminTestJSON-1960329480-project-admin May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: exception: Aggregate 6 could not be found. May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '6'} May 19 04:32:12.966531 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:12.967238 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. May 19 04:32:12.968321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:12.969303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-024fa41b-6203-445d-8713-cc33f1b96ed7 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:12.970497 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-024fa41b-6203-445d-8713-cc33f1b96ed7 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.043453 May 19 04:32:12.976253 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 132/261] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:32:12 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:32:12.984514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f309267-8118-4241-b030-11258617df15 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:12.988442 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:12.988442 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:13.016781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:13.028608 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-3f309267-8118-4241-b030-11258617df15 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] HTTP exception thrown: Aggregate 6 could not be found. May 19 04:32:13.036582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f309267-8118-4241-b030-11258617df15 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Request method failure captured: May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcggdqmtssIWLy_1VoEMQN4-_Wst7iLlUvX6iH7PUHNQjDOroS10CD7QeWiqMnjk-H5prsYcXq1HaAyuhQEjjoMG89IfQ8flkrEqucK2PUkEIG_66q5mUzM2p6ogdUNro7hU2j6dRi0QP9eQZOpB2tiVgeTdPBZu2M4mSF7ZHCQbprE May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 726808c782464c31961c4dbca7f5adc0 May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:13.038274 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_726808c782464c31961c4dbca7f5adc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 726808c782464c31961c4dbca7f5adc0 May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminTestJSON-1960329480-project-admin May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f997ccbc587c40fc83231423be790fec May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminTestJSON-1960329480-project-admin May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: exception: Aggregate 6 could not be found. May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '6'} May 19 04:32:13.039477 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:32:13.040269 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:13.041638 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:13.042721 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:13.042721 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:13.042721 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:13.042721 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. May 19 04:32:13.042721 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.042721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f309267-8118-4241-b030-11258617df15 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:13.042721 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3f309267-8118-4241-b030-11258617df15 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.059101 May 19 04:32:13.044703 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 133/262] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:32:13.048167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:13.052201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-957bfd25-0900-4338-a858-deba27f1d924 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1807243906", "name": "tempest-test_aggregate-2131232390"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:13.056651 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d0d2fbfa-fc94-4b76-8bca-4ea8e6f95cc4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1362 microversion: 2.25 time: 0.646772 May 19 04:32:13.071230 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 130/263] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:12 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:13.091036 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:13.091036 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:13.092107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-957bfd25-0900-4338-a858-deba27f1d924 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Generated uuid 9d96e616-6b2e-4209-a295-8f772f84c19f for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:13.158666 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-957bfd25-0900-4338-a858-deba27f1d924 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.112300 May 19 04:32:13.165329 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 134/264] 10.222.0.58 () {60 vars in 1164 bytes} [Thu May 19 04:32:13 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:13.171366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7735b2b5-8505-451f-8696-2c240bf5ce88 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:13.172614 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:13.172614 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:13.219900 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7735b2b5-8505-451f-8696-2c240bf5ce88 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.051385 May 19 04:32:13.222876 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 131/265] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:13 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:13.231503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8aef916f-d87c-4323-8018-34b96b318651 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:13.232270 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:13.232270 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:13.246582 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-8aef916f-d87c-4323-8018-34b96b318651 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] HTTP exception thrown: Aggregate 7 could not be found. May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8aef916f-d87c-4323-8018-34b96b318651 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Request method failure captured: May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcggdqmtssIWLy_1VoEMQN4-_Wst7iLlUvX6iH7PUHNQjDOroS10CD7QeWiqMnjk-H5prsYcXq1HaAyuhQEjjoMG89IfQ8flkrEqucK2PUkEIG_66q5mUzM2p6ogdUNro7hU2j6dRi0QP9eQZOpB2tiVgeTdPBZu2M4mSF7ZHCQbprE May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 726808c782464c31961c4dbca7f5adc0 May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:13.248191 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_726808c782464c31961c4dbca7f5adc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 726808c782464c31961c4dbca7f5adc0 May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminTestJSON-1960329480-project-admin May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f997ccbc587c40fc83231423be790fec May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminTestJSON-1960329480-project-admin May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: exception: Aggregate 7 could not be found. May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '7'} May 19 04:32:13.249575 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:13.250273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. May 19 04:32:13.251478 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:13.252405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8aef916f-d87c-4323-8018-34b96b318651 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:13.252405 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8aef916f-d87c-4323-8018-34b96b318651 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.022007 May 19 04:32:13.258640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a8b9bd1-c664-4d84-92e2-2d1bdbf5e4c6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:13.259416 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:13.259416 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:13.261503 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 135/266] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:32:13 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:32:13.278038 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1a8b9bd1-c664-4d84-92e2-2d1bdbf5e4c6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] HTTP exception thrown: Aggregate 7 could not be found. May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a8b9bd1-c664-4d84-92e2-2d1bdbf5e4c6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Request method failure captured: May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcggdqmtssIWLy_1VoEMQN4-_Wst7iLlUvX6iH7PUHNQjDOroS10CD7QeWiqMnjk-H5prsYcXq1HaAyuhQEjjoMG89IfQ8flkrEqucK2PUkEIG_66q5mUzM2p6ogdUNro7hU2j6dRi0QP9eQZOpB2tiVgeTdPBZu2M4mSF7ZHCQbprE May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 726808c782464c31961c4dbca7f5adc0 May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:32:13.280306 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/726808c782464c31961c4dbca7f5adc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_726808c782464c31961c4dbca7f5adc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 726808c782464c31961c4dbca7f5adc0 May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1960329480 May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AggregatesAdminTestJSON-1960329480-project-admin May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: f997ccbc587c40fc83231423be790fec May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AggregatesAdminTestJSON-1960329480-project-admin May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: exception: Aggregate 7 could not be found. May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '7'} May 19 04:32:13.281498 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:32:13.282196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:13.284018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:13.285420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:13.285420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:13.285420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:13.285420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. May 19 04:32:13.285420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:13.285420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a8b9bd1-c664-4d84-92e2-2d1bdbf5e4c6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:13.285420 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1a8b9bd1-c664-4d84-92e2-2d1bdbf5e4c6 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.027297 May 19 04:32:13.291785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-53f28592-b8bb-4cd5-941f-315b5ef05228 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1316175634"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:13.293204 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:13.293204 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:13.294438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-53f28592-b8bb-4cd5-941f-315b5ef05228 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Generated uuid d77bb4df-0024-439e-b63d-06bc070bb22a for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:13.304758 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 132/267] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:13 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:32:13.351736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-53f28592-b8bb-4cd5-941f-315b5ef05228 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064114 May 19 04:32:13.352342 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 136/268] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:32:13.363531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2858c3e-af76-4920-bb17-647c71a01b89 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:13.364304 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:13.364304 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:13.367077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2aec6ae2-680b-49bb-82ea-3e22b754c9bf tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Calling method '.version_select at 0x7fd316664dc0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:13.372865 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2858c3e-af76-4920-bb17-647c71a01b89 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.014278 May 19 04:32:13.385871 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 133/269] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:32:13 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:13.391199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47389eb5-4457-4ec1-bbe7-7e11b37dae62 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:13.397794 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:13.397794 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:13.448113 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47389eb5-4457-4ec1-bbe7-7e11b37dae62 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.061082 May 19 04:32:13.454136 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 134/270] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 19 04:32:13 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:13.459007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2049ea8-7046-4877-bfbf-198fc86ea004 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:13.460192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d2049ea8-7046-4877-bfbf-198fc86ea004 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:13.479053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2049ea8-7046-4877-bfbf-198fc86ea004 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:13.479508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2049ea8-7046-4877-bfbf-198fc86ea004 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:13.480300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2049ea8-7046-4877-bfbf-198fc86ea004 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:13.480742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2049ea8-7046-4877-bfbf-198fc86ea004 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:13.737891 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2aec6ae2-680b-49bb-82ea-3e22b754c9bf tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/40094da3c6c04d88bfcd57962a9a5230/defaults" status: 200 len: 371 microversion: 2.1 time: 0.376072 May 19 04:32:13.738907 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 137/271] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:32:13 2022] GET /compute/v2.1/os-quota-sets/40094da3c6c04d88bfcd57962a9a5230/defaults => generated 371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:13.748959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29b174a4-2c48-49d7-bb59-6993183b2ff8 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:13.750870 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:13.750870 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:13.773346 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29b174a4-2c48-49d7-bb59-6993183b2ff8 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.032895 May 19 04:32:13.774714 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 138/272] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:32:13 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:13.780562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fcec271e-2bf5-4a02-9f63-e6c160100c2f tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Action: 'update', calling method: .version_select at 0x7fd316664310>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:13.930097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fcec271e-2bf5-4a02-9f63-e6c160100c2f tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:13.931253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fcec271e-2bf5-4a02-9f63-e6c160100c2f tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:13.932804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fcec271e-2bf5-4a02-9f63-e6c160100c2f tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:13.933517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fcec271e-2bf5-4a02-9f63-e6c160100c2f tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:14.289430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d2049ea8-7046-4877-bfbf-198fc86ea004 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:14.300889 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2049ea8-7046-4877-bfbf-198fc86ea004 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1319 microversion: 2.1 time: 0.842842 May 19 04:32:14.304407 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 135/273] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:13 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1319 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:14.309285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99b2d59f-e9a1-4016-9b07-a868d5b0d351 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:14.319215 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:14.319215 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:14.383925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99b2d59f-e9a1-4016-9b07-a868d5b0d351 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.078151 May 19 04:32:14.391214 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 136/274] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:14 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:14.407879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c7182649-8cec-4684-a2e6-458420000cdb req-449d4e06-bb7c-4925-ba35-afd8b8a979df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca966824-4ecc-459d-b22b-83d6d7ee809e", "tag": "4eea3355-5aa0-426a-977d-f89a5e07bfb6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:14.435887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c7182649-8cec-4684-a2e6-458420000cdb req-449d4e06-bb7c-4925-ba35-afd8b8a979df service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:14.436772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c7182649-8cec-4684-a2e6-458420000cdb req-449d4e06-bb7c-4925-ba35-afd8b8a979df service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:14.463426 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c7182649-8cec-4684-a2e6-458420000cdb req-449d4e06-bb7c-4925-ba35-afd8b8a979df service nova] Creating event network-changed:4eea3355-5aa0-426a-977d-f89a5e07bfb6 for instance ca966824-4ecc-459d-b22b-83d6d7ee809e on n-h2-766726-30 May 19 04:32:14.480497 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c7182649-8cec-4684-a2e6-458420000cdb req-449d4e06-bb7c-4925-ba35-afd8b8a979df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087134 May 19 04:32:14.481297 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 137/275] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:14.500177 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fcec271e-2bf5-4a02-9f63-e6c160100c2f tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/40094da3c6c04d88bfcd57962a9a5230" status: 200 len: 329 microversion: 2.1 time: 0.723593 May 19 04:32:14.502388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:14.503292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:14.507267 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 139/276] 10.222.0.58 () {60 vars in 1262 bytes} [Thu May 19 04:32:13 2022] PUT /compute/v2.1/os-quota-sets/40094da3c6c04d88bfcd57962a9a5230 => generated 329 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:14.516080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13ff531e-a71c-4e51-abcc-a84d6a9752fb tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1327229061", "availability_zone": "tempest-test_az-1966940522"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:14.523116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:14.525834 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:14.525834 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:14.526719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:14.528049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-13ff531e-a71c-4e51-abcc-a84d6a9752fb tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Generated uuid 0a091a96-18ab-4dfc-9afa-0107130e5c20 for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:14.529107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:14.532016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:14.546312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=19,nova_api:DELETE=5 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:14.618803 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13ff531e-a71c-4e51-abcc-a84d6a9752fb tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.110496 May 19 04:32:14.625870 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 140/277] 10.222.0.58 () {60 vars in 1164 bytes} [Thu May 19 04:32:14 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:14.631876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bce53a98-4c16-482f-99c8-b01d5a20806c tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Action: 'update', calling method: .version_select at 0x7fd31668e310>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:14.773404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bce53a98-4c16-482f-99c8-b01d5a20806c tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:14.777658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bce53a98-4c16-482f-99c8-b01d5a20806c tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:14.780601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bce53a98-4c16-482f-99c8-b01d5a20806c tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:14.781137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bce53a98-4c16-482f-99c8-b01d5a20806c tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:15.417884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:15.482580 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bce53a98-4c16-482f-99c8-b01d5a20806c tempest-QuotasAdminTestJSON-1740596702 tempest-QuotasAdminTestJSON-1740596702-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/40094da3c6c04d88bfcd57962a9a5230" status: 200 len: 329 microversion: 2.1 time: 0.855374 May 19 04:32:15.490741 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 141/278] 10.222.0.58 () {60 vars in 1262 bytes} [Thu May 19 04:32:14 2022] PUT /compute/v2.1/os-quota-sets/40094da3c6c04d88bfcd57962a9a5230 => generated 329 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:15.497251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-021eea33-2ded-4db2-8b34-c0ec7dfffb7c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1327229061_new", "availability_zone": "tempest-test_az-1966940522_new"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:15.644163 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:15.644163 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:15.714804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:15.716978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-021eea33-2ded-4db2-8b34-c0ec7dfffb7c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:15.717477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-021eea33-2ded-4db2-8b34-c0ec7dfffb7c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:15.733738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:15.747022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:15.750703 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43fa4f63-3cb3-474d-a68b-37f45fd7b475 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1362 microversion: 2.25 time: 1.267845 May 19 04:32:15.755255 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 138/279] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:14 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1362 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:15.773649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-560b7a4a-e726-432f-b799-ddc749416578 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:15.777863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-560b7a4a-e726-432f-b799-ddc749416578 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:15.789197 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-021eea33-2ded-4db2-8b34-c0ec7dfffb7c tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.295540 May 19 04:32:15.793970 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 142/280] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:32:15 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:15.812349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a19ed3b-9fab-4378-a831-2c3598e17f3f tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:15.814082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-560b7a4a-e726-432f-b799-ddc749416578 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:15.816371 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:15.816371 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:15.816651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-560b7a4a-e726-432f-b799-ddc749416578 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:15.819830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-560b7a4a-e726-432f-b799-ddc749416578 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:15.824932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-560b7a4a-e726-432f-b799-ddc749416578 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:15.847912 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4a19ed3b-9fab-4378-a831-2c3598e17f3f tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.043246 May 19 04:32:15.861853 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 143/281] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:32:15 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:15.869876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7625f17c-26a7-4000-a08d-92e0c5dfa35f tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:15.872137 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:15.872137 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:15.923801 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7625f17c-26a7-4000-a08d-92e0c5dfa35f tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.064542 May 19 04:32:15.925490 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 144/282] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:15 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:15.967669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ca7f28fa-388c-4eee-98e0-0650e3e8e4b3 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1535195758"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:15.971423 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:15.971423 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:15.975552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-ca7f28fa-388c-4eee-98e0-0650e3e8e4b3 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Generated uuid cd5b10e5-59b0-4570-b2e1-bad0ea8a3e40 for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:16.031162 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ca7f28fa-388c-4eee-98e0-0650e3e8e4b3 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.095748 May 19 04:32:16.033177 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 145/283] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:32:16.048036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9efd4b5e-6c5c-4318-babd-83765fd941f9 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:16.049092 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:16.049092 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:16.056261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=17,nova_api:UPDATE=16,nova_api:DELETE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:16.059811 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9efd4b5e-6c5c-4318-babd-83765fd941f9 tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.020562 May 19 04:32:16.062177 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 146/284] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:32:16 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:32:16.080075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-71f6266a-00d7-41af-bff0-b69246c78ebb tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:16.081513 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:16.081513 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:16.119642 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-71f6266a-00d7-41af-bff0-b69246c78ebb tempest-AggregatesAdminTestJSON-1960329480 tempest-AggregatesAdminTestJSON-1960329480-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.050109 May 19 04:32:16.127034 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 147/285] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:16 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:16.139457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:16.140014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:16.169833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:16.170302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:16.175939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:16.176402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:16.206130 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] HTTP exception thrown: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Request method failure captured: May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 HTTP/1.1 May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcge_tUTYQdGhswkyefSG0Lg9memkNh2qdf2TAKiEEyUiidHfcCgVaLU57z6pd6nFO-dgOQFHWTCnJk8BD4DKZK9QilOLTCLVBLmeVyBw8HK5QQCfaqqGqMBIUlKGTco1zrDD0RWRGHNL9ll_N2kI6VuThaiNyWGyLyP-1Y7dOY5DdQ May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 217d5eae52bd48c09310b4bbd9372d15 May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminTestJSON-1277962820 May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:16.208079 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminTestJSON-1277962820 May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 217d5eae52bd48c09310b4bbd9372d15 May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1277962820 May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminTestJSON-1277962820-project May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 36a7e252b3bf40da89469e42cb668ee0 May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminTestJSON-1277962820-project May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.211384 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2ef878e1-99c8-4dd5-ad5b-cdcd2535def1'} May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:16.213028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.215333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.216842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Returning 404 to user: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:16.216842 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97472128-7cfe-4e3a-abe4-94dbf91ded5e tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 404 len: 111 microversion: 2.1 time: 0.081968 May 19 04:32:16.216842 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 148/286] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:32:16 2022] DELETE /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:16.239449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:16.240217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] [instance: 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:16.254218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:16.254677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:16.256010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:16.256457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:16.298021 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] HTTP exception thrown: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Request method failure captured: May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 HTTP/1.1 May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcge_tUTYQdGhswkyefSG0Lg9memkNh2qdf2TAKiEEyUiidHfcCgVaLU57z6pd6nFO-dgOQFHWTCnJk8BD4DKZK9QilOLTCLVBLmeVyBw8HK5QQCfaqqGqMBIUlKGTco1zrDD0RWRGHNL9ll_N2kI6VuThaiNyWGyLyP-1Y7dOY5DdQ May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 217d5eae52bd48c09310b4bbd9372d15 May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminTestJSON-1277962820 May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:16.303892 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_217d5eae52bd48c09310b4bbd9372d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminTestJSON-1277962820 May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 217d5eae52bd48c09310b4bbd9372d15 May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1277962820 May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminTestJSON-1277962820-project May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 36a7e252b3bf40da89469e42cb668ee0 May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminTestJSON-1277962820-project May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.305431 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2ef878e1-99c8-4dd5-ad5b-cdcd2535def1'} May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:16.306080 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. May 19 04:32:16.307583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:16.308823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] Returning 404 to user: Instance 2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:16.308823 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-62d02232-c52b-41cc-85c4-ca8b81ba4aa8 tempest-AggregatesAdminTestJSON-1277962820 tempest-AggregatesAdminTestJSON-1277962820-project] 10.222.0.58 "GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1" status: 404 len: 111 microversion: 2.1 time: 0.074911 May 19 04:32:16.312234 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 149/287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:16 2022] GET /compute/v2.1/servers/2ef878e1-99c8-4dd5-ad5b-cdcd2535def1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:32:16.569539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-560b7a4a-e726-432f-b799-ddc749416578 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:16.589527 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-560b7a4a-e726-432f-b799-ddc749416578 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1319 microversion: 2.1 time: 0.829794 May 19 04:32:16.590339 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 139/288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:15 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1319 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:16.772660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:16.774212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:16.787320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:16.787957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:16.789938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:16.794178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:17.055521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-deaea966-b2f6-4afd-8707-8b6b188e29a8 req-2ce0e78e-761e-4795-aa39-7e36ac158c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99310c06-abbf-4e4f-b3c4-4b686b2f6139", "name": "network-vif-plugged", "status": "completed", "tag": "bd629c36-b208-4288-ae36-bf8a28f018d8"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:17.075334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-deaea966-b2f6-4afd-8707-8b6b188e29a8 req-2ce0e78e-761e-4795-aa39-7e36ac158c64 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:17.077464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-deaea966-b2f6-4afd-8707-8b6b188e29a8 req-2ce0e78e-761e-4795-aa39-7e36ac158c64 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:17.102306 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-deaea966-b2f6-4afd-8707-8b6b188e29a8 req-2ce0e78e-761e-4795-aa39-7e36ac158c64 service nova] Creating event network-vif-plugged:bd629c36-b208-4288-ae36-bf8a28f018d8 for instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 on n-h1-766726-30 May 19 04:32:17.117770 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-deaea966-b2f6-4afd-8707-8b6b188e29a8 req-2ce0e78e-761e-4795-aa39-7e36ac158c64 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067458 May 19 04:32:17.118888 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 140/289] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:32:17.492414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:17.509377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:17.513522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:17.518195 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1b3fc112-a908-4fdb-ba10-55537e80be46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1362 microversion: 2.25 time: 0.746854 May 19 04:32:17.521163 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 150/290] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:16 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1362 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:17.607925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73b4378c-c9f3-4080-aeef-2dfaca3ccd06 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:17.608645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73b4378c-c9f3-4080-aeef-2dfaca3ccd06 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:17.622122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73b4378c-c9f3-4080-aeef-2dfaca3ccd06 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:17.622934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73b4378c-c9f3-4080-aeef-2dfaca3ccd06 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:17.623361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73b4378c-c9f3-4080-aeef-2dfaca3ccd06 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:17.623806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73b4378c-c9f3-4080-aeef-2dfaca3ccd06 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:18.221821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73b4378c-c9f3-4080-aeef-2dfaca3ccd06 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:18.229379 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73b4378c-c9f3-4080-aeef-2dfaca3ccd06 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1319 microversion: 2.1 time: 0.626174 May 19 04:32:18.229995 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 141/291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:17 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1319 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:18.539705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:18.540737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:18.561518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:18.563546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:18.565712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:18.569315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:18.983358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:18.992613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:18.995348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:18.997441 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-513491ad-3040-461f-b4cc-f812d4e42c93 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1362 microversion: 2.25 time: 0.463660 May 19 04:32:18.998508 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 151/292] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:18 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1362 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:19.246548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c163881-32da-42a2-a6a6-722f752f923a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:19.247260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c163881-32da-42a2-a6a6-722f752f923a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:19.262741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c163881-32da-42a2-a6a6-722f752f923a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:19.263283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c163881-32da-42a2-a6a6-722f752f923a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:19.266429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c163881-32da-42a2-a6a6-722f752f923a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:19.266891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c163881-32da-42a2-a6a6-722f752f923a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:19.374872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3057a511-91d9-464a-a5ec-d394fb31bdbb tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Action: 'create', calling method: .version_select at 0x7fd31671e5e0>, body: {"pool": null} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:19.854159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1c163881-32da-42a2-a6a6-722f752f923a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:19.869655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c163881-32da-42a2-a6a6-722f752f923a tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1319 microversion: 2.1 time: 0.626492 May 19 04:32:19.871013 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 152/293] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:19 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1319 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:32:19.887775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1356230021", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "649022310", "adminPass": "***", "networks": [{"uuid": "417cc322-aafc-4a9a-b761-dd6b9faf7e73"}], "security_groups": [{"name": "tempest-securitygroup--583486643"}], "key_name": "tempest-keypair-908441147", "user_data": "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:20.187611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] validate_networks() for [('417cc322-aafc-4a9a-b761-dd6b9faf7e73', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:32:21.121116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=16 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:21.338718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:22.011562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:32:22.012692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:32:22.013362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:32:22.013944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:32:22.014507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:32:22.029035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:22.036048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:22.037796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:22.038426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:22.062989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=24 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:22.085479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Getting quotas for project e9f7c96b0d5a45aaa70f0a09bdea144c. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:22.096984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Getting quotas for user f659bfc9046342629cd0c35e08871246 and project e9f7c96b0d5a45aaa70f0a09bdea144c. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:22.123676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:32:22.128361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:32:22.231332 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf5add62-6c33-4397-89cb-96a281b58712 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.357796 May 19 04:32:22.232566 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 153/294] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:32:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:32:22.285828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:22.286531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:22.295637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:22.296093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:22.296882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:22.301169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:22.334784 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3057a511-91d9-464a-a5ec-d394fb31bdbb tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.501375 May 19 04:32:22.335689 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 142/295] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:32:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:32:22.361473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-d290aeec-8334-44d8-afbe-14974c15c7b4 req-90a22401-cd59-495b-a3ee-bbdfb9121dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca966824-4ecc-459d-b22b-83d6d7ee809e", "name": "network-vif-plugged", "status": "completed", "tag": "4eea3355-5aa0-426a-977d-f89a5e07bfb6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:22.401854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d290aeec-8334-44d8-afbe-14974c15c7b4 req-90a22401-cd59-495b-a3ee-bbdfb9121dbd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:22.406259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d290aeec-8334-44d8-afbe-14974c15c7b4 req-90a22401-cd59-495b-a3ee-bbdfb9121dbd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:22.431925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-d290aeec-8334-44d8-afbe-14974c15c7b4 req-90a22401-cd59-495b-a3ee-bbdfb9121dbd service nova] Creating event network-vif-plugged:4eea3355-5aa0-426a-977d-f89a5e07bfb6 for instance ca966824-4ecc-459d-b22b-83d6d7ee809e on n-h2-766726-30 May 19 04:32:22.466132 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-d290aeec-8334-44d8-afbe-14974c15c7b4 req-90a22401-cd59-495b-a3ee-bbdfb9121dbd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126205 May 19 04:32:22.469570 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 143/296] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:22.479033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5878f9d2-873d-4c8f-869e-cbaea05e5232 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:22.486422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5878f9d2-873d-4c8f-869e-cbaea05e5232 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:22.526767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5878f9d2-873d-4c8f-869e-cbaea05e5232 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:22.529357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5878f9d2-873d-4c8f-869e-cbaea05e5232 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:22.530390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5878f9d2-873d-4c8f-869e-cbaea05e5232 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:22.532522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5878f9d2-873d-4c8f-869e-cbaea05e5232 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:23.211958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5878f9d2-873d-4c8f-869e-cbaea05e5232 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:23.212883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:23.225549 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5878f9d2-873d-4c8f-869e-cbaea05e5232 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1319 microversion: 2.1 time: 0.752218 May 19 04:32:23.226352 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 144/297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:22 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1319 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:23.232060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:23.234134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:23.245844 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8ae0b753-f395-4717-847d-c81b7c6c974d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1558 microversion: 2.25 time: 0.984510 May 19 04:32:23.251058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1db6ee64-51e8-4ca3-86de-81bb5fd4077a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:23.252006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1db6ee64-51e8-4ca3-86de-81bb5fd4077a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:23.262100 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 154/298] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:22 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1558 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:23.268113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d362bcad-5372-44e2-bc59-eb0304ab980c tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Calling method '.version_select at 0x7fd3165710d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:23.268509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1db6ee64-51e8-4ca3-86de-81bb5fd4077a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:23.269209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1db6ee64-51e8-4ca3-86de-81bb5fd4077a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:23.270276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1db6ee64-51e8-4ca3-86de-81bb5fd4077a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:23.270876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1db6ee64-51e8-4ca3-86de-81bb5fd4077a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:23.479763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1db6ee64-51e8-4ca3-86de-81bb5fd4077a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:23.496600 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1db6ee64-51e8-4ca3-86de-81bb5fd4077a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 200 len: 1266 microversion: 2.1 time: 0.268085 May 19 04:32:23.505222 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 145/299] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:23 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:23.698561 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d362bcad-5372-44e2-bc59-eb0304ab980c tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/07c0ac70-7ff9-4c78-a8a5-ce036d1ea6ff" status: 200 len: 141 microversion: 2.1 time: 0.433735 May 19 04:32:23.699520 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 155/300] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:32:23 2022] GET /compute/v2.1/os-floating-ips/07c0ac70-7ff9-4c78-a8a5-ce036d1ea6ff => generated 141 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:24.006078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1652337459", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "46fb63e9-6b42-4dee-8db7-bccbd0d35392"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:24.064901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] validate_networks() for [('46fb63e9-6b42-4dee-8db7-bccbd0d35392', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:32:24.074996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5800897d-7a93-4123-a608-bd054dd6f959 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:24.075753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5800897d-7a93-4123-a608-bd054dd6f959 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:24.082538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5800897d-7a93-4123-a608-bd054dd6f959 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:24.084553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5800897d-7a93-4123-a608-bd054dd6f959 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:24.085734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5800897d-7a93-4123-a608-bd054dd6f959 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:24.086173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5800897d-7a93-4123-a608-bd054dd6f959 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:24.374948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-5800897d-7a93-4123-a608-bd054dd6f959 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 99310c06-abbf-4e4f-b3c4-4b686b2f6139 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:32:24.495960 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5800897d-7a93-4123-a608-bd054dd6f959 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 2053 microversion: 2.25 time: 0.987933 May 19 04:32:24.496839 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 146/301] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:23 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 2053 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:24.513716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41c5a3d7-2dd9-499a-b3fa-7da0ba4d3b74 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Calling method '.version_select at 0x7fd31671ec10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:24.830722 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-41c5a3d7-2dd9-499a-b3fa-7da0ba4d3b74 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.332653 May 19 04:32:24.831488 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 147/302] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:32:24 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:24.843191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2c1445b-6d30-4cb4-8494-c544832f2f33 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:24.843961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f2c1445b-6d30-4cb4-8494-c544832f2f33 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:24.860016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2c1445b-6d30-4cb4-8494-c544832f2f33 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:24.860683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2c1445b-6d30-4cb4-8494-c544832f2f33 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:24.862400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2c1445b-6d30-4cb4-8494-c544832f2f33 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:24.864704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2c1445b-6d30-4cb4-8494-c544832f2f33 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:24.907323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:32:24.907918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:32:24.908247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:32:24.908632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:32:24.909239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:32:24.919690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:24.920512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:24.921532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:24.922255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:24.941392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Getting quotas for project b2425f9ddc1548958d45215e83aed84e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:24.946155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Getting quotas for user 75f651a13b474f09aa3877d1d66b8fc5 and project b2425f9ddc1548958d45215e83aed84e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:24.960437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:32:24.962823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:32:25.026745 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a43f22db-bbd5-4acc-a356-7bab82eac20a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326039 May 19 04:32:25.031773 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 156/303] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:32:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:32:25.057921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f2c1445b-6d30-4cb4-8494-c544832f2f33 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:25.084867 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2c1445b-6d30-4cb4-8494-c544832f2f33 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1469 microversion: 2.1 time: 0.245820 May 19 04:32:25.085956 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 148/304] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:24 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1469 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:25.101486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca152a40-9655-4688-b755-85ae381776e2 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:25.102216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca152a40-9655-4688-b755-85ae381776e2 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:25.117448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca152a40-9655-4688-b755-85ae381776e2 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:25.118099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca152a40-9655-4688-b755-85ae381776e2 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:25.119076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca152a40-9655-4688-b755-85ae381776e2 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:25.119592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca152a40-9655-4688-b755-85ae381776e2 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:25.376662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Calling method '.version_select at 0x7fd316613700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:25.378236 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:25.378236 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:25.390857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) {{(pid=124819) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 19 04:32:25.391979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:25.392894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:25.415263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:25.416186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:25.452155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:25.456948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:25.480740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:25.481363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:25.500092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-ca152a40-9655-4688-b755-85ae381776e2 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 99310c06-abbf-4e4f-b3c4-4b686b2f6139 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:32:25.524927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:25.528483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:25.533846 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ca152a40-9655-4688-b755-85ae381776e2 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 2053 microversion: 2.25 time: 0.442607 May 19 04:32:25.535175 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 149/305] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:25 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 2053 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:25.547726 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-22b3f2dd-b142-4d6e-be74-045dbb3a83ee tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1840 microversion: 2.53 time: 0.514431 May 19 04:32:25.548334 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 157/306] 10.222.0.58 () {60 vars in 1242 bytes} [Thu May 19 04:32:25 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1840 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:25.559289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0313814b-7e7e-49d5-b6cc-2162761f766b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:25.559289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0313814b-7e7e-49d5-b6cc-2162761f766b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:25.564256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d78bb1a4-e837-4651-ba66-17b9ccb62537 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Calling method '.version_select at 0x7fd316571820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:25.567080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0313814b-7e7e-49d5-b6cc-2162761f766b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:25.568845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0313814b-7e7e-49d5-b6cc-2162761f766b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:25.570165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0313814b-7e7e-49d5-b6cc-2162761f766b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:25.570916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0313814b-7e7e-49d5-b6cc-2162761f766b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:25.595191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:25.895849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0313814b-7e7e-49d5-b6cc-2162761f766b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:25.908642 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0313814b-7e7e-49d5-b6cc-2162761f766b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 200 len: 1387 microversion: 2.1 time: 0.370296 May 19 04:32:25.909579 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 150/307] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:25 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 1387 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:26.165983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c8f7dd1-7597-459b-918e-90c4a0794680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:26.167569 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:26.167569 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:26.169574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c8f7dd1-7597-459b-918e-90c4a0794680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.173033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c8f7dd1-7597-459b-918e-90c4a0794680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.174026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c8f7dd1-7597-459b-918e-90c4a0794680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.174727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c8f7dd1-7597-459b-918e-90c4a0794680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.205238 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c8f7dd1-7597-459b-918e-90c4a0794680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.294096 May 19 04:32:26.206190 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 151/308] 10.222.0.58 () {58 vars in 1175 bytes} [Thu May 19 04:32:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:26.211712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8e2cbcd-b11e-453a-ac35-31ec9dedbbc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:26.212538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8e2cbcd-b11e-453a-ac35-31ec9dedbbc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:26.220426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8e2cbcd-b11e-453a-ac35-31ec9dedbbc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.220927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8e2cbcd-b11e-453a-ac35-31ec9dedbbc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.222066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8e2cbcd-b11e-453a-ac35-31ec9dedbbc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.222524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8e2cbcd-b11e-453a-ac35-31ec9dedbbc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.325141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8e2cbcd-b11e-453a-ac35-31ec9dedbbc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:26.337700 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8e2cbcd-b11e-453a-ac35-31ec9dedbbc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1263 microversion: 2.1 time: 0.129995 May 19 04:32:26.339249 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 152/309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:26 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1263 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:26.348582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5602a22d-6fde-40f8-ae3e-64fb3e2c0d17 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:26.348582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5602a22d-6fde-40f8-ae3e-64fb3e2c0d17 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:26.353998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5602a22d-6fde-40f8-ae3e-64fb3e2c0d17 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.363050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5602a22d-6fde-40f8-ae3e-64fb3e2c0d17 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.364098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5602a22d-6fde-40f8-ae3e-64fb3e2c0d17 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.364560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5602a22d-6fde-40f8-ae3e-64fb3e2c0d17 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.553537 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5602a22d-6fde-40f8-ae3e-64fb3e2c0d17 tempest-DeleteServersAdminTestJSON-1987861827 tempest-DeleteServersAdminTestJSON-1987861827-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e/action" status: 202 len: 0 microversion: 2.1 time: 0.212872 May 19 04:32:26.554484 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 153/310] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:32:26 2022] POST /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:32:26.561443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2e1475f8-40b2-4144-86ec-29314504f084 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:26.563013 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:26.563013 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:26.565128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e1475f8-40b2-4144-86ec-29314504f084 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.565805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e1475f8-40b2-4144-86ec-29314504f084 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.566811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e1475f8-40b2-4144-86ec-29314504f084 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.567432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e1475f8-40b2-4144-86ec-29314504f084 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.597541 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2e1475f8-40b2-4144-86ec-29314504f084 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.041654 May 19 04:32:26.598559 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 154/311] 10.222.0.58 () {60 vars in 1216 bytes} [Thu May 19 04:32:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:32:26.603815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Calling method '.version_select at 0x7fd31659e8b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:26.605735 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:26.605735 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:26.607218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.607893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.641054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.642824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.677650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.688874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.723251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.725887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.759980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:26.767764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.768544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.775275 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d78bb1a4-e837-4651-ba66-17b9ccb62537 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/07c0ac70-7ff9-4c78-a8a5-ce036d1ea6ff" status: 202 len: 0 microversion: 2.1 time: 1.225895 May 19 04:32:26.776435 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 158/312] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:32:25 2022] DELETE /compute/v2.1/os-floating-ips/07c0ac70-7ff9-4c78-a8a5-ce036d1ea6ff => generated 0 bytes in 1228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:32:26.782698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6904cef0-4e46-411b-8727-52c30e5971eb tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-718632059"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:26.784820 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:26.784820 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:26.785255 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0a6a345-14f7-43f3-bf5a-b052c2ba08e1 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 609 microversion: 2.53 time: 0.184554 May 19 04:32:26.786506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-6904cef0-4e46-411b-8727-52c30e5971eb tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Generated uuid 30fb58eb-e503-476d-aa0c-2d2acc707fca for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:26.793434 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 155/313] 10.222.0.58 () {60 vars in 1221 bytes} [Thu May 19 04:32:26 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 609 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:32:26.803192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4b224d7c-f843-4a4d-86b8-45dc9493308e req-56edd477-375d-4efd-b27b-1e05f0e2858b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c37abf-5b6b-4f1a-905c-102625d80f3f", "tag": "368a33bf-8ca6-4409-b4ff-13c42a72e838"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:26.812904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4b224d7c-f843-4a4d-86b8-45dc9493308e req-56edd477-375d-4efd-b27b-1e05f0e2858b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.813224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4b224d7c-f843-4a4d-86b8-45dc9493308e req-56edd477-375d-4efd-b27b-1e05f0e2858b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.827556 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4b224d7c-f843-4a4d-86b8-45dc9493308e req-56edd477-375d-4efd-b27b-1e05f0e2858b service nova] Creating event network-changed:368a33bf-8ca6-4409-b4ff-13c42a72e838 for instance 64c37abf-5b6b-4f1a-905c-102625d80f3f on n-h2-766726-30 May 19 04:32:26.830733 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4b224d7c-f843-4a4d-86b8-45dc9493308e req-56edd477-375d-4efd-b27b-1e05f0e2858b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035217 May 19 04:32:26.831835 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 156/314] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:26.837641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:26.838347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:26.845629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.845903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.846677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.847364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.865187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6904cef0-4e46-411b-8727-52c30e5971eb tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087307 May 19 04:32:26.866148 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 159/315] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:26.873774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8a9d020c-2c58-40ba-a972-84b04a451598 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-766726-30", "block_migration": "auto"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:26.878220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8a9d020c-2c58-40ba-a972-84b04a451598 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:26.887735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a9d020c-2c58-40ba-a972-84b04a451598 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.889601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a9d020c-2c58-40ba-a972-84b04a451598 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.890562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a9d020c-2c58-40ba-a972-84b04a451598 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.891542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a9d020c-2c58-40ba-a972-84b04a451598 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.911425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:26.911916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:26.912375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lazy-loading 'fault' on Instance uuid ca966824-4ecc-459d-b22b-83d6d7ee809e {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:32:26.994644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-8a9d020c-2c58-40ba-a972-84b04a451598 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'flavor' on Instance uuid 99310c06-abbf-4e4f-b3c4-4b686b2f6139 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:32:27.069247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8a9d020c-2c58-40ba-a972-84b04a451598 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Going to try to live migrate instance to n-h2-766726-30 {{(pid=124819) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 04:32:27.099148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:27.116022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:27.124784 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7483c40d-1543-4d96-bd22-63de4d68da59 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1452 microversion: 2.1 time: 0.291662 May 19 04:32:27.137137 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 157/316] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:26 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1452 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:27.141863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ee69bcc7-c73d-4c13-820b-61eaaffd4bc9 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Action: 'create', calling method: .version_select at 0x7fd316574430>, body: {"pool": null} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:28.710398 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ee69bcc7-c73d-4c13-820b-61eaaffd4bc9 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.580804 May 19 04:32:28.710999 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 158/317] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:32:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:28.717937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ae5eda08-803d-4760-904b-4c7e6ddbad63 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Calling method '.version_select at 0x7fd3165741f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:28.720179 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:28.720179 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:28.721507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae5eda08-803d-4760-904b-4c7e6ddbad63 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:28.721958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae5eda08-803d-4760-904b-4c7e6ddbad63 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:28.751749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae5eda08-803d-4760-904b-4c7e6ddbad63 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:28.752199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae5eda08-803d-4760-904b-4c7e6ddbad63 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:28.759855 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ae5eda08-803d-4760-904b-4c7e6ddbad63 tempest-HypervisorAdminV253TestBase-441367013 tempest-HypervisorAdminV253TestBase-441367013-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/68f5ae66-6090-4d65-8cef-ef1186171d42" status: 200 len: 794 microversion: 2.53 time: 0.047384 May 19 04:32:28.760692 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 159/318] 10.222.0.58 () {60 vars in 1297 bytes} [Thu May 19 04:32:28 2022] GET /compute/v2.1/os-hypervisors/68f5ae66-6090-4d65-8cef-ef1186171d42 => generated 794 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:32:28.776278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1fabc2f9-5062-452e-ad8f-a9e88af26731 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:28.777902 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:28.777902 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:28.788775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fabc2f9-5062-452e-ad8f-a9e88af26731 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:28.789652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fabc2f9-5062-452e-ad8f-a9e88af26731 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:28.934169 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1fabc2f9-5062-452e-ad8f-a9e88af26731 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.163029 May 19 04:32:28.935557 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 160/319] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:32:28 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:28.941714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96c8a8c7-374c-478a-aa54-13ebfb28c5d2 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:28.942528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96c8a8c7-374c-478a-aa54-13ebfb28c5d2 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:28.950517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96c8a8c7-374c-478a-aa54-13ebfb28c5d2 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:28.951159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96c8a8c7-374c-478a-aa54-13ebfb28c5d2 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:28.952145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96c8a8c7-374c-478a-aa54-13ebfb28c5d2 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:28.952739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96c8a8c7-374c-478a-aa54-13ebfb28c5d2 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:29.214598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-96c8a8c7-374c-478a-aa54-13ebfb28c5d2 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:29.222670 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96c8a8c7-374c-478a-aa54-13ebfb28c5d2 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 200 len: 1387 microversion: 2.1 time: 0.285870 May 19 04:32:29.223813 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 161/320] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:28 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 1387 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:29.228766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-952524a7-f811-4419-8058-9f92a6f1d233 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:29.229499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-952524a7-f811-4419-8058-9f92a6f1d233 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:29.235775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-952524a7-f811-4419-8058-9f92a6f1d233 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:29.236507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-952524a7-f811-4419-8058-9f92a6f1d233 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:29.237633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-952524a7-f811-4419-8058-9f92a6f1d233 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:29.238278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-952524a7-f811-4419-8058-9f92a6f1d233 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:29.264706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-952524a7-f811-4419-8058-9f92a6f1d233 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:32:29.426874 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8a9d020c-2c58-40ba-a972-84b04a451598 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139/action" status: 202 len: 0 microversion: 2.25 time: 2.559205 May 19 04:32:29.429005 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 160/321] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:32:26 2022] POST /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139/action => generated 0 bytes in 2562 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:32:29.436088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a09f5e11-bb56-42ab-b327-48afcfe9b4fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:29.437259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a09f5e11-bb56-42ab-b327-48afcfe9b4fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:29.447605 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-952524a7-f811-4419-8058-9f92a6f1d233 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 204 len: 0 microversion: 2.1 time: 0.221814 May 19 04:32:29.448345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a09f5e11-bb56-42ab-b327-48afcfe9b4fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:29.448762 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 162/322] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:32:29 2022] DELETE /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:32:29.449385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a09f5e11-bb56-42ab-b327-48afcfe9b4fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:29.451020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a09f5e11-bb56-42ab-b327-48afcfe9b4fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:29.452145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a09f5e11-bb56-42ab-b327-48afcfe9b4fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:29.461940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a90e599f-f6cb-4bf2-a3f8-967afd7da5dc tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Calling method '.version_select at 0x7fd3165741f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:29.848537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a09f5e11-bb56-42ab-b327-48afcfe9b4fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:29.856884 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a09f5e11-bb56-42ab-b327-48afcfe9b4fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1311 microversion: 2.1 time: 0.426513 May 19 04:32:29.857729 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 161/323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:29 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1311 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:29.862692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-580db905-4532-45f6-a1a2-57352409ea7a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:29.863993 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:29.863993 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:29.876487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-580db905-4532-45f6-a1a2-57352409ea7a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:29.876949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-580db905-4532-45f6-a1a2-57352409ea7a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:29.903968 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-580db905-4532-45f6-a1a2-57352409ea7a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-766726-30. May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-580db905-4532-45f6-a1a2-57352409ea7a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Request method failure captured: May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 40 May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchYtaVQf45t4sNwpkut1I-o7FdLfQFchyn7Zbgib6C5fCtUpUXawOx9BkEkY_7LH1W-icFIsVM38tlDrzJWnfnDSGP74VXx2ewUBYJ3Qt3GK83vRNzbvnuTJGW7LcXtgCDN01f9cmmb3RsLVs6Ass0O1WxGzZY_h3VJLjDYWL1quxA May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:29.927087 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cb2e5791eb28424bb74740dfc9482c9c May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: {"add_host": {"host": "n-h2-766726-30"}} May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:29.929145 n-d-766726-30 devstack@n-api.service[124819]: exception: Aggregate 11 already has host n-h2-766726-30. May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-766726-30'}}} May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result.read() May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 04:32:29.930031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-766726-30-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi session.flush() May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._flush(objects) May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 04:32:29.932523 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi compat.raise_( May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi flush_context.execute() May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi rec.execute(self) May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 04:32:29.934213 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 04:32:29.935629 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result.read() May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-766726-30-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 19, 4, 32, 29, 895041), 'updated_at': None, 'host': 'n-h2-766726-30', 'aggregate_id': 11}] May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:29.937330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-766726-30. May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:29.939674 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-766726-30. May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:29.941766 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:29.943429 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-766726-30. May 19 04:32:29.943429 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:29.943429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-580db905-4532-45f6-a1a2-57352409ea7a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-766726-30. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:29.943429 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-580db905-4532-45f6-a1a2-57352409ea7a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.072898 May 19 04:32:29.943429 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 162/324] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:32:29 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) May 19 04:32:29.948956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:29.948956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:29.956581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:29.957032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:29.958075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:29.958717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:30.310313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:30.319095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:30.320523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:30.321971 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7d7ddb52-72c3-4c49-8ed4-b6ee3915db7f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1568 microversion: 2.25 time: 0.379389 May 19 04:32:30.322527 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 163/325] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:29 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:30.336996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:30.337685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:30.349595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:30.351979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:30.353402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:30.355345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:30.411300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:30.413843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:30.414115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lazy-loading 'fault' on Instance uuid ca966824-4ecc-459d-b22b-83d6d7ee809e {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:32:30.747569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:30.760058 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-07620b98-a1d3-4fa8-910a-6f393c34d885 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1458 microversion: 2.1 time: 0.435134 May 19 04:32:30.771747 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 164/326] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:30 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1458 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:30.782681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3bb5f033-b7ae-4580-a5ed-6c95b0e4674f req-d8dd04e5-5e17-4a6c-869b-2ec260466505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae28e440-afaa-461c-ad2e-9c119c468147", "tag": "8bc99dbc-616c-4771-aa9d-9afa83a872a9"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:30.806855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3bb5f033-b7ae-4580-a5ed-6c95b0e4674f req-d8dd04e5-5e17-4a6c-869b-2ec260466505 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:30.811276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3bb5f033-b7ae-4580-a5ed-6c95b0e4674f req-d8dd04e5-5e17-4a6c-869b-2ec260466505 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:30.858781 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3bb5f033-b7ae-4580-a5ed-6c95b0e4674f req-d8dd04e5-5e17-4a6c-869b-2ec260466505 service nova] Creating event network-changed:8bc99dbc-616c-4771-aa9d-9afa83a872a9 for instance ae28e440-afaa-461c-ad2e-9c119c468147 on n-h1-766726-30 May 19 04:32:30.880405 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3bb5f033-b7ae-4580-a5ed-6c95b0e4674f req-d8dd04e5-5e17-4a6c-869b-2ec260466505 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101317 May 19 04:32:30.890551 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 165/327] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:30.902856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79d83562-d6f5-4a49-baf0-63cfadff71e6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:30.906404 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:30.906404 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:30.945892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79d83562-d6f5-4a49-baf0-63cfadff71e6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:30.946430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79d83562-d6f5-4a49-baf0-63cfadff71e6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:31.143371 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79d83562-d6f5-4a49-baf0-63cfadff71e6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.249634 May 19 04:32:31.146625 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 166/328] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:32:30 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:31.153862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5df9876e-4e9e-4e80-bdd2-d91a574e1d6c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:31.154965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5df9876e-4e9e-4e80-bdd2-d91a574e1d6c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:31.160310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:31.167828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5df9876e-4e9e-4e80-bdd2-d91a574e1d6c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:31.169300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5df9876e-4e9e-4e80-bdd2-d91a574e1d6c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:31.170839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5df9876e-4e9e-4e80-bdd2-d91a574e1d6c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:31.171773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5df9876e-4e9e-4e80-bdd2-d91a574e1d6c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:31.496542 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a90e599f-f6cb-4bf2-a3f8-967afd7da5dc tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/8f673d39-9bc2-4d8c-af94-a75199b1fada" status: 202 len: 0 microversion: 2.1 time: 2.039408 May 19 04:32:31.497035 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 163/329] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:32:29 2022] DELETE /compute/v2.1/os-floating-ips/8f673d39-9bc2-4d8c-af94-a75199b1fada => generated 0 bytes in 2048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:32:31.502030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-152ec201-8f4e-4ca5-9104-cabe7d740daf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:31.502760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-152ec201-8f4e-4ca5-9104-cabe7d740daf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:31.517745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-152ec201-8f4e-4ca5-9104-cabe7d740daf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:31.518169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-152ec201-8f4e-4ca5-9104-cabe7d740daf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:31.519298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-152ec201-8f4e-4ca5-9104-cabe7d740daf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:31.524426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-152ec201-8f4e-4ca5-9104-cabe7d740daf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:31.709425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5df9876e-4e9e-4e80-bdd2-d91a574e1d6c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:31.723395 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5df9876e-4e9e-4e80-bdd2-d91a574e1d6c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 200 len: 1387 microversion: 2.1 time: 0.573876 May 19 04:32:31.729122 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 167/330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:31 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 1387 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:31.841401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-152ec201-8f4e-4ca5-9104-cabe7d740daf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:31.854939 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-152ec201-8f4e-4ca5-9104-cabe7d740daf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1311 microversion: 2.1 time: 0.356703 May 19 04:32:31.855529 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 164/331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:31 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1311 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:31.870177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c9b7f522-d2a9-4511-8964-b848d41756a2 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:31.871049 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:31.871049 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:31.938905 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c9b7f522-d2a9-4511-8964-b848d41756a2 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.072441 May 19 04:32:31.939541 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 165/332] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:31 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:31.953158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:31.954164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:31.961813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:31.962534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:31.964930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:31.965688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:32.194737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:32.210234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:32.211839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:32.213038 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e5a465d1-de97-4ef0-8d63-96a76193ed23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1568 microversion: 2.25 time: 0.265002 May 19 04:32:32.222875 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 166/333] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:31 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:32.228530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c8b3d7d1-386c-4b85-99d6-c5d26358c0b9 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Calling method '.version_select at 0x7fd316514e50>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:32.287416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1758357561", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "af325e41-dd5e-49a4-8d8b-0ae83cdd7660"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:32.336676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG neutronclient.v2_0.client [None req-c8b3d7d1-386c-4b85-99d6-c5d26358c0b9 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8f673d39-9bc2-4d8c-af94-a75199b1fada could not be found", "detail": ""}} {{(pid=124818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:32:32.337445 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c8b3d7d1-386c-4b85-99d6-c5d26358c0b9 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] HTTP exception thrown: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c8b3d7d1-386c-4b85-99d6-c5d26358c0b9 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Request method failure captured: May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-floating-ips/8f673d39-9bc2-4d8c-af94-a75199b1fada HTTP/1.1 May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchSvi_-e6jZ0kFioPh7xbwCnSXM39IoZ6H2hcmLzV1a3ggQlMJhfzFtTk0THnqok_mTAh2mUmlPQUnkz-qz52ERQoMyx37LzrbXaPAUYrG_4bb8_xmsaUZFzEtqFOUS6hVOHVlBDlJxfjzkEHVMuMI2i5W_lOlVbwJ_b5zMczGnjx8 May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 3baf59c8adbe4f32a0600d8190c72b88 May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FloatingIPsTestJSON-111590643 May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:32.348115 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3baf59c8adbe4f32a0600d8190c72b88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3baf59c8adbe4f32a0600d8190c72b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3baf59c8adbe4f32a0600d8190c72b88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3baf59c8adbe4f32a0600d8190c72b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FloatingIPsTestJSON-111590643 May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 3baf59c8adbe4f32a0600d8190c72b88 May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FloatingIPsTestJSON-111590643 May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FloatingIPsTestJSON-111590643-project May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e852866deab54f7bbfdda17d548b4ae6 May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FloatingIPsTestJSON-111590643-project May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: exception: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '8f673d39-9bc2-4d8c-af94-a75199b1fada'} May 19 04:32:32.350396 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:32:32.351925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8f673d39-9bc2-4d8c-af94-a75199b1fada could not be found May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4ce6e5a-7e75-4c86-9dc7-cad08c14e683'] May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada. May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:32.354067 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:32.358708 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:32.362673 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada May 19 04:32:32.362673 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:32.362673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c8b3d7d1-386c-4b85-99d6-c5d26358c0b9 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Returning 404 to user: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:32.362673 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c8b3d7d1-386c-4b85-99d6-c5d26358c0b9 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/8f673d39-9bc2-4d8c-af94-a75199b1fada" status: 404 len: 111 microversion: 2.1 time: 0.125724 May 19 04:32:32.362673 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 167/334] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:32:32 2022] GET /compute/v2.1/os-floating-ips/8f673d39-9bc2-4d8c-af94-a75199b1fada => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:32.362673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:32.363518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:32.368194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] validate_networks() for [('af325e41-dd5e-49a4-8d8b-0ae83cdd7660', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:32:32.373180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:32.376822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:32.377797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:32.378249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:32.468709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:32.474493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:32.474963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lazy-loading 'fault' on Instance uuid ca966824-4ecc-459d-b22b-83d6d7ee809e {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:32:32.595609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd403ce37c3d4ccc8853779a33902f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5b8a1fce545b88a7405cf7b310a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:32.607471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:32.614570 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b65e940-d28c-4d2f-9216-d706b60033d5 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 200 len: 1416 microversion: 2.1 time: 0.262379 May 19 04:32:32.615854 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 168/335] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:32 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 1416 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:32.622937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9a66702-6ee0-44d4-9c50-d5b8262f37d2 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-232488388"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:32.627360 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:32.627360 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:32.628643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.aggregate [None req-a9a66702-6ee0-44d4-9c50-d5b8262f37d2 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Generated uuid 079a09bc-9af1-4fc8-b6cb-619b91d87230 for aggregate {{(pid=124818) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:32.654289 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a9a66702-6ee0-44d4-9c50-d5b8262f37d2 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036930 May 19 04:32:32.663887 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 169/336] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:32.670385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55858c35-2e05-470a-be68-15923f55c0c4 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Calling method '.version_select at 0x7fd316374b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:32.999197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG neutronclient.v2_0.client [None req-55858c35-2e05-470a-be68-15923f55c0c4 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8f673d39-9bc2-4d8c-af94-a75199b1fada could not be found", "detail": ""}} {{(pid=124818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:32:33.000064 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-55858c35-2e05-470a-be68-15923f55c0c4 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] HTTP exception thrown: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55858c35-2e05-470a-be68-15923f55c0c4 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Request method failure captured: May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/os-floating-ips/8f673d39-9bc2-4d8c-af94-a75199b1fada HTTP/1.1 May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchSvi_-e6jZ0kFioPh7xbwCnSXM39IoZ6H2hcmLzV1a3ggQlMJhfzFtTk0THnqok_mTAh2mUmlPQUnkz-qz52ERQoMyx37LzrbXaPAUYrG_4bb8_xmsaUZFzEtqFOUS6hVOHVlBDlJxfjzkEHVMuMI2i5W_lOlVbwJ_b5zMczGnjx8 May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 3baf59c8adbe4f32a0600d8190c72b88 May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FloatingIPsTestJSON-111590643 May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:33.002296 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3baf59c8adbe4f32a0600d8190c72b88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3baf59c8adbe4f32a0600d8190c72b88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3baf59c8adbe4f32a0600d8190c72b88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3baf59c8adbe4f32a0600d8190c72b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FloatingIPsTestJSON-111590643 May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 3baf59c8adbe4f32a0600d8190c72b88 May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FloatingIPsTestJSON-111590643 May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FloatingIPsTestJSON-111590643-project May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e852866deab54f7bbfdda17d548b4ae6 May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FloatingIPsTestJSON-111590643-project May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: exception: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '8f673d39-9bc2-4d8c-af94-a75199b1fada'} May 19 04:32:33.003621 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:32:33.004771 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8f673d39-9bc2-4d8c-af94-a75199b1fada could not be found May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9a38bd4-4d0f-476a-b91e-b12e66e29ab0'] May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada. May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:33.006157 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:33.007428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:33.008623 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada May 19 04:32:33.008623 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.010891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55858c35-2e05-470a-be68-15923f55c0c4 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] Returning 404 to user: Floating IP not found for ID 8f673d39-9bc2-4d8c-af94-a75199b1fada {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:33.011319 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-55858c35-2e05-470a-be68-15923f55c0c4 tempest-FloatingIPsTestJSON-111590643 tempest-FloatingIPsTestJSON-111590643-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/8f673d39-9bc2-4d8c-af94-a75199b1fada" status: 404 len: 111 microversion: 2.1 time: 0.344796 May 19 04:32:33.012248 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 170/337] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:32:32 2022] DELETE /compute/v2.1/os-floating-ips/8f673d39-9bc2-4d8c-af94-a75199b1fada => generated 111 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:33.020239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-233b14e3-91a5-4aae-b7e7-33b3e349702d req-fb3a702a-a4f7-4830-bcda-c4699486fda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca966824-4ecc-459d-b22b-83d6d7ee809e", "name": "network-vif-deleted", "tag": "4eea3355-5aa0-426a-977d-f89a5e07bfb6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:33.033642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-233b14e3-91a5-4aae-b7e7-33b3e349702d req-fb3a702a-a4f7-4830-bcda-c4699486fda7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.034395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-233b14e3-91a5-4aae-b7e7-33b3e349702d req-fb3a702a-a4f7-4830-bcda-c4699486fda7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.054119 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-233b14e3-91a5-4aae-b7e7-33b3e349702d req-fb3a702a-a4f7-4830-bcda-c4699486fda7 service nova] Creating event network-vif-deleted:4eea3355-5aa0-426a-977d-f89a5e07bfb6 for instance ca966824-4ecc-459d-b22b-83d6d7ee809e on n-h2-766726-30 May 19 04:32:33.060561 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-233b14e3-91a5-4aae-b7e7-33b3e349702d req-fb3a702a-a4f7-4830-bcda-c4699486fda7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046822 May 19 04:32:33.061857 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 171/338] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:33.069611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-74fa0152-202b-4a84-9bda-ad77d2666b81 req-8f44103a-0edd-4546-b084-949c5fce0e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c37abf-5b6b-4f1a-905c-102625d80f3f", "name": "network-vif-plugged", "status": "completed", "tag": "368a33bf-8ca6-4409-b4ff-13c42a72e838"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:33.081386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-74fa0152-202b-4a84-9bda-ad77d2666b81 req-8f44103a-0edd-4546-b084-949c5fce0e30 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.084946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-74fa0152-202b-4a84-9bda-ad77d2666b81 req-8f44103a-0edd-4546-b084-949c5fce0e30 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.116251 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-74fa0152-202b-4a84-9bda-ad77d2666b81 req-8f44103a-0edd-4546-b084-949c5fce0e30 service nova] Creating event network-vif-plugged:368a33bf-8ca6-4409-b4ff-13c42a72e838 for instance 64c37abf-5b6b-4f1a-905c-102625d80f3f on n-h2-766726-30 May 19 04:32:33.125247 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-74fa0152-202b-4a84-9bda-ad77d2666b81 req-8f44103a-0edd-4546-b084-949c5fce0e30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058675 May 19 04:32:33.127674 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 172/339] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:33.314671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:32:33.318003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:32:33.320461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:32:33.321285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:32:33.321863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:32:33.347723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.348367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.349877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.350504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.373480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Getting quotas for project ff2741185bb8440db094f7bc87af8b2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:33.378354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Getting quotas for user 5b561a0c5d754a12a04e62664e607506 and project ff2741185bb8440db094f7bc87af8b2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:33.395097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:32:33.397477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:32:33.411810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f5247243-4255-49a9-80ff-0ddbd0031c2d tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:33.414433 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:33.414433 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:33.415582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f5247243-4255-49a9-80ff-0ddbd0031c2d tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'cfc83c4eb08f4c2a93979b17e76b44dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d70e280e314dfd950c6e5424d5db7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f5247243-4255-49a9-80ff-0ddbd0031c2d tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Request method failure captured: May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 40 May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchX86MGHM_n6iXTw_uq-FuuIR4sqPPZJ0sMPht1F1lq482ooM_Cr4uMBMp7BAs8dBCl0w8uvVYz3x5aRkBJDm4HJH5tEy6zOWLhQGMsY-CaygRtEYPos1nvkwY5YLF7e34sc4fTHdBGkT8ts6B99odqeQ7XfegutARwxati7vbx3T0 May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:33.418942 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: cfc83c4eb08f4c2a93979b17e76b44dc May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: {"add_host": {"host": "n-h2-766726-30"}} May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:33.420512 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-766726-30'}}} May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:33.421436 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 19 04:32:33.422648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.425067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f5247243-4255-49a9-80ff-0ddbd0031c2d tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:33.426105 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f5247243-4255-49a9-80ff-0ddbd0031c2d tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.297413 May 19 04:32:33.427202 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 173/340] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:32:33 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:33.433049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-17e818c4-7ca8-47ce-bcb7-b09a2062ed2b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:33.433922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-17e818c4-7ca8-47ce-bcb7-b09a2062ed2b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:33.443265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17e818c4-7ca8-47ce-bcb7-b09a2062ed2b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.443932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17e818c4-7ca8-47ce-bcb7-b09a2062ed2b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.444703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17e818c4-7ca8-47ce-bcb7-b09a2062ed2b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.445457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17e818c4-7ca8-47ce-bcb7-b09a2062ed2b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.473727 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-542bc6a6-83e6-422f-99ec-205b5ae4493e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741765 May 19 04:32:33.479007 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 168/341] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:32:33.484903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7cc682ce-ed32-4039-bde5-7ab75ebbf6dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:33.485546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7cc682ce-ed32-4039-bde5-7ab75ebbf6dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:33.495791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7cc682ce-ed32-4039-bde5-7ab75ebbf6dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.495791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7cc682ce-ed32-4039-bde5-7ab75ebbf6dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.496097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7cc682ce-ed32-4039-bde5-7ab75ebbf6dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.496515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7cc682ce-ed32-4039-bde5-7ab75ebbf6dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.696469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-17e818c4-7ca8-47ce-bcb7-b09a2062ed2b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:33.713508 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-17e818c4-7ca8-47ce-bcb7-b09a2062ed2b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 200 len: 1387 microversion: 2.1 time: 0.284953 May 19 04:32:33.723842 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 174/342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:33 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 1387 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:33.737624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8a114e3d-8df1-49fc-9136-44ce0291154a req-294f73aa-028b-407d-9d9f-a6c292a89e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99310c06-abbf-4e4f-b3c4-4b686b2f6139", "name": "network-vif-unplugged", "status": "completed", "tag": "bd629c36-b208-4288-ae36-bf8a28f018d8"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:33.747675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8a114e3d-8df1-49fc-9136-44ce0291154a req-294f73aa-028b-407d-9d9f-a6c292a89e5e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.748603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8a114e3d-8df1-49fc-9136-44ce0291154a req-294f73aa-028b-407d-9d9f-a6c292a89e5e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.767753 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8a114e3d-8df1-49fc-9136-44ce0291154a req-294f73aa-028b-407d-9d9f-a6c292a89e5e service nova] Creating event network-vif-unplugged:bd629c36-b208-4288-ae36-bf8a28f018d8 for instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 on n-h1-766726-30 May 19 04:32:33.773445 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8a114e3d-8df1-49fc-9136-44ce0291154a req-294f73aa-028b-407d-9d9f-a6c292a89e5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048004 May 19 04:32:33.774365 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 175/343] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:33.784434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7cc682ce-ed32-4039-bde5-7ab75ebbf6dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:33.793625 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7cc682ce-ed32-4039-bde5-7ab75ebbf6dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1311 microversion: 2.1 time: 0.313045 May 19 04:32:33.794786 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 169/344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:33 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1311 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:33.806634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:33.807482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:33.814292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.814814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.815823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:33.816477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:33.858458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66a22a55-6b45-40ae-911d-00447c8c6f96 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:33.859284 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:33.859284 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:33.864948 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-66a22a55-6b45-40ae-911d-00447c8c6f96 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66a22a55-6b45-40ae-911d-00447c8c6f96 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241-project-admin] Request method failure captured: May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchgJCnqMcPuNPV8hv1XvuBYQSuA3FYvFMYW9q_LUaQs1m6VY4zyoT6yvD8j0x7i2iVuScIRS9wEvG3ujYTU-Hez5os16VXjp9h3nOj-xhTimoRJSyN6Jk13OX3ArQRvs4G1jq3QmspmYv-TCwQo9X4B0-cf9hNFFHP7GpggRbP3uQs May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 823c0dd2b33b430b90d2d4d58617a26a May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241 May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:32:33.870936 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/823c0dd2b33b430b90d2d4d58617a26a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/823c0dd2b33b430b90d2d4d58617a26a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/823c0dd2b33b430b90d2d4d58617a26a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_823c0dd2b33b430b90d2d4d58617a26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241 May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 823c0dd2b33b430b90d2d4d58617a26a May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241 May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241-project-admin May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 4f6bc19ef96542249eca0e913630527f May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241-project-admin May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:33.872409 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid timestamp for date invalid_time May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'invalid_time'} May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:33.873099 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time May 19 04:32:33.874176 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:33.876272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66a22a55-6b45-40ae-911d-00447c8c6f96 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:33.877794 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66a22a55-6b45-40ae-911d-00447c8c6f96 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241 tempest-InstanceUsageAuditLogNegativeTestJSON-2108046241-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.099856 May 19 04:32:33.878844 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 176/345] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 19 04:32:33 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 04:32:33.887195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-068e8706-f0d6-4561-8d66-95502925dc11 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:33.888054 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:33.888054 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:33.925339 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-068e8706-f0d6-4561-8d66-95502925dc11 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.044453 May 19 04:32:33.926506 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 177/346] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:33 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:33.933521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-37ffcdab-8249-4dd2-8027-fad9f4ee4de2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:33.934750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-37ffcdab-8249-4dd2-8027-fad9f4ee4de2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:34.012669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-37ffcdab-8249-4dd2-8027-fad9f4ee4de2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:34.013487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:34.021470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:34.021787 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-37ffcdab-8249-4dd2-8027-fad9f4ee4de2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1208 microversion: 2.1 time: 0.093342 May 19 04:32:34.022628 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 178/347] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:33 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1208 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:34.031213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.031213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:34.032448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:34.034015 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c5a0bf9c-93f3-4dee-b137-cb796a2878b1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1568 microversion: 2.25 time: 0.237845 May 19 04:32:34.034727 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 170/348] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:33 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:34.044912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.044912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.044912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.044912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.069286 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] HTTP exception thrown: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Request method failure captured: May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e HTTP/1.1 May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcgeWgYHvCt5BN10qwAgM0gT5UO6O_jwo4dK9QFgKnofa7WPBHyxAVkm0s7_0EVdfIvn1v87lbsnRQBPYPe7rNVkDAvTcO6xxKXyvU3c2KiEd4TJu8cXOD-YXVL1VLWxoSVZXL4Q5LsiwDtUAZ3gXw1S3IIIynLUEW5v0k2zN1grz88 May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:34.075547 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd403ce37c3d4ccc8853779a33902f95 May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.077026 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'ca966824-4ecc-459d-b22b-83d6d7ee809e'} May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.082531 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.083792 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.084804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Returning 404 to user: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.084804 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fed6d733-dbc2-4b96-827e-b4b34f3ac334 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 404 len: 111 microversion: 2.1 time: 0.053472 May 19 04:32:34.084804 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 179/349] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:34 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.094103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a3e285e1-f426-4c14-9ad9-82142c8ab485 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1334849441"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:34.099442 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.099442 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:34.100424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.aggregate [None req-a3e285e1-f426-4c14-9ad9-82142c8ab485 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Generated uuid f937e0c4-d1b1-4d74-8bc2-4e4580da94b5 for aggregate {{(pid=124818) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:34.123064 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a3e285e1-f426-4c14-9ad9-82142c8ab485 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.043012 May 19 04:32:34.123727 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 180/350] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:34.128755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.129750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:34.138658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.139472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.140403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.140981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.157242 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] HTTP exception thrown: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Request method failure captured: May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e HTTP/1.1 May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcgeWgYHvCt5BN10qwAgM0gT5UO6O_jwo4dK9QFgKnofa7WPBHyxAVkm0s7_0EVdfIvn1v87lbsnRQBPYPe7rNVkDAvTcO6xxKXyvU3c2KiEd4TJu8cXOD-YXVL1VLWxoSVZXL4Q5LsiwDtUAZ3gXw1S3IIIynLUEW5v0k2zN1grz88 May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:34.158811 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd403ce37c3d4ccc8853779a33902f95 May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.160262 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'ca966824-4ecc-459d-b22b-83d6d7ee809e'} May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.161044 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.163565 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.164964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Returning 404 to user: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.164964 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-864f204c-aab6-43bf-b8b3-897b82be546d tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 404 len: 111 microversion: 2.1 time: 0.035622 May 19 04:32:34.164964 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 181/351] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:32:34 2022] DELETE /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.166059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8812711e-ebb1-492a-b12c-b2a715bd2a6c tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-61725941"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:34.167472 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.167472 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:34.176109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8812711e-ebb1-492a-b12c-b2a715bd2a6c tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.177742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8812711e-ebb1-492a-b12c-b2a715bd2a6c tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.187887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8812711e-ebb1-492a-b12c-b2a715bd2a6c tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.188334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8812711e-ebb1-492a-b12c-b2a715bd2a6c tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.196094 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-8812711e-ebb1-492a-b12c-b2a715bd2a6c tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-61725941 could not be found. May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8812711e-ebb1-492a-b12c-b2a715bd2a6c tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Request method failure captured: May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 56 May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchYtaVQf45t4sNwpkut1I-o7FdLfQFchyn7Zbgib6C5fCtUpUXawOx9BkEkY_7LH1W-icFIsVM38tlDrzJWnfnDSGP74VXx2ewUBYJ3Qt3GK83vRNzbvnuTJGW7LcXtgCDN01f9cmmb3RsLVs6Ass0O1WxGzZY_h3VJLjDYWL1quxA May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:32:34.198351 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: cb2e5791eb28424bb74740dfc9482c9c May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: {"add_host": {"host": "tempest-nonexist_host-61725941"}} May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:34.199808 n-d-766726-30 devstack@n-api.service[124818]: exception: Compute host tempest-nonexist_host-61725941 could not be found. May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-61725941'}}} May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-61725941' is not mapped to any cell May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.200659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate May 19 04:32:34.201966 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-61725941 could not be found. May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-61725941 could not be found. May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.203324 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.204718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.204718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.204718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.204718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:34.204718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:34.204718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-61725941 could not be found. May 19 04:32:34.204718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.205917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8812711e-ebb1-492a-b12c-b2a715bd2a6c tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-61725941 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.206910 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8812711e-ebb1-492a-b12c-b2a715bd2a6c tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 109 microversion: 2.1 time: 0.044475 May 19 04:32:34.208032 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 182/352] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:32:34 2022] POST /compute/v2.1/os-aggregates/13/action => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.214877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.215497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: ca966824-4ecc-459d-b22b-83d6d7ee809e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:34.222352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.222810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.224147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.224754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.238312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a9a7594-0e93-4b9d-92dd-7e7ca6473153 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.239876 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.239876 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:34.241481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0a9a7594-0e93-4b9d-92dd-7e7ca6473153 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '75af4734a9bb47c6a23aed504e428062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b6d1dbdc30400aaca1718c4ad65f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a9a7594-0e93-4b9d-92dd-7e7ca6473153 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] Request method failure captured: May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchf8FajX3hMhvvryPGjwo_STtBYTMRQVfjOCXSgV22bZqd3bfaBbHuz7w-9xSzw-7qW9WIcNqxcSX15yf5trCpBGDfGqu8nv35fRjqM8Xv8Iehp5msLazzSfTfmsjsDVkjmJWA65ybtHIuflXRS7Y26rwaTI2jLiqTQP7Eeb6t6crE May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: d4b6d1dbdc30400aaca1718c4ad65f4d May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:34.243809 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d4b6d1dbdc30400aaca1718c4ad65f4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4b6d1dbdc30400aaca1718c4ad65f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4b6d1dbdc30400aaca1718c4ad65f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d4b6d1dbdc30400aaca1718c4ad65f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: d4b6d1dbdc30400aaca1718c4ad65f4d May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 75af4734a9bb47c6a23aed504e428062 May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:34.245298 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: action_args: {} May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:34.246067 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 19 04:32:34.247485 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.249755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a9a7594-0e93-4b9d-92dd-7e7ca6473153 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.251242 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] HTTP exception thrown: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.251386 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0a9a7594-0e93-4b9d-92dd-7e7ca6473153 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.204489 May 19 04:32:34.252454 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 171/353] 10.222.0.58 () {58 vars in 1184 bytes} [Thu May 19 04:32:34 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Request method failure captured: May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e HTTP/1.1 May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcgeWgYHvCt5BN10qwAgM0gT5UO6O_jwo4dK9QFgKnofa7WPBHyxAVkm0s7_0EVdfIvn1v87lbsnRQBPYPe7rNVkDAvTcO6xxKXyvU3c2KiEd4TJu8cXOD-YXVL1VLWxoSVZXL4Q5LsiwDtUAZ3gXw1S3IIIynLUEW5v0k2zN1grz88 May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:34.254722 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd403ce37c3d4ccc8853779a33902f95 May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.256229 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'ca966824-4ecc-459d-b22b-83d6d7ee809e'} May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.256928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. May 19 04:32:34.258496 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.259804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Returning 404 to user: Instance ca966824-4ecc-459d-b22b-83d6d7ee809e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.262012 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-95d44f9c-e877-4d88-9872-07c09d75a0ba tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e" status: 404 len: 111 microversion: 2.1 time: 0.052696 May 19 04:32:34.264115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-39e51f36-34e3-440b-bc5b-c993008e2ac4 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.265055 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.265055 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:34.266733 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 183/354] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:34 2022] GET /compute/v2.1/servers/ca966824-4ecc-459d-b22b-83d6d7ee809e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.273334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8961308e-60cb-486a-8a9b-ed9bdce40b01 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.274191 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.274191 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:34.275563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8961308e-60cb-486a-8a9b-ed9bdce40b01 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '75af4734a9bb47c6a23aed504e428062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b6d1dbdc30400aaca1718c4ad65f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8961308e-60cb-486a-8a9b-ed9bdce40b01 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] Request method failure captured: May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19%2004:32:34 HTTP/1.1 May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchf8FajX3hMhvvryPGjwo_STtBYTMRQVfjOCXSgV22bZqd3bfaBbHuz7w-9xSzw-7qW9WIcNqxcSX15yf5trCpBGDfGqu8nv35fRjqM8Xv8Iehp5msLazzSfTfmsjsDVkjmJWA65ybtHIuflXRS7Y26rwaTI2jLiqTQP7Eeb6t6crE May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: d4b6d1dbdc30400aaca1718c4ad65f4d May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:34.277288 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d4b6d1dbdc30400aaca1718c4ad65f4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4b6d1dbdc30400aaca1718c4ad65f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4b6d1dbdc30400aaca1718c4ad65f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d4b6d1dbdc30400aaca1718c4ad65f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: d4b6d1dbdc30400aaca1718c4ad65f4d May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 75af4734a9bb47c6a23aed504e428062 May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:34.278769 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2022-05-19 04:32:34'} May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:34.279503 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.280842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8961308e-60cb-486a-8a9b-ed9bdce40b01 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.281919 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8961308e-60cb-486a-8a9b-ed9bdce40b01 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273 tempest-InstanceUsageAuditLogNegativeTestJSON-24022273-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19 04:32:34" status: 403 len: 128 microversion: 2.1 time: 0.011455 May 19 04:32:34.281919 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 184/355] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:32:34 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19%2004%3A32%3A34 => generated 128 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.295003 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-39e51f36-34e3-440b-bc5b-c993008e2ac4 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.041294 May 19 04:32:34.295953 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 172/356] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:34 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:34.307020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7a87bfd-9906-471d-a124-36328889f680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7a87bfd-9906-471d-a124-36328889f680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Request method failure captured: May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 283 May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchYtaVQf45t4sNwpkut1I-o7FdLfQFchyn7Zbgib6C5fCtUpUXawOx9BkEkY_7LH1W-icFIsVM38tlDrzJWnfnDSGP74VXx2ewUBYJ3Qt3GK83vRNzbvnuTJGW7LcXtgCDN01f9cmmb3RsLVs6Ass0O1WxGzZY_h3VJLjDYWL1quxA May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:34.311853 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cb2e5791eb28424bb74740dfc9482c9c May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:32:34.313425 n-d-766726-30 devstack@n-api.service[124819]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:32:34.314210 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:32:34.315380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:32:34.316581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:32:34.317428 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:32:34.317428 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.317428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7a87bfd-9906-471d-a124-36328889f680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.317428 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7a87bfd-9906-471d-a124-36328889f680 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.013424 May 19 04:32:34.317742 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 173/357] 10.222.0.58 () {60 vars in 1164 bytes} [Thu May 19 04:32:34 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 04:32:34.322125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.323732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4dfe0e3d-6de4-428e-88fa-160c3455d109 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:34.325053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4dfe0e3d-6de4-428e-88fa-160c3455d109 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Request method failure captured: May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 27 May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchYtaVQf45t4sNwpkut1I-o7FdLfQFchyn7Zbgib6C5fCtUpUXawOx9BkEkY_7LH1W-icFIsVM38tlDrzJWnfnDSGP74VXx2ewUBYJ3Qt3GK83vRNzbvnuTJGW7LcXtgCDN01f9cmmb3RsLVs6Ass0O1WxGzZY_h3VJLjDYWL1quxA May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:34.326243 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cb2e5791eb28424bb74740dfc9482c9c May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: {"aggregate": {"name": ""}} May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:34.327420 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute name. Value: . '' is too short May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'aggregate': {'name': ''}}} May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi '' May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.328118 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 19 04:32:34.329361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.330644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4dfe0e3d-6de4-428e-88fa-160c3455d109 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.330644 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4dfe0e3d-6de4-428e-88fa-160c3455d109 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.007309 May 19 04:32:34.334923 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 174/358] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:34 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:32:34.340417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-15f18a10-4977-4c21-8025-cb0a0b5e221c tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-345075568"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:34.342385 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.342385 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:34.343368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-15f18a10-4977-4c21-8025-cb0a0b5e221c tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'cfc83c4eb08f4c2a93979b17e76b44dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d70e280e314dfd950c6e5424d5db7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-15f18a10-4977-4c21-8025-cb0a0b5e221c tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Request method failure captured: May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 59 May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchX86MGHM_n6iXTw_uq-FuuIR4sqPPZJ0sMPht1F1lq482ooM_Cr4uMBMp7BAs8dBCl0w8uvVYz3x5aRkBJDm4HJH5tEy6zOWLhQGMsY-CaygRtEYPos1nvkwY5YLF7e34sc4fTHdBGkT8ts6B99odqeQ7XfegutARwxati7vbx3T0 May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:34.345230 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cfc83c4eb08f4c2a93979b17e76b44dc May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: {"aggregate": {"name": "tempest-test_aggregate-345075568"}} May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:34.346673 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-345075568'}}} May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:34.347541 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:34.349403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 19 04:32:34.350734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.350734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-15f18a10-4977-4c21-8025-cb0a0b5e221c tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.350734 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-15f18a10-4977-4c21-8025-cb0a0b5e221c tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.010819 May 19 04:32:34.351337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.351792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.352568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.353004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.355037 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 175/359] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:34 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.367060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ef5fe437-0dd6-47c5-bc21-f357d679fb64 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-59750041"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:34.369564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-ef5fe437-0dd6-47c5-bc21-f357d679fb64 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Generated uuid b64236c5-e552-4b3e-9512-8b1d97b29260 for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:34.391025 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] HTTP exception thrown: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Request method failure captured: May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e HTTP/1.1 May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcgeWgYHvCt5BN10qwAgM0gT5UO6O_jwo4dK9QFgKnofa7WPBHyxAVkm0s7_0EVdfIvn1v87lbsnRQBPYPe7rNVkDAvTcO6xxKXyvU3c2KiEd4TJu8cXOD-YXVL1VLWxoSVZXL4Q5LsiwDtUAZ3gXw1S3IIIynLUEW5v0k2zN1grz88 May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:34.393778 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd403ce37c3d4ccc8853779a33902f95 May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.395172 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '422f36f8-5f4c-4e68-a1ed-cedb6551b55e'} May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.395930 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.397165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.398515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Returning 404 to user: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.398515 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-90a75024-5203-4226-8fed-df2fe2ed629c tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "DELETE /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 404 len: 111 microversion: 2.1 time: 0.096112 May 19 04:32:34.400038 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 185/360] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:32:34 2022] DELETE /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.406373 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ef5fe437-0dd6-47c5-bc21-f357d679fb64 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050226 May 19 04:32:34.410778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.412492 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 176/361] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:34.412802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] [instance: 422f36f8-5f4c-4e68-a1ed-cedb6551b55e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:34.422131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.424059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.424456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e675e6a7-4b89-474c-8b74-7268a0643f27 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-59750041"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:34.425798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.425940 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.425940 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:34.426549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.427482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-e675e6a7-4b89-474c-8b74-7268a0643f27 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Generated uuid 4d845180-ae73-4a19-b948-c604ff492b0e for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:34.442237 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-e675e6a7-4b89-474c-8b74-7268a0643f27 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-59750041 already exists. May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e675e6a7-4b89-474c-8b74-7268a0643f27 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Request method failure captured: May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 58 May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchYtaVQf45t4sNwpkut1I-o7FdLfQFchyn7Zbgib6C5fCtUpUXawOx9BkEkY_7LH1W-icFIsVM38tlDrzJWnfnDSGP74VXx2ewUBYJ3Qt3GK83vRNzbvnuTJGW7LcXtgCDN01f9cmmb3RsLVs6Ass0O1WxGzZY_h3VJLjDYWL1quxA May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:34.444619 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cb2e5791eb28424bb74740dfc9482c9c May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: {"aggregate": {"name": "tempest-test_aggregate-59750041"}} May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:34.446088 n-d-766726-30 devstack@n-api.service[124819]: exception: Aggregate tempest-test_aggregate-59750041 already exists. May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-59750041'}}} May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate.create() May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create May 19 04:32:34.446931 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-59750041 already exists. May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:34.448685 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-59750041 already exists. May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-59750041 already exists. May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e675e6a7-4b89-474c-8b74-7268a0643f27 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-59750041 already exists. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.450746 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e675e6a7-4b89-474c-8b74-7268a0643f27 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 409 len: 109 microversion: 2.1 time: 0.032252 May 19 04:32:34.451757 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 177/362] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:34 2022] POST /compute/v2.1/os-aggregates => generated 109 bytes in 35 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:32:34.455077 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] HTTP exception thrown: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Request method failure captured: May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e HTTP/1.1 May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcgeWgYHvCt5BN10qwAgM0gT5UO6O_jwo4dK9QFgKnofa7WPBHyxAVkm0s7_0EVdfIvn1v87lbsnRQBPYPe7rNVkDAvTcO6xxKXyvU3c2KiEd4TJu8cXOD-YXVL1VLWxoSVZXL4Q5LsiwDtUAZ3gXw1S3IIIynLUEW5v0k2zN1grz88 May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:34.457677 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_35e5b8a1fce545b88a7405cf7b310a22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 35e5b8a1fce545b88a7405cf7b310a22 May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2022059741 May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd403ce37c3d4ccc8853779a33902f95 May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersAdminTestJSON-2022059741-project May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.459983 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '422f36f8-5f4c-4e68-a1ed-cedb6551b55e'} May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.460768 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. May 19 04:32:34.462118 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:34.463094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] Returning 404 to user: Instance 422f36f8-5f4c-4e68-a1ed-cedb6551b55e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.463094 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-85ed49f8-bc51-4ac4-83ca-66bf0f51c6e9 tempest-DeleteServersAdminTestJSON-2022059741 tempest-DeleteServersAdminTestJSON-2022059741-project] 10.222.0.58 "GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e" status: 404 len: 111 microversion: 2.1 time: 0.061654 May 19 04:32:34.467099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4b193f4e-a2de-4780-866b-44f9cfd88827 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.467099 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.467099 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:34.467412 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 186/363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:34 2022] GET /compute/v2.1/servers/422f36f8-5f4c-4e68-a1ed-cedb6551b55e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.494861 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4b193f4e-a2de-4780-866b-44f9cfd88827 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.042082 May 19 04:32:34.496016 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 178/364] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:34 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:34.506247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c37197ff-61f8-4f57-9d9a-6ccf8fbb2026 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-821355314"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:34.507704 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.507704 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:34.508700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.aggregate [None req-c37197ff-61f8-4f57-9d9a-6ccf8fbb2026 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Generated uuid 27abbc75-5c76-4282-ada5-c41bfc6bd6f6 for aggregate {{(pid=124818) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:34.557326 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c37197ff-61f8-4f57-9d9a-6ccf8fbb2026 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056066 May 19 04:32:34.562123 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 187/365] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:34.572573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd0c1b8a-0e2f-44bc-9ba7-c148ebb0bbd2 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.573739 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.573739 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:34.574979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd0c1b8a-0e2f-44bc-9ba7-c148ebb0bbd2 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'cfc83c4eb08f4c2a93979b17e76b44dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d70e280e314dfd950c6e5424d5db7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd0c1b8a-0e2f-44bc-9ba7-c148ebb0bbd2 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Request method failure captured: May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchX86MGHM_n6iXTw_uq-FuuIR4sqPPZJ0sMPht1F1lq482ooM_Cr4uMBMp7BAs8dBCl0w8uvVYz3x5aRkBJDm4HJH5tEy6zOWLhQGMsY-CaygRtEYPos1nvkwY5YLF7e34sc4fTHdBGkT8ts6B99odqeQ7XfegutARwxati7vbx3T0 May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:34.576967 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cfc83c4eb08f4c2a93979b17e76b44dc May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 19 04:32:34.578201 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '15'} May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:34.578869 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 19 04:32:34.579881 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.582732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd0c1b8a-0e2f-44bc-9ba7-c148ebb0bbd2 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.584325 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd0c1b8a-0e2f-44bc-9ba7-c148ebb0bbd2 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.016181 May 19 04:32:34.585769 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 179/366] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:34 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.596943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73001d38-a7eb-4c42-a16b-bf1e39677fe6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.598305 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.598305 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:34.625726 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73001d38-a7eb-4c42-a16b-bf1e39677fe6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.033738 May 19 04:32:34.626912 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 188/367] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:34 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:34.638794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2de7baf-8e23-4837-9d87-48b645f729a4 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.653245 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b2de7baf-8e23-4837-9d87-48b645f729a4 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2de7baf-8e23-4837-9d87-48b645f729a4 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Request method failure captured: May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchYtaVQf45t4sNwpkut1I-o7FdLfQFchyn7Zbgib6C5fCtUpUXawOx9BkEkY_7LH1W-icFIsVM38tlDrzJWnfnDSGP74VXx2ewUBYJ3Qt3GK83vRNzbvnuTJGW7LcXtgCDN01f9cmmb3RsLVs6Ass0O1WxGzZY_h3VJLjDYWL1quxA May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:34.655768 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cb2e5791eb28424bb74740dfc9482c9c May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: exception: Aggregate -1 could not be found. May 19 04:32:34.657326 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '-1'} May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 04:32:34.658060 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.659191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.660502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.660502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.660502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:34.660502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:34.660502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 19 04:32:34.660502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.663504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2de7baf-8e23-4837-9d87-48b645f729a4 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.664581 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b2de7baf-8e23-4837-9d87-48b645f729a4 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031131 May 19 04:32:34.665452 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 180/368] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:34 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:32:34.674945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fa8f8449-168b-4b3f-96e5-6d44e2e9240f tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1016370555"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:34.676902 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.676902 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:34.677807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.aggregate [None req-fa8f8449-168b-4b3f-96e5-6d44e2e9240f tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Generated uuid 78be4fcc-1edc-400d-ac63-4a7d6372c74e for aggregate {{(pid=124818) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:34.707853 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fa8f8449-168b-4b3f-96e5-6d44e2e9240f tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037102 May 19 04:32:34.710423 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 189/369] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:34.721605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a7df5e6-6596-4cf5-812f-587ca76e4d38 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.723780 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:34.723780 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:34.725592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3a7df5e6-6596-4cf5-812f-587ca76e4d38 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'cfc83c4eb08f4c2a93979b17e76b44dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d70e280e314dfd950c6e5424d5db7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a7df5e6-6596-4cf5-812f-587ca76e4d38 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Request method failure captured: May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchX86MGHM_n6iXTw_uq-FuuIR4sqPPZJ0sMPht1F1lq482ooM_Cr4uMBMp7BAs8dBCl0w8uvVYz3x5aRkBJDm4HJH5tEy6zOWLhQGMsY-CaygRtEYPos1nvkwY5YLF7e34sc4fTHdBGkT8ts6B99odqeQ7XfegutARwxati7vbx3T0 May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:34.738884 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cfc83c4eb08f4c2a93979b17e76b44dc May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 19 04:32:34.740485 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '16'} May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:34.741315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:34.742346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a7df5e6-6596-4cf5-812f-587ca76e4d38 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:34.743255 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a7df5e6-6596-4cf5-812f-587ca76e4d38 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.024124 May 19 04:32:34.745023 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 181/370] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:34 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:34.751478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86f34c29-5e9d-4e74-a8db-a65b8d377e5d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.752274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86f34c29-5e9d-4e74-a8db-a65b8d377e5d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:34.758796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e126314-0639-4fed-852b-dbe7125eb9f1 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.764833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86f34c29-5e9d-4e74-a8db-a65b8d377e5d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.767175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86f34c29-5e9d-4e74-a8db-a65b8d377e5d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.770047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86f34c29-5e9d-4e74-a8db-a65b8d377e5d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.772922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86f34c29-5e9d-4e74-a8db-a65b8d377e5d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.825362 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e126314-0639-4fed-852b-dbe7125eb9f1 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.078961 May 19 04:32:34.826205 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 182/371] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:34 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:34.835391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b51e1f55-eb68-4823-a0bd-6fe442e3ea6c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:34.836221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b51e1f55-eb68-4823-a0bd-6fe442e3ea6c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:34.859367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b51e1f55-eb68-4823-a0bd-6fe442e3ea6c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.861762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b51e1f55-eb68-4823-a0bd-6fe442e3ea6c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:34.867264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b51e1f55-eb68-4823-a0bd-6fe442e3ea6c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:34.868024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b51e1f55-eb68-4823-a0bd-6fe442e3ea6c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.192977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b51e1f55-eb68-4823-a0bd-6fe442e3ea6c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:35.203785 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b51e1f55-eb68-4823-a0bd-6fe442e3ea6c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1311 microversion: 2.1 time: 0.373751 May 19 04:32:35.204395 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 183/372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:34 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1311 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:35.210118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-271b916a-f600-468d-b047-44d6da86a09d tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:35.215112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86f34c29-5e9d-4e74-a8db-a65b8d377e5d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:35.221962 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:35.221962 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:35.223382 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86f34c29-5e9d-4e74-a8db-a65b8d377e5d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 200 len: 1585 microversion: 2.1 time: 0.481137 May 19 04:32:35.225174 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 190/373] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:34 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 1585 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:35.232041 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-271b916a-f600-468d-b047-44d6da86a09d tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-271b916a-f600-468d-b047-44d6da86a09d tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Request method failure captured: May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchYtaVQf45t4sNwpkut1I-o7FdLfQFchyn7Zbgib6C5fCtUpUXawOx9BkEkY_7LH1W-icFIsVM38tlDrzJWnfnDSGP74VXx2ewUBYJ3Qt3GK83vRNzbvnuTJGW7LcXtgCDN01f9cmmb3RsLVs6Ass0O1WxGzZY_h3VJLjDYWL1quxA May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:35.233670 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cb2e5791eb28424bb74740dfc9482c9c May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: exception: Aggregate -1 could not be found. May 19 04:32:35.234874 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '-1'} May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.235520 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 19 04:32:35.236604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.242829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-271b916a-f600-468d-b047-44d6da86a09d tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:35.242829 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-271b916a-f600-468d-b047-44d6da86a09d tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031071 May 19 04:32:35.242829 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 184/374] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:35 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:32:35.243459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d58b5021-bcb4-49d4-a9cf-7afe3dd0533b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:35.247135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d58b5021-bcb4-49d4-a9cf-7afe3dd0533b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:35.249279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:35.249834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:35.256165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:35.262401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d58b5021-bcb4-49d4-a9cf-7afe3dd0533b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.265614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d58b5021-bcb4-49d4-a9cf-7afe3dd0533b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.266622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d58b5021-bcb4-49d4-a9cf-7afe3dd0533b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.267259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d58b5021-bcb4-49d4-a9cf-7afe3dd0533b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.275412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.275949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.277829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.278549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.367335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d58b5021-bcb4-49d4-a9cf-7afe3dd0533b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:35.376031 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d58b5021-bcb4-49d4-a9cf-7afe3dd0533b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1278 microversion: 2.1 time: 0.149638 May 19 04:32:35.376622 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 191/375] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:35 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:35.381620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-58b07e9a-2dde-4105-b5a6-e32235368d83 req-976af615-1bc2-4fb6-8b4b-38cfa0546c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae28e440-afaa-461c-ad2e-9c119c468147", "name": "network-vif-plugged", "status": "completed", "tag": "8bc99dbc-616c-4771-aa9d-9afa83a872a9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:35.389833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-58b07e9a-2dde-4105-b5a6-e32235368d83 req-976af615-1bc2-4fb6-8b4b-38cfa0546c47 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.390380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-58b07e9a-2dde-4105-b5a6-e32235368d83 req-976af615-1bc2-4fb6-8b4b-38cfa0546c47 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.402657 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-58b07e9a-2dde-4105-b5a6-e32235368d83 req-976af615-1bc2-4fb6-8b4b-38cfa0546c47 service nova] Creating event network-vif-plugged:8bc99dbc-616c-4771-aa9d-9afa83a872a9 for instance ae28e440-afaa-461c-ad2e-9c119c468147 on n-h1-766726-30 May 19 04:32:35.408080 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-58b07e9a-2dde-4105-b5a6-e32235368d83 req-976af615-1bc2-4fb6-8b4b-38cfa0546c47 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029989 May 19 04:32:35.408691 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 192/376] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:35.418375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-930b0ff1-8b8b-4b11-9847-fb6f61920aed tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:35.419367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-930b0ff1-8b8b-4b11-9847-fb6f61920aed tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:35.429345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-930b0ff1-8b8b-4b11-9847-fb6f61920aed tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.432255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-930b0ff1-8b8b-4b11-9847-fb6f61920aed tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.435738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-930b0ff1-8b8b-4b11-9847-fb6f61920aed tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.436861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-930b0ff1-8b8b-4b11-9847-fb6f61920aed tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.441191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:35.450832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:35.452349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:35.453586 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e80352ba-a54c-4ba4-a13a-678863d0966d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1568 microversion: 2.25 time: 0.210632 May 19 04:32:35.454146 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 185/377] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:35 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:35.459553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2e5e371-21f3-4689-b71a-bedbaea66fd0 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:35.460562 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:35.460562 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:35.461736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e2e5e371-21f3-4689-b71a-bedbaea66fd0 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'cfc83c4eb08f4c2a93979b17e76b44dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d70e280e314dfd950c6e5424d5db7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2e5e371-21f3-4689-b71a-bedbaea66fd0 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Request method failure captured: May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchX86MGHM_n6iXTw_uq-FuuIR4sqPPZJ0sMPht1F1lq482ooM_Cr4uMBMp7BAs8dBCl0w8uvVYz3x5aRkBJDm4HJH5tEy6zOWLhQGMsY-CaygRtEYPos1nvkwY5YLF7e34sc4fTHdBGkT8ts6B99odqeQ7XfegutARwxati7vbx3T0 May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:35.464143 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cfc83c4eb08f4c2a93979b17e76b44dc May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 19 04:32:35.466156 n-d-766726-30 devstack@n-api.service[124819]: action_args: {} May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:35.466953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 19 04:32:35.468285 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.471111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2e5e371-21f3-4689-b71a-bedbaea66fd0 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:35.472662 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2e5e371-21f3-4689-b71a-bedbaea66fd0 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017321 May 19 04:32:35.473434 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 186/378] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:32:35 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:35.495260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fca7f469-fcab-41d5-a483-93e5f8fb3a82 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1937703284"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:35.497022 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:35.497022 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:35.499202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.aggregate [None req-fca7f469-fcab-41d5-a483-93e5f8fb3a82 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Generated uuid 53941122-2b6d-40ac-a576-9c87b4f712fd for aggregate {{(pid=124819) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:35.524560 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fca7f469-fcab-41d5-a483-93e5f8fb3a82 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.034146 May 19 04:32:35.527237 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 187/379] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:35.536231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-903ee81e-8c93-4c85-bb1b-5eae1f46663b tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:35.538047 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:35.538047 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:35.544131 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-930b0ff1-8b8b-4b11-9847-fb6f61920aed tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129881 May 19 04:32:35.544921 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 193/380] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:32:35 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:35.547984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903ee81e-8c93-4c85-bb1b-5eae1f46663b tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.548444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903ee81e-8c93-4c85-bb1b-5eae1f46663b tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.668356 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-903ee81e-8c93-4c85-bb1b-5eae1f46663b tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.136570 May 19 04:32:35.668944 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 188/381] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:32:35 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:35.680350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e34c5778-77cd-47f8-b112-9fddab08bf80 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-766726-30"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:35.681906 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:35.681906 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:35.682922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e34c5778-77cd-47f8-b112-9fddab08bf80 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'cfc83c4eb08f4c2a93979b17e76b44dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d70e280e314dfd950c6e5424d5db7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e34c5778-77cd-47f8-b112-9fddab08bf80 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Request method failure captured: May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 43 May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchX86MGHM_n6iXTw_uq-FuuIR4sqPPZJ0sMPht1F1lq482ooM_Cr4uMBMp7BAs8dBCl0w8uvVYz3x5aRkBJDm4HJH5tEy6zOWLhQGMsY-CaygRtEYPos1nvkwY5YLF7e34sc4fTHdBGkT8ts6B99odqeQ7XfegutARwxati7vbx3T0 May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:35.685459 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f8d70e280e314dfd950c6e5424d5db7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: f8d70e280e314dfd950c6e5424d5db7b May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-181959084 May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: cfc83c4eb08f4c2a93979b17e76b44dc May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-181959084-project May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: {"remove_host": {"host": "n-h2-766726-30"}} May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:32:35.686937 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-766726-30'}}} May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:35.687823 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 19 04:32:35.689227 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:35.694981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e34c5778-77cd-47f8-b112-9fddab08bf80 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:35.694981 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e34c5778-77cd-47f8-b112-9fddab08bf80 tempest-AggregatesAdminNegativeTestJSON-181959084 tempest-AggregatesAdminNegativeTestJSON-181959084-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.013267 May 19 04:32:35.694981 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 194/382] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:32:35 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:35.700356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e892f2de-44cf-4f49-8104-5af141fd9f1a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:35.701763 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:35.701763 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:35.710830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e892f2de-44cf-4f49-8104-5af141fd9f1a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.711877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e892f2de-44cf-4f49-8104-5af141fd9f1a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.816881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ccb3ad5a-0fb1-462e-8a08-6e0c01e480cd req-30197dd4-b6be-4fea-81fa-257d771780b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99310c06-abbf-4e4f-b3c4-4b686b2f6139", "tag": "bd629c36-b208-4288-ae36-bf8a28f018d8"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:35.829753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ccb3ad5a-0fb1-462e-8a08-6e0c01e480cd req-30197dd4-b6be-4fea-81fa-257d771780b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.830499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ccb3ad5a-0fb1-462e-8a08-6e0c01e480cd req-30197dd4-b6be-4fea-81fa-257d771780b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.843203 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e892f2de-44cf-4f49-8104-5af141fd9f1a tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.146615 May 19 04:32:35.844566 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 189/383] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:32:35 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:35.848704 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ccb3ad5a-0fb1-462e-8a08-6e0c01e480cd req-30197dd4-b6be-4fea-81fa-257d771780b7 service nova] Creating event network-changed:bd629c36-b208-4288-ae36-bf8a28f018d8 for instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 on n-h1-766726-30 May 19 04:32:35.856032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-604de02f-0f80-47d3-895e-320dd973bc96 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:35.856213 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ccb3ad5a-0fb1-462e-8a08-6e0c01e480cd req-30197dd4-b6be-4fea-81fa-257d771780b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042555 May 19 04:32:35.857143 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 195/384] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:35.858066 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:35.858066 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:35.895456 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-604de02f-0f80-47d3-895e-320dd973bc96 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.044451 May 19 04:32:35.896492 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 190/385] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:35 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:35.907044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8af0ef8-a632-49de-8b9a-0afaf6f16a44 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1826840875"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:35.908488 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:35.908488 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:35.909382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.aggregate [None req-e8af0ef8-a632-49de-8b9a-0afaf6f16a44 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Generated uuid bf804469-18bd-4016-9541-8f20520430af for aggregate {{(pid=124818) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 04:32:35.935623 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8af0ef8-a632-49de-8b9a-0afaf6f16a44 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033106 May 19 04:32:35.937970 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 196/386] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 04:32:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:35.949053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:35.950302 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:35.950302 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:35.960202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.960651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.970631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:35.971321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:35.979126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.compute.aggregates [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 19 04:32:35.979642 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Request method failure captured: May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 42 May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchYtaVQf45t4sNwpkut1I-o7FdLfQFchyn7Zbgib6C5fCtUpUXawOx9BkEkY_7LH1W-icFIsVM38tlDrzJWnfnDSGP74VXx2ewUBYJ3Qt3GK83vRNzbvnuTJGW7LcXtgCDN01f9cmmb3RsLVs6Ass0O1WxGzZY_h3VJLjDYWL1quxA May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:35.981771 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78a8da5a31bb473bad8d5c07da946ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 78a8da5a31bb473bad8d5c07da946ec7 May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932 May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cb2e5791eb28424bb74740dfc9482c9c May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: {"remove_host": {"host": "nonexist_host"}} May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:35.983144 n-d-766726-30 devstack@n-api.service[124819]: exception: Cannot remove host nonexist_host in aggregate 18 May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 19 04:32:35.983849 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) May 19 04:32:35.984935 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.986002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:35.987117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:35.987117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:35.987117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:35.987117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:35.987117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 May 19 04:32:35.987117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:35.989765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:35.990813 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-61b07c29-b0c4-4304-9605-ae8df88833d6 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.045582 May 19 04:32:35.991563 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 191/387] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 04:32:35 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 19 04:32:35.999818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bf7893c2-04ba-4230-aa64-b518791d7919 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:36.000872 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:36.000872 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:36.027703 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bf7893c2-04ba-4230-aa64-b518791d7919 tempest-AggregatesAdminNegativeTestJSON-1489740932 tempest-AggregatesAdminNegativeTestJSON-1489740932-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.031563 May 19 04:32:36.028786 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 197/388] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:32:35 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 04:32:36.221686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e86acc8d-34c1-4e1a-83a9-3ecaa9795bc1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:36.222301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e86acc8d-34c1-4e1a-83a9-3ecaa9795bc1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:36.229464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e86acc8d-34c1-4e1a-83a9-3ecaa9795bc1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:36.229923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e86acc8d-34c1-4e1a-83a9-3ecaa9795bc1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:36.230692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e86acc8d-34c1-4e1a-83a9-3ecaa9795bc1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:36.235914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e86acc8d-34c1-4e1a-83a9-3ecaa9795bc1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:36.407947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-21fe41ad-c419-4247-82dc-8805b98bd36a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:36.418001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-21fe41ad-c419-4247-82dc-8805b98bd36a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:36.455835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21fe41ad-c419-4247-82dc-8805b98bd36a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:36.456309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21fe41ad-c419-4247-82dc-8805b98bd36a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:36.457523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21fe41ad-c419-4247-82dc-8805b98bd36a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:36.462045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21fe41ad-c419-4247-82dc-8805b98bd36a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:36.911743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-21fe41ad-c419-4247-82dc-8805b98bd36a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:36.931760 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-21fe41ad-c419-4247-82dc-8805b98bd36a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1266 microversion: 2.1 time: 0.541769 May 19 04:32:36.941105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 198/389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:36 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1266 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:36.941105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:36.941105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:36.955159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:36.955534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:36.956327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:36.956766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:37.010409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e86acc8d-34c1-4e1a-83a9-3ecaa9795bc1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:37.022528 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e86acc8d-34c1-4e1a-83a9-3ecaa9795bc1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1311 microversion: 2.1 time: 0.805060 May 19 04:32:37.023109 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 192/390] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:36 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1311 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:37.485108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:37.494667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:37.510291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:37.512206 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bcf86c32-b3ca-4f11-9de9-99a401723669 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1568 microversion: 2.25 time: 0.578422 May 19 04:32:37.513366 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 199/391] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:36 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1568 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:37.922193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-88b69b64-fed9-416e-9f39-9b240dd51d29 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:37.924653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-88b69b64-fed9-416e-9f39-9b240dd51d29 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:37.948296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-70a4a559-c04f-4d84-bd27-f60abd93b533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:37.949744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-70a4a559-c04f-4d84-bd27-f60abd93b533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:37.966470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70a4a559-c04f-4d84-bd27-f60abd93b533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:37.966931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70a4a559-c04f-4d84-bd27-f60abd93b533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:37.967740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70a4a559-c04f-4d84-bd27-f60abd93b533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:37.968179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70a4a559-c04f-4d84-bd27-f60abd93b533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:37.976033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88b69b64-fed9-416e-9f39-9b240dd51d29 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:37.979103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88b69b64-fed9-416e-9f39-9b240dd51d29 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:37.979628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88b69b64-fed9-416e-9f39-9b240dd51d29 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:37.980516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88b69b64-fed9-416e-9f39-9b240dd51d29 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:38.540154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-70a4a559-c04f-4d84-bd27-f60abd93b533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:38.548430 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-70a4a559-c04f-4d84-bd27-f60abd93b533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1308 microversion: 2.1 time: 0.603939 May 19 04:32:38.555218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-88b69b64-fed9-416e-9f39-9b240dd51d29 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:38.562554 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 200/392] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:37 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1308 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:38.566710 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-88b69b64-fed9-416e-9f39-9b240dd51d29 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 200 len: 1585 microversion: 2.1 time: 0.667538 May 19 04:32:38.567426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5483469e-207b-4338-ad1e-4a76752ad0e9 req-44de0660-d262-471c-b171-0d6e2049c156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c37abf-5b6b-4f1a-905c-102625d80f3f", "tag": "368a33bf-8ca6-4409-b4ff-13c42a72e838"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:38.577743 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 193/393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:37 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 1585 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:38.592309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c84b2d3-7c04-41c7-acf4-91ec1c8e20ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:38.592940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c84b2d3-7c04-41c7-acf4-91ec1c8e20ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:38.593871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5483469e-207b-4338-ad1e-4a76752ad0e9 req-44de0660-d262-471c-b171-0d6e2049c156 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:38.595483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5483469e-207b-4338-ad1e-4a76752ad0e9 req-44de0660-d262-471c-b171-0d6e2049c156 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:38.616666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c84b2d3-7c04-41c7-acf4-91ec1c8e20ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:38.617151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c84b2d3-7c04-41c7-acf4-91ec1c8e20ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:38.617939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c84b2d3-7c04-41c7-acf4-91ec1c8e20ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:38.618428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c84b2d3-7c04-41c7-acf4-91ec1c8e20ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:38.626918 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5483469e-207b-4338-ad1e-4a76752ad0e9 req-44de0660-d262-471c-b171-0d6e2049c156 service nova] Creating event network-changed:368a33bf-8ca6-4409-b4ff-13c42a72e838 for instance 64c37abf-5b6b-4f1a-905c-102625d80f3f on n-h2-766726-30 May 19 04:32:38.633173 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5483469e-207b-4338-ad1e-4a76752ad0e9 req-44de0660-d262-471c-b171-0d6e2049c156 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069250 May 19 04:32:38.634227 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 201/394] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:38.639933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:38.641049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:38.648399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:38.649148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:38.650329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:38.651025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:39.155399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1c84b2d3-7c04-41c7-acf4-91ec1c8e20ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:39.165467 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c84b2d3-7c04-41c7-acf4-91ec1c8e20ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1494 microversion: 2.1 time: 0.586510 May 19 04:32:39.174203 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 194/395] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:38 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1494 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:39.177890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:39.194216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:39.200905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:39.204679 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dc193c19-47d9-497f-a524-0e1e9b67b7ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1568 microversion: 2.25 time: 0.568764 May 19 04:32:39.208105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 202/396] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:38 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1568 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:39.574323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3cb25895-30da-4073-9e3e-5ddcc0be1630 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:39.574931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3cb25895-30da-4073-9e3e-5ddcc0be1630 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:39.587412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3cb25895-30da-4073-9e3e-5ddcc0be1630 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:39.588121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3cb25895-30da-4073-9e3e-5ddcc0be1630 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:39.590668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3cb25895-30da-4073-9e3e-5ddcc0be1630 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:39.591460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3cb25895-30da-4073-9e3e-5ddcc0be1630 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:39.601824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c09514bb-5ea2-4df9-9373-8bf1c3d61204 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:39.602441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c09514bb-5ea2-4df9-9373-8bf1c3d61204 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:39.618863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c09514bb-5ea2-4df9-9373-8bf1c3d61204 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:39.619693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c09514bb-5ea2-4df9-9373-8bf1c3d61204 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:39.624783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c09514bb-5ea2-4df9-9373-8bf1c3d61204 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:39.626277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c09514bb-5ea2-4df9-9373-8bf1c3d61204 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:39.831164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:40.173291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3cb25895-30da-4073-9e3e-5ddcc0be1630 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:40.188043 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3cb25895-30da-4073-9e3e-5ddcc0be1630 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1308 microversion: 2.1 time: 0.615677 May 19 04:32:40.189439 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 203/397] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:39 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1308 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:40.217460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1c0ff855-ad56-42d6-99b5-c9cf77e5990f req-d3da0ec1-9658-471a-987c-0d388cf74304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae6a03f-375c-4b42-8544-59df1ba8cef5", "tag": "d3dc1818-db8c-4b28-b68c-3ab4103e42d9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:40.240872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1c0ff855-ad56-42d6-99b5-c9cf77e5990f req-d3da0ec1-9658-471a-987c-0d388cf74304 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:40.242479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1c0ff855-ad56-42d6-99b5-c9cf77e5990f req-d3da0ec1-9658-471a-987c-0d388cf74304 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:40.276967 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c09514bb-5ea2-4df9-9373-8bf1c3d61204 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1647 microversion: 2.1 time: 1.086832 May 19 04:32:40.279639 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1c0ff855-ad56-42d6-99b5-c9cf77e5990f req-d3da0ec1-9658-471a-987c-0d388cf74304 service nova] Creating event network-changed:d3dc1818-db8c-4b28-b68c-3ab4103e42d9 for instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 on n-h2-766726-30 May 19 04:32:40.281212 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 195/398] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:39 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1647 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:32:40.291706 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1c0ff855-ad56-42d6-99b5-c9cf77e5990f req-d3da0ec1-9658-471a-987c-0d388cf74304 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076180 May 19 04:32:40.292983 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 204/399] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:40.302456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e32828a5-910e-4026-a8b6-dfc250653a2f tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:40.303348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e32828a5-910e-4026-a8b6-dfc250653a2f tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:40.305227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:40.309544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:40.320756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e32828a5-910e-4026-a8b6-dfc250653a2f tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:40.322080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e32828a5-910e-4026-a8b6-dfc250653a2f tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:40.324903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e32828a5-910e-4026-a8b6-dfc250653a2f tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:40.326322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e32828a5-910e-4026-a8b6-dfc250653a2f tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:40.341321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:40.342365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:40.343593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:40.344427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:41.201809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:41.225123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:41.231529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:41.238035 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3533561-f148-46cb-a9cd-7e4db8c1821b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1568 microversion: 2.25 time: 0.951213 May 19 04:32:41.241612 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 196/400] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:40 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1568 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:41.246773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-687786b7-d8e6-4222-bbf4-0fc334c0a3a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:41.250595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-687786b7-d8e6-4222-bbf4-0fc334c0a3a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:41.264528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-687786b7-d8e6-4222-bbf4-0fc334c0a3a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:41.265151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-687786b7-d8e6-4222-bbf4-0fc334c0a3a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:41.267197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-687786b7-d8e6-4222-bbf4-0fc334c0a3a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:41.267770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-687786b7-d8e6-4222-bbf4-0fc334c0a3a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:41.281242 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e32828a5-910e-4026-a8b6-dfc250653a2f tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1647 microversion: 2.1 time: 0.984936 May 19 04:32:41.294711 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 205/401] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:40 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1647 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:41.299524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a933fd6-38cc-4bf6-8170-4ce99c2a4ab9 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:41.309026 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:41.309026 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:41.311084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a933fd6-38cc-4bf6-8170-4ce99c2a4ab9 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:41.311739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a933fd6-38cc-4bf6-8170-4ce99c2a4ab9 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:41.314174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a933fd6-38cc-4bf6-8170-4ce99c2a4ab9 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:41.315023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a933fd6-38cc-4bf6-8170-4ce99c2a4ab9 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:41.363156 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a933fd6-38cc-4bf6-8170-4ce99c2a4ab9 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.067369 May 19 04:32:41.370588 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 206/402] 10.222.0.58 () {58 vars in 1175 bytes} [Thu May 19 04:32:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:41.378945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5515d125-94f8-4f53-8734-53394236fb89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-766726-30", "block_migration": true, "disk_over_commit": false}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:41.381926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5515d125-94f8-4f53-8734-53394236fb89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:41.388510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5515d125-94f8-4f53-8734-53394236fb89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:41.389336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5515d125-94f8-4f53-8734-53394236fb89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:41.390431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5515d125-94f8-4f53-8734-53394236fb89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:41.391022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5515d125-94f8-4f53-8734-53394236fb89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:41.491377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-5515d125-94f8-4f53-8734-53394236fb89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lazy-loading 'flavor' on Instance uuid ae28e440-afaa-461c-ad2e-9c119c468147 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:32:41.502147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-687786b7-d8e6-4222-bbf4-0fc334c0a3a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:41.513121 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-687786b7-d8e6-4222-bbf4-0fc334c0a3a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1308 microversion: 2.1 time: 0.270208 May 19 04:32:41.515545 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 197/403] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:41 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:41.558068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5515d125-94f8-4f53-8734-53394236fb89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Going to try to live migrate instance to n-h2-766726-30 {{(pid=124818) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 04:32:41.611919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:41.964101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e8e898b-e4f7-4ec0-88fe-e2346965d771 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Calling method '.version_select at 0x7fd3161fa700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:41.965863 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:41.965863 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:41.968148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8e898b-e4f7-4ec0-88fe-e2346965d771 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:41.968824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8e898b-e4f7-4ec0-88fe-e2346965d771 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:41.992033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8e898b-e4f7-4ec0-88fe-e2346965d771 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:41.993263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8e898b-e4f7-4ec0-88fe-e2346965d771 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.004995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8e898b-e4f7-4ec0-88fe-e2346965d771 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.005557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8e898b-e4f7-4ec0-88fe-e2346965d771 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.011883 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e8e898b-e4f7-4ec0-88fe-e2346965d771 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.473542 May 19 04:32:42.012561 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 198/404] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:42.023655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-50702084-fee0-484c-a1da-557b3c142411 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Calling method '.version_select at 0x7fd3161fa8b0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.024575 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:42.024575 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:42.026100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50702084-fee0-484c-a1da-557b3c142411 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.037591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50702084-fee0-484c-a1da-557b3c142411 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.065385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50702084-fee0-484c-a1da-557b3c142411 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.066060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50702084-fee0-484c-a1da-557b3c142411 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.078022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50702084-fee0-484c-a1da-557b3c142411 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.078691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50702084-fee0-484c-a1da-557b3c142411 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.086869 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-50702084-fee0-484c-a1da-557b3c142411 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.067497 May 19 04:32:42.087728 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 199/405] 10.222.0.58 () {58 vars in 1166 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:32:42.105797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2275d4bd-3c4a-43e5-9b47-0ecf79d393de tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Calling method '.version_select at 0x7fd31621b160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.107328 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:42.107328 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:42.109003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2275d4bd-3c4a-43e5-9b47-0ecf79d393de tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.109633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2275d4bd-3c4a-43e5-9b47-0ecf79d393de tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.124665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2275d4bd-3c4a-43e5-9b47-0ecf79d393de tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.125322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2275d4bd-3c4a-43e5-9b47-0ecf79d393de tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.135619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:42.139568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2275d4bd-3c4a-43e5-9b47-0ecf79d393de tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.140200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2275d4bd-3c4a-43e5-9b47-0ecf79d393de tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.150404 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2275d4bd-3c4a-43e5-9b47-0ecf79d393de tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.051708 May 19 04:32:42.151708 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 200/406] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:42.162927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-843495c6-98e3-45ed-8d83-a49e341c0c3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Calling method '.version_select at 0x7fd31621b4c0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.163809 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:42.163809 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:42.165012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-843495c6-98e3-45ed-8d83-a49e341c0c3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.165485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-843495c6-98e3-45ed-8d83-a49e341c0c3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.185818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-843495c6-98e3-45ed-8d83-a49e341c0c3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.186486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-843495c6-98e3-45ed-8d83-a49e341c0c3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.196152 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-843495c6-98e3-45ed-8d83-a49e341c0c3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.038374 May 19 04:32:42.197173 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 201/407] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:42.211620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-faa5c55f-4da1-426f-80ed-2e836ebb314d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Calling method '.version_select at 0x7fd31621b310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.212433 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:42.212433 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:42.213823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-faa5c55f-4da1-426f-80ed-2e836ebb314d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.214164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-faa5c55f-4da1-426f-80ed-2e836ebb314d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.252832 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-faa5c55f-4da1-426f-80ed-2e836ebb314d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.046515 May 19 04:32:42.255143 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 202/408] 10.222.0.58 () {58 vars in 1178 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:42.260553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.261206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:42.267526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.268601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.269781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.271312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.470386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:42.479378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:42.481226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:42.482600 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da9f348b-bce1-48cf-b63d-16a023be0d46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1568 microversion: 2.25 time: 0.226296 May 19 04:32:42.494510 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 203/409] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:42.499435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0de2298d-4e05-4b75-b09f-ee1e1e4cdd3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Calling method '.version_select at 0x7fd31629b430>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.501602 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:42.501602 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:42.502977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0de2298d-4e05-4b75-b09f-ee1e1e4cdd3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.503708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0de2298d-4e05-4b75-b09f-ee1e1e4cdd3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.534680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0de2298d-4e05-4b75-b09f-ee1e1e4cdd3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.535453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0de2298d-4e05-4b75-b09f-ee1e1e4cdd3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.555838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0de2298d-4e05-4b75-b09f-ee1e1e4cdd3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.556978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0de2298d-4e05-4b75-b09f-ee1e1e4cdd3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.570626 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0de2298d-4e05-4b75-b09f-ee1e1e4cdd3b tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.074362 May 19 04:32:42.578200 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 204/410] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:42.584096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62cda2a0-b9db-4170-8443-ac59c6d0e4a2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.585251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62cda2a0-b9db-4170-8443-ac59c6d0e4a2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:42.595828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62cda2a0-b9db-4170-8443-ac59c6d0e4a2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.596964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62cda2a0-b9db-4170-8443-ac59c6d0e4a2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.598763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62cda2a0-b9db-4170-8443-ac59c6d0e4a2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.599706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62cda2a0-b9db-4170-8443-ac59c6d0e4a2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.763634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-62cda2a0-b9db-4170-8443-ac59c6d0e4a2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:42.774914 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-62cda2a0-b9db-4170-8443-ac59c6d0e4a2 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1308 microversion: 2.1 time: 0.195088 May 19 04:32:42.775862 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 205/411] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1308 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:42.785376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f3a5a67a-8aba-4a28-8c03-c42a1661b955 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Calling method '.version_select at 0x7fd3161fa940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.786752 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:42.786752 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:42.788169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3a5a67a-8aba-4a28-8c03-c42a1661b955 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.788649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3a5a67a-8aba-4a28-8c03-c42a1661b955 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.805980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3a5a67a-8aba-4a28-8c03-c42a1661b955 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.806450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3a5a67a-8aba-4a28-8c03-c42a1661b955 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.814145 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f3a5a67a-8aba-4a28-8c03-c42a1661b955 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.036457 May 19 04:32:42.821641 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 206/412] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:42.831606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-583a5491-4cad-46c4-b8db-71a4d48c5322 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Calling method '.version_select at 0x7fd316280ca0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.832607 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:42.832607 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:42.834063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-583a5491-4cad-46c4-b8db-71a4d48c5322 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.834610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-583a5491-4cad-46c4-b8db-71a4d48c5322 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.854506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-583a5491-4cad-46c4-b8db-71a4d48c5322 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.855042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-583a5491-4cad-46c4-b8db-71a4d48c5322 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.865366 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-583a5491-4cad-46c4-b8db-71a4d48c5322 tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.040155 May 19 04:32:42.866317 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 207/413] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:42.880116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9c77725b-3329-4846-af8e-d8e842d1e25d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Calling method '.version_select at 0x7fd316280a60>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:42.880902 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:42.880902 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:42.882105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c77725b-3329-4846-af8e-d8e842d1e25d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.882552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c77725b-3329-4846-af8e-d8e842d1e25d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.900852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c77725b-3329-4846-af8e-d8e842d1e25d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.901359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c77725b-3329-4846-af8e-d8e842d1e25d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.912819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c77725b-3329-4846-af8e-d8e842d1e25d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:42.913297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c77725b-3329-4846-af8e-d8e842d1e25d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:42.979316 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9c77725b-3329-4846-af8e-d8e842d1e25d tempest-HypervisorAdminTestJSON-1776677574 tempest-HypervisorAdminTestJSON-1776677574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.103748 May 19 04:32:42.988791 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 208/414] 10.222.0.58 () {58 vars in 1172 bytes} [Thu May 19 04:32:42 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:32:43.293917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2097232139", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:43.378046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:32:43.390087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=20 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:43.885565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:32:43.887592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:32:43.888831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:32:43.889521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:32:43.890681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:32:43.908110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:43.909285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:43.909623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:43.910251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:43.957989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Getting quotas for project 4c10356deaaf4ae9ae770bc357a19653. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:43.966372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Getting quotas for user c9244ac0fd02470f98baf4ae2926a757 and project 4c10356deaaf4ae9ae770bc357a19653. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:43.987462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:32:43.991363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:32:44.018355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:44.054335 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-86e15a73-8e43-4a63-8330-e0a66f5465b3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060002 May 19 04:32:44.055278 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 209/415] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:32:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:32:44.061032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:44.061876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:44.069810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:44.070491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:44.071635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:44.072261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:44.221471 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5515d125-94f8-4f53-8734-53394236fb89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147/action" status: 202 len: 0 microversion: 2.1 time: 2.848130 May 19 04:32:44.225668 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 207/416] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:32:41 2022] POST /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147/action => generated 0 bytes in 2854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:32:44.234899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a995d15a-3246-4141-9d64-88278cc7c963 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:44.238098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a995d15a-3246-4141-9d64-88278cc7c963 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:44.259146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a995d15a-3246-4141-9d64-88278cc7c963 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:44.259935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a995d15a-3246-4141-9d64-88278cc7c963 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:44.261423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a995d15a-3246-4141-9d64-88278cc7c963 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:44.262414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a995d15a-3246-4141-9d64-88278cc7c963 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:44.424068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:44.432887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:44.437677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:44.449039 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0e71c482-3bb4-4524-b9e2-5a474ff712dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1568 microversion: 2.25 time: 0.382591 May 19 04:32:44.450064 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 210/417] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:44 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1568 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:44.570852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a995d15a-3246-4141-9d64-88278cc7c963 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:44.581053 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a995d15a-3246-4141-9d64-88278cc7c963 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1308 microversion: 2.1 time: 0.351875 May 19 04:32:44.584322 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 208/418] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:44 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:44.596817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b01929f-5a7e-47ae-8d8e-b39463447d42 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:44.597695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7b01929f-5a7e-47ae-8d8e-b39463447d42 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:44.665502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7b01929f-5a7e-47ae-8d8e-b39463447d42 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:44.675451 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7b01929f-5a7e-47ae-8d8e-b39463447d42 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1223 microversion: 2.1 time: 0.080964 May 19 04:32:44.677531 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 209/419] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:44 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:44.691456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bdbac466-cb93-4722-b4ab-8be343456945 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:44.692906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bdbac466-cb93-4722-b4ab-8be343456945 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:44.703609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdbac466-cb93-4722-b4ab-8be343456945 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:44.704872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdbac466-cb93-4722-b4ab-8be343456945 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:44.706320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdbac466-cb93-4722-b4ab-8be343456945 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:44.707193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdbac466-cb93-4722-b4ab-8be343456945 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:44.743420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab943c98-e2ba-4676-a6dc-ec61a79cf888 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Action: 'update', calling method: .version_select at 0x7fd31629bdc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:44.974520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bdbac466-cb93-4722-b4ab-8be343456945 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:44.984839 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bdbac466-cb93-4722-b4ab-8be343456945 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1504 microversion: 2.1 time: 0.304189 May 19 04:32:44.996557 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 210/420] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:44 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:45.382446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aea4c7ed-e54c-460b-8636-9973d6170df0 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Calling method '.version_select at 0x7fd31634b700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:45.433015 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aea4c7ed-e54c-460b-8636-9973d6170df0 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104" status: 200 len: 636 microversion: 2.1 time: 0.055449 May 19 04:32:45.443533 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 211/421] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:32:45 2022] GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104 => generated 636 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:32:45.455170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-101736cb-c1d5-4e75-898a-28c204f0f618 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Action: 'update_all', calling method: .version_select at 0x7fd3162afca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:45.487864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab943c98-e2ba-4676-a6dc-ec61a79cf888 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:45.489052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab943c98-e2ba-4676-a6dc-ec61a79cf888 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:45.489890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab943c98-e2ba-4676-a6dc-ec61a79cf888 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:45.490333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab943c98-e2ba-4676-a6dc-ec61a79cf888 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:45.513238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-101736cb-c1d5-4e75-898a-28c204f0f618 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:45.517194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-101736cb-c1d5-4e75-898a-28c204f0f618 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for user 3fb8f70081a745c4ad33fb5f329abd06 and project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:45.640217 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab943c98-e2ba-4676-a6dc-ec61a79cf888 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/eb76267be36f4393ab5ed41c81098669" status: 200 len: 148 microversion: 2.57 time: 1.188706 May 19 04:32:45.641388 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 211/422] 10.222.0.58 () {62 vars in 1302 bytes} [Thu May 19 04:32:44 2022] PUT /compute/v2.1/os-quota-sets/eb76267be36f4393ab5ed41c81098669 => generated 148 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:32:45.652286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:45.661512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:45.683560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:45.683919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:45.684709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:45.695966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:45.954623 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-101736cb-c1d5-4e75-898a-28c204f0f618 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 61 microversion: 2.1 time: 0.502865 May 19 04:32:45.955785 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 212/423] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:32:45 2022] PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 61 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:32:45.965408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-69c1ce7a-11a4-4463-a8f7-58c78ed4bcea tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:45.966265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-69c1ce7a-11a4-4463-a8f7-58c78ed4bcea tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:45.975024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69c1ce7a-11a4-4463-a8f7-58c78ed4bcea tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:45.976431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69c1ce7a-11a4-4463-a8f7-58c78ed4bcea tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:45.977482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69c1ce7a-11a4-4463-a8f7-58c78ed4bcea tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:45.978163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69c1ce7a-11a4-4463-a8f7-58c78ed4bcea tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:46.008026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:46.022857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:46.024562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:46.025816 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f2320f4a-7862-4a65-b90a-b3e7ebb42585 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1558 microversion: 2.25 time: 0.383164 May 19 04:32:46.038011 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 212/424] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:45 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1558 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:46.042910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-efb3d545-25cf-49ec-a4c2-146adf35f145 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Calling method '.version_select at 0x7fd3161bd940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:46.234946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-69c1ce7a-11a4-4463-a8f7-58c78ed4bcea tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:46.253134 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-69c1ce7a-11a4-4463-a8f7-58c78ed4bcea tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1308 microversion: 2.1 time: 0.296006 May 19 04:32:46.259376 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 213/425] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:45 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:46.272193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bff2441a-719a-4a3b-8687-e6c6a4053c87 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:46.275657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bff2441a-719a-4a3b-8687-e6c6a4053c87 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:46.284674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bff2441a-719a-4a3b-8687-e6c6a4053c87 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:46.285395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bff2441a-719a-4a3b-8687-e6c6a4053c87 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:46.288296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bff2441a-719a-4a3b-8687-e6c6a4053c87 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:46.289163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bff2441a-719a-4a3b-8687-e6c6a4053c87 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:46.392431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efb3d545-25cf-49ec-a4c2-146adf35f145 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:46.392889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efb3d545-25cf-49ec-a4c2-146adf35f145 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:46.394709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efb3d545-25cf-49ec-a4c2-146adf35f145 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:46.395197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efb3d545-25cf-49ec-a4c2-146adf35f145 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:46.416989 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-efb3d545-25cf-49ec-a4c2-146adf35f145 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/eb76267be36f4393ab5ed41c81098669/detail" status: 200 len: 463 microversion: 2.57 time: 0.377748 May 19 04:32:46.424728 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 213/426] 10.222.0.58 () {60 vars in 1303 bytes} [Thu May 19 04:32:46 2022] GET /compute/v2.1/os-quota-sets/eb76267be36f4393ab5ed41c81098669/detail => generated 463 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:32:46.434238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bff2441a-719a-4a3b-8687-e6c6a4053c87 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:46.444839 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bff2441a-719a-4a3b-8687-e6c6a4053c87 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1281 microversion: 2.1 time: 0.182492 May 19 04:32:46.445468 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 214/427] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:46 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1281 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:46.449752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-19724b47-f9f3-45a8-8d6b-20eee416d6c6 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Calling method '.version_select at 0x7fd316197c10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:46.485101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-241c84d7-24db-49b4-a382-31a56abd4f20 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:46.485742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-241c84d7-24db-49b4-a382-31a56abd4f20 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:46.511881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-241c84d7-24db-49b4-a382-31a56abd4f20 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:46.517107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-241c84d7-24db-49b4-a382-31a56abd4f20 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:46.523962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-241c84d7-24db-49b4-a382-31a56abd4f20 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:46.527677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-241c84d7-24db-49b4-a382-31a56abd4f20 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:46.858144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-241c84d7-24db-49b4-a382-31a56abd4f20 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:46.886820 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-241c84d7-24db-49b4-a382-31a56abd4f20 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1504 microversion: 2.1 time: 0.432693 May 19 04:32:46.897488 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 215/428] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:46 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:46.905371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dcc2c663-4a15-4c12-83d8-1a75f68baedf tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '.version_select at 0x7fd316294a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:46.919202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcc2c663-4a15-4c12-83d8-1a75f68baedf tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:46.919689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcc2c663-4a15-4c12-83d8-1a75f68baedf tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:46.936781 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dcc2c663-4a15-4c12-83d8-1a75f68baedf tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1110 microversion: 2.25 time: 0.037692 May 19 04:32:46.945259 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 216/429] 10.222.0.58 () {60 vars in 1183 bytes} [Thu May 19 04:32:46 2022] GET /compute/v2.1/os-migrations => generated 1110 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:46.951366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Action: 'update', calling method: .version_select at 0x7fd31628c8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:47.022596 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-19724b47-f9f3-45a8-8d6b-20eee416d6c6 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "DELETE /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.596571 May 19 04:32:47.023455 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 214/430] 10.222.0.58 () {58 vars in 1295 bytes} [Thu May 19 04:32:46 2022] DELETE /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata/os_version => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:32:47.028595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-387b6d5d-08d6-4d8d-b0d8-97fe6ad12d5f req-9a0948e9-be9e-4538-8409-af2bad365103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae6a03f-375c-4b42-8544-59df1ba8cef5", "name": "network-vif-plugged", "status": "completed", "tag": "d3dc1818-db8c-4b28-b68c-3ab4103e42d9"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:47.040721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-387b6d5d-08d6-4d8d-b0d8-97fe6ad12d5f req-9a0948e9-be9e-4538-8409-af2bad365103 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.041174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-387b6d5d-08d6-4d8d-b0d8-97fe6ad12d5f req-9a0948e9-be9e-4538-8409-af2bad365103 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.054210 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-387b6d5d-08d6-4d8d-b0d8-97fe6ad12d5f req-9a0948e9-be9e-4538-8409-af2bad365103 service nova] Creating event network-vif-plugged:d3dc1818-db8c-4b28-b68c-3ab4103e42d9 for instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 on n-h2-766726-30 May 19 04:32:47.059185 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-387b6d5d-08d6-4d8d-b0d8-97fe6ad12d5f req-9a0948e9-be9e-4538-8409-af2bad365103 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034305 May 19 04:32:47.060076 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 215/431] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:47.065660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cbbc06d2-295d-475d-9ea4-3f46c6f6ace8 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:47.066348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cbbc06d2-295d-475d-9ea4-3f46c6f6ace8 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:47.073869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbbc06d2-295d-475d-9ea4-3f46c6f6ace8 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.074585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbbc06d2-295d-475d-9ea4-3f46c6f6ace8 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.075521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbbc06d2-295d-475d-9ea4-3f46c6f6ace8 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.076118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbbc06d2-295d-475d-9ea4-3f46c6f6ace8 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.306800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.307690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.310175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.311182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.328149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-cbbc06d2-295d-475d-9ea4-3f46c6f6ace8 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 99310c06-abbf-4e4f-b3c4-4b686b2f6139 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:32:47.376517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.377355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.378349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.379398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.461754 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cbbc06d2-295d-475d-9ea4-3f46c6f6ace8 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 2053 microversion: 2.25 time: 0.400146 May 19 04:32:47.464659 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 216/432] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:47 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 2053 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:47.471897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5532576-c248-41cb-85ac-f3e758b2968c tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Calling method '.version_select at 0x7fd31621bf70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:47.520467 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0dc13770-bc69-4b6f-8266-596a017e2569 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/eb76267be36f4393ab5ed41c81098669?user_id=4c6c609bb74847058693979132ea40cc" status: 200 len: 148 microversion: 2.57 time: 0.572787 May 19 04:32:47.525387 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 217/433] 10.222.0.58 () {62 vars in 1383 bytes} [Thu May 19 04:32:46 2022] PUT /compute/v2.1/os-quota-sets/eb76267be36f4393ab5ed41c81098669?user_id=4c6c609bb74847058693979132ea40cc => generated 148 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:32:47.537328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed109ed6-ad3b-4c11-b0c7-45bebc8b4311 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:47.541835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ed109ed6-ad3b-4c11-b0c7-45bebc8b4311 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:47.552908 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5532576-c248-41cb-85ac-f3e758b2968c tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 37 microversion: 2.1 time: 0.083756 May 19 04:32:47.562334 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 217/434] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:32:47 2022] GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 37 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:47.565126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed109ed6-ad3b-4c11-b0c7-45bebc8b4311 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.569782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed109ed6-ad3b-4c11-b0c7-45bebc8b4311 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.570974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed109ed6-ad3b-4c11-b0c7-45bebc8b4311 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.571868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed109ed6-ad3b-4c11-b0c7-45bebc8b4311 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.584482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-652cf77c-52a9-4435-8d89-01c070067663 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:47.585400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-652cf77c-52a9-4435-8d89-01c070067663 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:47.610521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-652cf77c-52a9-4435-8d89-01c070067663 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.619182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-652cf77c-52a9-4435-8d89-01c070067663 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.620226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-652cf77c-52a9-4435-8d89-01c070067663 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:47.621594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-652cf77c-52a9-4435-8d89-01c070067663 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:47.627786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:47.950356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-652cf77c-52a9-4435-8d89-01c070067663 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:47.952968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ed109ed6-ad3b-4c11-b0c7-45bebc8b4311 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:47.961200 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-652cf77c-52a9-4435-8d89-01c070067663 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1323 microversion: 2.1 time: 0.401977 May 19 04:32:47.961934 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 218/435] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:47 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1323 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:47.967328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d58030e-aa2b-4cc7-9cc7-1d8ef5412a32 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] Calling method '.version_select at 0x7fd31621b820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:47.969267 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ed109ed6-ad3b-4c11-b0c7-45bebc8b4311 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1308 microversion: 2.1 time: 0.441341 May 19 04:32:47.970025 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 218/436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:47 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:47.981020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ccbf1ebb-cc72-49b1-b1cd-4ff34ff027f2 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Action: 'update_all', calling method: .version_select at 0x7fd316236670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:48.041774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ccbf1ebb-cc72-49b1-b1cd-4ff34ff027f2 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:48.046206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ccbf1ebb-cc72-49b1-b1cd-4ff34ff027f2 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for user 3fb8f70081a745c4ad33fb5f329abd06 and project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:48.249681 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4d58030e-aa2b-4cc7-9cc7-1d8ef5412a32 tempest-QuotasAdminTestV257-1856748581 tempest-QuotasAdminTestV257-1856748581-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/eb76267be36f4393ab5ed41c81098669?user_id=4c6c609bb74847058693979132ea40cc" status: 200 len: 190 microversion: 2.57 time: 0.286391 May 19 04:32:48.250856 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 219/437] 10.222.0.58 () {60 vars in 1363 bytes} [Thu May 19 04:32:47 2022] GET /compute/v2.1/os-quota-sets/eb76267be36f4393ab5ed41c81098669?user_id=4c6c609bb74847058693979132ea40cc => generated 190 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:32:48.257749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-694651280", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "61be5a1b-718f-4838-b8d3-c8b42b1b073f"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:48.330819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] validate_networks() for [('61be5a1b-718f-4838-b8d3-c8b42b1b073f', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:32:48.516478 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ccbf1ebb-cc72-49b1-b1cd-4ff34ff027f2 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 61 microversion: 2.1 time: 0.545540 May 19 04:32:48.517163 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 219/438] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:32:47 2022] PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 61 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:48.897106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7fdcef62-f844-4a9f-9a2a-eb6c87f4a2e9 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Calling method '.version_select at 0x7fd316246a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:48.899350 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:48.899350 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:48.900900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fdcef62-f844-4a9f-9a2a-eb6c87f4a2e9 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:48.902827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fdcef62-f844-4a9f-9a2a-eb6c87f4a2e9 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:48.919857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fdcef62-f844-4a9f-9a2a-eb6c87f4a2e9 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:48.920317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fdcef62-f844-4a9f-9a2a-eb6c87f4a2e9 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:48.944400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:48.949234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fdcef62-f844-4a9f-9a2a-eb6c87f4a2e9 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:48.951116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fdcef62-f844-4a9f-9a2a-eb6c87f4a2e9 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:48.963790 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7fdcef62-f844-4a9f-9a2a-eb6c87f4a2e9 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.445438 May 19 04:32:48.965203 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 220/439] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:48.971225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-74ba863e-ccfc-4bb8-a14c-6ea086966ef6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:48.974195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-74ba863e-ccfc-4bb8-a14c-6ea086966ef6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:48.982084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74ba863e-ccfc-4bb8-a14c-6ea086966ef6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:48.984482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74ba863e-ccfc-4bb8-a14c-6ea086966ef6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:48.985336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74ba863e-ccfc-4bb8-a14c-6ea086966ef6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:48.985783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74ba863e-ccfc-4bb8-a14c-6ea086966ef6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.363536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-74ba863e-ccfc-4bb8-a14c-6ea086966ef6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:49.371603 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-74ba863e-ccfc-4bb8-a14c-6ea086966ef6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1504 microversion: 2.1 time: 0.404842 May 19 04:32:49.372470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 221/440] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:48 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:49.385774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-eb7b0ac4-71ed-438d-83da-71eccf39a297 req-3603194b-5ff5-4005-9f6d-e0c096accb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae28e440-afaa-461c-ad2e-9c119c468147", "name": "network-vif-unplugged", "status": "completed", "tag": "8bc99dbc-616c-4771-aa9d-9afa83a872a9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:49.399462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-eb7b0ac4-71ed-438d-83da-71eccf39a297 req-3603194b-5ff5-4005-9f6d-e0c096accb35 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.400304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-eb7b0ac4-71ed-438d-83da-71eccf39a297 req-3603194b-5ff5-4005-9f6d-e0c096accb35 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.412883 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-eb7b0ac4-71ed-438d-83da-71eccf39a297 req-3603194b-5ff5-4005-9f6d-e0c096accb35 service nova] Creating event network-vif-unplugged:8bc99dbc-616c-4771-aa9d-9afa83a872a9 for instance ae28e440-afaa-461c-ad2e-9c119c468147 on n-h1-766726-30 May 19 04:32:49.418018 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-eb7b0ac4-71ed-438d-83da-71eccf39a297 req-3603194b-5ff5-4005-9f6d-e0c096accb35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044231 May 19 04:32:49.418981 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 222/441] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:49.424268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39e3935f-1997-47a5-bb38-b3ee129afb9f tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Calling method '.version_select at 0x7fd31634b430>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:49.441847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:32:49.442891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:32:49.443563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:32:49.444154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:32:49.444772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:32:49.459651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.460175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.460987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.461561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.472072 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39e3935f-1997-47a5-bb38-b3ee129afb9f tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.051719 May 19 04:32:49.472643 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 223/442] 10.222.0.58 () {58 vars in 1289 bytes} [Thu May 19 04:32:49 2022] GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata/os_distro => generated 33 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:49.477993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd706a41-b3cd-4578-aefd-c614dea67249 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Calling method '.version_select at 0x7fd31628cf70>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:49.478882 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:49.478882 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:49.480016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd706a41-b3cd-4578-aefd-c614dea67249 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.480448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd706a41-b3cd-4578-aefd-c614dea67249 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.499548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd706a41-b3cd-4578-aefd-c614dea67249 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.499956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd706a41-b3cd-4578-aefd-c614dea67249 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.502222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Getting quotas for project 6d01f77aa473464b8e32d47e9b9d2a98. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:49.507867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Getting quotas for user 249e284f0cfe4ecda820efeb5956701f and project 6d01f77aa473464b8e32d47e9b9d2a98. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:49.524897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:32:49.527643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:32:49.534388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd706a41-b3cd-4578-aefd-c614dea67249 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.534860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd706a41-b3cd-4578-aefd-c614dea67249 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.542210 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd706a41-b3cd-4578-aefd-c614dea67249 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h2-766726-30/servers" status: 200 len: 434 microversion: 2.1 time: 0.067748 May 19 04:32:49.543018 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 224/443] 10.222.0.58 () {58 vars in 1214 bytes} [Thu May 19 04:32:49 2022] GET /compute/v2.1/os-hypervisors/n-h2-766726-30/servers => generated 434 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:49.554201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c3e7d105-2e42-4bd6-878e-bc50938414e3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:49.555155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c3e7d105-2e42-4bd6-878e-bc50938414e3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:49.561829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3e7d105-2e42-4bd6-878e-bc50938414e3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.563327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3e7d105-2e42-4bd6-878e-bc50938414e3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.564282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3e7d105-2e42-4bd6-878e-bc50938414e3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.564861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3e7d105-2e42-4bd6-878e-bc50938414e3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.580033 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-de49cdb9-a449-496e-8638-7e76000dfdd9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.327771 May 19 04:32:49.580757 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 220/444] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:32:49.587443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7a7b167-505a-4a1f-8a92-e9c4437da169 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:49.588073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e7a7b167-505a-4a1f-8a92-e9c4437da169 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:49.594556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7a7b167-505a-4a1f-8a92-e9c4437da169 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.595147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7a7b167-505a-4a1f-8a92-e9c4437da169 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.596215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7a7b167-505a-4a1f-8a92-e9c4437da169 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.596659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7a7b167-505a-4a1f-8a92-e9c4437da169 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.907511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c3e7d105-2e42-4bd6-878e-bc50938414e3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:49.916021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c3e7d105-2e42-4bd6-878e-bc50938414e3 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1323 microversion: 2.1 time: 0.365783 May 19 04:32:49.926024 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 225/445] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:49 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1323 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:49.931783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c2ba2785-fb13-4351-88f6-68f1d27ee71e req-a4161b0e-58c0-4db4-a69c-eb2e9c399065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cda3b3-b152-4744-9d5e-f4fd44b9eb2a", "tag": "4e7c80f2-af35-4f8c-b438-79c7270eb220"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:49.935835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7a7b167-505a-4a1f-8a92-e9c4437da169 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:49.942890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c2ba2785-fb13-4351-88f6-68f1d27ee71e req-a4161b0e-58c0-4db4-a69c-eb2e9c399065 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.943696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c2ba2785-fb13-4351-88f6-68f1d27ee71e req-a4161b0e-58c0-4db4-a69c-eb2e9c399065 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:49.958393 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7a7b167-505a-4a1f-8a92-e9c4437da169 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1489 microversion: 2.1 time: 0.375236 May 19 04:32:49.959169 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 221/446] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:49 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1489 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:49.962739 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c2ba2785-fb13-4351-88f6-68f1d27ee71e req-a4161b0e-58c0-4db4-a69c-eb2e9c399065 service nova] Creating event network-changed:4e7c80f2-af35-4f8c-b438-79c7270eb220 for instance 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a on n-h2-766726-30 May 19 04:32:49.964328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a863798-d125-4506-8af9-6523012cb9e2 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Action: 'update_all', calling method: .version_select at 0x7fd316197670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:49.969988 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c2ba2785-fb13-4351-88f6-68f1d27ee71e req-a4161b0e-58c0-4db4-a69c-eb2e9c399065 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042565 May 19 04:32:49.971506 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 226/447] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:49.980352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bad9107d-f49f-4fdb-aa23-e5d4914a0adb tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Calling method '.version_select at 0x7fd31634bee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:49.981844 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:49.981844 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:49.983972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad9107d-f49f-4fdb-aa23-e5d4914a0adb tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:49.984422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad9107d-f49f-4fdb-aa23-e5d4914a0adb tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.003100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad9107d-f49f-4fdb-aa23-e5d4914a0adb tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.004723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad9107d-f49f-4fdb-aa23-e5d4914a0adb tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.021045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-2a863798-d125-4506-8af9-6523012cb9e2 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:50.022978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad9107d-f49f-4fdb-aa23-e5d4914a0adb tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.023686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad9107d-f49f-4fdb-aa23-e5d4914a0adb tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.025153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-2a863798-d125-4506-8af9-6523012cb9e2 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for user 3fb8f70081a745c4ad33fb5f329abd06 and project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:50.033120 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bad9107d-f49f-4fdb-aa23-e5d4914a0adb tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.060241 May 19 04:32:50.034174 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 227/448] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:50.039048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:50.040139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:50.046819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.047617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.048667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.049129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.116564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:50.126384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:50.128577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:50.130992 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4d06b991-d1ad-4091-9586-50393a35ce51 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1265 microversion: 2.25 time: 0.096112 May 19 04:32:50.131722 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 228/449] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:50 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:50.138108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f832b90-5001-4918-9526-d8d14b063e46 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:50.138931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f832b90-5001-4918-9526-d8d14b063e46 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:50.146946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f832b90-5001-4918-9526-d8d14b063e46 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.148264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f832b90-5001-4918-9526-d8d14b063e46 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.149837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f832b90-5001-4918-9526-d8d14b063e46 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.150512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f832b90-5001-4918-9526-d8d14b063e46 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.209122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:50.235105 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f832b90-5001-4918-9526-d8d14b063e46 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5/action" status: 202 len: 0 microversion: 2.1 time: 0.101359 May 19 04:32:50.237245 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 229/450] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:32:50 2022] POST /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:32:50.244014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-97251066-04bc-4e2e-bb8f-71623a6607a8 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Calling method '.version_select at 0x7fd316372310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:50.245288 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:50.245288 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:50.246787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97251066-04bc-4e2e-bb8f-71623a6607a8 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.247589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97251066-04bc-4e2e-bb8f-71623a6607a8 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.262690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97251066-04bc-4e2e-bb8f-71623a6607a8 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.263267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97251066-04bc-4e2e-bb8f-71623a6607a8 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.269802 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-97251066-04bc-4e2e-bb8f-71623a6607a8 tempest-HypervisorAdminUnderV252Test-42888306 tempest-HypervisorAdminUnderV252Test-42888306-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h2-766726-30/search" status: 200 len: 105 microversion: 2.1 time: 0.031137 May 19 04:32:50.270539 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 230/451] 10.222.0.58 () {58 vars in 1211 bytes} [Thu May 19 04:32:50 2022] GET /compute/v2.1/os-hypervisors/n-h2-766726-30/search => generated 105 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:50.287227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b4750575-e259-47b2-9961-92d84dc3164a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:50.287965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4750575-e259-47b2-9961-92d84dc3164a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:50.309615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4750575-e259-47b2-9961-92d84dc3164a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.309960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4750575-e259-47b2-9961-92d84dc3164a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.310771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4750575-e259-47b2-9961-92d84dc3164a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.311326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4750575-e259-47b2-9961-92d84dc3164a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.342027 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a863798-d125-4506-8af9-6523012cb9e2 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 61 microversion: 2.1 time: 0.381377 May 19 04:32:50.343045 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 222/452] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:32:49 2022] PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 61 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:50.353972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f09a8f09-6147-4995-86ab-837acfb45e1d tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Calling method '.version_select at 0x7fd316138d30>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:50.411640 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f09a8f09-6147-4995-86ab-837acfb45e1d tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 61 microversion: 2.1 time: 0.062672 May 19 04:32:50.412515 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 223/453] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:32:50 2022] GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 61 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:50.418834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9b7ec96-4e2a-4d88-a9f1-071c94f2686a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:50.419753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a9b7ec96-4e2a-4d88-a9f1-071c94f2686a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:50.427916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9b7ec96-4e2a-4d88-a9f1-071c94f2686a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.428789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9b7ec96-4e2a-4d88-a9f1-071c94f2686a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.430781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9b7ec96-4e2a-4d88-a9f1-071c94f2686a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.431496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9b7ec96-4e2a-4d88-a9f1-071c94f2686a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.555928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b4750575-e259-47b2-9961-92d84dc3164a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:50.563973 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b4750575-e259-47b2-9961-92d84dc3164a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1494 microversion: 2.1 time: 0.292151 May 19 04:32:50.564847 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 231/454] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:50 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1494 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:50.570578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa84d3a7-838c-48f6-a162-6e4d522edd23 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Action: 'update_all', calling method: .version_select at 0x7fd316236af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:50.624913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-aa84d3a7-838c-48f6-a162-6e4d522edd23 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:50.630695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-aa84d3a7-838c-48f6-a162-6e4d522edd23 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for user 3fb8f70081a745c4ad33fb5f329abd06 and project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:50.662640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a9b7ec96-4e2a-4d88-a9f1-071c94f2686a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:50.672159 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9b7ec96-4e2a-4d88-a9f1-071c94f2686a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1504 microversion: 2.1 time: 0.257986 May 19 04:32:50.682611 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 224/455] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:50 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:50.933104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7cdf0c69-58d4-40fd-b40c-b445bcbc66ed tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:50.934231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7cdf0c69-58d4-40fd-b40c-b445bcbc66ed tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:50.941101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:50.943732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7cdf0c69-58d4-40fd-b40c-b445bcbc66ed tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.944425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7cdf0c69-58d4-40fd-b40c-b445bcbc66ed tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.945495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7cdf0c69-58d4-40fd-b40c-b445bcbc66ed tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:50.946140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7cdf0c69-58d4-40fd-b40c-b445bcbc66ed tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:50.973450 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa84d3a7-838c-48f6-a162-6e4d522edd23 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 61 microversion: 2.1 time: 0.407210 May 19 04:32:50.974167 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 232/456] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:32:50 2022] PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 61 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:50.983614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b7e3c14-fce5-4f86-bb59-a404015ca7c0 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Action: 'update_all', calling method: .version_select at 0x7fd3161bd1f0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:51.060781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5b7e3c14-fce5-4f86-bb59-a404015ca7c0 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:51.065277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5b7e3c14-fce5-4f86-bb59-a404015ca7c0 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for user 3fb8f70081a745c4ad33fb5f329abd06 and project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:51.228352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7cdf0c69-58d4-40fd-b40c-b445bcbc66ed tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:51.241875 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7cdf0c69-58d4-40fd-b40c-b445bcbc66ed tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1323 microversion: 2.1 time: 0.311939 May 19 04:32:51.243401 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 225/457] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:50 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:51.252147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:51.253442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:51.263621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:51.264159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:51.265176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:51.266792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:51.449780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:51.466035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:51.471654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:51.473405 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-815b72ad-cdea-4b28-9905-e430a90fa62e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1319 microversion: 2.25 time: 0.228185 May 19 04:32:51.478037 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 226/458] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:51 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:51.485933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5f2e7a42-48b8-4b67-ba04-a0cd337847d9 req-795425fc-e894-4082-b676-cfbe766dd081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae28e440-afaa-461c-ad2e-9c119c468147", "tag": "8bc99dbc-616c-4771-aa9d-9afa83a872a9"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:51.501647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5f2e7a42-48b8-4b67-ba04-a0cd337847d9 req-795425fc-e894-4082-b676-cfbe766dd081 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:51.502916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5f2e7a42-48b8-4b67-ba04-a0cd337847d9 req-795425fc-e894-4082-b676-cfbe766dd081 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:51.518573 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5f2e7a42-48b8-4b67-ba04-a0cd337847d9 req-795425fc-e894-4082-b676-cfbe766dd081 service nova] Creating event network-changed:8bc99dbc-616c-4771-aa9d-9afa83a872a9 for instance ae28e440-afaa-461c-ad2e-9c119c468147 on n-h1-766726-30 May 19 04:32:51.528195 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5f2e7a42-48b8-4b67-ba04-a0cd337847d9 req-795425fc-e894-4082-b676-cfbe766dd081 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048190 May 19 04:32:51.529267 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 227/459] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:51.583362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b411bad1-14c8-416c-820d-88e1f84b5ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:51.584191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b411bad1-14c8-416c-820d-88e1f84b5ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:51.601461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b411bad1-14c8-416c-820d-88e1f84b5ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:51.602278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b411bad1-14c8-416c-820d-88e1f84b5ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:51.604464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b411bad1-14c8-416c-820d-88e1f84b5ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:51.605191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b411bad1-14c8-416c-820d-88e1f84b5ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:51.738027 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b7e3c14-fce5-4f86-bb59-a404015ca7c0 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 64 microversion: 2.1 time: 0.758408 May 19 04:32:51.738846 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 233/460] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:32:50 2022] PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 64 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:32:51.749131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7bf96448-7f0d-4b2a-ba3f-e0bcbb3bc44f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:51.751735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7bf96448-7f0d-4b2a-ba3f-e0bcbb3bc44f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:51.761048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7bf96448-7f0d-4b2a-ba3f-e0bcbb3bc44f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:51.761947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7bf96448-7f0d-4b2a-ba3f-e0bcbb3bc44f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:51.763077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7bf96448-7f0d-4b2a-ba3f-e0bcbb3bc44f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:51.763716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7bf96448-7f0d-4b2a-ba3f-e0bcbb3bc44f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:51.972778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b411bad1-14c8-416c-820d-88e1f84b5ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:51.987212 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b411bad1-14c8-416c-820d-88e1f84b5ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 200 len: 1474 microversion: 2.1 time: 0.409474 May 19 04:32:52.000856 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 228/461] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:51 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 1474 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:52.008855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ba0bb4bc-d5f6-4a4c-884f-899a9d793cbe tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Calling method '.version_select at 0x7fd3161e5310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:52.065668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7bf96448-7f0d-4b2a-ba3f-e0bcbb3bc44f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:52.078656 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7bf96448-7f0d-4b2a-ba3f-e0bcbb3bc44f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1504 microversion: 2.1 time: 0.336297 May 19 04:32:52.079411 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 234/462] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:51 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:52.086285 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ba0bb4bc-d5f6-4a4c-884f-899a9d793cbe tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 64 microversion: 2.1 time: 0.083983 May 19 04:32:52.087206 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 229/463] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:32:52 2022] GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:52.092997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8e50790-8004-4078-82c4-1713d70e3533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1136685574"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:52.099219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cca286dd-3523-4212-acfe-c539870a550e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Action: 'update_all', calling method: .version_select at 0x7fd3161a65e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:52.101305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8e50790-8004-4078-82c4-1713d70e3533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:52.108644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8e50790-8004-4078-82c4-1713d70e3533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:52.113574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8e50790-8004-4078-82c4-1713d70e3533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:52.114477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8e50790-8004-4078-82c4-1713d70e3533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:52.114925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8e50790-8004-4078-82c4-1713d70e3533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:52.184576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cca286dd-3523-4212-acfe-c539870a550e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:52.193284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cca286dd-3523-4212-acfe-c539870a550e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for user 3fb8f70081a745c4ad33fb5f329abd06 and project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:52.580810 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8e50790-8004-4078-82c4-1713d70e3533 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5/action" status: 202 len: 0 microversion: 2.1 time: 0.498406 May 19 04:32:52.581953 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 235/464] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:32:52 2022] POST /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:32:52.590794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed93d642-5177-405a-b37b-1a8222d947c5 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:52.592134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ed93d642-5177-405a-b37b-1a8222d947c5 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:52.600112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed93d642-5177-405a-b37b-1a8222d947c5 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:52.601965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed93d642-5177-405a-b37b-1a8222d947c5 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:52.603869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed93d642-5177-405a-b37b-1a8222d947c5 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:52.604528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed93d642-5177-405a-b37b-1a8222d947c5 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:52.740334 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cca286dd-3523-4212-acfe-c539870a550e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 61 microversion: 2.1 time: 0.646958 May 19 04:32:52.742189 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 230/465] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:32:52 2022] PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 61 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:52.749696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:52.750392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:52.759115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:52.760645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:52.762395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:52.763206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:52.968733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ed93d642-5177-405a-b37b-1a8222d947c5 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:53.013181 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ed93d642-5177-405a-b37b-1a8222d947c5 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1323 microversion: 2.1 time: 0.427899 May 19 04:32:53.015810 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 236/466] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:52 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1323 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:53.029451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-52ac6bfa-2fa3-4ea9-acc7-9dc2f40bb670 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316294820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:53.071048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:53.104624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:53.110436 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-52ac6bfa-2fa3-4ea9-acc7-9dc2f40bb670 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.084758 May 19 04:32:53.112086 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 237/467] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:32:53 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:53.112730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:53.117746 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-54cf8505-441d-4e93-88ac-7f7139423308 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1361 microversion: 2.25 time: 0.373896 May 19 04:32:53.118526 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 231/468] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:52 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1361 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:53.126617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ce275b05-9f19-4808-bff2-61780c24e57b tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Action: 'update', calling method: .version_select at 0x7fd316372d30>, body: {"meta": {"os_version": "alt"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:53.131096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c3584e3-324e-4fca-af14-d56965124418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:53.133839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5c3584e3-324e-4fca-af14-d56965124418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:53.156625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c3584e3-324e-4fca-af14-d56965124418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:53.158395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c3584e3-324e-4fca-af14-d56965124418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:53.162354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c3584e3-324e-4fca-af14-d56965124418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:53.162853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c3584e3-324e-4fca-af14-d56965124418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:53.210890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ce275b05-9f19-4808-bff2-61780c24e57b tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:53.218915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ce275b05-9f19-4808-bff2-61780c24e57b tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for user 3fb8f70081a745c4ad33fb5f329abd06 and project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:53.376740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c3584e3-324e-4fca-af14-d56965124418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:53.387860 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5c3584e3-324e-4fca-af14-d56965124418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1504 microversion: 2.1 time: 0.268044 May 19 04:32:53.388752 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 232/469] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:53 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:53.643923 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ce275b05-9f19-4808-bff2-61780c24e57b tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.529842 May 19 04:32:53.645101 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 238/470] 10.222.0.58 () {60 vars in 1312 bytes} [Thu May 19 04:32:53 2022] PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata/os_version => generated 31 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:53.650429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1be47522-47d4-41b4-82f8-c0f93364a66b req-d0212fa0-3632-407e-9cd8-4a5af0f00164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5", "tag": "73456bb4-887e-4a14-b2f8-54b8006ad0bc"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:53.673266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1be47522-47d4-41b4-82f8-c0f93364a66b req-d0212fa0-3632-407e-9cd8-4a5af0f00164 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:53.673766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1be47522-47d4-41b4-82f8-c0f93364a66b req-d0212fa0-3632-407e-9cd8-4a5af0f00164 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:53.685886 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1be47522-47d4-41b4-82f8-c0f93364a66b req-d0212fa0-3632-407e-9cd8-4a5af0f00164 service nova] Creating event network-changed:73456bb4-887e-4a14-b2f8-54b8006ad0bc for instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 on n-h1-766726-30 May 19 04:32:53.690710 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1be47522-47d4-41b4-82f8-c0f93364a66b req-d0212fa0-3632-407e-9cd8-4a5af0f00164 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044424 May 19 04:32:53.692456 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 239/471] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:53.712476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a3dbe1d-1ac5-485e-9bda-44e9e4c57a91 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Calling method '.version_select at 0x7fd316269940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:53.745332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac7f0ddd-c8a7-48c7-bea6-1a7b95638fd0 tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] Action: 'create', calling method: .version_select at 0x7fd31611c0d0>, body: {"security_group": {"name": "tempest-securitygroup-763726517", "description": "tempest-description-1644446598"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:53.786454 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a3dbe1d-1ac5-485e-9bda-44e9e4c57a91 tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 58 microversion: 2.1 time: 0.092394 May 19 04:32:53.787351 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 240/472] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:32:53 2022] GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 58 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:53.807011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a596f8ea-86d2-4ccb-a4f9-960f3dd0aaab tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Action: 'update_all', calling method: .version_select at 0x7fd316218670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:53.871528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a596f8ea-86d2-4ccb-a4f9-960f3dd0aaab tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:53.876738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a596f8ea-86d2-4ccb-a4f9-960f3dd0aaab tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for user 3fb8f70081a745c4ad33fb5f329abd06 and project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:54.106026 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac7f0ddd-c8a7-48c7-bea6-1a7b95638fd0 tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.713017 May 19 04:32:54.107254 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 233/473] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:32:53 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:54.115395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-14b467f7-e1e9-48e6-8a40-884d84abcb54 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:54.116117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-14b467f7-e1e9-48e6-8a40-884d84abcb54 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:54.132032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14b467f7-e1e9-48e6-8a40-884d84abcb54 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:54.137340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14b467f7-e1e9-48e6-8a40-884d84abcb54 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:54.138656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14b467f7-e1e9-48e6-8a40-884d84abcb54 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:54.139362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14b467f7-e1e9-48e6-8a40-884d84abcb54 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:54.323545 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a596f8ea-86d2-4ccb-a4f9-960f3dd0aaab tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 61 microversion: 2.1 time: 0.522711 May 19 04:32:54.329603 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 241/474] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:32:53 2022] PUT /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 61 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:32:54.334449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c8a0a5e-14a7-45e4-9bf4-8afa3dccd194 tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] Action: 'create', calling method: .version_select at 0x7fd316218160>, body: {"security_group": {"name": "tempest-securitygroup-194183245", "description": "tempest-description-1823990121"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:54.338206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-14b467f7-e1e9-48e6-8a40-884d84abcb54 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:54.346951 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-14b467f7-e1e9-48e6-8a40-884d84abcb54 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1323 microversion: 2.1 time: 0.236188 May 19 04:32:54.348133 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 234/475] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:54 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:54.352759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5c489cf-35c3-4877-bd87-3ca233f641e8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3161fa820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:54.401320 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e5c489cf-35c3-4877-bd87-3ca233f641e8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.052103 May 19 04:32:54.402673 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 235/476] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:32:54 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:54.408809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:54.409455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:54.416647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:54.417125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:54.418092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:54.418655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:54.562096 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c8a0a5e-14a7-45e4-9bf4-8afa3dccd194 tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.231355 May 19 04:32:54.562704 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 242/477] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:32:54 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:54.568373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31d35b6b-e624-464f-babf-9f426d0dc98e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Action: 'create', calling method: .version_select at 0x7fd3161bd040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:54.628172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-31d35b6b-e624-464f-babf-9f426d0dc98e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:32:54.633336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-31d35b6b-e624-464f-babf-9f426d0dc98e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Getting quotas for user 3fb8f70081a745c4ad33fb5f329abd06 and project fcbae7e0eb7642e5a83aea14828362ad. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:32:54.689297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:54.700052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:54.701595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:54.708201 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3c4353d2-0e64-4800-b172-3a432a4cf617 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1361 microversion: 2.25 time: 0.298796 May 19 04:32:54.710682 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 236/478] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:54 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:54.724760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33573c3d-8cdb-4e5c-930e-139350e235e8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:54.725427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33573c3d-8cdb-4e5c-930e-139350e235e8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:54.736700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33573c3d-8cdb-4e5c-930e-139350e235e8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:54.737179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33573c3d-8cdb-4e5c-930e-139350e235e8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:54.737952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33573c3d-8cdb-4e5c-930e-139350e235e8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:54.738427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33573c3d-8cdb-4e5c-930e-139350e235e8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:54.918779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-33573c3d-8cdb-4e5c-930e-139350e235e8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:54.928813 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-33573c3d-8cdb-4e5c-930e-139350e235e8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1504 microversion: 2.1 time: 0.213989 May 19 04:32:54.929432 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 237/479] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:54 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:55.042666 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-31d35b6b-e624-464f-babf-9f426d0dc98e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "POST /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 85 microversion: 2.1 time: 0.478123 May 19 04:32:55.043287 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 243/480] 10.222.0.58 () {60 vars in 1280 bytes} [Thu May 19 04:32:54 2022] POST /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 85 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:55.047900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8cc1b2d2-38ca-48bb-badc-415752a1fa88 req-1eb3dd94-ddf2-4e97-9e84-3174d5f6f18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cda3b3-b152-4744-9d5e-f4fd44b9eb2a", "name": "network-vif-plugged", "status": "completed", "tag": "4e7c80f2-af35-4f8c-b438-79c7270eb220"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:55.057281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8cc1b2d2-38ca-48bb-badc-415752a1fa88 req-1eb3dd94-ddf2-4e97-9e84-3174d5f6f18e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.057721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8cc1b2d2-38ca-48bb-badc-415752a1fa88 req-1eb3dd94-ddf2-4e97-9e84-3174d5f6f18e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.068383 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8cc1b2d2-38ca-48bb-badc-415752a1fa88 req-1eb3dd94-ddf2-4e97-9e84-3174d5f6f18e service nova] Creating event network-vif-plugged:4e7c80f2-af35-4f8c-b438-79c7270eb220 for instance 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a on n-h2-766726-30 May 19 04:32:55.073455 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8cc1b2d2-38ca-48bb-badc-415752a1fa88 req-1eb3dd94-ddf2-4e97-9e84-3174d5f6f18e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029005 May 19 04:32:55.074450 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 244/481] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:55.115404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7875e715-878b-44ec-9b30-c5b63a365104 tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] Action: 'create', calling method: .version_select at 0x7fd31611c430>, body: {"security_group": {"name": "tempest-securitygroup-1819510996", "description": "tempest-description-1758547466"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:55.135642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ce340949-c254-4718-bd73-a1a1ace38a96 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Calling method '.version_select at 0x7fd316294430>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:55.136572 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:55.136572 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:55.137771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce340949-c254-4718-bd73-a1a1ace38a96 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.138213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce340949-c254-4718-bd73-a1a1ace38a96 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.159951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce340949-c254-4718-bd73-a1a1ace38a96 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.161463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce340949-c254-4718-bd73-a1a1ace38a96 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.176622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce340949-c254-4718-bd73-a1a1ace38a96 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.177490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce340949-c254-4718-bd73-a1a1ace38a96 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.184298 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ce340949-c254-4718-bd73-a1a1ace38a96 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.108874 May 19 04:32:55.185127 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 245/482] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:55.191498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-659fdbdb-084d-48eb-a9d3-642ef7b9072e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] Calling method '.version_select at 0x7fd316294a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:55.237264 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-659fdbdb-084d-48eb-a9d3-642ef7b9072e tempest-ImagesMetadataTestJSON-344772732 tempest-ImagesMetadataTestJSON-344772732-project] 10.222.0.58 "GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata" status: 200 len: 85 microversion: 2.1 time: 0.050731 May 19 04:32:55.237827 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 246/483] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/images/3faaf9ae-54a3-441f-991d-cc337375a104/metadata => generated 85 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:32:55.376984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94679b3d-ade4-473a-9585-3a4950164249 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] Calling method '.version_select at 0x7fd316236670>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:55.378025 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:55.378025 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:55.379985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94679b3d-ade4-473a-9585-3a4950164249 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '4e2f3cc600224981a309c1e189b505d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e007b2c4fc41d6a9aecdb3e45f6ea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94679b3d-ade4-473a-9585-3a4950164249 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] Request method failure captured: May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-hypervisors/n-h2-766726-30/search HTTP/1.1 May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihch16WxHigF0ycdEo2ulmresxc0bxa0MujjHGviMpVKpIq8TKWBRx0WEVDy34rIm9Iftxt3BtzdjLYcXVaToXHZMGidQSGPpCj99FZbKQ1YIj3bWlBLW4Aw9Nlt1-KlwN2KcJZfb-L_Vegn7p0baEVSkf2sw1v5TF8Zv7IQfPYaYqZQ May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 84e007b2c4fc41d6a9aecdb3e45f6ea7 May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1732881712 May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:32:55.382002 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/84e007b2c4fc41d6a9aecdb3e45f6ea7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/84e007b2c4fc41d6a9aecdb3e45f6ea7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/84e007b2c4fc41d6a9aecdb3e45f6ea7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_84e007b2c4fc41d6a9aecdb3e45f6ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1732881712 May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 84e007b2c4fc41d6a9aecdb3e45f6ea7 May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1732881712 May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 4e2f3cc600224981a309c1e189b505d6 May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 19 04:32:55.383306 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'n-h2-766726-30'} May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:55.384016 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 19 04:32:55.385166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:32:55.386172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94679b3d-ade4-473a-9585-3a4950164249 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:55.386172 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94679b3d-ade4-473a-9585-3a4950164249 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h2-766726-30/search" status: 403 len: 117 microversion: 2.1 time: 0.143569 May 19 04:32:55.390034 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 247/484] 10.222.0.58 () {58 vars in 1211 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/os-hypervisors/n-h2-766726-30/search => generated 117 bytes in 152 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:55.395845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18c1f5cd-2529-461d-a2ab-a079b353d9b6 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:55.396574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-18c1f5cd-2529-461d-a2ab-a079b353d9b6 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:55.403257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18c1f5cd-2529-461d-a2ab-a079b353d9b6 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.403793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18c1f5cd-2529-461d-a2ab-a079b353d9b6 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.404955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18c1f5cd-2529-461d-a2ab-a079b353d9b6 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.405797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18c1f5cd-2529-461d-a2ab-a079b353d9b6 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.568962 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7875e715-878b-44ec-9b30-c5b63a365104 tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.637625 May 19 04:32:55.570146 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 238/485] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:32:54 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:55.574752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ad50aa4-3b3c-43c1-867f-fbaa6c1557b4 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Calling method '.version_select at 0x7fd31611cdc0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:55.575645 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:55.575645 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:55.577939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ad50aa4-3b3c-43c1-867f-fbaa6c1557b4 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.578694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ad50aa4-3b3c-43c1-867f-fbaa6c1557b4 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.603077 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-2ad50aa4-3b3c-43c1-867f-fbaa6c1557b4 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ad50aa4-3b3c-43c1-867f-fbaa6c1557b4 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Request method failure captured: May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihch2SA2TdQhr5PWJpuKtG_1uSQP0AkK9Up-xbJr-leeX5AamZN5n7wrcszVcqRodpCEd2BuOZKrr1ML9batMAeu7Fsw3nDZ2ymOZIus-Wx8Vgr6AM4OGtgIEeq8Dn61w57eql0XxfaZRsiwtDZJu96XUCuCqxarJm5AIzifke4Pp-cU May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 544755436ad54f158b1cc3d81140d3e3 May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1519856370 May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:55.604766 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/544755436ad54f158b1cc3d81140d3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/544755436ad54f158b1cc3d81140d3e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/544755436ad54f158b1cc3d81140d3e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_544755436ad54f158b1cc3d81140d3e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1519856370 May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 544755436ad54f158b1cc3d81140d3e3 May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1519856370 May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd2a5a5a54384ca9bfc431d7276debf6 May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 19 04:32:55.606361 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'nonexistent_hypervisor_name'} May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:55.607126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:55.608231 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:55.608231 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:55.608231 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:55.608231 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 19 04:32:55.608231 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:55.609639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ad50aa4-3b3c-43c1-867f-fbaa6c1557b4 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:55.610691 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ad50aa4-3b3c-43c1-867f-fbaa6c1557b4 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.039443 May 19 04:32:55.611448 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 239/486] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:55.616704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d2aac99f-1c5c-4c51-aae0-bb6142d403a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd31629be50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:55.677214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-18c1f5cd-2529-461d-a2ab-a079b353d9b6 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:55.681440 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d2aac99f-1c5c-4c51-aae0-bb6142d403a4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.068374 May 19 04:32:55.682169 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 240/487] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:55.690157 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18c1f5cd-2529-461d-a2ab-a079b353d9b6 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1323 microversion: 2.1 time: 0.298780 May 19 04:32:55.690922 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 248/488] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1323 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:55.696110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-06ae9bfe-ac5f-4c59-ad43-f8677ae93c02 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Calling method '.version_select at 0x7fd3162940d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:55.696867 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:55.696867 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:32:55.698151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06ae9bfe-ac5f-4c59-ad43-f8677ae93c02 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.698593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06ae9bfe-ac5f-4c59-ad43-f8677ae93c02 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.701682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79dff7c8-812a-43e4-9eb6-f36c2f6ba296 tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] Action: 'create', calling method: .version_select at 0x7fd316503820>, body: {"security_group": {"name": "tempest-securitygroup-248047584", "description": "tempest-description-1980921745"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:55.723916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06ae9bfe-ac5f-4c59-ad43-f8677ae93c02 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.724508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06ae9bfe-ac5f-4c59-ad43-f8677ae93c02 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.741168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06ae9bfe-ac5f-4c59-ad43-f8677ae93c02 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.742044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06ae9bfe-ac5f-4c59-ad43-f8677ae93c02 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.751555 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-06ae9bfe-ac5f-4c59-ad43-f8677ae93c02 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.057984 May 19 04:32:55.754243 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 249/489] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:55.767268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:55.768172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:55.775708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.776579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.777489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:55.778102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:55.967088 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79dff7c8-812a-43e4-9eb6-f36c2f6ba296 tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.278733 May 19 04:32:55.967691 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 241/490] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:32:55 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:55.977005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c05980be-f458-436c-aed3-dd8e3162bb41 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] Calling method '.version_select at 0x7fd31629bee0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:55.977830 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:55.977830 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:55.979178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c05980be-f458-436c-aed3-dd8e3162bb41 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '4e2f3cc600224981a309c1e189b505d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e007b2c4fc41d6a9aecdb3e45f6ea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c05980be-f458-436c-aed3-dd8e3162bb41 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] Request method failure captured: May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihch16WxHigF0ycdEo2ulmresxc0bxa0MujjHGviMpVKpIq8TKWBRx0WEVDy34rIm9Iftxt3BtzdjLYcXVaToXHZMGidQSGPpCj99FZbKQ1YIj3bWlBLW4Aw9Nlt1-KlwN2KcJZfb-L_Vegn7p0baEVSkf2sw1v5TF8Zv7IQfPYaYqZQ May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 84e007b2c4fc41d6a9aecdb3e45f6ea7 May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1732881712 May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:55.980893 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/84e007b2c4fc41d6a9aecdb3e45f6ea7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/84e007b2c4fc41d6a9aecdb3e45f6ea7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/84e007b2c4fc41d6a9aecdb3e45f6ea7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_84e007b2c4fc41d6a9aecdb3e45f6ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1732881712 May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 84e007b2c4fc41d6a9aecdb3e45f6ea7 May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1732881712 May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 4e2f3cc600224981a309c1e189b505d6 May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 19 04:32:55.982559 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '1'} May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:55.983664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 19 04:32:55.984936 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:55.988089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c05980be-f458-436c-aed3-dd8e3162bb41 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:55.988089 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c05980be-f458-436c-aed3-dd8e3162bb41 tempest-HypervisorAdminNegativeUnderV252Test-1732881712 tempest-HypervisorAdminNegativeUnderV252Test-1732881712-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.013674 May 19 04:32:55.988089 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 242/491] 10.222.0.58 () {58 vars in 1175 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:55.996865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c54a4ba1-f4ed-45fe-9919-a1c6ebe33afb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:56.006189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:56.011770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c54a4ba1-f4ed-45fe-9919-a1c6ebe33afb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:56.019266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:56.020378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c54a4ba1-f4ed-45fe-9919-a1c6ebe33afb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:56.021276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c54a4ba1-f4ed-45fe-9919-a1c6ebe33afb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:56.022554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c54a4ba1-f4ed-45fe-9919-a1c6ebe33afb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:56.023193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:56.023515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c54a4ba1-f4ed-45fe-9919-a1c6ebe33afb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:56.025091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-256a9d62-2f39-432b-ae0e-b07e05821859 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1361 microversion: 2.25 time: 0.263085 May 19 04:32:56.029719 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 250/492] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:56.041409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d7a41a11-6f7f-40af-a4b2-355742c4ac00 tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] Calling method '.version_select at 0x7fd316218430>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:56.242489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c54a4ba1-f4ed-45fe-9919-a1c6ebe33afb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:56.253240 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c54a4ba1-f4ed-45fe-9919-a1c6ebe33afb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1504 microversion: 2.1 time: 0.269424 May 19 04:32:56.255160 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 243/493] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:55 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:56.262465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66e10265-75b9-40a9-94a2-267f3cc73e20 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Calling method '.version_select at 0x7fd316280dc0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:56.264060 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:32:56.264060 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:32:56.266000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66e10265-75b9-40a9-94a2-267f3cc73e20 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:56.267248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66e10265-75b9-40a9-94a2-267f3cc73e20 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:56.275268 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-66e10265-75b9-40a9-94a2-267f3cc73e20 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] HTTP exception thrown: No hypervisor matching 'a00b99fb-ea1e-4554-9858-0372b1d737f9' could be found. May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66e10265-75b9-40a9-94a2-267f3cc73e20 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Request method failure captured: May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-hypervisors/a00b99fb-ea1e-4554-9858-0372b1d737f9/servers HTTP/1.1 May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihch2SA2TdQhr5PWJpuKtG_1uSQP0AkK9Up-xbJr-leeX5AamZN5n7wrcszVcqRodpCEd2BuOZKrr1ML9batMAeu7Fsw3nDZ2ymOZIus-Wx8Vgr6AM4OGtgIEeq8Dn61w57eql0XxfaZRsiwtDZJu96XUCuCqxarJm5AIzifke4Pp-cU May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 544755436ad54f158b1cc3d81140d3e3 May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1519856370 May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:32:56.277555 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/544755436ad54f158b1cc3d81140d3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/544755436ad54f158b1cc3d81140d3e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/544755436ad54f158b1cc3d81140d3e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_544755436ad54f158b1cc3d81140d3e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1519856370 May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 544755436ad54f158b1cc3d81140d3e3 May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1519856370 May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd2a5a5a54384ca9bfc431d7276debf6 May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: exception: No hypervisor matching 'a00b99fb-ea1e-4554-9858-0372b1d737f9' could be found. May 19 04:32:56.278791 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'a00b99fb-ea1e-4554-9858-0372b1d737f9'} May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a00b99fb-ea1e-4554-9858-0372b1d737f9' could be found. May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:56.279664 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:56.280712 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:56.280712 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:56.280712 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:32:56.280712 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:32:56.280712 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a00b99fb-ea1e-4554-9858-0372b1d737f9' could be found. May 19 04:32:56.280712 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:56.282652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66e10265-75b9-40a9-94a2-267f3cc73e20 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] Returning 404 to user: No hypervisor matching 'a00b99fb-ea1e-4554-9858-0372b1d737f9' could be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:56.283830 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-66e10265-75b9-40a9-94a2-267f3cc73e20 tempest-HypervisorAdminNegativeUnderV252Test-1519856370 tempest-HypervisorAdminNegativeUnderV252Test-1519856370-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/a00b99fb-ea1e-4554-9858-0372b1d737f9/servers" status: 404 len: 123 microversion: 2.1 time: 0.027344 May 19 04:32:56.284851 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 244/494] 10.222.0.58 () {58 vars in 1280 bytes} [Thu May 19 04:32:56 2022] GET /compute/v2.1/os-hypervisors/a00b99fb-ea1e-4554-9858-0372b1d737f9/servers => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:56.695415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd9c702d-f463-4ab7-9416-eb483419964c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3161fa550>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:56.769954 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd9c702d-f463-4ab7-9416-eb483419964c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.077200 May 19 04:32:56.772513 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 245/495] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:32:56 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:32:56.791264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0d610e16-21f5-4aba-9fd8-4204ac510427 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:56.792371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0d610e16-21f5-4aba-9fd8-4204ac510427 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:56.822223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d610e16-21f5-4aba-9fd8-4204ac510427 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:56.824863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d610e16-21f5-4aba-9fd8-4204ac510427 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:56.826123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d610e16-21f5-4aba-9fd8-4204ac510427 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:56.828117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d610e16-21f5-4aba-9fd8-4204ac510427 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:57.397568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=13 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:57.749697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0d610e16-21f5-4aba-9fd8-4204ac510427 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:57.757693 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0d610e16-21f5-4aba-9fd8-4204ac510427 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1473 microversion: 2.1 time: 0.981392 May 19 04:32:57.761138 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 246/496] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:56 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1473 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:57.770516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:57.771250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:57.792571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:57.793137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:57.794021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:57.794517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:58.093240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:58.102416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:58.103913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:58.105031 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e80b740b-55c2-4841-adb6-878be11a707d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1361 microversion: 2.25 time: 0.342829 May 19 04:32:58.108833 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 247/497] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:57 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1361 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:32:58.123169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5e1a2196-eeb9-4e5d-bf51-10a394770364 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:58.124050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5e1a2196-eeb9-4e5d-bf51-10a394770364 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:58.140611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e1a2196-eeb9-4e5d-bf51-10a394770364 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:58.142021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e1a2196-eeb9-4e5d-bf51-10a394770364 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:58.142988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e1a2196-eeb9-4e5d-bf51-10a394770364 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:58.143589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e1a2196-eeb9-4e5d-bf51-10a394770364 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:58.451219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5e1a2196-eeb9-4e5d-bf51-10a394770364 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:58.465527 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5e1a2196-eeb9-4e5d-bf51-10a394770364 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1494 microversion: 2.1 time: 0.350029 May 19 04:32:58.466542 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 248/498] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:58 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1494 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:58.472822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:58.478363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:58.491471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:58.500228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:58.501190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:58.504442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:58.534120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:58.551181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Request method failure captured: May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a/diagnostics HTTP/1.1 May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchpjnor6kfW6ZrpfrNU1Q9q9NAJ9jNKEfOuEDz_pY8Zf0YGDdrYER6GnsWKvlWDXS6DjwWdHCc5LlUparoXrTSA0X6OWKPyMf13MlNxlOXdLk-_ExKGpp-giCY7ahKcJ2Tf-xi2_unLUVnLN1_fRXNoj1YTBu4CIgoVi5ZbcApW7fo May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 4c10356deaaf4ae9ae770bc357a19653 May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1726388172 May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:32:58.553331 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4c10356deaaf4ae9ae770bc357a19653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4c10356deaaf4ae9ae770bc357a19653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4c10356deaaf4ae9ae770bc357a19653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4c10356deaaf4ae9ae770bc357a19653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1726388172 May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 4c10356deaaf4ae9ae770bc357a19653 May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1726388172 May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerDiagnosticsNegativeTest-1726388172-project May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c9244ac0fd02470f98baf4ae2926a757 May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1726388172-project May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:32:58.554677 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'server_id': '84cda3b3-b152-4744-9d5e-f4fd44b9eb2a'} May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:32:58.555378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 19 04:32:58.556838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:32:58.560620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:32:58.561781 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0e4791c9-0ab8-44b7-ba8e-a7428d14022f tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.093583 May 19 04:32:58.562587 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 249/499] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:32:58 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a/diagnostics => generated 117 bytes in 95 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:32:58.568240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97b5bda4-c147-4f69-b0c2-3fa6e52aa99b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3161e5ee0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:58.630010 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97b5bda4-c147-4f69-b0c2-3fa6e52aa99b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.065412 May 19 04:32:58.630823 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 250/500] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:32:58 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:58.637362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb1435ef-2f33-47c5-a14a-c0436586a8c1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '.version_select at 0x7fd316124f70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:58.645862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb1435ef-2f33-47c5-a14a-c0436586a8c1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:58.646532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb1435ef-2f33-47c5-a14a-c0436586a8c1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:58.689344 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fb1435ef-2f33-47c5-a14a-c0436586a8c1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 790 microversion: 2.1 time: 0.052094 May 19 04:32:58.695343 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 251/501] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:32:58 2022] GET /compute/v2.1/os-migrations => generated 790 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:58.708650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be2a7b44-9ca8-4e09-883c-431c987a5a05 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:58.709192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be2a7b44-9ca8-4e09-883c-431c987a5a05 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:58.718425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be2a7b44-9ca8-4e09-883c-431c987a5a05 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:58.719163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be2a7b44-9ca8-4e09-883c-431c987a5a05 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:58.720985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be2a7b44-9ca8-4e09-883c-431c987a5a05 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:58.721826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be2a7b44-9ca8-4e09-883c-431c987a5a05 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:58.760146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be2a7b44-9ca8-4e09-883c-431c987a5a05 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:32:58.930748 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be2a7b44-9ca8-4e09-883c-431c987a5a05 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "DELETE /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 204 len: 0 microversion: 2.1 time: 0.230401 May 19 04:32:58.931645 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 252/502] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:32:58 2022] DELETE /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:32:58.952228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9fbba431-b1f0-4b60-b12d-45d7f8d01aa7 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:58.955496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9fbba431-b1f0-4b60-b12d-45d7f8d01aa7 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:58.972009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fbba431-b1f0-4b60-b12d-45d7f8d01aa7 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:58.975013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fbba431-b1f0-4b60-b12d-45d7f8d01aa7 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:58.976018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fbba431-b1f0-4b60-b12d-45d7f8d01aa7 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:58.976538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fbba431-b1f0-4b60-b12d-45d7f8d01aa7 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:59.203161 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9fbba431-b1f0-4b60-b12d-45d7f8d01aa7 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1647 microversion: 2.1 time: 0.266431 May 19 04:32:59.204040 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 253/503] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:58 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1647 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:59.234246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-60fe5360-f75e-4ca6-88a4-b459c80aee2d req-fd48284b-2fb1-4251-b9b5-5125386df599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae6a03f-375c-4b42-8544-59df1ba8cef5", "name": "network-vif-plugged", "status": "completed", "tag": "d3dc1818-db8c-4b28-b68c-3ab4103e42d9"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:32:59.258182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-60fe5360-f75e-4ca6-88a4-b459c80aee2d req-fd48284b-2fb1-4251-b9b5-5125386df599 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:59.258991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-60fe5360-f75e-4ca6-88a4-b459c80aee2d req-fd48284b-2fb1-4251-b9b5-5125386df599 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:59.283088 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-60fe5360-f75e-4ca6-88a4-b459c80aee2d req-fd48284b-2fb1-4251-b9b5-5125386df599 service nova] Creating event network-vif-plugged:d3dc1818-db8c-4b28-b68c-3ab4103e42d9 for instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 on n-h2-766726-30 May 19 04:32:59.293180 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-60fe5360-f75e-4ca6-88a4-b459c80aee2d req-fd48284b-2fb1-4251-b9b5-5125386df599 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074311 May 19 04:32:59.297160 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 254/504] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:32:59.309233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a2013744-8d25-4e44-a604-c850fd4d8ba7 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:59.310504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a2013744-8d25-4e44-a604-c850fd4d8ba7 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:59.331096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2013744-8d25-4e44-a604-c850fd4d8ba7 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:59.331878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2013744-8d25-4e44-a604-c850fd4d8ba7 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:59.333659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2013744-8d25-4e44-a604-c850fd4d8ba7 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:59.336057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2013744-8d25-4e44-a604-c850fd4d8ba7 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:59.486239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=15 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:32:59.637391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a2013744-8d25-4e44-a604-c850fd4d8ba7 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:32:59.643697 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a2013744-8d25-4e44-a604-c850fd4d8ba7 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1479 microversion: 2.1 time: 0.345069 May 19 04:32:59.644306 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 255/505] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:32:59 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1479 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:32:59.663191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:32:59.664093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:32:59.672364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:59.673197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:59.673883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:32:59.674350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:32:59.872030 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d7a41a11-6f7f-40af-a4b2-355742c4ac00 tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10369 microversion: 2.1 time: 3.840312 May 19 04:32:59.873042 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 251/506] 10.222.0.58 () {58 vars in 1190 bytes} [Thu May 19 04:32:56 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10369 bytes in 3843 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:32:59.879979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-898400656", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "46fb63e9-6b42-4dee-8db7-bccbd0d35392"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:00.021001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:00.035258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:00.037541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:00.039485 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1bf9870-a450-4213-9a4b-87086ae6d449 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1361 microversion: 2.25 time: 0.380347 May 19 04:33:00.040574 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 256/507] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:32:59 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1361 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:00.045794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cd21eb78-d6e9-4e1e-9624-835c3d4e2034 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd31629b670>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:00.202001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] validate_networks() for [('46fb63e9-6b42-4dee-8db7-bccbd0d35392', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:33:00.218034 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cd21eb78-d6e9-4e1e-9624-835c3d4e2034 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.175814 May 19 04:33:00.218617 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 257/508] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:00 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:00.234362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f1686a3-058b-456d-9615-c738387e2d0a tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] Calling method '.version_select at 0x7fd316247f70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:00.633945 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f1686a3-058b-456d-9615-c738387e2d0a tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.413967 May 19 04:33:00.634764 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 258/509] 10.222.0.58 () {58 vars in 1190 bytes} [Thu May 19 04:33:00 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:00.639955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-52f8b59d-9d6a-49e6-b5c3-8ff66c001151 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316138b80>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:00.716747 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-52f8b59d-9d6a-49e6-b5c3-8ff66c001151 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/00cdb173-5241-4b28-a721-aa30e4aae5e8" status: 200 len: 661 microversion: 2.1 time: 0.080739 May 19 04:33:00.717402 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 259/510] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:00 2022] GET /compute/v2.1/images/00cdb173-5241-4b28-a721-aa30e4aae5e8 => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:00.730266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-71303ad9-449d-4490-a85b-f7613fb1221c tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] Calling method '.version_select at 0x7fd3160d75e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:00.979176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:00.980806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:00.981511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:00.982750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:00.986675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:00.999445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:01.000211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:01.001834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:01.002436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:01.031699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Getting quotas for project b2425f9ddc1548958d45215e83aed84e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:01.046057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Getting quotas for user 75f651a13b474f09aa3877d1d66b8fc5 and project b2425f9ddc1548958d45215e83aed84e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:01.059043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:01.061861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:01.077602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:01.157951 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-17db9e14-b906-4e5e-ab74-b3938e933dbe tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283430 May 19 04:33:01.158924 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 252/511] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:32:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:33:01.171581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71585a0f-e80e-43d3-bad4-70f449467531 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:01.172612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-71585a0f-e80e-43d3-bad4-70f449467531 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:01.183225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71585a0f-e80e-43d3-bad4-70f449467531 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:01.183678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71585a0f-e80e-43d3-bad4-70f449467531 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:01.184468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71585a0f-e80e-43d3-bad4-70f449467531 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:01.184909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71585a0f-e80e-43d3-bad4-70f449467531 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:01.228238 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-71303ad9-449d-4490-a85b-f7613fb1221c tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/6e7abfdf-ce59-4785-8e1b-29e6e4fcdb21" status: 202 len: 0 microversion: 2.1 time: 0.509429 May 19 04:33:01.229862 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 260/512] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:33:00 2022] DELETE /compute/v2.1/os-security-groups/6e7abfdf-ce59-4785-8e1b-29e6e4fcdb21 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:33:01.236869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6a766db4-1060-4fcf-aa01-7f4fa317c4a5 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3161bd9d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:01.322709 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6a766db4-1060-4fcf-aa01-7f4fa317c4a5 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/00cdb173-5241-4b28-a721-aa30e4aae5e8" status: 200 len: 661 microversion: 2.1 time: 0.091560 May 19 04:33:01.323447 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 261/513] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:01 2022] GET /compute/v2.1/images/00cdb173-5241-4b28-a721-aa30e4aae5e8 => generated 661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:01.344531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:01.348796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:01.351695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-71585a0f-e80e-43d3-bad4-70f449467531 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9244ac0fd02470f98baf4ae2926a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c10356deaaf4ae9ae770bc357a19653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:01.361179 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-71585a0f-e80e-43d3-bad4-70f449467531 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 200 len: 1437 microversion: 2.1 time: 0.200963 May 19 04:33:01.364743 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 253/514] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:01 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 1437 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:01.379593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:01.380898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:01.381898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:01.382588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:01.389339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-134e763a-5466-4820-8b1e-4167851b9279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:01.389961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-134e763a-5466-4820-8b1e-4167851b9279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:01.559374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-134e763a-5466-4820-8b1e-4167851b9279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:01.567711 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-134e763a-5466-4820-8b1e-4167851b9279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1210 microversion: 2.1 time: 0.196164 May 19 04:33:01.570831 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 254/515] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:01 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1210 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:01.576824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bbfd255b-7e5e-4385-be0f-69cb2dbe6a49 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd31634b670>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:01.655729 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bbfd255b-7e5e-4385-be0f-69cb2dbe6a49 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.083537 May 19 04:33:01.656492 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 255/516] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:01 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:01.670994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27d6908c-2e56-4a73-b643-51e4da2da492 tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] Calling method '.version_select at 0x7fd316263040>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:01.716815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:01.726393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:01.727904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:01.729040 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed63d7df-d825-4abc-b9fc-5172c3ee6459 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1361 microversion: 2.25 time: 0.404520 May 19 04:33:01.741430 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 262/517] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:01 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1361 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:01.746396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-289610db-f099-48b6-8134-ee3e34427428 req-9eb305c2-9c79-4353-81b0-a1918aef3300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5", "name": "network-vif-plugged", "status": "completed", "tag": "73456bb4-887e-4a14-b2f8-54b8006ad0bc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:01.775622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-289610db-f099-48b6-8134-ee3e34427428 req-9eb305c2-9c79-4353-81b0-a1918aef3300 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:01.776089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-289610db-f099-48b6-8134-ee3e34427428 req-9eb305c2-9c79-4353-81b0-a1918aef3300 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:01.815633 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-289610db-f099-48b6-8134-ee3e34427428 req-9eb305c2-9c79-4353-81b0-a1918aef3300 service nova] Creating event network-vif-plugged:73456bb4-887e-4a14-b2f8-54b8006ad0bc for instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 on n-h1-766726-30 May 19 04:33:01.837919 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-289610db-f099-48b6-8134-ee3e34427428 req-9eb305c2-9c79-4353-81b0-a1918aef3300 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092633 May 19 04:33:01.838588 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 263/518] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:01.846548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-afd770b9-a40b-4b0f-9a0f-5a1cfcf79115 req-fd221cb5-ebfb-47f8-9d2c-b2562453b210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cda3b3-b152-4744-9d5e-f4fd44b9eb2a", "name": "network-vif-deleted", "tag": "4e7c80f2-af35-4f8c-b438-79c7270eb220"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:01.873863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-afd770b9-a40b-4b0f-9a0f-5a1cfcf79115 req-fd221cb5-ebfb-47f8-9d2c-b2562453b210 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:01.880545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-afd770b9-a40b-4b0f-9a0f-5a1cfcf79115 req-fd221cb5-ebfb-47f8-9d2c-b2562453b210 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:01.922043 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-afd770b9-a40b-4b0f-9a0f-5a1cfcf79115 req-fd221cb5-ebfb-47f8-9d2c-b2562453b210 service nova] Creating event network-vif-deleted:4e7c80f2-af35-4f8c-b438-79c7270eb220 for instance 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a on n-h2-766726-30 May 19 04:33:01.938695 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-afd770b9-a40b-4b0f-9a0f-5a1cfcf79115 req-fd221cb5-ebfb-47f8-9d2c-b2562453b210 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096019 May 19 04:33:01.939297 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 264/519] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:02.115402 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27d6908c-2e56-4a73-b643-51e4da2da492 tempest-SecurityGroupsTestAdminJSON-890171071 tempest-SecurityGroupsTestAdminJSON-890171071-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/4f982d5f-3cb2-4630-b3ad-e1ba2e288c60" status: 202 len: 0 microversion: 2.1 time: 0.457626 May 19 04:33:02.117511 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 256/520] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:33:01 2022] DELETE /compute/v2.1/os-security-groups/4f982d5f-3cb2-4630-b3ad-e1ba2e288c60 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:33:02.127367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79abc508-8d29-4a9a-a4b3-ee7f85d2a569 tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] Calling method '.version_select at 0x7fd31629b160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:02.206196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=34 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:02.385543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:02.386217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] [instance: 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:02.396199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:02.403274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:02.405117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:02.407044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:02.453064 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] HTTP exception thrown: Instance 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a could not be found. May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Request method failure captured: May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a HTTP/1.1 May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchpjnor6kfW6ZrpfrNU1Q9q9NAJ9jNKEfOuEDz_pY8Zf0YGDdrYER6GnsWKvlWDXS6DjwWdHCc5LlUparoXrTSA0X6OWKPyMf13MlNxlOXdLk-_ExKGpp-giCY7ahKcJ2Tf-xi2_unLUVnLN1_fRXNoj1YTBu4CIgoVi5ZbcApW7fo May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 4c10356deaaf4ae9ae770bc357a19653 May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1726388172 May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:33:02.457318 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4c10356deaaf4ae9ae770bc357a19653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4c10356deaaf4ae9ae770bc357a19653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4c10356deaaf4ae9ae770bc357a19653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4c10356deaaf4ae9ae770bc357a19653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1726388172 May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 4c10356deaaf4ae9ae770bc357a19653 May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1726388172 May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerDiagnosticsNegativeTest-1726388172-project May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: c9244ac0fd02470f98baf4ae2926a757 May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1726388172-project May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a could not be found. May 19 04:33:02.459456 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '84cda3b3-b152-4744-9d5e-f4fd44b9eb2a'} May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a could not be found. May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:33:02.460332 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a could not be found. May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a could not be found. May 19 04:33:02.461722 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:02.464526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] Returning 404 to user: Instance 84cda3b3-b152-4744-9d5e-f4fd44b9eb2a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:33:02.468738 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4b8688ba-6495-480b-9849-4e736c7ef750 tempest-ServerDiagnosticsNegativeTest-1726388172 tempest-ServerDiagnosticsNegativeTest-1726388172-project] 10.222.0.58 "GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a" status: 404 len: 111 microversion: 2.1 time: 0.088886 May 19 04:33:02.481061 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 257/521] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:02 2022] GET /compute/v2.1/servers/84cda3b3-b152-4744-9d5e-f4fd44b9eb2a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:33:02.599289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c2ae651-cb3b-4341-bee1-92d20053824b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:02.600032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c2ae651-cb3b-4341-bee1-92d20053824b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:02.610289 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79abc508-8d29-4a9a-a4b3-ee7f85d2a569 tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/13c8bc1c-9c1a-4e21-9fed-117f56e9ac22" status: 202 len: 0 microversion: 2.1 time: 0.488454 May 19 04:33:02.612470 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 265/522] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:33:02 2022] DELETE /compute/v2.1/os-security-groups/13c8bc1c-9c1a-4e21-9fed-117f56e9ac22 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:33:02.627423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c2ae651-cb3b-4341-bee1-92d20053824b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:02.627876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c2ae651-cb3b-4341-bee1-92d20053824b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:02.628965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c2ae651-cb3b-4341-bee1-92d20053824b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:02.629430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c2ae651-cb3b-4341-bee1-92d20053824b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:02.642671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a0338dc-441c-4827-9fb1-c2af3e78760e tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] Calling method '.version_select at 0x7fd3160d7160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:02.800096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c2ae651-cb3b-4341-bee1-92d20053824b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:02.817775 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c2ae651-cb3b-4341-bee1-92d20053824b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1206 microversion: 2.1 time: 0.223124 May 19 04:33:02.819846 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 258/523] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:02 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1206 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:33:03.098382 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a0338dc-441c-4827-9fb1-c2af3e78760e tempest-SecurityGroupsTestAdminJSON-1518289832 tempest-SecurityGroupsTestAdminJSON-1518289832-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/87475f68-84ee-4834-8d0d-ef1c471cc0b7" status: 202 len: 0 microversion: 2.1 time: 0.478350 May 19 04:33:03.106012 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 266/524] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:33:02 2022] DELETE /compute/v2.1/os-security-groups/87475f68-84ee-4834-8d0d-ef1c471cc0b7 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:33:03.112713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a448d956-33cc-4afb-9351-6f244b95f412 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3160c6040>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:03.471201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8471e45f-be5e-48dc-88e6-574109dc400a tempest-InstanceUsageAuditLogTestJSON-1359358456 tempest-InstanceUsageAuditLogTestJSON-1359358456-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:03.472088 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:33:03.472088 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:33:03.497138 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8471e45f-be5e-48dc-88e6-574109dc400a tempest-InstanceUsageAuditLogTestJSON-1359358456 tempest-InstanceUsageAuditLogTestJSON-1359358456-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19 04:33:02" status: 200 len: 318 microversion: 2.1 time: 0.674608 May 19 04:33:03.498402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 259/525] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:33:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19%2004%3A33%3A02 => generated 318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:03.503994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:03.504864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:03.511306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:03.512116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:03.514002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:03.515075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:03.805695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:03.817407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:03.822681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:03.823926 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c02d9e6b-c41e-4012-9678-6f120be8497e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1361 microversion: 2.25 time: 0.324372 May 19 04:33:03.825054 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 260/526] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:03 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:03.838492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b91ee4a-ea8a-4db6-be32-dc2cd338cc13 tempest-InstanceUsageAuditLogTestJSON-1359358456 tempest-InstanceUsageAuditLogTestJSON-1359358456-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:03.839717 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:33:03.839717 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:33:03.863413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a448d956-33cc-4afb-9351-6f244b95f412 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.755399 May 19 04:33:03.870168 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 267/527] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:03 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:03.872273 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7b91ee4a-ea8a-4db6-be32-dc2cd338cc13 tempest-InstanceUsageAuditLogTestJSON-1359358456 tempest-InstanceUsageAuditLogTestJSON-1359358456-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.045864 May 19 04:33:03.873359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a23484a8-d59a-4151-9ba7-f44f407c596a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31611c940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:03.875018 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 261/528] 10.222.0.58 () {58 vars in 1184 bytes} [Thu May 19 04:33:03 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:03.887535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b264d7ff-aeaf-4d47-aff7-f05c74c5adac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:03.888445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b264d7ff-aeaf-4d47-aff7-f05c74c5adac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:03.905978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b264d7ff-aeaf-4d47-aff7-f05c74c5adac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:03.906791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b264d7ff-aeaf-4d47-aff7-f05c74c5adac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:03.908222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b264d7ff-aeaf-4d47-aff7-f05c74c5adac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:03.913740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b264d7ff-aeaf-4d47-aff7-f05c74c5adac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:03.945346 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a23484a8-d59a-4151-9ba7-f44f407c596a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/4f97d090-dd38-4df6-80b5-07be1f03a058" status: 200 len: 661 microversion: 2.1 time: 0.077665 May 19 04:33:03.954497 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 268/529] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:03 2022] GET /compute/v2.1/images/4f97d090-dd38-4df6-80b5-07be1f03a058 => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:03.962556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc637efc-69b4-4404-bc78-b1f96cd8056d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3160c6a60>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:04.018443 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc637efc-69b4-4404-bc78-b1f96cd8056d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/4f97d090-dd38-4df6-80b5-07be1f03a058" status: 200 len: 661 microversion: 2.1 time: 0.062232 May 19 04:33:04.020214 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 269/530] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:03 2022] GET /compute/v2.1/images/4f97d090-dd38-4df6-80b5-07be1f03a058 => generated 661 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:04.031868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b264d7ff-aeaf-4d47-aff7-f05c74c5adac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:04.040269 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b264d7ff-aeaf-4d47-aff7-f05c74c5adac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1270 microversion: 2.1 time: 0.161223 May 19 04:33:04.047175 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 262/531] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:03 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:04.846314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:04.848054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:04.872739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:04.875067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:04.880406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-405cc916-21c9-4058-a909-a9c723407f6c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316269c10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:04.881651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:04.882671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:04.973811 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-405cc916-21c9-4058-a909-a9c723407f6c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.098861 May 19 04:33:04.974697 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 263/532] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:04 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:05.058154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4956ba4-8918-4c89-b9fd-12ca997cb30b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:05.059142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c4956ba4-8918-4c89-b9fd-12ca997cb30b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:05.073864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4956ba4-8918-4c89-b9fd-12ca997cb30b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:05.074570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4956ba4-8918-4c89-b9fd-12ca997cb30b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:05.078926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4956ba4-8918-4c89-b9fd-12ca997cb30b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:05.079690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4956ba4-8918-4c89-b9fd-12ca997cb30b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:05.494913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:05.517920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:05.520807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:05.528644 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5636033d-51c3-4b63-a580-519057fac3d6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1557 microversion: 2.25 time: 0.689952 May 19 04:33:05.530482 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 270/533] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:04 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1557 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:05.554396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c7310ae9-1dc3-4451-a76b-242636f82b53 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:05.554937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c7310ae9-1dc3-4451-a76b-242636f82b53 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:05.567642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7310ae9-1dc3-4451-a76b-242636f82b53 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:05.568099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7310ae9-1dc3-4451-a76b-242636f82b53 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:05.568885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7310ae9-1dc3-4451-a76b-242636f82b53 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:05.569353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7310ae9-1dc3-4451-a76b-242636f82b53 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:05.588801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c4956ba4-8918-4c89-b9fd-12ca997cb30b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:05.593063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:05.602370 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c4956ba4-8918-4c89-b9fd-12ca997cb30b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1310 microversion: 2.1 time: 0.548241 May 19 04:33:05.621162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 264/534] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:05 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1310 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:05.989412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-80b0d3b4-c771-4d52-afc7-947c51e57f48 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316269b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:06.089465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-c7310ae9-1dc3-4451-a76b-242636f82b53 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:06.120090 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c7310ae9-1dc3-4451-a76b-242636f82b53 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 2051 microversion: 2.25 time: 0.571816 May 19 04:33:06.121203 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 271/535] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:05 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 2051 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:33:06.138834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7b3f8216-c9e8-40d4-ba84-a6cb167a2f9e tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:06.144401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7b3f8216-c9e8-40d4-ba84-a6cb167a2f9e tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:06.161848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b3f8216-c9e8-40d4-ba84-a6cb167a2f9e tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:06.163420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b3f8216-c9e8-40d4-ba84-a6cb167a2f9e tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:06.165906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b3f8216-c9e8-40d4-ba84-a6cb167a2f9e tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:06.166882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b3f8216-c9e8-40d4-ba84-a6cb167a2f9e tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:06.385157 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-80b0d3b4-c771-4d52-afc7-947c51e57f48 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.401080 May 19 04:33:06.391216 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 265/536] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:05 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:33:06.397520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad07fdcf-0055-44cd-a79f-6ba2304c6adc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3161bd280>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:06.483747 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad07fdcf-0055-44cd-a79f-6ba2304c6adc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/a0c085f2-9d7c-450f-9d78-a846d47400fc" status: 200 len: 662 microversion: 2.1 time: 0.094956 May 19 04:33:06.485237 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 266/537] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:06 2022] GET /compute/v2.1/images/a0c085f2-9d7c-450f-9d78-a846d47400fc => generated 662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:06.505324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d39bf416-4f33-4857-a64f-cceda6ae8795 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316294a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:06.586255 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d39bf416-4f33-4857-a64f-cceda6ae8795 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/a0c085f2-9d7c-450f-9d78-a846d47400fc" status: 200 len: 662 microversion: 2.1 time: 0.088881 May 19 04:33:06.586837 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 267/538] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:06 2022] GET /compute/v2.1/images/a0c085f2-9d7c-450f-9d78-a846d47400fc => generated 662 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:06.601377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ad2218ae-a8ec-4957-a130-ce3e055fa70d req-237fd46d-3afb-4ee7-ba64-1dbdb0ffab28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287", "tag": "25a0cf3f-ffa4-47ce-9022-693353a6c37c"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:06.626629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ad2218ae-a8ec-4957-a130-ce3e055fa70d req-237fd46d-3afb-4ee7-ba64-1dbdb0ffab28 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:06.629492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ad2218ae-a8ec-4957-a130-ce3e055fa70d req-237fd46d-3afb-4ee7-ba64-1dbdb0ffab28 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:06.652143 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ad2218ae-a8ec-4957-a130-ce3e055fa70d req-237fd46d-3afb-4ee7-ba64-1dbdb0ffab28 service nova] Creating event network-changed:25a0cf3f-ffa4-47ce-9022-693353a6c37c for instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 on n-h1-766726-30 May 19 04:33:06.658986 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ad2218ae-a8ec-4957-a130-ce3e055fa70d req-237fd46d-3afb-4ee7-ba64-1dbdb0ffab28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062845 May 19 04:33:06.661563 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 268/539] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:33:06.667957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-30199391-b3bf-49fb-ace2-8188675adcef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:06.669003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-30199391-b3bf-49fb-ace2-8188675adcef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:06.679847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30199391-b3bf-49fb-ace2-8188675adcef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:06.681202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30199391-b3bf-49fb-ace2-8188675adcef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:06.682676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30199391-b3bf-49fb-ace2-8188675adcef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:06.683378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30199391-b3bf-49fb-ace2-8188675adcef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:06.688244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-7b3f8216-c9e8-40d4-ba84-a6cb167a2f9e tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:06.710316 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7b3f8216-c9e8-40d4-ba84-a6cb167a2f9e tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 2051 microversion: 2.25 time: 0.575321 May 19 04:33:06.712748 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 272/540] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:06 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 2051 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:06.731210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-241863d9-eba4-41f9-9555-a05e6d5e901b tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:06.737111 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:33:06.737111 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:33:06.738904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-241863d9-eba4-41f9-9555-a05e6d5e901b tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:06.739619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-241863d9-eba4-41f9-9555-a05e6d5e901b tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:06.742697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-241863d9-eba4-41f9-9555-a05e6d5e901b tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:06.749807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-241863d9-eba4-41f9-9555-a05e6d5e901b tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:06.833631 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-241863d9-eba4-41f9-9555-a05e6d5e901b tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.107557 May 19 04:33:06.835794 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 273/541] 10.222.0.58 () {60 vars in 1216 bytes} [Thu May 19 04:33:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:06.849613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5f211a2f-1a91-43aa-b089-edccc596bceb tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:06.851935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5f211a2f-1a91-43aa-b089-edccc596bceb tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:06.917856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f211a2f-1a91-43aa-b089-edccc596bceb tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:06.919446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f211a2f-1a91-43aa-b089-edccc596bceb tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:06.921864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f211a2f-1a91-43aa-b089-edccc596bceb tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:06.922499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f211a2f-1a91-43aa-b089-edccc596bceb tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:07.016895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-30199391-b3bf-49fb-ace2-8188675adcef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:07.032850 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-30199391-b3bf-49fb-ace2-8188675adcef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1310 microversion: 2.1 time: 0.369468 May 19 04:33:07.034128 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 269/542] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:06 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1310 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:07.087199 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5f211a2f-1a91-43aa-b089-edccc596bceb tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5/action" status: 202 len: 0 microversion: 2.25 time: 0.244319 May 19 04:33:07.088381 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 274/543] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:33:06 2022] POST /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 04:33:07.097166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-13a60b72-2c8f-44d6-bb49-cddb56c620d1 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:07.097778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-13a60b72-2c8f-44d6-bb49-cddb56c620d1 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:07.108948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13a60b72-2c8f-44d6-bb49-cddb56c620d1 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:07.109678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13a60b72-2c8f-44d6-bb49-cddb56c620d1 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:07.111329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13a60b72-2c8f-44d6-bb49-cddb56c620d1 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:07.113585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13a60b72-2c8f-44d6-bb49-cddb56c620d1 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:07.163344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1750763405", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:07.285720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:33:07.630759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-13a60b72-2c8f-44d6-bb49-cddb56c620d1 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:07.665564 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-13a60b72-2c8f-44d6-bb49-cddb56c620d1 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 2056 microversion: 2.25 time: 0.572724 May 19 04:33:07.666566 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 270/544] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:07 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 2056 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:07.677391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d82e47ec-b039-4bfa-8ffc-981bc3659a24 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3162949d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:07.752076 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d82e47ec-b039-4bfa-8ffc-981bc3659a24 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.084260 May 19 04:33:07.752658 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 271/545] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:07 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:07.837210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:07.837637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:07.838118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:07.838697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:07.839139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:07.851034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:07.853894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:07.854982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:07.855677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:07.888287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Getting quotas for project e754cec8a31e4f18af60f5b0579fc028. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:07.893125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Getting quotas for user 532d8f47a46842fab6e2c03ef04e4b4a and project e754cec8a31e4f18af60f5b0579fc028. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:07.908443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:07.911886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:07.966196 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-33726e93-c93d-422b-a955-01c3f3faba7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814782 May 19 04:33:07.967389 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 275/546] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:33:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:33:08.051727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03dd621e-122a-45a7-a1a3-e52d2ea5a41b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:08.052996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-03dd621e-122a-45a7-a1a3-e52d2ea5a41b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:08.061464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03dd621e-122a-45a7-a1a3-e52d2ea5a41b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:08.063955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03dd621e-122a-45a7-a1a3-e52d2ea5a41b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:08.065375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03dd621e-122a-45a7-a1a3-e52d2ea5a41b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:08.068400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03dd621e-122a-45a7-a1a3-e52d2ea5a41b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:08.259444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03dd621e-122a-45a7-a1a3-e52d2ea5a41b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:08.267450 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-03dd621e-122a-45a7-a1a3-e52d2ea5a41b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1310 microversion: 2.1 time: 0.220816 May 19 04:33:08.271500 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 272/547] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:08 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1310 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:08.301213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1036794658", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:08.408826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:33:08.704069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8de0e4f9-98e2-4d37-b2ee-e1abc9bf4794 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:08.705241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8de0e4f9-98e2-4d37-b2ee-e1abc9bf4794 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:08.764706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8de0e4f9-98e2-4d37-b2ee-e1abc9bf4794 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:08.768247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8de0e4f9-98e2-4d37-b2ee-e1abc9bf4794 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:08.772070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8de0e4f9-98e2-4d37-b2ee-e1abc9bf4794 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:08.773834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8de0e4f9-98e2-4d37-b2ee-e1abc9bf4794 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:08.903614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:08.904038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:08.905060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:08.905561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:08.906619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:08.950254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:08.955398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:08.959489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:08.959974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:09.039272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Getting quotas for project e754cec8a31e4f18af60f5b0579fc028. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:09.052471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Getting quotas for user 532d8f47a46842fab6e2c03ef04e4b4a and project e754cec8a31e4f18af60f5b0579fc028. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:09.091165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:09.093688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:09.125717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:09.145758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-8de0e4f9-98e2-4d37-b2ee-e1abc9bf4794 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:09.196273 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed52acdc-3b71-4816-8e6f-ad2d966058bc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895406 May 19 04:33:09.198856 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 276/548] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:33:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:33:09.215624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9650535-bdf0-435b-a04b-48071003c2e8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3161a6d30>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:09.265167 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8de0e4f9-98e2-4d37-b2ee-e1abc9bf4794 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 2036 microversion: 2.25 time: 0.584816 May 19 04:33:09.295453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 273/549] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:08 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 2036 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:09.336659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-49c774a6-6f0b-49f2-a872-af089c176fd8 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:09.344280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-49c774a6-6f0b-49f2-a872-af089c176fd8 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:09.357622 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9650535-bdf0-435b-a04b-48071003c2e8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.157316 May 19 04:33:09.364327 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 277/550] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:09 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:09.372659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fe2152d7-7d1c-4ab4-ac5b-8270143ea20b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:09.379584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fe2152d7-7d1c-4ab4-ac5b-8270143ea20b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:09.393125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe2152d7-7d1c-4ab4-ac5b-8270143ea20b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:09.394590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe2152d7-7d1c-4ab4-ac5b-8270143ea20b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:09.396103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe2152d7-7d1c-4ab4-ac5b-8270143ea20b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:09.397872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe2152d7-7d1c-4ab4-ac5b-8270143ea20b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:09.565119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-49c774a6-6f0b-49f2-a872-af089c176fd8 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:09.575312 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-49c774a6-6f0b-49f2-a872-af089c176fd8 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1218 microversion: 2.1 time: 0.276557 May 19 04:33:09.585057 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 274/551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:09 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1218 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:09.590442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7e3d76c-623c-455e-89b7-66f68ea8d7f5 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-766726-30", "block_migration": "auto"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:09.591858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7e3d76c-623c-455e-89b7-66f68ea8d7f5 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:09.615439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7e3d76c-623c-455e-89b7-66f68ea8d7f5 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:09.616077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7e3d76c-623c-455e-89b7-66f68ea8d7f5 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:09.617049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7e3d76c-623c-455e-89b7-66f68ea8d7f5 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:09.617714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7e3d76c-623c-455e-89b7-66f68ea8d7f5 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:09.686339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-a7e3d76c-623c-455e-89b7-66f68ea8d7f5 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'flavor' on Instance uuid 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:09.707121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7e3d76c-623c-455e-89b7-66f68ea8d7f5 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Going to try to live migrate instance to n-h2-766726-30 {{(pid=124818) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 04:33:09.787509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fe2152d7-7d1c-4ab4-ac5b-8270143ea20b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:09.797436 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fe2152d7-7d1c-4ab4-ac5b-8270143ea20b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1310 microversion: 2.1 time: 0.431817 May 19 04:33:09.800357 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 278/552] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:09 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1310 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:10.373571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-68499a49-e7ea-4f7d-a3a2-c5599a62f497 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd31629bca0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:10.500627 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-68499a49-e7ea-4f7d-a3a2-c5599a62f497 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.128353 May 19 04:33:10.504106 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 279/553] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:10 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:33:10.604106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5bde5b45-db64-46a5-80e7-8812087c277e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:10.605933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5bde5b45-db64-46a5-80e7-8812087c277e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:10.620823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bde5b45-db64-46a5-80e7-8812087c277e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:10.623886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bde5b45-db64-46a5-80e7-8812087c277e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:10.625694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bde5b45-db64-46a5-80e7-8812087c277e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:10.626574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bde5b45-db64-46a5-80e7-8812087c277e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:10.791562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5bde5b45-db64-46a5-80e7-8812087c277e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:10.795746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:10.808836 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5bde5b45-db64-46a5-80e7-8812087c277e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1270 microversion: 2.1 time: 0.208792 May 19 04:33:10.808836 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 280/554] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:10 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:10.841098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35a42c7d-3c7a-4984-821c-fa378699b9dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:10.843245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-35a42c7d-3c7a-4984-821c-fa378699b9dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:10.861646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35a42c7d-3c7a-4984-821c-fa378699b9dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:10.863409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35a42c7d-3c7a-4984-821c-fa378699b9dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:10.869552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35a42c7d-3c7a-4984-821c-fa378699b9dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:10.871076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35a42c7d-3c7a-4984-821c-fa378699b9dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:11.016514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:11.459358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-35a42c7d-3c7a-4984-821c-fa378699b9dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:11.472137 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-35a42c7d-3c7a-4984-821c-fa378699b9dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1310 microversion: 2.1 time: 0.659667 May 19 04:33:11.477196 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 281/555] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:10 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1310 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:11.517731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5370315-8895-47d6-b97d-b0b455b1e8f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3160760d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:11.610985 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5370315-8895-47d6-b97d-b0b455b1e8f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.097357 May 19 04:33:11.611769 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 282/556] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:11 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:11.991081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1859515553", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:12.114810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:33:13.408720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:13.410660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:13.411558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:13.412394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:13.413352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:13.446455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:13.447345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:13.448826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:13.449463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:13.511738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Getting quotas for project a46295a57a1c4addaff0ab1ad808f5b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:13.521503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Getting quotas for user 95a828a7fc494ba2bb3c9d8e811283a1 and project a46295a57a1c4addaff0ab1ad808f5b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:13.551210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:13.558348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:13.653395 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87f790e6-d480-4392-8884-c0f2611e87bb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039157 May 19 04:33:13.654455 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 283/557] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:33:13.660017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a1a4bace-4eb9-4b30-b776-ec91b16adbb4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:13.663200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a1a4bace-4eb9-4b30-b776-ec91b16adbb4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:13.676728 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a1a4bace-4eb9-4b30-b776-ec91b16adbb4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:13.694215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a1a4bace-4eb9-4b30-b776-ec91b16adbb4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:13.699843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a1a4bace-4eb9-4b30-b776-ec91b16adbb4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:13.700651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a1a4bace-4eb9-4b30-b776-ec91b16adbb4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:14.373218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7e3d76c-623c-455e-89b7-66f68ea8d7f5 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5/action" status: 202 len: 0 microversion: 2.25 time: 4.786241 May 19 04:33:14.374400 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 275/558] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:33:09 2022] POST /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5/action => generated 0 bytes in 4788 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:33:14.743725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b94f583c-66de-4274-8103-a339a92275b4 tempest-QuotaClassesAdmin257Test-137341156 tempest-QuotaClassesAdmin257Test-137341156-project-admin] Calling method '.version_select at 0x7fd3161e6700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:14.745669 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:33:14.745669 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:33:14.762033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=61 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:14.765388 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b94f583c-66de-4274-8103-a339a92275b4 tempest-QuotaClassesAdmin257Test-137341156 tempest-QuotaClassesAdmin257Test-137341156-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.389475 May 19 04:33:14.772602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a1a4bace-4eb9-4b30-b776-ec91b16adbb4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:14.782711 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 276/559] 10.222.0.58 () {60 vars in 1225 bytes} [Thu May 19 04:33:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:14.788849 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a1a4bace-4eb9-4b30-b776-ec91b16adbb4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1318 microversion: 2.1 time: 1.131033 May 19 04:33:14.791397 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 284/560] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:13 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1318 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:14.797049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2b3d1f2-ece4-4a49-8dce-e33f8ec2d500 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:14.798606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f2b3d1f2-ece4-4a49-8dce-e33f8ec2d500 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:14.802981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5dae59e-4f8f-4704-8696-580a14fd365d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316076820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:14.820803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2b3d1f2-ece4-4a49-8dce-e33f8ec2d500 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:14.822463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2b3d1f2-ece4-4a49-8dce-e33f8ec2d500 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:14.824891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2b3d1f2-ece4-4a49-8dce-e33f8ec2d500 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:14.825586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2b3d1f2-ece4-4a49-8dce-e33f8ec2d500 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:14.925821 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5dae59e-4f8f-4704-8696-580a14fd365d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.132988 May 19 04:33:14.927626 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 285/561] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:14 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:14.943029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-219dabb4-b94d-4074-80b0-5f3384126309 req-a6e2d066-0c65-4ab3-a209-abd33e87fd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287", "name": "network-vif-plugged", "status": "completed", "tag": "25a0cf3f-ffa4-47ce-9022-693353a6c37c"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:14.970363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-219dabb4-b94d-4074-80b0-5f3384126309 req-a6e2d066-0c65-4ab3-a209-abd33e87fd67 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:14.972050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-219dabb4-b94d-4074-80b0-5f3384126309 req-a6e2d066-0c65-4ab3-a209-abd33e87fd67 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:15.003312 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-219dabb4-b94d-4074-80b0-5f3384126309 req-a6e2d066-0c65-4ab3-a209-abd33e87fd67 service nova] Creating event network-vif-plugged:25a0cf3f-ffa4-47ce-9022-693353a6c37c for instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 on n-h1-766726-30 May 19 04:33:15.016744 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-219dabb4-b94d-4074-80b0-5f3384126309 req-a6e2d066-0c65-4ab3-a209-abd33e87fd67 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083529 May 19 04:33:15.017820 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 286/562] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:15.037769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21ae9ced-7f15-434f-9ac4-9088d9cfb9d4 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:15.038849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-21ae9ced-7f15-434f-9ac4-9088d9cfb9d4 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:15.046956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21ae9ced-7f15-434f-9ac4-9088d9cfb9d4 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:15.047653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21ae9ced-7f15-434f-9ac4-9088d9cfb9d4 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:15.048592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21ae9ced-7f15-434f-9ac4-9088d9cfb9d4 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:15.049124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21ae9ced-7f15-434f-9ac4-9088d9cfb9d4 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:15.349219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-21ae9ced-7f15-434f-9ac4-9088d9cfb9d4 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:15.367635 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21ae9ced-7f15-434f-9ac4-9088d9cfb9d4 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1274 microversion: 2.1 time: 0.336826 May 19 04:33:15.369016 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 287/563] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:15 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1274 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:15.376137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:15.376754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:15.399933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:15.401462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:15.404550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:15.406157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:15.672365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f2b3d1f2-ece4-4a49-8dce-e33f8ec2d500 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:15.685404 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2b3d1f2-ece4-4a49-8dce-e33f8ec2d500 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1310 microversion: 2.1 time: 0.901345 May 19 04:33:15.686868 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 277/564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:14 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1310 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:15.696790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ae83491e-85bf-49a5-be3e-9a7df9540e3f tempest-QuotaClassesAdmin257Test-137341156 tempest-QuotaClassesAdmin257Test-137341156-project-admin] Action: 'update', calling method: .version_select at 0x7fd3161dfa60>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:15.713986 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:33:15.713986 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:33:16.068980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ae83491e-85bf-49a5-be3e-9a7df9540e3f tempest-QuotaClassesAdmin257Test-137341156 tempest-QuotaClassesAdmin257Test-137341156-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.378774 May 19 04:33:16.069765 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 278/565] 10.222.0.58 () {62 vars in 1246 bytes} [Thu May 19 04:33:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:16.074838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9023672c-0f3d-4a6a-94a8-6dcaa917ad39 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:16.083834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9023672c-0f3d-4a6a-94a8-6dcaa917ad39 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:16.098628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9023672c-0f3d-4a6a-94a8-6dcaa917ad39 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:16.099533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9023672c-0f3d-4a6a-94a8-6dcaa917ad39 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:16.100609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9023672c-0f3d-4a6a-94a8-6dcaa917ad39 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:16.101286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9023672c-0f3d-4a6a-94a8-6dcaa917ad39 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:16.104095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:16.124315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:16.126141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:16.127945 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f8d81486-925f-4833-9c94-5895aabe76af tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1567 microversion: 2.25 time: 0.757426 May 19 04:33:16.129288 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 288/566] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:15 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1567 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:16.135406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-76bd67c8-606f-4c37-a08d-bd9c7d941554 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd31629be50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:16.262443 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-76bd67c8-606f-4c37-a08d-bd9c7d941554 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1414 microversion: 2.1 time: 0.118773 May 19 04:33:16.276591 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 289/567] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:16 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1414 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:16.306225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-394c2b05-94d5-4baf-956a-d4e7c271d2d5 tempest-QuotaClassesAdmin257Test-137341156 tempest-QuotaClassesAdmin257Test-137341156-project-admin] Calling method '.version_select at 0x7fd3161bd5e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:16.312978 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:33:16.312978 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:33:16.396882 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-394c2b05-94d5-4baf-956a-d4e7c271d2d5 tempest-QuotaClassesAdmin257Test-137341156 tempest-QuotaClassesAdmin257Test-137341156-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.116015 May 19 04:33:16.397879 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 290/568] 10.222.0.58 () {60 vars in 1225 bytes} [Thu May 19 04:33:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:16.410605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8f80f58c-8291-428e-82df-15f77187f67d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:16.420108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8f80f58c-8291-428e-82df-15f77187f67d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:16.428447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f80f58c-8291-428e-82df-15f77187f67d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:16.428914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f80f58c-8291-428e-82df-15f77187f67d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:16.430906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f80f58c-8291-428e-82df-15f77187f67d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:16.439855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f80f58c-8291-428e-82df-15f77187f67d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:16.687692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8f80f58c-8291-428e-82df-15f77187f67d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:16.702469 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8f80f58c-8291-428e-82df-15f77187f67d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1280 microversion: 2.1 time: 0.298710 May 19 04:33:16.704439 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 291/569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:16 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:16.719778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e4bbafa2-bc4b-436b-aa36-d5c0e5eb72b6 tempest-QuotaClassesAdmin257Test-137341156 tempest-QuotaClassesAdmin257Test-137341156-project-admin] Action: 'update', calling method: .version_select at 0x7fd3165833a0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:16.721446 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:33:16.721446 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:33:16.836929 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e4bbafa2-bc4b-436b-aa36-d5c0e5eb72b6 tempest-QuotaClassesAdmin257Test-137341156 tempest-QuotaClassesAdmin257Test-137341156-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.130918 May 19 04:33:16.838174 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 292/570] 10.222.0.58 () {62 vars in 1246 bytes} [Thu May 19 04:33:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:16.840113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9023672c-0f3d-4a6a-94a8-6dcaa917ad39 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:16.849127 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9023672c-0f3d-4a6a-94a8-6dcaa917ad39 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1318 microversion: 2.1 time: 0.778402 May 19 04:33:16.853493 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 279/571] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:16 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1318 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:16.861403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c739c768-8511-4d9b-9870-ecfaa743dc91 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:16.885691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c739c768-8511-4d9b-9870-ecfaa743dc91 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:16.917370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c739c768-8511-4d9b-9870-ecfaa743dc91 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:16.917838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c739c768-8511-4d9b-9870-ecfaa743dc91 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:16.918667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c739c768-8511-4d9b-9870-ecfaa743dc91 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:16.919112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c739c768-8511-4d9b-9870-ecfaa743dc91 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:17.146654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:17.147682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:17.159927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:17.164794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:17.166288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:17.167085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:18.214425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c739c768-8511-4d9b-9870-ecfaa743dc91 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:18.217331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:18.226614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:18.229281 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c739c768-8511-4d9b-9870-ecfaa743dc91 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1310 microversion: 2.1 time: 1.389229 May 19 04:33:18.231226 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 293/572] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:16 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1310 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:18.231463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:18.234516 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ee214136-775b-4aa4-bb61-a512b90bca88 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1567 microversion: 2.25 time: 1.092800 May 19 04:33:18.235436 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 280/573] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:17 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1567 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:18.243839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-76b804a5-f227-4f22-82a3-4bef326c83f6 req-736fe295-91c3-4419-ac56-790a4edefdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "894949df-7dda-4389-b7bc-ea820a53ffd1", "tag": "8be6a741-ebd0-4f13-99c9-b902a49319b3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:18.253788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0bfb360a-6554-47e7-bc9a-573d8ae28e31 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3160764c0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:18.264348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-76b804a5-f227-4f22-82a3-4bef326c83f6 req-736fe295-91c3-4419-ac56-790a4edefdd6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:18.264807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-76b804a5-f227-4f22-82a3-4bef326c83f6 req-736fe295-91c3-4419-ac56-790a4edefdd6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:18.292535 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-76b804a5-f227-4f22-82a3-4bef326c83f6 req-736fe295-91c3-4419-ac56-790a4edefdd6 service nova] Creating event network-changed:8be6a741-ebd0-4f13-99c9-b902a49319b3 for instance 894949df-7dda-4389-b7bc-ea820a53ffd1 on n-h2-766726-30 May 19 04:33:18.298719 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-76b804a5-f227-4f22-82a3-4bef326c83f6 req-736fe295-91c3-4419-ac56-790a4edefdd6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059658 May 19 04:33:18.300517 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 281/574] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:18.317506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a7afa49-a377-4d65-ba04-4b612605c53f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:18.318483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2a7afa49-a377-4d65-ba04-4b612605c53f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:18.319544 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0bfb360a-6554-47e7-bc9a-573d8ae28e31 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1423 microversion: 2.1 time: 0.086530 May 19 04:33:18.320208 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 294/575] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:18 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:18.334822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a7afa49-a377-4d65-ba04-4b612605c53f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:18.335513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a7afa49-a377-4d65-ba04-4b612605c53f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:18.336881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a7afa49-a377-4d65-ba04-4b612605c53f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:18.337570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a7afa49-a377-4d65-ba04-4b612605c53f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:18.349972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-02b1c26c-4d78-48fe-b6d4-9297096c9fa6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:18.350655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-02b1c26c-4d78-48fe-b6d4-9297096c9fa6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:18.365532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02b1c26c-4d78-48fe-b6d4-9297096c9fa6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:18.366017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02b1c26c-4d78-48fe-b6d4-9297096c9fa6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:18.372156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02b1c26c-4d78-48fe-b6d4-9297096c9fa6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:18.372855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02b1c26c-4d78-48fe-b6d4-9297096c9fa6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:18.460145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2a7afa49-a377-4d65-ba04-4b612605c53f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:18.468201 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2a7afa49-a377-4d65-ba04-4b612605c53f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1280 microversion: 2.1 time: 0.166282 May 19 04:33:18.469014 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 282/576] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:18 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1280 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:18.475255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1fa6203-5139-41cc-8707-34ddd946f0d9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd31619faf0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:18.537774 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1fa6203-5139-41cc-8707-34ddd946f0d9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 200 len: 1423 microversion: 2.1 time: 0.066034 May 19 04:33:18.546772 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 283/577] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:18 2022] GET /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:18.560023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2622cb9-b4a5-4a78-a1a7-2e8a9abbe41e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316218a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:19.004263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02b1c26c-4d78-48fe-b6d4-9297096c9fa6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:19.017305 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-02b1c26c-4d78-48fe-b6d4-9297096c9fa6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1318 microversion: 2.1 time: 0.693031 May 19 04:33:19.018513 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 295/578] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:18 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:19.032106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-cedd0ece-6f0d-4b05-8239-da051f374a40 req-f3e56403-586b-4664-8433-9a1ad8701bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab072e19-b664-4518-b3a1-4d6a31cdbac4", "tag": "9f40abdc-237f-468c-bebb-ab83998922c0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:19.051627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cedd0ece-6f0d-4b05-8239-da051f374a40 req-f3e56403-586b-4664-8433-9a1ad8701bcc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:19.052082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cedd0ece-6f0d-4b05-8239-da051f374a40 req-f3e56403-586b-4664-8433-9a1ad8701bcc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:19.080675 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cedd0ece-6f0d-4b05-8239-da051f374a40 req-f3e56403-586b-4664-8433-9a1ad8701bcc service nova] Creating event network-changed:9f40abdc-237f-468c-bebb-ab83998922c0 for instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 on n-h2-766726-30 May 19 04:33:19.088443 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-cedd0ece-6f0d-4b05-8239-da051f374a40 req-f3e56403-586b-4664-8433-9a1ad8701bcc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068382 May 19 04:33:19.089387 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 296/579] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:19.249003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e07c54e6-d41f-4e69-b076-27dbe6d5c967 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:19.250445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e07c54e6-d41f-4e69-b076-27dbe6d5c967 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:19.263894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e07c54e6-d41f-4e69-b076-27dbe6d5c967 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:19.273420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e07c54e6-d41f-4e69-b076-27dbe6d5c967 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:19.274397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e07c54e6-d41f-4e69-b076-27dbe6d5c967 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:19.274870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e07c54e6-d41f-4e69-b076-27dbe6d5c967 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:19.550735 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2622cb9-b4a5-4a78-a1a7-2e8a9abbe41e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 204 len: 0 microversion: 2.1 time: 1.002324 May 19 04:33:19.555606 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 284/580] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:18 2022] DELETE /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:33:19.564468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:19.565147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:19.587261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:19.590101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:19.593232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:19.595214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:19.700861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e07c54e6-d41f-4e69-b076-27dbe6d5c967 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:19.710510 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e07c54e6-d41f-4e69-b076-27dbe6d5c967 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1492 microversion: 2.1 time: 0.466375 May 19 04:33:19.720918 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 297/581] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:19 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1492 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:19.726261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4cce2017-2543-4319-b1ec-6270c22accdb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:19.727052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4cce2017-2543-4319-b1ec-6270c22accdb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:19.736337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cce2017-2543-4319-b1ec-6270c22accdb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:19.744577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cce2017-2543-4319-b1ec-6270c22accdb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:19.745603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cce2017-2543-4319-b1ec-6270c22accdb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:19.745915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cce2017-2543-4319-b1ec-6270c22accdb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:20.140517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:20.152604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:20.155501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:20.158320 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-927bc52a-012d-48c8-99b2-f6762ede939c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1567 microversion: 2.25 time: 0.601129 May 19 04:33:20.160103 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 285/582] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:19 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1567 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:20.166773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43a76df7-3c91-4330-ab60-53f841ec8d3e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:20.167474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43a76df7-3c91-4330-ab60-53f841ec8d3e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:20.176677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43a76df7-3c91-4330-ab60-53f841ec8d3e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:20.177532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43a76df7-3c91-4330-ab60-53f841ec8d3e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:20.178655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43a76df7-3c91-4330-ab60-53f841ec8d3e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:20.179438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43a76df7-3c91-4330-ab60-53f841ec8d3e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:20.227327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4cce2017-2543-4319-b1ec-6270c22accdb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:20.238796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43a76df7-3c91-4330-ab60-53f841ec8d3e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:33:20.241669 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4cce2017-2543-4319-b1ec-6270c22accdb tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1322 microversion: 2.1 time: 0.519260 May 19 04:33:20.242278 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 298/583] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:19 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:20.256606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-10dd485f-5b5a-4fde-bdf4-92846e29a657 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:20.257322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-10dd485f-5b5a-4fde-bdf4-92846e29a657 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:20.272674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10dd485f-5b5a-4fde-bdf4-92846e29a657 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:20.273467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10dd485f-5b5a-4fde-bdf4-92846e29a657 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:20.274462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10dd485f-5b5a-4fde-bdf4-92846e29a657 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:20.275082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10dd485f-5b5a-4fde-bdf4-92846e29a657 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:20.427049 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43a76df7-3c91-4330-ab60-53f841ec8d3e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 204 len: 0 microversion: 2.1 time: 0.263191 May 19 04:33:20.432544 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 286/584] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:33:20 2022] DELETE /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:33:20.457454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e9622119-2c11-4a69-917c-783adda8dbe2 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:20.458366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e9622119-2c11-4a69-917c-783adda8dbe2 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:20.467088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9622119-2c11-4a69-917c-783adda8dbe2 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:20.467699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9622119-2c11-4a69-917c-783adda8dbe2 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:20.468508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9622119-2c11-4a69-917c-783adda8dbe2 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:20.468956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9622119-2c11-4a69-917c-783adda8dbe2 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:20.526588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:20.553915 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-10dd485f-5b5a-4fde-bdf4-92846e29a657 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1645 microversion: 2.1 time: 0.310545 May 19 04:33:20.556337 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 299/585] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:20 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1645 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:20.572406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c3708bd-e7e6-4357-9d74-f3896725fe33 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:20.573491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c3708bd-e7e6-4357-9d74-f3896725fe33 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:20.610128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c3708bd-e7e6-4357-9d74-f3896725fe33 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:20.611024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c3708bd-e7e6-4357-9d74-f3896725fe33 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:20.613650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c3708bd-e7e6-4357-9d74-f3896725fe33 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:20.617143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c3708bd-e7e6-4357-9d74-f3896725fe33 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:20.880840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e9622119-2c11-4a69-917c-783adda8dbe2 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:20.890481 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e9622119-2c11-4a69-917c-783adda8dbe2 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1318 microversion: 2.1 time: 0.456290 May 19 04:33:20.891466 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 287/586] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:20 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:20.906941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1568243271", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "af325e41-dd5e-49a4-8d8b-0ae83cdd7660"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:21.030954 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c3708bd-e7e6-4357-9d74-f3896725fe33 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1645 microversion: 2.1 time: 0.463234 May 19 04:33:21.032747 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 300/587] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:20 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1645 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:33:21.038322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] validate_networks() for [('af325e41-dd5e-49a4-8d8b-0ae83cdd7660', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:33:21.050861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c154a328-5a3d-40c7-ac4c-5e6225a1e367 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:21.053744 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:33:21.053744 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:33:21.059659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c154a328-5a3d-40c7-ac4c-5e6225a1e367 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:21.060121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c154a328-5a3d-40c7-ac4c-5e6225a1e367 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:21.060970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c154a328-5a3d-40c7-ac4c-5e6225a1e367 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:21.061431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c154a328-5a3d-40c7-ac4c-5e6225a1e367 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:21.150805 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c154a328-5a3d-40c7-ac4c-5e6225a1e367 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.105276 May 19 04:33:21.158396 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 301/588] 10.222.0.58 () {58 vars in 1175 bytes} [Thu May 19 04:33:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:21.166420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b60cf994-3b2c-4a76-ade9-f6774cf3839a req-544ffc45-d4ef-4e1d-9a9b-653377d5896a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5", "name": "network-vif-unplugged", "status": "completed", "tag": "73456bb4-887e-4a14-b2f8-54b8006ad0bc"}, {"name": "network-changed", "server_uuid": "60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5", "tag": "73456bb4-887e-4a14-b2f8-54b8006ad0bc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:21.177251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b60cf994-3b2c-4a76-ade9-f6774cf3839a req-544ffc45-d4ef-4e1d-9a9b-653377d5896a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:21.177713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b60cf994-3b2c-4a76-ade9-f6774cf3839a req-544ffc45-d4ef-4e1d-9a9b-653377d5896a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:21.193051 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b60cf994-3b2c-4a76-ade9-f6774cf3839a req-544ffc45-d4ef-4e1d-9a9b-653377d5896a service nova] Creating event network-vif-unplugged:73456bb4-887e-4a14-b2f8-54b8006ad0bc for instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 on n-h1-766726-30 May 19 04:33:21.193595 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b60cf994-3b2c-4a76-ade9-f6774cf3839a req-544ffc45-d4ef-4e1d-9a9b-653377d5896a service nova] Creating event network-changed:73456bb4-887e-4a14-b2f8-54b8006ad0bc for instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 on n-h1-766726-30 May 19 04:33:21.201635 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b60cf994-3b2c-4a76-ade9-f6774cf3839a req-544ffc45-d4ef-4e1d-9a9b-653377d5896a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.038213 May 19 04:33:21.202235 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 302/589] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:21.209069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b0a1e2f-def7-48d0-b664-20fdc82f2f89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:21.210251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b0a1e2f-def7-48d0-b664-20fdc82f2f89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:21.219170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b0a1e2f-def7-48d0-b664-20fdc82f2f89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:21.219170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b0a1e2f-def7-48d0-b664-20fdc82f2f89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:21.220446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b0a1e2f-def7-48d0-b664-20fdc82f2f89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:21.220902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b0a1e2f-def7-48d0-b664-20fdc82f2f89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:21.376337 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b0a1e2f-def7-48d0-b664-20fdc82f2f89 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287/action" status: 202 len: 0 microversion: 2.1 time: 0.171054 May 19 04:33:21.383305 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 303/590] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:33:21 2022] POST /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:33:21.396910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:21.397869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:21.413966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:21.415378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:21.417195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:21.419511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:22.304299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:22.323610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:22.325815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:22.328298 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eb99a90f-4b6b-4b05-9918-17a6bbe9905c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1567 microversion: 2.25 time: 0.942896 May 19 04:33:22.343513 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 304/591] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:21 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1567 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:22.358120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c71cf02-61dc-472a-8ba3-db96d9004977 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:22.359262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c71cf02-61dc-472a-8ba3-db96d9004977 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:22.391644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c71cf02-61dc-472a-8ba3-db96d9004977 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:22.394065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c71cf02-61dc-472a-8ba3-db96d9004977 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:22.396946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c71cf02-61dc-472a-8ba3-db96d9004977 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:22.397898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c71cf02-61dc-472a-8ba3-db96d9004977 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:22.558037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:22.559588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:22.560238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:22.560808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:22.561407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:22.564094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=83,nova_api:UPDATE=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:22.584665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:22.585262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:22.589618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:22.595661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:22.658271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Getting quotas for project ff2741185bb8440db094f7bc87af8b2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:22.679622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Getting quotas for user 5b561a0c5d754a12a04e62664e607506 and project ff2741185bb8440db094f7bc87af8b2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:22.712535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:22.720480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:22.723471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c71cf02-61dc-472a-8ba3-db96d9004977 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:22.729717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:22.731917 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c71cf02-61dc-472a-8ba3-db96d9004977 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1322 microversion: 2.1 time: 0.386658 May 19 04:33:22.735963 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 305/592] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:22 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:22.747198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5d1baa1-fc6b-42c6-b6d4-815d2d54400c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:22.748841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b5d1baa1-fc6b-42c6-b6d4-815d2d54400c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:22.766405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5d1baa1-fc6b-42c6-b6d4-815d2d54400c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:22.771436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5d1baa1-fc6b-42c6-b6d4-815d2d54400c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:22.775173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5d1baa1-fc6b-42c6-b6d4-815d2d54400c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:22.775824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5d1baa1-fc6b-42c6-b6d4-815d2d54400c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:22.813788 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-71b0759a-9417-4127-a958-689d62836bc8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.921018 May 19 04:33:22.817313 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 288/593] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:33:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:33:22.824467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-264ccd6d-dc24-420f-9d86-897b8286fe7b tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:22.831199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b5d1baa1-fc6b-42c6-b6d4-815d2d54400c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:33:22.838901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-264ccd6d-dc24-420f-9d86-897b8286fe7b tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:22.855198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-264ccd6d-dc24-420f-9d86-897b8286fe7b tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:22.855968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-264ccd6d-dc24-420f-9d86-897b8286fe7b tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:22.857003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-264ccd6d-dc24-420f-9d86-897b8286fe7b tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:22.860515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-264ccd6d-dc24-420f-9d86-897b8286fe7b tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:23.010552 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5d1baa1-fc6b-42c6-b6d4-815d2d54400c tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 204 len: 0 microversion: 2.1 time: 0.269039 May 19 04:33:23.012048 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 306/594] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:33:22 2022] DELETE /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:33:23.027597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-12297f94-ba49-4b93-b054-dec26e14de2e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:23.032649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-12297f94-ba49-4b93-b054-dec26e14de2e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:23.067130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12297f94-ba49-4b93-b054-dec26e14de2e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:23.067593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12297f94-ba49-4b93-b054-dec26e14de2e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:23.071977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12297f94-ba49-4b93-b054-dec26e14de2e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:23.072450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12297f94-ba49-4b93-b054-dec26e14de2e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:23.535862 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-264ccd6d-dc24-420f-9d86-897b8286fe7b tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1630 microversion: 2.1 time: 0.716731 May 19 04:33:23.537685 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 289/595] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:22 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1630 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:23.553607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71e9bd5b-3b05-45dd-8820-e703d058fdee tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:23.556503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-71e9bd5b-3b05-45dd-8820-e703d058fdee tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:23.820071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-71e9bd5b-3b05-45dd-8820-e703d058fdee tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:23.828088 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-71e9bd5b-3b05-45dd-8820-e703d058fdee tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1208 microversion: 2.1 time: 0.289083 May 19 04:33:23.831469 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 290/596] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:23 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1208 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:23.844943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-655482344", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "1987996585", "adminPass": "***", "networks": [{"uuid": "417cc322-aafc-4a9a-b761-dd6b9faf7e73"}], "security_groups": [{"name": "tempest-securitygroup--583486643"}], "key_name": "tempest-keypair-908441147", "user_data": "}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:23.855998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-12297f94-ba49-4b93-b054-dec26e14de2e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:23.867612 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-12297f94-ba49-4b93-b054-dec26e14de2e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1318 microversion: 2.1 time: 0.850721 May 19 04:33:23.869962 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 307/597] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:23 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1318 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:23.875443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-071127f9-c925-4cd6-8947-9a5e61a4700d req-453e7beb-0656-402b-924f-f56b57818e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60d1fdd-bc27-420a-a4b2-fde586e236ef", "tag": "dc1988c4-753a-4d2d-a2af-b6427de33f1a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:23.897877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-071127f9-c925-4cd6-8947-9a5e61a4700d req-453e7beb-0656-402b-924f-f56b57818e71 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:23.900772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-071127f9-c925-4cd6-8947-9a5e61a4700d req-453e7beb-0656-402b-924f-f56b57818e71 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:23.930510 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-071127f9-c925-4cd6-8947-9a5e61a4700d req-453e7beb-0656-402b-924f-f56b57818e71 service nova] Creating event network-changed:dc1988c4-753a-4d2d-a2af-b6427de33f1a for instance e60d1fdd-bc27-420a-a4b2-fde586e236ef on n-h1-766726-30 May 19 04:33:23.937556 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-071127f9-c925-4cd6-8947-9a5e61a4700d req-453e7beb-0656-402b-924f-f56b57818e71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065328 May 19 04:33:23.940174 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 308/598] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:23.954850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e18111f2-2316-4624-959d-63c12e7582f9 req-92c098a6-8115-4914-bc73-b78ffc8f2607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae6a03f-375c-4b42-8544-59df1ba8cef5", "name": "network-vif-unplugged", "status": "completed", "tag": "d3dc1818-db8c-4b28-b68c-3ab4103e42d9"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:23.975407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e18111f2-2316-4624-959d-63c12e7582f9 req-92c098a6-8115-4914-bc73-b78ffc8f2607 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:23.978548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e18111f2-2316-4624-959d-63c12e7582f9 req-92c098a6-8115-4914-bc73-b78ffc8f2607 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:24.000471 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e18111f2-2316-4624-959d-63c12e7582f9 req-92c098a6-8115-4914-bc73-b78ffc8f2607 service nova] Creating event network-vif-unplugged:d3dc1818-db8c-4b28-b68c-3ab4103e42d9 for instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 on n-h2-766726-30 May 19 04:33:24.009353 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e18111f2-2316-4624-959d-63c12e7582f9 req-92c098a6-8115-4914-bc73-b78ffc8f2607 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066206 May 19 04:33:24.010484 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 309/599] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:24.021406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:24.029560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:24.041148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:24.041618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:24.046091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:24.046554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:24.111302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] validate_networks() for [('417cc322-aafc-4a9a-b761-dd6b9faf7e73', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:33:24.531136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:24.540196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:24.541772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:24.542960 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e3f2d02-14d5-4366-ad75-36394005ee80 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1567 microversion: 2.25 time: 0.529620 May 19 04:33:24.543522 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 310/600] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:24 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1567 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:24.547950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8baf281e-7292-4f59-ade4-23c6ce4680ab tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-766726-30", "block_migration": true, "disk_over_commit": false}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:24.559007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8baf281e-7292-4f59-ade4-23c6ce4680ab tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:24.584249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8baf281e-7292-4f59-ade4-23c6ce4680ab tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:24.585062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8baf281e-7292-4f59-ade4-23c6ce4680ab tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:24.586194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8baf281e-7292-4f59-ade4-23c6ce4680ab tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:24.586821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8baf281e-7292-4f59-ade4-23c6ce4680ab tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:24.636227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-8baf281e-7292-4f59-ade4-23c6ce4680ab tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lazy-loading 'flavor' on Instance uuid 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:24.660017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8baf281e-7292-4f59-ade4-23c6ce4680ab tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Going to try to live migrate instance to n-h2-766726-30 {{(pid=124819) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 04:33:25.056203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:25.056693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:25.057113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:25.057692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:25.058290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:25.072515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:25.072985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:25.073871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:25.074305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:25.118573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Getting quotas for project e9f7c96b0d5a45aaa70f0a09bdea144c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:25.123972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Getting quotas for user f659bfc9046342629cd0c35e08871246 and project e9f7c96b0d5a45aaa70f0a09bdea144c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:25.154398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:25.157275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:25.274154 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5bf87d71-d924-48bb-938f-760c4c3b9791 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.441347 May 19 04:33:25.277858 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 291/601] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:33:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:33:25.292325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9321947f-a635-450b-aa9a-d1d5e3f2ec83 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:25.296960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9321947f-a635-450b-aa9a-d1d5e3f2ec83 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:25.315501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9321947f-a635-450b-aa9a-d1d5e3f2ec83 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:25.316151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9321947f-a635-450b-aa9a-d1d5e3f2ec83 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:25.317214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9321947f-a635-450b-aa9a-d1d5e3f2ec83 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:25.317890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9321947f-a635-450b-aa9a-d1d5e3f2ec83 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:25.583317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9321947f-a635-450b-aa9a-d1d5e3f2ec83 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:25.603267 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9321947f-a635-450b-aa9a-d1d5e3f2ec83 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1322 microversion: 2.1 time: 0.324028 May 19 04:33:25.610559 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 292/602] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:25 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:25.988066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1d1c660f-a167-48ae-bd17-3f1fcf4c8209 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Action: 'update', calling method: .version_select at 0x7fd3161df3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:26.172371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d1c660f-a167-48ae-bd17-3f1fcf4c8209 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:26.174837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d1c660f-a167-48ae-bd17-3f1fcf4c8209 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:26.177758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d1c660f-a167-48ae-bd17-3f1fcf4c8209 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:26.179074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d1c660f-a167-48ae-bd17-3f1fcf4c8209 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:26.298150 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1d1c660f-a167-48ae-bd17-3f1fcf4c8209 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/cdc783ea476a458181affcf072f63bf0" status: 200 len: 240 microversion: 2.36 time: 0.686062 May 19 04:33:26.299530 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 293/603] 10.222.0.58 () {62 vars in 1302 bytes} [Thu May 19 04:33:25 2022] PUT /compute/v2.1/os-quota-sets/cdc783ea476a458181affcf072f63bf0 => generated 240 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:26.304851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-583d2bde-a41c-48c8-8da8-457263afd234 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:26.305737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-583d2bde-a41c-48c8-8da8-457263afd234 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:26.315253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-583d2bde-a41c-48c8-8da8-457263afd234 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:26.318334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-583d2bde-a41c-48c8-8da8-457263afd234 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:26.321382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-583d2bde-a41c-48c8-8da8-457263afd234 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:26.322200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-583d2bde-a41c-48c8-8da8-457263afd234 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:26.470519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-583d2bde-a41c-48c8-8da8-457263afd234 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:26.479537 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-583d2bde-a41c-48c8-8da8-457263afd234 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1266 microversion: 2.1 time: 0.178753 May 19 04:33:26.482390 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 294/604] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:26 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:26.495416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7928eb0-0e09-4504-9782-318dd217d7dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:26.498378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b7928eb0-0e09-4504-9782-318dd217d7dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:26.514158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7928eb0-0e09-4504-9782-318dd217d7dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:26.515061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7928eb0-0e09-4504-9782-318dd217d7dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:26.517175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7928eb0-0e09-4504-9782-318dd217d7dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:26.520340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7928eb0-0e09-4504-9782-318dd217d7dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:26.836820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=22 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:26.973041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b7928eb0-0e09-4504-9782-318dd217d7dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:26.982835 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b7928eb0-0e09-4504-9782-318dd217d7dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1318 microversion: 2.1 time: 0.498031 May 19 04:33:26.988212 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 295/605] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:26 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:27.122586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc90c249-2f48-4e95-b58a-45a01e477a9c tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] Calling method '.version_select at 0x7fd3161bda60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:27.302384 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bc90c249-2f48-4e95-b58a-45a01e477a9c tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.312828 May 19 04:33:27.310203 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 296/606] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:33:26 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:33:27.315949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d53145a8-6829-4d4e-9e00-652128ea600b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:27.316876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d53145a8-6829-4d4e-9e00-652128ea600b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:27.347816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d53145a8-6829-4d4e-9e00-652128ea600b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:27.348506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d53145a8-6829-4d4e-9e00-652128ea600b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:27.349599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d53145a8-6829-4d4e-9e00-652128ea600b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:27.351704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d53145a8-6829-4d4e-9e00-652128ea600b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:27.796368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d53145a8-6829-4d4e-9e00-652128ea600b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:27.808072 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d53145a8-6829-4d4e-9e00-652128ea600b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1333 microversion: 2.1 time: 0.496364 May 19 04:33:27.809137 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 297/607] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:27 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1333 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:27.815383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:27.816244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:27.832132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:27.833667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:27.834729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:27.835509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:27.978523 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8baf281e-7292-4f59-ade4-23c6ce4680ab tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287/action" status: 202 len: 0 microversion: 2.1 time: 3.433890 May 19 04:33:27.979139 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 311/608] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:33:24 2022] POST /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287/action => generated 0 bytes in 3435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:33:27.986263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-69cec5ab-fd7c-4187-a3d7-1633efc25ccc req-db919284-81c6-4f19-9b44-84a8799f6b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae6a03f-375c-4b42-8544-59df1ba8cef5", "name": "network-vif-deleted", "tag": "d3dc1818-db8c-4b28-b68c-3ab4103e42d9"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:28.027071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-69cec5ab-fd7c-4187-a3d7-1633efc25ccc req-db919284-81c6-4f19-9b44-84a8799f6b27 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.027873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-69cec5ab-fd7c-4187-a3d7-1633efc25ccc req-db919284-81c6-4f19-9b44-84a8799f6b27 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.056214 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-69cec5ab-fd7c-4187-a3d7-1633efc25ccc req-db919284-81c6-4f19-9b44-84a8799f6b27 service nova] Creating event network-vif-deleted:d3dc1818-db8c-4b28-b68c-3ab4103e42d9 for instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 on n-h2-766726-30 May 19 04:33:28.063926 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-69cec5ab-fd7c-4187-a3d7-1633efc25ccc req-db919284-81c6-4f19-9b44-84a8799f6b27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082779 May 19 04:33:28.065395 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 312/609] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:28.071660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13120070-7915-4785-95e2-66b2224ea5e8 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Calling method '.version_select at 0x7fd3160d5dc0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:28.184027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:28.195779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13120070-7915-4785-95e2-66b2224ea5e8 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.197172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13120070-7915-4785-95e2-66b2224ea5e8 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.198289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13120070-7915-4785-95e2-66b2224ea5e8 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.198996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13120070-7915-4785-95e2-66b2224ea5e8 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.226525 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13120070-7915-4785-95e2-66b2224ea5e8 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/cdc783ea476a458181affcf072f63bf0/detail" status: 200 len: 672 microversion: 2.36 time: 0.158819 May 19 04:33:28.227942 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 313/610] 10.222.0.58 () {60 vars in 1303 bytes} [Thu May 19 04:33:28 2022] GET /compute/v2.1/os-quota-sets/cdc783ea476a458181affcf072f63bf0/detail => generated 672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:28.234687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-40c49d8b-07c1-4661-a978-f4e74f55310e req-d0bcd8c0-cdf1-411b-96d8-27ead91950a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894949df-7dda-4389-b7bc-ea820a53ffd1", "name": "network-vif-plugged", "status": "completed", "tag": "8be6a741-ebd0-4f13-99c9-b902a49319b3"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:28.248087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-40c49d8b-07c1-4661-a978-f4e74f55310e req-d0bcd8c0-cdf1-411b-96d8-27ead91950a4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.248921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-40c49d8b-07c1-4661-a978-f4e74f55310e req-d0bcd8c0-cdf1-411b-96d8-27ead91950a4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.251892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:28.265360 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-40c49d8b-07c1-4661-a978-f4e74f55310e req-d0bcd8c0-cdf1-411b-96d8-27ead91950a4 service nova] Creating event network-vif-plugged:8be6a741-ebd0-4f13-99c9-b902a49319b3 for instance 894949df-7dda-4389-b7bc-ea820a53ffd1 on n-h2-766726-30 May 19 04:33:28.267046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:28.271932 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-40c49d8b-07c1-4661-a978-f4e74f55310e req-d0bcd8c0-cdf1-411b-96d8-27ead91950a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042343 May 19 04:33:28.273642 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 314/611] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:28.274228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:28.275676 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-561ff890-11fd-4771-acff-7a5b51883056 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1567 microversion: 2.25 time: 0.464965 May 19 04:33:28.290685 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 298/612] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:27 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1567 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:28.291194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17d38ab8-33bd-403c-be8f-1c862e58302c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:28.291194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17d38ab8-33bd-403c-be8f-1c862e58302c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:28.291407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-563b4be8-e951-4412-92f4-10c9bf348b7c tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] Action: 'create', calling method: .version_select at 0x7fd316191f70>, body: {"pool": "non_exist_pool"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:28.319873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17d38ab8-33bd-403c-be8f-1c862e58302c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.320330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17d38ab8-33bd-403c-be8f-1c862e58302c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.321905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17d38ab8-33bd-403c-be8f-1c862e58302c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.322662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17d38ab8-33bd-403c-be8f-1c862e58302c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.455997 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-563b4be8-e951-4412-92f4-10c9bf348b7c tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] HTTP exception thrown: Floating IP pool not found. May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-563b4be8-e951-4412-92f4-10c9bf348b7c tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] Request method failure captured: May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 26 May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihciUH-spMLddM1HNb5bm98oB_P9qz2eP6TnbB5D5V1CLKmnhrDn3wHSmCY5vkML5c1r1IQlZAarbh5pm9cFWU-F65_McZ2CbXjI2ha70-boqx4-fXl0INZolcvQHqK3crwd0aH3pKLZyW-LXjaNI4TgfCI4_7bknJ21cQE-cPT-KwC4 May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: bbb3891e5acb44389b6296e931483c05 May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1054464067 May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:33:28.457671 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bbb3891e5acb44389b6296e931483c05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bbb3891e5acb44389b6296e931483c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bbb3891e5acb44389b6296e931483c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bbb3891e5acb44389b6296e931483c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1054464067 May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: bbb3891e5acb44389b6296e931483c05 May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1054464067 May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FloatingIPsNegativeTestJSON-1054464067-project May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 3dc46143d20046c2aab0e0f12f13917a May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1054464067-project May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: {"pool": "non_exist_pool"} May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: exception: Floating IP pool not found. May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'pool': 'non_exist_pool'}} May 19 04:33:28.459583 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2957, in allocate_floating_ip May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2947, in _get_floating_ip_pool_id_by_name_or_id May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:33:28.460906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-563b4be8-e951-4412-92f4-10c9bf348b7c tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] Returning 404 to user: Floating IP pool not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:33:28.464572 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-563b4be8-e951-4412-92f4-10c9bf348b7c tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.177693 May 19 04:33:28.466785 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 299/613] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:33:28 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:33:28.466785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5f279fd-aea2-40e4-9f05-8f1710ce690c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:28.466785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5f279fd-aea2-40e4-9f05-8f1710ce690c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:28.480503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5f279fd-aea2-40e4-9f05-8f1710ce690c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.480953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5f279fd-aea2-40e4-9f05-8f1710ce690c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.481772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5f279fd-aea2-40e4-9f05-8f1710ce690c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.482212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5f279fd-aea2-40e4-9f05-8f1710ce690c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.604427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5f279fd-aea2-40e4-9f05-8f1710ce690c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:28.619880 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5f279fd-aea2-40e4-9f05-8f1710ce690c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1266 microversion: 2.1 time: 0.158103 May 19 04:33:28.623851 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 300/614] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:28 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:28.635884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d478b6b8-8fcd-45a6-ab90-7561403a0f89 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:28.639243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d478b6b8-8fcd-45a6-ab90-7561403a0f89 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:28.656675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d478b6b8-8fcd-45a6-ab90-7561403a0f89 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.657587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d478b6b8-8fcd-45a6-ab90-7561403a0f89 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.660944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d478b6b8-8fcd-45a6-ab90-7561403a0f89 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.661819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d478b6b8-8fcd-45a6-ab90-7561403a0f89 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.754375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-17d38ab8-33bd-403c-be8f-1c862e58302c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:28.769562 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17d38ab8-33bd-403c-be8f-1c862e58302c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1322 microversion: 2.1 time: 0.492687 May 19 04:33:28.770909 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 315/615] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:28 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:28.776742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-78f06a47-d158-470f-b6c0-43d693d033eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:28.777707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-78f06a47-d158-470f-b6c0-43d693d033eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:28.785227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78f06a47-d158-470f-b6c0-43d693d033eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.786008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78f06a47-d158-470f-b6c0-43d693d033eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.786793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78f06a47-d158-470f-b6c0-43d693d033eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:28.787226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78f06a47-d158-470f-b6c0-43d693d033eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:28.888781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d478b6b8-8fcd-45a6-ab90-7561403a0f89 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:28.899504 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d478b6b8-8fcd-45a6-ab90-7561403a0f89 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1502 microversion: 2.1 time: 0.273005 May 19 04:33:28.900479 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 301/616] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:28 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1502 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:28.905224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-995799fd-2ad6-4a02-8f02-932d6a2b2686 tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] Calling method '.version_select at 0x7fd3161e6790>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:29.022954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG neutronclient.v2_0.client [None req-995799fd-2ad6-4a02-8f02-932d6a2b2686 tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cd40507c-cb32-4d96-973a-bcd383a6f386 could not be found", "detail": ""}} {{(pid=124818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:33:29.023873 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-995799fd-2ad6-4a02-8f02-932d6a2b2686 tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] HTTP exception thrown: Floating IP not found for ID cd40507c-cb32-4d96-973a-bcd383a6f386 May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-995799fd-2ad6-4a02-8f02-932d6a2b2686 tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] Request method failure captured: May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/os-floating-ips/cd40507c-cb32-4d96-973a-bcd383a6f386 HTTP/1.1 May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihciUH-spMLddM1HNb5bm98oB_P9qz2eP6TnbB5D5V1CLKmnhrDn3wHSmCY5vkML5c1r1IQlZAarbh5pm9cFWU-F65_McZ2CbXjI2ha70-boqx4-fXl0INZolcvQHqK3crwd0aH3pKLZyW-LXjaNI4TgfCI4_7bknJ21cQE-cPT-KwC4 May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: bbb3891e5acb44389b6296e931483c05 May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1054464067 May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:33:29.026120 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bbb3891e5acb44389b6296e931483c05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bbb3891e5acb44389b6296e931483c05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bbb3891e5acb44389b6296e931483c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bbb3891e5acb44389b6296e931483c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1054464067 May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: bbb3891e5acb44389b6296e931483c05 May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1054464067 May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FloatingIPsNegativeTestJSON-1054464067-project May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 3dc46143d20046c2aab0e0f12f13917a May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1054464067-project May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: exception: Floating IP not found for ID cd40507c-cb32-4d96-973a-bcd383a6f386 May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'cd40507c-cb32-4d96-973a-bcd383a6f386'} May 19 04:33:29.027469 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:33:29.028326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP cd40507c-cb32-4d96-973a-bcd383a6f386 could not be found May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4859f113-7a15-4968-a906-57f428bb9ff3'] May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID cd40507c-cb32-4d96-973a-bcd383a6f386. May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:29.029848 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID cd40507c-cb32-4d96-973a-bcd383a6f386 May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:33:29.031114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:33:29.032278 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID cd40507c-cb32-4d96-973a-bcd383a6f386 May 19 04:33:29.032278 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:29.032278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-995799fd-2ad6-4a02-8f02-932d6a2b2686 tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] Returning 404 to user: Floating IP not found for ID cd40507c-cb32-4d96-973a-bcd383a6f386 {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:33:29.032278 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-995799fd-2ad6-4a02-8f02-932d6a2b2686 tempest-FloatingIPsNegativeTestJSON-1054464067 tempest-FloatingIPsNegativeTestJSON-1054464067-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/cd40507c-cb32-4d96-973a-bcd383a6f386" status: 404 len: 111 microversion: 2.1 time: 0.129776 May 19 04:33:29.032278 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 302/617] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:33:28 2022] DELETE /compute/v2.1/os-floating-ips/cd40507c-cb32-4d96-973a-bcd383a6f386 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:33:29.042540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Action: 'update', calling method: .version_select at 0x7fd316191a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:29.135464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-78f06a47-d158-470f-b6c0-43d693d033eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:29.150193 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-78f06a47-d158-470f-b6c0-43d693d033eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1318 microversion: 2.1 time: 0.377715 May 19 04:33:29.150448 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 316/618] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:28 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:29.159631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-26f7b66d-7224-44aa-ae63-54dc7f053aca tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:29.160146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-26f7b66d-7224-44aa-ae63-54dc7f053aca tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:29.167045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26f7b66d-7224-44aa-ae63-54dc7f053aca tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.167784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26f7b66d-7224-44aa-ae63-54dc7f053aca tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.168577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26f7b66d-7224-44aa-ae63-54dc7f053aca tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.169264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26f7b66d-7224-44aa-ae63-54dc7f053aca tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.170728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.178085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.179359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.181729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.244487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-26f7b66d-7224-44aa-ae63-54dc7f053aca tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:29.254664 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-26f7b66d-7224-44aa-ae63-54dc7f053aca tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1321 microversion: 2.1 time: 0.100667 May 19 04:33:29.256248 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 317/619] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:29 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1321 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:29.275300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.275750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.276894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.277358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.306692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:29.307594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:29.318891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.320740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.343402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.344074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.402492 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fd9197ee-e732-4979-bdfc-a959f07cf989 tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/cdc783ea476a458181affcf072f63bf0?user_id=bf87d8d56c1e40fb9f669b568ee71439" status: 200 len: 240 microversion: 2.36 time: 0.363696 May 19 04:33:29.409348 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 303/620] 10.222.0.58 () {62 vars in 1383 bytes} [Thu May 19 04:33:29 2022] PUT /compute/v2.1/os-quota-sets/cdc783ea476a458181affcf072f63bf0?user_id=bf87d8d56c1e40fb9f669b568ee71439 => generated 240 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:29.422910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f62cb310-f6a2-4324-924c-c0d22699f4ae tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] Calling method '.version_select at 0x7fd316263ee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:29.589466 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f62cb310-f6a2-4324-924c-c0d22699f4ae tempest-QuotasAdminTestV236-1153243138 tempest-QuotasAdminTestV236-1153243138-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/cdc783ea476a458181affcf072f63bf0?user_id=bf87d8d56c1e40fb9f669b568ee71439" status: 200 len: 282 microversion: 2.36 time: 0.175033 May 19 04:33:29.590443 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 304/621] 10.222.0.58 () {60 vars in 1363 bytes} [Thu May 19 04:33:29 2022] GET /compute/v2.1/os-quota-sets/cdc783ea476a458181affcf072f63bf0?user_id=bf87d8d56c1e40fb9f669b568ee71439 => generated 282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:29.638832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72f20216-e805-453e-8e05-d61a1b09b723 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:29.641177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72f20216-e805-453e-8e05-d61a1b09b723 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:29.653044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72f20216-e805-453e-8e05-d61a1b09b723 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.654102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72f20216-e805-453e-8e05-d61a1b09b723 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.655024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72f20216-e805-453e-8e05-d61a1b09b723 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.657903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72f20216-e805-453e-8e05-d61a1b09b723 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.903145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:29.918871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:29.926546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:29.927914 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bb5ea974-edb6-484e-acff-66050f53a356 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1567 microversion: 2.25 time: 0.632551 May 19 04:33:29.929128 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 318/622] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:29 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1567 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:29.943303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-702afdf4-43ff-4949-bfb2-81ce4a12f7df tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:29.944958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-702afdf4-43ff-4949-bfb2-81ce4a12f7df tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:29.960564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-702afdf4-43ff-4949-bfb2-81ce4a12f7df tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.966463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-702afdf4-43ff-4949-bfb2-81ce4a12f7df tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:29.967579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-702afdf4-43ff-4949-bfb2-81ce4a12f7df tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:29.968759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-702afdf4-43ff-4949-bfb2-81ce4a12f7df tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:30.042130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-72f20216-e805-453e-8e05-d61a1b09b723 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:30.051371 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72f20216-e805-453e-8e05-d61a1b09b723 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1308 microversion: 2.1 time: 0.418092 May 19 04:33:30.052966 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 305/623] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:29 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:33:30.058174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0e5c185d-975b-475a-85e8-b3cbf971868a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:30.059111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0e5c185d-975b-475a-85e8-b3cbf971868a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:30.076183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e5c185d-975b-475a-85e8-b3cbf971868a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:30.081944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e5c185d-975b-475a-85e8-b3cbf971868a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:30.083730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e5c185d-975b-475a-85e8-b3cbf971868a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:30.084411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e5c185d-975b-475a-85e8-b3cbf971868a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:30.320616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-702afdf4-43ff-4949-bfb2-81ce4a12f7df tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:30.334169 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-702afdf4-43ff-4949-bfb2-81ce4a12f7df tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1322 microversion: 2.1 time: 0.403637 May 19 04:33:30.335465 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 319/624] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:29 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:30.342214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6203f04-8019-48a5-abc7-92f0de27b924 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:30.343292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b6203f04-8019-48a5-abc7-92f0de27b924 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:30.354387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6203f04-8019-48a5-abc7-92f0de27b924 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:30.355405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6203f04-8019-48a5-abc7-92f0de27b924 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:30.356654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6203f04-8019-48a5-abc7-92f0de27b924 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:30.357424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6203f04-8019-48a5-abc7-92f0de27b924 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:30.505066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0e5c185d-975b-475a-85e8-b3cbf971868a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:30.521985 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0e5c185d-975b-475a-85e8-b3cbf971868a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1502 microversion: 2.1 time: 0.467582 May 19 04:33:30.522901 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 306/625] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:30 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1502 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:30.536252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a236d126-e40d-4baa-b26c-661093d9c70f tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:30.536881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a236d126-e40d-4baa-b26c-661093d9c70f tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:30.544702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:30.559521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a236d126-e40d-4baa-b26c-661093d9c70f tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:30.560215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a236d126-e40d-4baa-b26c-661093d9c70f tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:30.561231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a236d126-e40d-4baa-b26c-661093d9c70f tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:30.561836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a236d126-e40d-4baa-b26c-661093d9c70f tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:30.660621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b6203f04-8019-48a5-abc7-92f0de27b924 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:30.669465 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6203f04-8019-48a5-abc7-92f0de27b924 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1468 microversion: 2.1 time: 0.332586 May 19 04:33:30.673046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 320/626] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:30 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:30.685772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-99673a91-e50e-46cf-a68e-3170bf61e419 req-d3c74f74-0700-4c5a-8e3d-f23c37cbfb27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c37abf-5b6b-4f1a-905c-102625d80f3f", "name": "network-vif-unplugged", "status": "completed", "tag": "368a33bf-8ca6-4409-b4ff-13c42a72e838"}, {"server_uuid": "ab072e19-b664-4518-b3a1-4d6a31cdbac4", "name": "network-vif-plugged", "status": "completed", "tag": "9f40abdc-237f-468c-bebb-ab83998922c0"}, {"server_uuid": "e60d1fdd-bc27-420a-a4b2-fde586e236ef", "name": "network-vif-plugged", "status": "completed", "tag": "dc1988c4-753a-4d2d-a2af-b6427de33f1a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:30.707491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-99673a91-e50e-46cf-a68e-3170bf61e419 req-d3c74f74-0700-4c5a-8e3d-f23c37cbfb27 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:30.709598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-99673a91-e50e-46cf-a68e-3170bf61e419 req-d3c74f74-0700-4c5a-8e3d-f23c37cbfb27 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:30.746653 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-99673a91-e50e-46cf-a68e-3170bf61e419 req-d3c74f74-0700-4c5a-8e3d-f23c37cbfb27 service nova] Creating event network-vif-unplugged:368a33bf-8ca6-4409-b4ff-13c42a72e838 for instance 64c37abf-5b6b-4f1a-905c-102625d80f3f on n-h2-766726-30 May 19 04:33:30.747224 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-99673a91-e50e-46cf-a68e-3170bf61e419 req-d3c74f74-0700-4c5a-8e3d-f23c37cbfb27 service nova] Creating event network-vif-plugged:9f40abdc-237f-468c-bebb-ab83998922c0 for instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 on n-h2-766726-30 May 19 04:33:30.747725 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-99673a91-e50e-46cf-a68e-3170bf61e419 req-d3c74f74-0700-4c5a-8e3d-f23c37cbfb27 service nova] Creating event network-vif-plugged:dc1988c4-753a-4d2d-a2af-b6427de33f1a for instance e60d1fdd-bc27-420a-a4b2-fde586e236ef on n-h1-766726-30 May 19 04:33:30.780858 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-99673a91-e50e-46cf-a68e-3170bf61e419 req-d3c74f74-0700-4c5a-8e3d-f23c37cbfb27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.105569 May 19 04:33:30.784721 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 321/627] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:30.793222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9fc1972-1cad-4545-8288-54cc36bd294f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:30.796787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b9fc1972-1cad-4545-8288-54cc36bd294f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:30.806485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9fc1972-1cad-4545-8288-54cc36bd294f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:30.807174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9fc1972-1cad-4545-8288-54cc36bd294f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:30.808322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9fc1972-1cad-4545-8288-54cc36bd294f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:30.809026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9fc1972-1cad-4545-8288-54cc36bd294f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:31.190302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a236d126-e40d-4baa-b26c-661093d9c70f tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:31.200084 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a236d126-e40d-4baa-b26c-661093d9c70f tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.676097 May 19 04:33:31.200677 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 307/628] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:30 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:31.211816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f924d27a-bbdf-4283-939e-9d92013076c9 req-b7843479-0f7c-477d-97e9-77fab3ee13d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c37abf-5b6b-4f1a-905c-102625d80f3f", "name": "network-vif-deleted", "tag": "368a33bf-8ca6-4409-b4ff-13c42a72e838"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:31.241447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f924d27a-bbdf-4283-939e-9d92013076c9 req-b7843479-0f7c-477d-97e9-77fab3ee13d2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:31.246079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f924d27a-bbdf-4283-939e-9d92013076c9 req-b7843479-0f7c-477d-97e9-77fab3ee13d2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:31.268139 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f924d27a-bbdf-4283-939e-9d92013076c9 req-b7843479-0f7c-477d-97e9-77fab3ee13d2 service nova] Creating event network-vif-deleted:368a33bf-8ca6-4409-b4ff-13c42a72e838 for instance 64c37abf-5b6b-4f1a-905c-102625d80f3f on n-h2-766726-30 May 19 04:33:31.280306 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f924d27a-bbdf-4283-939e-9d92013076c9 req-b7843479-0f7c-477d-97e9-77fab3ee13d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071992 May 19 04:33:31.280929 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 308/629] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:31.290532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:31.291254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:31.305274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:31.305737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:31.310936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:31.311483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:31.401421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b9fc1972-1cad-4545-8288-54cc36bd294f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:31.404257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:31.423904 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b9fc1972-1cad-4545-8288-54cc36bd294f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4" status: 200 len: 1318 microversion: 2.1 time: 0.636230 May 19 04:33:31.430108 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 322/630] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:30 2022] GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4 => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:31.444588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e38f0477-e3ce-4666-86b2-db044533a57a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:31.447646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e38f0477-e3ce-4666-86b2-db044533a57a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:31.467405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e38f0477-e3ce-4666-86b2-db044533a57a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:31.469009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e38f0477-e3ce-4666-86b2-db044533a57a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:31.482567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e38f0477-e3ce-4666-86b2-db044533a57a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:31.483377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e38f0477-e3ce-4666-86b2-db044533a57a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:31.721730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:31.731644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:31.738905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:31.742141 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60701ee1-9e07-4d33-8c1e-824039a4cc8e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1542 microversion: 2.25 time: 0.458375 May 19 04:33:31.742925 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 309/631] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:31 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1542 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:31.751376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5cd77e0e-a8c4-472a-ad6a-0807744b4a8c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:31.753396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5cd77e0e-a8c4-472a-ad6a-0807744b4a8c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:31.773806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cd77e0e-a8c4-472a-ad6a-0807744b4a8c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:31.774269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cd77e0e-a8c4-472a-ad6a-0807744b4a8c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:31.775081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cd77e0e-a8c4-472a-ad6a-0807744b4a8c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:31.775520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cd77e0e-a8c4-472a-ad6a-0807744b4a8c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:31.809384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e38f0477-e3ce-4666-86b2-db044533a57a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:31.819121 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e38f0477-e3ce-4666-86b2-db044533a57a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1308 microversion: 2.1 time: 0.387558 May 19 04:33:31.824242 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 323/632] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:31 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1308 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:31.836729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-05fb84cf-21a9-478c-964b-c4fad94c0f4b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:31.837685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-05fb84cf-21a9-478c-964b-c4fad94c0f4b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:31.844072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05fb84cf-21a9-478c-964b-c4fad94c0f4b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:31.857922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05fb84cf-21a9-478c-964b-c4fad94c0f4b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:31.858877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05fb84cf-21a9-478c-964b-c4fad94c0f4b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:31.859422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05fb84cf-21a9-478c-964b-c4fad94c0f4b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:32.056461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5cd77e0e-a8c4-472a-ad6a-0807744b4a8c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:32.077160 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5cd77e0e-a8c4-472a-ad6a-0807744b4a8c tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1322 microversion: 2.1 time: 0.331611 May 19 04:33:32.077977 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 310/633] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:31 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:32.090524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-804f4321-4339-4382-9c39-c8ac5c193427 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '.version_select at 0x7fd31618c040>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:32.099985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-804f4321-4339-4382-9c39-c8ac5c193427 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:32.100492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-804f4321-4339-4382-9c39-c8ac5c193427 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:32.116297 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-804f4321-4339-4382-9c39-c8ac5c193427 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1955 microversion: 2.25 time: 0.036777 May 19 04:33:32.116936 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 311/634] 10.222.0.58 () {60 vars in 1183 bytes} [Thu May 19 04:33:32 2022] GET /compute/v2.1/os-migrations => generated 1955 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:32.140351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-367b4fae-acae-4df5-a1d7-f3038ad0ac71 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:32.141543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-367b4fae-acae-4df5-a1d7-f3038ad0ac71 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:32.155924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-367b4fae-acae-4df5-a1d7-f3038ad0ac71 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:32.157492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-05fb84cf-21a9-478c-964b-c4fad94c0f4b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:32.160807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-367b4fae-acae-4df5-a1d7-f3038ad0ac71 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:32.162018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-367b4fae-acae-4df5-a1d7-f3038ad0ac71 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:32.162537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-367b4fae-acae-4df5-a1d7-f3038ad0ac71 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:32.180516 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-05fb84cf-21a9-478c-964b-c4fad94c0f4b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1502 microversion: 2.1 time: 0.354732 May 19 04:33:32.182349 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 324/635] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:31 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1502 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:32.217174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-10479186-cd0a-4a83-b49a-ce4e32552e9d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:32.217795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-10479186-cd0a-4a83-b49a-ce4e32552e9d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:32.237067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10479186-cd0a-4a83-b49a-ce4e32552e9d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:32.241685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10479186-cd0a-4a83-b49a-ce4e32552e9d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:32.243175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10479186-cd0a-4a83-b49a-ce4e32552e9d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:32.243630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10479186-cd0a-4a83-b49a-ce4e32552e9d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:32.630028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:32.658850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-367b4fae-acae-4df5-a1d7-f3038ad0ac71 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:32.703350 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-367b4fae-acae-4df5-a1d7-f3038ad0ac71 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 2036 microversion: 2.25 time: 0.574322 May 19 04:33:32.710273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-10479186-cd0a-4a83-b49a-ce4e32552e9d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:32.710806 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 312/636] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:32 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 2036 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:32.729752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3228cddf-6759-4096-b5cc-fd5a046c3ad4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:32.730874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3228cddf-6759-4096-b5cc-fd5a046c3ad4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:32.736184 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-10479186-cd0a-4a83-b49a-ce4e32552e9d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.521719 May 19 04:33:32.741674 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 325/637] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:32 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:32.753653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3228cddf-6759-4096-b5cc-fd5a046c3ad4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:32.754401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3228cddf-6759-4096-b5cc-fd5a046c3ad4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:32.755818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3228cddf-6759-4096-b5cc-fd5a046c3ad4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:32.756486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3228cddf-6759-4096-b5cc-fd5a046c3ad4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:32.836619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e2f6828-2aa1-4105-9419-f7b18dcd4ed8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:32.837380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e2f6828-2aa1-4105-9419-f7b18dcd4ed8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:32.852319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e2f6828-2aa1-4105-9419-f7b18dcd4ed8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:32.856732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e2f6828-2aa1-4105-9419-f7b18dcd4ed8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:32.860265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e2f6828-2aa1-4105-9419-f7b18dcd4ed8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:32.866859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e2f6828-2aa1-4105-9419-f7b18dcd4ed8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:33.314092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3228cddf-6759-4096-b5cc-fd5a046c3ad4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:33.331735 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3228cddf-6759-4096-b5cc-fd5a046c3ad4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4" status: 200 len: 1468 microversion: 2.1 time: 0.616507 May 19 04:33:33.334158 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 313/638] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:32 2022] GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4 => generated 1468 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:33.360825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1257666983", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "61be5a1b-718f-4838-b8d3-c8b42b1b073f"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:33.381717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e2f6828-2aa1-4105-9419-f7b18dcd4ed8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:33.397658 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e2f6828-2aa1-4105-9419-f7b18dcd4ed8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1308 microversion: 2.1 time: 0.565150 May 19 04:33:33.398248 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 326/639] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:32 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1308 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:33.413032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f2840d84-451e-4fd7-ac90-8426465c8cd7 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:33.413921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f2840d84-451e-4fd7-ac90-8426465c8cd7 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:33.429316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2840d84-451e-4fd7-ac90-8426465c8cd7 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:33.429969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2840d84-451e-4fd7-ac90-8426465c8cd7 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:33.431002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2840d84-451e-4fd7-ac90-8426465c8cd7 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:33.431615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2840d84-451e-4fd7-ac90-8426465c8cd7 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:33.443685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] validate_networks() for [('61be5a1b-718f-4838-b8d3-c8b42b1b073f', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:33:33.835608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f2840d84-451e-4fd7-ac90-8426465c8cd7 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:33.867391 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f2840d84-451e-4fd7-ac90-8426465c8cd7 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1471 microversion: 2.1 time: 0.458163 May 19 04:33:33.871010 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 327/640] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:33 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1471 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:33.882166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17228190-1d56-46fc-beba-d7003e70e09a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:33.884805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17228190-1d56-46fc-beba-d7003e70e09a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:33.895932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17228190-1d56-46fc-beba-d7003e70e09a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:33.896385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17228190-1d56-46fc-beba-d7003e70e09a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:33.897393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17228190-1d56-46fc-beba-d7003e70e09a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:33.898022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17228190-1d56-46fc-beba-d7003e70e09a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:34.201792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-17228190-1d56-46fc-beba-d7003e70e09a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:34.217803 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17228190-1d56-46fc-beba-d7003e70e09a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1502 microversion: 2.1 time: 0.345683 May 19 04:33:34.218964 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 328/641] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:33 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1502 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:34.224681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5cc1b82c-f0a9-45ca-b336-cc3b9f202a23 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-311395084"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:34.225988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5cc1b82c-f0a9-45ca-b336-cc3b9f202a23 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:34.234553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cc1b82c-f0a9-45ca-b336-cc3b9f202a23 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:34.235324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cc1b82c-f0a9-45ca-b336-cc3b9f202a23 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:34.236963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cc1b82c-f0a9-45ca-b336-cc3b9f202a23 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:34.237595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cc1b82c-f0a9-45ca-b336-cc3b9f202a23 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:34.720223 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5cc1b82c-f0a9-45ca-b336-cc3b9f202a23 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "POST /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4/action" status: 202 len: 0 microversion: 2.1 time: 0.498897 May 19 04:33:34.725841 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 329/642] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:33:34 2022] POST /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:33:34.739952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0ff60edb-ed37-42b1-bf9e-877ea3f687fb req-65ccfe30-dc13-4831-94d8-89d9b7aab796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54201b4d-c068-43c2-bfe0-ea4714da319c", "tag": "78fe9c44-54e2-4ef9-b736-17c7c375e11a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:34.795502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0ff60edb-ed37-42b1-bf9e-877ea3f687fb req-65ccfe30-dc13-4831-94d8-89d9b7aab796 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:34.797979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0ff60edb-ed37-42b1-bf9e-877ea3f687fb req-65ccfe30-dc13-4831-94d8-89d9b7aab796 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:34.807520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:34.808156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:34.808575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:34.809065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:34.809649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:34.822971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:34.827487 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0ff60edb-ed37-42b1-bf9e-877ea3f687fb req-65ccfe30-dc13-4831-94d8-89d9b7aab796 service nova] Creating event network-changed:78fe9c44-54e2-4ef9-b736-17c7c375e11a for instance 54201b4d-c068-43c2-bfe0-ea4714da319c on n-h1-766726-30 May 19 04:33:34.828119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:34.829214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:34.829808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:34.837701 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0ff60edb-ed37-42b1-bf9e-877ea3f687fb req-65ccfe30-dc13-4831-94d8-89d9b7aab796 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108492 May 19 04:33:34.839672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 330/643] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:34.862296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ebbc4fd0-fef3-4e76-b6b3-bccbe9b65ef0 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:34.863357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ebbc4fd0-fef3-4e76-b6b3-bccbe9b65ef0 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:34.873308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebbc4fd0-fef3-4e76-b6b3-bccbe9b65ef0 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:34.874076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebbc4fd0-fef3-4e76-b6b3-bccbe9b65ef0 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:34.875390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebbc4fd0-fef3-4e76-b6b3-bccbe9b65ef0 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:34.876274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebbc4fd0-fef3-4e76-b6b3-bccbe9b65ef0 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:34.894589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Getting quotas for project 6d01f77aa473464b8e32d47e9b9d2a98. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:34.906544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Getting quotas for user 249e284f0cfe4ecda820efeb5956701f and project 6d01f77aa473464b8e32d47e9b9d2a98. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:34.926638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:34.938086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:35.056643 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b360d4e-6b1c-4499-b369-513c4f864561 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.717793 May 19 04:33:35.058520 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 314/644] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:33:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:33:35.243155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ebbc4fd0-fef3-4e76-b6b3-bccbe9b65ef0 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:35.252404 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ebbc4fd0-fef3-4e76-b6b3-bccbe9b65ef0 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.396496 May 19 04:33:35.253002 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 331/645] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:34 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:35.259371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7534491e-660f-4213-befc-3da138955043 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:35.259995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7534491e-660f-4213-befc-3da138955043 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:35.273036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7534491e-660f-4213-befc-3da138955043 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:35.281248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7534491e-660f-4213-befc-3da138955043 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:35.282149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7534491e-660f-4213-befc-3da138955043 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:35.282541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7534491e-660f-4213-befc-3da138955043 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:35.624478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d44ab454-8b9f-4232-ada1-0d046c259be0 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:35.625524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d44ab454-8b9f-4232-ada1-0d046c259be0 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] [instance: a9b5eb02-084f-4b42-a052-47bb4a7b39fb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:35.635795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7534491e-660f-4213-befc-3da138955043 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:35.638369 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-d44ab454-8b9f-4232-ada1-0d046c259be0 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] HTTP exception thrown: Instance a9b5eb02-084f-4b42-a052-47bb4a7b39fb could not be found. May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d44ab454-8b9f-4232-ada1-0d046c259be0 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Request method failure captured: May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/a9b5eb02-084f-4b42-a052-47bb4a7b39fb/action HTTP/1.1 May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 15 May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihciH5JX-h_Hh8aisv4_CaxxtopE8BUcD01BrdXzfaFNCTsPFHqaMaKdvqPu8t3w15ZUt3d5HDV5wN4MYtjYY5JuYdIojUaipjWG1wL30aaTKR8nNjjI83cchkM0sbyAo-Ni-ukgZ5slc-GHX9unNHBkYMWIvbxQtARwD5EW1MinH1ko May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:33:35.642320 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: de22cbe30a034a448ea0664be7927488 May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: {"migrate": {}} May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:33:35.644176 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance a9b5eb02-084f-4b42-a052-47bb4a7b39fb could not be found. May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'a9b5eb02-084f-4b42-a052-47bb4a7b39fb', 'body': {'migrate': {}}} May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b5eb02-084f-4b42-a052-47bb4a7b39fb could not be found. May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:33:35.645384 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b5eb02-084f-4b42-a052-47bb4a7b39fb could not be found. May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b5eb02-084f-4b42-a052-47bb4a7b39fb could not be found. May 19 04:33:35.646615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:35.650135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d44ab454-8b9f-4232-ada1-0d046c259be0 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Returning 404 to user: Instance a9b5eb02-084f-4b42-a052-47bb4a7b39fb could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:33:35.651336 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d44ab454-8b9f-4232-ada1-0d046c259be0 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/a9b5eb02-084f-4b42-a052-47bb4a7b39fb/action" status: 404 len: 111 microversion: 2.1 time: 0.591791 May 19 04:33:35.652437 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 315/646] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:33:35 2022] POST /compute/v2.1/servers/a9b5eb02-084f-4b42-a052-47bb4a7b39fb/action => generated 111 bytes in 593 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:33:35.653836 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7534491e-660f-4213-befc-3da138955043 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1308 microversion: 2.1 time: 0.398075 May 19 04:33:35.659773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f29102c-2bd9-4d50-9e63-bb51b31e8dbf tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31615b430>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:35.663859 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 332/647] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:35 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:35.669310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3862b764-ed46-4b78-9380-07705eef4eeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:35.669927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3862b764-ed46-4b78-9380-07705eef4eeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:35.718907 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f29102c-2bd9-4d50-9e63-bb51b31e8dbf tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.065034 May 19 04:33:35.724925 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 316/648] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:35 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:35.739138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-909d9d22-57cf-4879-88b1-69a0bd56f4d4 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:35.739774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-909d9d22-57cf-4879-88b1-69a0bd56f4d4 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:35.765636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-909d9d22-57cf-4879-88b1-69a0bd56f4d4 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:35.766099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-909d9d22-57cf-4879-88b1-69a0bd56f4d4 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:35.766894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-909d9d22-57cf-4879-88b1-69a0bd56f4d4 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:35.769784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-909d9d22-57cf-4879-88b1-69a0bd56f4d4 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:35.792794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3862b764-ed46-4b78-9380-07705eef4eeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:35.803020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3862b764-ed46-4b78-9380-07705eef4eeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:35.804550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3862b764-ed46-4b78-9380-07705eef4eeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:35.805717 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3862b764-ed46-4b78-9380-07705eef4eeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1262 microversion: 2.25 time: 0.140818 May 19 04:33:35.806290 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 333/649] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:35 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1262 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:35.826270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3e97a1de-0865-45c4-be0e-5b643f816edd req-b0a29271-04c7-4e9c-95b8-7163a267a307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287", "name": "network-vif-unplugged", "status": "completed", "tag": "25a0cf3f-ffa4-47ce-9022-693353a6c37c"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:35.847925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3e97a1de-0865-45c4-be0e-5b643f816edd req-b0a29271-04c7-4e9c-95b8-7163a267a307 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:35.852173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3e97a1de-0865-45c4-be0e-5b643f816edd req-b0a29271-04c7-4e9c-95b8-7163a267a307 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:35.877839 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3e97a1de-0865-45c4-be0e-5b643f816edd req-b0a29271-04c7-4e9c-95b8-7163a267a307 service nova] Creating event network-vif-unplugged:25a0cf3f-ffa4-47ce-9022-693353a6c37c for instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 on n-h1-766726-30 May 19 04:33:35.884114 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3e97a1de-0865-45c4-be0e-5b643f816edd req-b0a29271-04c7-4e9c-95b8-7163a267a307 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076541 May 19 04:33:35.885400 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 334/650] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:35.929770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-639893556", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:36.048081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:33:36.403684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-909d9d22-57cf-4879-88b1-69a0bd56f4d4 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:36.414586 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-909d9d22-57cf-4879-88b1-69a0bd56f4d4 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1502 microversion: 2.1 time: 0.692940 May 19 04:33:36.422383 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 317/651] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:35 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1502 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:36.428578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a0532d22-dd51-40c5-81ca-86bd47a32c91 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:36.429631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a0532d22-dd51-40c5-81ca-86bd47a32c91 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:36.444852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0532d22-dd51-40c5-81ca-86bd47a32c91 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:36.445647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0532d22-dd51-40c5-81ca-86bd47a32c91 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:36.446607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0532d22-dd51-40c5-81ca-86bd47a32c91 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:36.447210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0532d22-dd51-40c5-81ca-86bd47a32c91 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:36.560110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:36.560576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:36.561065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:36.561485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:36.562134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:36.573344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:36.574135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:36.575152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:36.575893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:36.585495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=13 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:36.598497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Getting quotas for project a46295a57a1c4addaff0ab1ad808f5b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:36.604814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Getting quotas for user 95a828a7fc494ba2bb3c9d8e811283a1 and project a46295a57a1c4addaff0ab1ad808f5b2. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:36.619223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:36.622092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:36.717590 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee2afca2-8e18-4eb4-890a-adcc2aa94307 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793655 May 19 04:33:36.719123 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 335/652] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:33:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:33:36.734178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-154a11a4-9b5f-4c10-bf6f-eeaaa5897536 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:36.735169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-154a11a4-9b5f-4c10-bf6f-eeaaa5897536 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:36.745808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-154a11a4-9b5f-4c10-bf6f-eeaaa5897536 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:36.747857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-154a11a4-9b5f-4c10-bf6f-eeaaa5897536 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:36.749161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-154a11a4-9b5f-4c10-bf6f-eeaaa5897536 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:36.749957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-154a11a4-9b5f-4c10-bf6f-eeaaa5897536 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:36.767553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a0532d22-dd51-40c5-81ca-86bd47a32c91 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:36.779985 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a0532d22-dd51-40c5-81ca-86bd47a32c91 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.356091 May 19 04:33:36.783230 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 318/653] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:36 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:36.796052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0cc09fbe-c45a-4af3-8b2f-59751877f998 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:36.796650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0cc09fbe-c45a-4af3-8b2f-59751877f998 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:37.044391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0cc09fbe-c45a-4af3-8b2f-59751877f998 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:37.051862 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0cc09fbe-c45a-4af3-8b2f-59751877f998 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1221 microversion: 2.1 time: 0.267395 May 19 04:33:37.066095 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 319/654] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:36 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1221 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:37.066095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b441990-4e6e-4825-a37d-b38384b71cd5 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31615bd30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:37.172778 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b441990-4e6e-4825-a37d-b38384b71cd5 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.108225 May 19 04:33:37.175232 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 320/655] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:37 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:37.185351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:37.186107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:37.206358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:37.209369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:37.211648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:37.213252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:37.518755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:37.520995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-154a11a4-9b5f-4c10-bf6f-eeaaa5897536 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:37.528934 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-154a11a4-9b5f-4c10-bf6f-eeaaa5897536 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1308 microversion: 2.1 time: 0.808439 May 19 04:33:37.531736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:37.535323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:37.536855 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5546999e-0da4-4ec1-8621-f53948c531b5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1320 microversion: 2.25 time: 0.360377 May 19 04:33:37.538174 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 321/656] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:37 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:37.541569 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 336/657] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:36 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1308 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:37.544346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8b91b4a6-b953-4e24-b28e-384fc077abc0 req-2d20e52e-dd29-4c05-b3eb-7b48988ccfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ebe2e4-9522-4997-9a9f-0b105b071543", "tag": "67a1a435-12f1-4439-b64f-5e6612b0cc13"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:37.550632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff204b02-d0ad-4a79-89b5-8284e2012452 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:37.554538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff204b02-d0ad-4a79-89b5-8284e2012452 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:37.554982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8b91b4a6-b953-4e24-b28e-384fc077abc0 req-2d20e52e-dd29-4c05-b3eb-7b48988ccfc8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:37.555581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8b91b4a6-b953-4e24-b28e-384fc077abc0 req-2d20e52e-dd29-4c05-b3eb-7b48988ccfc8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:37.571082 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8b91b4a6-b953-4e24-b28e-384fc077abc0 req-2d20e52e-dd29-4c05-b3eb-7b48988ccfc8 service nova] Creating event network-changed:67a1a435-12f1-4439-b64f-5e6612b0cc13 for instance c8ebe2e4-9522-4997-9a9f-0b105b071543 on n-h2-766726-30 May 19 04:33:37.571310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff204b02-d0ad-4a79-89b5-8284e2012452 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:37.572180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff204b02-d0ad-4a79-89b5-8284e2012452 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:37.573109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff204b02-d0ad-4a79-89b5-8284e2012452 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:37.573629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff204b02-d0ad-4a79-89b5-8284e2012452 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:37.577273 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8b91b4a6-b953-4e24-b28e-384fc077abc0 req-2d20e52e-dd29-4c05-b3eb-7b48988ccfc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037403 May 19 04:33:37.578229 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 322/658] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:37.741975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-776776146", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": "none"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:37.812469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:37.812980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:37.813702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:37.814277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:37.814818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:37.824902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:37.825469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:37.826546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:37.827061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:37.846024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Getting quotas for project 5dc478015a3e43f387ed88db381b37ed. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:37.851036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Getting quotas for user de3c49b39d4e4a3298a20d6f594846fc and project 5dc478015a3e43f387ed88db381b37ed. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:37.865269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:37.867846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:37.915902 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-58d4b6f1-233b-497b-8717-496cfbb6ee0f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.336244 May 19 04:33:37.917162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 323/659] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:33:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 338 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:33:37.928555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7f8c8364-c298-4829-8bdd-6084d305e3a1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:37.929573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7f8c8364-c298-4829-8bdd-6084d305e3a1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:37.937865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f8c8364-c298-4829-8bdd-6084d305e3a1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:37.939080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f8c8364-c298-4829-8bdd-6084d305e3a1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:37.940875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f8c8364-c298-4829-8bdd-6084d305e3a1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:37.941593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f8c8364-c298-4829-8bdd-6084d305e3a1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:38.365700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff204b02-d0ad-4a79-89b5-8284e2012452 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:38.380977 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff204b02-d0ad-4a79-89b5-8284e2012452 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1502 microversion: 2.1 time: 0.838010 May 19 04:33:38.387365 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 337/660] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:37 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1502 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:38.410842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4b06f590-7759-4bfa-bb80-d70c96ba55f8 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:38.414307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4b06f590-7759-4bfa-bb80-d70c96ba55f8 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:38.479085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b06f590-7759-4bfa-bb80-d70c96ba55f8 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:38.479848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b06f590-7759-4bfa-bb80-d70c96ba55f8 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:38.750298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4b06f590-7759-4bfa-bb80-d70c96ba55f8 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:38.758148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4b06f590-7759-4bfa-bb80-d70c96ba55f8 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:38.759755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4b06f590-7759-4bfa-bb80-d70c96ba55f8 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:38.760947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-4b06f590-7759-4bfa-bb80-d70c96ba55f8 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lazy-loading 'trusted_certs' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:38.791754 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4b06f590-7759-4bfa-bb80-d70c96ba55f8 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "PUT /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1362 microversion: 2.75 time: 0.400894 May 19 04:33:38.800317 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 338/661] 10.222.0.58 () {62 vars in 1296 bytes} [Thu May 19 04:33:38 2022] PUT /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:38.808984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ad55ab2b-5b32-4ffe-b925-b2733f885da2 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:38.809820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ad55ab2b-5b32-4ffe-b925-b2733f885da2 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:38.819376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad55ab2b-5b32-4ffe-b925-b2733f885da2 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:38.819971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad55ab2b-5b32-4ffe-b925-b2733f885da2 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:38.820821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad55ab2b-5b32-4ffe-b925-b2733f885da2 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:38.821443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad55ab2b-5b32-4ffe-b925-b2733f885da2 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:38.876706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7f8c8364-c298-4829-8bdd-6084d305e3a1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:38.887681 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7f8c8364-c298-4829-8bdd-6084d305e3a1 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.963914 May 19 04:33:38.889441 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 324/662] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:37 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:38.899893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a3e68110-4bc0-43b8-aa1e-baf1fe01ef5a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31615bc10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:38.949130 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a3e68110-4bc0-43b8-aa1e-baf1fe01ef5a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.058235 May 19 04:33:38.950075 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 325/663] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:38 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:38.955899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e7b432b7-e1ce-4acb-853e-7a3719fd154d req-f7ce3dd7-dccd-47c9-9c0e-5ff5a57822a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287", "tag": "25a0cf3f-ffa4-47ce-9022-693353a6c37c"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:38.964942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e7b432b7-e1ce-4acb-853e-7a3719fd154d req-f7ce3dd7-dccd-47c9-9c0e-5ff5a57822a9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:38.965505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e7b432b7-e1ce-4acb-853e-7a3719fd154d req-f7ce3dd7-dccd-47c9-9c0e-5ff5a57822a9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:38.980080 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e7b432b7-e1ce-4acb-853e-7a3719fd154d req-f7ce3dd7-dccd-47c9-9c0e-5ff5a57822a9 service nova] Creating event network-changed:25a0cf3f-ffa4-47ce-9022-693353a6c37c for instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 on n-h1-766726-30 May 19 04:33:38.987180 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e7b432b7-e1ce-4acb-853e-7a3719fd154d req-f7ce3dd7-dccd-47c9-9c0e-5ff5a57822a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034980 May 19 04:33:38.987392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ad55ab2b-5b32-4ffe-b925-b2733f885da2 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:38.989425 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 326/664] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:38.997683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8e02c2bf-5dcc-4f7c-945b-583596eeca97 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:38.999137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e02c2bf-5dcc-4f7c-945b-583596eeca97 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:39.009939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e02c2bf-5dcc-4f7c-945b-583596eeca97 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:39.010531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e02c2bf-5dcc-4f7c-945b-583596eeca97 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:39.011700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e02c2bf-5dcc-4f7c-945b-583596eeca97 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:39.012253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e02c2bf-5dcc-4f7c-945b-583596eeca97 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:39.016317 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ad55ab2b-5b32-4ffe-b925-b2733f885da2 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1279 microversion: 2.1 time: 0.212918 May 19 04:33:39.016909 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 339/665] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:38 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1279 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:39.044709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:39.045354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:39.064009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:39.064773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:39.065759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:39.066365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:39.277761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:39.302127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:39.304141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:39.306864 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-33fcbcc9-f984-4b98-8cd0-676a0416c026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1320 microversion: 2.25 time: 0.266052 May 19 04:33:39.311137 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 340/666] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:39 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:39.332218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:39.333891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:39.343360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:39.344267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:39.345473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:39.346824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:39.718049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:39.938045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e02c2bf-5dcc-4f7c-945b-583596eeca97 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:39.949174 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8e02c2bf-5dcc-4f7c-945b-583596eeca97 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1308 microversion: 2.1 time: 0.958102 May 19 04:33:39.957397 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 327/667] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:38 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1308 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:39.959675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:39.978040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:39.984098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4df9aabf-9f3f-4805-ba21-72b54b70729d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:39.984724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:39.985974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4df9aabf-9f3f-4805-ba21-72b54b70729d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:39.997499 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-989d6620-5be9-4e00-9d5f-18f17ab06bff tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1416 microversion: 2.75 time: 0.683200 May 19 04:33:40.000842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4df9aabf-9f3f-4805-ba21-72b54b70729d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:40.006835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4df9aabf-9f3f-4805-ba21-72b54b70729d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:40.009340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4df9aabf-9f3f-4805-ba21-72b54b70729d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:40.010024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4df9aabf-9f3f-4805-ba21-72b54b70729d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:40.021466 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 341/668] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:39 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1416 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:40.027793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-190262df-5449-47ce-8637-6fedf6b73762 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:40.030752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-190262df-5449-47ce-8637-6fedf6b73762 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:40.038547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-190262df-5449-47ce-8637-6fedf6b73762 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:40.039443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-190262df-5449-47ce-8637-6fedf6b73762 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:40.040465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-190262df-5449-47ce-8637-6fedf6b73762 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:40.041121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-190262df-5449-47ce-8637-6fedf6b73762 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:40.414074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-190262df-5449-47ce-8637-6fedf6b73762 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:40.430600 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-190262df-5449-47ce-8637-6fedf6b73762 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.407049 May 19 04:33:40.431408 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 342/669] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:40 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:40.436483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3d133c7e-89d4-4bfa-a018-f8ac79017ce9 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3161248b0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:40.469201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4df9aabf-9f3f-4805-ba21-72b54b70729d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:40.486291 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4df9aabf-9f3f-4805-ba21-72b54b70729d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1502 microversion: 2.1 time: 0.517717 May 19 04:33:40.487154 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 328/670] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:39 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1502 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:40.505861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7fc90f9e-97fe-4075-9fc7-e08c4663d08b tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:40.506928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7fc90f9e-97fe-4075-9fc7-e08c4663d08b tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:40.518424 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3d133c7e-89d4-4bfa-a018-f8ac79017ce9 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.085752 May 19 04:33:40.524273 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 343/671] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:40 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:40.527029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fc90f9e-97fe-4075-9fc7-e08c4663d08b tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:40.527797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fc90f9e-97fe-4075-9fc7-e08c4663d08b tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:40.528799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fc90f9e-97fe-4075-9fc7-e08c4663d08b tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:40.529457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fc90f9e-97fe-4075-9fc7-e08c4663d08b tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:40.534232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:40.536695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:40.550647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:40.552229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:40.555407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:40.556318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:41.346940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7fc90f9e-97fe-4075-9fc7-e08c4663d08b tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:41.393786 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7fc90f9e-97fe-4075-9fc7-e08c4663d08b tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1321 microversion: 2.1 time: 0.894719 May 19 04:33:41.396982 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 329/672] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:40 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1321 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:41.406096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-14eb7899-2521-446c-b913-28f1a118d92c req-11393cd1-0d06-415f-8d84-804d4cd21394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54201b4d-c068-43c2-bfe0-ea4714da319c", "name": "network-vif-plugged", "status": "completed", "tag": "78fe9c44-54e2-4ef9-b736-17c7c375e11a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:41.422016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-14eb7899-2521-446c-b913-28f1a118d92c req-11393cd1-0d06-415f-8d84-804d4cd21394 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:41.424150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-14eb7899-2521-446c-b913-28f1a118d92c req-11393cd1-0d06-415f-8d84-804d4cd21394 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:41.456114 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-14eb7899-2521-446c-b913-28f1a118d92c req-11393cd1-0d06-415f-8d84-804d4cd21394 service nova] Creating event network-vif-plugged:78fe9c44-54e2-4ef9-b736-17c7c375e11a for instance 54201b4d-c068-43c2-bfe0-ea4714da319c on n-h1-766726-30 May 19 04:33:41.466066 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-14eb7899-2521-446c-b913-28f1a118d92c req-11393cd1-0d06-415f-8d84-804d4cd21394 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067397 May 19 04:33:41.467737 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 330/673] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:41.475818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b7a6b80-aed4-49bb-bf70-a3a9268ab9ff tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:41.476876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8b7a6b80-aed4-49bb-bf70-a3a9268ab9ff tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:41.487626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a6b80-aed4-49bb-bf70-a3a9268ab9ff tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:41.489201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a6b80-aed4-49bb-bf70-a3a9268ab9ff tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:41.490436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a6b80-aed4-49bb-bf70-a3a9268ab9ff tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:41.491062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a6b80-aed4-49bb-bf70-a3a9268ab9ff tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:41.538060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:41.562389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:41.573268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:41.576882 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e84ca62a-5e65-4c99-a907-4f1038029559 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1362 microversion: 2.25 time: 1.050565 May 19 04:33:41.583804 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 344/674] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:40 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1362 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:41.605709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:41.607499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:41.638648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:41.639433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:41.640380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:41.641020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:41.922500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:41.936055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:41.944274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:41.953150 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f7927b67-c4f2-4b32-a5dc-ee20e5fdb131 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1416 microversion: 2.75 time: 0.365957 May 19 04:33:41.956190 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 345/675] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:41 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1416 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:41.973161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4060d994-90d7-4930-8826-d80692577fd3 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:41.973983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4060d994-90d7-4930-8826-d80692577fd3 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:41.987962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4060d994-90d7-4930-8826-d80692577fd3 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:41.990037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4060d994-90d7-4930-8826-d80692577fd3 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:41.993098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4060d994-90d7-4930-8826-d80692577fd3 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:41.994073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4060d994-90d7-4930-8826-d80692577fd3 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:42.427298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8b7a6b80-aed4-49bb-bf70-a3a9268ab9ff tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:42.436400 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b7a6b80-aed4-49bb-bf70-a3a9268ab9ff tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1308 microversion: 2.1 time: 0.966254 May 19 04:33:42.436997 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 331/676] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:41 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1308 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:42.450915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1dfc0fd5-afec-4b4e-b90d-4db83e3cc8cd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:42.451886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1dfc0fd5-afec-4b4e-b90d-4db83e3cc8cd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:42.466939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1dfc0fd5-afec-4b4e-b90d-4db83e3cc8cd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:42.469268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1dfc0fd5-afec-4b4e-b90d-4db83e3cc8cd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:42.482369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1dfc0fd5-afec-4b4e-b90d-4db83e3cc8cd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:42.483870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1dfc0fd5-afec-4b4e-b90d-4db83e3cc8cd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:42.724432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4060d994-90d7-4930-8826-d80692577fd3 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:42.732830 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4060d994-90d7-4930-8826-d80692577fd3 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.775502 May 19 04:33:42.733738 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 346/677] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:41 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:42.746701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a407358a-258b-42f8-a1cf-70de147738d6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316138820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:42.835905 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a407358a-258b-42f8-a1cf-70de147738d6 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.100944 May 19 04:33:42.836598 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 347/678] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:42 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:42.856697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5b8af607-7392-4349-9965-5af6dfa902b3 req-64556e27-54fe-4b2f-afe9-b24898a8d7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1323ca85-62b1-4f3b-a681-c83d275db419", "tag": "d23984c8-23da-45a8-bd19-c968bf2fec4a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:42.864432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:42.884799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5b8af607-7392-4349-9965-5af6dfa902b3 req-64556e27-54fe-4b2f-afe9-b24898a8d7a9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:42.887443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5b8af607-7392-4349-9965-5af6dfa902b3 req-64556e27-54fe-4b2f-afe9-b24898a8d7a9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:42.902738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1dfc0fd5-afec-4b4e-b90d-4db83e3cc8cd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:42.916777 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5b8af607-7392-4349-9965-5af6dfa902b3 req-64556e27-54fe-4b2f-afe9-b24898a8d7a9 service nova] Creating event network-changed:d23984c8-23da-45a8-bd19-c968bf2fec4a for instance 1323ca85-62b1-4f3b-a681-c83d275db419 on n-h1-766726-30 May 19 04:33:42.922673 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1dfc0fd5-afec-4b4e-b90d-4db83e3cc8cd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1502 microversion: 2.1 time: 0.480470 May 19 04:33:42.926482 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 332/679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:42 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1502 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:42.931098 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5b8af607-7392-4349-9965-5af6dfa902b3 req-64556e27-54fe-4b2f-afe9-b24898a8d7a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092680 May 19 04:33:42.933552 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 348/680] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:42.945741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b87cd774-f18f-4b26-a674-ce3be6fd99e0 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:42.948685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:42.950004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b87cd774-f18f-4b26-a674-ce3be6fd99e0 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:42.953978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:42.964707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:42.966002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b87cd774-f18f-4b26-a674-ce3be6fd99e0 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:42.966862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b87cd774-f18f-4b26-a674-ce3be6fd99e0 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:42.967951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:42.970720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:42.971415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:42.971563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b87cd774-f18f-4b26-a674-ce3be6fd99e0 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:42.972071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b87cd774-f18f-4b26-a674-ce3be6fd99e0 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:43.927251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:43.939401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:43.945855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:43.948946 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97a51769-0cb7-4ec8-af0d-8dd759e18d3b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1362 microversion: 2.25 time: 1.011219 May 19 04:33:43.952313 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 349/681] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:42 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1362 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:43.968012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:43.968837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:43.986451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:43.987148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:43.988137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:43.988643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.034855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b87cd774-f18f-4b26-a674-ce3be6fd99e0 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:44.052301 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b87cd774-f18f-4b26-a674-ce3be6fd99e0 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1321 microversion: 2.1 time: 1.121344 May 19 04:33:44.065354 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 333/682] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:42 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1321 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:44.071412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5797f88e-c027-4e70-9c72-8e7446959314 req-1aab878b-8120-4daf-bce4-b05a67bff968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc44755-e968-4e75-a8ce-76d6ab964726", "tag": "5bac3271-c20e-44db-a594-acca0467ed52"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:44.080845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5797f88e-c027-4e70-9c72-8e7446959314 req-1aab878b-8120-4daf-bce4-b05a67bff968 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.081315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5797f88e-c027-4e70-9c72-8e7446959314 req-1aab878b-8120-4daf-bce4-b05a67bff968 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.113993 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5797f88e-c027-4e70-9c72-8e7446959314 req-1aab878b-8120-4daf-bce4-b05a67bff968 service nova] Creating event network-changed:5bac3271-c20e-44db-a594-acca0467ed52 for instance 4bc44755-e968-4e75-a8ce-76d6ab964726 on n-h1-766726-30 May 19 04:33:44.119317 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5797f88e-c027-4e70-9c72-8e7446959314 req-1aab878b-8120-4daf-bce4-b05a67bff968 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064822 May 19 04:33:44.127774 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 334/683] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:44.138511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fb88fa2b-0ef2-414d-bfbc-37160cd1816b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:44.143372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fb88fa2b-0ef2-414d-bfbc-37160cd1816b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:44.157290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb88fa2b-0ef2-414d-bfbc-37160cd1816b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.159119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb88fa2b-0ef2-414d-bfbc-37160cd1816b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.162216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb88fa2b-0ef2-414d-bfbc-37160cd1816b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.162940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb88fa2b-0ef2-414d-bfbc-37160cd1816b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.186282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:44.198497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:44.200723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:44.209503 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-482c4b42-a0ab-4d8b-ad1a-2818d1a20c78 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1437 microversion: 2.75 time: 0.255917 May 19 04:33:44.210555 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 350/684] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:43 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1437 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:44.215978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9bb1df93-82c2-4ddc-a01e-7ab2b0810432 req-f69869dc-9eb6-4374-a05d-ab204c5e6ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab072e19-b664-4518-b3a1-4d6a31cdbac4", "name": "network-vif-plugged", "status": "completed", "tag": "9f40abdc-237f-468c-bebb-ab83998922c0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:44.226297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9bb1df93-82c2-4ddc-a01e-7ab2b0810432 req-f69869dc-9eb6-4374-a05d-ab204c5e6ffd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.227011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9bb1df93-82c2-4ddc-a01e-7ab2b0810432 req-f69869dc-9eb6-4374-a05d-ab204c5e6ffd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.258086 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9bb1df93-82c2-4ddc-a01e-7ab2b0810432 req-f69869dc-9eb6-4374-a05d-ab204c5e6ffd service nova] Creating event network-vif-plugged:9f40abdc-237f-468c-bebb-ab83998922c0 for instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 on n-h2-766726-30 May 19 04:33:44.268710 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9bb1df93-82c2-4ddc-a01e-7ab2b0810432 req-f69869dc-9eb6-4374-a05d-ab204c5e6ffd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053540 May 19 04:33:44.269602 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 351/685] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:44.277695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-720ed575-80ae-4f8e-a20a-535be62fe435 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:44.278632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-720ed575-80ae-4f8e-a20a-535be62fe435 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:44.286560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-720ed575-80ae-4f8e-a20a-535be62fe435 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.287299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-720ed575-80ae-4f8e-a20a-535be62fe435 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.288279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-720ed575-80ae-4f8e-a20a-535be62fe435 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.288891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-720ed575-80ae-4f8e-a20a-535be62fe435 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.800809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fb88fa2b-0ef2-414d-bfbc-37160cd1816b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:44.814047 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fb88fa2b-0ef2-414d-bfbc-37160cd1816b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1489 microversion: 2.1 time: 0.680722 May 19 04:33:44.816367 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 335/686] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:44 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1489 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:44.826793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b79b06ce-ca68-4d4b-bcf8-4b7c3b48b1df tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316152c10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:44.841370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-720ed575-80ae-4f8e-a20a-535be62fe435 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:44.858734 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-720ed575-80ae-4f8e-a20a-535be62fe435 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.587247 May 19 04:33:44.868488 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 352/687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:44 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:44.882023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a11418f-0b60-4d8c-85ae-ab3bbb2d6dd8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:44.884309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2a11418f-0b60-4d8c-85ae-ab3bbb2d6dd8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:44.899836 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b79b06ce-ca68-4d4b-bcf8-4b7c3b48b1df tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.080867 May 19 04:33:44.901628 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 336/688] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:44 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:44.909560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:44.915467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a11418f-0b60-4d8c-85ae-ab3bbb2d6dd8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.916289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a11418f-0b60-4d8c-85ae-ab3bbb2d6dd8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.917382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a11418f-0b60-4d8c-85ae-ab3bbb2d6dd8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.918069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a11418f-0b60-4d8c-85ae-ab3bbb2d6dd8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.922852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:44.933385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.938805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:44.939438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:44.939895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:45.128725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:45.131391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:45.132508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:45.133095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:45.133667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:45.232933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:45.270406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:45.293208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:45.293936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:45.296852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:45.297499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:45.485853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2a11418f-0b60-4d8c-85ae-ab3bbb2d6dd8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:45.497219 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a11418f-0b60-4d8c-85ae-ab3bbb2d6dd8 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1502 microversion: 2.1 time: 0.633788 May 19 04:33:45.516234 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 353/689] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:44 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1502 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:45.523196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-57a6b57d-3edb-4e2d-afa6-d6dfcbb6423a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:45.540542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57a6b57d-3edb-4e2d-afa6-d6dfcbb6423a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:45.541745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57a6b57d-3edb-4e2d-afa6-d6dfcbb6423a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:45.715858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-57a6b57d-3edb-4e2d-afa6-d6dfcbb6423a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Going to try to stop instance {{(pid=124819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 04:33:45.728686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:45.738070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:45.752772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:45.778091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6493d15a-e3b2-4672-8dbf-db47176c9e36 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "POST /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06/action" status: 202 len: 1494 microversion: 2.75 time: 0.875144 May 19 04:33:45.778755 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 337/690] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:33:44 2022] POST /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06/action => generated 1494 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 19 04:33:45.810392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:45.812351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:45.837128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:45.838002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:45.839065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:45.839754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:45.889884 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-57a6b57d-3edb-4e2d-afa6-d6dfcbb6423a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c/action" status: 202 len: 0 microversion: 2.1 time: 0.371280 May 19 04:33:45.895842 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 354/691] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:33:45 2022] POST /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:33:45.911402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1c34f0c-74f5-4a58-9f74-c5253a9b9e77 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:45.919438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e1c34f0c-74f5-4a58-9f74-c5253a9b9e77 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:45.949449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1c34f0c-74f5-4a58-9f74-c5253a9b9e77 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:45.950269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1c34f0c-74f5-4a58-9f74-c5253a9b9e77 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:45.951325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1c34f0c-74f5-4a58-9f74-c5253a9b9e77 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:45.951977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1c34f0c-74f5-4a58-9f74-c5253a9b9e77 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:46.602275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:46.617491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:46.628892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:46.638063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:46.641390 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cfbbb8a8-0dc2-4dbd-946e-58ea78e78be1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1362 microversion: 2.25 time: 0.856641 May 19 04:33:46.659651 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 338/692] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:45 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1362 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:46.666313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e1c34f0c-74f5-4a58-9f74-c5253a9b9e77 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:46.667937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:46.668876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:46.681341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:46.683243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:46.684545 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e1c34f0c-74f5-4a58-9f74-c5253a9b9e77 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1321 microversion: 2.1 time: 0.787128 May 19 04:33:46.685015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:46.685188 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 355/693] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:45 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1321 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:46.686903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:46.714217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f20169ca-5679-43f2-97f6-ff77163aab12 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:46.716370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f20169ca-5679-43f2-97f6-ff77163aab12 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:46.731674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f20169ca-5679-43f2-97f6-ff77163aab12 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:46.732204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f20169ca-5679-43f2-97f6-ff77163aab12 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:46.733180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f20169ca-5679-43f2-97f6-ff77163aab12 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:46.733842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f20169ca-5679-43f2-97f6-ff77163aab12 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:46.852571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:46.872749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:46.878137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:46.895965 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d13df2a7-6509-4eee-8067-1a668686ab9e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.234699 May 19 04:33:46.898741 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 339/694] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:46 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:46.930756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64738a1e-88e9-4191-91c7-b17e11b62835 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:46.935879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64738a1e-88e9-4191-91c7-b17e11b62835 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:46.956155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64738a1e-88e9-4191-91c7-b17e11b62835 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:46.956693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64738a1e-88e9-4191-91c7-b17e11b62835 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:46.957730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64738a1e-88e9-4191-91c7-b17e11b62835 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:46.959465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64738a1e-88e9-4191-91c7-b17e11b62835 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:47.288174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f20169ca-5679-43f2-97f6-ff77163aab12 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:47.304507 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f20169ca-5679-43f2-97f6-ff77163aab12 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.617599 May 19 04:33:47.315114 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 356/695] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:46 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:47.321962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8dc0db96-a283-4d44-a099-1fdbc0fa4d47 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316138940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:47.415258 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8dc0db96-a283-4d44-a099-1fdbc0fa4d47 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.098477 May 19 04:33:47.425393 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 357/696] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:47 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:47.431907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-dd4cb6f1-4f3c-437b-aa58-88847d62997f req-f995b018-9295-47b8-bd57-ac363f9d8a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ebe2e4-9522-4997-9a9f-0b105b071543", "name": "network-vif-plugged", "status": "completed", "tag": "67a1a435-12f1-4439-b64f-5e6612b0cc13"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:47.465022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dd4cb6f1-4f3c-437b-aa58-88847d62997f req-f995b018-9295-47b8-bd57-ac363f9d8a7b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:47.465781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dd4cb6f1-4f3c-437b-aa58-88847d62997f req-f995b018-9295-47b8-bd57-ac363f9d8a7b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:47.496046 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-dd4cb6f1-4f3c-437b-aa58-88847d62997f req-f995b018-9295-47b8-bd57-ac363f9d8a7b service nova] Creating event network-vif-plugged:67a1a435-12f1-4439-b64f-5e6612b0cc13 for instance c8ebe2e4-9522-4997-9a9f-0b105b071543 on n-h2-766726-30 May 19 04:33:47.511116 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-dd4cb6f1-4f3c-437b-aa58-88847d62997f req-f995b018-9295-47b8-bd57-ac363f9d8a7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084149 May 19 04:33:47.514128 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 358/697] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:47.519744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75030233-f5b3-44fd-98fd-882c774ffa72 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:47.528289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-75030233-f5b3-44fd-98fd-882c774ffa72 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:47.546463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75030233-f5b3-44fd-98fd-882c774ffa72 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:47.547173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75030233-f5b3-44fd-98fd-882c774ffa72 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:47.548722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75030233-f5b3-44fd-98fd-882c774ffa72 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:47.551564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75030233-f5b3-44fd-98fd-882c774ffa72 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:47.835978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=15 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:47.861226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=76,nova_cell0:UPDATE=7 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:48.466271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-64738a1e-88e9-4191-91c7-b17e11b62835 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:48.478137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-75030233-f5b3-44fd-98fd-882c774ffa72 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:48.492837 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64738a1e-88e9-4191-91c7-b17e11b62835 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 1.586454 May 19 04:33:48.499927 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 340/698] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:46 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:48.500601 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-75030233-f5b3-44fd-98fd-882c774ffa72 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1477 microversion: 2.1 time: 0.982950 May 19 04:33:48.503157 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 359/699] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:47 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1477 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:48.521291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:48.522726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0af0c7fe-d4a3-4845-a1ab-7df79bcf4713 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:48.523589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0af0c7fe-d4a3-4845-a1ab-7df79bcf4713 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:48.527762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:48.550938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0af0c7fe-d4a3-4845-a1ab-7df79bcf4713 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:48.553306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:48.554134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0af0c7fe-d4a3-4845-a1ab-7df79bcf4713 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:48.556343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0af0c7fe-d4a3-4845-a1ab-7df79bcf4713 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:48.558686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:48.559362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0af0c7fe-d4a3-4845-a1ab-7df79bcf4713 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:48.561661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:48.568396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:48.757226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=12 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:49.018037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0af0c7fe-d4a3-4845-a1ab-7df79bcf4713 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:49.033683 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0af0c7fe-d4a3-4845-a1ab-7df79bcf4713 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1321 microversion: 2.1 time: 0.526824 May 19 04:33:49.034573 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 360/700] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:48 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:49.052103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:49.066757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:49.068444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:49.070807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:49.072222 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c51085cf-6312-4ad4-8e30-15bb2c7e446e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1362 microversion: 2.25 time: 0.569457 May 19 04:33:49.072361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:49.079446 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 341/701] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:48 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1362 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:49.085143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b95c4032-b29a-43d1-bac3-a472c5bacee8 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:49.087855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b95c4032-b29a-43d1-bac3-a472c5bacee8 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:49.100516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.101267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:49.102236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.102840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:49.104122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b95c4032-b29a-43d1-bac3-a472c5bacee8 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.104633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b95c4032-b29a-43d1-bac3-a472c5bacee8 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:49.105506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b95c4032-b29a-43d1-bac3-a472c5bacee8 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.105955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b95c4032-b29a-43d1-bac3-a472c5bacee8 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:49.265745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:49.267984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:49.277888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:49.279391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:49.304971 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c2b705f-a568-43e9-a764-b55350a893a9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.269126 May 19 04:33:49.314303 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 361/702] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:49 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:49.326126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ac8db4a-e676-46f8-b32d-92c148bd828f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316613dc0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:49.459453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b95c4032-b29a-43d1-bac3-a472c5bacee8 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:49.475023 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b95c4032-b29a-43d1-bac3-a472c5bacee8 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1388 microversion: 2.1 time: 0.394211 May 19 04:33:49.477902 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 342/703] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:49 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1388 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:49.492194 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4ac8db4a-e676-46f8-b32d-92c148bd828f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.176614 May 19 04:33:49.493609 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 362/704] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:49 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:49.510277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef15f17e-e4a2-4c4c-b1da-3562f7d5df77 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '.version_select at 0x7fd316149310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:49.517969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6ce8e2d-90ab-41b3-b709-6e5c9ac0356d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:49.523379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef15f17e-e4a2-4c4c-b1da-3562f7d5df77 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.524848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b6ce8e2d-90ab-41b3-b709-6e5c9ac0356d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:49.527405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef15f17e-e4a2-4c4c-b1da-3562f7d5df77 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:49.556050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6ce8e2d-90ab-41b3-b709-6e5c9ac0356d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.556511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6ce8e2d-90ab-41b3-b709-6e5c9ac0356d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:49.559408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6ce8e2d-90ab-41b3-b709-6e5c9ac0356d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.559898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6ce8e2d-90ab-41b3-b709-6e5c9ac0356d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:49.562411 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef15f17e-e4a2-4c4c-b1da-3562f7d5df77 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.081840 May 19 04:33:49.565604 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 343/705] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:33:49 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:49.577014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e5d277d9-ea38-4941-80e1-41e11d1d3a10 req-313bf56f-5fb0-42d4-88e0-43d346b27896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1323ca85-62b1-4f3b-a681-c83d275db419", "name": "network-vif-plugged", "status": "completed", "tag": "d23984c8-23da-45a8-bd19-c968bf2fec4a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:49.596537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:49.612110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e5d277d9-ea38-4941-80e1-41e11d1d3a10 req-313bf56f-5fb0-42d4-88e0-43d346b27896 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.616845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e5d277d9-ea38-4941-80e1-41e11d1d3a10 req-313bf56f-5fb0-42d4-88e0-43d346b27896 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:49.647266 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e5d277d9-ea38-4941-80e1-41e11d1d3a10 req-313bf56f-5fb0-42d4-88e0-43d346b27896 service nova] Creating event network-vif-plugged:d23984c8-23da-45a8-bd19-c968bf2fec4a for instance 1323ca85-62b1-4f3b-a681-c83d275db419 on n-h1-766726-30 May 19 04:33:49.662235 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e5d277d9-ea38-4941-80e1-41e11d1d3a10 req-313bf56f-5fb0-42d4-88e0-43d346b27896 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093293 May 19 04:33:49.663152 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 344/706] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:49.678525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d6747be3-31bc-4f0f-ad4a-be5d4ae94c53 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:49.679538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d6747be3-31bc-4f0f-ad4a-be5d4ae94c53 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:49.690346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6747be3-31bc-4f0f-ad4a-be5d4ae94c53 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.690994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6747be3-31bc-4f0f-ad4a-be5d4ae94c53 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:49.691973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6747be3-31bc-4f0f-ad4a-be5d4ae94c53 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:49.694302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6747be3-31bc-4f0f-ad4a-be5d4ae94c53 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:50.202838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b6ce8e2d-90ab-41b3-b709-6e5c9ac0356d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:50.214927 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6ce8e2d-90ab-41b3-b709-6e5c9ac0356d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.701316 May 19 04:33:50.237777 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 363/707] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:49 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:50.243160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31d67379-a409-40c7-8577-cdc99996e776 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:50.244032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31d67379-a409-40c7-8577-cdc99996e776 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:50.263980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d6747be3-31bc-4f0f-ad4a-be5d4ae94c53 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1630 microversion: 2.1 time: 0.599573 May 19 04:33:50.267203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31d67379-a409-40c7-8577-cdc99996e776 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:50.267541 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 345/708] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:49 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1630 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:50.269691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31d67379-a409-40c7-8577-cdc99996e776 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:50.275506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31d67379-a409-40c7-8577-cdc99996e776 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:50.278640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31d67379-a409-40c7-8577-cdc99996e776 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:50.281322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:50.285731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:50.296221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:50.298916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:50.299916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:50.314739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:50.669427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31d67379-a409-40c7-8577-cdc99996e776 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:50.673036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:50.678346 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31d67379-a409-40c7-8577-cdc99996e776 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1321 microversion: 2.1 time: 0.439186 May 19 04:33:50.678949 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 364/709] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:50 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:50.691937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:50.693767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:50.694388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:50.695020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:50.696548 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a50e33ef-d375-4bfd-9dbd-b08300a6dd06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1362 microversion: 2.25 time: 0.427718 May 19 04:33:50.697566 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 346/710] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:50 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:50.702537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef3b37a0-b33a-42e3-8a2e-b7f234bc6fac tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:50.703488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef3b37a0-b33a-42e3-8a2e-b7f234bc6fac tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:50.712241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef3b37a0-b33a-42e3-8a2e-b7f234bc6fac tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:50.713964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef3b37a0-b33a-42e3-8a2e-b7f234bc6fac tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:50.719361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef3b37a0-b33a-42e3-8a2e-b7f234bc6fac tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:50.720128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef3b37a0-b33a-42e3-8a2e-b7f234bc6fac tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:50.722748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:50.727004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:50.730013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:50.730634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:50.870451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:50.887908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:50.889460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:50.902129 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5c4ca365-d968-43d8-9787-645b5be09dd4 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.217313 May 19 04:33:50.914776 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 365/711] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:50 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:50.921963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3d126d6a-ff2c-4b94-81af-9ed72bcd120c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3160d51f0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:50.969054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ef3b37a0-b33a-42e3-8a2e-b7f234bc6fac tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:50.978432 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef3b37a0-b33a-42e3-8a2e-b7f234bc6fac tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1586 microversion: 2.1 time: 0.279305 May 19 04:33:50.992803 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 347/712] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:50 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1586 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:50.999799 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3d126d6a-ff2c-4b94-81af-9ed72bcd120c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.078893 May 19 04:33:51.001100 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 366/713] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:50 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:51.007135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-381442677", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "46fb63e9-6b42-4dee-8db7-bccbd0d35392"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:51.010008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e288af5e-710f-4f9b-920c-b2cd88405533 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:51.019529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e288af5e-710f-4f9b-920c-b2cd88405533 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:51.029541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e288af5e-710f-4f9b-920c-b2cd88405533 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:51.032132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e288af5e-710f-4f9b-920c-b2cd88405533 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:51.033259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e288af5e-710f-4f9b-920c-b2cd88405533 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:51.041375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e288af5e-710f-4f9b-920c-b2cd88405533 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:51.103783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] validate_networks() for [('46fb63e9-6b42-4dee-8db7-bccbd0d35392', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:33:51.317820 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e288af5e-710f-4f9b-920c-b2cd88405533 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.315125 May 19 04:33:51.324357 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 367/714] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:33:51 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:51.330027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ca959a48-4866-47a1-ad1a-9e98418f1f21 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:51.330838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ca959a48-4866-47a1-ad1a-9e98418f1f21 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:51.352612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ca959a48-4866-47a1-ad1a-9e98418f1f21 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:51.356175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ca959a48-4866-47a1-ad1a-9e98418f1f21 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:51.357410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ca959a48-4866-47a1-ad1a-9e98418f1f21 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:51.358044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ca959a48-4866-47a1-ad1a-9e98418f1f21 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:51.860135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ca959a48-4866-47a1-ad1a-9e98418f1f21 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:51.873093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ca959a48-4866-47a1-ad1a-9e98418f1f21 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.543102 May 19 04:33:51.873939 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 368/715] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:51 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:51.881165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-666656c7-9e7f-4d21-92c1-778e4503fd39 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:51.891228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-666656c7-9e7f-4d21-92c1-778e4503fd39 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:51.904476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-666656c7-9e7f-4d21-92c1-778e4503fd39 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:51.908740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-666656c7-9e7f-4d21-92c1-778e4503fd39 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:51.909852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-666656c7-9e7f-4d21-92c1-778e4503fd39 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:51.910463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-666656c7-9e7f-4d21-92c1-778e4503fd39 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.296226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:33:52.297377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:33:52.298609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:33:52.299645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:33:52.300228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:33:52.317577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-666656c7-9e7f-4d21-92c1-778e4503fd39 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:52.325912 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-666656c7-9e7f-4d21-92c1-778e4503fd39 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1470 microversion: 2.1 time: 0.450715 May 19 04:33:52.334959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:52.336245 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 369/716] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:51 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1470 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:52.338638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.339637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:52.341655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.352985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:52.357646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:52.372274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:52.376572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.378283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:52.379975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.400386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Getting quotas for project b2425f9ddc1548958d45215e83aed84e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:33:52.416045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Getting quotas for user 75f651a13b474f09aa3877d1d66b8fc5 and project b2425f9ddc1548958d45215e83aed84e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:33:52.450818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:33:52.454686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:33:52.571353 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-91949f2c-27bc-4685-b288-73f7ba3405dc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576880 May 19 04:33:52.573812 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 348/717] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:33:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:33:52.581129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:52.583205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:52.596608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:52.597281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.598316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:52.598920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.667115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:52.676806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:52.679912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:52.681130 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7851c71f-487d-41ad-9c13-e12456efd9d4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1362 microversion: 2.25 time: 0.343706 May 19 04:33:52.682022 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 370/718] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:52 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:52.686723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e44799d9-8f8e-4757-9536-78d7fcfb4d8b req-4d5aa973-0c04-4cb8-8812-0b654dac0c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc44755-e968-4e75-a8ce-76d6ab964726", "name": "network-vif-plugged", "status": "completed", "tag": "5bac3271-c20e-44db-a594-acca0467ed52"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:52.696642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e44799d9-8f8e-4757-9536-78d7fcfb4d8b req-4d5aa973-0c04-4cb8-8812-0b654dac0c79 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:52.697137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e44799d9-8f8e-4757-9536-78d7fcfb4d8b req-4d5aa973-0c04-4cb8-8812-0b654dac0c79 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.709901 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e44799d9-8f8e-4757-9536-78d7fcfb4d8b req-4d5aa973-0c04-4cb8-8812-0b654dac0c79 service nova] Creating event network-vif-plugged:5bac3271-c20e-44db-a594-acca0467ed52 for instance 4bc44755-e968-4e75-a8ce-76d6ab964726 on n-h1-766726-30 May 19 04:33:52.729329 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e44799d9-8f8e-4757-9536-78d7fcfb4d8b req-4d5aa973-0c04-4cb8-8812-0b654dac0c79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045897 May 19 04:33:52.730161 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 371/719] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:52.751606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-db45ae04-243f-41a6-992d-fb67dcb4cb40 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3161a6550>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:52.787751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:52.822247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:52.828227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:52.839874 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-991d15f5-54f4-4ba9-a2be-7081eabb792e tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.264253 May 19 04:33:52.841208 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 349/720] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:52 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:52.851944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7e57d72-cd36-4c9b-b66f-d0ba4921f958 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:52.852494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b7e57d72-cd36-4c9b-b66f-d0ba4921f958 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:52.859922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7e57d72-cd36-4c9b-b66f-d0ba4921f958 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:52.860692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7e57d72-cd36-4c9b-b66f-d0ba4921f958 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.861524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7e57d72-cd36-4c9b-b66f-d0ba4921f958 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:52.862068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7e57d72-cd36-4c9b-b66f-d0ba4921f958 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:52.893179 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-db45ae04-243f-41a6-992d-fb67dcb4cb40 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.145915 May 19 04:33:52.893785 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 372/721] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:52 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:52.912495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-b7e57d72-cd36-4c9b-b66f-d0ba4921f958 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lazy-loading 'flavor' on Instance uuid 1323ca85-62b1-4f3b-a681-c83d275db419 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:53.054479 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b7e57d72-cd36-4c9b-b66f-d0ba4921f958 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419/action" status: 202 len: 0 microversion: 2.1 time: 0.208146 May 19 04:33:53.055640 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 350/722] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:33:52 2022] POST /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:33:53.069720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-93f8c368-5f99-44c5-9608-108193b82837 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:53.070856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-93f8c368-5f99-44c5-9608-108193b82837 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:53.209787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-93f8c368-5f99-44c5-9608-108193b82837 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:53.224424 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-93f8c368-5f99-44c5-9608-108193b82837 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1210 microversion: 2.1 time: 0.167342 May 19 04:33:53.225014 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 351/723] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:53 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:53.229547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0effcaa7-2416-474d-bfe8-1ca50ac5b7a1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:53.230154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0effcaa7-2416-474d-bfe8-1ca50ac5b7a1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:53.252915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ec1b7b3-6ca8-4541-9ecc-ae397627142f tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Action: 'create', calling method: .version_select at 0x7fd316613430>, body: {"pool": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:53.260419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0effcaa7-2416-474d-bfe8-1ca50ac5b7a1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:53.260868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0effcaa7-2416-474d-bfe8-1ca50ac5b7a1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:53.261690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0effcaa7-2416-474d-bfe8-1ca50ac5b7a1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:53.265294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0effcaa7-2416-474d-bfe8-1ca50ac5b7a1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:53.616876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0effcaa7-2416-474d-bfe8-1ca50ac5b7a1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:53.642722 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0effcaa7-2416-474d-bfe8-1ca50ac5b7a1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.415244 May 19 04:33:53.643839 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 352/724] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:53 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:53.666937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e537967a-3ddb-49cc-b0ce-166eb97275bf tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:53.667773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e537967a-3ddb-49cc-b0ce-166eb97275bf tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:53.691040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e537967a-3ddb-49cc-b0ce-166eb97275bf tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:53.695201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e537967a-3ddb-49cc-b0ce-166eb97275bf tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:53.696835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e537967a-3ddb-49cc-b0ce-166eb97275bf tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:53.722576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e537967a-3ddb-49cc-b0ce-166eb97275bf tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:54.334333 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e537967a-3ddb-49cc-b0ce-166eb97275bf tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1614 microversion: 2.1 time: 0.681855 May 19 04:33:54.337447 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 353/725] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:53 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1614 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:54.366382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:54.370822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:54.390172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:54.393561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:54.397006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:54.397869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:54.638988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:54.642412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:33:54.652948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:54.656336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:54.658235 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c81ab41-4109-4ec7-aa83-36ffaee5e7a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1362 microversion: 2.25 time: 0.317334 May 19 04:33:54.659831 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 354/726] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:54 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:54.683939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:54.689585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:54.697483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:54.708768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:54.709960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:54.712623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:55.013294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:55.034140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:55.038176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:55.058945 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c78fb16-dd0a-4d3f-a9e7-d400987e4916 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.395960 May 19 04:33:55.073113 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 355/727] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:54 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:55.079438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c58de68-e1e9-43d1-b4f2-053a6f467c5f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316191700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:55.157840 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6c58de68-e1e9-43d1-b4f2-053a6f467c5f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.094727 May 19 04:33:55.158687 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 356/728] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:55 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:55.174209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-849ed37a-4b27-4115-8f63-795b5b66640b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:55.174768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-849ed37a-4b27-4115-8f63-795b5b66640b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:55.182992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849ed37a-4b27-4115-8f63-795b5b66640b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:55.183564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849ed37a-4b27-4115-8f63-795b5b66640b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:55.184391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849ed37a-4b27-4115-8f63-795b5b66640b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:55.184888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849ed37a-4b27-4115-8f63-795b5b66640b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:55.661527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-849ed37a-4b27-4115-8f63-795b5b66640b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:55.671744 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-849ed37a-4b27-4115-8f63-795b5b66640b tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1586 microversion: 2.1 time: 0.501800 May 19 04:33:55.671744 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 357/729] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:55 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1586 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:55.687207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2b5ad988-8329-492a-b69a-688a7e38ecb7 req-f1853206-560a-4ece-8adb-289e794fa97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ebe2e4-9522-4997-9a9f-0b105b071543", "tag": "67a1a435-12f1-4439-b64f-5e6612b0cc13"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:55.706704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2b5ad988-8329-492a-b69a-688a7e38ecb7 req-f1853206-560a-4ece-8adb-289e794fa97b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:55.707073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2b5ad988-8329-492a-b69a-688a7e38ecb7 req-f1853206-560a-4ece-8adb-289e794fa97b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:55.737942 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2b5ad988-8329-492a-b69a-688a7e38ecb7 req-f1853206-560a-4ece-8adb-289e794fa97b service nova] Creating event network-changed:67a1a435-12f1-4439-b64f-5e6612b0cc13 for instance c8ebe2e4-9522-4997-9a9f-0b105b071543 on n-h2-766726-30 May 19 04:33:55.749414 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2b5ad988-8329-492a-b69a-688a7e38ecb7 req-f1853206-560a-4ece-8adb-289e794fa97b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076787 May 19 04:33:55.750208 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 358/730] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:55.784603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-494be16d-920a-40bf-b657-c7d9093f090d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:55.785361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-494be16d-920a-40bf-b657-c7d9093f090d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:55.797168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-494be16d-920a-40bf-b657-c7d9093f090d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:55.798077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-494be16d-920a-40bf-b657-c7d9093f090d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:55.798927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-494be16d-920a-40bf-b657-c7d9093f090d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:55.800059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-494be16d-920a-40bf-b657-c7d9093f090d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:56.166387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-494be16d-920a-40bf-b657-c7d9093f090d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:56.177711 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-494be16d-920a-40bf-b657-c7d9093f090d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1268 microversion: 2.1 time: 0.425553 May 19 04:33:56.178605 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 359/731] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:55 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1268 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:56.184596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:56.190131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:56.201856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:56.206232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:56.207324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:56.207929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:56.348298 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] HTTP exception thrown: Cannot 'migrate' instance 1323ca85-62b1-4f3b-a681-c83d275db419 while it is in vm_state suspended May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Request method failure captured: May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419/action HTTP/1.1 May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 15 May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihciH5JX-h_Hh8aisv4_CaxxtopE8BUcD01BrdXzfaFNCTsPFHqaMaKdvqPu8t3w15ZUt3d5HDV5wN4MYtjYY5JuYdIojUaipjWG1wL30aaTKR8nNjjI83cchkM0sbyAo-Ni-ukgZ5slc-GHX9unNHBkYMWIvbxQtARwD5EW1MinH1ko May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:33:56.350179 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: de22cbe30a034a448ea0664be7927488 May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: {"migrate": {}} May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:33:56.351583 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'migrate' instance 1323ca85-62b1-4f3b-a681-c83d275db419 while it is in vm_state suspended May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '1323ca85-62b1-4f3b-a681-c83d275db419', 'body': {'migrate': {}}} May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1323ca85-62b1-4f3b-a681-c83d275db419 in vm_state suspended. Cannot resize while the instance is in this state. May 19 04:33:56.352389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 1323ca85-62b1-4f3b-a681-c83d275db419 while it is in vm_state suspended May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:56.353679 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:56.354934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:56.354934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:56.354934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:33:56.354934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:33:56.354934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 1323ca85-62b1-4f3b-a681-c83d275db419 while it is in vm_state suspended May 19 04:33:56.354934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:56.354934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Returning 409 to user: Cannot 'migrate' instance 1323ca85-62b1-4f3b-a681-c83d275db419 while it is in vm_state suspended {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:33:56.354934 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e35338a-c9da-4784-83bb-9992456bfeae tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419/action" status: 409 len: 148 microversion: 2.1 time: 0.171893 May 19 04:33:56.354934 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 360/732] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:33:56 2022] POST /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419/action => generated 148 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:33:56.359135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7404925-fd6f-44e7-89bd-b41777786150 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:56.359753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7404925-fd6f-44e7-89bd-b41777786150 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:56.367879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7404925-fd6f-44e7-89bd-b41777786150 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:56.368430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7404925-fd6f-44e7-89bd-b41777786150 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:56.369138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7404925-fd6f-44e7-89bd-b41777786150 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:56.369581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7404925-fd6f-44e7-89bd-b41777786150 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:56.848913 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ec1b7b3-6ca8-4541-9ecc-ae397627142f tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.954058 May 19 04:33:56.851960 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 373/733] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:33:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:33:56.858054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:56.859182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:56.881919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a7404925-fd6f-44e7-89bd-b41777786150 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:56.890411 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7404925-fd6f-44e7-89bd-b41777786150 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.535613 May 19 04:33:56.895494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:56.896485 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 361/734] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:56 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:56.896755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:56.898376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:56.899504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:56.903785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:56.906983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:56.920399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:56.920771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:56.923278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:56.924253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:57.150736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:57.170979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:57.178118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:57.186695 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-16c0fac7-4023-4af8-bca8-a11b87aa1b0a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.287862 May 19 04:33:57.190110 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 362/735] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:56 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:57.195241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fd9e0ed4-4611-44a1-a10a-8f21f1663c25 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316191f70>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:57.267322 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fd9e0ed4-4611-44a1-a10a-8f21f1663c25 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.075810 May 19 04:33:57.273644 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 363/736] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:57 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:57.278721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c0c10c2a-5280-449d-b37b-3278f35c96c4 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c0c10c2a-5280-449d-b37b-3278f35c96c4 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Request method failure captured: May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef/action HTTP/1.1 May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 39 May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihciH5JX-h_Hh8aisv4_CaxxtopE8BUcD01BrdXzfaFNCTsPFHqaMaKdvqPu8t3w15ZUt3d5HDV5wN4MYtjYY5JuYdIojUaipjWG1wL30aaTKR8nNjjI83cchkM0sbyAo-Ni-ukgZ5slc-GHX9unNHBkYMWIvbxQtARwD5EW1MinH1ko May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:33:57.281432 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: de22cbe30a034a448ea0664be7927488 May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: {"os-resetState": {"state": "invalid"}} May 19 04:33:57.283981 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'e60d1fdd-bc27-420a-a4b2-fde586e236ef', 'body': {'os-resetState': {'state': 'invalid'}}} May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'invalid' May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:57.284718 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:33:57.286059 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 19 04:33:57.287179 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:33:57.290121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c0c10c2a-5280-449d-b37b-3278f35c96c4 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:33:57.291931 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c0c10c2a-5280-449d-b37b-3278f35c96c4 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef/action" status: 400 len: 144 microversion: 2.1 time: 0.016827 May 19 04:33:57.293156 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 364/737] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:33:57 2022] POST /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:33:57.306330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e9f1c48-664f-4cc0-a754-8593999c1ce4 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Action: 'create', calling method: .version_select at 0x7fd3161df9d0>, body: {"pool": null} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:57.514592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:57.527671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:57.540862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:57.549447 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-772db019-a1ca-4a9b-876a-bdcd5c134ed7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1559 microversion: 2.25 time: 0.696077 May 19 04:33:57.551713 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 374/738] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:56 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1559 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:57.557337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff64f746-05bd-4d0d-8a37-ecf28067c2d9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:57.558437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff64f746-05bd-4d0d-8a37-ecf28067c2d9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:57.565587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff64f746-05bd-4d0d-8a37-ecf28067c2d9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:57.566367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff64f746-05bd-4d0d-8a37-ecf28067c2d9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:57.567373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff64f746-05bd-4d0d-8a37-ecf28067c2d9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:57.568150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff64f746-05bd-4d0d-8a37-ecf28067c2d9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:58.057031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff64f746-05bd-4d0d-8a37-ecf28067c2d9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:58.070704 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff64f746-05bd-4d0d-8a37-ecf28067c2d9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1310 microversion: 2.1 time: 0.517200 May 19 04:33:58.075023 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 375/739] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:57 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1310 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:58.094229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d190ac6f-800e-40be-adbc-1cd54eb9fa19 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d190ac6f-800e-40be-adbc-1cd54eb9fa19 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Request method failure captured: May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef/action HTTP/1.1 May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 31 May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihciH5JX-h_Hh8aisv4_CaxxtopE8BUcD01BrdXzfaFNCTsPFHqaMaKdvqPu8t3w15ZUt3d5HDV5wN4MYtjYY5JuYdIojUaipjWG1wL30aaTKR8nNjjI83cchkM0sbyAo-Ni-ukgZ5slc-GHX9unNHBkYMWIvbxQtARwD5EW1MinH1ko May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:33:58.096735 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: de22cbe30a034a448ea0664be7927488 May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: {"os-resetState": {"state": 1}} May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:33:58.098102 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'e60d1fdd-bc27-420a-a4b2-fde586e236ef', 'body': {'os-resetState': {'state': 1}}} May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 1 May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:33:58.098885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 19 04:33:58.100913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:58.103969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d190ac6f-800e-40be-adbc-1cd54eb9fa19 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:33:58.103969 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d190ac6f-800e-40be-adbc-1cd54eb9fa19 tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef/action" status: 400 len: 120 microversion: 2.1 time: 0.022118 May 19 04:33:58.103969 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 376/740] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:33:58 2022] POST /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef/action => generated 120 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:33:58.108746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0ec1969-635c-41ae-a99f-8b6404fa2975 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:58.109396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d0ec1969-635c-41ae-a99f-8b6404fa2975 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:58.116849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0ec1969-635c-41ae-a99f-8b6404fa2975 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:58.117564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0ec1969-635c-41ae-a99f-8b6404fa2975 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:58.118526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0ec1969-635c-41ae-a99f-8b6404fa2975 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:58.119128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0ec1969-635c-41ae-a99f-8b6404fa2975 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:58.607628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-d0ec1969-635c-41ae-a99f-8b6404fa2975 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 4bc44755-e968-4e75-a8ce-76d6ab964726 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:33:58.636980 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d0ec1969-635c-41ae-a99f-8b6404fa2975 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 2054 microversion: 2.25 time: 0.532819 May 19 04:33:58.644634 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 377/741] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:58 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 2054 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:58.658468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-19d6f36d-f518-4c0b-b20c-5ace0c8dc098 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:58.660339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-19d6f36d-f518-4c0b-b20c-5ace0c8dc098 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:58.673549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19d6f36d-f518-4c0b-b20c-5ace0c8dc098 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:58.674400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19d6f36d-f518-4c0b-b20c-5ace0c8dc098 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:58.675409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19d6f36d-f518-4c0b-b20c-5ace0c8dc098 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:58.677283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19d6f36d-f518-4c0b-b20c-5ace0c8dc098 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:59.040866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-19d6f36d-f518-4c0b-b20c-5ace0c8dc098 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:59.049787 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-19d6f36d-f518-4c0b-b20c-5ace0c8dc098 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.403764 May 19 04:33:59.050441 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 378/742] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:58 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:59.057342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b0be0e4-580f-4193-b294-8686ec0e877d tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:33:59.058937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b0be0e4-580f-4193-b294-8686ec0e877d tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Failed to fetch instance by id 999 {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 04:33:59.059732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-0b0be0e4-580f-4193-b294-8686ec0e877d tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] HTTP exception thrown: Instance 999 could not be found. May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b0be0e4-580f-4193-b294-8686ec0e877d tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Request method failure captured: May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 37 May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihciH5JX-h_Hh8aisv4_CaxxtopE8BUcD01BrdXzfaFNCTsPFHqaMaKdvqPu8t3w15ZUt3d5HDV5wN4MYtjYY5JuYdIojUaipjWG1wL30aaTKR8nNjjI83cchkM0sbyAo-Ni-ukgZ5slc-GHX9unNHBkYMWIvbxQtARwD5EW1MinH1ko May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:33:59.115836 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dfdbd88a22bf487285c5a4468bac808f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: dfdbd88a22bf487285c5a4468bac808f May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1282649815 May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: de22cbe30a034a448ea0664be7927488 May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1282649815-project-admin May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: {"os-resetState": {"state": "error"}} May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:33:59.117992 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 999 could not be found. May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:33:59.118945 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 19 04:33:59.120583 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:33:59.124757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b0be0e4-580f-4193-b294-8686ec0e877d tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:33:59.128330 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b0be0e4-580f-4193-b294-8686ec0e877d tempest-ServersAdminNegativeTestJSON-1282649815 tempest-ServersAdminNegativeTestJSON-1282649815-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.076125 May 19 04:33:59.129143 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 379/743] 10.222.0.58 () {60 vars in 1178 bytes} [Thu May 19 04:33:59 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:33:59.136746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:59.137561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:59.144903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:59.145406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:59.146185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:59.146620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:59.262329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:59.275911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:59.278599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:59.287441 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8174ff5e-50d7-4845-b1cc-c65267b09431 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.153084 May 19 04:33:59.288930 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 380/744] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:33:59 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:33:59.296157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1211f18f-5ba6-4984-a4db-352bb570973f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3160d55e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:59.375183 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1211f18f-5ba6-4984-a4db-352bb570973f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1454 microversion: 2.1 time: 0.084383 May 19 04:33:59.382406 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 381/745] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:33:59 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:59.387444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e524c6eb-8c81-459a-804c-dc9574917d60 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:59.388880 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:33:59.388880 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:33:59.390223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e524c6eb-8c81-459a-804c-dc9574917d60 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:59.390670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e524c6eb-8c81-459a-804c-dc9574917d60 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:59.391715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e524c6eb-8c81-459a-804c-dc9574917d60 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:59.397459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e524c6eb-8c81-459a-804c-dc9574917d60 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:59.424369 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e524c6eb-8c81-459a-804c-dc9574917d60 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.040678 May 19 04:33:59.425737 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 382/746] 10.222.0.58 () {60 vars in 1216 bytes} [Thu May 19 04:33:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:33:59.442673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2fa54a26-14fa-4c6a-98d7-3eb1b5d2174a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:59.443778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2fa54a26-14fa-4c6a-98d7-3eb1b5d2174a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:59.452866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fa54a26-14fa-4c6a-98d7-3eb1b5d2174a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:59.453584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fa54a26-14fa-4c6a-98d7-3eb1b5d2174a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:59.454747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fa54a26-14fa-4c6a-98d7-3eb1b5d2174a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:59.455656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fa54a26-14fa-4c6a-98d7-3eb1b5d2174a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:59.861405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2fa54a26-14fa-4c6a-98d7-3eb1b5d2174a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:33:59.870402 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2fa54a26-14fa-4c6a-98d7-3eb1b5d2174a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1310 microversion: 2.1 time: 0.442406 May 19 04:33:59.879778 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 383/747] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:33:59 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1310 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:33:59.884398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-700e5d38-a29d-43d9-b865-eb56db5ebaa6 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:33:59.884902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-700e5d38-a29d-43d9-b865-eb56db5ebaa6 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:33:59.891068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-700e5d38-a29d-43d9-b865-eb56db5ebaa6 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:59.891524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-700e5d38-a29d-43d9-b865-eb56db5ebaa6 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:59.892290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-700e5d38-a29d-43d9-b865-eb56db5ebaa6 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:33:59.892727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-700e5d38-a29d-43d9-b865-eb56db5ebaa6 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:33:59.918365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-700e5d38-a29d-43d9-b865-eb56db5ebaa6 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:34:00.019119 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-700e5d38-a29d-43d9-b865-eb56db5ebaa6 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 204 len: 0 microversion: 2.1 time: 0.137698 May 19 04:34:00.020306 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 384/748] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:33:59 2022] DELETE /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:34:00.026748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8341fc5c-f6b2-4aa9-92e3-1b3963fe970c req-2dfdb6b2-c112-463a-bb6c-df201b9c963d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2ae1de-c359-4358-ba9a-a978ce719a40", "tag": "a90ed039-62ad-4f8b-b460-aeb6755cd08f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:00.036362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8341fc5c-f6b2-4aa9-92e3-1b3963fe970c req-2dfdb6b2-c112-463a-bb6c-df201b9c963d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:00.036847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8341fc5c-f6b2-4aa9-92e3-1b3963fe970c req-2dfdb6b2-c112-463a-bb6c-df201b9c963d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:00.041812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:00.051939 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8341fc5c-f6b2-4aa9-92e3-1b3963fe970c req-2dfdb6b2-c112-463a-bb6c-df201b9c963d service nova] Creating event network-changed:a90ed039-62ad-4f8b-b460-aeb6755cd08f for instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 on n-h1-766726-30 May 19 04:34:00.065313 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8341fc5c-f6b2-4aa9-92e3-1b3963fe970c req-2dfdb6b2-c112-463a-bb6c-df201b9c963d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043073 May 19 04:34:00.067157 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 385/749] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:00.073498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-01348040-30c7-43a6-819b-b15bad65064f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:00.074382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-01348040-30c7-43a6-819b-b15bad65064f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:00.082659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01348040-30c7-43a6-819b-b15bad65064f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:00.084153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01348040-30c7-43a6-819b-b15bad65064f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:00.085503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01348040-30c7-43a6-819b-b15bad65064f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:00.086249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01348040-30c7-43a6-819b-b15bad65064f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:00.226348 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e9f1c48-664f-4cc0-a754-8593999c1ce4 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.931761 May 19 04:34:00.227551 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 365/750] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:33:57 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:00.233643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f93bdefd-9334-487e-92c2-19084292a17b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:00.234413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f93bdefd-9334-487e-92c2-19084292a17b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:00.241558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f93bdefd-9334-487e-92c2-19084292a17b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:00.242524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f93bdefd-9334-487e-92c2-19084292a17b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:00.243469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f93bdefd-9334-487e-92c2-19084292a17b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:00.244092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f93bdefd-9334-487e-92c2-19084292a17b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:00.276746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-01348040-30c7-43a6-819b-b15bad65064f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:00.287772 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-01348040-30c7-43a6-819b-b15bad65064f tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1467 microversion: 2.1 time: 0.218418 May 19 04:34:00.288969 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 386/751] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:00 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1467 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:00.294256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e09f8c1a-2695-449b-89d1-54914385a30b tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Action: 'create', calling method: .version_select at 0x7fd316076a60>, body: {"pool": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:00.457032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f93bdefd-9334-487e-92c2-19084292a17b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:00.465116 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f93bdefd-9334-487e-92c2-19084292a17b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.236373 May 19 04:34:00.465702 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 366/752] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:00 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:00.473040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:00.474211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:00.481539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:00.482194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:00.482960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:00.483595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:00.826877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:00.835472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:00.837009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:00.841832 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-55fcee22-78c0-40b8-9811-241f633e0b8f tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.374835 May 19 04:34:00.842402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 367/753] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:00 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:00.847607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a1978062-d414-4331-b389-88b475b6ada4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3161df5e0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:00.898331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a1978062-d414-4331-b389-88b475b6ada4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1463 microversion: 2.1 time: 0.054597 May 19 04:34:00.899565 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 368/754] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:00 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1463 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:00.907190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-85e749fe-753b-4b35-8410-de22b431afeb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:00.907825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-85e749fe-753b-4b35-8410-de22b431afeb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:00.913941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85e749fe-753b-4b35-8410-de22b431afeb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:00.914397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85e749fe-753b-4b35-8410-de22b431afeb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:00.915178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85e749fe-753b-4b35-8410-de22b431afeb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:00.915794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85e749fe-753b-4b35-8410-de22b431afeb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:01.124217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-85e749fe-753b-4b35-8410-de22b431afeb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:01.135132 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-85e749fe-753b-4b35-8410-de22b431afeb tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1310 microversion: 2.1 time: 0.234326 May 19 04:34:01.136331 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 369/755] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:00 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1310 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:01.142104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c425b20a-88cf-4556-a8a1-75507a5f84a7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3161df430>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:01.192590 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c425b20a-88cf-4556-a8a1-75507a5f84a7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 200 len: 1463 microversion: 2.1 time: 0.054601 May 19 04:34:01.193589 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 370/756] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:01 2022] GET /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 1463 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:01.215932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-616742f7-d9eb-40ca-9bec-a68ea9b55429 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:01.219532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-616742f7-d9eb-40ca-9bec-a68ea9b55429 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:01.232458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-616742f7-d9eb-40ca-9bec-a68ea9b55429 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:01.235045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-616742f7-d9eb-40ca-9bec-a68ea9b55429 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:01.237415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-616742f7-d9eb-40ca-9bec-a68ea9b55429 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:01.238017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-616742f7-d9eb-40ca-9bec-a68ea9b55429 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:01.595352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-616742f7-d9eb-40ca-9bec-a68ea9b55429 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:01.603151 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-616742f7-d9eb-40ca-9bec-a68ea9b55429 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4" status: 200 len: 1468 microversion: 2.1 time: 0.402304 May 19 04:34:01.603859 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 371/757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:01 2022] GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4 => generated 1468 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:01.609040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3ec43aca-7c6d-49f6-9a0a-809a7e4382be tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:01.609261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3ec43aca-7c6d-49f6-9a0a-809a7e4382be tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:01.626881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ec43aca-7c6d-49f6-9a0a-809a7e4382be tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:01.627508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ec43aca-7c6d-49f6-9a0a-809a7e4382be tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:01.628331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ec43aca-7c6d-49f6-9a0a-809a7e4382be tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:01.628771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ec43aca-7c6d-49f6-9a0a-809a7e4382be tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:02.113466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3ec43aca-7c6d-49f6-9a0a-809a7e4382be tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:02.121118 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3ec43aca-7c6d-49f6-9a0a-809a7e4382be tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1467 microversion: 2.1 time: 0.516245 May 19 04:34:02.121941 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 372/758] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:01 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1467 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:02.127424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2bef7ec2-4ebc-4fdb-9ff6-1cd09e50fb99 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:02.128243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2bef7ec2-4ebc-4fdb-9ff6-1cd09e50fb99 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:02.135421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2bef7ec2-4ebc-4fdb-9ff6-1cd09e50fb99 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:02.136073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2bef7ec2-4ebc-4fdb-9ff6-1cd09e50fb99 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:02.136848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2bef7ec2-4ebc-4fdb-9ff6-1cd09e50fb99 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:02.137346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2bef7ec2-4ebc-4fdb-9ff6-1cd09e50fb99 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:02.352516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:02.559773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2bef7ec2-4ebc-4fdb-9ff6-1cd09e50fb99 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:02.568943 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2bef7ec2-4ebc-4fdb-9ff6-1cd09e50fb99 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.445758 May 19 04:34:02.570348 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 373/759] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:02 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:02.576452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a4a9dde-072b-4c6f-834a-8a043f5da86c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1806712262"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:02.577867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a4a9dde-072b-4c6f-834a-8a043f5da86c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:02.585146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a4a9dde-072b-4c6f-834a-8a043f5da86c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:02.585344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a4a9dde-072b-4c6f-834a-8a043f5da86c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:02.586060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a4a9dde-072b-4c6f-834a-8a043f5da86c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:02.586500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a4a9dde-072b-4c6f-834a-8a043f5da86c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:02.776851 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e09f8c1a-2695-449b-89d1-54914385a30b tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.486307 May 19 04:34:02.784410 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 387/760] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:34:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:02.785155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:02.785808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:02.794925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:02.795373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:02.796282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:02.796952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:02.866925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a4a9dde-072b-4c6f-834a-8a043f5da86c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "POST /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1/action" status: 202 len: 0 microversion: 2.1 time: 0.295655 May 19 04:34:02.867908 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 374/761] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:34:02 2022] POST /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:34:02.884693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b59bb5e-0b6a-4abd-8b39-b944c02d0424 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:02.885404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b59bb5e-0b6a-4abd-8b39-b944c02d0424 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:02.893861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b59bb5e-0b6a-4abd-8b39-b944c02d0424 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:02.894437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b59bb5e-0b6a-4abd-8b39-b944c02d0424 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:02.895306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b59bb5e-0b6a-4abd-8b39-b944c02d0424 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:02.895990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b59bb5e-0b6a-4abd-8b39-b944c02d0424 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:02.912962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:02.927932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:02.930886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:02.940280 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cbe18e09-d1ed-4500-94d3-d8410ae11aa9 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.160888 May 19 04:34:02.941508 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 388/762] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:02 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:02.947489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cbd6d018-c77d-4eff-9041-f682da1bb882 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Action: 'create', calling method: .version_select at 0x7fd3161bdc10>, body: {"pool": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:03.215424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:03.342303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b59bb5e-0b6a-4abd-8b39-b944c02d0424 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:03.354425 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b59bb5e-0b6a-4abd-8b39-b944c02d0424 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1310 microversion: 2.1 time: 0.480861 May 19 04:34:03.357338 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 375/763] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:02 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1310 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:03.362513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f8e17297-ace5-4195-ac7e-966749ef753b tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3161bd040>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:03.442218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f8e17297-ace5-4195-ac7e-966749ef753b tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.085166 May 19 04:34:03.443084 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 376/764] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:03 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:03.447860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:03.448473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:03.455204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:03.455660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:03.456441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:03.456885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:03.490798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:03.491254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:03.491896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lazy-loading 'fault' on Instance uuid 1323ca85-62b1-4f3b-a681-c83d275db419 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:03.827999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:03.830904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:03.837822 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e41ece9-dcd4-4447-bfa5-6fd642f42999 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 200 len: 1311 microversion: 2.1 time: 0.393570 May 19 04:34:03.838424 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 377/765] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:03 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 1311 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:03.843197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b448d277-2d77-4843-ace5-c1dacd336fc9 req-74ff8368-f325-4258-ab41-f11cf42b5b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1323ca85-62b1-4f3b-a681-c83d275db419", "name": "network-vif-deleted", "tag": "d23984c8-23da-45a8-bd19-c968bf2fec4a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:03.852766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b448d277-2d77-4843-ace5-c1dacd336fc9 req-74ff8368-f325-4258-ab41-f11cf42b5b55 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:03.853246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b448d277-2d77-4843-ace5-c1dacd336fc9 req-74ff8368-f325-4258-ab41-f11cf42b5b55 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:03.864357 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b448d277-2d77-4843-ace5-c1dacd336fc9 req-74ff8368-f325-4258-ab41-f11cf42b5b55 service nova] Creating event network-vif-deleted:d23984c8-23da-45a8-bd19-c968bf2fec4a for instance 1323ca85-62b1-4f3b-a681-c83d275db419 on n-h1-766726-30 May 19 04:34:03.869242 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b448d277-2d77-4843-ace5-c1dacd336fc9 req-74ff8368-f325-4258-ab41-f11cf42b5b55 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029669 May 19 04:34:03.869879 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 378/766] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:03.875095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6cb6c0c4-8053-4380-b24b-54c4a612674c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "762da6db-2ec3-4ff6-8915-471258eb696d", "device": "/dev/xvdb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:03.877027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6cb6c0c4-8053-4380-b24b-54c4a612674c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:03.883200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cb6c0c4-8053-4380-b24b-54c4a612674c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:03.883991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cb6c0c4-8053-4380-b24b-54c4a612674c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:03.884775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cb6c0c4-8053-4380-b24b-54c4a612674c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:03.885251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cb6c0c4-8053-4380-b24b-54c4a612674c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:04.219519 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6cb6c0c4-8053-4380-b24b-54c4a612674c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "POST /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.348114 May 19 04:34:04.224718 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 379/767] 10.222.0.58 () {62 vars in 1363 bytes} [Thu May 19 04:34:03 2022] POST /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:34:04.225643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fdb736aa-fbb9-4125-93ad-5f2e8cc77aa9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:04.226355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fdb736aa-fbb9-4125-93ad-5f2e8cc77aa9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:04.232943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdb736aa-fbb9-4125-93ad-5f2e8cc77aa9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:04.233634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdb736aa-fbb9-4125-93ad-5f2e8cc77aa9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:04.234837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdb736aa-fbb9-4125-93ad-5f2e8cc77aa9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:04.235280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdb736aa-fbb9-4125-93ad-5f2e8cc77aa9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:04.479710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fdb736aa-fbb9-4125-93ad-5f2e8cc77aa9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:04.490925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fdb736aa-fbb9-4125-93ad-5f2e8cc77aa9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.269559 May 19 04:34:04.494886 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 380/768] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:04 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:04.499690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:04.505243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:04.517958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:04.519496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:04.520456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:04.521027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:04.604450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:04.619281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:04.620858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:04.627988 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fc122aae-eca2-48e2-a01d-0ace72fa3ec0 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.131859 May 19 04:34:04.628796 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 381/769] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:04 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:04.633620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4abcf04e-6a5f-481f-8817-349705a91bab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:04.634397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4abcf04e-6a5f-481f-8817-349705a91bab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:04.640489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4abcf04e-6a5f-481f-8817-349705a91bab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:04.640967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4abcf04e-6a5f-481f-8817-349705a91bab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:04.641771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4abcf04e-6a5f-481f-8817-349705a91bab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:04.642210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4abcf04e-6a5f-481f-8817-349705a91bab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:04.874798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4abcf04e-6a5f-481f-8817-349705a91bab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:04.885189 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4abcf04e-6a5f-481f-8817-349705a91bab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1310 microversion: 2.1 time: 0.254840 May 19 04:34:04.886225 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 382/770] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:04 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1310 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:04.900330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c4c1c5f-57b5-45f2-97dc-55245c6b6a37 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31608b700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:04.958083 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c4c1c5f-57b5-45f2-97dc-55245c6b6a37 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.061724 May 19 04:34:04.959058 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 383/771] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:04 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:04.963501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:04.964757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: 1323ca85-62b1-4f3b-a681-c83d275db419] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:04.971945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:04.972406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:04.973569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:04.974014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:04.989464 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] HTTP exception thrown: Instance 1323ca85-62b1-4f3b-a681-c83d275db419 could not be found. May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Request method failure captured: May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 HTTP/1.1 May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihciFRHO5i0zXGvstBAneu1N1LEJGtEbAymj_RpKg-xxvhTMd9kCH6f5AWK9JJZjvbTH9GAjaBdKdU_lhVMj0l0NYCGt_Uv2nRjsdt-7ML_fxgZadyLxJoni0fqlZU5grNwYmSyXgWDzIzUxO899-vaTnfZnmXSWOmWBuJ0qD7YbEd-Y May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a46295a57a1c4addaff0ab1ad808f5b2 May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2125135805 May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:34:04.991150 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a46295a57a1c4addaff0ab1ad808f5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a46295a57a1c4addaff0ab1ad808f5b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a46295a57a1c4addaff0ab1ad808f5b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a46295a57a1c4addaff0ab1ad808f5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2125135805 May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a46295a57a1c4addaff0ab1ad808f5b2 May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2125135805 May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersAdminNegativeTestJSON-2125135805-project May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 95a828a7fc494ba2bb3c9d8e811283a1 May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2125135805-project May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 1323ca85-62b1-4f3b-a681-c83d275db419 could not be found. May 19 04:34:04.992806 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '1323ca85-62b1-4f3b-a681-c83d275db419'} May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1323ca85-62b1-4f3b-a681-c83d275db419 could not be found. May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:04.993917 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1323ca85-62b1-4f3b-a681-c83d275db419 could not be found. May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1323ca85-62b1-4f3b-a681-c83d275db419 could not be found. May 19 04:34:04.995297 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:04.997020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Returning 404 to user: Instance 1323ca85-62b1-4f3b-a681-c83d275db419 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:04.997020 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-79ca4081-90ca-449d-9c1a-d889b85ae23d tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419" status: 404 len: 111 microversion: 2.1 time: 0.032887 May 19 04:34:04.997020 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 384/772] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:04 2022] GET /compute/v2.1/servers/1323ca85-62b1-4f3b-a681-c83d275db419 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:34:05.001722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-40376d08-3643-4927-b9d5-43b7ca7c8394 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:05.002201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-40376d08-3643-4927-b9d5-43b7ca7c8394 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:05.008042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40376d08-3643-4927-b9d5-43b7ca7c8394 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.008564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40376d08-3643-4927-b9d5-43b7ca7c8394 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.009423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40376d08-3643-4927-b9d5-43b7ca7c8394 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.009936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40376d08-3643-4927-b9d5-43b7ca7c8394 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.039094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-40376d08-3643-4927-b9d5-43b7ca7c8394 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:34:05.068511 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cbd6d018-c77d-4eff-9041-f682da1bb882 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.125673 May 19 04:34:05.069174 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 389/773] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:34:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:05.080000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f80847ef-4409-47ed-a637-3ad1b51bc7aa tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Calling method '.version_select at 0x7fd315fe9f70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:05.115402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:05.135272 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-40376d08-3643-4927-b9d5-43b7ca7c8394 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 204 len: 0 microversion: 2.1 time: 0.137438 May 19 04:34:05.138787 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 385/774] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:34:04 2022] DELETE /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:34:05.146049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac0e9b4a-b4b6-4365-987e-5e2cc255c9c8 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:05.147550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac0e9b4a-b4b6-4365-987e-5e2cc255c9c8 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:05.157533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0e9b4a-b4b6-4365-987e-5e2cc255c9c8 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.157533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0e9b4a-b4b6-4365-987e-5e2cc255c9c8 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.158094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0e9b4a-b4b6-4365-987e-5e2cc255c9c8 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.158609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0e9b4a-b4b6-4365-987e-5e2cc255c9c8 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.325887 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f80847ef-4409-47ed-a637-3ad1b51bc7aa tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/24743322-883b-485f-b3aa-e59c42107150" status: 200 len: 142 microversion: 2.1 time: 0.250314 May 19 04:34:05.333523 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 390/775] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:34:05 2022] GET /compute/v2.1/os-floating-ips/24743322-883b-485f-b3aa-e59c42107150 => generated 142 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:34:05.340533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3e082fd5-1e90-4326-bf3c-1f23bac6bba7 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Calling method '.version_select at 0x7fd3160764c0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:05.371262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac0e9b4a-b4b6-4365-987e-5e2cc255c9c8 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:05.384666 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac0e9b4a-b4b6-4365-987e-5e2cc255c9c8 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1477 microversion: 2.1 time: 0.244372 May 19 04:34:05.385781 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 386/776] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:05 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1477 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:05.502897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-690660ae-fd75-445a-8a98-3a348dc4932b req-817ff6fa-740b-4b6f-afbc-d74a23429eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab072e19-b664-4518-b3a1-4d6a31cdbac4", "name": "network-vif-unplugged", "status": "completed", "tag": "9f40abdc-237f-468c-bebb-ab83998922c0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:05.519038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-690660ae-fd75-445a-8a98-3a348dc4932b req-817ff6fa-740b-4b6f-afbc-d74a23429eec service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.519773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-690660ae-fd75-445a-8a98-3a348dc4932b req-817ff6fa-740b-4b6f-afbc-d74a23429eec service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.538575 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-690660ae-fd75-445a-8a98-3a348dc4932b req-817ff6fa-740b-4b6f-afbc-d74a23429eec service nova] Creating event network-vif-unplugged:9f40abdc-237f-468c-bebb-ab83998922c0 for instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 on n-h2-766726-30 May 19 04:34:05.548788 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-690660ae-fd75-445a-8a98-3a348dc4932b req-817ff6fa-740b-4b6f-afbc-d74a23429eec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050056 May 19 04:34:05.550515 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 387/777] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:34:05.557375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bda0c5ec-893a-4037-8568-39dd79b0bfc7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:05.558640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bda0c5ec-893a-4037-8568-39dd79b0bfc7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:05.565819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bda0c5ec-893a-4037-8568-39dd79b0bfc7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.566828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bda0c5ec-893a-4037-8568-39dd79b0bfc7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.567754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bda0c5ec-893a-4037-8568-39dd79b0bfc7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.568483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bda0c5ec-893a-4037-8568-39dd79b0bfc7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.848231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bda0c5ec-893a-4037-8568-39dd79b0bfc7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:05.856422 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bda0c5ec-893a-4037-8568-39dd79b0bfc7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.304310 May 19 04:34:05.866739 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 388/778] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:05 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:05.871641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:05.872256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:05.886503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.887670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.887949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.888394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.969428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:05.978264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:05.979949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:05.985994 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5662227d-ec23-4ee4-8b95-10438e18cf56 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.118141 May 19 04:34:05.986721 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 389/779] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:05 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:05.991250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-45e9a072-2e95-48ac-9dc8-732351653e44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:05.991989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-45e9a072-2e95-48ac-9dc8-732351653e44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:05.998083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45e9a072-2e95-48ac-9dc8-732351653e44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:05.998646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45e9a072-2e95-48ac-9dc8-732351653e44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:05.999526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45e9a072-2e95-48ac-9dc8-732351653e44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:06.000634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45e9a072-2e95-48ac-9dc8-732351653e44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:06.205760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-45e9a072-2e95-48ac-9dc8-732351653e44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:06.213783 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-45e9a072-2e95-48ac-9dc8-732351653e44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1310 microversion: 2.1 time: 0.225979 May 19 04:34:06.214722 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 390/780] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:05 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1310 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:06.219537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d539a852-74f4-4baa-b0c5-55994acad9d3 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316089670>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:06.267822 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3e082fd5-1e90-4326-bf3c-1f23bac6bba7 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/24743322-883b-485f-b3aa-e59c42107150" status: 202 len: 0 microversion: 2.1 time: 0.931565 May 19 04:34:06.268899 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 391/781] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:34:05 2022] DELETE /compute/v2.1/os-floating-ips/24743322-883b-485f-b3aa-e59c42107150 => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:34:06.273354 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d539a852-74f4-4baa-b0c5-55994acad9d3 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.057792 May 19 04:34:06.274263 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 391/782] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:06 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:06.277974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-320f9800-c317-43da-89cc-14d973e07c2c tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Calling method '.version_select at 0x7fd315fba9d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:06.402224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b01d93f-1033-4b67-bf0c-a7383a1026e5 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:06.402721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7b01d93f-1033-4b67-bf0c-a7383a1026e5 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:06.409952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b01d93f-1033-4b67-bf0c-a7383a1026e5 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:06.410396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b01d93f-1033-4b67-bf0c-a7383a1026e5 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:06.411163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b01d93f-1033-4b67-bf0c-a7383a1026e5 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:06.411601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b01d93f-1033-4b67-bf0c-a7383a1026e5 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:06.517257 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-320f9800-c317-43da-89cc-14d973e07c2c tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.242974 May 19 04:34:06.517848 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 392/783] 10.222.0.58 () {58 vars in 1163 bytes} [Thu May 19 04:34:06 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:34:06.528959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b89ed6d-0ac6-4a7a-97a0-87f783212bbf tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Calling method '.version_select at 0x7fd31606f310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:06.638551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7b01d93f-1033-4b67-bf0c-a7383a1026e5 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:06.647136 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7b01d93f-1033-4b67-bf0c-a7383a1026e5 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1477 microversion: 2.1 time: 0.248840 May 19 04:34:06.647875 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 392/784] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:06 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1477 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:06.746430 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5b89ed6d-0ac6-4a7a-97a0-87f783212bbf tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.221107 May 19 04:34:06.747028 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 393/785] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:34:06 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:06.761526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-faafb337-7c10-4825-9b5a-35ec0e4b2f11 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Calling method '.version_select at 0x7fd316071310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:06.875091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f70a3eb0-2388-453f-8503-41c1e53a493d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:06.875641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f70a3eb0-2388-453f-8503-41c1e53a493d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:06.886124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f70a3eb0-2388-453f-8503-41c1e53a493d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:06.886710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f70a3eb0-2388-453f-8503-41c1e53a493d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:06.887683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f70a3eb0-2388-453f-8503-41c1e53a493d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:06.888130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f70a3eb0-2388-453f-8503-41c1e53a493d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:07.280021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f70a3eb0-2388-453f-8503-41c1e53a493d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:07.293328 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f70a3eb0-2388-453f-8503-41c1e53a493d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.423114 May 19 04:34:07.294651 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 394/786] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:06 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:07.300714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:07.301862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:07.308611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:07.309426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:07.310726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:07.311678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:07.629689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:07.650283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:07.652060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:07.665126 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cd228137-a799-4821-b496-e8d9ed62e157 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.369171 May 19 04:34:07.665946 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 395/787] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:07 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:07.674185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e062663-b8c3-4336-99d9-4604345caed0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:07.675741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e062663-b8c3-4336-99d9-4604345caed0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:07.686499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e062663-b8c3-4336-99d9-4604345caed0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:07.688438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e062663-b8c3-4336-99d9-4604345caed0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:07.690125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e062663-b8c3-4336-99d9-4604345caed0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:07.690938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e062663-b8c3-4336-99d9-4604345caed0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:08.082041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e062663-b8c3-4336-99d9-4604345caed0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:08.089513 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e062663-b8c3-4336-99d9-4604345caed0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1310 microversion: 2.1 time: 0.419702 May 19 04:34:08.093180 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 396/788] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:07 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1310 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:08.104731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8f61b066-e75d-4b16-b566-b1ffa13bba2c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3160d7280>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:08.190876 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8f61b066-e75d-4b16-b566-b1ffa13bba2c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.095458 May 19 04:34:08.198345 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 397/789] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:08 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:08.205662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6db90799-4229-4789-af8b-25f12727c677 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:08.206475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6db90799-4229-4789-af8b-25f12727c677 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:08.216858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6db90799-4229-4789-af8b-25f12727c677 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:08.217692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6db90799-4229-4789-af8b-25f12727c677 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:08.219972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6db90799-4229-4789-af8b-25f12727c677 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:08.220991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6db90799-4229-4789-af8b-25f12727c677 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:08.417490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6db90799-4229-4789-af8b-25f12727c677 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:08.428616 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6db90799-4229-4789-af8b-25f12727c677 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1435 microversion: 2.1 time: 0.228947 May 19 04:34:08.447424 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 398/790] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:08 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1435 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:08.452489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8c19b248-43c3-484e-b378-12f2515a3731 req-262cea12-0503-470d-8dc6-4934217ae23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2ae1de-c359-4358-ba9a-a978ce719a40", "name": "network-vif-plugged", "status": "completed", "tag": "a90ed039-62ad-4f8b-b460-aeb6755cd08f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:08.468715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8c19b248-43c3-484e-b378-12f2515a3731 req-262cea12-0503-470d-8dc6-4934217ae23e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:08.469904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8c19b248-43c3-484e-b378-12f2515a3731 req-262cea12-0503-470d-8dc6-4934217ae23e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:08.492989 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8c19b248-43c3-484e-b378-12f2515a3731 req-262cea12-0503-470d-8dc6-4934217ae23e service nova] Creating event network-vif-plugged:a90ed039-62ad-4f8b-b460-aeb6755cd08f for instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 on n-h1-766726-30 May 19 04:34:08.498847 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8c19b248-43c3-484e-b378-12f2515a3731 req-262cea12-0503-470d-8dc6-4934217ae23e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050097 May 19 04:34:08.502427 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 399/791] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:08.510524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e855f4c3-5fcc-4cf7-9894-88f25e0ff24f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:08.511529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e855f4c3-5fcc-4cf7-9894-88f25e0ff24f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:08.524478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e855f4c3-5fcc-4cf7-9894-88f25e0ff24f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:08.525147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e855f4c3-5fcc-4cf7-9894-88f25e0ff24f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:08.525948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e855f4c3-5fcc-4cf7-9894-88f25e0ff24f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:08.526391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e855f4c3-5fcc-4cf7-9894-88f25e0ff24f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:08.587412 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-faafb337-7c10-4825-9b5a-35ec0e4b2f11 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/2de1efe3-e56f-433e-9faf-498013c9aceb" status: 202 len: 0 microversion: 2.1 time: 1.830075 May 19 04:34:08.588625 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 393/792] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:34:06 2022] DELETE /compute/v2.1/os-floating-ips/2de1efe3-e56f-433e-9faf-498013c9aceb => generated 0 bytes in 1832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:34:08.595147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-74405566-299a-4d97-9612-cea6b2cf065b req-67556a27-2129-418b-bea0-94398938045e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60d1fdd-bc27-420a-a4b2-fde586e236ef", "name": "network-vif-deleted", "tag": "dc1988c4-753a-4d2d-a2af-b6427de33f1a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:08.623226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-74405566-299a-4d97-9612-cea6b2cf065b req-67556a27-2129-418b-bea0-94398938045e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:08.632063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-74405566-299a-4d97-9612-cea6b2cf065b req-67556a27-2129-418b-bea0-94398938045e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:08.659687 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-74405566-299a-4d97-9612-cea6b2cf065b req-67556a27-2129-418b-bea0-94398938045e service nova] Creating event network-vif-deleted:dc1988c4-753a-4d2d-a2af-b6427de33f1a for instance e60d1fdd-bc27-420a-a4b2-fde586e236ef on n-h1-766726-30 May 19 04:34:08.673227 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-74405566-299a-4d97-9612-cea6b2cf065b req-67556a27-2129-418b-bea0-94398938045e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082757 May 19 04:34:08.674206 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 394/793] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:08.690442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-243ae97d-c5fb-45b6-adee-3631424af2b1 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Calling method '.version_select at 0x7fd316071dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:08.993430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e855f4c3-5fcc-4cf7-9894-88f25e0ff24f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:09.001830 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e855f4c3-5fcc-4cf7-9894-88f25e0ff24f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.498265 May 19 04:34:09.005690 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 400/794] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:08 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:09.024676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:09.025507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:09.043854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:09.045595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:09.046553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:09.056952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:09.212892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:09.227895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:09.238221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:09.244790 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9f0ecf5e-ec8d-49aa-91ab-21c07b6a83bc tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.237849 May 19 04:34:09.258374 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 401/795] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:09 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:09.264282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-37fa6d3c-2684-402a-af49-aa57384e6449 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:09.265067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-37fa6d3c-2684-402a-af49-aa57384e6449 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:09.274453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:09.280342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37fa6d3c-2684-402a-af49-aa57384e6449 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:09.281115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37fa6d3c-2684-402a-af49-aa57384e6449 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:09.282247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37fa6d3c-2684-402a-af49-aa57384e6449 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:09.282837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37fa6d3c-2684-402a-af49-aa57384e6449 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:09.403941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:09.939522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-37fa6d3c-2684-402a-af49-aa57384e6449 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:09.949378 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-37fa6d3c-2684-402a-af49-aa57384e6449 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1310 microversion: 2.1 time: 0.689561 May 19 04:34:09.952055 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 402/796] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:09 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1310 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:09.957248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8cced16a-9e49-4ecf-9fe0-50a678523e1b tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3160d7280>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:10.025723 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8cced16a-9e49-4ecf-9fe0-50a678523e1b tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.072662 May 19 04:34:10.026539 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 403/797] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:09 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:10.037012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:10.037852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:10.045448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.046143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:10.047135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.047741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:10.084390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.085037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:10.085867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lazy-loading 'fault' on Instance uuid e60d1fdd-bc27-420a-a4b2-fde586e236ef {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:10.163144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a828a7fc494ba2bb3c9d8e811283a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46295a57a1c4addaff0ab1ad808f5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:10.172965 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c8dc96e-e2c2-480c-911b-0da5be447eb3 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 200 len: 1312 microversion: 2.1 time: 0.140260 May 19 04:34:10.174103 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 404/798] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:10 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:10.187840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-262b3573-c394-4b6d-9cab-e4ed81ab2ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:10.189638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-262b3573-c394-4b6d-9cab-e4ed81ab2ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:10.196888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-262b3573-c394-4b6d-9cab-e4ed81ab2ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.198081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-262b3573-c394-4b6d-9cab-e4ed81ab2ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:10.199054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-262b3573-c394-4b6d-9cab-e4ed81ab2ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.199925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-262b3573-c394-4b6d-9cab-e4ed81ab2ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:10.609438 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-243ae97d-c5fb-45b6-adee-3631424af2b1 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/762275ea-a869-49b6-aa46-48dfbd145c38" status: 202 len: 0 microversion: 2.1 time: 1.933434 May 19 04:34:10.611057 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 395/799] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:34:08 2022] DELETE /compute/v2.1/os-floating-ips/762275ea-a869-49b6-aa46-48dfbd145c38 => generated 0 bytes in 1936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:34:10.616162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-262b3573-c394-4b6d-9cab-e4ed81ab2ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:10.618110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:10.619017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:10.624166 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-262b3573-c394-4b6d-9cab-e4ed81ab2ee4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.441087 May 19 04:34:10.625245 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 405/800] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:10 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:10.633809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0867dd49-f83d-43f6-97da-a28b86bb9693 req-00bce529-e10c-493b-ab0d-82191fd7c331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894949df-7dda-4389-b7bc-ea820a53ffd1", "name": "network-vif-plugged", "status": "completed", "tag": "8be6a741-ebd0-4f13-99c9-b902a49319b3"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:10.641689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.642442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:10.643384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.644260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:10.651355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0867dd49-f83d-43f6-97da-a28b86bb9693 req-00bce529-e10c-493b-ab0d-82191fd7c331 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.651933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0867dd49-f83d-43f6-97da-a28b86bb9693 req-00bce529-e10c-493b-ab0d-82191fd7c331 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:10.665493 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0867dd49-f83d-43f6-97da-a28b86bb9693 req-00bce529-e10c-493b-ab0d-82191fd7c331 service nova] Creating event network-vif-plugged:8be6a741-ebd0-4f13-99c9-b902a49319b3 for instance 894949df-7dda-4389-b7bc-ea820a53ffd1 on n-h2-766726-30 May 19 04:34:10.673423 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0867dd49-f83d-43f6-97da-a28b86bb9693 req-00bce529-e10c-493b-ab0d-82191fd7c331 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047337 May 19 04:34:10.674806 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 406/801] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:10.690314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48351103-6f7d-4b51-8126-ea70414258d6 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] Calling method '.version_select at 0x7fd31621b8b0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:10.804759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:10.817643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:10.827448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:10.833876 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2895c6d-448b-4227-8801-af6799d2609c tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.221332 May 19 04:34:10.841860 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 396/802] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:10 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:10.966121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-75693fe0-fe8a-4cd2-84b9-8a6fbb704b8c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:10.967231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-75693fe0-fe8a-4cd2-84b9-8a6fbb704b8c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:10.974032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75693fe0-fe8a-4cd2-84b9-8a6fbb704b8c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.974974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75693fe0-fe8a-4cd2-84b9-8a6fbb704b8c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:10.976035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75693fe0-fe8a-4cd2-84b9-8a6fbb704b8c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:10.976692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75693fe0-fe8a-4cd2-84b9-8a6fbb704b8c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:11.296820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-75693fe0-fe8a-4cd2-84b9-8a6fbb704b8c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:11.310839 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-75693fe0-fe8a-4cd2-84b9-8a6fbb704b8c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1493 microversion: 2.1 time: 0.345406 May 19 04:34:11.339360 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 397/803] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:10 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1493 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:11.350543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c13bf72-7381-4bc6-ac02-c75f526cf8b7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3160a9dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:11.492306 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c13bf72-7381-4bc6-ac02-c75f526cf8b7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.151968 May 19 04:34:11.492904 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 398/804] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:11 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:11.502601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:11.508598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] [instance: e60d1fdd-bc27-420a-a4b2-fde586e236ef] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:11.541928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:11.543602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:11.544827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:11.547709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:11.551414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:11.576252 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] HTTP exception thrown: Instance e60d1fdd-bc27-420a-a4b2-fde586e236ef could not be found. May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Request method failure captured: May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef HTTP/1.1 May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihciFRHO5i0zXGvstBAneu1N1LEJGtEbAymj_RpKg-xxvhTMd9kCH6f5AWK9JJZjvbTH9GAjaBdKdU_lhVMj0l0NYCGt_Uv2nRjsdt-7ML_fxgZadyLxJoni0fqlZU5grNwYmSyXgWDzIzUxO899-vaTnfZnmXSWOmWBuJ0qD7YbEd-Y May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a46295a57a1c4addaff0ab1ad808f5b2 May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2125135805 May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:34:11.579318 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a46295a57a1c4addaff0ab1ad808f5b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a46295a57a1c4addaff0ab1ad808f5b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a46295a57a1c4addaff0ab1ad808f5b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a46295a57a1c4addaff0ab1ad808f5b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2125135805 May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a46295a57a1c4addaff0ab1ad808f5b2 May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2125135805 May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersAdminNegativeTestJSON-2125135805-project May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 95a828a7fc494ba2bb3c9d8e811283a1 May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2125135805-project May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance e60d1fdd-bc27-420a-a4b2-fde586e236ef could not be found. May 19 04:34:11.581311 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'e60d1fdd-bc27-420a-a4b2-fde586e236ef'} May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60d1fdd-bc27-420a-a4b2-fde586e236ef could not be found. May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:11.582221 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60d1fdd-bc27-420a-a4b2-fde586e236ef could not be found. May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60d1fdd-bc27-420a-a4b2-fde586e236ef could not be found. May 19 04:34:11.583628 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:11.586170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] Returning 404 to user: Instance e60d1fdd-bc27-420a-a4b2-fde586e236ef could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:11.587459 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef12ebf8-1524-4a8f-8f14-f3885c72e543 tempest-ServersAdminNegativeTestJSON-2125135805 tempest-ServersAdminNegativeTestJSON-2125135805-project] 10.222.0.58 "GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef" status: 404 len: 111 microversion: 2.1 time: 0.093328 May 19 04:34:11.588635 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 399/805] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:11 2022] GET /compute/v2.1/servers/e60d1fdd-bc27-420a-a4b2-fde586e236ef => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:34:11.596452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a3d30b3-f9a4-4308-952f-f74ae95d52b1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:11.597393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a3d30b3-f9a4-4308-952f-f74ae95d52b1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:11.606909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a3d30b3-f9a4-4308-952f-f74ae95d52b1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:11.610047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a3d30b3-f9a4-4308-952f-f74ae95d52b1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:11.611521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a3d30b3-f9a4-4308-952f-f74ae95d52b1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:11.612134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a3d30b3-f9a4-4308-952f-f74ae95d52b1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:12.018648 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a3d30b3-f9a4-4308-952f-f74ae95d52b1 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1646 microversion: 2.1 time: 0.427103 May 19 04:34:12.022130 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 400/806] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:11 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1646 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:12.027393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96f8c717-e3cf-42f4-ab45-91c789d581a9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:12.033554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96f8c717-e3cf-42f4-ab45-91c789d581a9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:12.052605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f8c717-e3cf-42f4-ab45-91c789d581a9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:12.053525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f8c717-e3cf-42f4-ab45-91c789d581a9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:12.062839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f8c717-e3cf-42f4-ab45-91c789d581a9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:12.063296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f8c717-e3cf-42f4-ab45-91c789d581a9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:12.136587 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-48351103-6f7d-4b51-8126-ea70414258d6 tempest-FloatingIPDetailsTestJSON-1450151302 tempest-FloatingIPDetailsTestJSON-1450151302-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/c84b422d-3ada-4398-85f7-dc016c6e7c63" status: 202 len: 0 microversion: 2.1 time: 1.451001 May 19 04:34:12.137820 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 407/807] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:34:10 2022] DELETE /compute/v2.1/os-floating-ips/c84b422d-3ada-4398-85f7-dc016c6e7c63 => generated 0 bytes in 1454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:34:12.145391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:12.146465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:12.168180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:12.168650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:12.173215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:12.173974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:12.709864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:12.726091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:12.728714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:12.744358 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-562efabc-acb2-4c8f-8f78-d95a6c62096d tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.604325 May 19 04:34:12.745534 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 408/808] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:12 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:12.757669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f0f963b-b893-4613-939f-18bf129ecb8e tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:12.759609 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:34:12.759609 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:34:12.765996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0f963b-b893-4613-939f-18bf129ecb8e tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:12.767364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0f963b-b893-4613-939f-18bf129ecb8e tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:12.774489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0f963b-b893-4613-939f-18bf129ecb8e tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:12.775606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0f963b-b893-4613-939f-18bf129ecb8e tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:12.836931 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f0f963b-b893-4613-939f-18bf129ecb8e tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.088361 May 19 04:34:12.840877 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 409/809] 10.222.0.58 () {58 vars in 1175 bytes} [Thu May 19 04:34:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:12.864942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0342f2da-8ee2-4967-be68-b120fd14fdcc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315fe9310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:12.953489 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0342f2da-8ee2-4967-be68-b120fd14fdcc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.110672 May 19 04:34:12.954393 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 410/810] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:12 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:13.049877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-96f8c717-e3cf-42f4-ab45-91c789d581a9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:13.062024 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96f8c717-e3cf-42f4-ab45-91c789d581a9 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 1.038497 May 19 04:34:13.062652 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 401/811] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:12 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:13.772187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:13.773495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:13.803852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:13.804837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:13.805923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:13.806598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:13.950302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:13.966667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:13.967142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-852c1087-f85f-4221-8c69-075eea114a55 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3160714c0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:13.972119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:13.997093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-049abc7d-e0eb-48ec-bb52-097068146ab7 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.236282 May 19 04:34:14.012487 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 411/812] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:13 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:14.069584 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-852c1087-f85f-4221-8c69-075eea114a55 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.107091 May 19 04:34:14.074797 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 402/813] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:13 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:14.080589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1e62363-24ab-4476-94ce-404bf6ee7602 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:14.081359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e1e62363-24ab-4476-94ce-404bf6ee7602 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:14.092551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1e62363-24ab-4476-94ce-404bf6ee7602 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:14.100033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1e62363-24ab-4476-94ce-404bf6ee7602 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:14.102088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1e62363-24ab-4476-94ce-404bf6ee7602 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:14.103092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1e62363-24ab-4476-94ce-404bf6ee7602 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:14.447282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e1e62363-24ab-4476-94ce-404bf6ee7602 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:14.455932 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e1e62363-24ab-4476-94ce-404bf6ee7602 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.380692 May 19 04:34:14.460038 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 412/814] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:14 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:15.021213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:15.022122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:15.039212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:15.040077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:15.041105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:15.045107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:15.083602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a90734c0-7e97-4ba9-95d6-9cf2881215b3 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3161e5940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:15.172186 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a90734c0-7e97-4ba9-95d6-9cf2881215b3 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.092249 May 19 04:34:15.174051 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 413/815] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:15 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:15.231625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:15.258209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:15.259842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:15.275557 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4cbe5f13-9165-47f0-aa06-17cc7c79dc59 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.260668 May 19 04:34:15.278838 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 403/816] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:15 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:15.481962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3be0c389-5f72-4bb2-9c84-845ffc4c1a2d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:15.482966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3be0c389-5f72-4bb2-9c84-845ffc4c1a2d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:15.498946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be0c389-5f72-4bb2-9c84-845ffc4c1a2d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:15.499896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be0c389-5f72-4bb2-9c84-845ffc4c1a2d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:15.501482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be0c389-5f72-4bb2-9c84-845ffc4c1a2d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:15.503014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be0c389-5f72-4bb2-9c84-845ffc4c1a2d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:15.885345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3be0c389-5f72-4bb2-9c84-845ffc4c1a2d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:15.895069 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3be0c389-5f72-4bb2-9c84-845ffc4c1a2d tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.419695 May 19 04:34:15.901261 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 414/817] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:15 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:16.192201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6df45f93-d7d9-4588-a922-cab3d17954ac tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316503430>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:16.276248 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6df45f93-d7d9-4588-a922-cab3d17954ac tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.093703 May 19 04:34:16.277486 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 415/818] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:16 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:16.299327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:16.300248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:16.311450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.316073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.317169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.317775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.322907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:16.413818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fdfdcc3d-cd05-424e-a771-8a81a775a612 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:16.415304 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:34:16.415304 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:34:16.417231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdfdcc3d-cd05-424e-a771-8a81a775a612 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.417648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdfdcc3d-cd05-424e-a771-8a81a775a612 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.418578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdfdcc3d-cd05-424e-a771-8a81a775a612 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.423107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdfdcc3d-cd05-424e-a771-8a81a775a612 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.479729 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fdfdcc3d-cd05-424e-a771-8a81a775a612 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.485129 May 19 04:34:16.484661 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 404/819] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:34:15 2022] GET /compute/v2.1/os-services => generated 949 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:16.495436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7cc72616-4406-42b9-a33b-9fa40decc0d8 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:16.497070 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:34:16.497070 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:34:16.504178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cc72616-4406-42b9-a33b-9fa40decc0d8 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.505488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cc72616-4406-42b9-a33b-9fa40decc0d8 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.506322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cc72616-4406-42b9-a33b-9fa40decc0d8 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.506764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cc72616-4406-42b9-a33b-9fa40decc0d8 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.515471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:16.527832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:16.529419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:16.542046 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bb87da1f-fe7a-413b-8ed7-a11cced9ff65 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1446 microversion: 2.75 time: 0.247358 May 19 04:34:16.542946 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 416/820] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:16 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1446 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:16.565487 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7cc72616-4406-42b9-a33b-9fa40decc0d8 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-766726-30" status: 200 len: 581 microversion: 2.1 time: 0.073900 May 19 04:34:16.573377 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 405/821] 10.222.0.58 () {58 vars in 1173 bytes} [Thu May 19 04:34:16 2022] GET /compute/v2.1/os-services?host=n-d-766726-30 => generated 581 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:16.578979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e374115d-1cff-494f-bbdd-3f54eab118c0 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:16.580304 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:34:16.580304 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:34:16.581581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e374115d-1cff-494f-bbdd-3f54eab118c0 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.582036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e374115d-1cff-494f-bbdd-3f54eab118c0 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.582837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e374115d-1cff-494f-bbdd-3f54eab118c0 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.583267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e374115d-1cff-494f-bbdd-3f54eab118c0 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.634188 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e374115d-1cff-494f-bbdd-3f54eab118c0 tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.058872 May 19 04:34:16.647183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-29ff533f-b132-4c40-bd90-946c288a7b0e tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:16.648746 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:34:16.648746 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:34:16.650218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29ff533f-b132-4c40-bd90-946c288a7b0e tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.650882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29ff533f-b132-4c40-bd90-946c288a7b0e tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.651863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29ff533f-b132-4c40-bd90-946c288a7b0e tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.652470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29ff533f-b132-4c40-bd90-946c288a7b0e tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.653459 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 417/822] 10.222.0.58 () {58 vars in 1175 bytes} [Thu May 19 04:34:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:16.712547 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-29ff533f-b132-4c40-bd90-946c288a7b0e tempest-ServicesAdminTestJSON-1925918424 tempest-ServicesAdminTestJSON-1925918424-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.068943 May 19 04:34:16.713185 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 406/823] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:34:16 2022] GET /compute/v2.1/os-services => generated 949 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:16.912551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-863dcc0a-b985-4c99-b165-33e3a45dec60 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:16.913223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-863dcc0a-b985-4c99-b165-33e3a45dec60 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:16.928305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-863dcc0a-b985-4c99-b165-33e3a45dec60 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.929606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-863dcc0a-b985-4c99-b165-33e3a45dec60 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:16.931552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-863dcc0a-b985-4c99-b165-33e3a45dec60 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:16.933342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-863dcc0a-b985-4c99-b165-33e3a45dec60 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:17.289913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9dd8307a-1617-4ce9-b426-ae1b6c2dfbce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316080d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:17.348263 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9dd8307a-1617-4ce9-b426-ae1b6c2dfbce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.062273 May 19 04:34:17.360146 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 407/824] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:17 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:17.384496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a5c4caf-98e0-4cca-bff5-2060368f94af tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e05601a7-483a-46f1-bbf0-2817b714cdad", "device": "/dev/xvdb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:17.388378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a5c4caf-98e0-4cca-bff5-2060368f94af tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:17.411396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a5c4caf-98e0-4cca-bff5-2060368f94af tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:17.415363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a5c4caf-98e0-4cca-bff5-2060368f94af tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:17.416284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a5c4caf-98e0-4cca-bff5-2060368f94af tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:17.416735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a5c4caf-98e0-4cca-bff5-2060368f94af tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:17.589042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-863dcc0a-b985-4c99-b165-33e3a45dec60 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:17.604042 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-863dcc0a-b985-4c99-b165-33e3a45dec60 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1499 microversion: 2.1 time: 0.695385 May 19 04:34:17.620079 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 418/825] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:16 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1499 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:17.634074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:17.635966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:17.645945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:17.646645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:17.647593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:17.648180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:17.876303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:17.890049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:17.893624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:17.906177 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7dc12e19-37ef-4ba3-90ff-8ed87a11db10 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1464 microversion: 2.75 time: 0.284694 May 19 04:34:17.923317 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 419/826] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:17 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1464 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:18.073413 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a5c4caf-98e0-4cca-bff5-2060368f94af tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "POST /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711256 May 19 04:34:18.074652 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 408/827] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:34:17 2022] POST /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:18.375679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e3d41c6e-93cd-42dc-be23-371616350121 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31621bca0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:18.487898 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e3d41c6e-93cd-42dc-be23-371616350121 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.119920 May 19 04:34:18.489251 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 420/828] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:18 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:18.635216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d7016790-16cb-4fbe-ac80-dc68a758441b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:18.642911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d7016790-16cb-4fbe-ac80-dc68a758441b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:18.665700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7016790-16cb-4fbe-ac80-dc68a758441b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:18.666803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7016790-16cb-4fbe-ac80-dc68a758441b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:18.672678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7016790-16cb-4fbe-ac80-dc68a758441b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:18.673609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7016790-16cb-4fbe-ac80-dc68a758441b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:18.928723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:18.929524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:18.948529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:18.948992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:18.953135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:18.956389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:19.196683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:19.214944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:19.237233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:19.268022 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-58db6a07-1b50-443e-998e-ffe0cc8bb0ca tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1452 microversion: 2.75 time: 0.336707 May 19 04:34:19.268734 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 421/829] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:18 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1452 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:34:19.391840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d7016790-16cb-4fbe-ac80-dc68a758441b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:19.406662 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d7016790-16cb-4fbe-ac80-dc68a758441b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 200 len: 1476 microversion: 2.1 time: 0.784610 May 19 04:34:19.407127 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 409/830] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:18 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 1476 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:19.426562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c16eafb9-7a74-4035-9643-041cbcf937b6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1611749813"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:19.427649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c16eafb9-7a74-4035-9643-041cbcf937b6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:19.434477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c16eafb9-7a74-4035-9643-041cbcf937b6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:19.435379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c16eafb9-7a74-4035-9643-041cbcf937b6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:19.436562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c16eafb9-7a74-4035-9643-041cbcf937b6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:19.437826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c16eafb9-7a74-4035-9643-041cbcf937b6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:19.505326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e29d470d-c97f-4c7c-aaae-6bc151fb4255 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316089820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:19.626620 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e29d470d-c97f-4c7c-aaae-6bc151fb4255 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.129204 May 19 04:34:19.632119 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 410/831] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:19 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:20.226193 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c16eafb9-7a74-4035-9643-041cbcf937b6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c/action" status: 202 len: 0 microversion: 2.1 time: 0.804835 May 19 04:34:20.230142 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 422/832] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:34:19 2022] POST /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:34:20.243791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-598c7be9-c09f-40cf-8b60-785515de15b3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316061820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:20.288772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:20.289660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:20.296585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:20.302655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:20.304929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:20.305896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:20.402173 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-598c7be9-c09f-40cf-8b60-785515de15b3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1414 microversion: 2.1 time: 0.165489 May 19 04:34:20.403013 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 411/833] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:20 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1414 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:20.520535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:20.530736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:20.538979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:20.559738 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2baee148-f02e-4f90-a4ee-790430889524 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1452 microversion: 2.75 time: 0.275586 May 19 04:34:20.560823 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 423/834] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:20 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1452 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:20.643615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-77f14d02-7084-4ef6-adc8-7a8b7dab91ec tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3164509d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:20.726474 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-77f14d02-7084-4ef6-adc8-7a8b7dab91ec tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.087642 May 19 04:34:20.727071 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 412/835] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:20 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:21.428165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d70f6092-86ec-42e5-acbe-68f39fb5fae6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316076310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:21.518921 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d70f6092-86ec-42e5-acbe-68f39fb5fae6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1414 microversion: 2.1 time: 0.095407 May 19 04:34:21.520305 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 424/836] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:21 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:21.581475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:21.582355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:21.599682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:21.601352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:21.604522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:21.605146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:21.707869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-874541244", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:21.780023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:34:21.934934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:21.954681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:21.967070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:21.990603 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1630a4f4-ffe9-46bf-93f7-7898b48cb338 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1437 microversion: 2.75 time: 0.414539 May 19 04:34:21.995052 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 425/837] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:21 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1437 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:34:22.007237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-09a17142-0628-403b-8e06-e7c3e757c8dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31606f5e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:22.090772 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-09a17142-0628-403b-8e06-e7c3e757c8dd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1455 microversion: 2.1 time: 0.094316 May 19 04:34:22.091372 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 426/838] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:21 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:22.251951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:34:22.252637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:34:22.253316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:34:22.253910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:34:22.254500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:34:22.266273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:22.266860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:22.267995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:22.268818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:22.294738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Getting quotas for project 5edbfd578f24447bbc845b88cbca6f3f. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:34:22.304359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Getting quotas for user b29b563514df4ad1b042894921248df9 and project 5edbfd578f24447bbc845b88cbca6f3f. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:34:22.345562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:34:22.347915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:34:22.380991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:22.383472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:22.402630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:22.403895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:22.404606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:22.405057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:22.443114 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0ed3a455-f324-447e-8fed-ffeda3637c49 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993105 May 19 04:34:22.453155 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 413/839] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 04:34:22.474245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2559e4e3-aef0-45ff-b5bf-50827f608be8 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:22.475993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2559e4e3-aef0-45ff-b5bf-50827f608be8 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:22.604525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2559e4e3-aef0-45ff-b5bf-50827f608be8 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:22.613016 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2559e4e3-aef0-45ff-b5bf-50827f608be8 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1216 microversion: 2.1 time: 0.158417 May 19 04:34:22.613631 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 414/840] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:22 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:22.619069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-84c3edc3-9dca-446c-88a1-95b2ce61901b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316033430>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:22.689680 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-84c3edc3-9dca-446c-88a1-95b2ce61901b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1414 microversion: 2.1 time: 0.074498 May 19 04:34:22.690253 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 415/841] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:22 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:22.713641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:34:22.715127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:34:22.718533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:34:22.719234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:34:22.719939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:34:22.852951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:22.867846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:22.870525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:22.871410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:22.872184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:23.104459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a684b93f-e36f-4c08-97fd-89794f4a18b7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3160619d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:23.189608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:23.216646 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-33f187cf-ebd2-4750-ac74-6b598ac8f997 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06/action" status: 202 len: 1942 microversion: 2.75 time: 1.124207 May 19 04:34:23.217599 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 427/842] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:34:22 2022] POST /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06/action => generated 1942 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 19 04:34:23.236704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4a0c7da-7d58-47a0-8123-80166bf2df3c tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:23.238256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4a0c7da-7d58-47a0-8123-80166bf2df3c tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:23.256040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a0c7da-7d58-47a0-8123-80166bf2df3c tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:23.257645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a0c7da-7d58-47a0-8123-80166bf2df3c tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:23.260848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a0c7da-7d58-47a0-8123-80166bf2df3c tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:23.261677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a0c7da-7d58-47a0-8123-80166bf2df3c tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:23.408443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-a4a0c7da-7d58-47a0-8123-80166bf2df3c tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:23.450997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4a0c7da-7d58-47a0-8123-80166bf2df3c tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.219412 May 19 04:34:23.451598 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 428/843] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:23 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:23.633051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5d4cf3d-271e-4228-a028-e0654b80bb33 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:23.634699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e5d4cf3d-271e-4228-a028-e0654b80bb33 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:23.645579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5d4cf3d-271e-4228-a028-e0654b80bb33 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:23.647499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5d4cf3d-271e-4228-a028-e0654b80bb33 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:23.648702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5d4cf3d-271e-4228-a028-e0654b80bb33 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:23.652509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5d4cf3d-271e-4228-a028-e0654b80bb33 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:23.780431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e5d4cf3d-271e-4228-a028-e0654b80bb33 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:23.798360 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e5d4cf3d-271e-4228-a028-e0654b80bb33 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1220 microversion: 2.1 time: 0.171075 May 19 04:34:23.798864 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 429/844] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:23 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:23.810865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-002960f7-5fad-49da-85e8-a8446f7e5978 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316076280>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:26.591177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:29.751394 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a684b93f-e36f-4c08-97fd-89794f4a18b7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1464 microversion: 2.1 time: 6.651428 May 19 04:34:29.752305 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 416/845] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:23 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1464 bytes in 6653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:29.759273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b3eb609-f6cd-4bbe-9345-ba93267443f8 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:29.759885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4b3eb609-f6cd-4bbe-9345-ba93267443f8 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:29.766376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b3eb609-f6cd-4bbe-9345-ba93267443f8 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:29.766827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b3eb609-f6cd-4bbe-9345-ba93267443f8 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:29.767605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b3eb609-f6cd-4bbe-9345-ba93267443f8 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:29.768047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b3eb609-f6cd-4bbe-9345-ba93267443f8 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:29.787847 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-002960f7-5fad-49da-85e8-a8446f7e5978 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1414 microversion: 2.1 time: 5.983424 May 19 04:34:29.788514 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 430/846] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:23 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1414 bytes in 5985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:29.810154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-543839b4-9677-4f05-9d76-fd22f7b58a40 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:29.810154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-543839b4-9677-4f05-9d76-fd22f7b58a40 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:29.811596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-543839b4-9677-4f05-9d76-fd22f7b58a40 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:29.812157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-543839b4-9677-4f05-9d76-fd22f7b58a40 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:29.813382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-543839b4-9677-4f05-9d76-fd22f7b58a40 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:29.813943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-543839b4-9677-4f05-9d76-fd22f7b58a40 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:29.930222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-4b3eb609-f6cd-4bbe-9345-ba93267443f8 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:29.956407 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4b3eb609-f6cd-4bbe-9345-ba93267443f8 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.202416 May 19 04:34:29.957856 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 417/847] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:29 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:29.962812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b059f785-35e7-463d-8df9-6025e5b89efa req-ae6f8b54-f960-457b-ae01-2de7a5a5840e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54201b4d-c068-43c2-bfe0-ea4714da319c", "name": "network-vif-plugged", "status": "completed", "tag": "78fe9c44-54e2-4ef9-b736-17c7c375e11a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:29.974716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b059f785-35e7-463d-8df9-6025e5b89efa req-ae6f8b54-f960-457b-ae01-2de7a5a5840e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:29.975427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b059f785-35e7-463d-8df9-6025e5b89efa req-ae6f8b54-f960-457b-ae01-2de7a5a5840e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:29.989297 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b059f785-35e7-463d-8df9-6025e5b89efa req-ae6f8b54-f960-457b-ae01-2de7a5a5840e service nova] Creating event network-vif-plugged:78fe9c44-54e2-4ef9-b736-17c7c375e11a for instance 54201b4d-c068-43c2-bfe0-ea4714da319c on n-h1-766726-30 May 19 04:34:30.001528 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b059f785-35e7-463d-8df9-6025e5b89efa req-ae6f8b54-f960-457b-ae01-2de7a5a5840e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042178 May 19 04:34:30.005782 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 418/848] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:30.072169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-543839b4-9677-4f05-9d76-fd22f7b58a40 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:30.085147 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-543839b4-9677-4f05-9d76-fd22f7b58a40 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1316 microversion: 2.1 time: 0.295411 May 19 04:34:30.099851 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 431/849] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:29 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:30.104985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8d27b6ad-e046-49c4-ba9d-2b95d7799b16 req-3cbbf042-f391-44d7-bc8d-e9bb9ffcc3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7722f7-7133-4dc0-8b77-5930a6540977", "tag": "899edd27-edc4-49c6-a407-a9a5cd069533"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:30.120056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8d27b6ad-e046-49c4-ba9d-2b95d7799b16 req-3cbbf042-f391-44d7-bc8d-e9bb9ffcc3d0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:30.120788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8d27b6ad-e046-49c4-ba9d-2b95d7799b16 req-3cbbf042-f391-44d7-bc8d-e9bb9ffcc3d0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:30.133973 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8d27b6ad-e046-49c4-ba9d-2b95d7799b16 req-3cbbf042-f391-44d7-bc8d-e9bb9ffcc3d0 service nova] Creating event network-changed:899edd27-edc4-49c6-a407-a9a5cd069533 for instance 0e7722f7-7133-4dc0-8b77-5930a6540977 on n-h1-766726-30 May 19 04:34:30.140361 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8d27b6ad-e046-49c4-ba9d-2b95d7799b16 req-3cbbf042-f391-44d7-bc8d-e9bb9ffcc3d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037930 May 19 04:34:30.141241 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 432/850] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:30.161971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-efe030db-2ef5-4e9a-9e78-a8f7412476bd tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:30.162360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-efe030db-2ef5-4e9a-9e78-a8f7412476bd tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:30.201036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efe030db-2ef5-4e9a-9e78-a8f7412476bd tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:30.206590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efe030db-2ef5-4e9a-9e78-a8f7412476bd tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:30.208143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efe030db-2ef5-4e9a-9e78-a8f7412476bd tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:30.209482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efe030db-2ef5-4e9a-9e78-a8f7412476bd tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:30.284096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2141781460", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "3c260e33-45cd-46ef-9773-557635955e8f"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:30.373416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] validate_networks() for [('3c260e33-45cd-46ef-9773-557635955e8f', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:34:30.498991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:30.507641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-efe030db-2ef5-4e9a-9e78-a8f7412476bd tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 4bc44755-e968-4e75-a8ce-76d6ab964726 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:30.537314 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-efe030db-2ef5-4e9a-9e78-a8f7412476bd tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 2132 microversion: 2.25 time: 0.387898 May 19 04:34:30.554366 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 433/851] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:30 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 2132 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:30.572209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8a1349a0-b83a-4f44-895e-6134f4d82e7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31608bf70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:30.643728 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8a1349a0-b83a-4f44-895e-6134f4d82e7e tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 200 len: 1464 microversion: 2.1 time: 0.087925 May 19 04:34:30.644396 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 434/852] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:30 2022] GET /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:30.654351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c1588f0-f660-4bee-aa4b-4b8c5861ceae tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-766726-30", "block_migration": "auto"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:30.660070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c1588f0-f660-4bee-aa4b-4b8c5861ceae tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:30.675701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c1588f0-f660-4bee-aa4b-4b8c5861ceae tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:30.676823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c1588f0-f660-4bee-aa4b-4b8c5861ceae tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:30.678487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c1588f0-f660-4bee-aa4b-4b8c5861ceae tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:30.679304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c1588f0-f660-4bee-aa4b-4b8c5861ceae tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:30.729460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-0c1588f0-f660-4bee-aa4b-4b8c5861ceae tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'flavor' on Instance uuid 4bc44755-e968-4e75-a8ce-76d6ab964726 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:30.746345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c1588f0-f660-4bee-aa4b-4b8c5861ceae tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Going to try to live migrate instance to n-h2-766726-30 {{(pid=124819) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 04:34:31.207399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:34:31.207960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:34:31.208688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:34:31.209339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:34:31.210056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:34:31.235763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:31.236649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:31.237818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:31.238659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:31.315529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Getting quotas for project c754f227f43646e7bc6e53e50d93365d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:34:31.342778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Getting quotas for user e9afd2aff4344e6c8130cfd6b3305b5f and project c754f227f43646e7bc6e53e50d93365d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:34:31.364485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:34:31.367327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:34:31.433150 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-19273ea2-81e0-46c5-9c48-f41c7fadbe8c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426371 May 19 04:34:31.434181 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 419/853] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:34:31.440052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-37e212fc-a033-4be0-be9f-0b3354edbbbc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:31.441062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-37e212fc-a033-4be0-be9f-0b3354edbbbc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:31.450106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37e212fc-a033-4be0-be9f-0b3354edbbbc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:31.450993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37e212fc-a033-4be0-be9f-0b3354edbbbc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:31.453238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37e212fc-a033-4be0-be9f-0b3354edbbbc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:31.453971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37e212fc-a033-4be0-be9f-0b3354edbbbc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:31.834490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-37e212fc-a033-4be0-be9f-0b3354edbbbc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:31.847334 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-37e212fc-a033-4be0-be9f-0b3354edbbbc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1468 microversion: 2.1 time: 0.411873 May 19 04:34:31.848988 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 420/854] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:31 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1468 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:31.865916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e406a425-00c1-4e8b-9a51-535c7ff47357 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316082a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:31.966091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e406a425-00c1-4e8b-9a51-535c7ff47357 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1414 microversion: 2.1 time: 0.102498 May 19 04:34:31.973114 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 421/855] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:31 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:31.998274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e9dad291-840c-4827-a4c8-57714c980f02 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:31.998939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e9dad291-840c-4827-a4c8-57714c980f02 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:32.016214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9dad291-840c-4827-a4c8-57714c980f02 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.019440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9dad291-840c-4827-a4c8-57714c980f02 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:32.020424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9dad291-840c-4827-a4c8-57714c980f02 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.021366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9dad291-840c-4827-a4c8-57714c980f02 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:32.168716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-e9dad291-840c-4827-a4c8-57714c980f02 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:32.227958 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e9dad291-840c-4827-a4c8-57714c980f02 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.258735 May 19 04:34:32.250108 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 422/856] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:31 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:32.262452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e0462245-b9d0-4f9a-9aff-77a1b8059b51 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:32.266599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e0462245-b9d0-4f9a-9aff-77a1b8059b51 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:32.279147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0462245-b9d0-4f9a-9aff-77a1b8059b51 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.279601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0462245-b9d0-4f9a-9aff-77a1b8059b51 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:32.280972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0462245-b9d0-4f9a-9aff-77a1b8059b51 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.288992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0462245-b9d0-4f9a-9aff-77a1b8059b51 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:32.570005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e0462245-b9d0-4f9a-9aff-77a1b8059b51 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:32.583820 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e0462245-b9d0-4f9a-9aff-77a1b8059b51 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1316 microversion: 2.1 time: 0.325924 May 19 04:34:32.585756 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 423/857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:32 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:32.598417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-05fed301-1bf5-428f-856e-f74c307a8b26 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:32.601637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-05fed301-1bf5-428f-856e-f74c307a8b26 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:32.616110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:32.622890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05fed301-1bf5-428f-856e-f74c307a8b26 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.623355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05fed301-1bf5-428f-856e-f74c307a8b26 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:32.624699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05fed301-1bf5-428f-856e-f74c307a8b26 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.625421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05fed301-1bf5-428f-856e-f74c307a8b26 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:32.800625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-05fed301-1bf5-428f-856e-f74c307a8b26 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:32.812789 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-05fed301-1bf5-428f-856e-f74c307a8b26 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1229 microversion: 2.1 time: 0.224847 May 19 04:34:32.826225 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 424/858] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:32 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1229 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:32.835395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b62b01b-fc24-4d7d-96aa-c2b0205cf97d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1870675329"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:32.837561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b62b01b-fc24-4d7d-96aa-c2b0205cf97d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:32.851416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b62b01b-fc24-4d7d-96aa-c2b0205cf97d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.852306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b62b01b-fc24-4d7d-96aa-c2b0205cf97d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:32.854181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b62b01b-fc24-4d7d-96aa-c2b0205cf97d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.856892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b62b01b-fc24-4d7d-96aa-c2b0205cf97d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:32.922155 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c1588f0-f660-4bee-aa4b-4b8c5861ceae tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/action" status: 202 len: 0 microversion: 2.25 time: 2.273341 May 19 04:34:32.922831 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 435/859] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:34:30 2022] POST /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/action => generated 0 bytes in 2278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:34:32.933100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:32.934037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:32.956027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.963549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:32.969651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:32.970478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:33.245827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:33.290012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:33.291754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:33.292984 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7184f91c-e549-4777-8589-54b144f32fc8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.365814 May 19 04:34:33.302077 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 436/860] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:32 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:34:33.307529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c913db4a-a7aa-491f-bbe1-67fd8a5efcf6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315e9bb80>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:33.372954 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b62b01b-fc24-4d7d-96aa-c2b0205cf97d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "POST /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4/action" status: 202 len: 0 microversion: 2.1 time: 0.543865 May 19 04:34:33.376034 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 425/861] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:34:32 2022] POST /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:34:33.384681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bf94cca4-6321-4bad-8c65-58a2d7148c0a tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:33.386169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bf94cca4-6321-4bad-8c65-58a2d7148c0a tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:33.395852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf94cca4-6321-4bad-8c65-58a2d7148c0a tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:33.396430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf94cca4-6321-4bad-8c65-58a2d7148c0a tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:33.397413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf94cca4-6321-4bad-8c65-58a2d7148c0a tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:33.397925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf94cca4-6321-4bad-8c65-58a2d7148c0a tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:33.406481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:33.429054 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c913db4a-a7aa-491f-bbe1-67fd8a5efcf6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1414 microversion: 2.1 time: 0.125544 May 19 04:34:33.433326 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 437/862] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:33 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:33.438550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-03b611ea-ad77-4026-a952-4fccae6758ad tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315eaa820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:33.533276 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-03b611ea-ad77-4026-a952-4fccae6758ad tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 200 len: 1455 microversion: 2.1 time: 0.098838 May 19 04:34:33.533850 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 438/863] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:33 2022] GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:33.539730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-bf94cca4-6321-4bad-8c65-58a2d7148c0a tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:33.566928 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bf94cca4-6321-4bad-8c65-58a2d7148c0a tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.189362 May 19 04:34:33.578984 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 426/864] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:33 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:33.603657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7758488-2048-4500-b241-de8d9e6b945c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:33.604401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7758488-2048-4500-b241-de8d9e6b945c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:33.615951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7758488-2048-4500-b241-de8d9e6b945c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:33.616394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7758488-2048-4500-b241-de8d9e6b945c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:33.620283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7758488-2048-4500-b241-de8d9e6b945c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:33.620657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7758488-2048-4500-b241-de8d9e6b945c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:33.833588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3ffc90df-5038-4cb2-abab-c0361a9fe659 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:33.834365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3ffc90df-5038-4cb2-abab-c0361a9fe659 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:33.847751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ffc90df-5038-4cb2-abab-c0361a9fe659 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:33.848209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ffc90df-5038-4cb2-abab-c0361a9fe659 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:33.848975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ffc90df-5038-4cb2-abab-c0361a9fe659 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:33.854295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ffc90df-5038-4cb2-abab-c0361a9fe659 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:34.012171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3ffc90df-5038-4cb2-abab-c0361a9fe659 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:34.025755 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3ffc90df-5038-4cb2-abab-c0361a9fe659 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1283 microversion: 2.1 time: 0.197266 May 19 04:34:34.049903 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 427/865] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:33 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1283 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:34.057729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a5911c8b-7c0f-4e66-acf0-fae5200de595 req-6faad08c-a27d-4c30-876f-c05fce80d8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7722f7-7133-4dc0-8b77-5930a6540977", "name": "network-vif-plugged", "status": "completed", "tag": "899edd27-edc4-49c6-a407-a9a5cd069533"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:34.079335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a5911c8b-7c0f-4e66-acf0-fae5200de595 req-6faad08c-a27d-4c30-876f-c05fce80d8c4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:34.079755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a5911c8b-7c0f-4e66-acf0-fae5200de595 req-6faad08c-a27d-4c30-876f-c05fce80d8c4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:34.095509 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a5911c8b-7c0f-4e66-acf0-fae5200de595 req-6faad08c-a27d-4c30-876f-c05fce80d8c4 service nova] Creating event network-vif-plugged:899edd27-edc4-49c6-a407-a9a5cd069533 for instance 0e7722f7-7133-4dc0-8b77-5930a6540977 on n-h1-766726-30 May 19 04:34:34.102466 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a5911c8b-7c0f-4e66-acf0-fae5200de595 req-6faad08c-a27d-4c30-876f-c05fce80d8c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050458 May 19 04:34:34.103556 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 428/866] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:34.313225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:34.313936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:34.336466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:34.337474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:34.338336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:34.365149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:34.683548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7758488-2048-4500-b241-de8d9e6b945c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:34.693042 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7758488-2048-4500-b241-de8d9e6b945c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1316 microversion: 2.1 time: 1.095169 May 19 04:34:34.705563 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 439/867] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:33 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1316 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:34.708588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e3c0b9c-f71c-4fb8-bf36-3dad3375700c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd31606f160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:34.779251 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e3c0b9c-f71c-4fb8-bf36-3dad3375700c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1414 microversion: 2.1 time: 0.080854 May 19 04:34:34.779736 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 440/868] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:34 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:34.788212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f2c522d-e920-4343-89c0-e4f6641b7d4f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315eaa8b0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:34.853137 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7f2c522d-e920-4343-89c0-e4f6641b7d4f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 200 len: 1455 microversion: 2.1 time: 0.071489 May 19 04:34:34.854762 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 441/869] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:34 2022] GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:34.861504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-658d5025-cb69-4f8a-9094-364fa565a3f2 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:34.863127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-658d5025-cb69-4f8a-9094-364fa565a3f2 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:34.871013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-658d5025-cb69-4f8a-9094-364fa565a3f2 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:34.871842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-658d5025-cb69-4f8a-9094-364fa565a3f2 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:34.872881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-658d5025-cb69-4f8a-9094-364fa565a3f2 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:34.874117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-658d5025-cb69-4f8a-9094-364fa565a3f2 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:35.049870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-658d5025-cb69-4f8a-9094-364fa565a3f2 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:35.077402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:35.083112 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-658d5025-cb69-4f8a-9094-364fa565a3f2 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.227023 May 19 04:34:35.084298 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 442/870] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:34 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:35.089320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-446ff1e4-feb9-49a4-8919-3df02888eaeb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:35.090137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-446ff1e4-feb9-49a4-8919-3df02888eaeb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:35.091305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:35.094354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:35.097114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-446ff1e4-feb9-49a4-8919-3df02888eaeb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:35.097754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-446ff1e4-feb9-49a4-8919-3df02888eaeb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:35.098740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-446ff1e4-feb9-49a4-8919-3df02888eaeb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:35.099353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-446ff1e4-feb9-49a4-8919-3df02888eaeb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:35.105688 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1c5f6626-93d0-4633-9a3b-bc6236f6c796 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.796737 May 19 04:34:35.125509 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 429/871] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:34 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:35.245146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-446ff1e4-feb9-49a4-8919-3df02888eaeb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:35.255284 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-446ff1e4-feb9-49a4-8919-3df02888eaeb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1283 microversion: 2.1 time: 0.169721 May 19 04:34:35.269436 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 443/872] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:35 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:35.713115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bf2e540b-63a4-4a84-908a-5c91a25ad033 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:35.713936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bf2e540b-63a4-4a84-908a-5c91a25ad033 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:35.722156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf2e540b-63a4-4a84-908a-5c91a25ad033 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:35.733725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf2e540b-63a4-4a84-908a-5c91a25ad033 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:35.734784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf2e540b-63a4-4a84-908a-5c91a25ad033 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:35.735384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf2e540b-63a4-4a84-908a-5c91a25ad033 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:35.797108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1413fa0c-43cb-4a74-b5b8-fc5866758f87 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316054160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:35.887339 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1413fa0c-43cb-4a74-b5b8-fc5866758f87 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1414 microversion: 2.1 time: 0.098817 May 19 04:34:35.887940 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 444/873] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:35 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:35.907680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1a83aa1a-0e43-4e94-83f2-79b4c4e18533 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31606f160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:35.984566 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1a83aa1a-0e43-4e94-83f2-79b4c4e18533 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 200 len: 1455 microversion: 2.1 time: 0.093124 May 19 04:34:35.987384 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 445/874] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:35 2022] GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:36.104332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5353ca0a-48cc-4c93-b9b3-ec84a193ffae tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:36.104874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5353ca0a-48cc-4c93-b9b3-ec84a193ffae tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:36.123264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5353ca0a-48cc-4c93-b9b3-ec84a193ffae tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:36.124047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5353ca0a-48cc-4c93-b9b3-ec84a193ffae tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:36.127427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5353ca0a-48cc-4c93-b9b3-ec84a193ffae tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:36.128111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5353ca0a-48cc-4c93-b9b3-ec84a193ffae tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:36.275385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bf2e540b-63a4-4a84-908a-5c91a25ad033 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:36.291471 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bf2e540b-63a4-4a84-908a-5c91a25ad033 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1316 microversion: 2.1 time: 0.582087 May 19 04:34:36.296137 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 430/875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:35 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:36.315113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-04735171-48e5-4aa8-a146-8bf27b6d5383 req-0c6ab453-f02e-44d8-8b13-b0d1893e5c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894949df-7dda-4389-b7bc-ea820a53ffd1", "name": "network-vif-unplugged", "status": "completed", "tag": "8be6a741-ebd0-4f13-99c9-b902a49319b3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:36.334494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-04735171-48e5-4aa8-a146-8bf27b6d5383 req-0c6ab453-f02e-44d8-8b13-b0d1893e5c84 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:36.337852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-04735171-48e5-4aa8-a146-8bf27b6d5383 req-0c6ab453-f02e-44d8-8b13-b0d1893e5c84 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:36.376663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-5353ca0a-48cc-4c93-b9b3-ec84a193ffae tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:36.414675 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-04735171-48e5-4aa8-a146-8bf27b6d5383 req-0c6ab453-f02e-44d8-8b13-b0d1893e5c84 service nova] Creating event network-vif-unplugged:8be6a741-ebd0-4f13-99c9-b902a49319b3 for instance 894949df-7dda-4389-b7bc-ea820a53ffd1 on n-h2-766726-30 May 19 04:34:36.421224 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-04735171-48e5-4aa8-a146-8bf27b6d5383 req-0c6ab453-f02e-44d8-8b13-b0d1893e5c84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123230 May 19 04:34:36.428715 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 431/876] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:36.434659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:36.435375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:36.454139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:36.454905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:36.455880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:36.456142 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5353ca0a-48cc-4c93-b9b3-ec84a193ffae tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.356828 May 19 04:34:36.459328 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 446/877] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:36 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:36.466545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:36.480650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d00bd9b-d0d4-4892-97d8-40363b12b8cc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:36.487856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5d00bd9b-d0d4-4892-97d8-40363b12b8cc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:36.516596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d00bd9b-d0d4-4892-97d8-40363b12b8cc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:36.517513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d00bd9b-d0d4-4892-97d8-40363b12b8cc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:36.518518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d00bd9b-d0d4-4892-97d8-40363b12b8cc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:36.519632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d00bd9b-d0d4-4892-97d8-40363b12b8cc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:37.207510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5d00bd9b-d0d4-4892-97d8-40363b12b8cc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:37.219952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:37.220895 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5d00bd9b-d0d4-4892-97d8-40363b12b8cc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1325 microversion: 2.1 time: 0.759480 May 19 04:34:37.223929 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 447/878] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:36 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1325 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:37.230772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:37.234143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:37.236399 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a63afc0c-473b-46db-abd4-9b157cee4ee7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.806191 May 19 04:34:37.238427 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 432/879] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:36 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:37.256042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-245990cd-2236-4072-a841-7f2f8ba73301 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3160a9160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:37.272634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4458898b-1f83-4ec9-868f-975099202342 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315e9baf0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:37.502124 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-245990cd-2236-4072-a841-7f2f8ba73301 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 200 len: 1455 microversion: 2.1 time: 0.261587 May 19 04:34:37.504449 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 433/880] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:37 2022] GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 1455 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:37.509455 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4458898b-1f83-4ec9-868f-975099202342 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1414 microversion: 2.1 time: 0.281328 May 19 04:34:37.509455 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 448/881] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:37 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1414 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:37.517755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f3c948b9-8ae4-4824-80c5-2349d91a3b89 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:37.518859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f3c948b9-8ae4-4824-80c5-2349d91a3b89 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:37.520106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-56ba9acf-4206-4c97-a94f-2f22ff0d2e68 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:37.521762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-56ba9acf-4206-4c97-a94f-2f22ff0d2e68 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:37.537494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56ba9acf-4206-4c97-a94f-2f22ff0d2e68 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:37.538391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56ba9acf-4206-4c97-a94f-2f22ff0d2e68 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:37.539359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56ba9acf-4206-4c97-a94f-2f22ff0d2e68 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:37.539957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56ba9acf-4206-4c97-a94f-2f22ff0d2e68 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:37.543877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f3c948b9-8ae4-4824-80c5-2349d91a3b89 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:37.544437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f3c948b9-8ae4-4824-80c5-2349d91a3b89 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:37.550930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f3c948b9-8ae4-4824-80c5-2349d91a3b89 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:37.551469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f3c948b9-8ae4-4824-80c5-2349d91a3b89 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:37.777313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-f3c948b9-8ae4-4824-80c5-2349d91a3b89 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:37.819951 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f3c948b9-8ae4-4824-80c5-2349d91a3b89 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.307229 May 19 04:34:37.835977 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 434/882] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:37 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:37.935164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-56ba9acf-4206-4c97-a94f-2f22ff0d2e68 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:37.943638 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-56ba9acf-4206-4c97-a94f-2f22ff0d2e68 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1465 microversion: 2.1 time: 0.435256 May 19 04:34:37.952342 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 449/883] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:37 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1465 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:37.962995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c60c4ad7-1a5f-427f-990d-5e7747272a5d tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-262669797", "metadata": {"image_type": "test"}}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:37.964285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c60c4ad7-1a5f-427f-990d-5e7747272a5d tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:37.978300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c60c4ad7-1a5f-427f-990d-5e7747272a5d tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:37.987826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c60c4ad7-1a5f-427f-990d-5e7747272a5d tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:37.989799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bec2164d-d717-406f-8062-18f585824e38 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:37.990124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bec2164d-d717-406f-8062-18f585824e38 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:37.991823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c60c4ad7-1a5f-427f-990d-5e7747272a5d tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:37.993482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c60c4ad7-1a5f-427f-990d-5e7747272a5d tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:37.999229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bec2164d-d717-406f-8062-18f585824e38 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:38.003371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bec2164d-d717-406f-8062-18f585824e38 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:38.004177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bec2164d-d717-406f-8062-18f585824e38 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:38.004615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bec2164d-d717-406f-8062-18f585824e38 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:38.072134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bec2164d-d717-406f-8062-18f585824e38 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:34:38.142273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c60c4ad7-1a5f-427f-990d-5e7747272a5d tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Getting quotas for project 5edbfd578f24447bbc845b88cbca6f3f. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:34:38.156201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c60c4ad7-1a5f-427f-990d-5e7747272a5d tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Getting quotas for user b29b563514df4ad1b042894921248df9 and project 5edbfd578f24447bbc845b88cbca6f3f. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:34:38.237335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:38.253565 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bec2164d-d717-406f-8062-18f585824e38 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 204 len: 0 microversion: 2.1 time: 0.267197 May 19 04:34:38.254339 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 450/884] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:34:37 2022] DELETE /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:34:38.262371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49027389-44a8-4ec9-99b1-9c2f2f30b150 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:38.264600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49027389-44a8-4ec9-99b1-9c2f2f30b150 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:38.279732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49027389-44a8-4ec9-99b1-9c2f2f30b150 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:38.280572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49027389-44a8-4ec9-99b1-9c2f2f30b150 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:38.283294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49027389-44a8-4ec9-99b1-9c2f2f30b150 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:38.283950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49027389-44a8-4ec9-99b1-9c2f2f30b150 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:38.621925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49027389-44a8-4ec9-99b1-9c2f2f30b150 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:38.637629 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49027389-44a8-4ec9-99b1-9c2f2f30b150 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1325 microversion: 2.1 time: 0.379932 May 19 04:34:38.638937 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 451/885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:38 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1325 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:38.643827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:38.652740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:38.662687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:38.664327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:38.665185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:38.665682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:38.942366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:38.955116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:38.956901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:38.967068 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5d94ae8d-b31a-4465-a4fa-ed0007fe0a9d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.326823 May 19 04:34:38.977861 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 452/886] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:38 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:38.983536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e699ab9-7718-4ee8-869b-c043659b7bff tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:38.994215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7e699ab9-7718-4ee8-869b-c043659b7bff tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:39.001690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e699ab9-7718-4ee8-869b-c043659b7bff tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:39.002424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e699ab9-7718-4ee8-869b-c043659b7bff tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:39.003395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e699ab9-7718-4ee8-869b-c043659b7bff tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:39.003990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e699ab9-7718-4ee8-869b-c043659b7bff tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:39.316319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e699ab9-7718-4ee8-869b-c043659b7bff tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:39.330256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:39.335381 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e699ab9-7718-4ee8-869b-c043659b7bff tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1709 microversion: 2.1 time: 0.355966 May 19 04:34:39.336233 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 453/887] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:38 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1709 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:39.352861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-55579b26-5771-4bfd-bb22-4cd8595f6660 req-7202244e-b747-4dce-9b21-e02572850bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0", "tag": "e3f937f7-39e2-483b-b059-a1a0eed90eae"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:39.366712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-55579b26-5771-4bfd-bb22-4cd8595f6660 req-7202244e-b747-4dce-9b21-e02572850bf3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:39.367447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-55579b26-5771-4bfd-bb22-4cd8595f6660 req-7202244e-b747-4dce-9b21-e02572850bf3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:39.389304 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-55579b26-5771-4bfd-bb22-4cd8595f6660 req-7202244e-b747-4dce-9b21-e02572850bf3 service nova] Creating event network-changed:e3f937f7-39e2-483b-b059-a1a0eed90eae for instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 on n-h1-766726-30 May 19 04:34:39.394893 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-55579b26-5771-4bfd-bb22-4cd8595f6660 req-7202244e-b747-4dce-9b21-e02572850bf3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057199 May 19 04:34:39.402323 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 454/888] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:39.408520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-34df0574-68d0-4b44-82a4-9330b5efd467 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31604b700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:41.146577 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-34df0574-68d0-4b44-82a4-9330b5efd467 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 200 len: 1455 microversion: 2.1 time: 1.742744 May 19 04:34:41.148027 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 455/889] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:39 2022] GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 1455 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:41.164568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed5090bb-db9b-4222-a8a5-7022ce92069a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3160b7430>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:41.234945 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed5090bb-db9b-4222-a8a5-7022ce92069a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1423 microversion: 2.1 time: 0.081533 May 19 04:34:41.235793 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 456/890] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:41 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:41.243712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a549fd1b-9983-4a10-8826-38cf5ec61dbf tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:41.245562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a549fd1b-9983-4a10-8826-38cf5ec61dbf tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:41.259791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a549fd1b-9983-4a10-8826-38cf5ec61dbf tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:41.265781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a549fd1b-9983-4a10-8826-38cf5ec61dbf tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:41.267247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a549fd1b-9983-4a10-8826-38cf5ec61dbf tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:41.267641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a549fd1b-9983-4a10-8826-38cf5ec61dbf tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:41.271819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=10 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:41.366002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=14 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:41.447710 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c60c4ad7-1a5f-427f-990d-5e7747272a5d tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "POST /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977/action" status: 202 len: 0 microversion: 2.1 time: 3.488440 May 19 04:34:41.449096 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 435/891] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:34:37 2022] POST /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977/action => generated 0 bytes in 3491 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:34:41.455811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-947882b0-2aa7-45a2-be65-e5d597813cff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:41.456860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-947882b0-2aa7-45a2-be65-e5d597813cff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:41.465760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-947882b0-2aa7-45a2-be65-e5d597813cff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:41.466598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-947882b0-2aa7-45a2-be65-e5d597813cff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:41.467861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-947882b0-2aa7-45a2-be65-e5d597813cff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:41.468594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-947882b0-2aa7-45a2-be65-e5d597813cff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:41.791178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-a549fd1b-9983-4a10-8826-38cf5ec61dbf tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:41.866083 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a549fd1b-9983-4a10-8826-38cf5ec61dbf tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.628992 May 19 04:34:41.875066 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 457/892] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:41 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:41.880174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:41.891482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:41.908897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:41.913675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:41.914518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:41.914953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:42.160339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-947882b0-2aa7-45a2-be65-e5d597813cff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:42.174047 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-947882b0-2aa7-45a2-be65-e5d597813cff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1325 microversion: 2.1 time: 0.722751 May 19 04:34:42.178368 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 436/893] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:41 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1325 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:42.209699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e6143321-fd13-4c37-9d54-101d722285af req-2e515848-0ef9-451a-968e-b95efd1d22e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab072e19-b664-4518-b3a1-4d6a31cdbac4", "name": "network-vif-plugged", "status": "completed", "tag": "9f40abdc-237f-468c-bebb-ab83998922c0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:42.234002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e6143321-fd13-4c37-9d54-101d722285af req-2e515848-0ef9-451a-968e-b95efd1d22e0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:42.236944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e6143321-fd13-4c37-9d54-101d722285af req-2e515848-0ef9-451a-968e-b95efd1d22e0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:42.267738 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e6143321-fd13-4c37-9d54-101d722285af req-2e515848-0ef9-451a-968e-b95efd1d22e0 service nova] Creating event network-vif-plugged:9f40abdc-237f-468c-bebb-ab83998922c0 for instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 on n-h2-766726-30 May 19 04:34:42.280631 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e6143321-fd13-4c37-9d54-101d722285af req-2e515848-0ef9-451a-968e-b95efd1d22e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100187 May 19 04:34:42.285302 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 437/894] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:42.293240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d17a7435-9d39-4002-a268-6c952315c174 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:42.294522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d17a7435-9d39-4002-a268-6c952315c174 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:42.317904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d17a7435-9d39-4002-a268-6c952315c174 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:42.318387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d17a7435-9d39-4002-a268-6c952315c174 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:42.320074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d17a7435-9d39-4002-a268-6c952315c174 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:42.323231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d17a7435-9d39-4002-a268-6c952315c174 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:42.420106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:42.428130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d17a7435-9d39-4002-a268-6c952315c174 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659bfc9046342629cd0c35e08871246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f7c96b0d5a45aaa70f0a09bdea144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:42.450435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:42.461190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:42.462444 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d17a7435-9d39-4002-a268-6c952315c174 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 200 len: 1642 microversion: 2.1 time: 0.171408 May 19 04:34:42.463120 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 438/895] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:42 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 1642 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:42.465776 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-34a86edb-2161-48d7-885e-8ce6312897ed tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.589377 May 19 04:34:42.468420 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 458/896] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:41 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:42.483161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b6fccea-d60d-4ef3-a94f-8a8d131b0df4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316082dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:42.490037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3fb4e23f-b5a8-4e6f-8524-73ffb2fb25fd tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315eaa550>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:42.686772 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3fb4e23f-b5a8-4e6f-8524-73ffb2fb25fd tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 200 len: 1421 microversion: 2.1 time: 0.216993 May 19 04:34:42.687600 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 459/897] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:42 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 1421 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:42.708298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61d9100a-9c8a-493b-b3aa-69cec1f1a153 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316054a60>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:42.727975 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b6fccea-d60d-4ef3-a94f-8a8d131b0df4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 200 len: 1423 microversion: 2.1 time: 0.262517 May 19 04:34:42.736835 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 439/898] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:42 2022] GET /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 1423 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:42.759431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a778d8b-43cd-42c6-b689-7e253b3a34f1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316083c10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:43.871612 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a778d8b-43cd-42c6-b689-7e253b3a34f1 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 204 len: 0 microversion: 2.1 time: 1.132778 May 19 04:34:43.872524 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 440/899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:42 2022] DELETE /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:34:43.878349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-613c3b1f-0b83-42b2-9790-da713d9236aa req-05d47485-e82d-4caa-b8e0-25220f41ada3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ebe2e4-9522-4997-9a9f-0b105b071543", "name": "network-vif-deleted", "tag": "67a1a435-12f1-4439-b64f-5e6612b0cc13"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:43.891154 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-61d9100a-9c8a-493b-b3aa-69cec1f1a153 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 200 len: 1455 microversion: 2.1 time: 1.192491 May 19 04:34:43.892059 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 460/900] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:42 2022] GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 1455 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:43.912213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-613c3b1f-0b83-42b2-9790-da713d9236aa req-05d47485-e82d-4caa-b8e0-25220f41ada3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:43.912665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-613c3b1f-0b83-42b2-9790-da713d9236aa req-05d47485-e82d-4caa-b8e0-25220f41ada3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:43.913944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e6f6b7b-e9bd-4067-ac07-0ea3856800f1 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:43.914564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7e6f6b7b-e9bd-4067-ac07-0ea3856800f1 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:43.925318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e6f6b7b-e9bd-4067-ac07-0ea3856800f1 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:43.925783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e6f6b7b-e9bd-4067-ac07-0ea3856800f1 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:43.927126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e6f6b7b-e9bd-4067-ac07-0ea3856800f1 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:43.930038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e6f6b7b-e9bd-4067-ac07-0ea3856800f1 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:43.942757 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-613c3b1f-0b83-42b2-9790-da713d9236aa req-05d47485-e82d-4caa-b8e0-25220f41ada3 service nova] Creating event network-vif-deleted:67a1a435-12f1-4439-b64f-5e6612b0cc13 for instance c8ebe2e4-9522-4997-9a9f-0b105b071543 on n-h2-766726-30 May 19 04:34:43.954214 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-613c3b1f-0b83-42b2-9790-da713d9236aa req-05d47485-e82d-4caa-b8e0-25220f41ada3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079811 May 19 04:34:43.954825 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 441/901] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:43.971897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-590b6140-7aab-446a-9005-aec746c4168d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:43.972605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-590b6140-7aab-446a-9005-aec746c4168d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:43.991199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-590b6140-7aab-446a-9005-aec746c4168d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:43.991661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-590b6140-7aab-446a-9005-aec746c4168d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:43.992450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-590b6140-7aab-446a-9005-aec746c4168d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:43.992891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-590b6140-7aab-446a-9005-aec746c4168d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.088710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-7e6f6b7b-e9bd-4067-ac07-0ea3856800f1 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:44.130049 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e6f6b7b-e9bd-4067-ac07-0ea3856800f1 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.234626 May 19 04:34:44.132010 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 461/902] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:43 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:44.141128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:44.142323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:44.159591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.160440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.162596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.163410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.203261 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] HTTP exception thrown: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Request method failure captured: May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 HTTP/1.1 May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg5Hh4NFtEdJBopDpHUa0wYcC3UktO4Epg2OdioXDhtyiwtHGJPtEOHLvBc2IUYpjIwD7MhIINA1Kn18KjIB2VszbtkdcE9OYMwzS0v7msSjb7OOXGMul-F7lpk6wixD58YXluuwcc6Cp_cm3WJyI0VTwn-IkJm_EosPptSKrntbcU May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:34:44.204956 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f659bfc9046342629cd0c35e08871246 May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:44.206525 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c8ebe2e4-9522-4997-9a9f-0b105b071543'} May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:44.207480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:44.208967 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.210340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Returning 404 to user: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:44.219400 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-224e27df-c798-4ab7-9898-3e545a0bd4a6 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 404 len: 111 microversion: 2.1 time: 0.085629 May 19 04:34:44.224109 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 462/903] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:44 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:34:44.237756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:44.241870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:44.242078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-590b6140-7aab-446a-9005-aec746c4168d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:44.252077 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-590b6140-7aab-446a-9005-aec746c4168d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1325 microversion: 2.1 time: 0.293951 May 19 04:34:44.253785 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 442/904] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:43 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:44.259735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4ef3df8a-611b-4fa7-b469-805c08996e8b tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd31608b700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:44.277814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.278279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.288408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.292000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.340432 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4ef3df8a-611b-4fa7-b469-805c08996e8b tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 200 len: 1421 microversion: 2.1 time: 0.085405 May 19 04:34:44.342633 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 443/905] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:44 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:44.347447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8143a87a-f853-4b00-951e-3ce6c05569ba tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:44.349290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8143a87a-f853-4b00-951e-3ce6c05569ba tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:44.358168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8143a87a-f853-4b00-951e-3ce6c05569ba tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.359156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8143a87a-f853-4b00-951e-3ce6c05569ba tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.363122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8143a87a-f853-4b00-951e-3ce6c05569ba tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.363750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8143a87a-f853-4b00-951e-3ce6c05569ba tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.647549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:44.658918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:44.664161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:44.668744 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff431fbb-af39-429e-ae64-0403855f8cf9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.438935 May 19 04:34:44.669534 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 463/906] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:44 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:44.693050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49721015-e66f-4788-af25-18033ba6d28b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:44.693637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49721015-e66f-4788-af25-18033ba6d28b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:44.703788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49721015-e66f-4788-af25-18033ba6d28b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.718513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8143a87a-f853-4b00-951e-3ce6c05569ba tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1692 microversion: 2.1 time: 0.374641 May 19 04:34:44.719115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49721015-e66f-4788-af25-18033ba6d28b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.720189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49721015-e66f-4788-af25-18033ba6d28b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.720744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49721015-e66f-4788-af25-18033ba6d28b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.723836 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 444/907] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:44 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1692 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:44.754190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:44.754926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:44.763545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.764879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.768458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.769799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.774136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49721015-e66f-4788-af25-18033ba6d28b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:34:44.803853 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] HTTP exception thrown: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Request method failure captured: May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f HTTP/1.1 May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcg5Hh4NFtEdJBopDpHUa0wYcC3UktO4Epg2OdioXDhtyiwtHGJPtEOHLvBc2IUYpjIwD7MhIINA1Kn18KjIB2VszbtkdcE9OYMwzS0v7msSjb7OOXGMul-F7lpk6wixD58YXluuwcc6Cp_cm3WJyI0VTwn-IkJm_EosPptSKrntbcU May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:34:44.805546 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: f659bfc9046342629cd0c35e08871246 May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.806889 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '64c37abf-5b6b-4f1a-905c-102625d80f3f'} May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:44.807640 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.812374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:44.813577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Returning 404 to user: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:44.813577 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ed8e162b-a521-4b15-a2b0-4ef4b8886661 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 404 len: 111 microversion: 2.1 time: 0.069926 May 19 04:34:44.813577 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 445/908] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:34:44 2022] DELETE /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:34:44.815102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-29d05ac1-4947-4e2a-baeb-eb4a245ae42b req-e924c47f-b225-4ef6-bf0d-e3c2ff7c6c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0", "name": "network-vif-plugged", "status": "completed", "tag": "e3f937f7-39e2-483b-b059-a1a0eed90eae"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:44.824773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-29d05ac1-4947-4e2a-baeb-eb4a245ae42b req-e924c47f-b225-4ef6-bf0d-e3c2ff7c6c6f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.825631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-29d05ac1-4947-4e2a-baeb-eb4a245ae42b req-e924c47f-b225-4ef6-bf0d-e3c2ff7c6c6f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.841610 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-29d05ac1-4947-4e2a-baeb-eb4a245ae42b req-e924c47f-b225-4ef6-bf0d-e3c2ff7c6c6f service nova] Creating event network-vif-plugged:e3f937f7-39e2-483b-b059-a1a0eed90eae for instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 on n-h1-766726-30 May 19 04:34:44.847953 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-29d05ac1-4947-4e2a-baeb-eb4a245ae42b req-e924c47f-b225-4ef6-bf0d-e3c2ff7c6c6f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038595 May 19 04:34:44.853351 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 446/909] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:44.865881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6cacde67-ee10-4052-9c2f-0d01550a0664 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-766726-30", "block_migration": true, "disk_over_commit": false}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:44.867468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6cacde67-ee10-4052-9c2f-0d01550a0664 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:44.893395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cacde67-ee10-4052-9c2f-0d01550a0664 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.894690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cacde67-ee10-4052-9c2f-0d01550a0664 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.902244 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49721015-e66f-4788-af25-18033ba6d28b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 204 len: 0 microversion: 2.1 time: 0.223361 May 19 04:34:44.904531 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 464/910] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:34:44 2022] DELETE /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:34:44.909879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cacde67-ee10-4052-9c2f-0d01550a0664 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.910336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cacde67-ee10-4052-9c2f-0d01550a0664 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.911892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:44.913142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:44.921892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.922693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.923791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:44.924678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:44.954040 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] HTTP exception thrown: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Request method failure captured: May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f HTTP/1.1 May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg5Hh4NFtEdJBopDpHUa0wYcC3UktO4Epg2OdioXDhtyiwtHGJPtEOHLvBc2IUYpjIwD7MhIINA1Kn18KjIB2VszbtkdcE9OYMwzS0v7msSjb7OOXGMul-F7lpk6wixD58YXluuwcc6Cp_cm3WJyI0VTwn-IkJm_EosPptSKrntbcU May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:34:44.956864 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f659bfc9046342629cd0c35e08871246 May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.958644 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '64c37abf-5b6b-4f1a-905c-102625d80f3f'} May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:44.961857 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:44.963088 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:44.973022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Returning 404 to user: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:44.974370 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7452e284-0405-4915-bf5f-cabbf66551a9 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 404 len: 111 microversion: 2.1 time: 0.068274 May 19 04:34:44.978660 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 465/911] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:44 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:34:44.980893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-6cacde67-ee10-4052-9c2f-0d01550a0664 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lazy-loading 'flavor' on Instance uuid 7f2ae1de-c359-4358-ba9a-a978ce719a40 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:44.984367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31cfa19c-1a60-4ce4-a542-070031eaa8bd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315e033a0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:45.004378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6cacde67-ee10-4052-9c2f-0d01550a0664 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Going to try to live migrate instance to n-h2-766726-30 {{(pid=124818) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 04:34:45.009386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:45.056191 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31cfa19c-1a60-4ce4-a542-070031eaa8bd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 200 len: 1455 microversion: 2.1 time: 0.076074 May 19 04:34:45.063476 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 466/912] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:44 2022] GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:45.076475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1cf58723-ccf2-4245-bc6a-a5f1828fd74d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '.version_select at 0x7fd315df6e50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:45.121587 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1cf58723-ccf2-4245-bc6a-a5f1828fd74d tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-908441147" status: 202 len: 0 microversion: 2.1 time: 0.056849 May 19 04:34:45.126344 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 467/913] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:34:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-908441147 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:34:45.133764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-903337843", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "af325e41-dd5e-49a4-8d8b-0ae83cdd7660"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:45.212302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] validate_networks() for [('af325e41-dd5e-49a4-8d8b-0ae83cdd7660', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:34:45.804258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:34:45.804681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:34:45.805183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:34:45.805810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:34:45.806393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:34:45.821199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:45.821807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:45.822623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:45.827885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:45.855646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Getting quotas for project ff2741185bb8440db094f7bc87af8b2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:34:45.864417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Getting quotas for user 5b561a0c5d754a12a04e62664e607506 and project ff2741185bb8440db094f7bc87af8b2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:34:45.879588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:34:45.883152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:34:45.983567 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-53a7282c-21fe-40b9-9ac6-11ceda5a2578 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850468 May 19 04:34:45.989853 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 468/914] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:34:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:34:45.998620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3270a6d-950a-4afb-ac05-9e9aa7c10fe9 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:46.000491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3270a6d-950a-4afb-ac05-9e9aa7c10fe9 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:46.009362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3270a6d-950a-4afb-ac05-9e9aa7c10fe9 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:46.009828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3270a6d-950a-4afb-ac05-9e9aa7c10fe9 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:46.010627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3270a6d-950a-4afb-ac05-9e9aa7c10fe9 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:46.011072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3270a6d-950a-4afb-ac05-9e9aa7c10fe9 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:46.134526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-d3270a6d-950a-4afb-ac05-9e9aa7c10fe9 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:46.177879 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d3270a6d-950a-4afb-ac05-9e9aa7c10fe9 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1929 microversion: 2.75 time: 0.165497 May 19 04:34:46.181392 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 469/915] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:45 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:46.196280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e782fad8-338c-4a21-a868-74f217081278 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:46.197649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e782fad8-338c-4a21-a868-74f217081278 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:46.215235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e782fad8-338c-4a21-a868-74f217081278 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:46.216733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e782fad8-338c-4a21-a868-74f217081278 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:46.221174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e782fad8-338c-4a21-a868-74f217081278 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:46.221868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e782fad8-338c-4a21-a868-74f217081278 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:46.983522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e782fad8-338c-4a21-a868-74f217081278 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:46.993031 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e782fad8-338c-4a21-a868-74f217081278 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1325 microversion: 2.1 time: 0.809200 May 19 04:34:46.998338 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 470/916] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:46 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1325 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:47.010687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fda831e6-6761-4951-9549-b6cee21a48c0 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd3161e5940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:48.063938 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6cacde67-ee10-4052-9c2f-0d01550a0664 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/action" status: 202 len: 0 microversion: 2.1 time: 3.207911 May 19 04:34:48.064733 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 447/917] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:34:44 2022] POST /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/action => generated 0 bytes in 3211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:34:48.070448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:48.075677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:48.111566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:48.112796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:48.128082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:48.139076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:48.713482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:48.751805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:48.769268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:48.773107 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18209653-cf82-479e-9f50-5b5a9903bcc0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.704897 May 19 04:34:48.777827 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 448/918] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:48 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:48.794229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94c3ee4c-6e26-408d-92c4-fb2ccab6d47e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:48.795739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-94c3ee4c-6e26-408d-92c4-fb2ccab6d47e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:48.833131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94c3ee4c-6e26-408d-92c4-fb2ccab6d47e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:48.833636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94c3ee4c-6e26-408d-92c4-fb2ccab6d47e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:48.834470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94c3ee4c-6e26-408d-92c4-fb2ccab6d47e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:48.837246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94c3ee4c-6e26-408d-92c4-fb2ccab6d47e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:48.984187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94c3ee4c-6e26-408d-92c4-fb2ccab6d47e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:49.011318 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94c3ee4c-6e26-408d-92c4-fb2ccab6d47e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 200 len: 1259 microversion: 2.1 time: 0.231760 May 19 04:34:49.018420 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 449/919] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:48 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:49.035016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a5e1d0f6-282e-4d7f-b6e7-45e912b92c83 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316061d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:54.536092 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fda831e6-6761-4951-9549-b6cee21a48c0 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 200 len: 1421 microversion: 2.1 time: 7.535957 May 19 04:34:54.539450 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 471/920] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:46 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 1421 bytes in 7540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:54.546806 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a5e1d0f6-282e-4d7f-b6e7-45e912b92c83 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 200 len: 1464 microversion: 2.1 time: 5.515665 May 19 04:34:54.552984 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 450/921] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:49 2022] GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 1464 bytes in 5522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:54.556868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d45ac26-0d4d-4b52-8b04-db479822c522 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:54.557857 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:34:54.557857 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:34:54.562521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-962db079-f70c-45b4-aabb-abd93f148b15 req-fe51a0d4-2bdb-4425-bb49-e6fd20c095bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54201b4d-c068-43c2-bfe0-ea4714da319c", "name": "network-vif-unplugged", "status": "completed", "tag": "78fe9c44-54e2-4ef9-b736-17c7c375e11a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:54.578604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-962db079-f70c-45b4-aabb-abd93f148b15 req-fe51a0d4-2bdb-4425-bb49-e6fd20c095bb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:54.579338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-962db079-f70c-45b4-aabb-abd93f148b15 req-fe51a0d4-2bdb-4425-bb49-e6fd20c095bb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:54.594568 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-962db079-f70c-45b4-aabb-abd93f148b15 req-fe51a0d4-2bdb-4425-bb49-e6fd20c095bb service nova] Creating event network-vif-unplugged:78fe9c44-54e2-4ef9-b736-17c7c375e11a for instance 54201b4d-c068-43c2-bfe0-ea4714da319c on n-h1-766726-30 May 19 04:34:54.600402 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-962db079-f70c-45b4-aabb-abd93f148b15 req-fe51a0d4-2bdb-4425-bb49-e6fd20c095bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046081 May 19 04:34:54.601226 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 451/922] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:54.606878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-714026c9-3211-404b-b61d-4c47f3acbe26 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:54.608210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-714026c9-3211-404b-b61d-4c47f3acbe26 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:54.611155 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4d45ac26-0d4d-4b52-8b04-db479822c522 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/649022310" status: 202 len: 0 microversion: 2.1 time: 0.070593 May 19 04:34:54.614985 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 472/923] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:34:54 2022] DELETE /compute/v2.1/flavors/649022310 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:34:54.618749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-714026c9-3211-404b-b61d-4c47f3acbe26 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:54.619232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-714026c9-3211-404b-b61d-4c47f3acbe26 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:54.620181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-714026c9-3211-404b-b61d-4c47f3acbe26 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:54.620627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-714026c9-3211-404b-b61d-4c47f3acbe26 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:54.625302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2b9c8b3f-ca19-478f-b6d5-2fef0f5dbcdd req-5160975c-395a-4fe9-a6cb-f9974dc01cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54201b4d-c068-43c2-bfe0-ea4714da319c", "name": "network-vif-deleted", "tag": "78fe9c44-54e2-4ef9-b736-17c7c375e11a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:54.635150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2b9c8b3f-ca19-478f-b6d5-2fef0f5dbcdd req-5160975c-395a-4fe9-a6cb-f9974dc01cbe service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:54.635632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2b9c8b3f-ca19-478f-b6d5-2fef0f5dbcdd req-5160975c-395a-4fe9-a6cb-f9974dc01cbe service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:54.648504 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2b9c8b3f-ca19-478f-b6d5-2fef0f5dbcdd req-5160975c-395a-4fe9-a6cb-f9974dc01cbe service nova] Creating event network-vif-deleted:78fe9c44-54e2-4ef9-b736-17c7c375e11a for instance 54201b4d-c068-43c2-bfe0-ea4714da319c on n-h1-766726-30 May 19 04:34:54.654380 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2b9c8b3f-ca19-478f-b6d5-2fef0f5dbcdd req-5160975c-395a-4fe9-a6cb-f9974dc01cbe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036827 May 19 04:34:54.655236 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 473/924] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:54.660587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d7a14186-e7c1-4d26-8032-257b93b1f9fb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:54.661575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d7a14186-e7c1-4d26-8032-257b93b1f9fb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:54.677928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7a14186-e7c1-4d26-8032-257b93b1f9fb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:54.678356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7a14186-e7c1-4d26-8032-257b93b1f9fb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:54.679161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7a14186-e7c1-4d26-8032-257b93b1f9fb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:54.679643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7a14186-e7c1-4d26-8032-257b93b1f9fb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:54.713030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-714026c9-3211-404b-b61d-4c47f3acbe26 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] Lazy-loading 'services' on Instance uuid 23b05919-5870-450a-9a39-470192b0ec06 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:34:54.733804 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-714026c9-3211-404b-b61d-4c47f3acbe26 tempest-ServersAdmin275Test-1196441294 tempest-ServersAdmin275Test-1196441294-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1920 microversion: 2.75 time: 0.131140 May 19 04:34:54.735029 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 452/925] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:54 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1920 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:54.739746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da55249e-b600-4de2-a214-c54c73f7f021 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:54.740358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da55249e-b600-4de2-a214-c54c73f7f021 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:54.746364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da55249e-b600-4de2-a214-c54c73f7f021 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:54.755421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da55249e-b600-4de2-a214-c54c73f7f021 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:54.756338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da55249e-b600-4de2-a214-c54c73f7f021 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:54.756970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da55249e-b600-4de2-a214-c54c73f7f021 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:54.956663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d7a14186-e7c1-4d26-8032-257b93b1f9fb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:54.968751 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d7a14186-e7c1-4d26-8032-257b93b1f9fb tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1521 microversion: 2.1 time: 0.312278 May 19 04:34:54.969396 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 474/926] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:54 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:54.975445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:54.976244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:55.000792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.001274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.002326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.004297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.029162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-da55249e-b600-4de2-a214-c54c73f7f021 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:55.037951 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da55249e-b600-4de2-a214-c54c73f7f021 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.301717 May 19 04:34:55.038826 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 453/927] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:54 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:55.049228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-29a72136-bb80-457e-82e5-d8ba7125b633 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.053836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-29a72136-bb80-457e-82e5-d8ba7125b633 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:55.061123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29a72136-bb80-457e-82e5-d8ba7125b633 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.062301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29a72136-bb80-457e-82e5-d8ba7125b633 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.063241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29a72136-bb80-457e-82e5-d8ba7125b633 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.064062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29a72136-bb80-457e-82e5-d8ba7125b633 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.266322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:55.275438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:55.277499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:55.279715 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4d4ad503-62cc-43e8-b128-c5b2a4c28256 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.307913 May 19 04:34:55.284216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-29a72136-bb80-457e-82e5-d8ba7125b633 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:55.290749 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 475/928] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:54 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:55.292823 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-29a72136-bb80-457e-82e5-d8ba7125b633 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 200 len: 1307 microversion: 2.1 time: 0.248582 May 19 04:34:55.293453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 454/929] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:55 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 1307 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:55.296530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bfabacdd-574b-4d7d-a232-c47d9c4e0071 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315e030d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.298683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ecca6fc-90a1-463b-a534-5966a855043f tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.319398 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ecca6fc-90a1-463b-a534-5966a855043f tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.024594 May 19 04:34:55.320018 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 455/930] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:34:55 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:55.327352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-586c1f75-0782-432c-a98e-a8fd02ba8a4a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.328123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-586c1f75-0782-432c-a98e-a8fd02ba8a4a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:55.337180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-586c1f75-0782-432c-a98e-a8fd02ba8a4a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.337650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-586c1f75-0782-432c-a98e-a8fd02ba8a4a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.338447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-586c1f75-0782-432c-a98e-a8fd02ba8a4a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.338892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-586c1f75-0782-432c-a98e-a8fd02ba8a4a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.364451 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bfabacdd-574b-4d7d-a232-c47d9c4e0071 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 200 len: 1464 microversion: 2.1 time: 0.072232 May 19 04:34:55.371539 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 476/931] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:55 2022] GET /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 1464 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:55.371774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-586c1f75-0782-432c-a98e-a8fd02ba8a4a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:34:55.375846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21ef8323-0ec9-40b4-8a26-a423dce9a84c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.376902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-21ef8323-0ec9-40b4-8a26-a423dce9a84c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:55.383698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21ef8323-0ec9-40b4-8a26-a423dce9a84c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.384157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21ef8323-0ec9-40b4-8a26-a423dce9a84c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.384938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21ef8323-0ec9-40b4-8a26-a423dce9a84c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.385399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21ef8323-0ec9-40b4-8a26-a423dce9a84c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.529550 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-586c1f75-0782-432c-a98e-a8fd02ba8a4a tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 204 len: 0 microversion: 2.75 time: 0.207217 May 19 04:34:55.534885 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 456/932] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:34:55 2022] DELETE /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:34:55.536032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6178f360-77df-4c8a-8cd2-2abb237a7ef1 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.536935 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:34:55.536935 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:34:55.562388 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6178f360-77df-4c8a-8cd2-2abb237a7ef1 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1987996585" status: 202 len: 0 microversion: 2.1 time: 0.030215 May 19 04:34:55.563234 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 457/933] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:34:55 2022] DELETE /compute/v2.1/flavors/1987996585 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:34:55.568695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f8d946b-9e07-4477-8a78-c65f060074ce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.569815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f8d946b-9e07-4477-8a78-c65f060074ce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:55.577448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f8d946b-9e07-4477-8a78-c65f060074ce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.578495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f8d946b-9e07-4477-8a78-c65f060074ce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.578932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f8d946b-9e07-4477-8a78-c65f060074ce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.579443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f8d946b-9e07-4477-8a78-c65f060074ce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.636749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-21ef8323-0ec9-40b4-8a26-a423dce9a84c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:55.663859 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21ef8323-0ec9-40b4-8a26-a423dce9a84c tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1521 microversion: 2.1 time: 0.297377 May 19 04:34:55.664790 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 477/934] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:55 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:55.685679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.686299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:55.694322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.694729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.695511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.695940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.829585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:55.841454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:55.844908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:55.848742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:55.853674 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-72efb22e-a195-47fa-946e-c8154da61912 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1443 microversion: 2.75 time: 0.172852 May 19 04:34:55.855147 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 478/935] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:55 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1443 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:55.860415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b1165445-a589-4632-ad56-1c00c6b3bc22 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315e28dc0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.884212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:55.923462 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b1165445-a589-4632-ad56-1c00c6b3bc22 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 200 len: 1421 microversion: 2.1 time: 0.066677 May 19 04:34:55.924490 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 479/936] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:55 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 1421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:55.931231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f6f939d-7cb7-4cc6-93aa-63396bb57da0 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.957039 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f6f939d-7cb7-4cc6-93aa-63396bb57da0 tempest-ServersWithSpecificFlavorTestJSON-1478449992 tempest-ServersWithSpecificFlavorTestJSON-1478449992-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030384 May 19 04:34:55.958198 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 480/937] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:34:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:55.963763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c4d104e-ab6c-42e2-b918-f87bb14cab5d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1647824168", "metadata": {"": ""}}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c4d104e-ab6c-42e2-b918-f87bb14cab5d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action HTTP/1.1 May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 107 May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:34:55.968241 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1647824168", "metadata": {"": ""}}} May 19 04:34:55.969717 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1647824168', 'metadata': {'': ''}}}} May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'': ''} May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:55.970517 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:55.971839 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:55.973053 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:55.973053 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:55.973053 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:34:55.973053 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:34:55.973053 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:34:55.973053 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:55.975459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c4d104e-ab6c-42e2-b918-f87bb14cab5d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:55.976988 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3c4d104e-ab6c-42e2-b918-f87bb14cab5d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action" status: 400 len: 170 microversion: 2.1 time: 0.017235 May 19 04:34:55.978522 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 481/938] 10.222.0.58 () {60 vars in 1278 bytes} [Thu May 19 04:34:55 2022] POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action => generated 170 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:34:55.983727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:55.985215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:55.994247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.995701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:55.997031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:55.998684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.016060 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] HTTP exception thrown: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Request method failure captured: May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 HTTP/1.1 May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg5Hh4NFtEdJBopDpHUa0wYcC3UktO4Epg2OdioXDhtyiwtHGJPtEOHLvBc2IUYpjIwD7MhIINA1Kn18KjIB2VszbtkdcE9OYMwzS0v7msSjb7OOXGMul-F7lpk6wixD58YXluuwcc6Cp_cm3WJyI0VTwn-IkJm_EosPptSKrntbcU May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:34:56.022510 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f659bfc9046342629cd0c35e08871246 May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.024060 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c8ebe2e4-9522-4997-9a9f-0b105b071543'} May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:56.024873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.026241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.027660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Returning 404 to user: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:56.027660 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5d1d1511-9da5-4e35-a757-e2257face0a5 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 404 len: 111 microversion: 2.1 time: 0.046137 May 19 04:34:56.029106 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 482/939] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:34:55 2022] DELETE /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:34:56.034329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b217d1e4-1d57-4222-86bc-1eabc8eb9e1b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:56.035199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b217d1e4-1d57-4222-86bc-1eabc8eb9e1b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:56.042390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b217d1e4-1d57-4222-86bc-1eabc8eb9e1b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.042842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b217d1e4-1d57-4222-86bc-1eabc8eb9e1b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.043624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b217d1e4-1d57-4222-86bc-1eabc8eb9e1b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.044601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b217d1e4-1d57-4222-86bc-1eabc8eb9e1b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.279553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f8d946b-9e07-4477-8a78-c65f060074ce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:56.301478 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f8d946b-9e07-4477-8a78-c65f060074ce tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4" status: 200 len: 1468 microversion: 2.1 time: 0.737162 May 19 04:34:56.313750 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 458/940] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:55 2022] GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4 => generated 1468 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:56.320616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:56.321475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: c8ebe2e4-9522-4997-9a9f-0b105b071543] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:56.333384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.334086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.338916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.339592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.356272 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] HTTP exception thrown: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.358774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b217d1e4-1d57-4222-86bc-1eabc8eb9e1b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Request method failure captured: May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 HTTP/1.1 May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcg5Hh4NFtEdJBopDpHUa0wYcC3UktO4Epg2OdioXDhtyiwtHGJPtEOHLvBc2IUYpjIwD7MhIINA1Kn18KjIB2VszbtkdcE9OYMwzS0v7msSjb7OOXGMul-F7lpk6wixD58YXluuwcc6Cp_cm3WJyI0VTwn-IkJm_EosPptSKrntbcU May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:34:56.358964 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: f659bfc9046342629cd0c35e08871246 May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.360538 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c8ebe2e4-9522-4997-9a9f-0b105b071543'} May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:56.361452 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. May 19 04:34:56.362845 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:56.364224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Returning 404 to user: Instance c8ebe2e4-9522-4997-9a9f-0b105b071543 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:56.364224 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9efd6b0c-f28b-4f9f-962b-a851bc129b1a tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543" status: 404 len: 111 microversion: 2.1 time: 0.045321 May 19 04:34:56.364224 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 459/941] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:56 2022] GET /compute/v2.1/servers/c8ebe2e4-9522-4997-9a9f-0b105b071543 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:34:56.366095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:56.368766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf4d2905-1ec3-4c68-8d57-5c2d27635042 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:56.369430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cf4d2905-1ec3-4c68-8d57-5c2d27635042 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:56.373024 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b217d1e4-1d57-4222-86bc-1eabc8eb9e1b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1521 microversion: 2.1 time: 0.342009 May 19 04:34:56.374399 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 483/942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:56 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:56.381492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:56.382468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:56.388841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf4d2905-1ec3-4c68-8d57-5c2d27635042 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.389317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.389465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf4d2905-1ec3-4c68-8d57-5c2d27635042 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.390120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf4d2905-1ec3-4c68-8d57-5c2d27635042 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.390339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.390560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf4d2905-1ec3-4c68-8d57-5c2d27635042 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.391563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.392221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.597790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cf4d2905-1ec3-4c68-8d57-5c2d27635042 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:56.601299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:56.619819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:56.620092 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cf4d2905-1ec3-4c68-8d57-5c2d27635042 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.254722 May 19 04:34:56.620653 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 460/943] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:56 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:56.630015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f892852-0816-4995-aa24-a7097911d222 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:56.630015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f892852-0816-4995-aa24-a7097911d222 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:56.632401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:56.633387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f892852-0816-4995-aa24-a7097911d222 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.633842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f892852-0816-4995-aa24-a7097911d222 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.634242 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f77b7f1e-fb8e-48bb-baee-97083933a4fa tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.258580 May 19 04:34:56.634619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f892852-0816-4995-aa24-a7097911d222 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.635065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f892852-0816-4995-aa24-a7097911d222 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.635743 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 484/944] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:56 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:56.640580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-25804205-89a5-49eb-87b1-c1eb35f72c5d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315eaa820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:56.752042 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-25804205-89a5-49eb-87b1-c1eb35f72c5d tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images?changes-since=2022-05-19T04%3A33%3A04Z" status: 200 len: 2375 microversion: 2.1 time: 0.114960 May 19 04:34:56.759983 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 485/945] 10.222.0.58 () {58 vars in 1198 bytes} [Thu May 19 04:34:56 2022] GET /compute/v2.1/images?changes-since=2022-05-19T04%3A33%3A04Z => generated 2375 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:56.759983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:56.759983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:56.777504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.778219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.779705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.781009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.804340 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] HTTP exception thrown: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Request method failure captured: May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f HTTP/1.1 May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg5Hh4NFtEdJBopDpHUa0wYcC3UktO4Epg2OdioXDhtyiwtHGJPtEOHLvBc2IUYpjIwD7MhIINA1Kn18KjIB2VszbtkdcE9OYMwzS0v7msSjb7OOXGMul-F7lpk6wixD58YXluuwcc6Cp_cm3WJyI0VTwn-IkJm_EosPptSKrntbcU May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:34:56.806207 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f659bfc9046342629cd0c35e08871246 May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:56.807782 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '64c37abf-5b6b-4f1a-905c-102625d80f3f'} May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:56.808742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:56.810132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:56.811371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Returning 404 to user: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:56.811371 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d44ed12a-cd33-4976-88fc-69b63ec3f4ba tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 404 len: 111 microversion: 2.1 time: 0.055535 May 19 04:34:56.813617 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 486/946] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:34:56 2022] DELETE /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:34:56.818937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e72059b-efdc-4cf1-adcc-ca0d12586032 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:56.819558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e72059b-efdc-4cf1-adcc-ca0d12586032 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:56.826409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e72059b-efdc-4cf1-adcc-ca0d12586032 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.826868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e72059b-efdc-4cf1-adcc-ca0d12586032 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.828103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e72059b-efdc-4cf1-adcc-ca0d12586032 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.828103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e72059b-efdc-4cf1-adcc-ca0d12586032 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.842743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0f892852-0816-4995-aa24-a7097911d222 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:56.852624 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f892852-0816-4995-aa24-a7097911d222 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 200 len: 1307 microversion: 2.1 time: 0.230637 May 19 04:34:56.853665 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 461/947] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:56 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:56.858776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-73168204-b113-4f5b-8fbc-41770d37309e req-f44b003e-04a1-4651-93f6-5e5c7f915a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7722f7-7133-4dc0-8b77-5930a6540977", "name": "network-vif-plugged", "status": "completed", "tag": "899edd27-edc4-49c6-a407-a9a5cd069533"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:56.867278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-73168204-b113-4f5b-8fbc-41770d37309e req-f44b003e-04a1-4651-93f6-5e5c7f915a74 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.867729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-73168204-b113-4f5b-8fbc-41770d37309e req-f44b003e-04a1-4651-93f6-5e5c7f915a74 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.880289 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-73168204-b113-4f5b-8fbc-41770d37309e req-f44b003e-04a1-4651-93f6-5e5c7f915a74 service nova] Creating event network-vif-plugged:899edd27-edc4-49c6-a407-a9a5cd069533 for instance 0e7722f7-7133-4dc0-8b77-5930a6540977 on n-h1-766726-30 May 19 04:34:56.885682 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-73168204-b113-4f5b-8fbc-41770d37309e req-f44b003e-04a1-4651-93f6-5e5c7f915a74 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030711 May 19 04:34:56.887667 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 462/948] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:56.893576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-42a76446-734c-4d00-836d-d4ff8fb8e615 req-cc65dab8-cfdb-49ea-9046-d3b584f00c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6853ff39-0163-4695-b867-c594611090d0", "tag": "eb84c282-9216-4222-bc7a-1129fa1ec71c"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:56.901949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-42a76446-734c-4d00-836d-d4ff8fb8e615 req-cc65dab8-cfdb-49ea-9046-d3b584f00c69 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:56.902394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-42a76446-734c-4d00-836d-d4ff8fb8e615 req-cc65dab8-cfdb-49ea-9046-d3b584f00c69 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:56.918470 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-42a76446-734c-4d00-836d-d4ff8fb8e615 req-cc65dab8-cfdb-49ea-9046-d3b584f00c69 service nova] Creating event network-changed:eb84c282-9216-4222-bc7a-1129fa1ec71c for instance 6853ff39-0163-4695-b867-c594611090d0 on n-h2-766726-30 May 19 04:34:56.924145 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-42a76446-734c-4d00-836d-d4ff8fb8e615 req-cc65dab8-cfdb-49ea-9046-d3b584f00c69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034331 May 19 04:34:56.925208 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 463/949] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:56.943952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e50d4a1-9788-42a9-83fc-17410992e1ea tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd316061160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:56.995785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e72059b-efdc-4cf1-adcc-ca0d12586032 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:57.004980 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e72059b-efdc-4cf1-adcc-ca0d12586032 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1521 microversion: 2.1 time: 0.190182 May 19 04:34:57.005599 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 487/950] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:56 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:57.010232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.010767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] [instance: 64c37abf-5b6b-4f1a-905c-102625d80f3f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:57.018354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.018801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:57.019710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.020171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:57.036413 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e50d4a1-9788-42a9-83fc-17410992e1ea tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-360138187" status: 200 len: 484 microversion: 2.1 time: 0.109846 May 19 04:34:57.036584 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] HTTP exception thrown: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:57.037328 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 464/951] 10.222.0.58 () {58 vars in 1228 bytes} [Thu May 19 04:34:56 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-360138187 => generated 484 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:57.042352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Request method failure captured: May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f HTTP/1.1 May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg5Hh4NFtEdJBopDpHUa0wYcC3UktO4Epg2OdioXDhtyiwtHGJPtEOHLvBc2IUYpjIwD7MhIINA1Kn18KjIB2VszbtkdcE9OYMwzS0v7msSjb7OOXGMul-F7lpk6wixD58YXluuwcc6Cp_cm3WJyI0VTwn-IkJm_EosPptSKrntbcU May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:34:57.043809 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f7c96b0d5a45aaa70f0a09bdea144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: e9f7c96b0d5a45aaa70f0a09bdea144c May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418 May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f659bfc9046342629cd0c35e08871246 May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-676463418-project May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:57.045377 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '64c37abf-5b6b-4f1a-905c-102625d80f3f'} May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:57.046190 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. May 19 04:34:57.047533 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.049067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:57.050367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] Returning 404 to user: Instance 64c37abf-5b6b-4f1a-905c-102625d80f3f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:57.052707 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-20564929-594a-4151-a957-bc6b962c7003 tempest-ServersWithSpecificFlavorTestJSON-676463418 tempest-ServersWithSpecificFlavorTestJSON-676463418-project] 10.222.0.58 "GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f" status: 404 len: 111 microversion: 2.1 time: 0.045621 May 19 04:34:57.056451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.057130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:57.058418 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 488/952] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/servers/64c37abf-5b6b-4f1a-905c-102625d80f3f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:34:57.063283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab850e0d-b75b-4bd2-8de0-808a2081fe54 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd31604b160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.065225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.071691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:57.125514 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab850e0d-b75b-4bd2-8de0-808a2081fe54 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 200 len: 1421 microversion: 2.1 time: 0.065900 May 19 04:34:57.126093 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 489/953] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 1421 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:57.132205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86727caa-0733-4729-bd4e-d2a2e4539eb3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-695610312", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86727caa-0733-4729-bd4e-d2a2e4539eb3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action HTTP/1.1 May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 618 May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:34:57.136388 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:34:57.138584 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:34:57.139358 n-d-766726-30 devstack@n-api.service[124819]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-695610312", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} May 19 04:34:57.139358 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:34:57.139358 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-695610312', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 19 04:34:57.139633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:57.140467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.142091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:57.143514 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:57.143514 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:57.143514 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:34:57.143514 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:34:57.143514 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:34:57.143514 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:57.145108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86727caa-0733-4729-bd4e-d2a2e4539eb3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:57.146237 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-86727caa-0733-4729-bd4e-d2a2e4539eb3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action" status: 400 len: 938 microversion: 2.1 time: 0.019023 May 19 04:34:57.147369 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 490/954] 10.222.0.58 () {60 vars in 1278 bytes} [Thu May 19 04:34:57 2022] POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action => generated 938 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:34:57.152308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4c88f565-9553-4ca0-860c-12ef539904b3 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315eaa700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.164166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:57.174282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:57.176128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de3c49b39d4e4a3298a20d6f594846fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc478015a3e43f387ed88db381b37ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:57.182135 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-adae504a-b939-4427-bf18-f779fc5ec8b1 tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 200 len: 1443 microversion: 2.75 time: 0.143651 May 19 04:34:57.183456 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 465/955] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 1443 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:57.188738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-808a11a9-c578-494f-bb27-fe0f02cb5125 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.189625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-808a11a9-c578-494f-bb27-fe0f02cb5125 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:57.195237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:57.197191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-808a11a9-c578-494f-bb27-fe0f02cb5125 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.197849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-808a11a9-c578-494f-bb27-fe0f02cb5125 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:57.199134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-808a11a9-c578-494f-bb27-fe0f02cb5125 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.199799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-808a11a9-c578-494f-bb27-fe0f02cb5125 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:57.293562 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4c88f565-9553-4ca0-860c-12ef539904b3 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images?server=ab072e19-b664-4518-b3a1-4d6a31cdbac4" status: 200 len: 957 microversion: 2.1 time: 0.144825 May 19 04:34:57.298672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 491/956] 10.222.0.58 () {58 vars in 1208 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/images?server=ab072e19-b664-4518-b3a1-4d6a31cdbac4 => generated 957 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:57.312835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4013a552-4092-4103-aa83-59185a874000 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31604b430>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.402633 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4013a552-4092-4103-aa83-59185a874000 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 485 microversion: 2.1 time: 0.094107 May 19 04:34:57.403553 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 492/957] 10.222.0.58 () {58 vars in 1316 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 485 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:34:57.421024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b297974a-09ec-4a63-a1fa-5999934cd8e1 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315eaaaf0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.475778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-808a11a9-c578-494f-bb27-fe0f02cb5125 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:57.495819 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-808a11a9-c578-494f-bb27-fe0f02cb5125 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1521 microversion: 2.1 time: 0.311091 May 19 04:34:57.498285 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b297974a-09ec-4a63-a1fa-5999934cd8e1 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 485 microversion: 2.1 time: 0.083979 May 19 04:34:57.511924 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 493/958] 10.222.0.58 () {58 vars in 1302 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 485 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:57.512431 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 466/959] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:57.528068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9c6f42a8-a380-47f3-bab8-0ca2b26cbddd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31608b0d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.529534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b35c6061-33a5-44cc-88bf-9884706b423d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.532308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b35c6061-33a5-44cc-88bf-9884706b423d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:57.555907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b35c6061-33a5-44cc-88bf-9884706b423d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.556638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b35c6061-33a5-44cc-88bf-9884706b423d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:57.560358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b35c6061-33a5-44cc-88bf-9884706b423d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.565863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b35c6061-33a5-44cc-88bf-9884706b423d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:57.666109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:57.783632 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9c6f42a8-a380-47f3-bab8-0ca2b26cbddd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.259151 May 19 04:34:57.791636 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 494/960] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:34:57.791636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9054e7ff-9f9a-4f73-bd6d-6403378dff59 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:57.791636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9054e7ff-9f9a-4f73-bd6d-6403378dff59 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:57.804056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9054e7ff-9f9a-4f73-bd6d-6403378dff59 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.804524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9054e7ff-9f9a-4f73-bd6d-6403378dff59 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:57.808779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9054e7ff-9f9a-4f73-bd6d-6403378dff59 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:57.809303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9054e7ff-9f9a-4f73-bd6d-6403378dff59 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.118326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9054e7ff-9f9a-4f73-bd6d-6403378dff59 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:58.134022 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9054e7ff-9f9a-4f73-bd6d-6403378dff59 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.348202 May 19 04:34:58.134896 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 495/961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:58.139820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:58.140707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:58.159039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b35c6061-33a5-44cc-88bf-9884706b423d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:58.167846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.170215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.171324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.171944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.172805 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b35c6061-33a5-44cc-88bf-9884706b423d tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1521 microversion: 2.1 time: 0.658388 May 19 04:34:58.188175 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 467/962] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:57 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1521 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:58.193662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c75fa8c3-7abf-4715-a910-13bcc020cbcb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315f7cc10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:58.299479 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c75fa8c3-7abf-4715-a910-13bcc020cbcb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.109654 May 19 04:34:58.308502 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 468/963] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:34:58 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:58.338093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c9917f7f-cc7f-4eb8-8678-83cb7b1bfb1b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:58.338801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c9917f7f-cc7f-4eb8-8678-83cb7b1bfb1b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:58.352555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9917f7f-cc7f-4eb8-8678-83cb7b1bfb1b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.353041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9917f7f-cc7f-4eb8-8678-83cb7b1bfb1b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.353878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9917f7f-cc7f-4eb8-8678-83cb7b1bfb1b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.354318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9917f7f-cc7f-4eb8-8678-83cb7b1bfb1b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.497859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:58.519473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:58.521645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:58.523067 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-03c7e8e9-909c-4cb4-a756-9949d7ad2c39 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.387055 May 19 04:34:58.523948 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 496/964] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:58 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:34:58.543018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d2dd75ac-9983-4c40-a9c1-3259c89cbb8c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315db0940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:58.612840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c9917f7f-cc7f-4eb8-8678-83cb7b1bfb1b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:58.614853 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d2dd75ac-9983-4c40-a9c1-3259c89cbb8c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 200 len: 1421 microversion: 2.1 time: 0.089691 May 19 04:34:58.615604 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 497/965] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:34:58 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 1421 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:58.626507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1ee95e2-26d8-40a2-b9ed-88efbfd158bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:58.627091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c9917f7f-cc7f-4eb8-8678-83cb7b1bfb1b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 200 len: 1307 microversion: 2.1 time: 0.317062 May 19 04:34:58.628148 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 469/966] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:58 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1ee95e2-26d8-40a2-b9ed-88efbfd158bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action HTTP/1.1 May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 285 May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:34:58.631160 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:34:58.632752 n-d-766726-30 devstack@n-api.service[124819]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:34:58.634289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:34:58.635036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:34:58.636471 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:34:58.637448 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:34:58.637448 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:34:58.638661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1ee95e2-26d8-40a2-b9ed-88efbfd158bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:58.641127 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1ee95e2-26d8-40a2-b9ed-88efbfd158bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action" status: 400 len: 619 microversion: 2.1 time: 0.024279 May 19 04:34:58.641996 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 498/967] 10.222.0.58 () {60 vars in 1278 bytes} [Thu May 19 04:34:58 2022] POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:34:58.649038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2806086b-bbac-4306-95a6-5873ca308ca7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315db1af0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:58.649904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:58.656007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] [instance: 23b05919-5870-450a-9a39-470192b0ec06] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:58.664903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.665682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.666629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.667656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.691993 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] HTTP exception thrown: Instance 23b05919-5870-450a-9a39-470192b0ec06 could not be found. May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Request method failure captured: May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 HTTP/1.1 May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcigo4iShsnSU60jaNnRs70ImUqX5Hjcw50IEhxakn1Te1aiuBChtqzDRPIDW_dV4Hh1YL08v-IndsKHKqaycp5nAo64nZHNwT8byD3h0xMHOp8TEsn8L1tW9W6z6CScmv6XWhuj906jywPqd0cUuOJQesQrHLXXqgmXAC0VP9jJU9M May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.75 May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 5dc478015a3e43f387ed88db381b37ed May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersAdmin275Test-85490595 May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:34:58.694316 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dc478015a3e43f387ed88db381b37ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dc478015a3e43f387ed88db381b37ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dc478015a3e43f387ed88db381b37ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dc478015a3e43f387ed88db381b37ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersAdmin275Test-85490595 May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 5dc478015a3e43f387ed88db381b37ed May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersAdmin275Test-85490595 May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersAdmin275Test-85490595-project May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: de3c49b39d4e4a3298a20d6f594846fc May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersAdmin275Test-85490595-project May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 23b05919-5870-450a-9a39-470192b0ec06 could not be found. May 19 04:34:58.695750 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '23b05919-5870-450a-9a39-470192b0ec06'} May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b05919-5870-450a-9a39-470192b0ec06 could not be found. May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:34:58.696590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b05919-5870-450a-9a39-470192b0ec06 could not be found. May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b05919-5870-450a-9a39-470192b0ec06 could not be found. May 19 04:34:58.697782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:34:58.698937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] Returning 404 to user: Instance 23b05919-5870-450a-9a39-470192b0ec06 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:34:58.698937 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b151a6d9-7718-4151-9d5c-251d6042e8ae tempest-ServersAdmin275Test-85490595 tempest-ServersAdmin275Test-85490595-project] 10.222.0.58 "GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06" status: 404 len: 111 microversion: 2.75 time: 0.066240 May 19 04:34:58.698937 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 470/968] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:58 2022] GET /compute/v2.1/servers/23b05919-5870-450a-9a39-470192b0ec06 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:34:58.702109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ddd9d8fc-d667-4307-b439-043cf70eacf2 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:58.703063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ddd9d8fc-d667-4307-b439-043cf70eacf2 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:58.710373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ddd9d8fc-d667-4307-b439-043cf70eacf2 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.711138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ddd9d8fc-d667-4307-b439-043cf70eacf2 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.711997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ddd9d8fc-d667-4307-b439-043cf70eacf2 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.712507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ddd9d8fc-d667-4307-b439-043cf70eacf2 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.814299 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2806086b-bbac-4306-95a6-5873ca308ca7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.169688 May 19 04:34:58.822896 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 499/969] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:34:58 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:58.835921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8919bc3e-2ad2-4cbf-a363-874cfbb789e0 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315e28310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:58.899415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ddd9d8fc-d667-4307-b439-043cf70eacf2 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:58.909498 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ddd9d8fc-d667-4307-b439-043cf70eacf2 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1521 microversion: 2.1 time: 0.211617 May 19 04:34:58.911069 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 471/970] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:58 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:58.927864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ae0ee25-eb19-4dae-8f2d-6bae419a364e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:58.930323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2ae0ee25-eb19-4dae-8f2d-6bae419a364e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:58.941844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ae0ee25-eb19-4dae-8f2d-6bae419a364e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.942505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ae0ee25-eb19-4dae-8f2d-6bae419a364e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:58.945367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ae0ee25-eb19-4dae-8f2d-6bae419a364e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:58.947063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ae0ee25-eb19-4dae-8f2d-6bae419a364e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:59.080904 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8919bc3e-2ad2-4cbf-a363-874cfbb789e0 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/detail?changes-since=2022-05-19T04%3A32%3A59Z" status: 200 len: 6333 microversion: 2.1 time: 0.256479 May 19 04:34:59.086114 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 500/971] 10.222.0.58 () {58 vars in 1219 bytes} [Thu May 19 04:34:58 2022] GET /compute/v2.1/images/detail?changes-since=2022-05-19T04%3A32%3A59Z => generated 6333 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:59.103003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f7d28c2b-84c9-463b-b8bc-04c7536b4934 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd3164a8940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:59.188821 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f7d28c2b-84c9-463b-b8bc-04c7536b4934 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-360138187" status: 200 len: 664 microversion: 2.1 time: 0.091126 May 19 04:34:59.189818 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 501/972] 10.222.0.58 () {58 vars in 1249 bytes} [Thu May 19 04:34:59 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-360138187 => generated 664 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:34:59.204070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92f5025d-49d7-498e-aae0-bf82966c27e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:59.207713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-92f5025d-49d7-498e-aae0-bf82966c27e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:59.222036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92f5025d-49d7-498e-aae0-bf82966c27e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:59.224384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92f5025d-49d7-498e-aae0-bf82966c27e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:59.226948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92f5025d-49d7-498e-aae0-bf82966c27e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:59.227318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2ae0ee25-eb19-4dae-8f2d-6bae419a364e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:59.228393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92f5025d-49d7-498e-aae0-bf82966c27e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:59.236098 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ae0ee25-eb19-4dae-8f2d-6bae419a364e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1521 microversion: 2.1 time: 0.313118 May 19 04:34:59.238372 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 472/973] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:58 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:59.243558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-62de46ef-0276-4933-98c8-7277184b9b08 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315f97040>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:59.332837 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-62de46ef-0276-4933-98c8-7277184b9b08 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1467 microversion: 2.1 time: 0.091037 May 19 04:34:59.340280 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 473/974] 10.222.0.58 () {58 vars in 1337 bytes} [Thu May 19 04:34:59 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2F894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1467 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:59.349054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-432c314a-3d94-4ed1-a900-a02f49d151cf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-45263411"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:34:59.355921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-432c314a-3d94-4ed1-a900-a02f49d151cf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:59.362904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-432c314a-3d94-4ed1-a900-a02f49d151cf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:59.363472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-432c314a-3d94-4ed1-a900-a02f49d151cf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:59.364264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-432c314a-3d94-4ed1-a900-a02f49d151cf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:59.364843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-432c314a-3d94-4ed1-a900-a02f49d151cf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:59.666824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-92f5025d-49d7-498e-aae0-bf82966c27e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:34:59.675648 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92f5025d-49d7-498e-aae0-bf82966c27e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.484405 May 19 04:34:59.680940 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 502/975] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:34:59 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:59.692508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-255ff8b3-b425-4d6f-86fc-47d37291040f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315db0f70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:59.889747 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-255ff8b3-b425-4d6f-86fc-47d37291040f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1467 microversion: 2.1 time: 0.207265 May 19 04:34:59.890365 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 503/976] 10.222.0.58 () {58 vars in 1323 bytes} [Thu May 19 04:34:59 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2F894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1467 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:34:59.909863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:34:59.910486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:34:59.923498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:34:59.933311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:59.943887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:34:59.944783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:34:59.945264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:00.011241 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-432c314a-3d94-4ed1-a900-a02f49d151cf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action" status: 202 len: 0 microversion: 2.1 time: 0.675337 May 19 04:35:00.013431 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 474/977] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:34:59 2022] POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:35:00.021699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b283a6e3-558b-4101-a3f7-f8181f60edc3 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd31615b940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:00.111603 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b283a6e3-558b-4101-a3f7-f8181f60edc3 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 200 len: 1421 microversion: 2.1 time: 0.096396 May 19 04:35:00.121465 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 475/978] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:00 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 1421 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:00.130164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6894a7d-e473-48d5-8b8c-394bce5a66e7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:00.132818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6894a7d-e473-48d5-8b8c-394bce5a66e7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:00.140323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:00.157498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6894a7d-e473-48d5-8b8c-394bce5a66e7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:00.157498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6894a7d-e473-48d5-8b8c-394bce5a66e7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:00.165134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:00.171934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:00.189245 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dfd685dd-ece8-414a-8419-145d6722f57a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.274176 May 19 04:35:00.189245 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 504/979] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:34:59 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:00.189584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6894a7d-e473-48d5-8b8c-394bce5a66e7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:00.189584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6894a7d-e473-48d5-8b8c-394bce5a66e7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:00.195673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-939f2098-42e0-4c49-9f78-00a60c9ad182 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315e9b700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:00.474107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e6894a7d-e473-48d5-8b8c-394bce5a66e7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:00.492704 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6894a7d-e473-48d5-8b8c-394bce5a66e7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 200 len: 1307 microversion: 2.1 time: 0.368996 May 19 04:35:00.498394 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-939f2098-42e0-4c49-9f78-00a60c9ad182 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.294485 May 19 04:35:00.499643 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 505/980] 10.222.0.58 () {58 vars in 1169 bytes} [Thu May 19 04:35:00 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:00.505985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1765994389"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:00.506549 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 476/981] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:00 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:00.513719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:00.519945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-81703930-b2d3-4cf2-ab5f-cdcd2ea06288 req-41f121d6-3042-442c-866d-4e1c05dc2a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6853ff39-0163-4695-b867-c594611090d0", "name": "network-vif-plugged", "status": "completed", "tag": "eb84c282-9216-4222-bc7a-1129fa1ec71c"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:00.537329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:00.548649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-81703930-b2d3-4cf2-ab5f-cdcd2ea06288 req-41f121d6-3042-442c-866d-4e1c05dc2a2b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:00.552579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:00.552579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:00.553193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-81703930-b2d3-4cf2-ab5f-cdcd2ea06288 req-41f121d6-3042-442c-866d-4e1c05dc2a2b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:00.553292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:00.591467 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-81703930-b2d3-4cf2-ab5f-cdcd2ea06288 req-41f121d6-3042-442c-866d-4e1c05dc2a2b service nova] Creating event network-vif-plugged:eb84c282-9216-4222-bc7a-1129fa1ec71c for instance 6853ff39-0163-4695-b867-c594611090d0 on n-h2-766726-30 May 19 04:35:00.604556 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-81703930-b2d3-4cf2-ab5f-cdcd2ea06288 req-41f121d6-3042-442c-866d-4e1c05dc2a2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093745 May 19 04:35:00.606034 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 477/982] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:00.624897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-90b4a092-2915-45d6-9aeb-6f17f4f8e8cc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315f955e0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:00.632797 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Cannot 'createImage' instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 while it is in task_state image_snapshot May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action HTTP/1.1 May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 85 May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:00.636539 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1765994389"}} May 19 04:35:00.638788 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: exception: Cannot 'createImage' instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 while it is in task_state image_snapshot May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1765994389'}}} May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1348, in _action_create_image May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 in task_state image_snapshot. Cannot snapshot while the instance is in this state. May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:00.639684 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1353, in _action_create_image May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 while it is in task_state image_snapshot May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 while it is in task_state image_snapshot May 19 04:35:00.641126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:00.644022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 409 to user: Cannot 'createImage' instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 while it is in task_state image_snapshot {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:00.646002 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-94ebac6d-3c5a-4cc1-ae81-fdcb5521db79 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action" status: 409 len: 159 microversion: 2.1 time: 0.145184 May 19 04:35:00.647208 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 506/983] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:35:00 2022] POST /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0/action => generated 159 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:35:00.670227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48e8d861-c51d-47f9-88ae-4f990292bd52 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '.version_select at 0x7fd315db0160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:00.987662 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-48e8d861-c51d-47f9-88ae-4f990292bd52 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/images/e2f5ab1b-5adb-4404-9c59-9f5c406d5ae5" status: 204 len: 0 microversion: 2.1 time: 0.322598 May 19 04:35:00.989346 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 507/984] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:00 2022] DELETE /compute/v2.1/images/e2f5ab1b-5adb-4404-9c59-9f5c406d5ae5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:01.020702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bde98993-bdf8-4883-a7e5-03d015c69604 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:01.021384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bde98993-bdf8-4883-a7e5-03d015c69604 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:01.047328 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-90b4a092-2915-45d6-9aeb-6f17f4f8e8cc tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.433531 May 19 04:35:01.049892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bde98993-bdf8-4883-a7e5-03d015c69604 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:01.050603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bde98993-bdf8-4883-a7e5-03d015c69604 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:01.054604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bde98993-bdf8-4883-a7e5-03d015c69604 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:01.054988 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 478/985] 10.222.0.58 () {58 vars in 1169 bytes} [Thu May 19 04:35:00 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:01.061254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bde98993-bdf8-4883-a7e5-03d015c69604 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:01.067834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-32a21641-4aa8-4e9c-bf23-77ae0766d433 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:01.070368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-32a21641-4aa8-4e9c-bf23-77ae0766d433 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:01.085841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a21641-4aa8-4e9c-bf23-77ae0766d433 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:01.086756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a21641-4aa8-4e9c-bf23-77ae0766d433 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:01.089420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a21641-4aa8-4e9c-bf23-77ae0766d433 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:01.090135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a21641-4aa8-4e9c-bf23-77ae0766d433 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:01.422907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32a21641-4aa8-4e9c-bf23-77ae0766d433 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:01.441194 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-32a21641-4aa8-4e9c-bf23-77ae0766d433 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1533 microversion: 2.1 time: 0.382278 May 19 04:35:01.441551 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 479/986] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:01 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1533 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:01.446300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d150bb20-1241-4729-9d0d-fb7ede13d9e5 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315f951f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:01.547916 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d150bb20-1241-4729-9d0d-fb7ede13d9e5 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/a784e77f-4241-416d-b5b0-40834f7e24eb" status: 200 len: 784 microversion: 2.1 time: 0.105035 May 19 04:35:01.550497 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 480/987] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:01 2022] GET /compute/v2.1/images/a784e77f-4241-416d-b5b0-40834f7e24eb => generated 784 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:01.557456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a2fa95ca-48f1-4352-8242-fa9d46b1c2a0 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315f9bc10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:01.597714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bde98993-bdf8-4883-a7e5-03d015c69604 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:01.607067 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bde98993-bdf8-4883-a7e5-03d015c69604 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.605578 May 19 04:35:01.608435 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 508/988] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:01 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:01.626675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:01.628436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:01.635157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:01.636048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:01.637176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:01.638356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:01.646242 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a2fa95ca-48f1-4352-8242-fa9d46b1c2a0 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 200 len: 1430 microversion: 2.1 time: 0.094259 May 19 04:35:01.646834 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 481/989] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:01 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 1430 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:01.671803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b5043c57-045e-4f58-9001-bc1f8fe9da57 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:01.672463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b5043c57-045e-4f58-9001-bc1f8fe9da57 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:01.682117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5043c57-045e-4f58-9001-bc1f8fe9da57 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:01.682577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5043c57-045e-4f58-9001-bc1f8fe9da57 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:01.683680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5043c57-045e-4f58-9001-bc1f8fe9da57 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:01.684150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5043c57-045e-4f58-9001-bc1f8fe9da57 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:01.941391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:01.950556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:01.962160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:01.964131 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-427281e4-25ce-4643-8cea-cb33a47bba99 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.354496 May 19 04:35:01.966852 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 509/990] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:01 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:01.986563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d954d033-618a-4ce0-a3b3-9c5b87d0d95c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315db1790>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:02.017490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5043c57-045e-4f58-9001-bc1f8fe9da57 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:02.052234 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b5043c57-045e-4f58-9001-bc1f8fe9da57 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 200 len: 1307 microversion: 2.1 time: 0.404206 May 19 04:35:02.063225 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 482/991] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:01 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 1307 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:02.068047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b25573a3-9513-4d11-b253-2eda3cdc5a06 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd316087700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:02.083782 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d954d033-618a-4ce0-a3b3-9c5b87d0d95c tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.114313 May 19 04:35:02.084320 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 510/992] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:35:01 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:02.101510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ebb19a2d-8cff-451d-9976-069f772a6da3 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315e223a0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:02.171821 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b25573a3-9513-4d11-b253-2eda3cdc5a06 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 200 len: 1430 microversion: 2.1 time: 0.106546 May 19 04:35:02.173014 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 483/993] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:02 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 1430 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:02.189909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f576022-6225-41db-b9aa-a06052f7386e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:02.190887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f576022-6225-41db-b9aa-a06052f7386e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:02.201400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f576022-6225-41db-b9aa-a06052f7386e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:02.201966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f576022-6225-41db-b9aa-a06052f7386e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:02.203334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f576022-6225-41db-b9aa-a06052f7386e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:02.203774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f576022-6225-41db-b9aa-a06052f7386e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:02.383756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f576022-6225-41db-b9aa-a06052f7386e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:02.391965 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f576022-6225-41db-b9aa-a06052f7386e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1465 microversion: 2.1 time: 0.209413 May 19 04:35:02.392607 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 484/994] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:02 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1465 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:02.414060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b24ec249-c634-48f8-ad8e-fc75d1fd985b tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd3161bd5e0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:02.480661 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b24ec249-c634-48f8-ad8e-fc75d1fd985b tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/a784e77f-4241-416d-b5b0-40834f7e24eb" status: 200 len: 784 microversion: 2.1 time: 0.076017 May 19 04:35:02.482273 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 485/995] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:02 2022] GET /compute/v2.1/images/a784e77f-4241-416d-b5b0-40834f7e24eb => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:02.487225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43aa2452-f5a2-4175-b963-5a5ead2070b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:02.488354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43aa2452-f5a2-4175-b963-5a5ead2070b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:02.494838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43aa2452-f5a2-4175-b963-5a5ead2070b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:02.496147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43aa2452-f5a2-4175-b963-5a5ead2070b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:02.497238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43aa2452-f5a2-4175-b963-5a5ead2070b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:02.499143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43aa2452-f5a2-4175-b963-5a5ead2070b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:02.844623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-43aa2452-f5a2-4175-b963-5a5ead2070b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:02.859031 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43aa2452-f5a2-4175-b963-5a5ead2070b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1539 microversion: 2.1 time: 0.375408 May 19 04:35:02.868184 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 486/996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:02 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1539 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:02.875157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6b394dec-aea3-4d0c-bf31-948984a27886 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:02.904349 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6b394dec-aea3-4d0c-bf31-948984a27886 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034529 May 19 04:35:02.911379 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 487/997] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:02.926284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a4c24f6-bae9-454f-be31-5a28cb883311 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:02.930325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1a4c24f6-bae9-454f-be31-5a28cb883311 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:02.951801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a4c24f6-bae9-454f-be31-5a28cb883311 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:02.953311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a4c24f6-bae9-454f-be31-5a28cb883311 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:02.955230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a4c24f6-bae9-454f-be31-5a28cb883311 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:02.955990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a4c24f6-bae9-454f-be31-5a28cb883311 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:03.046458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ebb19a2d-8cff-451d-9976-069f772a6da3 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "DELETE /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e" status: 204 len: 0 microversion: 2.1 time: 0.949374 May 19 04:35:03.047080 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 511/998] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:02 2022] DELETE /compute/v2.1/images/ef103f04-2d76-4e01-8565-dd451a24860e => generated 0 bytes in 954 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:35:03.057853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-fe370d63-776e-4886-abe3-e73fb522ab88 req-2f1978a1-763e-4898-9f8f-2c4634f8c34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab072e19-b664-4518-b3a1-4d6a31cdbac4", "name": "network-vif-unplugged", "status": "completed", "tag": "9f40abdc-237f-468c-bebb-ab83998922c0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:03.078846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fe370d63-776e-4886-abe3-e73fb522ab88 req-2f1978a1-763e-4898-9f8f-2c4634f8c34e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:03.079289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fe370d63-776e-4886-abe3-e73fb522ab88 req-2f1978a1-763e-4898-9f8f-2c4634f8c34e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:03.100656 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-fe370d63-776e-4886-abe3-e73fb522ab88 req-2f1978a1-763e-4898-9f8f-2c4634f8c34e service nova] Creating event network-vif-unplugged:9f40abdc-237f-468c-bebb-ab83998922c0 for instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 on n-h2-766726-30 May 19 04:35:03.112423 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-fe370d63-776e-4886-abe3-e73fb522ab88 req-2f1978a1-763e-4898-9f8f-2c4634f8c34e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062779 May 19 04:35:03.119816 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 512/999] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:03.128622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-346c2e15-6529-4fd1-9fd8-2d2762fe7b68 req-9c4fbd1c-4499-4d29-931b-bf7f7097044b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc44755-e968-4e75-a8ce-76d6ab964726", "name": "network-vif-unplugged", "status": "completed", "tag": "5bac3271-c20e-44db-a594-acca0467ed52"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:03.159735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-346c2e15-6529-4fd1-9fd8-2d2762fe7b68 req-9c4fbd1c-4499-4d29-931b-bf7f7097044b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:03.160199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-346c2e15-6529-4fd1-9fd8-2d2762fe7b68 req-9c4fbd1c-4499-4d29-931b-bf7f7097044b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:03.188792 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-346c2e15-6529-4fd1-9fd8-2d2762fe7b68 req-9c4fbd1c-4499-4d29-931b-bf7f7097044b service nova] Creating event network-vif-unplugged:5bac3271-c20e-44db-a594-acca0467ed52 for instance 4bc44755-e968-4e75-a8ce-76d6ab964726 on n-h1-766726-30 May 19 04:35:03.195517 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-346c2e15-6529-4fd1-9fd8-2d2762fe7b68 req-9c4fbd1c-4499-4d29-931b-bf7f7097044b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073798 May 19 04:35:03.196736 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 513/1000] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:03.202712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3e8f27f9-7f87-4a8a-b3cd-bf6b2695cc72 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315e9b700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:03.252133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1a4c24f6-bae9-454f-be31-5a28cb883311 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:03.295232 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1a4c24f6-bae9-454f-be31-5a28cb883311 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.364249 May 19 04:35:03.298449 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 488/1001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:02 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:03.316851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:03.318656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:03.335939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:03.336296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:03.337106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:03.337568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:03.798107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:03.808090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:03.809745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:03.811705 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73c63aa5-f6ec-4b7e-8bbe-62371004ea16 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.510144 May 19 04:35:03.812279 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 489/1002] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:03 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:03.819653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71621ab8-78d7-4301-a6fa-a58cac2bd242 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315f498b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:04.328827 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3e8f27f9-7f87-4a8a-b3cd-bf6b2695cc72 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "DELETE /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 204 len: 0 microversion: 2.1 time: 1.130923 May 19 04:35:04.330669 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 514/1003] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:03 2022] DELETE /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 0 bytes in 1134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:04.337797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f30af9c-16af-42d9-8706-8d6d018737f3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:04.338598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6f30af9c-16af-42d9-8706-8d6d018737f3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:04.352208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f30af9c-16af-42d9-8706-8d6d018737f3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.353192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f30af9c-16af-42d9-8706-8d6d018737f3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.354362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f30af9c-16af-42d9-8706-8d6d018737f3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.355311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f30af9c-16af-42d9-8706-8d6d018737f3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.544611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6f30af9c-16af-42d9-8706-8d6d018737f3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:04.553870 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f30af9c-16af-42d9-8706-8d6d018737f3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 200 len: 1488 microversion: 2.1 time: 0.221769 May 19 04:35:04.555099 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 515/1004] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:04 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 1488 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:04.561738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3c80918-a528-42f5-a99d-2c9b1994353a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:04.562867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c3c80918-a528-42f5-a99d-2c9b1994353a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:04.575329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3c80918-a528-42f5-a99d-2c9b1994353a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.576077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3c80918-a528-42f5-a99d-2c9b1994353a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.577107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3c80918-a528-42f5-a99d-2c9b1994353a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.578750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3c80918-a528-42f5-a99d-2c9b1994353a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.620063 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-71621ab8-78d7-4301-a6fa-a58cac2bd242 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "DELETE /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235" status: 204 len: 0 microversion: 2.1 time: 0.806684 May 19 04:35:04.620645 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 490/1005] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:03 2022] DELETE /compute/v2.1/images/bba0d25b-a607-4fdb-ae8f-35d20339c235 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:04.765109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c3c80918-a528-42f5-a99d-2c9b1994353a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:04.773477 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3c80918-a528-42f5-a99d-2c9b1994353a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1534 microversion: 2.1 time: 0.217006 May 19 04:35:04.774678 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 516/1006] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:04 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1534 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:04.781730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7c4a2d81-72a6-48c1-8e25-6b039b60395b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:04.782765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7c4a2d81-72a6-48c1-8e25-6b039b60395b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:04.790507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c4a2d81-72a6-48c1-8e25-6b039b60395b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.791118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c4a2d81-72a6-48c1-8e25-6b039b60395b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.791975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c4a2d81-72a6-48c1-8e25-6b039b60395b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.792410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c4a2d81-72a6-48c1-8e25-6b039b60395b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.814518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2af9957-2981-4894-be67-c7ef130e41f4 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Action: 'update', calling method: .version_select at 0x7fd315f49790>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:04.816151 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:04.816151 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:04.817592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2af9957-2981-4894-be67-c7ef130e41f4 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.818201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2af9957-2981-4894-be67-c7ef130e41f4 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.827350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2af9957-2981-4894-be67-c7ef130e41f4 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.828016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2af9957-2981-4894-be67-c7ef130e41f4 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.836109 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c2af9957-2981-4894-be67-c7ef130e41f4 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] HTTP exception thrown: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2af9957-2981-4894-be67-c7ef130e41f4 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Request method failure captured: May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: request: PUT /compute/v2.1/os-services/4ab07454-e647-49ee-8a6c-9f8befb52770 HTTP/1.1 May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 56 May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcj3y-_F3g2bh08txzR6AuGm3dTbJfYsywRAVgish3N_VRmLx-sTdg9Xc0ZWgQzOWNs0_eo1fcjSplhoHqQDZ7V4E97b4zD1Jlf0xYdH8uUUqXXAvD3gOGM674gGKVS71_t9PX3H8b_jG_xVngdsiXvQmwo1zspw0xf9q0vtyJtZK8U May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.53 May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 89d2454706964dd989ae469a18360bfa May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1859452458 May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:35:04.838480 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/89d2454706964dd989ae469a18360bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89d2454706964dd989ae469a18360bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89d2454706964dd989ae469a18360bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_89d2454706964dd989ae469a18360bfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1859452458 May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 89d2454706964dd989ae469a18360bfa May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1859452458 May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: ddc2782ab9a546fd925929a0ed5b87ad May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: {"status": "disabled", "disabled_reason": "maintenance"} May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:04.840103 n-d-766726-30 devstack@n-api.service[124818]: exception: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '4ab07454-e647-49ee-8a6c-9f8befb52770', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.841711 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:04.843288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:04.844778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:04.844778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:04.844778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.845770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2af9957-2981-4894-be67-c7ef130e41f4 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Returning 404 to user: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:04.846788 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2af9957-2981-4894-be67-c7ef130e41f4 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/4ab07454-e647-49ee-8a6c-9f8befb52770" status: 404 len: 110 microversion: 2.53 time: 0.224813 May 19 04:35:04.847553 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 491/1007] 10.222.0.58 () {62 vars in 1308 bytes} [Thu May 19 04:35:04 2022] PUT /compute/v2.1/os-services/4ab07454-e647-49ee-8a6c-9f8befb52770 => generated 110 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:35:04.855483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a5c954e-8e03-4ee0-9596-c432b7f4b18a tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315fef4c0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:04.880372 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-2a5c954e-8e03-4ee0-9596-c432b7f4b18a tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] HTTP exception thrown: Image not found. May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a5c954e-8e03-4ee0-9596-c432b7f4b18a tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Request method failure captured: May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 HTTP/1.1 May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcjNT-my8O729XtoMVsfzp4RRdmksTEfl6C0IzLTWh9CUEn2uHEIXxDj_ORBMiWPFJYrlSZ8ri-IHFgcgG8BXbW4yKKvXxbuZHlcRjOyv3q8yQEwaF9jpjQIIGB5jgZ2Q9Ho3px96eMybAnleREn6hzqKiN934KtBPef77GMGme9EIE May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 5edbfd578f24447bbc845b88cbca6f3f May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesOneServerTestJSON-708401828 May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:04.907247 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesOneServerTestJSON-708401828 May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 5edbfd578f24447bbc845b88cbca6f3f May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-708401828 May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesOneServerTestJSON-708401828-project May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b29b563514df4ad1b042894921248df9 May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesOneServerTestJSON-708401828-project May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: exception: Image not found. May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'df088de8-5747-4f43-98bb-942d887e2911'} May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:04.909402 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID df088de8-5747-4f43-98bb-942d887e2911 May 19 04:35:04.910326 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:35:04.911456 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df088de8-5747-4f43-98bb-942d887e2911 could not be found. May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:04.912681 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a5c954e-8e03-4ee0-9596-c432b7f4b18a tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Returning 404 to user: Image not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:04.915441 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2a5c954e-8e03-4ee0-9596-c432b7f4b18a tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 404 len: 62 microversion: 2.1 time: 0.060797 May 19 04:35:04.917145 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 492/1008] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:04 2022] GET /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:35:04.921620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9500acab-b588-45fb-8fd7-2c48e88ba09f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:04.922429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9500acab-b588-45fb-8fd7-2c48e88ba09f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:04.933172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9500acab-b588-45fb-8fd7-2c48e88ba09f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.933337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9500acab-b588-45fb-8fd7-2c48e88ba09f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.934549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9500acab-b588-45fb-8fd7-2c48e88ba09f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:04.935372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9500acab-b588-45fb-8fd7-2c48e88ba09f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:04.958390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7c4a2d81-72a6-48c1-8e25-6b039b60395b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:04.966792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-9500acab-b588-45fb-8fd7-2c48e88ba09f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lazy-loading 'flavor' on Instance uuid 6853ff39-0163-4695-b867-c594611090d0 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:35:04.975026 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7c4a2d81-72a6-48c1-8e25-6b039b60395b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.198843 May 19 04:35:04.977409 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 517/1009] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:04 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:04.983084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-565cd0d8-2c3e-4f1a-9aef-fe7abf1ca9eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31606f4c0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:05.102482 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9500acab-b588-45fb-8fd7-2c48e88ba09f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0/action" status: 202 len: 0 microversion: 2.1 time: 0.190351 May 19 04:35:05.103146 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 493/1010] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:35:04 2022] POST /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:35:05.118576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:05.119310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:05.128498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.129278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.130288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.133009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.139958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:05.327554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:05.337361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:05.338857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:05.341224 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-19beb2fc-51a8-4b6e-972f-7adf7a1cfdea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.236055 May 19 04:35:05.342146 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 494/1011] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:05 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:05.356735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0e3b017d-cfb4-4621-912d-8f2ea0d9cd77 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Action: 'update', calling method: .version_select at 0x7fd315f38ca0>, body: {"status": "disabled"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:05.359157 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:05.359157 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:05.361231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e3b017d-cfb4-4621-912d-8f2ea0d9cd77 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.361758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e3b017d-cfb4-4621-912d-8f2ea0d9cd77 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.367947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e3b017d-cfb4-4621-912d-8f2ea0d9cd77 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.368401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e3b017d-cfb4-4621-912d-8f2ea0d9cd77 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.373987 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-0e3b017d-cfb4-4621-912d-8f2ea0d9cd77 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] HTTP exception thrown: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0e3b017d-cfb4-4621-912d-8f2ea0d9cd77 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Request method failure captured: May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: request: PUT /compute/v2.1/os-services/4ab07454-e647-49ee-8a6c-9f8befb52770 HTTP/1.1 May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 22 May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcj3y-_F3g2bh08txzR6AuGm3dTbJfYsywRAVgish3N_VRmLx-sTdg9Xc0ZWgQzOWNs0_eo1fcjSplhoHqQDZ7V4E97b4zD1Jlf0xYdH8uUUqXXAvD3gOGM674gGKVS71_t9PX3H8b_jG_xVngdsiXvQmwo1zspw0xf9q0vtyJtZK8U May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.53 May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 89d2454706964dd989ae469a18360bfa May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1859452458 May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:35:05.375742 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/89d2454706964dd989ae469a18360bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89d2454706964dd989ae469a18360bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89d2454706964dd989ae469a18360bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_89d2454706964dd989ae469a18360bfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1859452458 May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 89d2454706964dd989ae469a18360bfa May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1859452458 May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: ddc2782ab9a546fd925929a0ed5b87ad May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: {"status": "disabled"} May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: exception: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.377189 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '4ab07454-e647-49ee-8a6c-9f8befb52770', 'body': {'status': 'disabled'}} May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:05.382314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:05.384046 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:05.385595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.385595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.385595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0e3b017d-cfb4-4621-912d-8f2ea0d9cd77 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Returning 404 to user: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:05.385595 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0e3b017d-cfb4-4621-912d-8f2ea0d9cd77 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/4ab07454-e647-49ee-8a6c-9f8befb52770" status: 404 len: 110 microversion: 2.53 time: 0.033698 May 19 04:35:05.385595 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 495/1012] 10.222.0.58 () {62 vars in 1308 bytes} [Thu May 19 04:35:05 2022] PUT /compute/v2.1/os-services/4ab07454-e647-49ee-8a6c-9f8befb52770 => generated 110 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:35:05.385595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a5da71b0-fd7e-4e8a-94d3-280a5b7b8d61 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-892546766"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:05.386743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a5da71b0-fd7e-4e8a-94d3-280a5b7b8d61 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:05.394806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5da71b0-fd7e-4e8a-94d3-280a5b7b8d61 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.395260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5da71b0-fd7e-4e8a-94d3-280a5b7b8d61 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.396225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5da71b0-fd7e-4e8a-94d3-280a5b7b8d61 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.396669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5da71b0-fd7e-4e8a-94d3-280a5b7b8d61 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.529788 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-565cd0d8-2c3e-4f1a-9aef-fe7abf1ca9eb tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "DELETE /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6" status: 204 len: 0 microversion: 2.1 time: 0.550664 May 19 04:35:05.534599 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 518/1013] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:04 2022] DELETE /compute/v2.1/images/1487743c-5fb3-47c9-abc0-33e677c14fc6 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:05.554042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a872b4fe-4338-45e5-b7dd-3d0c3bd4c868 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:05.554757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a872b4fe-4338-45e5-b7dd-3d0c3bd4c868 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:05.563409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a872b4fe-4338-45e5-b7dd-3d0c3bd4c868 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.564129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a872b4fe-4338-45e5-b7dd-3d0c3bd4c868 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.567214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a872b4fe-4338-45e5-b7dd-3d0c3bd4c868 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.569371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a872b4fe-4338-45e5-b7dd-3d0c3bd4c868 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.743129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a872b4fe-4338-45e5-b7dd-3d0c3bd4c868 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:05.754974 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a872b4fe-4338-45e5-b7dd-3d0c3bd4c868 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 200 len: 1496 microversion: 2.1 time: 0.218905 May 19 04:35:05.756606 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 519/1014] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:05 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 1496 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:05.762115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5097a216-1cf0-4465-a114-67b3116b854b req-acb80ffe-e31c-4fe1-b414-386d109f66a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc44755-e968-4e75-a8ce-76d6ab964726", "tag": "5bac3271-c20e-44db-a594-acca0467ed52"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:05.772972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5097a216-1cf0-4465-a114-67b3116b854b req-acb80ffe-e31c-4fe1-b414-386d109f66a6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.773516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5097a216-1cf0-4465-a114-67b3116b854b req-acb80ffe-e31c-4fe1-b414-386d109f66a6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.783937 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a5da71b0-fd7e-4e8a-94d3-280a5b7b8d61 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "POST /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977/action" status: 202 len: 0 microversion: 2.1 time: 0.404594 May 19 04:35:05.789157 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 496/1015] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:35:05 2022] POST /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:35:05.790773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-97b2753b-2932-4d8c-b443-93f84d73cbc2 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Action: 'update', calling method: .version_select at 0x7fd315f97280>, body: {"status": "enabled"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:05.792428 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5097a216-1cf0-4465-a114-67b3116b854b req-acb80ffe-e31c-4fe1-b414-386d109f66a6 service nova] Creating event network-changed:5bac3271-c20e-44db-a594-acca0467ed52 for instance 4bc44755-e968-4e75-a8ce-76d6ab964726 on n-h1-766726-30 May 19 04:35:05.792595 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:05.792595 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:05.794871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97b2753b-2932-4d8c-b443-93f84d73cbc2 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.795453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97b2753b-2932-4d8c-b443-93f84d73cbc2 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.798173 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5097a216-1cf0-4465-a114-67b3116b854b req-acb80ffe-e31c-4fe1-b414-386d109f66a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040073 May 19 04:35:05.798996 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 520/1016] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:05.802326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97b2753b-2932-4d8c-b443-93f84d73cbc2 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.802779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97b2753b-2932-4d8c-b443-93f84d73cbc2 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.807451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fbf87191-dfbd-4961-8403-fde0b72225d7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:05.808056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fbf87191-dfbd-4961-8403-fde0b72225d7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:05.810512 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-97b2753b-2932-4d8c-b443-93f84d73cbc2 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] HTTP exception thrown: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-97b2753b-2932-4d8c-b443-93f84d73cbc2 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Request method failure captured: May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: request: PUT /compute/v2.1/os-services/4ab07454-e647-49ee-8a6c-9f8befb52770 HTTP/1.1 May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 21 May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcj3y-_F3g2bh08txzR6AuGm3dTbJfYsywRAVgish3N_VRmLx-sTdg9Xc0ZWgQzOWNs0_eo1fcjSplhoHqQDZ7V4E97b4zD1Jlf0xYdH8uUUqXXAvD3gOGM674gGKVS71_t9PX3H8b_jG_xVngdsiXvQmwo1zspw0xf9q0vtyJtZK8U May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.53 May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 89d2454706964dd989ae469a18360bfa May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1859452458 May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:35:05.814071 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/89d2454706964dd989ae469a18360bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89d2454706964dd989ae469a18360bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/89d2454706964dd989ae469a18360bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_89d2454706964dd989ae469a18360bfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1859452458 May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 89d2454706964dd989ae469a18360bfa May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1859452458 May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: ddc2782ab9a546fd925929a0ed5b87ad May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: {"status": "enabled"} May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: exception: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.815685 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '4ab07454-e647-49ee-8a6c-9f8befb52770', 'body': {'status': 'enabled'}} May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:05.816556 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:05.818541 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:05.820423 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. May 19 04:35:05.820423 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:05.820560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbf87191-dfbd-4961-8403-fde0b72225d7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.820560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbf87191-dfbd-4961-8403-fde0b72225d7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.820560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbf87191-dfbd-4961-8403-fde0b72225d7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.820847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-97b2753b-2932-4d8c-b443-93f84d73cbc2 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Returning 404 to user: Service 4ab07454-e647-49ee-8a6c-9f8befb52770 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:05.821317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbf87191-dfbd-4961-8403-fde0b72225d7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.821595 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-97b2753b-2932-4d8c-b443-93f84d73cbc2 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/4ab07454-e647-49ee-8a6c-9f8befb52770" status: 404 len: 110 microversion: 2.53 time: 0.034828 May 19 04:35:05.822836 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 497/1017] 10.222.0.58 () {62 vars in 1308 bytes} [Thu May 19 04:35:05 2022] PUT /compute/v2.1/os-services/4ab07454-e647-49ee-8a6c-9f8befb52770 => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:35:05.830711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-869478bf-82b3-49f7-89f1-246eec95cfb8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:05.831547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-869478bf-82b3-49f7-89f1-246eec95cfb8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:05.840264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869478bf-82b3-49f7-89f1-246eec95cfb8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.841153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869478bf-82b3-49f7-89f1-246eec95cfb8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.842025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869478bf-82b3-49f7-89f1-246eec95cfb8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:05.842707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869478bf-82b3-49f7-89f1-246eec95cfb8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:05.861533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fbf87191-dfbd-4961-8403-fde0b72225d7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:35:05.917556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:06.005883 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fbf87191-dfbd-4961-8403-fde0b72225d7 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "DELETE /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 204 len: 0 microversion: 2.1 time: 0.205374 May 19 04:35:06.006935 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 521/1018] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:35:05 2022] DELETE /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:06.012988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-91ef40b0-59c1-4064-824c-2b17beb22ec1 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315e28d30>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.050519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-869478bf-82b3-49f7-89f1-246eec95cfb8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:06.070193 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-869478bf-82b3-49f7-89f1-246eec95cfb8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1521 microversion: 2.1 time: 0.245827 May 19 04:35:06.071028 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 498/1019] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:05 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:06.075872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-449f812f-eaca-4170-989f-4063d77ffa11 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.077204 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-91ef40b0-59c1-4064-824c-2b17beb22ec1 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1" status: 200 len: 1426 microversion: 2.1 time: 0.068898 May 19 04:35:06.077702 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:06.077702 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:06.077921 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 522/1020] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1 => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:06.079339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-449f812f-eaca-4170-989f-4063d77ffa11 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.080040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-449f812f-eaca-4170-989f-4063d77ffa11 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.081265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-449f812f-eaca-4170-989f-4063d77ffa11 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.081988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-449f812f-eaca-4170-989f-4063d77ffa11 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.103665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1ef19fa5-60a4-4490-9ef2-38f37f348910 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.104526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1ef19fa5-60a4-4490-9ef2-38f37f348910 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:06.111378 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-449f812f-eaca-4170-989f-4063d77ffa11 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.038873 May 19 04:35:06.112286 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 499/1021] 10.222.0.58 () {60 vars in 1177 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:06.117254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-65f22da3-03ee-446c-b995-7214a9f6d46a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.118146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-65f22da3-03ee-446c-b995-7214a9f6d46a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:06.122976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ef19fa5-60a4-4490-9ef2-38f37f348910 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.123434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ef19fa5-60a4-4490-9ef2-38f37f348910 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.124482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ef19fa5-60a4-4490-9ef2-38f37f348910 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.124927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ef19fa5-60a4-4490-9ef2-38f37f348910 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.126134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65f22da3-03ee-446c-b995-7214a9f6d46a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.126593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65f22da3-03ee-446c-b995-7214a9f6d46a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.127375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65f22da3-03ee-446c-b995-7214a9f6d46a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.127819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65f22da3-03ee-446c-b995-7214a9f6d46a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.498179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1ef19fa5-60a4-4490-9ef2-38f37f348910 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:06.511016 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1ef19fa5-60a4-4490-9ef2-38f37f348910 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.419698 May 19 04:35:06.511999 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 523/1022] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:06.517732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-91cc90d3-0a22-426f-8a49-3ae8a76cc493 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.518436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-91cc90d3-0a22-426f-8a49-3ae8a76cc493 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:06.525564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-91cc90d3-0a22-426f-8a49-3ae8a76cc493 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.526243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-91cc90d3-0a22-426f-8a49-3ae8a76cc493 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.527291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-91cc90d3-0a22-426f-8a49-3ae8a76cc493 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.528463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-91cc90d3-0a22-426f-8a49-3ae8a76cc493 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.531096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65f22da3-03ee-446c-b995-7214a9f6d46a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:06.544262 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-65f22da3-03ee-446c-b995-7214a9f6d46a tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1474 microversion: 2.1 time: 0.429801 May 19 04:35:06.545000 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 500/1023] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1474 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:06.552477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b96f2ce-db4b-4dbc-8ad1-a8f4f4ea9601 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.553913 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:06.553913 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:06.555337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b96f2ce-db4b-4dbc-8ad1-a8f4f4ea9601 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.556025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b96f2ce-db4b-4dbc-8ad1-a8f4f4ea9601 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.557138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b96f2ce-db4b-4dbc-8ad1-a8f4f4ea9601 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.557852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b96f2ce-db4b-4dbc-8ad1-a8f4f4ea9601 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.576420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-91cc90d3-0a22-426f-8a49-3ae8a76cc493 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:35:06.615350 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7b96f2ce-db4b-4dbc-8ad1-a8f4f4ea9601 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.068491 May 19 04:35:06.615607 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 501/1024] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:06.620272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0ea65342-0cc1-408a-bd45-221137e0c544 req-a55e58ef-6b08-4079-9de3-0f8d43052d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0", "name": "network-vif-plugged", "status": "completed", "tag": "e3f937f7-39e2-483b-b059-a1a0eed90eae"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:06.629671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0ea65342-0cc1-408a-bd45-221137e0c544 req-a55e58ef-6b08-4079-9de3-0f8d43052d32 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.630415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0ea65342-0cc1-408a-bd45-221137e0c544 req-a55e58ef-6b08-4079-9de3-0f8d43052d32 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.643058 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0ea65342-0cc1-408a-bd45-221137e0c544 req-a55e58ef-6b08-4079-9de3-0f8d43052d32 service nova] Creating event network-vif-plugged:e3f937f7-39e2-483b-b059-a1a0eed90eae for instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 on n-h1-766726-30 May 19 04:35:06.648133 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0ea65342-0cc1-408a-bd45-221137e0c544 req-a55e58ef-6b08-4079-9de3-0f8d43052d32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 May 19 04:35:06.648729 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 502/1025] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:06.654383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.655079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:06.661512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.661961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.662731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.663170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.692598 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-91cc90d3-0a22-426f-8a49-3ae8a76cc493 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 204 len: 0 microversion: 2.1 time: 0.177204 May 19 04:35:06.693511 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 524/1026] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:35:06 2022] DELETE /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:06.698968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a4dff64-bbb7-4d53-a1ce-8419996c9977 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.700981 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:06.700981 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:06.702211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a4dff64-bbb7-4d53-a1ce-8419996c9977 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.702649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a4dff64-bbb7-4d53-a1ce-8419996c9977 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.703445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a4dff64-bbb7-4d53-a1ce-8419996c9977 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.703873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a4dff64-bbb7-4d53-a1ce-8419996c9977 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.729002 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4a4dff64-bbb7-4d53-a1ce-8419996c9977 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.034216 May 19 04:35:06.737267 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 525/1027] 10.222.0.58 () {60 vars in 1177 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:06.745616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7fdd4217-0685-43d7-aaee-0281df8c8ce8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.747989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7fdd4217-0685-43d7-aaee-0281df8c8ce8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:06.756218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fdd4217-0685-43d7-aaee-0281df8c8ce8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.757348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fdd4217-0685-43d7-aaee-0281df8c8ce8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.758495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fdd4217-0685-43d7-aaee-0281df8c8ce8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.759169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fdd4217-0685-43d7-aaee-0281df8c8ce8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.893664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:06.906257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:06.906257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:06.907265 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8bf6061a-7677-412b-9a19-c2325168a90c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.257402 May 19 04:35:06.908297 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 503/1028] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:06.915569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-69de89e6-e38d-4964-a16b-9a67096c0297 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.922700 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:06.922700 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:06.924679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69de89e6-e38d-4964-a16b-9a67096c0297 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.925948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69de89e6-e38d-4964-a16b-9a67096c0297 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.927009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69de89e6-e38d-4964-a16b-9a67096c0297 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.927879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69de89e6-e38d-4964-a16b-9a67096c0297 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.948238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7fdd4217-0685-43d7-aaee-0281df8c8ce8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:06.956902 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-69de89e6-e38d-4964-a16b-9a67096c0297 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-766726-30&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.045403 May 19 04:35:06.957713 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7fdd4217-0685-43d7-aaee-0281df8c8ce8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1527 microversion: 2.1 time: 0.217450 May 19 04:35:06.964097 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 504/1029] 10.222.0.58 () {60 vars in 1236 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/os-services?host=n-d-766726-30&binary=xxx => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:06.969448 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 526/1030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1527 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:06.970041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-adc62256-3f2f-46eb-8295-3529a30dd4e4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.970891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-adc62256-3f2f-46eb-8295-3529a30dd4e4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:06.974220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afe4fc45-2f6a-4898-b7b2-16fe4600bce5 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:06.975406 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:06.975406 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:06.976627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afe4fc45-2f6a-4898-b7b2-16fe4600bce5 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.977099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afe4fc45-2f6a-4898-b7b2-16fe4600bce5 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.978017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afe4fc45-2f6a-4898-b7b2-16fe4600bce5 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.978251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-adc62256-3f2f-46eb-8295-3529a30dd4e4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.978487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afe4fc45-2f6a-4898-b7b2-16fe4600bce5 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.979198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-adc62256-3f2f-46eb-8295-3529a30dd4e4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:06.980063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-adc62256-3f2f-46eb-8295-3529a30dd4e4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:06.980734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-adc62256-3f2f-46eb-8295-3529a30dd4e4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.002923 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afe4fc45-2f6a-4898-b7b2-16fe4600bce5 tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.032324 May 19 04:35:07.009125 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 527/1031] 10.222.0.58 () {60 vars in 1177 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:07.013990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a86f93d-abc9-408c-b390-f4d3109e6d6c tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:07.015275 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:07.015275 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:07.016489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a86f93d-abc9-408c-b390-f4d3109e6d6c tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.017384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a86f93d-abc9-408c-b390-f4d3109e6d6c tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.018380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a86f93d-abc9-408c-b390-f4d3109e6d6c tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.018824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a86f93d-abc9-408c-b390-f4d3109e6d6c tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.047810 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a86f93d-abc9-408c-b390-f4d3109e6d6c tempest-ServicesAdminNegativeV253TestJSON-1859452458 tempest-ServicesAdminNegativeV253TestJSON-1859452458-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.037188 May 19 04:35:07.048441 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 528/1032] 10.222.0.58 () {60 vars in 1238 bytes} [Thu May 19 04:35:07 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:07.133342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-adc62256-3f2f-46eb-8295-3529a30dd4e4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:07.141163 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-adc62256-3f2f-46eb-8295-3529a30dd4e4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 200 len: 1479 microversion: 2.1 time: 0.175725 May 19 04:35:07.141961 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 505/1033] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:06 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 1479 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:07.155099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-68c16d9b-0606-4593-84d5-007d1b116826 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315f95d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:07.183453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00fc3e98-a26c-4e07-bb56-c56258f7d357 tempest-ServicesAdminNegativeV253TestJSON-905059539 tempest-ServicesAdminNegativeV253TestJSON-905059539-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:07.184922 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:07.184922 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:07.186221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-00fc3e98-a26c-4e07-bb56-c56258f7d357 tempest-ServicesAdminNegativeV253TestJSON-905059539 tempest-ServicesAdminNegativeV253TestJSON-905059539-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '79e070927c4b42019bd127c0a9c824e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96078008fd2546c0bffaba6c94a4243c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00fc3e98-a26c-4e07-bb56-c56258f7d357 tempest-ServicesAdminNegativeV253TestJSON-905059539 tempest-ServicesAdminNegativeV253TestJSON-905059539-project] Request method failure captured: May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-services HTTP/1.1 May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcj2Odsr0CUGmlQ1av2kwOJhXJB2DeOCMEAfYYw7yUla93f8DNJa6_ej8VWxPJlERPVwxHB65ugmco6dEVLGnhSs3G_IJiClY2f6Z55XsD0ldUF9nzFnOq5mhCEg1P1FkWVYs6FQ-WJ136sI9-NpZROgJqrYoyFXaM4f9ksdrA0cgLA May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.53 May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 96078008fd2546c0bffaba6c94a4243c May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-905059539 May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:07.188080 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/96078008fd2546c0bffaba6c94a4243c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96078008fd2546c0bffaba6c94a4243c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96078008fd2546c0bffaba6c94a4243c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_96078008fd2546c0bffaba6c94a4243c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-905059539 May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 96078008fd2546c0bffaba6c94a4243c May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-905059539 May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServicesAdminNegativeV253TestJSON-905059539-project May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 79e070927c4b42019bd127c0a9c824e5 May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-905059539-project May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 04:35:07.189569 n-d-766726-30 devstack@n-api.service[124819]: action_args: {} May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:35:07.190403 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 04:35:07.191649 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:07.192935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00fc3e98-a26c-4e07-bb56-c56258f7d357 tempest-ServicesAdminNegativeV253TestJSON-905059539 tempest-ServicesAdminNegativeV253TestJSON-905059539-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:07.192935 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00fc3e98-a26c-4e07-bb56-c56258f7d357 tempest-ServicesAdminNegativeV253TestJSON-905059539 tempest-ServicesAdminNegativeV253TestJSON-905059539-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.133519 May 19 04:35:07.192935 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 529/1034] 10.222.0.58 () {60 vars in 1177 bytes} [Thu May 19 04:35:07 2022] GET /compute/v2.1/os-services => generated 112 bytes in 135 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) May 19 04:35:07.198754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5f255e92-ad8c-4681-a099-181ca90954d4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-405765910"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:07.199887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5f255e92-ad8c-4681-a099-181ca90954d4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:07.209320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f255e92-ad8c-4681-a099-181ca90954d4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.209887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f255e92-ad8c-4681-a099-181ca90954d4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.210681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f255e92-ad8c-4681-a099-181ca90954d4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.211125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f255e92-ad8c-4681-a099-181ca90954d4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.248426 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-68c16d9b-0606-4593-84d5-007d1b116826 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1" status: 200 len: 1426 microversion: 2.1 time: 0.105202 May 19 04:35:07.249311 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 506/1035] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:07 2022] GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1 => generated 1426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:07.528850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-24e5cb08-fa89-4812-bf9c-3d3d0f9cbdef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:07.529557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-24e5cb08-fa89-4812-bf9c-3d3d0f9cbdef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:07.539530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24e5cb08-fa89-4812-bf9c-3d3d0f9cbdef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.539991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24e5cb08-fa89-4812-bf9c-3d3d0f9cbdef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.540771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24e5cb08-fa89-4812-bf9c-3d3d0f9cbdef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.545994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24e5cb08-fa89-4812-bf9c-3d3d0f9cbdef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.680907 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5f255e92-ad8c-4681-a099-181ca90954d4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0/action" status: 202 len: 0 microversion: 2.1 time: 0.489671 May 19 04:35:07.681582 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 530/1036] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:35:07 2022] POST /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:35:07.695058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4fdc0449-fc57-495a-8075-6aab2cd7e132 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:07.696082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4fdc0449-fc57-495a-8075-6aab2cd7e132 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:07.703872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fdc0449-fc57-495a-8075-6aab2cd7e132 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.704546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fdc0449-fc57-495a-8075-6aab2cd7e132 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.705489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fdc0449-fc57-495a-8075-6aab2cd7e132 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.706030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fdc0449-fc57-495a-8075-6aab2cd7e132 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.855684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-24e5cb08-fa89-4812-bf9c-3d3d0f9cbdef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:07.865820 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-24e5cb08-fa89-4812-bf9c-3d3d0f9cbdef tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.341731 May 19 04:35:07.873414 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 507/1037] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:07 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:07.882165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2610cba3-bcb9-49f0-926e-8d6d7023e001 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315f38ee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:07.953566 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2610cba3-bcb9-49f0-926e-8d6d7023e001 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73" status: 200 len: 1439 microversion: 2.1 time: 0.078707 May 19 04:35:07.954216 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 508/1038] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:07 2022] GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 => generated 1439 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:07.966594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:07.967224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:07.984180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.984625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:07.985429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:07.985864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:08.129322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4fdc0449-fc57-495a-8075-6aab2cd7e132 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:08.143888 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4fdc0449-fc57-495a-8075-6aab2cd7e132 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1474 microversion: 2.1 time: 0.457184 May 19 04:35:08.146975 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 531/1039] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:07 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1474 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:08.158018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-328ac1fd-f3e9-4edd-82bd-2d26cf1e9c12 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:08.162769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-328ac1fd-f3e9-4edd-82bd-2d26cf1e9c12 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:08.178748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-328ac1fd-f3e9-4edd-82bd-2d26cf1e9c12 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:08.182353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-328ac1fd-f3e9-4edd-82bd-2d26cf1e9c12 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:08.185126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-328ac1fd-f3e9-4edd-82bd-2d26cf1e9c12 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:08.185892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-328ac1fd-f3e9-4edd-82bd-2d26cf1e9c12 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:08.754468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:08.764129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:08.765999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:08.782473 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-22707ad3-0f02-46fe-b132-316c2b7212db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.827241 May 19 04:35:08.793194 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 509/1040] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:07 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:08.798833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71dec1f9-efdd-48d2-ba27-50e223c91d70 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315e7ad30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:08.867645 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-71dec1f9-efdd-48d2-ba27-50e223c91d70 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1" status: 200 len: 1426 microversion: 2.1 time: 0.072498 May 19 04:35:08.868327 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 510/1041] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:08 2022] GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1 => generated 1426 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:08.882604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-28a8db49-e078-44a4-84ea-d0cf32de5f00 req-3e57c134-6fc0-42b9-8f92-d38b0ce09a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7722f7-7133-4dc0-8b77-5930a6540977", "name": "network-vif-unplugged", "status": "completed", "tag": "899edd27-edc4-49c6-a407-a9a5cd069533"}, {"server_uuid": "10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0", "name": "network-vif-unplugged", "status": "completed", "tag": "e3f937f7-39e2-483b-b059-a1a0eed90eae"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:08.900954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-28a8db49-e078-44a4-84ea-d0cf32de5f00 req-3e57c134-6fc0-42b9-8f92-d38b0ce09a5e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:08.902003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-28a8db49-e078-44a4-84ea-d0cf32de5f00 req-3e57c134-6fc0-42b9-8f92-d38b0ce09a5e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:08.915383 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-28a8db49-e078-44a4-84ea-d0cf32de5f00 req-3e57c134-6fc0-42b9-8f92-d38b0ce09a5e service nova] Creating event network-vif-unplugged:899edd27-edc4-49c6-a407-a9a5cd069533 for instance 0e7722f7-7133-4dc0-8b77-5930a6540977 on n-h1-766726-30 May 19 04:35:08.916316 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-28a8db49-e078-44a4-84ea-d0cf32de5f00 req-3e57c134-6fc0-42b9-8f92-d38b0ce09a5e service nova] Creating event network-vif-unplugged:e3f937f7-39e2-483b-b059-a1a0eed90eae for instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 on n-h1-766726-30 May 19 04:35:08.924745 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-28a8db49-e078-44a4-84ea-d0cf32de5f00 req-3e57c134-6fc0-42b9-8f92-d38b0ce09a5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.055012 May 19 04:35:08.925662 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 511/1042] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:08.933067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5a7ba2ed-3b66-4e47-9dfb-31815c88988c req-c57928eb-6f7e-4a76-87b1-7d0d2f324cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894949df-7dda-4389-b7bc-ea820a53ffd1", "name": "network-vif-deleted", "tag": "8be6a741-ebd0-4f13-99c9-b902a49319b3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:08.942534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5a7ba2ed-3b66-4e47-9dfb-31815c88988c req-c57928eb-6f7e-4a76-87b1-7d0d2f324cf5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:08.943320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5a7ba2ed-3b66-4e47-9dfb-31815c88988c req-c57928eb-6f7e-4a76-87b1-7d0d2f324cf5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:08.955770 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5a7ba2ed-3b66-4e47-9dfb-31815c88988c req-c57928eb-6f7e-4a76-87b1-7d0d2f324cf5 service nova] Creating event network-vif-deleted:8be6a741-ebd0-4f13-99c9-b902a49319b3 for instance 894949df-7dda-4389-b7bc-ea820a53ffd1 on n-h2-766726-30 May 19 04:35:08.963641 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5a7ba2ed-3b66-4e47-9dfb-31815c88988c req-c57928eb-6f7e-4a76-87b1-7d0d2f324cf5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036286 May 19 04:35:08.964569 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 512/1043] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:08.970971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-250c7833-a047-4937-991f-76a9410ae7f5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:08.972027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-250c7833-a047-4937-991f-76a9410ae7f5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:08.980039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-250c7833-a047-4937-991f-76a9410ae7f5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:08.981489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-250c7833-a047-4937-991f-76a9410ae7f5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:08.982665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-250c7833-a047-4937-991f-76a9410ae7f5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:08.983317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-250c7833-a047-4937-991f-76a9410ae7f5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:09.050036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-328ac1fd-f3e9-4edd-82bd-2d26cf1e9c12 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:09.062422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-328ac1fd-f3e9-4edd-82bd-2d26cf1e9c12 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1527 microversion: 2.1 time: 0.913809 May 19 04:35:09.063012 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 532/1044] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:08 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1527 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:09.077724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-81d24613-aa8d-4781-9009-499c1b12546b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd31606f5e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:09.157226 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-81d24613-aa8d-4781-9009-499c1b12546b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73" status: 200 len: 1439 microversion: 2.1 time: 0.088059 May 19 04:35:09.163164 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 533/1045] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:09 2022] GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:09.177929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:09.178739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:09.188813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:09.190550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:09.192996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:09.193855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:09.241013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:09.241878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:09.242887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lazy-loading 'fault' on Instance uuid 894949df-7dda-4389-b7bc-ea820a53ffd1 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:35:09.380046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:09.388404 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7145007d-a7e2-4ea3-83df-c85e75a9c8b4 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 200 len: 1308 microversion: 2.1 time: 0.224518 May 19 04:35:09.391219 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 534/1046] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:09 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:09.531116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-250c7833-a047-4937-991f-76a9410ae7f5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:09.556369 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-250c7833-a047-4937-991f-76a9410ae7f5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.584500 May 19 04:35:09.559448 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 513/1047] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:08 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:09.801093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:09.803105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:09.813618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:09.814084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:09.814881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:09.815337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:09.885136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b338525-4ada-4f92-8a22-322a3eaac702 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd316061160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:09.982546 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b338525-4ada-4f92-8a22-322a3eaac702 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1" status: 200 len: 1426 microversion: 2.1 time: 0.103976 May 19 04:35:09.983919 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 514/1048] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:09 2022] GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1 => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:10.080661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-57c67d0a-4fa1-49d8-ad1c-55b0a3098b09 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:10.081526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-57c67d0a-4fa1-49d8-ad1c-55b0a3098b09 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:10.093972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c67d0a-4fa1-49d8-ad1c-55b0a3098b09 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.094689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c67d0a-4fa1-49d8-ad1c-55b0a3098b09 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.095884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c67d0a-4fa1-49d8-ad1c-55b0a3098b09 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.098006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c67d0a-4fa1-49d8-ad1c-55b0a3098b09 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.194291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:10.210166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:10.220680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:10.225647 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4cf895c0-2faf-45a9-9fff-f16290e8e1c8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.428432 May 19 04:35:10.227578 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 535/1049] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:09 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:10.242002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4fc1e347-84da-43c2-8531-5ce56ddd55a0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315d80790>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:10.361136 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4fc1e347-84da-43c2-8531-5ce56ddd55a0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73" status: 200 len: 1439 microversion: 2.1 time: 0.130047 May 19 04:35:10.372583 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 536/1050] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:10 2022] GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 => generated 1439 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:10.408873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:10.409904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: 894949df-7dda-4389-b7bc-ea820a53ffd1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:10.419887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.420879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.424371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.427286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.464402 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] HTTP exception thrown: Instance 894949df-7dda-4389-b7bc-ea820a53ffd1 could not be found. May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Request method failure captured: May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 HTTP/1.1 May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihch6YAiovKuJ3cTY4m9njSizULepJgXFxj4m4X7m0CHtAClsFl0LVBajC6JxnuJUtKLUI7KlvLarFjUmMwz9hpu56aPuz4mBSY6e3y972slZTZ3L6_-ZZRwSL61khGWHcO5isVQo76zNmZJ9WelldWKZXc7p6g-fhKptxBuIVSuPZL0 May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: e754cec8a31e4f18af60f5b0579fc028 May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListImageFiltersTestJSON-1800768009 May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:10.468197 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e754cec8a31e4f18af60f5b0579fc028"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e754cec8a31e4f18af60f5b0579fc028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e754cec8a31e4f18af60f5b0579fc028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e754cec8a31e4f18af60f5b0579fc028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListImageFiltersTestJSON-1800768009 May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: e754cec8a31e4f18af60f5b0579fc028 May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1800768009 May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListImageFiltersTestJSON-1800768009-project May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 532d8f47a46842fab6e2c03ef04e4b4a May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListImageFiltersTestJSON-1800768009-project May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 894949df-7dda-4389-b7bc-ea820a53ffd1 could not be found. May 19 04:35:10.469844 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '894949df-7dda-4389-b7bc-ea820a53ffd1'} May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894949df-7dda-4389-b7bc-ea820a53ffd1 could not be found. May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:10.470609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894949df-7dda-4389-b7bc-ea820a53ffd1 could not be found. May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894949df-7dda-4389-b7bc-ea820a53ffd1 could not be found. May 19 04:35:10.471845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:10.474351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Returning 404 to user: Instance 894949df-7dda-4389-b7bc-ea820a53ffd1 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:10.475711 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c919ceb-b270-41fe-846b-93c1ad4a9950 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1" status: 404 len: 111 microversion: 2.1 time: 0.071471 May 19 04:35:10.480121 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 537/1051] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:10 2022] GET /compute/v2.1/servers/894949df-7dda-4389-b7bc-ea820a53ffd1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:35:10.487561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3be923e2-44f1-4826-8ceb-2efaa0a9bccd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:10.488417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3be923e2-44f1-4826-8ceb-2efaa0a9bccd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:10.493761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-57c67d0a-4fa1-49d8-ad1c-55b0a3098b09 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:10.498986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be923e2-44f1-4826-8ceb-2efaa0a9bccd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.499743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be923e2-44f1-4826-8ceb-2efaa0a9bccd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.500858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be923e2-44f1-4826-8ceb-2efaa0a9bccd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.501601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be923e2-44f1-4826-8ceb-2efaa0a9bccd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.503121 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-57c67d0a-4fa1-49d8-ad1c-55b0a3098b09 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1527 microversion: 2.1 time: 0.428457 May 19 04:35:10.506665 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 515/1052] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:10 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1527 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:10.549603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3be923e2-44f1-4826-8ceb-2efaa0a9bccd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:35:10.575979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09b57d90-7a45-4373-a3bd-c164deb02054 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:10.576805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-09b57d90-7a45-4373-a3bd-c164deb02054 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:10.587256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09b57d90-7a45-4373-a3bd-c164deb02054 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.592926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09b57d90-7a45-4373-a3bd-c164deb02054 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.593998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09b57d90-7a45-4373-a3bd-c164deb02054 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.594594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09b57d90-7a45-4373-a3bd-c164deb02054 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.879054 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3be923e2-44f1-4826-8ceb-2efaa0a9bccd tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4" status: 204 len: 0 microversion: 2.1 time: 0.394302 May 19 04:35:10.880388 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 538/1053] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:35:10 2022] DELETE /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:10.904697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac4fe911-a952-4be9-8c7c-8d1771cd08ef tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:10.906492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ac4fe911-a952-4be9-8c7c-8d1771cd08ef tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:10.931350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac4fe911-a952-4be9-8c7c-8d1771cd08ef tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.935893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac4fe911-a952-4be9-8c7c-8d1771cd08ef tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.939027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac4fe911-a952-4be9-8c7c-8d1771cd08ef tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:10.940032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac4fe911-a952-4be9-8c7c-8d1771cd08ef tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:10.981853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:11.084304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-09b57d90-7a45-4373-a3bd-c164deb02054 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:11.122306 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-09b57d90-7a45-4373-a3bd-c164deb02054 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.549485 May 19 04:35:11.128407 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 516/1054] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:10 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:11.149374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-97c0d3dc-2bcf-4b92-8fc2-60848c8fa6c7 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315e80b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:11.277992 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-97c0d3dc-2bcf-4b92-8fc2-60848c8fa6c7 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1" status: 200 len: 1426 microversion: 2.1 time: 0.147968 May 19 04:35:11.280127 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 517/1055] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:11 2022] GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1 => generated 1426 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:11.292900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:11.297862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:11.315475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:11.320087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:11.323297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:11.323928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:11.635695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ac4fe911-a952-4be9-8c7c-8d1771cd08ef tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:11.646861 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac4fe911-a952-4be9-8c7c-8d1771cd08ef tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4" status: 200 len: 1474 microversion: 2.1 time: 0.757782 May 19 04:35:11.657779 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 539/1056] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:10 2022] GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4 => generated 1474 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:11.662922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1ce51d72-669f-4066-aca3-c1223d106942 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315e17820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:11.677744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:11.690225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:11.691744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:11.693213 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d13dfcd6-ac1f-4697-9660-0da7d97715a8 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.411678 May 19 04:35:11.694115 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 518/1057] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:11 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:11.699351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5c485be8-10f6-4493-8aeb-8eca481ff719 req-417941cb-e73f-467c-973b-bd61c8fe6674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0", "name": "network-vif-deleted", "tag": "e3f937f7-39e2-483b-b059-a1a0eed90eae"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:11.711211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5c485be8-10f6-4493-8aeb-8eca481ff719 req-417941cb-e73f-467c-973b-bd61c8fe6674 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:11.712048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5c485be8-10f6-4493-8aeb-8eca481ff719 req-417941cb-e73f-467c-973b-bd61c8fe6674 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:11.725967 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5c485be8-10f6-4493-8aeb-8eca481ff719 req-417941cb-e73f-467c-973b-bd61c8fe6674 service nova] Creating event network-vif-deleted:e3f937f7-39e2-483b-b059-a1a0eed90eae for instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 on n-h1-766726-30 May 19 04:35:11.733349 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5c485be8-10f6-4493-8aeb-8eca481ff719 req-417941cb-e73f-467c-973b-bd61c8fe6674 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037727 May 19 04:35:11.738745 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 519/1058] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:11.745807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:11.747458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:11.755500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:11.756200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:11.756649 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1ce51d72-669f-4066-aca3-c1223d106942 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73" status: 200 len: 1439 microversion: 2.1 time: 0.097615 May 19 04:35:11.757333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:11.757600 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 540/1059] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:11 2022] GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:11.759048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:11.778333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:11.806440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:11.807201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:11.807869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lazy-loading 'fault' on Instance uuid 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:35:11.868425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:11.889671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ecd9c220-7735-473f-96d7-55f699dfd332 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 200 len: 1315 microversion: 2.1 time: 0.149235 May 19 04:35:11.891243 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 520/1060] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:11 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:12.144547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf52d23d-db72-4f54-9e2f-71fd8f1b60fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:12.145898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cf52d23d-db72-4f54-9e2f-71fd8f1b60fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:12.155875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf52d23d-db72-4f54-9e2f-71fd8f1b60fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:12.157501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf52d23d-db72-4f54-9e2f-71fd8f1b60fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:12.158660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf52d23d-db72-4f54-9e2f-71fd8f1b60fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:12.162099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf52d23d-db72-4f54-9e2f-71fd8f1b60fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:12.437001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f9904558-b90a-477c-a52f-0533710ff769 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:12.463220 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f9904558-b90a-477c-a52f-0533710ff769 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.696123 May 19 04:35:12.472197 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 541/1061] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:12.488167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d957fd6-d78b-4048-bdf7-04c0388447de tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315e17820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:12.571199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cf52d23d-db72-4f54-9e2f-71fd8f1b60fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:12.587957 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cf52d23d-db72-4f54-9e2f-71fd8f1b60fd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.447711 May 19 04:35:12.589428 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 521/1062] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:12 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:12.604156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d4768af8-9e7a-4209-b749-d7f24be4529f tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:12.662861 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d4768af8-9e7a-4209-b749-d7f24be4529f tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.062748 May 19 04:35:12.679090 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 522/1063] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:35:12 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:12.689876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa83cbd0-71b3-45b7-b2f1-6064a65b1281 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:12.690501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aa83cbd0-71b3-45b7-b2f1-6064a65b1281 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:12.709530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa83cbd0-71b3-45b7-b2f1-6064a65b1281 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:12.709986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa83cbd0-71b3-45b7-b2f1-6064a65b1281 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:12.710803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa83cbd0-71b3-45b7-b2f1-6064a65b1281 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:12.711243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa83cbd0-71b3-45b7-b2f1-6064a65b1281 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:13.042972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aa83cbd0-71b3-45b7-b2f1-6064a65b1281 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532d8f47a46842fab6e2c03ef04e4b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e754cec8a31e4f18af60f5b0579fc028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:13.051605 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa83cbd0-71b3-45b7-b2f1-6064a65b1281 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4" status: 200 len: 1474 microversion: 2.1 time: 0.371478 May 19 04:35:13.069607 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 523/1064] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:12 2022] GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4 => generated 1474 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:13.093559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e0b9482-c46f-4754-8fef-b950d2c8bcd3 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:13.131332 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e0b9482-c46f-4754-8fef-b950d2c8bcd3 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.058150 May 19 04:35:13.136629 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 524/1065] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:13.155683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:13.157012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:13.176949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:13.183651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:13.186134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:13.188998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:13.644015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:13.658943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:13.666276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:13.678787 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b5c27e3d-5e03-4213-8268-8ebc67b2d37f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1647 microversion: 2.25 time: 0.530065 May 19 04:35:13.689805 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 525/1066] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:13 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1647 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:13.689805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9ef6aa6b-016c-4802-9652-2d784817b144 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315f38820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:16.942023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:17.024055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:21.641454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:22.446026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:23.176551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=91 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:23.649554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=23 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:24.427950 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d957fd6-d78b-4048-bdf7-04c0388447de tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1" status: 200 len: 1435 microversion: 2.1 time: 11.953828 May 19 04:35:24.436387 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9ef6aa6b-016c-4802-9652-2d784817b144 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73" status: 200 len: 1439 microversion: 2.1 time: 10.755838 May 19 04:35:24.436998 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 542/1067] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:12 2022] GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1 => generated 1435 bytes in 11964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:24.438927 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 526/1068] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:13 2022] GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 => generated 1439 bytes in 10759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:24.448399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d0d44c68-f1e4-42aa-8667-20efeb3d7c42 req-f178d5dd-74f1-4d5b-b21f-202031b1a81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7722f7-7133-4dc0-8b77-5930a6540977", "name": "network-vif-plugged", "status": "completed", "tag": "899edd27-edc4-49c6-a407-a9a5cd069533"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:24.448938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:24.452988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:24.463281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.464016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.465384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.465836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.472965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d0d44c68-f1e4-42aa-8667-20efeb3d7c42 req-f178d5dd-74f1-4d5b-b21f-202031b1a81a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.473759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d0d44c68-f1e4-42aa-8667-20efeb3d7c42 req-f178d5dd-74f1-4d5b-b21f-202031b1a81a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.481463 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 HTTP/1.1 May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:24.483129 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:35:24.484577 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0'} May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:24.485427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:35:24.487018 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.488169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:24.488169 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f996ba2-7a1b-46a8-8ff7-c573fe0cdb22 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 404 len: 111 microversion: 2.1 time: 0.044077 May 19 04:35:24.488169 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 527/1069] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:24 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:35:24.490848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-177bf387-bd75-4b7a-b59d-8fec005384e2 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:24.494498 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d0d44c68-f1e4-42aa-8667-20efeb3d7c42 req-f178d5dd-74f1-4d5b-b21f-202031b1a81a service nova] Creating event network-vif-plugged:899edd27-edc4-49c6-a407-a9a5cd069533 for instance 0e7722f7-7133-4dc0-8b77-5930a6540977 on n-h1-766726-30 May 19 04:35:24.500702 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d0d44c68-f1e4-42aa-8667-20efeb3d7c42 req-f178d5dd-74f1-4d5b-b21f-202031b1a81a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062823 May 19 04:35:24.501780 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 543/1070] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:24.510466 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-177bf387-bd75-4b7a-b59d-8fec005384e2 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014580 May 19 04:35:24.511519 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 528/1071] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:24.511908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ea13a128-e2f9-4f8f-81be-b55ddafd7134 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:24.513150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ea13a128-e2f9-4f8f-81be-b55ddafd7134 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:24.519377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4e53fde4-ade9-4ef6-ac63-15aa789fcf0b req-346a91fb-fc90-45b0-94bc-e6434060d472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab072e19-b664-4518-b3a1-4d6a31cdbac4", "name": "network-vif-deleted", "tag": "9f40abdc-237f-468c-bebb-ab83998922c0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:24.520553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea13a128-e2f9-4f8f-81be-b55ddafd7134 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.521303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea13a128-e2f9-4f8f-81be-b55ddafd7134 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.522346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea13a128-e2f9-4f8f-81be-b55ddafd7134 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.523028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea13a128-e2f9-4f8f-81be-b55ddafd7134 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.536121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4e53fde4-ade9-4ef6-ac63-15aa789fcf0b req-346a91fb-fc90-45b0-94bc-e6434060d472 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.536574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4e53fde4-ade9-4ef6-ac63-15aa789fcf0b req-346a91fb-fc90-45b0-94bc-e6434060d472 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.550478 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4e53fde4-ade9-4ef6-ac63-15aa789fcf0b req-346a91fb-fc90-45b0-94bc-e6434060d472 service nova] Creating event network-vif-deleted:9f40abdc-237f-468c-bebb-ab83998922c0 for instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 on n-h2-766726-30 May 19 04:35:24.556452 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4e53fde4-ade9-4ef6-ac63-15aa789fcf0b req-346a91fb-fc90-45b0-94bc-e6434060d472 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043047 May 19 04:35:24.557105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 529/1072] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:24.566185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:24.567174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] [instance: ab072e19-b664-4518-b3a1-4d6a31cdbac4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:24.575312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.576112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.577341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.577981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.594356 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] HTTP exception thrown: Instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 could not be found. May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Request method failure captured: May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4 HTTP/1.1 May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihch6YAiovKuJ3cTY4m9njSizULepJgXFxj4m4X7m0CHtAClsFl0LVBajC6JxnuJUtKLUI7KlvLarFjUmMwz9hpu56aPuz4mBSY6e3y972slZTZ3L6_-ZZRwSL61khGWHcO5isVQo76zNmZJ9WelldWKZXc7p6g-fhKptxBuIVSuPZL0 May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: e754cec8a31e4f18af60f5b0579fc028 May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ListImageFiltersTestJSON-1800768009 May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:24.596545 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e754cec8a31e4f18af60f5b0579fc028"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e754cec8a31e4f18af60f5b0579fc028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e754cec8a31e4f18af60f5b0579fc028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e754cec8a31e4f18af60f5b0579fc028"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ListImageFiltersTestJSON-1800768009 May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: e754cec8a31e4f18af60f5b0579fc028 May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1800768009 May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ListImageFiltersTestJSON-1800768009-project May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 532d8f47a46842fab6e2c03ef04e4b4a May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ListImageFiltersTestJSON-1800768009-project May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 could not be found. May 19 04:35:24.598007 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'ab072e19-b664-4518-b3a1-4d6a31cdbac4'} May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 could not be found. May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:24.598763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 could not be found. May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 could not be found. May 19 04:35:24.600091 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:24.602441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Returning 404 to user: Instance ab072e19-b664-4518-b3a1-4d6a31cdbac4 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:24.603351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-59272275-07d2-4671-aa16-51f09aa8330f tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4" status: 404 len: 111 microversion: 2.1 time: 0.041359 May 19 04:35:24.607481 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 530/1073] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:24 2022] GET /compute/v2.1/servers/ab072e19-b664-4518-b3a1-4d6a31cdbac4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:35:24.612594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:24.625263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:24.632521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.633312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.634298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:24.634909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:24.685488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ea13a128-e2f9-4f8f-81be-b55ddafd7134 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:24.703129 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ea13a128-e2f9-4f8f-81be-b55ddafd7134 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.199621 May 19 04:35:24.711443 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 544/1074] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:24 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:24.888792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:24.899153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:24.900743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:24.902634 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b699404f-37f6-4ae3-ae19-44d5be29b482 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1637 microversion: 2.25 time: 0.293519 May 19 04:35:24.903434 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 531/1075] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:24 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1637 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:24.920215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-929bdebd-c911-4a73-bb9f-93a711ace755 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315f383a0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:24.970973 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-929bdebd-c911-4a73-bb9f-93a711ace755 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1" status: 200 len: 1435 microversion: 2.1 time: 0.054493 May 19 04:35:24.971643 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 532/1076] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:24 2022] GET /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1 => generated 1435 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:24.976917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b8ad83e-64d7-4bbe-8f00-51b4463b7ece tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'create', calling method: .version_select at 0x7fd315ed9820>, body: {"keypair": {"name": "tempest-keypair-1492313153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3X2DaWoKVNu2641M1xOAOzsNHJrivzjWB0iZeCVIal23BUx/iSSzEHspUg2B9VqY7kaNpSdRY+n5sn5lce3x1j9wjtlrYiQzmLs/5in1vzipw62LcpQeyClqebBP4d+w=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:24.994402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-3b8ad83e-64d7-4bbe-8f00-51b4463b7ece tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Getting quotas for project c754f227f43646e7bc6e53e50d93365d. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:24.999832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7f35f5b-ee80-4e7b-a60e-5275d91aba49 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1904471941", "id": 661718222, "os-flavor-access:is_public": "False"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:25.000034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-3b8ad83e-64d7-4bbe-8f00-51b4463b7ece tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Getting quotas for user e9afd2aff4344e6c8130cfd6b3305b5f and project c754f227f43646e7bc6e53e50d93365d. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:25.001968 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:25.001968 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:25.031449 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b8ad83e-64d7-4bbe-8f00-51b4463b7ece tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058741 May 19 04:35:25.032461 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 533/1077] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:35:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:25.039984 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7f35f5b-ee80-4e7b-a60e-5275d91aba49 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.335107 May 19 04:35:25.041162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-59d904a9-c9bd-4793-8c9f-b7dc0dbd21c8 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:25.046247 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 545/1078] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:35:24 2022] POST /compute/v2.1/flavors => generated 436 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:25.051479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dd98bcf6-b761-41d3-bf25-9cdf35980b31 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315d8d1f0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:25.094894 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-59d904a9-c9bd-4793-8c9f-b7dc0dbd21c8 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.055476 May 19 04:35:25.102125 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 534/1079] 10.222.0.58 () {58 vars in 1164 bytes} [Thu May 19 04:35:25 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:25.108037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b8fe0d7-2284-4bad-8482-14776814ec87 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '.version_select at 0x7fd315ed9310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:25.121714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b8fe0d7-2284-4bad-8482-14776814ec87 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:25.123639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b8fe0d7-2284-4bad-8482-14776814ec87 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:25.146057 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b8fe0d7-2284-4bad-8482-14776814ec87 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2806 microversion: 2.25 time: 0.042725 May 19 04:35:25.149812 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 535/1080] 10.222.0.58 () {60 vars in 1183 bytes} [Thu May 19 04:35:25 2022] GET /compute/v2.1/os-migrations => generated 2806 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:25.167130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a0d6d6f-8af2-46d9-9d08-2fde282f1361 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:25.169140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a0d6d6f-8af2-46d9-9d08-2fde282f1361 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:25.196727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a0d6d6f-8af2-46d9-9d08-2fde282f1361 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:25.197528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a0d6d6f-8af2-46d9-9d08-2fde282f1361 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:25.199014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a0d6d6f-8af2-46d9-9d08-2fde282f1361 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:25.200044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a0d6d6f-8af2-46d9-9d08-2fde282f1361 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:25.506206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a0d6d6f-8af2-46d9-9d08-2fde282f1361 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:25.519836 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a0d6d6f-8af2-46d9-9d08-2fde282f1361 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1465 microversion: 2.1 time: 0.368300 May 19 04:35:25.521404 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 536/1081] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:25 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1465 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:25.528630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94966872-6149-4a85-9bc7-d02ed8ff68e1 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:25.530300 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:25.530300 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:25.540669 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dd98bcf6-b761-41d3-bf25-9cdf35980b31 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "DELETE /compute/v2.1/images/a0c085f2-9d7c-450f-9d78-a846d47400fc" status: 204 len: 0 microversion: 2.1 time: 0.493142 May 19 04:35:25.541299 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 546/1082] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:25 2022] DELETE /compute/v2.1/images/a0c085f2-9d7c-450f-9d78-a846d47400fc => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:25.546578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8d304ccc-e882-49c6-b7fb-ff1dfd21de9f tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:25.556522 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8d304ccc-e882-49c6-b7fb-ff1dfd21de9f tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014133 May 19 04:35:25.557377 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 547/1083] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:25.562540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-464eefca-cd14-4ef5-8bad-03d3aa3c6db9 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:25.563381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-464eefca-cd14-4ef5-8bad-03d3aa3c6db9 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:25.573369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-464eefca-cd14-4ef5-8bad-03d3aa3c6db9 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:25.574860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-464eefca-cd14-4ef5-8bad-03d3aa3c6db9 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:25.576055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-464eefca-cd14-4ef5-8bad-03d3aa3c6db9 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:25.576694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-464eefca-cd14-4ef5-8bad-03d3aa3c6db9 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:25.642511 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94966872-6149-4a85-9bc7-d02ed8ff68e1 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/661718222/action" status: 200 len: 96 microversion: 2.1 time: 0.118784 May 19 04:35:25.643220 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 537/1084] 10.222.0.58 () {60 vars in 1196 bytes} [Thu May 19 04:35:25 2022] POST /compute/v2.1/flavors/661718222/action => generated 96 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:35:25.653901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98bf41cd-69bf-41b1-aed3-b55aab9c852f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315eac8b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:25.711161 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-98bf41cd-69bf-41b1-aed3-b55aab9c852f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73" status: 200 len: 1448 microversion: 2.1 time: 0.066693 May 19 04:35:25.719060 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 538/1085] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:25 2022] GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 => generated 1448 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:25.724213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e15e101-a38e-489d-9a67-ecb33a50572c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315eac040>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:25.811948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-464eefca-cd14-4ef5-8bad-03d3aa3c6db9 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 4bc44755-e968-4e75-a8ce-76d6ab964726 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:35:25.840225 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-464eefca-cd14-4ef5-8bad-03d3aa3c6db9 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 2132 microversion: 2.25 time: 0.281105 May 19 04:35:25.840830 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 548/1086] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:25 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 2132 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:25.857434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a076b0e5-a451-428b-8fc8-ed670f294275 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd31604b280>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:26.164307 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a076b0e5-a451-428b-8fc8-ed670f294275 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "DELETE /compute/v2.1/images/4f97d090-dd38-4df6-80b5-07be1f03a058" status: 204 len: 0 microversion: 2.1 time: 0.311143 May 19 04:35:26.169382 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 549/1087] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:25 2022] DELETE /compute/v2.1/images/4f97d090-dd38-4df6-80b5-07be1f03a058 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:26.174583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-def14738-1ac8-4a36-b7cf-c06624db286c tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:26.200550 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-def14738-1ac8-4a36-b7cf-c06624db286c tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.029703 May 19 04:35:26.201761 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 550/1088] 10.222.0.58 () {58 vars in 1168 bytes} [Thu May 19 04:35:26 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:26.206673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-388693fc-f6d3-49fa-b014-45e5c98ad40c tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:26.208062 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:26.208062 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:26.294977 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-388693fc-f6d3-49fa-b014-45e5c98ad40c tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 578ead430e504002af75fb68a579ae8c combination. May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-388693fc-f6d3-49fa-b014-45e5c98ad40c tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Request method failure captured: May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/flavors/661718222/action HTTP/1.1 May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 67 May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckBb-gOBUz3f2qwWjaSpqBpqPCm7LrU5QaFX9l-uo5eMcp-n06C1fJ8KD3DMx0KsEchKFVgb0tCP-tYcOHlhzZbvg3QB3GHuCE4IvN2ZRFi6i1RhNPoOu_YBbRN8DjLEIxIEPMS1I-VZPYLxN6AVRlQw3Rku5Cywi8AvsTomTJYsws May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 0e82c91c77584bdbb6474483aa7726c9 May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1687418200 May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:35:26.299000 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1687418200 May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 0e82c91c77584bdbb6474483aa7726c9 May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1687418200 May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a93bd9fc3bff4927a9c49f53d36b9ea3 May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: {"addTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} May 19 04:35:26.300528 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: exception: Flavor access already exists for flavor 35 and project 578ead430e504002af75fb68a579ae8c combination. May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '661718222', 'body': {'addTenantAccess': {'tenant': '578ead430e504002af75fb68a579ae8c'}}} May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result.read() May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 04:35:26.301509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-578ead430e504002af75fb68a579ae8c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi project.save(context.session) May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi session.flush() May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._flush(objects) May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 04:35:26.302831 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi compat.raise_( May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi flush_context.execute() May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi rec.execute(self) May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 04:35:26.304200 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 04:35:26.305439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result.read() May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-578ead430e504002af75fb68a579ae8c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 19, 4, 35, 26, 288692), 'updated_at': None, 'flavor_id': 35, 'project_id': '578ead430e504002af75fb68a579ae8c'}] May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:26.306707 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._add_access(project_id) May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project 578ead430e504002af75fb68a579ae8c combination. May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:26.307918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project 578ead430e504002af75fb68a579ae8c combination. May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:26.311008 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:26.314867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project 578ead430e504002af75fb68a579ae8c combination. May 19 04:35:26.314867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:26.314867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-388693fc-f6d3-49fa-b014-45e5c98ad40c tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 578ead430e504002af75fb68a579ae8c combination. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:26.315115 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4e15e101-a38e-489d-9a67-ecb33a50572c tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "DELETE /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1" status: 204 len: 0 microversion: 2.1 time: 0.592999 May 19 04:35:26.315218 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-388693fc-f6d3-49fa-b014-45e5c98ad40c tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/661718222/action" status: 409 len: 152 microversion: 2.1 time: 0.110737 May 19 04:35:26.315640 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 551/1090] 10.222.0.58 () {60 vars in 1196 bytes} [Thu May 19 04:35:26 2022] POST /compute/v2.1/flavors/661718222/action => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:35:26.316939 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 539/1090] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:25 2022] DELETE /compute/v2.1/images/c360b817-c00a-443c-b7da-3691cb7bb5a1 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:26.321950 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb13b274-d6c6-461b-a290-daa6acffafdf tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd3160cbdc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:26.323372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92a76b5c-93f5-4d23-9682-af9be226913f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:26.324236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-92a76b5c-93f5-4d23-9682-af9be226913f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:26.331372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92a76b5c-93f5-4d23-9682-af9be226913f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:26.332664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92a76b5c-93f5-4d23-9682-af9be226913f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:26.333669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92a76b5c-93f5-4d23-9682-af9be226913f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:26.334332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92a76b5c-93f5-4d23-9682-af9be226913f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:26.387441 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eb13b274-d6c6-461b-a290-daa6acffafdf tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73" status: 200 len: 1448 microversion: 2.1 time: 0.069392 May 19 04:35:26.388173 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 540/1091] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:26 2022] GET /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 => generated 1448 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:26.393489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a9e7c0c-48c5-4719-b651-b5d6e6e50a36 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:26.395118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1a9e7c0c-48c5-4719-b651-b5d6e6e50a36 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:26.401589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a9e7c0c-48c5-4719-b651-b5d6e6e50a36 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:26.402112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a9e7c0c-48c5-4719-b651-b5d6e6e50a36 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:26.402896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a9e7c0c-48c5-4719-b651-b5d6e6e50a36 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:26.403350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a9e7c0c-48c5-4719-b651-b5d6e6e50a36 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:26.610220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-92a76b5c-93f5-4d23-9682-af9be226913f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:26.619907 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92a76b5c-93f5-4d23-9682-af9be226913f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.302899 May 19 04:35:26.620853 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 552/1092] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:26 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:26.626674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61b1a64f-4866-467c-b83d-7f9463d4e001 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] Calling method '.version_select at 0x7fd315e22d30>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:26.670860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-1a9e7c0c-48c5-4719-b651-b5d6e6e50a36 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid 4bc44755-e968-4e75-a8ce-76d6ab964726 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:35:26.726260 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1a9e7c0c-48c5-4719-b651-b5d6e6e50a36 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 2132 microversion: 2.25 time: 0.336380 May 19 04:35:26.727603 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 541/1093] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:35:26 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 2132 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:35:26.733832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-32275dcb-1521-4306-b522-a844e93c17bd tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:26.750708 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-32275dcb-1521-4306-b522-a844e93c17bd tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.021512 May 19 04:35:26.751980 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 542/1094] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:35:26 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:26.757250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31e0441c-8b03-41ff-9e6b-1ec1431e61a9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '.version_select at 0x7fd315e87b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:26.830572 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-31e0441c-8b03-41ff-9e6b-1ec1431e61a9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] HTTP exception thrown: Image not found. May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31e0441c-8b03-41ff-9e6b-1ec1431e61a9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Request method failure captured: May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 HTTP/1.1 May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcjNT-my8O729XtoMVsfzp4RRdmksTEfl6C0IzLTWh9CUEn2uHEIXxDj_ORBMiWPFJYrlSZ8ri-IHFgcgG8BXbW4yKKvXxbuZHlcRjOyv3q8yQEwaF9jpjQIIGB5jgZ2Q9Ho3px96eMybAnleREn6hzqKiN934KtBPef77GMGme9EIE May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 5edbfd578f24447bbc845b88cbca6f3f May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesOneServerTestJSON-708401828 May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:26.833307 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesOneServerTestJSON-708401828 May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 5edbfd578f24447bbc845b88cbca6f3f May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-708401828 May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesOneServerTestJSON-708401828-project May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b29b563514df4ad1b042894921248df9 May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesOneServerTestJSON-708401828-project May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: exception: Image not found. May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'df088de8-5747-4f43-98bb-942d887e2911'} May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:26.834925 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image df088de8-5747-4f43-98bb-942d887e2911 to delete May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:26.835905 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df088de8-5747-4f43-98bb-942d887e2911 could not be found. May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:26.837196 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31e0441c-8b03-41ff-9e6b-1ec1431e61a9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Returning 404 to user: Image not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:26.840087 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-31e0441c-8b03-41ff-9e6b-1ec1431e61a9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "DELETE /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911" status: 404 len: 62 microversion: 2.1 time: 0.085648 May 19 04:35:26.842294 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 543/1095] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:26 2022] DELETE /compute/v2.1/images/df088de8-5747-4f43-98bb-942d887e2911 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:35:26.847044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6faea1ac-66b2-49b8-b1ed-f55c3643910a tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:26.848981 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:26.848981 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:26.946145 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6faea1ac-66b2-49b8-b1ed-f55c3643910a tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/661718222/action" status: 200 len: 21 microversion: 2.1 time: 0.104428 May 19 04:35:26.948269 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 544/1096] 10.222.0.58 () {60 vars in 1196 bytes} [Thu May 19 04:35:26 2022] POST /compute/v2.1/flavors/661718222/action => generated 21 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:35:26.956686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8850a786-4909-4e55-bc36-bb0763d64cef tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315ed9940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:26.963869 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-61b1a64f-4866-467c-b83d-7f9463d4e001 tempest-ListImageFiltersTestJSON-1800768009 tempest-ListImageFiltersTestJSON-1800768009-project] 10.222.0.58 "DELETE /compute/v2.1/images/00cdb173-5241-4b28-a721-aa30e4aae5e8" status: 204 len: 0 microversion: 2.1 time: 0.341342 May 19 04:35:26.965062 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 553/1097] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:26 2022] DELETE /compute/v2.1/images/00cdb173-5241-4b28-a721-aa30e4aae5e8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:26.970899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-500359db-6859-47ce-901e-d2156cc3685b req-75d05aa8-25d8-4315-ac03-310ee59c4c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6853ff39-0163-4695-b867-c594611090d0", "name": "network-vif-plugged", "status": "completed", "tag": "eb84c282-9216-4222-bc7a-1129fa1ec71c"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:26.981747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-500359db-6859-47ce-901e-d2156cc3685b req-75d05aa8-25d8-4315-ac03-310ee59c4c1f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:26.982476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-500359db-6859-47ce-901e-d2156cc3685b req-75d05aa8-25d8-4315-ac03-310ee59c4c1f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:26.998270 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-500359db-6859-47ce-901e-d2156cc3685b req-75d05aa8-25d8-4315-ac03-310ee59c4c1f service nova] Creating event network-vif-plugged:eb84c282-9216-4222-bc7a-1129fa1ec71c for instance 6853ff39-0163-4695-b867-c594611090d0 on n-h2-766726-30 May 19 04:35:27.006350 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-500359db-6859-47ce-901e-d2156cc3685b req-75d05aa8-25d8-4315-ac03-310ee59c4c1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039136 May 19 04:35:27.007525 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 554/1098] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:27.015875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8268e679-1016-4c92-91fb-f123695c1ccb tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:27.025868 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8268e679-1016-4c92-91fb-f123695c1ccb tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016851 May 19 04:35:27.027952 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 555/1099] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:27.033157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f515a74-4a93-4cf4-b654-90695f350989 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:27.034154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3f515a74-4a93-4cf4-b654-90695f350989 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:27.044259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f515a74-4a93-4cf4-b654-90695f350989 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:27.045193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f515a74-4a93-4cf4-b654-90695f350989 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:27.046140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f515a74-4a93-4cf4-b654-90695f350989 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:27.046729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f515a74-4a93-4cf4-b654-90695f350989 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:27.262472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-3f515a74-4a93-4cf4-b654-90695f350989 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lazy-loading 'services' on Instance uuid 4bc44755-e968-4e75-a8ce-76d6ab964726 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:35:27.412102 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3f515a74-4a93-4cf4-b654-90695f350989 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments/762da6db-2ec3-4ff6-8915-471258eb696d" status: 202 len: 0 microversion: 2.25 time: 0.382700 May 19 04:35:27.413020 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 556/1100] 10.222.0.58 () {60 vars in 1456 bytes} [Thu May 19 04:35:27 2022] DELETE /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments/762da6db-2ec3-4ff6-8915-471258eb696d => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:27.420096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3d61dfb3-d6a3-4921-9c4c-6666f5ef297f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:27.421505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3d61dfb3-d6a3-4921-9c4c-6666f5ef297f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:27.430864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d61dfb3-d6a3-4921-9c4c-6666f5ef297f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:27.431327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d61dfb3-d6a3-4921-9c4c-6666f5ef297f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:27.432698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d61dfb3-d6a3-4921-9c4c-6666f5ef297f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:27.433470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d61dfb3-d6a3-4921-9c4c-6666f5ef297f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:27.469612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3d61dfb3-d6a3-4921-9c4c-6666f5ef297f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:35:27.616843 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3d61dfb3-d6a3-4921-9c4c-6666f5ef297f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 204 len: 0 microversion: 2.1 time: 0.201431 May 19 04:35:27.618533 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 557/1101] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:35:27 2022] DELETE /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:27.628690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b14f1d18-adb2-488f-93b9-c700aeb75008 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:27.629972 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:27.629972 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:27.661288 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b14f1d18-adb2-488f-93b9-c700aeb75008 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/661718222" status: 202 len: 0 microversion: 2.1 time: 0.038041 May 19 04:35:27.667059 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 558/1102] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:35:27 2022] DELETE /compute/v2.1/flavors/661718222 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:35:27.672387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dee8337a-1442-43bc-89cb-1820ba822c39 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:27.679352 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8850a786-4909-4e55-bc36-bb0763d64cef tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73" status: 204 len: 0 microversion: 2.1 time: 0.728572 May 19 04:35:27.682805 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 545/1103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:26 2022] DELETE /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:27.685921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1008802839", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:27.715083 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dee8337a-1442-43bc-89cb-1820ba822c39 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.047747 May 19 04:35:27.715812 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 559/1104] 10.222.0.58 () {58 vars in 1166 bytes} [Thu May 19 04:35:27 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:27.721230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0ccb7293-20ad-4fc0-b32a-1301cf7fcf95 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:27.724680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0ccb7293-20ad-4fc0-b32a-1301cf7fcf95 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:27.731596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ccb7293-20ad-4fc0-b32a-1301cf7fcf95 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:27.732057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ccb7293-20ad-4fc0-b32a-1301cf7fcf95 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:27.732829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ccb7293-20ad-4fc0-b32a-1301cf7fcf95 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:27.733312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ccb7293-20ad-4fc0-b32a-1301cf7fcf95 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:27.756985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] validate_networks() for [('3c260e33-45cd-46ef-9773-557635955e8f', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:35:27.768530 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0ccb7293-20ad-4fc0-b32a-1301cf7fcf95 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051460 May 19 04:35:27.769644 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 560/1105] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:27 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:27.775796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f2dbcec2-95c5-46e0-aa0b-29a6c8c165b9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:27.776477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f2dbcec2-95c5-46e0-aa0b-29a6c8c165b9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:27.799380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2dbcec2-95c5-46e0-aa0b-29a6c8c165b9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:27.799834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2dbcec2-95c5-46e0-aa0b-29a6c8c165b9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:27.800602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2dbcec2-95c5-46e0-aa0b-29a6c8c165b9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:27.801038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2dbcec2-95c5-46e0-aa0b-29a6c8c165b9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:28.064861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f2dbcec2-95c5-46e0-aa0b-29a6c8c165b9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:28.078210 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f2dbcec2-95c5-46e0-aa0b-29a6c8c165b9 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1471 microversion: 2.1 time: 0.306873 May 19 04:35:28.079600 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 561/1106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:27 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1471 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:28.085361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29f6818b-0a4a-4b47-87c0-571dbee8d362 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:28.086297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-29f6818b-0a4a-4b47-87c0-571dbee8d362 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:28.094224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29f6818b-0a4a-4b47-87c0-571dbee8d362 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:28.094682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29f6818b-0a4a-4b47-87c0-571dbee8d362 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:28.095466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29f6818b-0a4a-4b47-87c0-571dbee8d362 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:28.095909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29f6818b-0a4a-4b47-87c0-571dbee8d362 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:28.632885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-29f6818b-0a4a-4b47-87c0-571dbee8d362 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:28.643051 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29f6818b-0a4a-4b47-87c0-571dbee8d362 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.562088 May 19 04:35:28.644086 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 562/1107] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:28 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:28.650086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6e5f2699-6416-4cb4-bab8-eb8c9afebbd4 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:28.674515 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6e5f2699-6416-4cb4-bab8-eb8c9afebbd4 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029039 May 19 04:35:28.675577 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 563/1108] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:35:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:28.680859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-902ec3a0-030b-4007-a557-a2bd7dadd629 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:28.681613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-902ec3a0-030b-4007-a557-a2bd7dadd629 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:28.692891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-902ec3a0-030b-4007-a557-a2bd7dadd629 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:28.693386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-902ec3a0-030b-4007-a557-a2bd7dadd629 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:28.694170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-902ec3a0-030b-4007-a557-a2bd7dadd629 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:28.697562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-902ec3a0-030b-4007-a557-a2bd7dadd629 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:28.736952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-902ec3a0-030b-4007-a557-a2bd7dadd629 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:35:28.777247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:35:28.778765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:35:28.779423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:35:28.780002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:35:28.780593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:35:28.792947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:28.793432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:28.794242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:28.794673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:28.816265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Getting quotas for project c754f227f43646e7bc6e53e50d93365d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:28.822325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Getting quotas for user e9afd2aff4344e6c8130cfd6b3305b5f and project c754f227f43646e7bc6e53e50d93365d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:28.839066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:35:28.841445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:35:28.849967 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-902ec3a0-030b-4007-a557-a2bd7dadd629 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 204 len: 0 microversion: 2.1 time: 0.172320 May 19 04:35:28.851230 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 564/1109] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:35:28 2022] DELETE /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:28.862577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-109f38f7-ea4d-4e35-bd84-8daf0702c293 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:28.873816 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-109f38f7-ea4d-4e35-bd84-8daf0702c293 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021068 May 19 04:35:28.874712 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 565/1110] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:28.882170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac2d253d-ca9b-4ff5-be48-92d0f42cbf33 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-379430857", "id": 604630130, "os-flavor-access:is_public": "True"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:28.884426 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:28.884426 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:28.916077 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac2d253d-ca9b-4ff5-be48-92d0f42cbf33 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.036352 May 19 04:35:28.917812 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 566/1111] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:35:28 2022] POST /compute/v2.1/flavors => generated 434 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:28.920392 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-91e6b508-5935-454a-b369-1eaa126b2d1e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.239797 May 19 04:35:28.921464 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 546/1112] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:35:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:35:28.929752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa6d4e74-f086-44f3-8370-a341a981f831 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:28.931040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa6d4e74-f086-44f3-8370-a341a981f831 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:28.932009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf68397a-91e3-4c52-aa93-5892c3ca39c7 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:28.957094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d4e74-f086-44f3-8370-a341a981f831 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:28.957577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d4e74-f086-44f3-8370-a341a981f831 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:28.969984 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cf68397a-91e3-4c52-aa93-5892c3ca39c7 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1916 microversion: 2.1 time: 0.046880 May 19 04:35:28.970914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d4e74-f086-44f3-8370-a341a981f831 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:28.971066 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 547/1113] 10.222.0.58 () {58 vars in 1143 bytes} [Thu May 19 04:35:28 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1916 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:28.972447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d4e74-f086-44f3-8370-a341a981f831 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:28.979581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cdeccbfb-6e4b-475c-a789-a661cbadebcc tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:28.981005 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:28.981005 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:28.991046 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-cdeccbfb-6e4b-475c-a789-a661cbadebcc tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] HTTP exception thrown: Access list not available for public flavors. May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cdeccbfb-6e4b-475c-a789-a661cbadebcc tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Request method failure captured: May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/flavors/604630130/os-flavor-access HTTP/1.1 May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckBb-gOBUz3f2qwWjaSpqBpqPCm7LrU5QaFX9l-uo5eMcp-n06C1fJ8KD3DMx0KsEchKFVgb0tCP-tYcOHlhzZbvg3QB3GHuCE4IvN2ZRFi6i1RhNPoOu_YBbRN8DjLEIxIEPMS1I-VZPYLxN6AVRlQw3Rku5Cywi8AvsTomTJYsws May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0e82c91c77584bdbb6474483aa7726c9 May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1687418200 May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:35:28.992788 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1687418200 May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0e82c91c77584bdbb6474483aa7726c9 May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1687418200 May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a93bd9fc3bff4927a9c49f53d36b9ea3 May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: exception: Access list not available for public flavors. May 19 04:35:28.994445 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'flavor_id': '604630130'} May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. May 19 04:35:28.995866 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:29.000466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cdeccbfb-6e4b-475c-a789-a661cbadebcc tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:29.001979 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cdeccbfb-6e4b-475c-a789-a661cbadebcc tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/604630130/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029015 May 19 04:35:29.007152 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 548/1114] 10.222.0.58 () {58 vars in 1205 bytes} [Thu May 19 04:35:28 2022] GET /compute/v2.1/flavors/604630130/os-flavor-access => generated 91 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:35:29.018370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-530ee579-7cd3-490b-9a7d-628df835ce34 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:29.019000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-530ee579-7cd3-490b-9a7d-628df835ce34 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:29.046555 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fa6d4e74-f086-44f3-8370-a341a981f831 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125806 May 19 04:35:29.056236 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 567/1115] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:28 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:29.061804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eb573c40-3f2b-46c4-a637-7f6692b1b969 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:29.090154 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eb573c40-3f2b-46c4-a637-7f6692b1b969 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032629 May 19 04:35:29.097043 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 568/1116] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:29.103122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-815719cc-9691-4684-96da-08bdf05c5e48 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:29.104083 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:29.104083 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:29.130919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-530ee579-7cd3-490b-9a7d-628df835ce34 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:29.131281 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-815719cc-9691-4684-96da-08bdf05c5e48 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/604630130" status: 202 len: 0 microversion: 2.1 time: 0.032586 May 19 04:35:29.137128 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 569/1117] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:35:29 2022] DELETE /compute/v2.1/flavors/604630130 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:35:29.144562 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-530ee579-7cd3-490b-9a7d-628df835ce34 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1225 microversion: 2.1 time: 0.136386 May 19 04:35:29.147906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-82637f7a-64a0-4306-85ae-ec40a0a2fc65 req-fd163c4a-5457-4259-bea4-19e33e9a42cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7722f7-7133-4dc0-8b77-5930a6540977", "name": "network-vif-unplugged", "status": "completed", "tag": "899edd27-edc4-49c6-a407-a9a5cd069533"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:29.149477 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 549/1118] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:29 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:29.159262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1218056099", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "af325e41-dd5e-49a4-8d8b-0ae83cdd7660"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:29.184165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-82637f7a-64a0-4306-85ae-ec40a0a2fc65 req-fd163c4a-5457-4259-bea4-19e33e9a42cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:29.184710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-82637f7a-64a0-4306-85ae-ec40a0a2fc65 req-fd163c4a-5457-4259-bea4-19e33e9a42cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:29.212403 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-82637f7a-64a0-4306-85ae-ec40a0a2fc65 req-fd163c4a-5457-4259-bea4-19e33e9a42cb service nova] Creating event network-vif-unplugged:899edd27-edc4-49c6-a407-a9a5cd069533 for instance 0e7722f7-7133-4dc0-8b77-5930a6540977 on n-h1-766726-30 May 19 04:35:29.217995 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-82637f7a-64a0-4306-85ae-ec40a0a2fc65 req-fd163c4a-5457-4259-bea4-19e33e9a42cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079439 May 19 04:35:29.223195 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 570/1119] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:29.231099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c163bfaa-689b-4cc7-926b-b7cd01f8f38e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:29.232050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c163bfaa-689b-4cc7-926b-b7cd01f8f38e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:29.239380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c163bfaa-689b-4cc7-926b-b7cd01f8f38e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:29.240045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c163bfaa-689b-4cc7-926b-b7cd01f8f38e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:29.241338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c163bfaa-689b-4cc7-926b-b7cd01f8f38e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:29.242347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c163bfaa-689b-4cc7-926b-b7cd01f8f38e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:29.250610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] validate_networks() for [('af325e41-dd5e-49a4-8d8b-0ae83cdd7660', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:35:29.656972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c163bfaa-689b-4cc7-926b-b7cd01f8f38e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:29.670531 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c163bfaa-689b-4cc7-926b-b7cd01f8f38e tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1471 microversion: 2.1 time: 0.445368 May 19 04:35:29.681394 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 571/1120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:29 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1471 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:29.687836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae8dd204-7921-4381-bb90-35a53c854978 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:29.709900 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae8dd204-7921-4381-bb90-35a53c854978 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.026317 May 19 04:35:29.710808 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 572/1121] 10.222.0.58 () {58 vars in 1147 bytes} [Thu May 19 04:35:29 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:29.716186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-879347f8-c453-4d6c-9cd6-204a3b06028e tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:29.737203 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-879347f8-c453-4d6c-9cd6-204a3b06028e tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024766 May 19 04:35:29.748191 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 573/1122] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:35:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:29.919641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:35:29.920185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:35:29.920545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:35:29.920961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:35:29.921274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35770f59-4905-4604-bd8d-cf8140b3aaf7 tempest-ListImageFiltersNegativeTestJSON-1634211437 tempest-ListImageFiltersNegativeTestJSON-1634211437-project] Calling method '.version_select at 0x7fd315cdeaf0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:29.921405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:35:29.937676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:29.938143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:29.938970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:29.939415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:29.945687 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-35770f59-4905-4604-bd8d-cf8140b3aaf7 tempest-ListImageFiltersNegativeTestJSON-1634211437 tempest-ListImageFiltersNegativeTestJSON-1634211437-project] HTTP exception thrown: Image not found. May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35770f59-4905-4604-bd8d-cf8140b3aaf7 tempest-ListImageFiltersNegativeTestJSON-1634211437 tempest-ListImageFiltersNegativeTestJSON-1634211437-project] Request method failure captured: May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/images/28ed0001-e77f-4cdf-be54-e610f3629975 HTTP/1.1 May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckRSFCNj3FNRM9kE0LD9_JEIRGPMuQ2LQDyo_pBa466fOQm87gE1TLUr6J7uknthoVrbniEFRYy8INAF-fy-h9hwzJatIcfiyRFbb_FALy3TRdjMj0QzJo65was2iKnHIqNyTtbRAXjssUg-RqWJ-VdARfLHyXUITZEIzzaERB3Lro May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bf1ec38e7a5e48c49b32e2c0f978e316 May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1634211437 May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:29.950994 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf1ec38e7a5e48c49b32e2c0f978e316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf1ec38e7a5e48c49b32e2c0f978e316"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf1ec38e7a5e48c49b32e2c0f978e316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf1ec38e7a5e48c49b32e2c0f978e316"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1634211437 May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bf1ec38e7a5e48c49b32e2c0f978e316 May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1634211437 May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListImageFiltersNegativeTestJSON-1634211437-project May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 45252b696c564a58b3b8aac91906b471 May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1634211437-project May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '28ed0001-e77f-4cdf-be54-e610f3629975'} May 19 04:35:29.952439 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:35:29.953376 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 28ed0001-e77f-4cdf-be54-e610f3629975 May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:35:29.955010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28ed0001-e77f-4cdf-be54-e610f3629975 could not be found. May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:29.957620 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:29.960315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35770f59-4905-4604-bd8d-cf8140b3aaf7 tempest-ListImageFiltersNegativeTestJSON-1634211437 tempest-ListImageFiltersNegativeTestJSON-1634211437-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:29.962824 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-35770f59-4905-4604-bd8d-cf8140b3aaf7 tempest-ListImageFiltersNegativeTestJSON-1634211437 tempest-ListImageFiltersNegativeTestJSON-1634211437-project] 10.222.0.58 "GET /compute/v2.1/images/28ed0001-e77f-4cdf-be54-e610f3629975" status: 404 len: 62 microversion: 2.1 time: 0.213220 May 19 04:35:29.967450 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 574/1123] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:29 2022] GET /compute/v2.1/images/28ed0001-e77f-4cdf-be54-e610f3629975 => generated 62 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:35:29.978893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Getting quotas for project ff2741185bb8440db094f7bc87af8b2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:29.987237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1fa712b4-65aa-484f-96d4-5f9ab38d472a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:29.989187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1fa712b4-65aa-484f-96d4-5f9ab38d472a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:29.989566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Getting quotas for user 5b561a0c5d754a12a04e62664e607506 and project ff2741185bb8440db094f7bc87af8b2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:30.017793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fa712b4-65aa-484f-96d4-5f9ab38d472a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:30.018591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fa712b4-65aa-484f-96d4-5f9ab38d472a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:30.019582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fa712b4-65aa-484f-96d4-5f9ab38d472a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:30.020191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fa712b4-65aa-484f-96d4-5f9ab38d472a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:30.022348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:35:30.027873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:30.029376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:35:30.118351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-188fff64-6110-4423-abb1-821505afcd28 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964770 May 19 04:35:30.119353 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 550/1124] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:35:30.126334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f6303e5-2e3f-4f03-9d10-79b18af798c3 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.139932 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f6303e5-2e3f-4f03-9d10-79b18af798c3 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.019269 May 19 04:35:30.147350 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 551/1125] 10.222.0.58 () {58 vars in 1139 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:30.152839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1ed1f989-621f-4d91-a851-41600bcbef62 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1458710005", "id": 1287697271, "os-flavor-access:is_public": "False"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:30.155075 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:30.155075 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:30.179635 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1ed1f989-621f-4d91-a851-41600bcbef62 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.030287 May 19 04:35:30.181045 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 552/1126] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:35:30 2022] POST /compute/v2.1/flavors => generated 439 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:30.187622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b5d1779-7008-4513-be3d-e9b1427fa674 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.189644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b5d1779-7008-4513-be3d-e9b1427fa674 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:30.197182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b5d1779-7008-4513-be3d-e9b1427fa674 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:30.198008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b5d1779-7008-4513-be3d-e9b1427fa674 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:30.199862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b5d1779-7008-4513-be3d-e9b1427fa674 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:30.200582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b5d1779-7008-4513-be3d-e9b1427fa674 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:30.246172 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b5d1779-7008-4513-be3d-e9b1427fa674 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.063464 May 19 04:35:30.247512 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 553/1127] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:30.254115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5ea2dcd3-3491-4a0d-bd5f-159bd0d4f6dd tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.255592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5ea2dcd3-3491-4a0d-bd5f-159bd0d4f6dd tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:30.367715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5ea2dcd3-3491-4a0d-bd5f-159bd0d4f6dd tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:30.374100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1fa712b4-65aa-484f-96d4-5f9ab38d472a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:30.386700 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1fa712b4-65aa-484f-96d4-5f9ab38d472a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.413449 May 19 04:35:30.386927 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5ea2dcd3-3491-4a0d-bd5f-159bd0d4f6dd tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1208 microversion: 2.1 time: 0.135282 May 19 04:35:30.387358 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 554/1128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1208 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:30.398526 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 575/1129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:29 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:30.404637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2fb5ebc5-35e9-4770-b6e3-9f9ea4cbe9e4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.405578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2fb5ebc5-35e9-4770-b6e3-9f9ea4cbe9e4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:30.410127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2eaf0bed-3d05-4461-8d0a-5bcb5144144f tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.426248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fb5ebc5-35e9-4770-b6e3-9f9ea4cbe9e4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:30.429027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fb5ebc5-35e9-4770-b6e3-9f9ea4cbe9e4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:30.430080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fb5ebc5-35e9-4770-b6e3-9f9ea4cbe9e4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:30.430956 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2eaf0bed-3d05-4461-8d0a-5bcb5144144f tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041033 May 19 04:35:30.431564 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 555/1130] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:30.431958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fb5ebc5-35e9-4770-b6e3-9f9ea4cbe9e4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:30.684827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98ec5337-4f89-4495-8f8b-494334dfdfb4 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:30.686163 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:30.686163 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:30.687193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-98ec5337-4f89-4495-8f8b-494334dfdfb4 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '2001356d7e6d48e1b925b4fd272ec7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578ead430e504002af75fb68a579ae8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98ec5337-4f89-4495-8f8b-494334dfdfb4 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] Request method failure captured: May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/flavors/1287697271/action HTTP/1.1 May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 67 May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckAzL2SrzwLuyyYKCdKYBgz8lXfC3f_C_9ah7qAwq7NS4KNPtR8ADJPtMY13Cn00opv-yOpGpI9-YIJdm7zDDIRtuq5STBOJOJx4MVp_bM1bG0O7BSt8TP7uZ9M_pnNkp6Xr6w0Zl9bRbY7y8KYwCfZP-_BVZjw0iwzk0bBMUh9vMo May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 578ead430e504002af75fb68a579ae8c May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1305844873 May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:30.695676 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/578ead430e504002af75fb68a579ae8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578ead430e504002af75fb68a579ae8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578ead430e504002af75fb68a579ae8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_578ead430e504002af75fb68a579ae8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1305844873 May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 578ead430e504002af75fb68a579ae8c May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1305844873 May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsAccessNegativeTestJSON-1305844873-project May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 2001356d7e6d48e1b925b4fd272ec7ea May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1305844873-project May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: {"addTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} May 19 04:35:30.697060 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '1287697271', 'body': {'addTenantAccess': {'tenant': '578ead430e504002af75fb68a579ae8c'}}} May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:35:30.697892 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 19 04:35:30.703993 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:30.707270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98ec5337-4f89-4495-8f8b-494334dfdfb4 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:30.707270 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-98ec5337-4f89-4495-8f8b-494334dfdfb4 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] 10.222.0.58 "POST /compute/v2.1/flavors/1287697271/action" status: 403 len: 130 microversion: 2.1 time: 0.250189 May 19 04:35:30.707270 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 556/1131] 10.222.0.58 () {60 vars in 1199 bytes} [Thu May 19 04:35:30 2022] POST /compute/v2.1/flavors/1287697271/action => generated 130 bytes in 268 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:35:30.715463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-65441254-694a-4231-b3dc-dbc6fd5e27ab tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.755503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2fb5ebc5-35e9-4770-b6e3-9f9ea4cbe9e4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:30.769535 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2fb5ebc5-35e9-4770-b6e3-9f9ea4cbe9e4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1285 microversion: 2.1 time: 0.367733 May 19 04:35:30.770581 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 576/1132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1285 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:30.776188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-02b72e35-c760-4427-8a56-3122e153efb5 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.778138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-02b72e35-c760-4427-8a56-3122e153efb5 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:30.792040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02b72e35-c760-4427-8a56-3122e153efb5 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:30.793589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02b72e35-c760-4427-8a56-3122e153efb5 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:30.794515 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-65441254-694a-4231-b3dc-dbc6fd5e27ab tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.092954 May 19 04:35:30.795109 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 557/1133] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:30.797244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02b72e35-c760-4427-8a56-3122e153efb5 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:30.798341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02b72e35-c760-4427-8a56-3122e153efb5 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:30.817772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c3168510-79c0-4582-bfb8-6f203a4b1bbd tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.818608 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:30.818608 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:30.820684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:30.858900 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c3168510-79c0-4582-bfb8-6f203a4b1bbd tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1287697271" status: 202 len: 0 microversion: 2.1 time: 0.044719 May 19 04:35:30.860330 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 558/1134] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:35:30 2022] DELETE /compute/v2.1/flavors/1287697271 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:35:30.867232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e083fc3-e2d2-42ad-b300-96247c4463d0 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.905126 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e083fc3-e2d2-42ad-b300-96247c4463d0 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041339 May 19 04:35:30.905126 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 559/1135] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:30.909954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0eeae176-6f1a-4b40-9453-7deddc29c8ab tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.932504 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0eeae176-6f1a-4b40-9453-7deddc29c8ab tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026348 May 19 04:35:30.937249 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 560/1136] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:30.956975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-70f0ff01-1043-46f4-94f3-b5fc5a6e9fc1 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:30.972136 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-70f0ff01-1043-46f4-94f3-b5fc5a6e9fc1 tempest-FlavorsV2TestJSON-765541609 tempest-FlavorsV2TestJSON-765541609-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033318 May 19 04:35:30.973692 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 561/1137] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:30.983816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed772ee7-cf03-477d-81da-f0c63f8bdb59 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-470158828", "id": 1036485650, "os-flavor-access:is_public": "False"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:30.986025 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:30.986025 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:31.004317 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ed772ee7-cf03-477d-81da-f0c63f8bdb59 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.029190 May 19 04:35:31.005773 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 562/1138] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:35:30 2022] POST /compute/v2.1/flavors => generated 438 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:31.018971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2144ad21-d29d-4c51-8ced-de58a3cb79da tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:31.374401 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2144ad21-d29d-4c51-8ced-de58a3cb79da tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1036485650/action" status: 200 len: 97 microversion: 2.1 time: 0.362253 May 19 04:35:31.375267 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 563/1139] 10.222.0.58 () {60 vars in 1199 bytes} [Thu May 19 04:35:31 2022] POST /compute/v2.1/flavors/1036485650/action => generated 97 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:35:31.389039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6fe58b2e-a204-4c58-a4d1-a3889d7311ad req-f7ab9176-5e9b-40d0-8f03-3ba92411696a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6853ff39-0163-4695-b867-c594611090d0", "name": "network-vif-unplugged", "status": "completed", "tag": "eb84c282-9216-4222-bc7a-1129fa1ec71c"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:31.405579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02b72e35-c760-4427-8a56-3122e153efb5 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29b563514df4ad1b042894921248df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edbfd578f24447bbc845b88cbca6f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:31.412900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6fe58b2e-a204-4c58-a4d1-a3889d7311ad req-f7ab9176-5e9b-40d0-8f03-3ba92411696a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:31.414892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6fe58b2e-a204-4c58-a4d1-a3889d7311ad req-f7ab9176-5e9b-40d0-8f03-3ba92411696a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:31.422872 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-02b72e35-c760-4427-8a56-3122e153efb5 tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 200 len: 1471 microversion: 2.1 time: 0.650693 May 19 04:35:31.426076 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 577/1140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:30 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 1471 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:31.441591 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6fe58b2e-a204-4c58-a4d1-a3889d7311ad req-f7ab9176-5e9b-40d0-8f03-3ba92411696a service nova] Creating event network-vif-unplugged:eb84c282-9216-4222-bc7a-1129fa1ec71c for instance 6853ff39-0163-4695-b867-c594611090d0 on n-h2-766726-30 May 19 04:35:31.451309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f71a70a7-8d71-41ff-b913-5c4f5823771b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:31.452320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f71a70a7-8d71-41ff-b913-5c4f5823771b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:31.467101 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6fe58b2e-a204-4c58-a4d1-a3889d7311ad req-f7ab9176-5e9b-40d0-8f03-3ba92411696a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088128 May 19 04:35:31.467997 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 564/1141] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:31.474265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a25f64ed-ab98-4b97-9e59-43e6e99085c8 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:31.475735 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:31.475735 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:31.476853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a25f64ed-ab98-4b97-9e59-43e6e99085c8 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '2001356d7e6d48e1b925b4fd272ec7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578ead430e504002af75fb68a579ae8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:31.478679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f71a70a7-8d71-41ff-b913-5c4f5823771b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:31.479146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f71a70a7-8d71-41ff-b913-5c4f5823771b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:31.480037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f71a70a7-8d71-41ff-b913-5c4f5823771b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a25f64ed-ab98-4b97-9e59-43e6e99085c8 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] Request method failure captured: May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/flavors/1036485650/action HTTP/1.1 May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 70 May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckAzL2SrzwLuyyYKCdKYBgz8lXfC3f_C_9ah7qAwq7NS4KNPtR8ADJPtMY13Cn00opv-yOpGpI9-YIJdm7zDDIRtuq5STBOJOJx4MVp_bM1bG0O7BSt8TP7uZ9M_pnNkp6Xr6w0Zl9bRbY7y8KYwCfZP-_BVZjw0iwzk0bBMUh9vMo May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 578ead430e504002af75fb68a579ae8c May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1305844873 May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:31.481059 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/578ead430e504002af75fb68a579ae8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578ead430e504002af75fb68a579ae8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578ead430e504002af75fb68a579ae8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_578ead430e504002af75fb68a579ae8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1305844873 May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 578ead430e504002af75fb68a579ae8c May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1305844873 May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FlavorsAccessNegativeTestJSON-1305844873-project May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 2001356d7e6d48e1b925b4fd272ec7ea May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1305844873-project May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: {"removeTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} May 19 04:35:31.482681 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '1036485650', 'body': {'removeTenantAccess': {'tenant': '578ead430e504002af75fb68a579ae8c'}}} May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can( May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:35:31.483419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 19 04:35:31.484695 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:31.486010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f71a70a7-8d71-41ff-b913-5c4f5823771b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:31.489271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a25f64ed-ab98-4b97-9e59-43e6e99085c8 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:31.492102 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a25f64ed-ab98-4b97-9e59-43e6e99085c8 tempest-FlavorsAccessNegativeTestJSON-1305844873 tempest-FlavorsAccessNegativeTestJSON-1305844873-project] 10.222.0.58 "POST /compute/v2.1/flavors/1036485650/action" status: 403 len: 133 microversion: 2.1 time: 0.021705 May 19 04:35:31.495603 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 565/1142] 10.222.0.58 () {60 vars in 1199 bytes} [Thu May 19 04:35:31 2022] POST /compute/v2.1/flavors/1036485650/action => generated 133 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:35:31.506123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-15c207fe-bdf5-4d3c-94c2-8e0e38ae53eb req-5cc2c349-0d4a-4511-a57e-b3a65e6a6575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7722f7-7133-4dc0-8b77-5930a6540977", "name": "network-vif-deleted", "tag": "899edd27-edc4-49c6-a407-a9a5cd069533"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:31.519245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-15c207fe-bdf5-4d3c-94c2-8e0e38ae53eb req-5cc2c349-0d4a-4511-a57e-b3a65e6a6575 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:31.519689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-15c207fe-bdf5-4d3c-94c2-8e0e38ae53eb req-5cc2c349-0d4a-4511-a57e-b3a65e6a6575 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:31.543446 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-15c207fe-bdf5-4d3c-94c2-8e0e38ae53eb req-5cc2c349-0d4a-4511-a57e-b3a65e6a6575 service nova] Creating event network-vif-deleted:899edd27-edc4-49c6-a407-a9a5cd069533 for instance 0e7722f7-7133-4dc0-8b77-5930a6540977 on n-h1-766726-30 May 19 04:35:31.549823 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-15c207fe-bdf5-4d3c-94c2-8e0e38ae53eb req-5cc2c349-0d4a-4511-a57e-b3a65e6a6575 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052713 May 19 04:35:31.550939 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 566/1143] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:31.557021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e23ce89f-4b74-4160-9c69-cbbb89ecaf9c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:31.564360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e23ce89f-4b74-4160-9c69-cbbb89ecaf9c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:31.576016 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f71a70a7-8d71-41ff-b913-5c4f5823771b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.145737 May 19 04:35:31.576792 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 578/1144] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:31 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:31.580959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e23ce89f-4b74-4160-9c69-cbbb89ecaf9c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:31.581657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e23ce89f-4b74-4160-9c69-cbbb89ecaf9c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:31.583141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e23ce89f-4b74-4160-9c69-cbbb89ecaf9c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:31.590259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e23ce89f-4b74-4160-9c69-cbbb89ecaf9c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:31.597213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0e0add8-228a-408b-bb01-c0050c8c38e9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:31.597893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b0e0add8-228a-408b-bb01-c0050c8c38e9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:31.618550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0e0add8-228a-408b-bb01-c0050c8c38e9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:31.619019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0e0add8-228a-408b-bb01-c0050c8c38e9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:31.623068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0e0add8-228a-408b-bb01-c0050c8c38e9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:31.624831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0e0add8-228a-408b-bb01-c0050c8c38e9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:32.110932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e23ce89f-4b74-4160-9c69-cbbb89ecaf9c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:32.124447 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e23ce89f-4b74-4160-9c69-cbbb89ecaf9c tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1260 microversion: 2.1 time: 0.568672 May 19 04:35:32.125765 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 567/1145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:31 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1260 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:32.137728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-76f609b9-7439-4c32-989c-25b5eed1dce9 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "578ead430e504002af75fb68a579ae8c"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:32.139375 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:32.139375 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:32.357804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b0e0add8-228a-408b-bb01-c0050c8c38e9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:32.372041 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0e0add8-228a-408b-bb01-c0050c8c38e9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.788732 May 19 04:35:32.379294 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 579/1146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:31 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:32.387682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40de3b4d-a563-45bc-bb9b-a83331b6032e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:32.388818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-40de3b4d-a563-45bc-bb9b-a83331b6032e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:32.406244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40de3b4d-a563-45bc-bb9b-a83331b6032e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:32.407130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40de3b4d-a563-45bc-bb9b-a83331b6032e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:32.408150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40de3b4d-a563-45bc-bb9b-a83331b6032e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:32.408790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40de3b4d-a563-45bc-bb9b-a83331b6032e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:32.569533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-40de3b4d-a563-45bc-bb9b-a83331b6032e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:32.582298 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-40de3b4d-a563-45bc-bb9b-a83331b6032e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1283 microversion: 2.1 time: 0.201179 May 19 04:35:32.583413 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 580/1147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:32 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1283 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:32.592930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:32.593929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] [instance: 0e7722f7-7133-4dc0-8b77-5930a6540977] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:32.607118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:32.612158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:32.613414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:32.614083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:32.658919 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] HTTP exception thrown: Instance 0e7722f7-7133-4dc0-8b77-5930a6540977 could not be found. May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Request method failure captured: May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 HTTP/1.1 May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcjNT-my8O729XtoMVsfzp4RRdmksTEfl6C0IzLTWh9CUEn2uHEIXxDj_ORBMiWPFJYrlSZ8ri-IHFgcgG8BXbW4yKKvXxbuZHlcRjOyv3q8yQEwaF9jpjQIIGB5jgZ2Q9Ho3px96eMybAnleREn6hzqKiN934KtBPef77GMGme9EIE May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 5edbfd578f24447bbc845b88cbca6f3f May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesOneServerTestJSON-708401828 May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:32.662218 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5edbfd578f24447bbc845b88cbca6f3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesOneServerTestJSON-708401828 May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 5edbfd578f24447bbc845b88cbca6f3f May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-708401828 May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesOneServerTestJSON-708401828-project May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: b29b563514df4ad1b042894921248df9 May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesOneServerTestJSON-708401828-project May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 0e7722f7-7133-4dc0-8b77-5930a6540977 could not be found. May 19 04:35:32.663616 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '0e7722f7-7133-4dc0-8b77-5930a6540977'} May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7722f7-7133-4dc0-8b77-5930a6540977 could not be found. May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:32.664361 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7722f7-7133-4dc0-8b77-5930a6540977 could not be found. May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7722f7-7133-4dc0-8b77-5930a6540977 could not be found. May 19 04:35:32.665657 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:32.669294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] Returning 404 to user: Instance 0e7722f7-7133-4dc0-8b77-5930a6540977 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:32.669294 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4fb57844-7375-4a5e-9f1a-d394f19d270f tempest-ImagesOneServerTestJSON-708401828 tempest-ImagesOneServerTestJSON-708401828-project] 10.222.0.58 "GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977" status: 404 len: 111 microversion: 2.1 time: 0.078530 May 19 04:35:32.671213 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 581/1148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:32 2022] GET /compute/v2.1/servers/0e7722f7-7133-4dc0-8b77-5930a6540977 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:35:32.685461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-52bd2197-b672-4a98-9f6f-8f55b5d66832 req-bc70355d-c32a-4cbb-99cb-268bdacac759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6853ff39-0163-4695-b867-c594611090d0", "name": "network-vif-deleted", "tag": "eb84c282-9216-4222-bc7a-1129fa1ec71c"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:32.703823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:32.717688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-52bd2197-b672-4a98-9f6f-8f55b5d66832 req-bc70355d-c32a-4cbb-99cb-268bdacac759 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:32.718137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-52bd2197-b672-4a98-9f6f-8f55b5d66832 req-bc70355d-c32a-4cbb-99cb-268bdacac759 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:32.719772 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-76f609b9-7439-4c32-989c-25b5eed1dce9 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1036485650/action" status: 200 len: 21 microversion: 2.1 time: 0.589679 May 19 04:35:32.723295 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 568/1149] 10.222.0.58 () {60 vars in 1199 bytes} [Thu May 19 04:35:32 2022] POST /compute/v2.1/flavors/1036485650/action => generated 21 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:35:32.746861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-68cf22b1-4caf-4a03-a6cb-a3eaf91f5e2e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:32.749979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-68cf22b1-4caf-4a03-a6cb-a3eaf91f5e2e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:32.760814 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-52bd2197-b672-4a98-9f6f-8f55b5d66832 req-bc70355d-c32a-4cbb-99cb-268bdacac759 service nova] Creating event network-vif-deleted:eb84c282-9216-4222-bc7a-1129fa1ec71c for instance 6853ff39-0163-4695-b867-c594611090d0 on n-h2-766726-30 May 19 04:35:32.765892 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-52bd2197-b672-4a98-9f6f-8f55b5d66832 req-bc70355d-c32a-4cbb-99cb-268bdacac759 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093355 May 19 04:35:32.770894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68cf22b1-4caf-4a03-a6cb-a3eaf91f5e2e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:32.773799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68cf22b1-4caf-4a03-a6cb-a3eaf91f5e2e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:32.775291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68cf22b1-4caf-4a03-a6cb-a3eaf91f5e2e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:32.777931 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 582/1150] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:32.778254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68cf22b1-4caf-4a03-a6cb-a3eaf91f5e2e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:32.782979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d61e0045-9fbb-48ad-b6a7-802554085c7b tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:32.783807 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:32.783807 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:32.827191 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d61e0045-9fbb-48ad-b6a7-802554085c7b tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1036485650" status: 202 len: 0 microversion: 2.1 time: 0.048080 May 19 04:35:32.828129 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 583/1151] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:35:32 2022] DELETE /compute/v2.1/flavors/1036485650 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:35:32.838866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-176d8542-ae15-43aa-9906-77bfd1bac416 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:32.873981 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-68cf22b1-4caf-4a03-a6cb-a3eaf91f5e2e tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.148479 May 19 04:35:32.874819 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 569/1152] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:32 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:32.876833 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-176d8542-ae15-43aa-9906-77bfd1bac416 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044727 May 19 04:35:32.878153 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 584/1153] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:35:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:32.904813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-281597b6-ce2a-4e79-ba2c-ed93f5b456fc tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1291266383", "id": 116260700, "os-flavor-access:is_public": "False"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:32.907463 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:32.907463 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:32.932911 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-281597b6-ce2a-4e79-ba2c-ed93f5b456fc tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.038311 May 19 04:35:32.933770 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 570/1154] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:35:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:32.944410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-000453f8-aa89-4ad6-be33-b5b5650d345f tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0535e84756e04f87ab8318ef04fe5117"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:32.945665 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:32.945665 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:33.142835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89c3503d-590c-41f6-bdbc-427f3c1bc266 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:33.143536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-89c3503d-590c-41f6-bdbc-427f3c1bc266 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:33.150805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89c3503d-590c-41f6-bdbc-427f3c1bc266 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:33.151274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89c3503d-590c-41f6-bdbc-427f3c1bc266 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:33.152734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89c3503d-590c-41f6-bdbc-427f3c1bc266 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:33.165810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89c3503d-590c-41f6-bdbc-427f3c1bc266 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:33.308830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-89c3503d-590c-41f6-bdbc-427f3c1bc266 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:33.319800 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-89c3503d-590c-41f6-bdbc-427f3c1bc266 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1266 microversion: 2.1 time: 0.178651 May 19 04:35:33.320729 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 571/1155] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:33 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:33.390369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-578c50e8-85cc-40ab-9cac-9f601562278f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:33.390997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-578c50e8-85cc-40ab-9cac-9f601562278f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:33.405027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-578c50e8-85cc-40ab-9cac-9f601562278f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:33.405562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-578c50e8-85cc-40ab-9cac-9f601562278f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:33.406469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-578c50e8-85cc-40ab-9cac-9f601562278f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:33.406976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-578c50e8-85cc-40ab-9cac-9f601562278f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:33.539615 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-000453f8-aa89-4ad6-be33-b5b5650d345f tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] HTTP exception thrown: Flavor access not found for 39 / 0535e84756e04f87ab8318ef04fe5117 combination. May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-000453f8-aa89-4ad6-be33-b5b5650d345f tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Request method failure captured: May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/flavors/116260700/action HTTP/1.1 May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 70 May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckBb-gOBUz3f2qwWjaSpqBpqPCm7LrU5QaFX9l-uo5eMcp-n06C1fJ8KD3DMx0KsEchKFVgb0tCP-tYcOHlhzZbvg3QB3GHuCE4IvN2ZRFi6i1RhNPoOu_YBbRN8DjLEIxIEPMS1I-VZPYLxN6AVRlQw3Rku5Cywi8AvsTomTJYsws May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 0e82c91c77584bdbb6474483aa7726c9 May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1687418200 May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:35:33.545839 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0e82c91c77584bdbb6474483aa7726c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1687418200 May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 0e82c91c77584bdbb6474483aa7726c9 May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1687418200 May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a93bd9fc3bff4927a9c49f53d36b9ea3 May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: {"removeTenantAccess": {"tenant": "0535e84756e04f87ab8318ef04fe5117"}} May 19 04:35:33.547179 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: exception: Flavor access not found for 39 / 0535e84756e04f87ab8318ef04fe5117 combination. May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '116260700', 'body': {'removeTenantAccess': {'tenant': '0535e84756e04f87ab8318ef04fe5117'}}} May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project May 19 04:35:33.547934 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 0535e84756e04f87ab8318ef04fe5117 combination. May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 0535e84756e04f87ab8318ef04fe5117 combination. May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:33.549106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:33.551538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:33.551538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:33.551538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:33.551538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:33.551538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 0535e84756e04f87ab8318ef04fe5117 combination. May 19 04:35:33.551538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:33.551538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-000453f8-aa89-4ad6-be33-b5b5650d345f tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Returning 404 to user: Flavor access not found for 39 / 0535e84756e04f87ab8318ef04fe5117 combination. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:33.551538 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-000453f8-aa89-4ad6-be33-b5b5650d345f tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/116260700/action" status: 404 len: 124 microversion: 2.1 time: 0.608629 May 19 04:35:33.551538 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 585/1156] 10.222.0.58 () {60 vars in 1196 bytes} [Thu May 19 04:35:32 2022] POST /compute/v2.1/flavors/116260700/action => generated 124 bytes in 610 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:35:33.559531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6a0ac050-3edc-4070-9fc0-9851cacb7a34 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:33.616569 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6a0ac050-3edc-4070-9fc0-9851cacb7a34 tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/116260700" status: 202 len: 0 microversion: 2.1 time: 0.061161 May 19 04:35:33.617951 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 586/1157] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:35:33 2022] DELETE /compute/v2.1/flavors/116260700 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:35:33.625573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7a269f8f-8292-4ed0-b054-971c0de63a9b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:33.627972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7a269f8f-8292-4ed0-b054-971c0de63a9b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:33.642732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a269f8f-8292-4ed0-b054-971c0de63a9b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:33.644129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a269f8f-8292-4ed0-b054-971c0de63a9b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:33.649802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a269f8f-8292-4ed0-b054-971c0de63a9b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:33.650503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a269f8f-8292-4ed0-b054-971c0de63a9b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:34.207237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7a269f8f-8292-4ed0-b054-971c0de63a9b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:34.222305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-578c50e8-85cc-40ab-9cac-9f601562278f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:34.222875 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7a269f8f-8292-4ed0-b054-971c0de63a9b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1325 microversion: 2.1 time: 0.600216 May 19 04:35:34.223255 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 587/1158] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:33 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1325 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:34.240213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ddd7df1c-e8a0-4b66-8be1-847921f82d2c tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:34.240417 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-578c50e8-85cc-40ab-9cac-9f601562278f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.854481 May 19 04:35:34.241022 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 572/1159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:33 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:34.251644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-644e7bc5-8b41-4065-a3d0-0fc63c2d455c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:34.255816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-644e7bc5-8b41-4065-a3d0-0fc63c2d455c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:34.270181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-644e7bc5-8b41-4065-a3d0-0fc63c2d455c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:34.270952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-644e7bc5-8b41-4065-a3d0-0fc63c2d455c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:34.272724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-644e7bc5-8b41-4065-a3d0-0fc63c2d455c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:34.277141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-644e7bc5-8b41-4065-a3d0-0fc63c2d455c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:34.288977 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ddd7df1c-e8a0-4b66-8be1-847921f82d2c tempest-FlavorsAccessNegativeTestJSON-1687418200 tempest-FlavorsAccessNegativeTestJSON-1687418200-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062044 May 19 04:35:34.289626 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 588/1160] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:35:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:34.337502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d664c318-e9f3-45ed-b7d9-416402afcd0a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:34.338106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d664c318-e9f3-45ed-b7d9-416402afcd0a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:34.349038 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-644e7bc5-8b41-4065-a3d0-0fc63c2d455c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103803 May 19 04:35:34.349897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d664c318-e9f3-45ed-b7d9-416402afcd0a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:34.350611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d664c318-e9f3-45ed-b7d9-416402afcd0a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:34.351555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d664c318-e9f3-45ed-b7d9-416402afcd0a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:34.352805 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 573/1161] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:34 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:34.353456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d664c318-e9f3-45ed-b7d9-416402afcd0a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:34.765810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d664c318-e9f3-45ed-b7d9-416402afcd0a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:34.777578 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d664c318-e9f3-45ed-b7d9-416402afcd0a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 0.440443 May 19 04:35:34.778208 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 589/1162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:34 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:35.242271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-36a68ae7-42c5-4e65-88e2-cebd0b110d11 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:35.243010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-36a68ae7-42c5-4e65-88e2-cebd0b110d11 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:35.257016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36a68ae7-42c5-4e65-88e2-cebd0b110d11 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:35.258308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d88d7f2e-090b-4770-a763-b77b85cbc68d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:35.258893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36a68ae7-42c5-4e65-88e2-cebd0b110d11 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:35.259299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d88d7f2e-090b-4770-a763-b77b85cbc68d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:35.262488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36a68ae7-42c5-4e65-88e2-cebd0b110d11 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:35.264873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36a68ae7-42c5-4e65-88e2-cebd0b110d11 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:35.270430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d88d7f2e-090b-4770-a763-b77b85cbc68d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:35.277939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d88d7f2e-090b-4770-a763-b77b85cbc68d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:35.277939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d88d7f2e-090b-4770-a763-b77b85cbc68d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:35.277939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d88d7f2e-090b-4770-a763-b77b85cbc68d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:36.097769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d88d7f2e-090b-4770-a763-b77b85cbc68d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:36.109703 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d88d7f2e-090b-4770-a763-b77b85cbc68d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.855487 May 19 04:35:36.124961 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 590/1163] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:35 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:36.131353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40081757-18b4-48d0-8d24-074b9908fc23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:36.132764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-40081757-18b4-48d0-8d24-074b9908fc23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:36.148082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40081757-18b4-48d0-8d24-074b9908fc23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:36.152123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40081757-18b4-48d0-8d24-074b9908fc23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:36.153315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40081757-18b4-48d0-8d24-074b9908fc23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:36.153997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40081757-18b4-48d0-8d24-074b9908fc23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:36.200652 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-40081757-18b4-48d0-8d24-074b9908fc23 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074180 May 19 04:35:36.202046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 591/1164] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:36 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:36.237634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-36a68ae7-42c5-4e65-88e2-cebd0b110d11 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:36.250265 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-36a68ae7-42c5-4e65-88e2-cebd0b110d11 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1325 microversion: 2.1 time: 1.012058 May 19 04:35:36.260074 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 574/1165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:35 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1325 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:36.264690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5713ef0a-bbf0-4100-ba3e-a59639113bcc tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:36.277952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5713ef0a-bbf0-4100-ba3e-a59639113bcc tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:36.286042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5713ef0a-bbf0-4100-ba3e-a59639113bcc tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:36.286598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5713ef0a-bbf0-4100-ba3e-a59639113bcc tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:36.287467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5713ef0a-bbf0-4100-ba3e-a59639113bcc tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:36.287999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5713ef0a-bbf0-4100-ba3e-a59639113bcc tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:36.458362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cc71553e-30d5-4756-994a-a3a8e64c5185 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Action: 'create', calling method: .version_select at 0x7fd315c50700>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWb3eIQrFqRPYb+bnLCgylM+z0+hHjC5TnDxd/uylh/76Ekkbke7a20uqgFpzcYcgGiT4j+wQsc9/TiaXT0HXxFCx1UUn6xpDtkMJukYqJT7v8AnGQLRzopq95VwtX+lw=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:36.465781 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-cc71553e-30d5-4756-994a-a3a8e64c5185 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cc71553e-30d5-4756-994a-a3a8e64c5185 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Request method failure captured: May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 257 May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckXV6kC-ixZ0c-V45avgJznEI0mnn5FfF48xP9Oe-h3NRPMzlnCa_we2vQRxzEcnYtXZZteCG1PJxf63lylGf2oyqKd-M3sQQYg9sDTJKZLQLC0o_QnEYwMxoISUFlklSvmNZWartz4bgjnqioQg35PIoHPvkzmD9KJt_IXyV4X3pQ May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:36.468278 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76bcd7672f154912892c1e735f453a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWb3eIQrFqRPYb+bnLCgylM+z0+hHjC5TnDxd/uylh/76Ekkbke7a20uqgFpzcYcgGiT4j+wQsc9/TiaXT0HXxFCx1UUn6xpDtkMJukYqJT7v8AnGQLRzopq95VwtX+lw=="}} May 19 04:35:36.471384 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: exception: Keypair data is invalid: Keypair name contains unsafe characters May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWb3eIQrFqRPYb+bnLCgylM+z0+hHjC5TnDxd/uylh/76Ekkbke7a20uqgFpzcYcgGiT4j+wQsc9/TiaXT0HXxFCx1UUn6xpDtkMJukYqJT7v8AnGQLRzopq95VwtX+lw=='}}} May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair May 19 04:35:36.472311 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 04:35:36.473686 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.475174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cc71553e-30d5-4756-994a-a3a8e64c5185 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:36.477109 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cc71553e-30d5-4756-994a-a3a8e64c5185 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.267078 May 19 04:35:36.477674 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 592/1166] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:35:36 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:35:36.484558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-208ffb1e-a1bc-4675-82b5-69d92d9e5c12 req-7ace41a1-659c-4ad2-99ff-9267c0315c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21238921-8bdc-42a0-a385-3f9e3dd13bee", "tag": "f7939cb3-a0f7-4a0c-82b1-df0644c9d215"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:36.527392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-208ffb1e-a1bc-4675-82b5-69d92d9e5c12 req-7ace41a1-659c-4ad2-99ff-9267c0315c41 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:36.527392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-208ffb1e-a1bc-4675-82b5-69d92d9e5c12 req-7ace41a1-659c-4ad2-99ff-9267c0315c41 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:36.551053 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-208ffb1e-a1bc-4675-82b5-69d92d9e5c12 req-7ace41a1-659c-4ad2-99ff-9267c0315c41 service nova] Creating event network-changed:f7939cb3-a0f7-4a0c-82b1-df0644c9d215 for instance 21238921-8bdc-42a0-a385-3f9e3dd13bee on n-h1-766726-30 May 19 04:35:36.569927 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-208ffb1e-a1bc-4675-82b5-69d92d9e5c12 req-7ace41a1-659c-4ad2-99ff-9267c0315c41 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090039 May 19 04:35:36.571572 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 593/1167] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:36.579002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64fe074b-4c05-43e6-9548-f3f33779ed08 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Action: 'create', calling method: .version_select at 0x7fd315bf9040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1716739708", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:36.617171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-64fe074b-4c05-43e6-9548-f3f33779ed08 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:36.624796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-64fe074b-4c05-43e6-9548-f3f33779ed08 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for user d6ac817ae9ef417eb8fd137d6bef8eed and project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:36.650224 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-64fe074b-4c05-43e6-9548-f3f33779ed08 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64fe074b-4c05-43e6-9548-f3f33779ed08 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Request method failure captured: May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 2167 May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckXV6kC-ixZ0c-V45avgJznEI0mnn5FfF48xP9Oe-h3NRPMzlnCa_we2vQRxzEcnYtXZZteCG1PJxf63lylGf2oyqKd-M3sQQYg9sDTJKZLQLC0o_QnEYwMxoISUFlklSvmNZWartz4bgjnqioQg35PIoHPvkzmD9KJt_IXyV4X3pQ May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76bcd7672f154912892c1e735f453a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1716739708", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:35:36.666574 n-d-766726-30 devstack@n-api.service[124819]: exception: Keypair data is invalid: failed to generate fingerprint May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1716739708', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:36.669451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 19 04:35:36.673135 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.681520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64fe074b-4c05-43e6-9548-f3f33779ed08 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:36.681520 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64fe074b-4c05-43e6-9548-f3f33779ed08 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.106944 May 19 04:35:36.683966 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 594/1168] 10.222.0.58 () {60 vars in 1159 bytes} [Thu May 19 04:35:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 04:35:36.700414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-adf90eec-b9ee-43d0-9ce1-11ef323391b6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Action: 'create', calling method: .version_select at 0x7fd315bd9af0>, body: {"keypair": {"name": "tempest-keypair-746477205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgGBbf01i/VuTkPVz8ZvISTLyyFjCykG5byxHBkb+j/OW9fNU7fiS2dZwU49K09SJaHGnO7XBNr8a8fARcTBkAHn2ffNyIZFDoVmj0KkSFp+FeuC+P/OBJNrIaoEE5wQA=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:36.732035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-adf90eec-b9ee-43d0-9ce1-11ef323391b6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:36.741265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-adf90eec-b9ee-43d0-9ce1-11ef323391b6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for user d6ac817ae9ef417eb8fd137d6bef8eed and project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:36.776143 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-adf90eec-b9ee-43d0-9ce1-11ef323391b6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085478 May 19 04:35:36.777248 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 595/1169] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:35:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:35:36.793835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-376ddcfa-4d27-4c13-8efc-730f0dc07209 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Action: 'create', calling method: .version_select at 0x7fd315bd98b0>, body: {"keypair": {"name": "tempest-keypair-746477205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIBYuSAVBZJHAKFVmke7Olpzspz5nQGQPx/KbR3x+fxRCJS+SL5sBidU05zl/ewhWN6wzLG1hglGkC2tnGegzVX2U/1VD4/OpjR9zO+7vjRgDF1/9FhwZEtfOPDtk1uPw=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:36.827009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-376ddcfa-4d27-4c13-8efc-730f0dc07209 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:36.833787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-376ddcfa-4d27-4c13-8efc-730f0dc07209 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for user d6ac817ae9ef417eb8fd137d6bef8eed and project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:36.881914 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-376ddcfa-4d27-4c13-8efc-730f0dc07209 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] HTTP exception thrown: Key pair 'tempest-keypair-746477205' already exists. May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-376ddcfa-4d27-4c13-8efc-730f0dc07209 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Request method failure captured: May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 272 May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckXV6kC-ixZ0c-V45avgJznEI0mnn5FfF48xP9Oe-h3NRPMzlnCa_we2vQRxzEcnYtXZZteCG1PJxf63lylGf2oyqKd-M3sQQYg9sDTJKZLQLC0o_QnEYwMxoISUFlklSvmNZWartz4bgjnqioQg35PIoHPvkzmD9KJt_IXyV4X3pQ May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76bcd7672f154912892c1e735f453a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: {"keypair": {"name": "tempest-keypair-746477205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIBYuSAVBZJHAKFVmke7Olpzspz5nQGQPx/KbR3x+fxRCJS+SL5sBidU05zl/ewhWN6wzLG1hglGkC2tnGegzVX2U/1VD4/OpjR9zO+7vjRgDF1/9FhwZEtfOPDtk1uPw=="}} May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: exception: Key pair 'tempest-keypair-746477205' already exists. May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-746477205', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIBYuSAVBZJHAKFVmke7Olpzspz5nQGQPx/KbR3x+fxRCJS+SL5sBidU05zl/ewhWN6wzLG1hglGkC2tnGegzVX2U/1VD4/OpjR9zO+7vjRgDF1/9FhwZEtfOPDtk1uPw=='}}} May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result.read() May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'd6ac817ae9ef417eb8fd137d6bef8eed-tempest-keypair-746477205' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 19 04:35:36.887769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi kp.save(context.session) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi session.flush() May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._flush(objects) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi compat.raise_( May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi flush_context.execute() May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi rec.execute(self) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result.read() May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 04:35:36.891948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'd6ac817ae9ef417eb8fd137d6bef8eed-tempest-keypair-746477205' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 19, 4, 35, 36, 868121), 'updated_at': None, 'name': 'tempest-keypair-746477205', 'user_id': 'd6ac817ae9ef417eb8fd137d6bef8eed', 'fingerprint': 'c3:04:61:4b:fe:76:35:27:b5:49:9d:4a:07:11:25:90', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIBYuSAVBZJHAKFVmke7Olpzspz5nQGQPx/KbR3x+fxRCJS+SL5sBidU05zl/ewhWN6wzLG1hglGkC2tnGegzVX2U/1VD4/OpjR9zO+7vjRgDF1/9FhwZEtfOPDtk1uPw==', 'type': 'ssh'}] May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi keypair.create() May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._create() May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-746477205' already exists. May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) May 19 04:35:36.902978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-746477205' already exists. May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-746477205' already exists. May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-376ddcfa-4d27-4c13-8efc-730f0dc07209 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Returning 409 to user: Key pair 'tempest-keypair-746477205' already exists. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-376ddcfa-4d27-4c13-8efc-730f0dc07209 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.109440 May 19 04:35:36.910548 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 596/1170] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:35:36 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:35:36.915026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ec1adad1-25b3-4e36-a2fe-13babfe07ed9 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Calling method '.version_select at 0x7fd315c43af0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:36.925375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5713ef0a-bbf0-4100-ba3e-a59639113bcc tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:36.940014 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5713ef0a-bbf0-4100-ba3e-a59639113bcc tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 0.683093 May 19 04:35:36.941918 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 575/1171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:36 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:36.965898 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ec1adad1-25b3-4e36-a2fe-13babfe07ed9 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-746477205" status: 202 len: 0 microversion: 2.1 time: 0.062594 May 19 04:35:36.967796 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 597/1172] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-746477205 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:35:36.978574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-62e33a4b-09f1-43b0-bf5b-4c4d0215030a tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Action: 'create', calling method: .version_select at 0x7fd315df23a0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDefmg9J3CaZc7Av6aVs/w22AF9/5lzlvaPYmpvPL+R/LpyyVz5ZcmrhJFJuM0RhykwrtVuace8v2fafqWuE0zkKNBQ+3Q0/RXRSuUk/AlrpE6jcEAnWtO4XnqC21SRWhw=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-62e33a4b-09f1-43b0-bf5b-4c4d0215030a tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Request method failure captured: May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 247 May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckXV6kC-ixZ0c-V45avgJznEI0mnn5FfF48xP9Oe-h3NRPMzlnCa_we2vQRxzEcnYtXZZteCG1PJxf63lylGf2oyqKd-M3sQQYg9sDTJKZLQLC0o_QnEYwMxoISUFlklSvmNZWartz4bgjnqioQg35PIoHPvkzmD9KJt_IXyV4X3pQ May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76bcd7672f154912892c1e735f453a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDefmg9J3CaZc7Av6aVs/w22AF9/5lzlvaPYmpvPL+R/LpyyVz5ZcmrhJFJuM0RhykwrtVuace8v2fafqWuE0zkKNBQ+3Q0/RXRSuUk/AlrpE6jcEAnWtO4XnqC21SRWhw=="}} May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute name. Value: . '' is too short May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDefmg9J3CaZc7Av6aVs/w22AF9/5lzlvaPYmpvPL+R/LpyyVz5ZcmrhJFJuM0RhykwrtVuace8v2fafqWuE0zkKNBQ+3Q0/RXRSuUk/AlrpE6jcEAnWtO4XnqC21SRWhw=='}}} May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi '' May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:35:36.982400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-62e33a4b-09f1-43b0-bf5b-4c4d0215030a tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:36.986485 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-62e33a4b-09f1-43b0-bf5b-4c4d0215030a tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009450 May 19 04:35:36.987549 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 576/1173] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:35:36 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 04:35:36.999263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8edd399a-72c4-45f0-b962-3571feadeca6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Action: 'create', calling method: .version_select at 0x7fd315e22f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-67580514", "public_key": " "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:37.044440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-8edd399a-72c4-45f0-b962-3571feadeca6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:37.073112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-8edd399a-72c4-45f0-b962-3571feadeca6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for user d6ac817ae9ef417eb8fd137d6bef8eed and project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:37.100055 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-8edd399a-72c4-45f0-b962-3571feadeca6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8edd399a-72c4-45f0-b962-3571feadeca6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Request method failure captured: May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 93 May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckXV6kC-ixZ0c-V45avgJznEI0mnn5FfF48xP9Oe-h3NRPMzlnCa_we2vQRxzEcnYtXZZteCG1PJxf63lylGf2oyqKd-M3sQQYg9sDTJKZLQLC0o_QnEYwMxoISUFlklSvmNZWartz4bgjnqioQg35PIoHPvkzmD9KJt_IXyV4X3pQ May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76bcd7672f154912892c1e735f453a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-67580514", "public_key": " "}} May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: exception: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-67580514', 'public_key': ' '}}} May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.102807 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.107665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.111671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8edd399a-72c4-45f0-b962-3571feadeca6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:37.113120 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8edd399a-72c4-45f0-b962-3571feadeca6 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.120605 May 19 04:35:37.113959 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 598/1174] 10.222.0.58 () {60 vars in 1157 bytes} [Thu May 19 04:35:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 04:35:37.126066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7166ba53-26ae-403f-8c4e-c6c664673196 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Action: 'create', calling method: .version_select at 0x7fd315f97790>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2CUbOg/iPFIH/XQwNagBboFV2OZX+TtC9gWa8Twvd5mbvQICNbHcl+TqLCEWlejZF51Vt/lD5DoIDk6sOVm6tceTdQqSbCEgfI8hJdMMziA3zBGvdn5Q4VD5ebmW5HQw=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7166ba53-26ae-403f-8c4e-c6c664673196 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Request method failure captured: May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 507 May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckXV6kC-ixZ0c-V45avgJznEI0mnn5FfF48xP9Oe-h3NRPMzlnCa_we2vQRxzEcnYtXZZteCG1PJxf63lylGf2oyqKd-M3sQQYg9sDTJKZLQLC0o_QnEYwMxoISUFlklSvmNZWartz4bgjnqioQg35PIoHPvkzmD9KJt_IXyV4X3pQ May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76bcd7672f154912892c1e735f453a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2CUbOg/iPFIH/XQwNagBboFV2OZX+TtC9gWa8Twvd5mbvQICNbHcl+TqLCEWlejZF51Vt/lD5DoIDk6sOVm6tceTdQqSbCEgfI8hJdMMziA3zBGvdn5Q4VD5ebmW5HQw=="}} May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2CUbOg/iPFIH/XQwNagBboFV2OZX+TtC9gWa8Twvd5mbvQICNbHcl+TqLCEWlejZF51Vt/lD5DoIDk6sOVm6tceTdQqSbCEgfI8hJdMMziA3zBGvdn5Q4VD5ebmW5HQw=='}}} May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' May 19 04:35:37.128237 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7166ba53-26ae-403f-8c4e-c6c664673196 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:37.131613 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7166ba53-26ae-403f-8c4e-c6c664673196 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.008024 May 19 04:35:37.133598 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 577/1175] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:35:37 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:35:37.135646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-150ba106-d53f-469e-b3c9-89ebafb4ce40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:37.136402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-150ba106-d53f-469e-b3c9-89ebafb4ce40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:37.152142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5202472f-e554-4c0b-b4c2-ebe245c8b569 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Action: 'create', calling method: .version_select at 0x7fd315f975e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1930307086", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:37.154635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-150ba106-d53f-469e-b3c9-89ebafb4ce40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:37.155114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-150ba106-d53f-469e-b3c9-89ebafb4ce40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:37.155937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-150ba106-d53f-469e-b3c9-89ebafb4ce40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:37.156385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-150ba106-d53f-469e-b3c9-89ebafb4ce40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:37.200573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5202472f-e554-4c0b-b4c2-ebe245c8b569 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:37.222959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5202472f-e554-4c0b-b4c2-ebe245c8b569 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Getting quotas for user d6ac817ae9ef417eb8fd137d6bef8eed and project 76bcd7672f154912892c1e735f453a9c. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:37.283708 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-5202472f-e554-4c0b-b4c2-ebe245c8b569 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5202472f-e554-4c0b-b4c2-ebe245c8b569 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Request method failure captured: May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 118 May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckXV6kC-ixZ0c-V45avgJznEI0mnn5FfF48xP9Oe-h3NRPMzlnCa_we2vQRxzEcnYtXZZteCG1PJxf63lylGf2oyqKd-M3sQQYg9sDTJKZLQLC0o_QnEYwMxoISUFlklSvmNZWartz4bgjnqioQg35PIoHPvkzmD9KJt_IXyV4X3pQ May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76bcd7672f154912892c1e735f453a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1930307086", "public_key": "ssh-rsa JUNK nova@ubuntu"}} May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: exception: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1930307086', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ValueError: Invalid data May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 19 04:35:37.289340 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5202472f-e554-4c0b-b4c2-ebe245c8b569 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:37.294164 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5202472f-e554-4c0b-b4c2-ebe245c8b569 tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.155370 May 19 04:35:37.299964 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 578/1176] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:35:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 04:35:37.308208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5d116b5a-a510-4bbd-a040-39045590734c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:37.312220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5d116b5a-a510-4bbd-a040-39045590734c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:37.329066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d116b5a-a510-4bbd-a040-39045590734c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:37.333700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d116b5a-a510-4bbd-a040-39045590734c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:37.335642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d116b5a-a510-4bbd-a040-39045590734c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:37.337502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d116b5a-a510-4bbd-a040-39045590734c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:37.414267 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5d116b5a-a510-4bbd-a040-39045590734c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111858 May 19 04:35:37.416938 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 579/1177] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:37 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:37.429860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2999a45-6f80-4deb-bc7c-ddaadc419971 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:37.430615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2999a45-6f80-4deb-bc7c-ddaadc419971 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:37.454304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2999a45-6f80-4deb-bc7c-ddaadc419971 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:37.454756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2999a45-6f80-4deb-bc7c-ddaadc419971 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:37.455544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2999a45-6f80-4deb-bc7c-ddaadc419971 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:37.455989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2999a45-6f80-4deb-bc7c-ddaadc419971 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:37.736231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-150ba106-d53f-469e-b3c9-89ebafb4ce40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:37.753205 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-150ba106-d53f-469e-b3c9-89ebafb4ce40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.625707 May 19 04:35:37.765547 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 599/1178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:37 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:37.771203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b36ddfb6-3ba8-48d2-b558-ebd21839e47e tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Calling method '.version_select at 0x7fd315becc10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:37.802188 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b36ddfb6-3ba8-48d2-b558-ebd21839e47e tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1805831178 not found for user d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b36ddfb6-3ba8-48d2-b558-ebd21839e47e tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Request method failure captured: May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1805831178 HTTP/1.1 May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckXV6kC-ixZ0c-V45avgJznEI0mnn5FfF48xP9Oe-h3NRPMzlnCa_we2vQRxzEcnYtXZZteCG1PJxf63lylGf2oyqKd-M3sQQYg9sDTJKZLQLC0o_QnEYwMxoISUFlklSvmNZWartz4bgjnqioQg35PIoHPvkzmD9KJt_IXyV4X3pQ May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76bcd7672f154912892c1e735f453a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76bcd7672f154912892c1e735f453a9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 76bcd7672f154912892c1e735f453a9c May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-713936485 May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-KeyPairsNegativeTestJSON-713936485-project May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: exception: Keypair tempest-keypair-non-existent-1805831178 not found for user d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'tempest-keypair-non-existent-1805831178'} May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1805831178 not found for user d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.806202 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req, id) May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1805831178 not found for user d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1805831178 not found for user d6ac817ae9ef417eb8fd137d6bef8eed May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b36ddfb6-3ba8-48d2-b558-ebd21839e47e tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1805831178 not found for user d6ac817ae9ef417eb8fd137d6bef8eed {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b36ddfb6-3ba8-48d2-b558-ebd21839e47e tempest-KeyPairsNegativeTestJSON-713936485 tempest-KeyPairsNegativeTestJSON-713936485-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1805831178" status: 404 len: 145 microversion: 2.1 time: 0.049411 May 19 04:35:37.810218 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 600/1179] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:35:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1805831178 => generated 145 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:35:37.959720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-137ccc10-e352-4201-ab66-b7cabfb6b91e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:37.960387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-137ccc10-e352-4201-ab66-b7cabfb6b91e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:37.974955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-137ccc10-e352-4201-ab66-b7cabfb6b91e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:37.975412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-137ccc10-e352-4201-ab66-b7cabfb6b91e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:37.980178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-137ccc10-e352-4201-ab66-b7cabfb6b91e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:37.982177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-137ccc10-e352-4201-ab66-b7cabfb6b91e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:38.672232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e2999a45-6f80-4deb-bc7c-ddaadc419971 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:38.688178 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2999a45-6f80-4deb-bc7c-ddaadc419971 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1325 microversion: 2.1 time: 1.265288 May 19 04:35:38.691419 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 580/1180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:37 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1325 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:38.707770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7cf30407-d00d-4e4f-88c5-5cb113fc075a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:38.709010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7cf30407-d00d-4e4f-88c5-5cb113fc075a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:38.715878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-137ccc10-e352-4201-ab66-b7cabfb6b91e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:38.740815 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-137ccc10-e352-4201-ab66-b7cabfb6b91e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 0.783914 May 19 04:35:38.741711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cf30407-d00d-4e4f-88c5-5cb113fc075a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:38.742535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cf30407-d00d-4e4f-88c5-5cb113fc075a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:38.743552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cf30407-d00d-4e4f-88c5-5cb113fc075a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:38.743836 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 601/1181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:37 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:38.744528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cf30407-d00d-4e4f-88c5-5cb113fc075a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:38.759218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a264cc7b-3ea9-4b1c-a412-d037b71921d9 req-ab4ced1f-ca2a-4775-980a-345207ac38e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cef1740-3fa0-4754-a41d-173d88e0ef61", "tag": "1636583b-1cb6-44bf-b63b-387cf5c5276b"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:38.778571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a264cc7b-3ea9-4b1c-a412-d037b71921d9 req-ab4ced1f-ca2a-4775-980a-345207ac38e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:38.779025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a264cc7b-3ea9-4b1c-a412-d037b71921d9 req-ab4ced1f-ca2a-4775-980a-345207ac38e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:38.788548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:38.811666 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a264cc7b-3ea9-4b1c-a412-d037b71921d9 req-ab4ced1f-ca2a-4775-980a-345207ac38e1 service nova] Creating event network-changed:1636583b-1cb6-44bf-b63b-387cf5c5276b for instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 on n-h2-766726-30 May 19 04:35:38.814260 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7cf30407-d00d-4e4f-88c5-5cb113fc075a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119481 May 19 04:35:38.815459 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 581/1182] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:38 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:38.824239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2f40be7-127d-4019-bfb0-d08bc5a8ad24 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:38.825228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c2f40be7-127d-4019-bfb0-d08bc5a8ad24 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:38.828120 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a264cc7b-3ea9-4b1c-a412-d037b71921d9 req-ab4ced1f-ca2a-4775-980a-345207ac38e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078806 May 19 04:35:38.829245 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 602/1183] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:38.834886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2f40be7-127d-4019-bfb0-d08bc5a8ad24 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:38.835861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2f40be7-127d-4019-bfb0-d08bc5a8ad24 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:38.837008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2f40be7-127d-4019-bfb0-d08bc5a8ad24 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:38.839287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2f40be7-127d-4019-bfb0-d08bc5a8ad24 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:39.285862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c2f40be7-127d-4019-bfb0-d08bc5a8ad24 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:39.296018 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2f40be7-127d-4019-bfb0-d08bc5a8ad24 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.479184 May 19 04:35:39.297664 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 582/1184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:38 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:39.708353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d0b092f-9bd9-46d1-b9e0-af36a33380b8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:39.709270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2d0b092f-9bd9-46d1-b9e0-af36a33380b8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:39.723567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d0b092f-9bd9-46d1-b9e0-af36a33380b8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:39.724221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d0b092f-9bd9-46d1-b9e0-af36a33380b8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:39.725433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d0b092f-9bd9-46d1-b9e0-af36a33380b8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:39.729638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d0b092f-9bd9-46d1-b9e0-af36a33380b8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:39.766737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-afa14c66-e3d5-4a58-a2eb-f4176c41e1ae tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:39.767920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-afa14c66-e3d5-4a58-a2eb-f4176c41e1ae tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:39.777593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afa14c66-e3d5-4a58-a2eb-f4176c41e1ae tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:39.778326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afa14c66-e3d5-4a58-a2eb-f4176c41e1ae tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:39.779653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afa14c66-e3d5-4a58-a2eb-f4176c41e1ae tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:39.780359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afa14c66-e3d5-4a58-a2eb-f4176c41e1ae tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:39.962955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:40.573537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-afa14c66-e3d5-4a58-a2eb-f4176c41e1ae tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:40.589520 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-afa14c66-e3d5-4a58-a2eb-f4176c41e1ae tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 0.831129 May 19 04:35:40.590732 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 583/1185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:39 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:40.611087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-49cc0114-bf55-4bdd-b769-4d7e1ba21f66 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:40.612748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-49cc0114-bf55-4bdd-b769-4d7e1ba21f66 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:40.644092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49cc0114-bf55-4bdd-b769-4d7e1ba21f66 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:40.645290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49cc0114-bf55-4bdd-b769-4d7e1ba21f66 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:40.649327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49cc0114-bf55-4bdd-b769-4d7e1ba21f66 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:40.651311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49cc0114-bf55-4bdd-b769-4d7e1ba21f66 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:40.668688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d0b092f-9bd9-46d1-b9e0-af36a33380b8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:40.691725 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d0b092f-9bd9-46d1-b9e0-af36a33380b8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1325 microversion: 2.1 time: 0.983930 May 19 04:35:40.695316 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 603/1186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:39 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1325 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:40.718532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a5cc329f-d3dc-45ef-85cc-2668cd32d74f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:40.723845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a5cc329f-d3dc-45ef-85cc-2668cd32d74f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:40.763638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5cc329f-d3dc-45ef-85cc-2668cd32d74f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:40.765034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5cc329f-d3dc-45ef-85cc-2668cd32d74f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:40.767990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5cc329f-d3dc-45ef-85cc-2668cd32d74f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:40.771684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5cc329f-d3dc-45ef-85cc-2668cd32d74f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:40.830654 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-49cc0114-bf55-4bdd-b769-4d7e1ba21f66 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.236446 May 19 04:35:40.837247 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 584/1187] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:40 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:41.350639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a5cc329f-d3dc-45ef-85cc-2668cd32d74f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:41.363885 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a5cc329f-d3dc-45ef-85cc-2668cd32d74f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.663412 May 19 04:35:41.366135 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 604/1188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:40 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:41.612831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf20f9e1-c243-4cf8-8ca2-ee593627134b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:41.621739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cf20f9e1-c243-4cf8-8ca2-ee593627134b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:41.628526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf20f9e1-c243-4cf8-8ca2-ee593627134b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:41.629263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf20f9e1-c243-4cf8-8ca2-ee593627134b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:41.630222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf20f9e1-c243-4cf8-8ca2-ee593627134b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:41.632009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf20f9e1-c243-4cf8-8ca2-ee593627134b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:41.709790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3bd44832-51be-4e16-adfb-5371250c9f2e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:41.710656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3bd44832-51be-4e16-adfb-5371250c9f2e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:41.726539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bd44832-51be-4e16-adfb-5371250c9f2e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:41.727741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bd44832-51be-4e16-adfb-5371250c9f2e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:41.728971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bd44832-51be-4e16-adfb-5371250c9f2e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:41.730521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bd44832-51be-4e16-adfb-5371250c9f2e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:42.804617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3bd44832-51be-4e16-adfb-5371250c9f2e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:42.821297 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3bd44832-51be-4e16-adfb-5371250c9f2e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1325 microversion: 2.1 time: 1.111081 May 19 04:35:42.824278 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 605/1189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:41 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1325 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:42.841753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e3d060d7-d7f7-4f2f-98fc-aba360e3ead2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:42.842785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e3d060d7-d7f7-4f2f-98fc-aba360e3ead2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:42.857492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3d060d7-d7f7-4f2f-98fc-aba360e3ead2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:42.857966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3d060d7-d7f7-4f2f-98fc-aba360e3ead2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:42.858782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3d060d7-d7f7-4f2f-98fc-aba360e3ead2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:42.859227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3d060d7-d7f7-4f2f-98fc-aba360e3ead2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:42.920192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:42.951418 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e3d060d7-d7f7-4f2f-98fc-aba360e3ead2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125980 May 19 04:35:42.960954 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 606/1190] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:42 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:42.968443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cf20f9e1-c243-4cf8-8ca2-ee593627134b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:42.979269 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cf20f9e1-c243-4cf8-8ca2-ee593627134b tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 1.375629 May 19 04:35:42.988706 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 585/1191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:41 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:42.991591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-facc50b1-86ec-4386-b3a8-ae1ba7ed24cc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:42.995129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-facc50b1-86ec-4386-b3a8-ae1ba7ed24cc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:43.014284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-facc50b1-86ec-4386-b3a8-ae1ba7ed24cc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:43.014943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-facc50b1-86ec-4386-b3a8-ae1ba7ed24cc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:43.019163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-facc50b1-86ec-4386-b3a8-ae1ba7ed24cc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:43.019163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-facc50b1-86ec-4386-b3a8-ae1ba7ed24cc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:43.483629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-facc50b1-86ec-4386-b3a8-ae1ba7ed24cc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:43.499318 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-facc50b1-86ec-4386-b3a8-ae1ba7ed24cc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.536309 May 19 04:35:43.501287 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 607/1192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:42 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:43.842761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82e76235-3735-449c-9e7b-1b9bfc0d968e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:43.844179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82e76235-3735-449c-9e7b-1b9bfc0d968e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:43.880665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82e76235-3735-449c-9e7b-1b9bfc0d968e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:43.882201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82e76235-3735-449c-9e7b-1b9bfc0d968e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:43.883948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82e76235-3735-449c-9e7b-1b9bfc0d968e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:43.884709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82e76235-3735-449c-9e7b-1b9bfc0d968e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:43.968566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d7ee185-edbd-4be8-960a-97e8f134fddf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:43.970138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d7ee185-edbd-4be8-960a-97e8f134fddf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:43.974316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=8,nova_api:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:43.990418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7ee185-edbd-4be8-960a-97e8f134fddf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:43.990781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7ee185-edbd-4be8-960a-97e8f134fddf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:43.991570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7ee185-edbd-4be8-960a-97e8f134fddf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:44.000666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7ee185-edbd-4be8-960a-97e8f134fddf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:44.098021 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d7ee185-edbd-4be8-960a-97e8f134fddf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.133031 May 19 04:35:44.129716 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 608/1193] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:43 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:35:44.140610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-18410944-9735-432a-87d8-ee132d064e35 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:44.141321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-18410944-9735-432a-87d8-ee132d064e35 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:44.159618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18410944-9735-432a-87d8-ee132d064e35 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:44.160429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18410944-9735-432a-87d8-ee132d064e35 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:44.161521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18410944-9735-432a-87d8-ee132d064e35 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:44.165329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18410944-9735-432a-87d8-ee132d064e35 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:44.758838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82e76235-3735-449c-9e7b-1b9bfc0d968e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:44.765943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-18410944-9735-432a-87d8-ee132d064e35 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:44.775334 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-18410944-9735-432a-87d8-ee132d064e35 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 0.644491 May 19 04:35:44.775671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82e76235-3735-449c-9e7b-1b9bfc0d968e tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1325 microversion: 2.1 time: 0.940288 May 19 04:35:44.779731 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 609/1194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:44 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:44.785035 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 586/1195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:43 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1325 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:44.805236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3c7602c9-8470-42ea-9ea8-9b01fd42870a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:44.807244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3c7602c9-8470-42ea-9ea8-9b01fd42870a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:44.826441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c7602c9-8470-42ea-9ea8-9b01fd42870a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:44.827060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c7602c9-8470-42ea-9ea8-9b01fd42870a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:44.829328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c7602c9-8470-42ea-9ea8-9b01fd42870a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:44.830790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c7602c9-8470-42ea-9ea8-9b01fd42870a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.072023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3a86e7e-0462-4519-95d5-07f40ea51086 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Calling method '.version_select at 0x7fd315bbf1f0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:45.074371 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:45.074371 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:35:45.075921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a86e7e-0462-4519-95d5-07f40ea51086 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.076542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a86e7e-0462-4519-95d5-07f40ea51086 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.109997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a86e7e-0462-4519-95d5-07f40ea51086 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.112634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a86e7e-0462-4519-95d5-07f40ea51086 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.141315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a86e7e-0462-4519-95d5-07f40ea51086 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.142033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a86e7e-0462-4519-95d5-07f40ea51086 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.158163 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3a86e7e-0462-4519-95d5-07f40ea51086 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.377310 May 19 04:35:45.161558 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 610/1196] 10.222.0.58 () {60 vars in 1186 bytes} [Thu May 19 04:35:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:45.173855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a8bafb18-ed58-4fff-ab11-7487879aff8c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:45.175928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a8bafb18-ed58-4fff-ab11-7487879aff8c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:45.193939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8bafb18-ed58-4fff-ab11-7487879aff8c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.194585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8bafb18-ed58-4fff-ab11-7487879aff8c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.198470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8bafb18-ed58-4fff-ab11-7487879aff8c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.204222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8bafb18-ed58-4fff-ab11-7487879aff8c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.221938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3c7602c9-8470-42ea-9ea8-9b01fd42870a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:45.237175 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3c7602c9-8470-42ea-9ea8-9b01fd42870a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.444645 May 19 04:35:45.237829 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 587/1197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:44 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:45.252219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8847bee-06f7-4c9a-aee2-15ca9da69699 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Calling method '.version_select at 0x7fd315f95dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:45.253033 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:35:45.253033 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:35:45.254251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8847bee-06f7-4c9a-aee2-15ca9da69699 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.254825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8847bee-06f7-4c9a-aee2-15ca9da69699 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.277972 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a8bafb18-ed58-4fff-ab11-7487879aff8c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.114994 May 19 04:35:45.278480 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 611/1198] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:35:45 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:45.319693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8847bee-06f7-4c9a-aee2-15ca9da69699 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.320147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8847bee-06f7-4c9a-aee2-15ca9da69699 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.344029 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8847bee-06f7-4c9a-aee2-15ca9da69699 tempest-HypervisorAdminV228Test-1128403941 tempest-HypervisorAdminV228Test-1128403941-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.103393 May 19 04:35:45.372904 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 588/1199] 10.222.0.58 () {60 vars in 1192 bytes} [Thu May 19 04:35:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:35:45.794952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-73e1a8a6-b3bf-4315-9281-a14371b4bf0a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:45.795926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f4f5eee1-e7d3-44f6-8493-4791e8b7fbbe tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:45.796547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f4f5eee1-e7d3-44f6-8493-4791e8b7fbbe tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:45.796807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-73e1a8a6-b3bf-4315-9281-a14371b4bf0a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:45.814689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4f5eee1-e7d3-44f6-8493-4791e8b7fbbe tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.815198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4f5eee1-e7d3-44f6-8493-4791e8b7fbbe tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.815999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4f5eee1-e7d3-44f6-8493-4791e8b7fbbe tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.817877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73e1a8a6-b3bf-4315-9281-a14371b4bf0a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.818907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73e1a8a6-b3bf-4315-9281-a14371b4bf0a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.820677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73e1a8a6-b3bf-4315-9281-a14371b4bf0a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:45.821375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73e1a8a6-b3bf-4315-9281-a14371b4bf0a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:45.833426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4f5eee1-e7d3-44f6-8493-4791e8b7fbbe tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:46.964430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-73e1a8a6-b3bf-4315-9281-a14371b4bf0a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:46.982492 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-73e1a8a6-b3bf-4315-9281-a14371b4bf0a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1325 microversion: 2.1 time: 1.192896 May 19 04:35:46.989482 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 612/1200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:45 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1325 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:35:46.993875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4f5eee1-e7d3-44f6-8493-4791e8b7fbbe tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:47.006256 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f4f5eee1-e7d3-44f6-8493-4791e8b7fbbe tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 1.214202 May 19 04:35:47.014202 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 589/1201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:45 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:47.031368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-708c85f6-e43c-4622-900d-4b336407ca33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:47.035468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-708c85f6-e43c-4622-900d-4b336407ca33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:47.048000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-708c85f6-e43c-4622-900d-4b336407ca33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:47.054632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-708c85f6-e43c-4622-900d-4b336407ca33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:47.055734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-708c85f6-e43c-4622-900d-4b336407ca33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:47.058793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-708c85f6-e43c-4622-900d-4b336407ca33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:47.101896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=16 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:47.263592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=24 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:47.542644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-708c85f6-e43c-4622-900d-4b336407ca33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:47.550077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-326360374", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "3ba5e61a-5d01-4401-a0a2-9128eee8ac26"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:47.551678 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-708c85f6-e43c-4622-900d-4b336407ca33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.549690 May 19 04:35:47.552266 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 613/1202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:46 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:47.671764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] validate_networks() for [('3ba5e61a-5d01-4401-a0a2-9128eee8ac26', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:35:48.000353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df0c10f6-9f51-45bf-84e6-b5fff1759c61 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:48.001118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-df0c10f6-9f51-45bf-84e6-b5fff1759c61 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:48.012175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df0c10f6-9f51-45bf-84e6-b5fff1759c61 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:48.012634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df0c10f6-9f51-45bf-84e6-b5fff1759c61 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:48.021832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df0c10f6-9f51-45bf-84e6-b5fff1759c61 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:48.026043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df0c10f6-9f51-45bf-84e6-b5fff1759c61 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:49.121146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df0c10f6-9f51-45bf-84e6-b5fff1759c61 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:49.130645 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-df0c10f6-9f51-45bf-84e6-b5fff1759c61 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1325 microversion: 2.1 time: 1.134346 May 19 04:35:49.134770 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 614/1203] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:47 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1325 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:49.152373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be92231f-548e-4061-b0fd-693a97f57fe5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:49.153396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be92231f-548e-4061-b0fd-693a97f57fe5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:49.172470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be92231f-548e-4061-b0fd-693a97f57fe5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:49.176056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be92231f-548e-4061-b0fd-693a97f57fe5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:49.177825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be92231f-548e-4061-b0fd-693a97f57fe5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:49.178523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be92231f-548e-4061-b0fd-693a97f57fe5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:49.862734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-be92231f-548e-4061-b0fd-693a97f57fe5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:49.877644 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be92231f-548e-4061-b0fd-693a97f57fe5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 0.737871 May 19 04:35:49.879609 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 615/1204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:49 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:49.898340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b7e86a62-2cbf-4e7d-b65e-63bf77089534 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:49.898977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b7e86a62-2cbf-4e7d-b65e-63bf77089534 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:49.940630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7e86a62-2cbf-4e7d-b65e-63bf77089534 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:49.942629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7e86a62-2cbf-4e7d-b65e-63bf77089534 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:49.944272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7e86a62-2cbf-4e7d-b65e-63bf77089534 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:49.948689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7e86a62-2cbf-4e7d-b65e-63bf77089534 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:50.074897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:35:50.076614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:35:50.080532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:35:50.081221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:35:50.081815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:35:50.101866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:50.102816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:50.104480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:50.105131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:50.142721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Getting quotas for project f026983989674a98928e2c3645ed1ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:50.164365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Getting quotas for user fcc8b342ef834d308f6503fa0daf66ec and project f026983989674a98928e2c3645ed1ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:50.204363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:35:50.207230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:35:50.332626 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6e14145-0a51-4a60-8a87-3d1ab091f812 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.300332 May 19 04:35:50.347934 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 590/1205] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:35:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:35:50.360019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c9fe3ad7-9bb1-4d2e-970a-c9b8b65273cf req-e1bd46f1-aa5e-43cf-8868-dfeda0b0f674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21238921-8bdc-42a0-a385-3f9e3dd13bee", "name": "network-vif-plugged", "status": "completed", "tag": "f7939cb3-a0f7-4a0c-82b1-df0644c9d215"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:50.377857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:50.391955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c9fe3ad7-9bb1-4d2e-970a-c9b8b65273cf req-e1bd46f1-aa5e-43cf-8868-dfeda0b0f674 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:50.392376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c9fe3ad7-9bb1-4d2e-970a-c9b8b65273cf req-e1bd46f1-aa5e-43cf-8868-dfeda0b0f674 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:50.483263 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c9fe3ad7-9bb1-4d2e-970a-c9b8b65273cf req-e1bd46f1-aa5e-43cf-8868-dfeda0b0f674 service nova] Creating event network-vif-plugged:f7939cb3-a0f7-4a0c-82b1-df0644c9d215 for instance 21238921-8bdc-42a0-a385-3f9e3dd13bee on n-h1-766726-30 May 19 04:35:50.512939 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c9fe3ad7-9bb1-4d2e-970a-c9b8b65273cf req-e1bd46f1-aa5e-43cf-8868-dfeda0b0f674 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162827 May 19 04:35:50.515455 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 591/1206] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:50.534743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b4b8183-5510-4071-adb8-1f2d83a8e6bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:50.539118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7b4b8183-5510-4071-adb8-1f2d83a8e6bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:50.559702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b4b8183-5510-4071-adb8-1f2d83a8e6bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:50.560107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b4b8183-5510-4071-adb8-1f2d83a8e6bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:50.561816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b4b8183-5510-4071-adb8-1f2d83a8e6bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:50.563560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b4b8183-5510-4071-adb8-1f2d83a8e6bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:50.935842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b7e86a62-2cbf-4e7d-b65e-63bf77089534 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:50.960413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b7e86a62-2cbf-4e7d-b65e-63bf77089534 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 1.070416 May 19 04:35:50.963696 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 616/1207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:49 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:50.985520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aab8229f-c00b-4b56-8cc9-8bd704250223 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:50.986180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aab8229f-c00b-4b56-8cc9-8bd704250223 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:51.898557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aab8229f-c00b-4b56-8cc9-8bd704250223 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:51.907038 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aab8229f-c00b-4b56-8cc9-8bd704250223 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1223 microversion: 2.1 time: 0.939016 May 19 04:35:51.922390 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 617/1208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:50 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1223 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:52.202747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7b4b8183-5510-4071-adb8-1f2d83a8e6bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:52.223714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17b4703d-4dbe-4dc1-b424-1865bc619ddb tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Action: 'create', calling method: .version_select at 0x7fd315b415e0>, body: {"keypair": {"name": "tempest-keypair-218920590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5MeR36YsMSjUPP+pIB/WONlCvcux5Y6USIKh3k3iBDzzY95wOat30kjpOf1qxd0Y5xuTiJAJXZVV9IF/3/dZM+iJJjGI7XWufjfR0YSNImAm9XXzJ+2gf/hXhIP6hJeQ=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:52.225721 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7b4b8183-5510-4071-adb8-1f2d83a8e6bd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1325 microversion: 2.1 time: 1.708699 May 19 04:35:52.232595 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 592/1209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:50 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1325 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:52.274736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7826ce71-739e-4c7a-a772-f665533bad44 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:52.280791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7826ce71-739e-4c7a-a772-f665533bad44 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:52.300052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-17b4703d-4dbe-4dc1-b424-1865bc619ddb tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Getting quotas for project d0c0500491454fa3af763f11c897104a. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:35:52.311177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-17b4703d-4dbe-4dc1-b424-1865bc619ddb tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Getting quotas for user a112a35379df43eaa46bdaadb126c022 and project d0c0500491454fa3af763f11c897104a. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:35:52.333572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7826ce71-739e-4c7a-a772-f665533bad44 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:52.334072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7826ce71-739e-4c7a-a772-f665533bad44 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:52.339596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7826ce71-739e-4c7a-a772-f665533bad44 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:52.340057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7826ce71-739e-4c7a-a772-f665533bad44 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:52.411115 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17b4703d-4dbe-4dc1-b424-1865bc619ddb tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.487417 May 19 04:35:52.412409 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 618/1210] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:35:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:52.429877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae106bda-b84e-4185-8d53-958644c06418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:52.431489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ae106bda-b84e-4185-8d53-958644c06418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:52.450324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae106bda-b84e-4185-8d53-958644c06418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:52.457441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae106bda-b84e-4185-8d53-958644c06418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:52.462235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae106bda-b84e-4185-8d53-958644c06418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:52.462980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae106bda-b84e-4185-8d53-958644c06418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:53.120933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7826ce71-739e-4c7a-a772-f665533bad44 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:53.136393 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7826ce71-739e-4c7a-a772-f665533bad44 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 0.900420 May 19 04:35:53.136988 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 593/1211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:52 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:53.149177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9bb062c8-2cfd-40db-a9cd-9245b4eb91ae req-03e72d4e-b276-4ea5-88d4-187f01d8dc5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cef1740-3fa0-4754-a41d-173d88e0ef61", "name": "network-vif-plugged", "status": "completed", "tag": "1636583b-1cb6-44bf-b63b-387cf5c5276b"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:53.196424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9bb062c8-2cfd-40db-a9cd-9245b4eb91ae req-03e72d4e-b276-4ea5-88d4-187f01d8dc5b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:53.197019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9bb062c8-2cfd-40db-a9cd-9245b4eb91ae req-03e72d4e-b276-4ea5-88d4-187f01d8dc5b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:53.228836 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9bb062c8-2cfd-40db-a9cd-9245b4eb91ae req-03e72d4e-b276-4ea5-88d4-187f01d8dc5b service nova] Creating event network-vif-plugged:1636583b-1cb6-44bf-b63b-387cf5c5276b for instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 on n-h2-766726-30 May 19 04:35:53.239644 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9bb062c8-2cfd-40db-a9cd-9245b4eb91ae req-03e72d4e-b276-4ea5-88d4-187f01d8dc5b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101241 May 19 04:35:53.243262 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 594/1212] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:35:53.311544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8767391a-3c50-44e9-a97e-cbb28bdfd850 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:53.323223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8767391a-3c50-44e9-a97e-cbb28bdfd850 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:53.325583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae106bda-b84e-4185-8d53-958644c06418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:53.337728 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae106bda-b84e-4185-8d53-958644c06418 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.919984 May 19 04:35:53.358415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8767391a-3c50-44e9-a97e-cbb28bdfd850 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:53.360079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8767391a-3c50-44e9-a97e-cbb28bdfd850 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:53.364227 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 619/1213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:52 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:53.366152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8767391a-3c50-44e9-a97e-cbb28bdfd850 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:53.366677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8767391a-3c50-44e9-a97e-cbb28bdfd850 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:53.392252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce8cabaf-a9e0-4026-9bd3-e09c8953b4e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:53.394398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ce8cabaf-a9e0-4026-9bd3-e09c8953b4e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:53.446866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce8cabaf-a9e0-4026-9bd3-e09c8953b4e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:53.448119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce8cabaf-a9e0-4026-9bd3-e09c8953b4e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:53.449010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce8cabaf-a9e0-4026-9bd3-e09c8953b4e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:53.453033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce8cabaf-a9e0-4026-9bd3-e09c8953b4e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:53.805908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8767391a-3c50-44e9-a97e-cbb28bdfd850 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:53.817467 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8767391a-3c50-44e9-a97e-cbb28bdfd850 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1283 microversion: 2.1 time: 0.571537 May 19 04:35:53.819968 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 595/1214] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:53 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1283 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:54.157699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1788e863-b979-4e47-93b8-eaa12e06f427 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:54.159213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1788e863-b979-4e47-93b8-eaa12e06f427 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:54.186084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1788e863-b979-4e47-93b8-eaa12e06f427 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:54.186947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1788e863-b979-4e47-93b8-eaa12e06f427 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:54.188015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1788e863-b979-4e47-93b8-eaa12e06f427 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:54.188629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1788e863-b979-4e47-93b8-eaa12e06f427 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:54.560803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ce8cabaf-a9e0-4026-9bd3-e09c8953b4e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:54.583192 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce8cabaf-a9e0-4026-9bd3-e09c8953b4e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1521 microversion: 2.1 time: 1.216667 May 19 04:35:54.601718 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 620/1215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:53 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1521 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:54.617953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce664a7b-5f05-4675-b623-0fd0de83a479 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:54.620859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ce664a7b-5f05-4675-b623-0fd0de83a479 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:54.643988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce664a7b-5f05-4675-b623-0fd0de83a479 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:54.649736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce664a7b-5f05-4675-b623-0fd0de83a479 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:54.652643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce664a7b-5f05-4675-b623-0fd0de83a479 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:54.656979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce664a7b-5f05-4675-b623-0fd0de83a479 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:54.986711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1788e863-b979-4e47-93b8-eaa12e06f427 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:55.000879 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1788e863-b979-4e47-93b8-eaa12e06f427 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1308 microversion: 2.1 time: 0.850995 May 19 04:35:55.028420 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 596/1216] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:54 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1308 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:55.047759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fd574ccc-56e0-48d7-b1c1-f761833fa531 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:55.055042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fd574ccc-56e0-48d7-b1c1-f761833fa531 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:55.104593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd574ccc-56e0-48d7-b1c1-f761833fa531 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:55.112093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd574ccc-56e0-48d7-b1c1-f761833fa531 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:55.113688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd574ccc-56e0-48d7-b1c1-f761833fa531 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:55.116071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd574ccc-56e0-48d7-b1c1-f761833fa531 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:55.417869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ce664a7b-5f05-4675-b623-0fd0de83a479 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:55.431061 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce664a7b-5f05-4675-b623-0fd0de83a479 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.831936 May 19 04:35:55.442339 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 621/1217] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:54 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:55.458150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-519fcf39-8867-4e69-9455-bb3a404043aa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:55.460012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-519fcf39-8867-4e69-9455-bb3a404043aa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:55.486522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-519fcf39-8867-4e69-9455-bb3a404043aa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:55.486993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-519fcf39-8867-4e69-9455-bb3a404043aa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:55.492893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-519fcf39-8867-4e69-9455-bb3a404043aa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:55.496892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-519fcf39-8867-4e69-9455-bb3a404043aa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:55.904568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-519fcf39-8867-4e69-9455-bb3a404043aa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:55.917841 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-519fcf39-8867-4e69-9455-bb3a404043aa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1281 microversion: 2.1 time: 0.480428 May 19 04:35:55.922844 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 622/1218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:55 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1281 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:55.934343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fd574ccc-56e0-48d7-b1c1-f761833fa531 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:55.960972 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fd574ccc-56e0-48d7-b1c1-f761833fa531 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1521 microversion: 2.1 time: 0.929762 May 19 04:35:55.962449 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 597/1219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:55 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1521 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:55.980543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-928cfaec-ede5-4b86-b4a5-e7272e9af9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-929943553"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:55.982125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-928cfaec-ede5-4b86-b4a5-e7272e9af9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:55.996282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-928cfaec-ede5-4b86-b4a5-e7272e9af9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:55.997725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-928cfaec-ede5-4b86-b4a5-e7272e9af9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:55.998766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-928cfaec-ede5-4b86-b4a5-e7272e9af9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:55.999377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-928cfaec-ede5-4b86-b4a5-e7272e9af9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:56.044898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f50d05c-8277-428f-b226-9ecf6b95f1fa tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:56.045566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5f50d05c-8277-428f-b226-9ecf6b95f1fa tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:56.054846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f50d05c-8277-428f-b226-9ecf6b95f1fa tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:56.055307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f50d05c-8277-428f-b226-9ecf6b95f1fa tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:56.064419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f50d05c-8277-428f-b226-9ecf6b95f1fa tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:56.065046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f50d05c-8277-428f-b226-9ecf6b95f1fa tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:56.879126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:56.937499 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-928cfaec-ede5-4b86-b4a5-e7272e9af9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee/action" status: 202 len: 0 microversion: 2.1 time: 0.957469 May 19 04:35:56.938592 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 623/1220] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:35:55 2022] POST /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee/action => generated 0 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:35:56.974501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1ca0f60-4b77-4a1b-97e9-0bc58121cb86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:56.977061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1ca0f60-4b77-4a1b-97e9-0bc58121cb86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:57.001025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca0f60-4b77-4a1b-97e9-0bc58121cb86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:57.001025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca0f60-4b77-4a1b-97e9-0bc58121cb86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:57.001025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca0f60-4b77-4a1b-97e9-0bc58121cb86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:57.001025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca0f60-4b77-4a1b-97e9-0bc58121cb86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:57.068283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5f50d05c-8277-428f-b226-9ecf6b95f1fa tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:57.078283 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5f50d05c-8277-428f-b226-9ecf6b95f1fa tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1489 microversion: 2.1 time: 1.039120 May 19 04:35:57.079750 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 598/1221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:56 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1489 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:57.085605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c0b96975-4b53-40b6-99ee-1a4cc8db1671 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:57.086432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c0b96975-4b53-40b6-99ee-1a4cc8db1671 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:57.096237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0b96975-4b53-40b6-99ee-1a4cc8db1671 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:57.097129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0b96975-4b53-40b6-99ee-1a4cc8db1671 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:57.098876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0b96975-4b53-40b6-99ee-1a4cc8db1671 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:57.099493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0b96975-4b53-40b6-99ee-1a4cc8db1671 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:57.378549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c0b96975-4b53-40b6-99ee-1a4cc8db1671 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:57.393738 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c0b96975-4b53-40b6-99ee-1a4cc8db1671 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1281 microversion: 2.1 time: 0.308542 May 19 04:35:57.395025 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 599/1222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:57 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:57.403236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-505942f8-4f8d-4712-aa42-c4a2bbfad66b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '.version_select at 0x7fd315e128b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:57.534664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1ca0f60-4b77-4a1b-97e9-0bc58121cb86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:57.546625 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1ca0f60-4b77-4a1b-97e9-0bc58121cb86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.605763 May 19 04:35:57.561214 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 624/1223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:56 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:57.566562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9f93fa3b-af4e-4f7d-bf3d-c46991ef98d6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-798641036"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:35:57.567834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9f93fa3b-af4e-4f7d-bf3d-c46991ef98d6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:57.590988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f93fa3b-af4e-4f7d-bf3d-c46991ef98d6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:57.591189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f93fa3b-af4e-4f7d-bf3d-c46991ef98d6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:57.598353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f93fa3b-af4e-4f7d-bf3d-c46991ef98d6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:57.599078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f93fa3b-af4e-4f7d-bf3d-c46991ef98d6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:57.732830 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-505942f8-4f8d-4712-aa42-c4a2bbfad66b tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/images/eb103ca1-4079-4648-8088-e52e652bdb84" status: 204 len: 0 microversion: 2.1 time: 0.336443 May 19 04:35:57.737151 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 600/1224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:57 2022] DELETE /compute/v2.1/images/eb103ca1-4079-4648-8088-e52e652bdb84 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:35:57.751678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cc71c43e-1bc7-4d88-a7db-8bd3a2336c82 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '.version_select at 0x7fd315e12430>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:57.797314 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-cc71c43e-1bc7-4d88-a7db-8bd3a2336c82 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Image not found. May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cc71c43e-1bc7-4d88-a7db-8bd3a2336c82 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/images/eb103ca1-4079-4648-8088-e52e652bdb84 HTTP/1.1 May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: exception: Image not found. May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'eb103ca1-4079-4648-8088-e52e652bdb84'} May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID eb103ca1-4079-4648-8088-e52e652bdb84 May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:35:57.799349 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eb103ca1-4079-4648-8088-e52e652bdb84 could not be found. May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cc71c43e-1bc7-4d88-a7db-8bd3a2336c82 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Image not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cc71c43e-1bc7-4d88-a7db-8bd3a2336c82 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/images/eb103ca1-4079-4648-8088-e52e652bdb84" status: 404 len: 62 microversion: 2.1 time: 0.062597 May 19 04:35:57.803567 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 601/1225] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:57 2022] GET /compute/v2.1/images/eb103ca1-4079-4648-8088-e52e652bdb84 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:35:57.821324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8d095bb1-aed0-4751-ae48-07e2b32af7fc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:57.834732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8d095bb1-aed0-4751-ae48-07e2b32af7fc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:57.869602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d095bb1-aed0-4751-ae48-07e2b32af7fc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:57.870187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d095bb1-aed0-4751-ae48-07e2b32af7fc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:57.871885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d095bb1-aed0-4751-ae48-07e2b32af7fc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:57.872342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d095bb1-aed0-4751-ae48-07e2b32af7fc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:57.929334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:35:58.291684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8d095bb1-aed0-4751-ae48-07e2b32af7fc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:58.311761 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8d095bb1-aed0-4751-ae48-07e2b32af7fc tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1533 microversion: 2.1 time: 0.493657 May 19 04:35:58.312943 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 602/1226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:57 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1533 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:58.403911 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9f93fa3b-af4e-4f7d-bf3d-c46991ef98d6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "POST /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61/action" status: 202 len: 0 microversion: 2.1 time: 0.848096 May 19 04:35:58.405562 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 625/1227] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:35:57 2022] POST /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61/action => generated 0 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 04:35:58.414666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c7151403-780d-421b-8726-9adece02aefc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:58.416838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c7151403-780d-421b-8726-9adece02aefc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:58.435690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7151403-780d-421b-8726-9adece02aefc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:58.438323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7151403-780d-421b-8726-9adece02aefc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:58.439313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7151403-780d-421b-8726-9adece02aefc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:58.440785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bfa52a22-e8e1-44af-b533-45dfe7e3e4c4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315bd98b0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:58.441292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7151403-780d-421b-8726-9adece02aefc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:58.559762 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bfa52a22-e8e1-44af-b533-45dfe7e3e4c4 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515" status: 200 len: 1413 microversion: 2.1 time: 0.131218 May 19 04:35:58.560345 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 626/1228] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:58 2022] GET /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515 => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:58.574366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dba8a973-7c79-4b77-a016-40fd8deb0a33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:58.578584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dba8a973-7c79-4b77-a016-40fd8deb0a33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:58.609693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dba8a973-7c79-4b77-a016-40fd8deb0a33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:58.610911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dba8a973-7c79-4b77-a016-40fd8deb0a33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:58.611879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dba8a973-7c79-4b77-a016-40fd8deb0a33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:58.612475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dba8a973-7c79-4b77-a016-40fd8deb0a33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:59.086113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c7151403-780d-421b-8726-9adece02aefc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:59.094473 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c7151403-780d-421b-8726-9adece02aefc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1323 microversion: 2.1 time: 0.686751 May 19 04:35:59.098162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 603/1229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:58 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1323 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:59.103037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ec7d6ea-2bb3-41f4-9ca2-e0e9ede91eac tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315dd3c10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:59.165024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dba8a973-7c79-4b77-a016-40fd8deb0a33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:35:59.176233 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ec7d6ea-2bb3-41f4-9ca2-e0e9ede91eac tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515" status: 200 len: 1413 microversion: 2.1 time: 0.076738 May 19 04:35:59.177647 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 604/1230] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:59 2022] GET /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:59.189951 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dba8a973-7c79-4b77-a016-40fd8deb0a33 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.625004 May 19 04:35:59.190551 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 627/1231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:58 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:35:59.199642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1d43a171-2cc5-4d18-927a-f91dca702f04 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315e92a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:59.338593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9290f029-8131-4080-baaa-d00fc629d1b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:59.339327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9290f029-8131-4080-baaa-d00fc629d1b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:59.361635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9290f029-8131-4080-baaa-d00fc629d1b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:59.373742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9290f029-8131-4080-baaa-d00fc629d1b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:59.378331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9290f029-8131-4080-baaa-d00fc629d1b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:59.381104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9290f029-8131-4080-baaa-d00fc629d1b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:59.531203 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1d43a171-2cc5-4d18-927a-f91dca702f04 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515" status: 204 len: 0 microversion: 2.1 time: 0.344639 May 19 04:35:59.532024 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 605/1232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:59 2022] DELETE /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:35:59.540421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a729bf07-82fd-4a97-a46d-711910ce9816 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315ed9790>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:59.580717 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-a729bf07-82fd-4a97-a46d-711910ce9816 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Image not found. May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a729bf07-82fd-4a97-a46d-711910ce9816 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515 HTTP/1.1 May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: exception: Image not found. May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '9ca3e24f-7b4d-46f7-a44c-987b20bc6515'} May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9ca3e24f-7b4d-46f7-a44c-987b20bc6515 May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:35:59.589622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ca3e24f-7b4d-46f7-a44c-987b20bc6515 could not be found. May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:35:59.594472 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:35:59.597913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a729bf07-82fd-4a97-a46d-711910ce9816 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Image not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:35:59.600515 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a729bf07-82fd-4a97-a46d-711910ce9816 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515" status: 404 len: 62 microversion: 2.1 time: 0.062810 May 19 04:35:59.601367 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 606/1233] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:35:59 2022] GET /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 19 04:35:59.620923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-69529097-34e4-4775-bebd-18c77cfece12 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:35:59.624311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-69529097-34e4-4775-bebd-18c77cfece12 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:35:59.642567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69529097-34e4-4775-bebd-18c77cfece12 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:59.643091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69529097-34e4-4775-bebd-18c77cfece12 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:35:59.643936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69529097-34e4-4775-bebd-18c77cfece12 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:35:59.644450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69529097-34e4-4775-bebd-18c77cfece12 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:00.118284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:00.200045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:00.666361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9290f029-8131-4080-baaa-d00fc629d1b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:00.683933 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9290f029-8131-4080-baaa-d00fc629d1b9 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1539 microversion: 2.1 time: 1.350418 May 19 04:36:00.689862 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 628/1234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:59 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1539 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:00.710647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d4da2392-4827-404d-97be-bdbb8dfad7bc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:00.711709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d4da2392-4827-404d-97be-bdbb8dfad7bc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:00.720503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4da2392-4827-404d-97be-bdbb8dfad7bc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:00.721448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4da2392-4827-404d-97be-bdbb8dfad7bc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:00.722765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4da2392-4827-404d-97be-bdbb8dfad7bc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:00.723996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4da2392-4827-404d-97be-bdbb8dfad7bc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:00.728440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-69529097-34e4-4775-bebd-18c77cfece12 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:00.738384 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-69529097-34e4-4775-bebd-18c77cfece12 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1501 microversion: 2.1 time: 1.125775 May 19 04:36:00.749453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 607/1235] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:35:59 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1501 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:00.756545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "93766ae6-8687-44b1-b931-56cef453b827"}], "security_groups": [{"name": "tempest-securitygroup--30534529"}], "key_name": "tempest-keypair-218920590", "user_data": "}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:01.400654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] validate_networks() for [('93766ae6-8687-44b1-b931-56cef453b827', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:36:01.443854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d4da2392-4827-404d-97be-bdbb8dfad7bc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:01.451802 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d4da2392-4827-404d-97be-bdbb8dfad7bc tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1323 microversion: 2.1 time: 0.760283 May 19 04:36:01.452397 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 629/1236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:00 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1323 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:01.474202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-796cbc27-4ca6-401c-8ad3-7bbe70d72952 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:01.474832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-796cbc27-4ca6-401c-8ad3-7bbe70d72952 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:01.484661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-796cbc27-4ca6-401c-8ad3-7bbe70d72952 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:01.485149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-796cbc27-4ca6-401c-8ad3-7bbe70d72952 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:01.485951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-796cbc27-4ca6-401c-8ad3-7bbe70d72952 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:01.486403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-796cbc27-4ca6-401c-8ad3-7bbe70d72952 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:02.342681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:02.375753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-796cbc27-4ca6-401c-8ad3-7bbe70d72952 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:02.390350 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-796cbc27-4ca6-401c-8ad3-7bbe70d72952 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.920073 May 19 04:36:02.391276 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 630/1237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:01 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:02.396164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-291c91d0-d572-4e99-b664-2f1bb9e03212 req-8a2f3e33-e3fa-45d4-b84b-faee59cfebcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2ae1de-c359-4358-ba9a-a978ce719a40", "name": "network-vif-unplugged", "status": "completed", "tag": "a90ed039-62ad-4f8b-b460-aeb6755cd08f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:02.451449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-291c91d0-d572-4e99-b664-2f1bb9e03212 req-8a2f3e33-e3fa-45d4-b84b-faee59cfebcb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:02.452058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-291c91d0-d572-4e99-b664-2f1bb9e03212 req-8a2f3e33-e3fa-45d4-b84b-faee59cfebcb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:02.490059 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-291c91d0-d572-4e99-b664-2f1bb9e03212 req-8a2f3e33-e3fa-45d4-b84b-faee59cfebcb service nova] Creating event network-vif-unplugged:a90ed039-62ad-4f8b-b460-aeb6755cd08f for instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 on n-h1-766726-30 May 19 04:36:02.525562 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-291c91d0-d572-4e99-b664-2f1bb9e03212 req-8a2f3e33-e3fa-45d4-b84b-faee59cfebcb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132549 May 19 04:36:02.526186 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 631/1238] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:02.546648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-54490c75-d736-48d4-8178-aa239791c812 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:02.547377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-54490c75-d736-48d4-8178-aa239791c812 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:02.586558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54490c75-d736-48d4-8178-aa239791c812 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:02.587024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54490c75-d736-48d4-8178-aa239791c812 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:02.588052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54490c75-d736-48d4-8178-aa239791c812 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:02.588502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54490c75-d736-48d4-8178-aa239791c812 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:04.204208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-54490c75-d736-48d4-8178-aa239791c812 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:04.213578 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-54490c75-d736-48d4-8178-aa239791c812 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1521 microversion: 2.1 time: 1.686121 May 19 04:36:04.220397 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 632/1239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:02 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1521 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:04.233315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3d317472-b84d-4cc5-a613-5e9737bb9025 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:04.237024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3d317472-b84d-4cc5-a613-5e9737bb9025 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:04.245320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d317472-b84d-4cc5-a613-5e9737bb9025 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:04.246035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d317472-b84d-4cc5-a613-5e9737bb9025 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:04.247082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d317472-b84d-4cc5-a613-5e9737bb9025 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:04.247747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d317472-b84d-4cc5-a613-5e9737bb9025 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:04.359214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:36:04.360430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:36:04.361156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:36:04.361770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:36:04.362363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:36:04.384800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:04.385279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:04.386100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:04.386541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:04.437749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Getting quotas for project d0c0500491454fa3af763f11c897104a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:04.447781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Getting quotas for user a112a35379df43eaa46bdaadb126c022 and project d0c0500491454fa3af763f11c897104a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:04.482502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:36:04.490712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:36:04.605264 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1c4082a-266e-4f74-8c29-5b6ce33d4fba tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.850656 May 19 04:36:04.606468 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 608/1240] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:36:00 2022] POST /compute/v2.1/servers => generated 407 bytes in 3856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:36:04.615739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-688c9313-a9ba-4995-a59b-06e1d8303d8f tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:04.616609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-688c9313-a9ba-4995-a59b-06e1d8303d8f tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:04.635538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-688c9313-a9ba-4995-a59b-06e1d8303d8f tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:04.636347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-688c9313-a9ba-4995-a59b-06e1d8303d8f tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:04.651024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-688c9313-a9ba-4995-a59b-06e1d8303d8f tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:04.652560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-688c9313-a9ba-4995-a59b-06e1d8303d8f tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:04.791429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3d317472-b84d-4cc5-a613-5e9737bb9025 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:04.809761 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3d317472-b84d-4cc5-a613-5e9737bb9025 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1489 microversion: 2.1 time: 0.586766 May 19 04:36:04.810402 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 633/1241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:04 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1489 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:04.827236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-871a3564-c724-4ef7-ad83-9fd1a2373e52 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:04.827876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-871a3564-c724-4ef7-ad83-9fd1a2373e52 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:04.849886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-871a3564-c724-4ef7-ad83-9fd1a2373e52 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:04.850342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-871a3564-c724-4ef7-ad83-9fd1a2373e52 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:04.851134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-871a3564-c724-4ef7-ad83-9fd1a2373e52 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:04.851573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-871a3564-c724-4ef7-ad83-9fd1a2373e52 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:05.080736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-688c9313-a9ba-4995-a59b-06e1d8303d8f tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:05.105452 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-688c9313-a9ba-4995-a59b-06e1d8303d8f tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1323 microversion: 2.1 time: 0.497238 May 19 04:36:05.106418 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 609/1242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:04 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:05.120143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3906873c-4132-4569-a9a1-dac7ae5aee01 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:05.120655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3906873c-4132-4569-a9a1-dac7ae5aee01 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:05.141509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3906873c-4132-4569-a9a1-dac7ae5aee01 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:05.141971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3906873c-4132-4569-a9a1-dac7ae5aee01 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:05.142789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3906873c-4132-4569-a9a1-dac7ae5aee01 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:05.143398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3906873c-4132-4569-a9a1-dac7ae5aee01 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:05.247104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3906873c-4132-4569-a9a1-dac7ae5aee01 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:36:05.334188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-871a3564-c724-4ef7-ad83-9fd1a2373e52 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:05.351447 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-871a3564-c724-4ef7-ad83-9fd1a2373e52 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.539925 May 19 04:36:05.352826 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 634/1243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:04 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:05.383869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-238dd05d-2898-445b-ba76-584520928b43 req-059d9e2d-3dff-4f76-ba06-08621b966437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6092f529-4e24-4335-9922-76f287b8696d", "tag": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6"}, {"name": "network-changed", "server_uuid": "7f2ae1de-c359-4358-ba9a-a978ce719a40", "tag": "a90ed039-62ad-4f8b-b460-aeb6755cd08f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:05.398699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-238dd05d-2898-445b-ba76-584520928b43 req-059d9e2d-3dff-4f76-ba06-08621b966437 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:05.399562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-238dd05d-2898-445b-ba76-584520928b43 req-059d9e2d-3dff-4f76-ba06-08621b966437 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:05.440459 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-238dd05d-2898-445b-ba76-584520928b43 req-059d9e2d-3dff-4f76-ba06-08621b966437 service nova] Creating event network-changed:9cbf4581-2ce2-4cac-9676-5b95af59ddd6 for instance 6092f529-4e24-4335-9922-76f287b8696d on n-h1-766726-30 May 19 04:36:05.442071 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-238dd05d-2898-445b-ba76-584520928b43 req-059d9e2d-3dff-4f76-ba06-08621b966437 service nova] Creating event network-changed:a90ed039-62ad-4f8b-b460-aeb6755cd08f for instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 on n-h1-766726-30 May 19 04:36:05.463666 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-238dd05d-2898-445b-ba76-584520928b43 req-059d9e2d-3dff-4f76-ba06-08621b966437 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.102642 May 19 04:36:05.466300 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 635/1244] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:05.482901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-14fe9564-68a7-40bd-9a8d-8c3c9b8b7811 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:05.485030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-14fe9564-68a7-40bd-9a8d-8c3c9b8b7811 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:05.508788 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3906873c-4132-4569-a9a1-dac7ae5aee01 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 204 len: 0 microversion: 2.1 time: 0.399258 May 19 04:36:05.517510 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 610/1245] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:05 2022] DELETE /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:05.527880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27d08acf-fb5d-4338-acba-250b599ef25f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:05.528976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27d08acf-fb5d-4338-acba-250b599ef25f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:05.537452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d08acf-fb5d-4338-acba-250b599ef25f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:05.538244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d08acf-fb5d-4338-acba-250b599ef25f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:05.539200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d08acf-fb5d-4338-acba-250b599ef25f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:05.539803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d08acf-fb5d-4338-acba-250b599ef25f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:05.629251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27d08acf-fb5d-4338-acba-250b599ef25f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:36:05.773837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-14fe9564-68a7-40bd-9a8d-8c3c9b8b7811 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:05.788346 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-14fe9564-68a7-40bd-9a8d-8c3c9b8b7811 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1225 microversion: 2.1 time: 0.318244 May 19 04:36:05.789798 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 636/1246] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:05 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1225 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:05.805579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dfb73727-8380-48af-b425-4eb8275288d3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:05.806705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dfb73727-8380-48af-b425-4eb8275288d3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:05.815213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfb73727-8380-48af-b425-4eb8275288d3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:05.818353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfb73727-8380-48af-b425-4eb8275288d3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:05.819464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfb73727-8380-48af-b425-4eb8275288d3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:05.823806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfb73727-8380-48af-b425-4eb8275288d3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:05.864522 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27d08acf-fb5d-4338-acba-250b599ef25f tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 204 len: 0 microversion: 2.1 time: 0.344595 May 19 04:36:05.866741 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 611/1247] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:05 2022] DELETE /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:05.883715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8fa3e3af-8d00-4285-9870-3374b4c95980 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315dd48b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:05.933783 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-8fa3e3af-8d00-4285-9870-3374b4c95980 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Image not found. May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8fa3e3af-8d00-4285-9870-3374b4c95980 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515 HTTP/1.1 May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: exception: Image not found. May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '9ca3e24f-7b4d-46f7-a44c-987b20bc6515'} May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9ca3e24f-7b4d-46f7-a44c-987b20bc6515 to delete May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ca3e24f-7b4d-46f7-a44c-987b20bc6515 could not be found. May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:05.936014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:05.940365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:05.943133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8fa3e3af-8d00-4285-9870-3374b4c95980 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Image not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:05.944194 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8fa3e3af-8d00-4285-9870-3374b4c95980 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515" status: 404 len: 62 microversion: 2.1 time: 0.071178 May 19 04:36:05.945414 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 612/1248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:05 2022] DELETE /compute/v2.1/images/9ca3e24f-7b4d-46f7-a44c-987b20bc6515 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:05.954069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82aacebe-a841-4dbb-97f9-60929bc3abc0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:05.959542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82aacebe-a841-4dbb-97f9-60929bc3abc0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:05.972382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82aacebe-a841-4dbb-97f9-60929bc3abc0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:05.973389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82aacebe-a841-4dbb-97f9-60929bc3abc0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:05.974397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82aacebe-a841-4dbb-97f9-60929bc3abc0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:05.975900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82aacebe-a841-4dbb-97f9-60929bc3abc0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:06.047697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82aacebe-a841-4dbb-97f9-60929bc3abc0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:36:06.058632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dfb73727-8380-48af-b425-4eb8275288d3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:06.068218 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dfb73727-8380-48af-b425-4eb8275288d3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1527 microversion: 2.1 time: 0.275262 May 19 04:36:06.069793 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 637/1249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:05 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1527 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:06.124622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a80b0636-6d12-4c7d-a8d6-a44f9f328a66 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:06.126538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a80b0636-6d12-4c7d-a8d6-a44f9f328a66 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:06.144324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a80b0636-6d12-4c7d-a8d6-a44f9f328a66 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:06.145699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a80b0636-6d12-4c7d-a8d6-a44f9f328a66 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:06.148123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a80b0636-6d12-4c7d-a8d6-a44f9f328a66 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:06.151622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a80b0636-6d12-4c7d-a8d6-a44f9f328a66 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:06.163302 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-82aacebe-a841-4dbb-97f9-60929bc3abc0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Instance is already in deleting state, ignoring this request May 19 04:36:06.164539 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82aacebe-a841-4dbb-97f9-60929bc3abc0 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 204 len: 0 microversion: 2.1 time: 0.214843 May 19 04:36:06.170224 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 613/1250] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:05 2022] DELETE /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:06.180303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3d275a99-c6bc-418c-aa2c-6d0118506421 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:06.182554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3d275a99-c6bc-418c-aa2c-6d0118506421 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:06.203947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d275a99-c6bc-418c-aa2c-6d0118506421 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:06.210156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d275a99-c6bc-418c-aa2c-6d0118506421 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:06.212679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d275a99-c6bc-418c-aa2c-6d0118506421 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:06.220191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d275a99-c6bc-418c-aa2c-6d0118506421 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:06.917935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3d275a99-c6bc-418c-aa2c-6d0118506421 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:06.926014 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3d275a99-c6bc-418c-aa2c-6d0118506421 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1495 microversion: 2.1 time: 0.751602 May 19 04:36:06.926607 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 614/1251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:06 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1495 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:06.939904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b56a6641-e141-432e-a54d-4255c2507b8e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:06.940534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b56a6641-e141-432e-a54d-4255c2507b8e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:06.956237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b56a6641-e141-432e-a54d-4255c2507b8e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:06.956781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b56a6641-e141-432e-a54d-4255c2507b8e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:06.958104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b56a6641-e141-432e-a54d-4255c2507b8e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:06.958569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b56a6641-e141-432e-a54d-4255c2507b8e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:06.971733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a80b0636-6d12-4c7d-a8d6-a44f9f328a66 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:06.996880 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a80b0636-6d12-4c7d-a8d6-a44f9f328a66 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1323 microversion: 2.1 time: 0.877100 May 19 04:36:07.006132 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 638/1252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:06 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1323 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:36:07.013491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-c62cbd5b-c5b8-4002-b5f0-b81f3a679bdb req-54c4e100-ca6d-483a-98a6-3cb7fc2dbee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21238921-8bdc-42a0-a385-3f9e3dd13bee", "name": "network-vif-plugged", "status": "completed", "tag": "f7939cb3-a0f7-4a0c-82b1-df0644c9d215"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:07.036658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c62cbd5b-c5b8-4002-b5f0-b81f3a679bdb req-54c4e100-ca6d-483a-98a6-3cb7fc2dbee7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:07.038010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c62cbd5b-c5b8-4002-b5f0-b81f3a679bdb req-54c4e100-ca6d-483a-98a6-3cb7fc2dbee7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:07.086078 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-c62cbd5b-c5b8-4002-b5f0-b81f3a679bdb req-54c4e100-ca6d-483a-98a6-3cb7fc2dbee7 service nova] Creating event network-vif-plugged:f7939cb3-a0f7-4a0c-82b1-df0644c9d215 for instance 21238921-8bdc-42a0-a385-3f9e3dd13bee on n-h1-766726-30 May 19 04:36:07.099498 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-c62cbd5b-c5b8-4002-b5f0-b81f3a679bdb req-54c4e100-ca6d-483a-98a6-3cb7fc2dbee7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097322 May 19 04:36:07.100538 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 639/1253] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:07.119203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f73d9ddf-b1ef-468a-9885-07d685a847a1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:07.120685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f73d9ddf-b1ef-468a-9885-07d685a847a1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:07.156284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f73d9ddf-b1ef-468a-9885-07d685a847a1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:07.159672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f73d9ddf-b1ef-468a-9885-07d685a847a1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:07.162381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f73d9ddf-b1ef-468a-9885-07d685a847a1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:07.164111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f73d9ddf-b1ef-468a-9885-07d685a847a1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:07.195655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b56a6641-e141-432e-a54d-4255c2507b8e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:07.215470 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b56a6641-e141-432e-a54d-4255c2507b8e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.282725 May 19 04:36:07.216893 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 615/1254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:06 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:07.224300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd43db11-eba6-4a05-99d0-55e13c2729d4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:07.224931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cd43db11-eba6-4a05-99d0-55e13c2729d4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:07.243653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd43db11-eba6-4a05-99d0-55e13c2729d4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:07.246426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd43db11-eba6-4a05-99d0-55e13c2729d4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:07.247310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd43db11-eba6-4a05-99d0-55e13c2729d4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:07.247699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd43db11-eba6-4a05-99d0-55e13c2729d4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:07.362748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f73d9ddf-b1ef-468a-9885-07d685a847a1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:07.375623 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f73d9ddf-b1ef-468a-9885-07d685a847a1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1221 microversion: 2.1 time: 0.271248 May 19 04:36:07.378691 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 640/1255] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:07 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1221 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:07.675984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cd43db11-eba6-4a05-99d0-55e13c2729d4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:07.685791 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd43db11-eba6-4a05-99d0-55e13c2729d4 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1527 microversion: 2.1 time: 0.466583 May 19 04:36:07.687189 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 616/1256] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:07 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1527 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:07.949560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ebaf78b5-440d-44dc-bbdc-be1d4ecf6fd6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:07.951192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ebaf78b5-440d-44dc-bbdc-be1d4ecf6fd6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:07.960226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebaf78b5-440d-44dc-bbdc-be1d4ecf6fd6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:07.961252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebaf78b5-440d-44dc-bbdc-be1d4ecf6fd6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:07.962518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebaf78b5-440d-44dc-bbdc-be1d4ecf6fd6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:07.963886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebaf78b5-440d-44dc-bbdc-be1d4ecf6fd6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:08.015474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c9970c6e-29af-4c60-96be-5f9d26fe9413 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:08.016755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c9970c6e-29af-4c60-96be-5f9d26fe9413 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:08.025112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9970c6e-29af-4c60-96be-5f9d26fe9413 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:08.025878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9970c6e-29af-4c60-96be-5f9d26fe9413 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:08.027091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9970c6e-29af-4c60-96be-5f9d26fe9413 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:08.027976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9970c6e-29af-4c60-96be-5f9d26fe9413 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:08.407819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ebaf78b5-440d-44dc-bbdc-be1d4ecf6fd6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:08.423974 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ebaf78b5-440d-44dc-bbdc-be1d4ecf6fd6 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1495 microversion: 2.1 time: 0.482117 May 19 04:36:08.429627 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 641/1257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:07 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1495 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:36:08.452040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-53fbb834-82e7-46c0-96a3-eef65c3699d2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:08.454063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-53fbb834-82e7-46c0-96a3-eef65c3699d2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:08.488064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53fbb834-82e7-46c0-96a3-eef65c3699d2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:08.498045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53fbb834-82e7-46c0-96a3-eef65c3699d2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:08.498896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53fbb834-82e7-46c0-96a3-eef65c3699d2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:08.505814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53fbb834-82e7-46c0-96a3-eef65c3699d2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:09.405581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c9970c6e-29af-4c60-96be-5f9d26fe9413 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:09.418476 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c9970c6e-29af-4c60-96be-5f9d26fe9413 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1323 microversion: 2.1 time: 1.406570 May 19 04:36:09.428208 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 617/1258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:08 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1323 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:36:09.437163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eae48e8f-a2e6-44d7-991a-8e9847b52d29 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:09.445608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eae48e8f-a2e6-44d7-991a-8e9847b52d29 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:09.466995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eae48e8f-a2e6-44d7-991a-8e9847b52d29 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:09.470762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eae48e8f-a2e6-44d7-991a-8e9847b52d29 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:09.473704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eae48e8f-a2e6-44d7-991a-8e9847b52d29 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:09.474940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eae48e8f-a2e6-44d7-991a-8e9847b52d29 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:09.607104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-53fbb834-82e7-46c0-96a3-eef65c3699d2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:09.617373 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-53fbb834-82e7-46c0-96a3-eef65c3699d2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 1.184000 May 19 04:36:09.617974 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 642/1259] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:08 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:09.634353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c630d8f7-e0c3-4fce-ba18-37ceb7751763 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:09.641766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c630d8f7-e0c3-4fce-ba18-37ceb7751763 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:09.662503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c630d8f7-e0c3-4fce-ba18-37ceb7751763 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:09.663124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c630d8f7-e0c3-4fce-ba18-37ceb7751763 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:09.664153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c630d8f7-e0c3-4fce-ba18-37ceb7751763 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:09.664604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c630d8f7-e0c3-4fce-ba18-37ceb7751763 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:09.675410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:09.836459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eae48e8f-a2e6-44d7-991a-8e9847b52d29 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:09.847846 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eae48e8f-a2e6-44d7-991a-8e9847b52d29 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1283 microversion: 2.1 time: 0.417092 May 19 04:36:09.859879 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 618/1260] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:09 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1283 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:09.876081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ec77cc80-68d4-4bdd-860c-9216cf2d26f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:09.877194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ec77cc80-68d4-4bdd-860c-9216cf2d26f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:09.895333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec77cc80-68d4-4bdd-860c-9216cf2d26f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:09.896700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec77cc80-68d4-4bdd-860c-9216cf2d26f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:09.898614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec77cc80-68d4-4bdd-860c-9216cf2d26f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:09.899297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec77cc80-68d4-4bdd-860c-9216cf2d26f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:09.910465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:10.114717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ec77cc80-68d4-4bdd-860c-9216cf2d26f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b561a0c5d754a12a04e62664e607506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff2741185bb8440db094f7bc87af8b2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:10.127073 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ec77cc80-68d4-4bdd-860c-9216cf2d26f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 200 len: 1293 microversion: 2.1 time: 0.264547 May 19 04:36:10.129845 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 619/1261] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:09 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 1293 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:10.154098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-57cb58ba-f688-44f1-98bf-9f7c9689b535 req-f556b16f-5734-4ea7-a211-dde1a02c3920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cef1740-3fa0-4754-a41d-173d88e0ef61", "name": "network-vif-plugged", "status": "completed", "tag": "1636583b-1cb6-44bf-b63b-387cf5c5276b"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:10.191999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-57cb58ba-f688-44f1-98bf-9f7c9689b535 req-f556b16f-5734-4ea7-a211-dde1a02c3920 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:10.194679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-57cb58ba-f688-44f1-98bf-9f7c9689b535 req-f556b16f-5734-4ea7-a211-dde1a02c3920 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:10.222588 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-57cb58ba-f688-44f1-98bf-9f7c9689b535 req-f556b16f-5734-4ea7-a211-dde1a02c3920 service nova] Creating event network-vif-plugged:1636583b-1cb6-44bf-b63b-387cf5c5276b for instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 on n-h2-766726-30 May 19 04:36:10.235347 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-57cb58ba-f688-44f1-98bf-9f7c9689b535 req-f556b16f-5734-4ea7-a211-dde1a02c3920 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103775 May 19 04:36:10.238358 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 620/1262] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:10.252185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fbf97f4f-19bb-485d-b0bb-9f235ee001b3 req-92693401-64df-4763-b41a-05e8081e84d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cef1740-3fa0-4754-a41d-173d88e0ef61", "name": "network-vif-deleted", "tag": "1636583b-1cb6-44bf-b63b-387cf5c5276b"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:10.271827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fbf97f4f-19bb-485d-b0bb-9f235ee001b3 req-92693401-64df-4763-b41a-05e8081e84d9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:10.273043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fbf97f4f-19bb-485d-b0bb-9f235ee001b3 req-92693401-64df-4763-b41a-05e8081e84d9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:10.299387 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fbf97f4f-19bb-485d-b0bb-9f235ee001b3 req-92693401-64df-4763-b41a-05e8081e84d9 service nova] Creating event network-vif-deleted:1636583b-1cb6-44bf-b63b-387cf5c5276b for instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 on n-h2-766726-30 May 19 04:36:10.315550 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fbf97f4f-19bb-485d-b0bb-9f235ee001b3 req-92693401-64df-4763-b41a-05e8081e84d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071743 May 19 04:36:10.317865 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 621/1263] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:10.448143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9917f827-4664-44b7-b123-c38f33543e0e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:10.450476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9917f827-4664-44b7-b123-c38f33543e0e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:10.484514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9917f827-4664-44b7-b123-c38f33543e0e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:10.489854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9917f827-4664-44b7-b123-c38f33543e0e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:10.490974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9917f827-4664-44b7-b123-c38f33543e0e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:10.495078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9917f827-4664-44b7-b123-c38f33543e0e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:11.302279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c630d8f7-e0c3-4fce-ba18-37ceb7751763 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:11.315543 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c630d8f7-e0c3-4fce-ba18-37ceb7751763 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1527 microversion: 2.1 time: 1.689752 May 19 04:36:11.316255 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 643/1264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:09 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1527 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:11.348458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-400631e0-e1fb-485d-8fec-114a979cf6c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:11.354141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-400631e0-e1fb-485d-8fec-114a979cf6c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:11.366173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-400631e0-e1fb-485d-8fec-114a979cf6c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:11.368125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-400631e0-e1fb-485d-8fec-114a979cf6c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:11.370173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-400631e0-e1fb-485d-8fec-114a979cf6c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:11.371651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-400631e0-e1fb-485d-8fec-114a979cf6c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:12.028040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9917f827-4664-44b7-b123-c38f33543e0e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:12.036594 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9917f827-4664-44b7-b123-c38f33543e0e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1323 microversion: 2.1 time: 1.601439 May 19 04:36:12.041026 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 622/1265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:10 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1323 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:12.051537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b4634c6-824b-4054-8478-3f2cb2e9e1fd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:12.052469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b4634c6-824b-4054-8478-3f2cb2e9e1fd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:12.066317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b4634c6-824b-4054-8478-3f2cb2e9e1fd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:12.068187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b4634c6-824b-4054-8478-3f2cb2e9e1fd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:12.070143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b4634c6-824b-4054-8478-3f2cb2e9e1fd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:12.070842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b4634c6-824b-4054-8478-3f2cb2e9e1fd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:12.318663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b4634c6-824b-4054-8478-3f2cb2e9e1fd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:12.334456 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b4634c6-824b-4054-8478-3f2cb2e9e1fd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1283 microversion: 2.1 time: 0.291847 May 19 04:36:12.350222 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 623/1266] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:12 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1283 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:12.374264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:12.376130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 8cef1740-3fa0-4754-a41d-173d88e0ef61] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:12.418884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:12.421995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:12.423034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:12.423633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:12.447539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-400631e0-e1fb-485d-8fec-114a979cf6c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:12.476317 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 could not be found. May 19 04:36:12.476546 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-400631e0-e1fb-485d-8fec-114a979cf6c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 1.157686 May 19 04:36:12.476845 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 644/1267] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:11 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 HTTP/1.1 May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 could not be found. May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '8cef1740-3fa0-4754-a41d-173d88e0ef61'} May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 could not be found. May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 could not be found. May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.480528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:12.486133 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:12.486133 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:12.486133 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:12.486133 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:12.486133 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 could not be found. May 19 04:36:12.486133 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.491626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Instance 8cef1740-3fa0-4754-a41d-173d88e0ef61 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:12.492870 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9384620c-ddc2-4cda-bd5c-3edf181797e3 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61" status: 404 len: 111 microversion: 2.1 time: 0.141386 May 19 04:36:12.501448 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 624/1268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:12 2022] GET /compute/v2.1/servers/8cef1740-3fa0-4754-a41d-173d88e0ef61 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:12.508705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5188447e-435e-4888-808e-529f75b6ccaf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:12.511169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5188447e-435e-4888-808e-529f75b6ccaf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:12.526586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5188447e-435e-4888-808e-529f75b6ccaf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:12.530152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5188447e-435e-4888-808e-529f75b6ccaf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:12.531311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5188447e-435e-4888-808e-529f75b6ccaf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:12.532735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5188447e-435e-4888-808e-529f75b6ccaf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:12.756611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5188447e-435e-4888-808e-529f75b6ccaf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:12.759591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce198eb2-3367-47f9-b1e1-72e3a2eb5e52 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Calling method '.version_select at 0x7fd315afa9d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:12.769980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5188447e-435e-4888-808e-529f75b6ccaf tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 200 len: 1485 microversion: 2.1 time: 0.266006 May 19 04:36:12.783244 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 625/1269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:12 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 1485 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:12.791969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-10c0fe30-d9f2-4ed4-9732-2140b309ca3a req-80830ab9-a4f2-4c79-ae6a-3df382438cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6092f529-4e24-4335-9922-76f287b8696d", "name": "network-vif-plugged", "status": "completed", "tag": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:12.811707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-10c0fe30-d9f2-4ed4-9732-2140b309ca3a req-80830ab9-a4f2-4c79-ae6a-3df382438cbf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:12.813997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-10c0fe30-d9f2-4ed4-9732-2140b309ca3a req-80830ab9-a4f2-4c79-ae6a-3df382438cbf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:12.832404 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-10c0fe30-d9f2-4ed4-9732-2140b309ca3a req-80830ab9-a4f2-4c79-ae6a-3df382438cbf service nova] Creating event network-vif-plugged:9cbf4581-2ce2-4cac-9676-5b95af59ddd6 for instance 6092f529-4e24-4335-9922-76f287b8696d on n-h1-766726-30 May 19 04:36:12.859551 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-10c0fe30-d9f2-4ed4-9732-2140b309ca3a req-80830ab9-a4f2-4c79-ae6a-3df382438cbf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072267 May 19 04:36:12.862250 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 626/1270] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:12.880738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2dca4e41-c7de-4b72-8f2e-90bf2e089f19 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd316089280>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:12.895140 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce198eb2-3367-47f9-b1e1-72e3a2eb5e52 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 200 len: 371 microversion: 2.1 time: 0.417092 May 19 04:36:12.899351 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 645/1271] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 04:36:12 2022] GET /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:12.910058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3afe46c9-1fdf-4055-963e-6e89283e7bd1 req-2bed5b0b-3147-49a4-86d6-9ac0022f189d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21238921-8bdc-42a0-a385-3f9e3dd13bee", "name": "network-vif-deleted", "tag": "f7939cb3-a0f7-4a0c-82b1-df0644c9d215"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:12.930597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3afe46c9-1fdf-4055-963e-6e89283e7bd1 req-2bed5b0b-3147-49a4-86d6-9ac0022f189d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:12.931690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3afe46c9-1fdf-4055-963e-6e89283e7bd1 req-2bed5b0b-3147-49a4-86d6-9ac0022f189d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:12.939038 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-2dca4e41-c7de-4b72-8f2e-90bf2e089f19 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Image not found. May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2dca4e41-c7de-4b72-8f2e-90bf2e089f19 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 HTTP/1.1 May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: exception: Image not found. May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '7b4dbe5a-9060-428d-ae06-b2b553d2ec73'} May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7b4dbe5a-9060-428d-ae06-b2b553d2ec73 to delete May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7b4dbe5a-9060-428d-ae06-b2b553d2ec73 could not be found. May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.941901 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:12.947741 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:12.951018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2dca4e41-c7de-4b72-8f2e-90bf2e089f19 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Image not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:12.952121 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2dca4e41-c7de-4b72-8f2e-90bf2e089f19 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73" status: 404 len: 62 microversion: 2.1 time: 0.088598 May 19 04:36:12.956328 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 627/1272] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:12 2022] DELETE /compute/v2.1/images/7b4dbe5a-9060-428d-ae06-b2b553d2ec73 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:12.965900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-275d4ec6-f80a-4965-84b3-cfdcf848aae8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Action: 'update', calling method: .version_select at 0x7fd315dd3280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:12.969622 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3afe46c9-1fdf-4055-963e-6e89283e7bd1 req-2bed5b0b-3147-49a4-86d6-9ac0022f189d service nova] Creating event network-vif-deleted:f7939cb3-a0f7-4a0c-82b1-df0644c9d215 for instance 21238921-8bdc-42a0-a385-3f9e3dd13bee on n-h1-766726-30 May 19 04:36:12.979458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3afe46c9-1fdf-4055-963e-6e89283e7bd1 req-2bed5b0b-3147-49a4-86d6-9ac0022f189d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078144 May 19 04:36:12.983420 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 646/1273] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:12.989408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:12.990428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:12.998459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:12.998917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.000012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.000744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.018003 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 HTTP/1.1 May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '6853ff39-0163-4695-b867-c594611090d0'} May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:13.019974 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.024724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.026545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:13.027579 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-11a6191e-db3b-416e-bbb2-2a0bc727578e tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 404 len: 111 microversion: 2.1 time: 0.042981 May 19 04:36:13.028626 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 647/1274] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:12 2022] DELETE /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:13.037107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:13.037979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 6853ff39-0163-4695-b867-c594611090d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:13.045168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.046191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.047138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.047735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.083353 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 HTTP/1.1 May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '6853ff39-0163-4695-b867-c594611090d0'} May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.092290 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.096486 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:13.096486 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:13.096486 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:13.096486 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:13.096486 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. May 19 04:36:13.096486 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.096486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Instance 6853ff39-0163-4695-b867-c594611090d0 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:13.096486 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c18b7b72-99bd-45d6-9ffd-445880be12f5 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0" status: 404 len: 111 microversion: 2.1 time: 0.061281 May 19 04:36:13.097823 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 648/1275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:13 2022] GET /compute/v2.1/servers/6853ff39-0163-4695-b867-c594611090d0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:13.106999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-256479f7-4289-466c-97db-dc9600277a33 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:13.114820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-256479f7-4289-466c-97db-dc9600277a33 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:13.131073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-256479f7-4289-466c-97db-dc9600277a33 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.131983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-256479f7-4289-466c-97db-dc9600277a33 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.133026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-256479f7-4289-466c-97db-dc9600277a33 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.133764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-256479f7-4289-466c-97db-dc9600277a33 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.137355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-275d4ec6-f80a-4965-84b3-cfdcf848aae8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.137877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-275d4ec6-f80a-4965-84b3-cfdcf848aae8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.138626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-275d4ec6-f80a-4965-84b3-cfdcf848aae8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.139111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-275d4ec6-f80a-4965-84b3-cfdcf848aae8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.276622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:13.290935 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-275d4ec6-f80a-4965-84b3-cfdcf848aae8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 200 len: 328 microversion: 2.1 time: 0.331311 May 19 04:36:13.308880 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 628/1276] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:36:12 2022] PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 328 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:13.314515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9016b81-42ed-411e-b9d5-f6258da9b7c8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315dd3af0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:13.352480 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-a9016b81-42ed-411e-b9d5-f6258da9b7c8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Image not found. May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9016b81-42ed-411e-b9d5-f6258da9b7c8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 HTTP/1.1 May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: exception: Image not found. May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '70901f22-bac8-41d4-9ab5-7871c7acdb96'} May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 70901f22-bac8-41d4-9ab5-7871c7acdb96 to delete May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 70901f22-bac8-41d4-9ab5-7871c7acdb96 could not be found. May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:13.355071 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:13.359257 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:13.363708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9016b81-42ed-411e-b9d5-f6258da9b7c8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Image not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:13.365268 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a9016b81-42ed-411e-b9d5-f6258da9b7c8 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96" status: 404 len: 62 microversion: 2.1 time: 0.054618 May 19 04:36:13.370125 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 629/1277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:13 2022] DELETE /compute/v2.1/images/70901f22-bac8-41d4-9ab5-7871c7acdb96 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:13.378039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9d64e3ff-cf3f-400d-8bd8-a033ac832211 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:13.378991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9d64e3ff-cf3f-400d-8bd8-a033ac832211 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:13.414136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9d64e3ff-cf3f-400d-8bd8-a033ac832211 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.416838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9d64e3ff-cf3f-400d-8bd8-a033ac832211 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.418201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9d64e3ff-cf3f-400d-8bd8-a033ac832211 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.418994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9d64e3ff-cf3f-400d-8bd8-a033ac832211 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.715510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-256479f7-4289-466c-97db-dc9600277a33 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:13.728298 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-256479f7-4289-466c-97db-dc9600277a33 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1323 microversion: 2.1 time: 0.628560 May 19 04:36:13.747177 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 649/1278] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:13 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:13.756579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:13.757391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:13.769210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:13.773505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.774979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.776744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.778660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.816309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c HTTP/1.1 May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '54201b4d-c068-43c2-bfe0-ea4714da319c'} May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:13.827140 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:13.831186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:13.833479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:13.834567 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-747d9f86-78b7-433b-8b16-9a33615083d7 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 404 len: 111 microversion: 2.1 time: 0.096745 May 19 04:36:13.847205 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 650/1279] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:13 2022] DELETE /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:13.852503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ddf16c16-06a8-4a5e-ad97-10b2a50c597b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:13.853689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ddf16c16-06a8-4a5e-ad97-10b2a50c597b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:13.854594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9d64e3ff-cf3f-400d-8bd8-a033ac832211 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:13.864487 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9d64e3ff-cf3f-400d-8bd8-a033ac832211 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1349 microversion: 2.1 time: 0.493151 May 19 04:36:13.867393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ddf16c16-06a8-4a5e-ad97-10b2a50c597b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.869102 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 630/1280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:13 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1349 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:13.880921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ddf16c16-06a8-4a5e-ad97-10b2a50c597b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.890277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ddf16c16-06a8-4a5e-ad97-10b2a50c597b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:13.892270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ddf16c16-06a8-4a5e-ad97-10b2a50c597b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:13.984474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1419970903", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:14.064916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:36:14.573543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ddf16c16-06a8-4a5e-ad97-10b2a50c597b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:14.584704 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ddf16c16-06a8-4a5e-ad97-10b2a50c597b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.736008 May 19 04:36:14.613486 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 651/1281] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:13 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:14.625598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:14.630216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:14.643054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:36:14.643616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:36:14.643942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:36:14.644350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:36:14.644762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:36:14.646135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:14.655591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:14.656933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:14.657656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:14.659895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:14.660351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:14.661314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:14.661616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:14.685587 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee HTTP/1.1 May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '21238921-8bdc-42a0-a385-3f9e3dd13bee'} May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.687500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:14.691535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.691535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.691535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:14.691535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:14.691535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:14.691535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:14.691535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:14.691535 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.695992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:14.697360 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9449632c-e00f-4734-a511-38f2e655c9e1 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 404 len: 111 microversion: 2.1 time: 0.080340 May 19 04:36:14.699695 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 652/1282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:14 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:14.703560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Getting quotas for project 4baf2ceef8834c2ca9fcc176248d73f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:14.707072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:14.708266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 54201b4d-c068-43c2-bfe0-ea4714da319c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:14.722258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Getting quotas for user 7f9d206e7c324b939673c68f1b60e193 and project 4baf2ceef8834c2ca9fcc176248d73f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:14.725785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:14.727598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:14.729324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:14.729999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:14.749285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.utils [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] cores quota exceeded for 4baf2ceef8834c2ca9fcc176248d73f9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=124818) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 19 04:36:14.754319 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Request method failure captured: May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 145 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihck5CCudPOzxVlEXybG2IKWBwecRmOZ7q9XPppVLTpM_ehhrj-BkCiafgRAJLxMsVL-319hxpPAwjlvZhC3piaa0Lw814nCcz7wq2fHakzWqZi6Ho8mCQuFsqn8JgH16wS1CqQ9Q0RxcvYYaVaDOyCeZxu-pRbYSEHkm_SfsOEedQWQ May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 4baf2ceef8834c2ca9fcc176248d73f9 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 4baf2ceef8834c2ca9fcc176248d73f9 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-QuotasAdminNegativeTest-1059039960-project May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7f9d206e7c324b939673c68f1b60e193 May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-QuotasAdminNegativeTest-1059039960-project May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1419970903", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1419970903', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452'}}} May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 04:36:14.758288 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 04:36:14.763230 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:14.767477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:14.768641 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-044855cf-c137-46be-8c38-e1a8f7ed360a tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.898395 May 19 04:36:14.773516 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 631/1283] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:36:13 2022] POST /compute/v2.1/servers => generated 111 bytes in 904 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:14.782200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-05d4d2c9-3f5e-409d-9ff9-2196320374f5 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:14.798639 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c HTTP/1.1 May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '54201b4d-c068-43c2-bfe0-ea4714da319c'} May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.803073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:14.810091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:14.810091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:14.810091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:14.810091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:14.810091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. May 19 04:36:14.810091 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:14.811039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-05d4d2c9-3f5e-409d-9ff9-2196320374f5 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:14.811219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Instance 54201b4d-c068-43c2-bfe0-ea4714da319c could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:14.812154 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9fdf19a-6e4f-4231-a51c-6906fe02306a tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c" status: 404 len: 111 microversion: 2.1 time: 0.108249 May 19 04:36:14.814041 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 653/1284] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:14 2022] GET /compute/v2.1/servers/54201b4d-c068-43c2-bfe0-ea4714da319c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:14.825393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-777eb3b8-acb9-480a-b419-a25d2cdc398b tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Action: 'update', calling method: .version_select at 0x7fd315cde0d0>, body: {"quota_set": {"cores": 20}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:14.829302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05d4d2c9-3f5e-409d-9ff9-2196320374f5 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:14.829889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05d4d2c9-3f5e-409d-9ff9-2196320374f5 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:14.831074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05d4d2c9-3f5e-409d-9ff9-2196320374f5 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:14.833264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05d4d2c9-3f5e-409d-9ff9-2196320374f5 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:15.053961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-777eb3b8-acb9-480a-b419-a25d2cdc398b tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:15.054525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-777eb3b8-acb9-480a-b419-a25d2cdc398b tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:15.055574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-777eb3b8-acb9-480a-b419-a25d2cdc398b tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:15.056670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-777eb3b8-acb9-480a-b419-a25d2cdc398b tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:15.190929 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-777eb3b8-acb9-480a-b419-a25d2cdc398b tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 200 len: 329 microversion: 2.1 time: 0.371427 May 19 04:36:15.198044 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 654/1285] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:36:14 2022] PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 329 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:15.207563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21d91881-a050-4b54-9d54-12bb0e4f0b22 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '.version_select at 0x7fd315b9e9d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:15.243233 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-21d91881-a050-4b54-9d54-12bb0e4f0b22 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Image not found. May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21d91881-a050-4b54-9d54-12bb0e4f0b22 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e HTTP/1.1 May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '01b7f287-c39a-4fa0-8b32-aa6af057f18e'} May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 01b7f287-c39a-4fa0-8b32-aa6af057f18e to delete May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 01b7f287-c39a-4fa0-8b32-aa6af057f18e could not be found. May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:15.245384 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:15.250577 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:15.263104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21d91881-a050-4b54-9d54-12bb0e4f0b22 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:15.264163 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21d91881-a050-4b54-9d54-12bb0e4f0b22 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e" status: 404 len: 62 microversion: 2.1 time: 0.065080 May 19 04:36:15.264889 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 655/1286] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:15 2022] DELETE /compute/v2.1/images/01b7f287-c39a-4fa0-8b32-aa6af057f18e => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:15.273916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29df4bcc-b230-419a-8438-d990a2b2400d tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:15.282576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-29df4bcc-b230-419a-8438-d990a2b2400d tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:15.292129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29df4bcc-b230-419a-8438-d990a2b2400d tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:15.292868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29df4bcc-b230-419a-8438-d990a2b2400d tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:15.294015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29df4bcc-b230-419a-8438-d990a2b2400d tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:15.294622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29df4bcc-b230-419a-8438-d990a2b2400d tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:15.302177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-05d4d2c9-3f5e-409d-9ff9-2196320374f5 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:15.314121 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-05d4d2c9-3f5e-409d-9ff9-2196320374f5 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1323 microversion: 2.1 time: 0.539068 May 19 04:36:15.315038 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 632/1287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:14 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1323 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:15.320988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1724914803", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:15.465979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] validate_networks() for [('3c260e33-45cd-46ef-9773-557635955e8f', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:36:16.405571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-29df4bcc-b230-419a-8438-d990a2b2400d tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:16.415847 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29df4bcc-b230-419a-8438-d990a2b2400d tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1349 microversion: 2.1 time: 1.149543 May 19 04:36:16.417226 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 656/1288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:15 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1349 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:16.423143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9d3bb76-63ce-477f-bdce-5767db5f304f tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Calling method '.version_select at 0x7fd315b9ee50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:16.589005 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9d3bb76-63ce-477f-bdce-5767db5f304f tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 200 len: 371 microversion: 2.1 time: 0.169968 May 19 04:36:16.589864 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 657/1289] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 04:36:16 2022] GET /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:16.599029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:16.601052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:16.621124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:16.622978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:16.624419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:16.624869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:16.654483 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 HTTP/1.1 May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '1ae6a03f-375c-4b42-8544-59df1ba8cef5'} May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:16.662017 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:16.666193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:16.669314 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-348420c9-9398-47a7-8f4d-07449e3487ed tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 404 len: 111 microversion: 2.1 time: 0.077633 May 19 04:36:16.669892 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 658/1290] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:16 2022] DELETE /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:16.678212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b8e08e49-0b2e-43c6-a779-9ae54820a9a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:16.678870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b8e08e49-0b2e-43c6-a779-9ae54820a9a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:16.692947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8e08e49-0b2e-43c6-a779-9ae54820a9a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:16.695980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8e08e49-0b2e-43c6-a779-9ae54820a9a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:16.698076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8e08e49-0b2e-43c6-a779-9ae54820a9a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:16.700015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8e08e49-0b2e-43c6-a779-9ae54820a9a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.072561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:36:17.073949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:36:17.074786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:36:17.075376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:36:17.075964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:36:17.101850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:17.105930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.106869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:17.107320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.162792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Getting quotas for project c754f227f43646e7bc6e53e50d93365d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:17.168838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Getting quotas for user e9afd2aff4344e6c8130cfd6b3305b5f and project c754f227f43646e7bc6e53e50d93365d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:17.205214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:36:17.207897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:36:17.268901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b8e08e49-0b2e-43c6-a779-9ae54820a9a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:17.288953 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b8e08e49-0b2e-43c6-a779-9ae54820a9a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 0.614574 May 19 04:36:17.290593 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 659/1291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:16 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:17.305601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6b1f87e2-d427-42ff-98fa-fd4ccaaa97d0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:17.306625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6b1f87e2-d427-42ff-98fa-fd4ccaaa97d0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:17.315375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6b1f87e2-d427-42ff-98fa-fd4ccaaa97d0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:17.315835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6b1f87e2-d427-42ff-98fa-fd4ccaaa97d0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.316624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6b1f87e2-d427-42ff-98fa-fd4ccaaa97d0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:17.317332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6b1f87e2-d427-42ff-98fa-fd4ccaaa97d0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.326449 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-34265c1a-50aa-4908-bf77-d5ef4aea8886 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.010216 May 19 04:36:17.331052 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 633/1292] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:36:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:36:17.335835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-509e7f47-d9fa-49ba-bd3f-a8ebb3ce92c0 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Action: 'update', calling method: .version_select at 0x7fd315dd4b80>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:17.527481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-509e7f47-d9fa-49ba-bd3f-a8ebb3ce92c0 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:17.528478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-509e7f47-d9fa-49ba-bd3f-a8ebb3ce92c0 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.532818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-509e7f47-d9fa-49ba-bd3f-a8ebb3ce92c0 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:17.533673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-509e7f47-d9fa-49ba-bd3f-a8ebb3ce92c0 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.770582 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-509e7f47-d9fa-49ba-bd3f-a8ebb3ce92c0 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 200 len: 328 microversion: 2.1 time: 0.437933 May 19 04:36:17.771731 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 634/1293] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:36:17 2022] PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 328 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:17.792243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:17.794574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] [instance: 1ae6a03f-375c-4b42-8544-59df1ba8cef5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:17.816614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:17.825202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.827046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:17.827640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.878128 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] HTTP exception thrown: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Request method failure captured: May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 HTTP/1.1 May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihche6PQmd0LNUIfh8VQEswAgG8GNpTBa2wonNG80zyZWJ8rQi_mPo8dwZwNhvxSrAt3EJBgOXTfRQePDDju-zRrFEvuU0zAK97b0kkr5yT7TWrPGtCEzRxQdSg774fX-cu6Gucncpt1kPSdWBBl9_W8fnavZJT50_rEC8icXipUpang May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ff2741185bb8440db094f7bc87af8b2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesTestJSON-1938579978 May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ff2741185bb8440db094f7bc87af8b2b May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesTestJSON-1938579978 May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesTestJSON-1938579978-project May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 5b561a0c5d754a12a04e62664e607506 May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesTestJSON-1938579978-project May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '1ae6a03f-375c-4b42-8544-59df1ba8cef5'} May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:17.879989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:17.885123 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:17.885123 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:17.885123 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:17.885123 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:17.885123 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. May 19 04:36:17.885123 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:17.889810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] Returning 404 to user: Instance 1ae6a03f-375c-4b42-8544-59df1ba8cef5 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:17.890849 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b2837e06-a631-4cdb-a055-802adb711623 tempest-ImagesTestJSON-1938579978 tempest-ImagesTestJSON-1938579978-project] 10.222.0.58 "GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5" status: 404 len: 111 microversion: 2.1 time: 0.117073 May 19 04:36:17.892594 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 635/1294] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:17 2022] GET /compute/v2.1/servers/1ae6a03f-375c-4b42-8544-59df1ba8cef5 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:17.906892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c4190b88-1f5f-4346-bb94-e91b1d3c05f7 req-b9120b8a-3e31-4881-8fa0-0015457355e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67d7145-9eba-4a60-9898-fa8bc142ba4b", "tag": "49ff73e4-16fb-448b-820c-0f2c523bc539"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:17.946583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c4190b88-1f5f-4346-bb94-e91b1d3c05f7 req-b9120b8a-3e31-4881-8fa0-0015457355e2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:17.952158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c4190b88-1f5f-4346-bb94-e91b1d3c05f7 req-b9120b8a-3e31-4881-8fa0-0015457355e2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:17.999128 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c4190b88-1f5f-4346-bb94-e91b1d3c05f7 req-b9120b8a-3e31-4881-8fa0-0015457355e2 service nova] Creating event network-changed:49ff73e4-16fb-448b-820c-0f2c523bc539 for instance f67d7145-9eba-4a60-9898-fa8bc142ba4b on n-h2-766726-30 May 19 04:36:18.012177 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c4190b88-1f5f-4346-bb94-e91b1d3c05f7 req-b9120b8a-3e31-4881-8fa0-0015457355e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111346 May 19 04:36:18.013679 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 636/1295] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:18.026294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1402a530-62cb-4149-86a4-9f91321040e6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:18.027307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1402a530-62cb-4149-86a4-9f91321040e6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:18.118298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6b1f87e2-d427-42ff-98fa-fd4ccaaa97d0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:18.145414 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6b1f87e2-d427-42ff-98fa-fd4ccaaa97d0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1518 microversion: 2.1 time: 0.849528 May 19 04:36:18.150389 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 660/1296] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:17 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1518 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:18.201799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62b53595-1538-4aa2-894f-af0227d925c9 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:18.202729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62b53595-1538-4aa2-894f-af0227d925c9 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:18.228956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62b53595-1538-4aa2-894f-af0227d925c9 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:18.231993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62b53595-1538-4aa2-894f-af0227d925c9 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:18.233862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62b53595-1538-4aa2-894f-af0227d925c9 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:18.234484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62b53595-1538-4aa2-894f-af0227d925c9 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:18.329488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1402a530-62cb-4149-86a4-9f91321040e6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:18.351226 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1402a530-62cb-4149-86a4-9f91321040e6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1225 microversion: 2.1 time: 0.325494 May 19 04:36:18.351854 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 637/1297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:18 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1225 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:18.365849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1565756255", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:18.487434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:36:18.963729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:36:18.964570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:36:18.965337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:36:18.966002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:36:18.966643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:36:18.984845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:18.988655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-62b53595-1538-4aa2-894f-af0227d925c9 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:18.993291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:18.998033 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-62b53595-1538-4aa2-894f-af0227d925c9 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1349 microversion: 2.1 time: 0.822741 May 19 04:36:18.999947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:19.002043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:19.007271 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 661/1298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:18 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1349 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:19.015962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ebac7ab-c1e1-4b87-8e1a-3d5965f422c1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Action: 'create', calling method: .version_select at 0x7fd315c7ba60>, body: {"pool": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:19.058155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Getting quotas for project 4baf2ceef8834c2ca9fcc176248d73f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:19.076779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Getting quotas for user 7f9d206e7c324b939673c68f1b60e193 and project 4baf2ceef8834c2ca9fcc176248d73f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:19.098987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.utils [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] instances quota exceeded for 4baf2ceef8834c2ca9fcc176248d73f9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=124818) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 19 04:36:19.099899 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Request method failure captured: May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 145 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihck5CCudPOzxVlEXybG2IKWBwecRmOZ7q9XPppVLTpM_ehhrj-BkCiafgRAJLxMsVL-319hxpPAwjlvZhC3piaa0Lw814nCcz7wq2fHakzWqZi6Ho8mCQuFsqn8JgH16wS1CqQ9Q0RxcvYYaVaDOyCeZxu-pRbYSEHkm_SfsOEedQWQ May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 4baf2ceef8834c2ca9fcc176248d73f9 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 4baf2ceef8834c2ca9fcc176248d73f9 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-QuotasAdminNegativeTest-1059039960-project May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7f9d206e7c324b939673c68f1b60e193 May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-QuotasAdminNegativeTest-1059039960-project May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1565756255", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1565756255', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452'}}} May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 04:36:19.102267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 04:36:19.108141 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:19.114043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:19.118293 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-89ed76b0-fbd5-42ea-bb42-7c18848aa601 tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.762595 May 19 04:36:19.125167 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 638/1299] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:36:18 2022] POST /compute/v2.1/servers => generated 119 bytes in 764 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:19.130960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2500cd6a-cc47-4b75-bab3-f8afe715b427 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:19.131986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2500cd6a-cc47-4b75-bab3-f8afe715b427 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:19.149179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2500cd6a-cc47-4b75-bab3-f8afe715b427 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:19.150577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2500cd6a-cc47-4b75-bab3-f8afe715b427 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:19.151673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2500cd6a-cc47-4b75-bab3-f8afe715b427 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:19.153622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2500cd6a-cc47-4b75-bab3-f8afe715b427 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:20.731316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2500cd6a-cc47-4b75-bab3-f8afe715b427 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:20.754695 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2500cd6a-cc47-4b75-bab3-f8afe715b427 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1549 microversion: 2.1 time: 1.619554 May 19 04:36:20.755416 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 639/1300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:19 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1549 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:20.789442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-87f75adf-ad8f-4ec5-baf3-f428201827a8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Action: 'update', calling method: .version_select at 0x7fd315cf5820>, body: {"quota_set": {"instances": 10}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:21.448018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87f75adf-ad8f-4ec5-baf3-f428201827a8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:21.449502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87f75adf-ad8f-4ec5-baf3-f428201827a8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:21.450642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87f75adf-ad8f-4ec5-baf3-f428201827a8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:21.451534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87f75adf-ad8f-4ec5-baf3-f428201827a8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:21.674189 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-87f75adf-ad8f-4ec5-baf3-f428201827a8 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 200 len: 329 microversion: 2.1 time: 0.912746 May 19 04:36:21.675987 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 640/1301] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:36:20 2022] PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 329 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:21.690402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aed5ad28-3475-46d4-b144-1415db929482 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:21.692251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aed5ad28-3475-46d4-b144-1415db929482 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:21.712883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aed5ad28-3475-46d4-b144-1415db929482 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:21.714671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aed5ad28-3475-46d4-b144-1415db929482 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:21.716725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aed5ad28-3475-46d4-b144-1415db929482 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:21.718608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aed5ad28-3475-46d4-b144-1415db929482 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:22.082917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aed5ad28-3475-46d4-b144-1415db929482 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:22.106304 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aed5ad28-3475-46d4-b144-1415db929482 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1283 microversion: 2.1 time: 0.427904 May 19 04:36:22.116398 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 641/1302] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:21 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1283 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:22.122088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9ffa56e7-1056-42ff-826e-42b159165d57 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:22.134109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9ffa56e7-1056-42ff-826e-42b159165d57 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:22.148524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ffa56e7-1056-42ff-826e-42b159165d57 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:22.149285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ffa56e7-1056-42ff-826e-42b159165d57 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:22.150796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ffa56e7-1056-42ff-826e-42b159165d57 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:22.151424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ffa56e7-1056-42ff-826e-42b159165d57 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:22.770302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9ffa56e7-1056-42ff-826e-42b159165d57 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:22.783999 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9ffa56e7-1056-42ff-826e-42b159165d57 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1349 microversion: 2.1 time: 0.663341 May 19 04:36:22.804042 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 642/1303] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:22 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1349 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:22.819124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-54464b51-e0a7-4233-aa2d-14b2a2a80433 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Calling method '.version_select at 0x7fd315d80f70>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:23.006785 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-54464b51-e0a7-4233-aa2d-14b2a2a80433 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 200 len: 371 microversion: 2.1 time: 0.199796 May 19 04:36:23.013646 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 643/1304] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 04:36:22 2022] GET /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:23.026813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-90bf2438-fd4f-463d-aa38-5ad395f97988 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:23.027628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-90bf2438-fd4f-463d-aa38-5ad395f97988 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:23.048749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90bf2438-fd4f-463d-aa38-5ad395f97988 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:23.049867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90bf2438-fd4f-463d-aa38-5ad395f97988 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:23.053107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90bf2438-fd4f-463d-aa38-5ad395f97988 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:23.060987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90bf2438-fd4f-463d-aa38-5ad395f97988 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:23.520564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-90bf2438-fd4f-463d-aa38-5ad395f97988 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:23.537543 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-90bf2438-fd4f-463d-aa38-5ad395f97988 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1539 microversion: 2.1 time: 0.518781 May 19 04:36:23.549451 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 644/1305] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:23 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1539 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:23.560111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0716bd1c-aa21-4128-bde5-b2fcb3ab1c99 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Action: 'update', calling method: .version_select at 0x7fd315d1a0d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:24.015375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0716bd1c-aa21-4128-bde5-b2fcb3ab1c99 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:24.015880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0716bd1c-aa21-4128-bde5-b2fcb3ab1c99 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:24.016683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0716bd1c-aa21-4128-bde5-b2fcb3ab1c99 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:24.017191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0716bd1c-aa21-4128-bde5-b2fcb3ab1c99 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:24.049318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:24.128688 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0716bd1c-aa21-4128-bde5-b2fcb3ab1c99 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 200 len: 325 microversion: 2.1 time: 0.583930 May 19 04:36:24.129841 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 645/1306] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:36:23 2022] PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 325 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:24.135037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0056414-7ef4-45eb-826e-808d05e8e024 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:24.135902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f0056414-7ef4-45eb-826e-808d05e8e024 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:24.153053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0056414-7ef4-45eb-826e-808d05e8e024 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:24.154979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0056414-7ef4-45eb-826e-808d05e8e024 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:24.160585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0056414-7ef4-45eb-826e-808d05e8e024 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:24.161444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0056414-7ef4-45eb-826e-808d05e8e024 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:24.600354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f0056414-7ef4-45eb-826e-808d05e8e024 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:24.609355 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0056414-7ef4-45eb-826e-808d05e8e024 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1325 microversion: 2.1 time: 0.478257 May 19 04:36:24.610163 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 646/1307] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:24 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:24.623737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea9819ca-c9e3-48a4-b7c7-96cb1250f285 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '.version_select at 0x7fd315d709d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:24.626641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea9819ca-c9e3-48a4-b7c7-96cb1250f285 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:24.627177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea9819ca-c9e3-48a4-b7c7-96cb1250f285 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:24.649382 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ea9819ca-c9e3-48a4-b7c7-96cb1250f285 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2344 microversion: 2.1 time: 0.026684 May 19 04:36:24.650804 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 647/1308] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:36:24 2022] GET /compute/v2.1/os-migrations => generated 2344 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:24.664832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4f46048d-bbd7-4b27-9db7-b75d64348afe tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:24.665682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4f46048d-bbd7-4b27-9db7-b75d64348afe tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:24.673140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f46048d-bbd7-4b27-9db7-b75d64348afe tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:24.673368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f46048d-bbd7-4b27-9db7-b75d64348afe tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:24.674527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f46048d-bbd7-4b27-9db7-b75d64348afe tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:24.675154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f46048d-bbd7-4b27-9db7-b75d64348afe tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:25.074616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4f46048d-bbd7-4b27-9db7-b75d64348afe tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:25.081433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:25.095801 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4f46048d-bbd7-4b27-9db7-b75d64348afe tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1349 microversion: 2.1 time: 0.443499 May 19 04:36:25.098347 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 648/1309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:24 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1349 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:25.114736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-66575ebe-d9be-4877-832b-7b4da8c1ac0a req-4fd11d35-0253-4d8a-93d8-356da2f07458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d7145-9eba-4a60-9898-fa8bc142ba4b", "name": "network-vif-plugged", "status": "completed", "tag": "49ff73e4-16fb-448b-820c-0f2c523bc539"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:25.134175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-66575ebe-d9be-4877-832b-7b4da8c1ac0a req-4fd11d35-0253-4d8a-93d8-356da2f07458 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:25.135119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-66575ebe-d9be-4877-832b-7b4da8c1ac0a req-4fd11d35-0253-4d8a-93d8-356da2f07458 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:25.140386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:25.152930 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-66575ebe-d9be-4877-832b-7b4da8c1ac0a req-4fd11d35-0253-4d8a-93d8-356da2f07458 service nova] Creating event network-vif-plugged:49ff73e4-16fb-448b-820c-0f2c523bc539 for instance f67d7145-9eba-4a60-9898-fa8bc142ba4b on n-h2-766726-30 May 19 04:36:25.160681 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-66575ebe-d9be-4877-832b-7b4da8c1ac0a req-4fd11d35-0253-4d8a-93d8-356da2f07458 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056143 May 19 04:36:25.162076 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 649/1310] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:25.239054 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ebac7ab-c1e1-4b87-8e1a-3d5965f422c1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.230345 May 19 04:36:25.243435 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 662/1311] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:36:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:25.267997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-281758904", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:25.395374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:36:25.437775 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7281d278-bfa7-447c-bcd9-f9efce53c91f tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] 10.222.0.58 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.273402 May 19 04:36:25.439628 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 650/1312] 10.222.0.58 () {58 vars in 1127 bytes} [Thu May 19 04:36:25 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 04:36:25.457508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cc0df7c3-0ebb-45dd-82f8-b2bb99e30615 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:25.458546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cc0df7c3-0ebb-45dd-82f8-b2bb99e30615 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:25.476857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc0df7c3-0ebb-45dd-82f8-b2bb99e30615 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:25.477915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc0df7c3-0ebb-45dd-82f8-b2bb99e30615 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:25.480087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc0df7c3-0ebb-45dd-82f8-b2bb99e30615 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:25.480865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc0df7c3-0ebb-45dd-82f8-b2bb99e30615 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:25.829635 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cc0df7c3-0ebb-45dd-82f8-b2bb99e30615 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1692 microversion: 2.1 time: 0.383440 May 19 04:36:25.831714 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 651/1313] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:25 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1692 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:25.842982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c14b89c-8111-4642-be6b-2a8e00c1789b tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Calling method '.version_select at 0x7fd315d80dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:25.873593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:36:25.874472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:36:25.875147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:36:25.875997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:36:25.876878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:36:25.897495 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9c14b89c-8111-4642-be6b-2a8e00c1789b tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] HTTP exception thrown: Image not found. May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c14b89c-8111-4642-be6b-2a8e00c1789b tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Request method failure captured: May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihclIAxfejlyJgYf56XSa8uANj4ibiimzYS_PnWPOuJxQSzTI6SX7epv6XbuP54aCE7KHmQoVvElbu5HPt3VF5H9C-VNzeRp6k-oieTFCWG9PzdnUnqZTRlkVUGs5V-AsghE8q9INDa-fYDWK7wS1c0LdZ45JAEdWl_Taagj11Xi6tYI May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7dbb35cb0b2e4857a1ccd174113ae878 May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: exception: Image not found. May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '-1'} May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:25.899360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:25.906791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c14b89c-8111-4642-be6b-2a8e00c1789b tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Returning 404 to user: Image not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:25.909509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:25.909509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:25.910736 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c14b89c-8111-4642-be6b-2a8e00c1789b tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] 10.222.0.58 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.068908 May 19 04:36:25.910921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:25.910921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:25.911261 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 652/1314] 10.222.0.58 () {58 vars in 1133 bytes} [Thu May 19 04:36:25 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:25.911422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-209239377", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "3ba5e61a-5d01-4401-a0a2-9128eee8ac26"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:25.927423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Getting quotas for project 4baf2ceef8834c2ca9fcc176248d73f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:25.938227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Getting quotas for user 7f9d206e7c324b939673c68f1b60e193 and project 4baf2ceef8834c2ca9fcc176248d73f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:25.967624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.utils [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] ram quota exceeded for 4baf2ceef8834c2ca9fcc176248d73f9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=124819) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 19 04:36:25.968470 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Request method failure captured: May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 144 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihck5CCudPOzxVlEXybG2IKWBwecRmOZ7q9XPppVLTpM_ehhrj-BkCiafgRAJLxMsVL-319hxpPAwjlvZhC3piaa0Lw814nCcz7wq2fHakzWqZi6Ho8mCQuFsqn8JgH16wS1CqQ9Q0RxcvYYaVaDOyCeZxu-pRbYSEHkm_SfsOEedQWQ May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 4baf2ceef8834c2ca9fcc176248d73f9 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 4baf2ceef8834c2ca9fcc176248d73f9 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-QuotasAdminNegativeTest-1059039960-project May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7f9d206e7c324b939673c68f1b60e193 May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-QuotasAdminNegativeTest-1059039960-project May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-281758904", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-281758904', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452'}}} May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 04:36:25.971921 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:25.976845 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0448c06e-2c34-4c88-b9b7-484a9fc47bab tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.728567 May 19 04:36:25.982358 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 663/1315] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:36:25 2022] POST /compute/v2.1/servers => generated 110 bytes in 733 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:25.984068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc43cc4d-c9ff-4929-8ee0-beafd191cdc6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:25.984777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fc43cc4d-c9ff-4929-8ee0-beafd191cdc6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:25.991592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc43cc4d-c9ff-4929-8ee0-beafd191cdc6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:25.992041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc43cc4d-c9ff-4929-8ee0-beafd191cdc6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:25.992810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc43cc4d-c9ff-4929-8ee0-beafd191cdc6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:25.993270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc43cc4d-c9ff-4929-8ee0-beafd191cdc6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:26.005972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] validate_networks() for [('3ba5e61a-5d01-4401-a0a2-9128eee8ac26', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:36:26.403128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fc43cc4d-c9ff-4929-8ee0-beafd191cdc6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:26.413762 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc43cc4d-c9ff-4929-8ee0-beafd191cdc6 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1325 microversion: 2.1 time: 0.433987 May 19 04:36:26.425128 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 664/1316] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:25 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1325 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:26.431732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8d1c5cd0-e3c6-43fe-b467-e0d81159afb5 req-384fbf00-0624-4f83-b84d-ca71cf97aac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ab76d6-86a9-42fc-a669-dc49332ac3eb", "tag": "9e3e9227-b9b8-49cb-934b-a531e96647b8"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:26.452392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8d1c5cd0-e3c6-43fe-b467-e0d81159afb5 req-384fbf00-0624-4f83-b84d-ca71cf97aac6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:26.453288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8d1c5cd0-e3c6-43fe-b467-e0d81159afb5 req-384fbf00-0624-4f83-b84d-ca71cf97aac6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:26.469351 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8d1c5cd0-e3c6-43fe-b467-e0d81159afb5 req-384fbf00-0624-4f83-b84d-ca71cf97aac6 service nova] Creating event network-changed:9e3e9227-b9b8-49cb-934b-a531e96647b8 for instance 05ab76d6-86a9-42fc-a669-dc49332ac3eb on n-h1-766726-30 May 19 04:36:26.477922 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8d1c5cd0-e3c6-43fe-b467-e0d81159afb5 req-384fbf00-0624-4f83-b84d-ca71cf97aac6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051197 May 19 04:36:26.479552 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 665/1317] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:26.487963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-719823fb-c5c6-435e-987c-7f5fb0daadef tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:26.489142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-719823fb-c5c6-435e-987c-7f5fb0daadef tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:26.499102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-719823fb-c5c6-435e-987c-7f5fb0daadef tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:26.499992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-719823fb-c5c6-435e-987c-7f5fb0daadef tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:26.501462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-719823fb-c5c6-435e-987c-7f5fb0daadef tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:26.502336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-719823fb-c5c6-435e-987c-7f5fb0daadef tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:26.763308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:36:26.765379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:36:26.767277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:36:26.768330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:36:26.769039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:36:26.792975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:26.793383 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-719823fb-c5c6-435e-987c-7f5fb0daadef tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1692 microversion: 2.1 time: 0.312182 May 19 04:36:26.794181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:26.795260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:26.796214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:26.802237 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 666/1318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:26 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1692 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:26.812866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0d41634-b895-4d30-af54-7e6d5b8a9c98 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Calling method '.version_select at 0x7fd315a6d670>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:26.831686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Getting quotas for project f026983989674a98928e2c3645ed1ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:26.840726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Getting quotas for user fcc8b342ef834d308f6503fa0daf66ec and project f026983989674a98928e2c3645ed1ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:26.853217 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b0d41634-b895-4d30-af54-7e6d5b8a9c98 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] HTTP exception thrown: Image not found. May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0d41634-b895-4d30-af54-7e6d5b8a9c98 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Request method failure captured: May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/images/9f7b300f-882b-41ea-ba97-4b7dd8f38f7j HTTP/1.1 May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclIAxfejlyJgYf56XSa8uANj4ibiimzYS_PnWPOuJxQSzTI6SX7epv6XbuP54aCE7KHmQoVvElbu5HPt3VF5H9C-VNzeRp6k-oieTFCWG9PzdnUnqZTRlkVUGs5V-AsghE8q9INDa-fYDWK7wS1c0LdZ45JAEdWl_Taagj11Xi6tYI May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7dbb35cb0b2e4857a1ccd174113ae878 May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '9f7b300f-882b-41ea-ba97-4b7dd8f38f7j'} May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9f7b300f-882b-41ea-ba97-4b7dd8f38f7j to delete May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f7b300f-882b-41ea-ba97-4b7dd8f38f7j could not be found. May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:26.855837 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0d41634-b895-4d30-af54-7e6d5b8a9c98 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:26.861157 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0d41634-b895-4d30-af54-7e6d5b8a9c98 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] 10.222.0.58 "DELETE /compute/v2.1/images/9f7b300f-882b-41ea-ba97-4b7dd8f38f7j" status: 404 len: 62 microversion: 2.1 time: 0.055323 May 19 04:36:26.863652 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 667/1319] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:26 2022] DELETE /compute/v2.1/images/9f7b300f-882b-41ea-ba97-4b7dd8f38f7j => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:26.868612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dd30f6a5-7872-4ac4-b364-d95b744e2948 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Action: 'update', calling method: .version_select at 0x7fd315a6d940>, body: {"quota_set": {"ram": 51200}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:26.869933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:36:26.872972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:36:26.939971 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-98ac3609-6e0a-4245-b3c3-3e031725c9d1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032103 May 19 04:36:26.940895 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 653/1320] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:36:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:36:26.945891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e251fe5-68cd-4115-bb8e-4016a0b04df5 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:26.947242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9e251fe5-68cd-4115-bb8e-4016a0b04df5 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:26.956184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e251fe5-68cd-4115-bb8e-4016a0b04df5 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:26.956869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e251fe5-68cd-4115-bb8e-4016a0b04df5 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:26.957845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e251fe5-68cd-4115-bb8e-4016a0b04df5 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:26.958458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e251fe5-68cd-4115-bb8e-4016a0b04df5 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.078731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd30f6a5-7872-4ac4-b364-d95b744e2948 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.080754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd30f6a5-7872-4ac4-b364-d95b744e2948 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.083492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd30f6a5-7872-4ac4-b364-d95b744e2948 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.083944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd30f6a5-7872-4ac4-b364-d95b744e2948 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.203263 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dd30f6a5-7872-4ac4-b364-d95b744e2948 tempest-QuotasAdminNegativeTest-2046225943 tempest-QuotasAdminNegativeTest-2046225943-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 200 len: 329 microversion: 2.1 time: 0.338417 May 19 04:36:27.210869 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 668/1321] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:36:26 2022] PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 329 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:27.217180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-354edacc-fccb-4b85-93bc-ed64b3ccdc43 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Calling method '.version_select at 0x7fd315a74160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:27.224412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9e251fe5-68cd-4115-bb8e-4016a0b04df5 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:27.234755 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e251fe5-68cd-4115-bb8e-4016a0b04df5 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1539 microversion: 2.1 time: 0.292252 May 19 04:36:27.236344 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 654/1322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:26 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1539 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:27.239498 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-354edacc-fccb-4b85-93bc-ed64b3ccdc43 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] HTTP exception thrown: Image not found. May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-354edacc-fccb-4b85-93bc-ed64b3ccdc43 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Request method failure captured: May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/images/331af913-1649-42dd-8cc0-13ebfe0df1721 HTTP/1.1 May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclIAxfejlyJgYf56XSa8uANj4ibiimzYS_PnWPOuJxQSzTI6SX7epv6XbuP54aCE7KHmQoVvElbu5HPt3VF5H9C-VNzeRp6k-oieTFCWG9PzdnUnqZTRlkVUGs5V-AsghE8q9INDa-fYDWK7wS1c0LdZ45JAEdWl_Taagj11Xi6tYI May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7dbb35cb0b2e4857a1ccd174113ae878 May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '331af913-1649-42dd-8cc0-13ebfe0df1721'} May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 331af913-1649-42dd-8cc0-13ebfe0df1721 to delete May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 331af913-1649-42dd-8cc0-13ebfe0df1721 could not be found. May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.242310 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:27.248847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.253252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-354edacc-fccb-4b85-93bc-ed64b3ccdc43 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:27.254782 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-354edacc-fccb-4b85-93bc-ed64b3ccdc43 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] 10.222.0.58 "DELETE /compute/v2.1/images/331af913-1649-42dd-8cc0-13ebfe0df1721" status: 404 len: 62 microversion: 2.1 time: 0.042490 May 19 04:36:27.255864 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 669/1323] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:27 2022] DELETE /compute/v2.1/images/331af913-1649-42dd-8cc0-13ebfe0df1721 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:27.260212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c502ba99-6cd3-4454-a409-8bd75cb88861 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:27.262885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c502ba99-6cd3-4454-a409-8bd75cb88861 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:27.263809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1378fc6f-252e-40b1-a176-65b78b0178e1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:27.264643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1378fc6f-252e-40b1-a176-65b78b0178e1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:27.279144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c502ba99-6cd3-4454-a409-8bd75cb88861 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.279964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c502ba99-6cd3-4454-a409-8bd75cb88861 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.280989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c502ba99-6cd3-4454-a409-8bd75cb88861 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.281587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c502ba99-6cd3-4454-a409-8bd75cb88861 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.340422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1378fc6f-252e-40b1-a176-65b78b0178e1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:27.349495 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1378fc6f-252e-40b1-a176-65b78b0178e1 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1223 microversion: 2.1 time: 0.092119 May 19 04:36:27.350486 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 670/1324] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:27 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:27.360045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3adce830-2ccd-4bc9-beb5-b594b64f22ae tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Action: 'update', calling method: .version_select at 0x7fd315a74af0>, body: {"quota_set": {"ram": 0}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:27.362909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3adce830-2ccd-4bc9-beb5-b594b64f22ae tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '7f9d206e7c324b939673c68f1b60e193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baf2ceef8834c2ca9fcc176248d73f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3adce830-2ccd-4bc9-beb5-b594b64f22ae tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Request method failure captured: May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 HTTP/1.1 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 25 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihck5CCudPOzxVlEXybG2IKWBwecRmOZ7q9XPppVLTpM_ehhrj-BkCiafgRAJLxMsVL-319hxpPAwjlvZhC3piaa0Lw814nCcz7wq2fHakzWqZi6Ho8mCQuFsqn8JgH16wS1CqQ9Q0RxcvYYaVaDOyCeZxu-pRbYSEHkm_SfsOEedQWQ May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 4baf2ceef8834c2ca9fcc176248d73f9 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4baf2ceef8834c2ca9fcc176248d73f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 4baf2ceef8834c2ca9fcc176248d73f9 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1059039960 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-QuotasAdminNegativeTest-1059039960-project May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7f9d206e7c324b939673c68f1b60e193 May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-QuotasAdminNegativeTest-1059039960-project May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: {"quota_set": {"ram": 0}} May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '4baf2ceef8834c2ca9fcc176248d73f9', 'body': {'quota_set': {'ram': 0}}} May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:36:27.365036 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3adce830-2ccd-4bc9-beb5-b594b64f22ae tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3adce830-2ccd-4bc9-beb5-b594b64f22ae tempest-QuotasAdminNegativeTest-1059039960 tempest-QuotasAdminNegativeTest-1059039960-project] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9" status: 403 len: 116 microversion: 2.1 time: 0.015095 May 19 04:36:27.373762 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 671/1325] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:36:27 2022] PUT /compute/v2.1/os-quota-sets/4baf2ceef8834c2ca9fcc176248d73f9 => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:27.385002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3cc810c9-ab2f-4312-8f35-00668c2e9834 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:27.385466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3cc810c9-ab2f-4312-8f35-00668c2e9834 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:27.395678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cc810c9-ab2f-4312-8f35-00668c2e9834 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.396131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cc810c9-ab2f-4312-8f35-00668c2e9834 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.396914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cc810c9-ab2f-4312-8f35-00668c2e9834 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.397432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cc810c9-ab2f-4312-8f35-00668c2e9834 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.455473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-c502ba99-6cd3-4454-a409-8bd75cb88861 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lazy-loading 'services' on Instance uuid 7f2ae1de-c359-4358-ba9a-a978ce719a40 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:36:27.589601 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3cc810c9-ab2f-4312-8f35-00668c2e9834 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.219366 May 19 04:36:27.590842 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 672/1326] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:36:27 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:27.596356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29e7d381-5869-40c0-8f40-95f62db510c5 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Calling method '.version_select at 0x7fd315bd8dc0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:27.635013 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c502ba99-6cd3-4454-a409-8bd75cb88861 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments/e05601a7-483a-46f1-bbf0-2817b714cdad" status: 202 len: 0 microversion: 2.1 time: 0.396899 May 19 04:36:27.635624 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 655/1327] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 04:36:27 2022] DELETE /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments/e05601a7-483a-46f1-bbf0-2817b714cdad => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:36:27.648248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c26460c2-796f-492c-a811-a564ad3baba8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:27.648966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c26460c2-796f-492c-a811-a564ad3baba8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:27.670507 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-29e7d381-5869-40c0-8f40-95f62db510c5 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] HTTP exception thrown: Image not found. May 19 04:36:27.670823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c26460c2-796f-492c-a811-a564ad3baba8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.671949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c26460c2-796f-492c-a811-a564ad3baba8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29e7d381-5869-40c0-8f40-95f62db510c5 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Request method failure captured: May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/images/tempest-invalid-2075060129 HTTP/1.1 May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclIAxfejlyJgYf56XSa8uANj4ibiimzYS_PnWPOuJxQSzTI6SX7epv6XbuP54aCE7KHmQoVvElbu5HPt3VF5H9C-VNzeRp6k-oieTFCWG9PzdnUnqZTRlkVUGs5V-AsghE8q9INDa-fYDWK7wS1c0LdZ45JAEdWl_Taagj11Xi6tYI May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7dbb35cb0b2e4857a1ccd174113ae878 May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'tempest-invalid-2075060129'} May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2075060129 to delete May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2075060129 could not be found. May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.672906 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:27.678603 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.685103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29e7d381-5869-40c0-8f40-95f62db510c5 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:27.685332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c26460c2-796f-492c-a811-a564ad3baba8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.685332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c26460c2-796f-492c-a811-a564ad3baba8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.685657 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29e7d381-5869-40c0-8f40-95f62db510c5 tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] 10.222.0.58 "DELETE /compute/v2.1/images/tempest-invalid-2075060129" status: 404 len: 62 microversion: 2.1 time: 0.092427 May 19 04:36:27.694954 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 673/1328] 10.222.0.58 () {58 vars in 1205 bytes} [Thu May 19 04:36:27 2022] DELETE /compute/v2.1/images/tempest-invalid-2075060129 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:27.699924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b414a2c-92e3-4aba-891c-c8060e63c199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:27.703770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1b414a2c-92e3-4aba-891c-c8060e63c199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:27.740276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b414a2c-92e3-4aba-891c-c8060e63c199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.740734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b414a2c-92e3-4aba-891c-c8060e63c199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.741556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b414a2c-92e3-4aba-891c-c8060e63c199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:27.741996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b414a2c-92e3-4aba-891c-c8060e63c199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:27.814863 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1b414a2c-92e3-4aba-891c-c8060e63c199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122728 May 19 04:36:27.815981 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 674/1329] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:27 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:27.821186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-408ae699-1c33-453b-88ca-1f7746bc797f tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Calling method '.version_select at 0x7fd315a743a0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:27.857499 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-408ae699-1c33-453b-88ca-1f7746bc797f tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] HTTP exception thrown: Image not found. May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-408ae699-1c33-453b-88ca-1f7746bc797f tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Request method failure captured: May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/images/6d2ae23b-0ab4-4118-b6d6-e3e626240d9c HTTP/1.1 May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclIAxfejlyJgYf56XSa8uANj4ibiimzYS_PnWPOuJxQSzTI6SX7epv6XbuP54aCE7KHmQoVvElbu5HPt3VF5H9C-VNzeRp6k-oieTFCWG9PzdnUnqZTRlkVUGs5V-AsghE8q9INDa-fYDWK7wS1c0LdZ45JAEdWl_Taagj11Xi6tYI May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce24170e6cb5494e995faf85552fcf1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ce24170e6cb5494e995faf85552fcf1a May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339 May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7dbb35cb0b2e4857a1ccd174113ae878 May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1652512339-project May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '6d2ae23b-0ab4-4118-b6d6-e3e626240d9c'} May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6d2ae23b-0ab4-4118-b6d6-e3e626240d9c to delete May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6d2ae23b-0ab4-4118-b6d6-e3e626240d9c could not be found. May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.866867 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-408ae699-1c33-453b-88ca-1f7746bc797f tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-408ae699-1c33-453b-88ca-1f7746bc797f tempest-ImagesDeleteNegativeTestJSON-1652512339 tempest-ImagesDeleteNegativeTestJSON-1652512339-project] 10.222.0.58 "DELETE /compute/v2.1/images/6d2ae23b-0ab4-4118-b6d6-e3e626240d9c" status: 404 len: 62 microversion: 2.1 time: 0.051248 May 19 04:36:27.874072 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 675/1330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:27 2022] DELETE /compute/v2.1/images/6d2ae23b-0ab4-4118-b6d6-e3e626240d9c => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:28.116346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c26460c2-796f-492c-a811-a564ad3baba8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:28.131064 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c26460c2-796f-492c-a811-a564ad3baba8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1325 microversion: 2.1 time: 0.488735 May 19 04:36:28.132156 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 656/1331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:27 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1325 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:28.369103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86cd5381-1a74-4b05-aa08-843bd453b152 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:28.372132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-86cd5381-1a74-4b05-aa08-843bd453b152 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:28.394369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86cd5381-1a74-4b05-aa08-843bd453b152 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:28.401711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86cd5381-1a74-4b05-aa08-843bd453b152 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:28.406464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86cd5381-1a74-4b05-aa08-843bd453b152 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:28.407981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86cd5381-1a74-4b05-aa08-843bd453b152 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:28.486631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-453257134", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "61be5a1b-718f-4838-b8d3-c8b42b1b073f"}], "block_device_mapping_v2": [{"uuid": "61eeebcd-78b6-4888-9512-55e9be2cdbcf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:28.578127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-86cd5381-1a74-4b05-aa08-843bd453b152 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:28.586672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-86cd5381-1a74-4b05-aa08-843bd453b152 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1283 microversion: 2.1 time: 0.224921 May 19 04:36:28.590221 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 676/1332] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:28 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1283 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:28.642734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] validate_networks() for [('61be5a1b-718f-4838-b8d3-c8b42b1b073f', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:36:28.828277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-72b47474-fbda-4170-8ca5-a65354fc21a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:28.829587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72b47474-fbda-4170-8ca5-a65354fc21a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:28.836536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72b47474-fbda-4170-8ca5-a65354fc21a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:28.837615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72b47474-fbda-4170-8ca5-a65354fc21a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:28.838626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72b47474-fbda-4170-8ca5-a65354fc21a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:28.839282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72b47474-fbda-4170-8ca5-a65354fc21a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:28.860912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:28.886534 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-72b47474-fbda-4170-8ca5-a65354fc21a9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055424 May 19 04:36:28.896662 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 677/1333] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:28 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:29.150203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d43d4c8b-7b8d-46e3-a69d-2e0e5132eec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:29.151316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d43d4c8b-7b8d-46e3-a69d-2e0e5132eec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:29.166204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d43d4c8b-7b8d-46e3-a69d-2e0e5132eec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:29.167111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d43d4c8b-7b8d-46e3-a69d-2e0e5132eec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:29.168129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d43d4c8b-7b8d-46e3-a69d-2e0e5132eec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:29.168740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d43d4c8b-7b8d-46e3-a69d-2e0e5132eec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:30.290004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d43d4c8b-7b8d-46e3-a69d-2e0e5132eec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:30.306886 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d43d4c8b-7b8d-46e3-a69d-2e0e5132eec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1325 microversion: 2.1 time: 1.157777 May 19 04:36:30.318063 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 678/1334] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:29 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1325 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:30.326329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ac8f698-a557-4ac3-90bd-07a1a291c231 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:30.328763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ac8f698-a557-4ac3-90bd-07a1a291c231 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:30.347468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ac8f698-a557-4ac3-90bd-07a1a291c231 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:30.354685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ac8f698-a557-4ac3-90bd-07a1a291c231 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:30.365818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ac8f698-a557-4ac3-90bd-07a1a291c231 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:30.367451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ac8f698-a557-4ac3-90bd-07a1a291c231 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:30.581969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:36:30.582502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:36:30.583079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:36:30.583601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:36:30.584106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:36:30.602226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=67 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:30.609602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:30.610549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:30.611696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:30.612357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:30.647208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=19 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:30.663003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5ac8f698-a557-4ac3-90bd-07a1a291c231 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:30.671352 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ac8f698-a557-4ac3-90bd-07a1a291c231 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1281 microversion: 2.1 time: 0.357496 May 19 04:36:30.676807 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 679/1335] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:30 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1281 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:30.691590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4d8e62b-7818-4e53-8937-04388abccbfa tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:30.695701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f4d8e62b-7818-4e53-8937-04388abccbfa tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:30.707995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Getting quotas for project 6d01f77aa473464b8e32d47e9b9d2a98. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:30.722000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d8e62b-7818-4e53-8937-04388abccbfa tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:30.722681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d8e62b-7818-4e53-8937-04388abccbfa tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:30.724554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d8e62b-7818-4e53-8937-04388abccbfa tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:30.729347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Getting quotas for user 249e284f0cfe4ecda820efeb5956701f and project 6d01f77aa473464b8e32d47e9b9d2a98. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:30.730138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d8e62b-7818-4e53-8937-04388abccbfa tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:30.830973 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4d8e62b-7818-4e53-8937-04388abccbfa tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152795 May 19 04:36:30.838297 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 680/1336] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:30 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:30.843152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d5b8647f-052d-4ab7-83ee-c1ed95240e38 req-bae322cc-bcff-4019-a8fa-844af83b8044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67d7145-9eba-4a60-9898-fa8bc142ba4b", "tag": "49ff73e4-16fb-448b-820c-0f2c523bc539"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:30.880459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d5b8647f-052d-4ab7-83ee-c1ed95240e38 req-bae322cc-bcff-4019-a8fa-844af83b8044 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:30.880909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d5b8647f-052d-4ab7-83ee-c1ed95240e38 req-bae322cc-bcff-4019-a8fa-844af83b8044 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:30.913709 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d5b8647f-052d-4ab7-83ee-c1ed95240e38 req-bae322cc-bcff-4019-a8fa-844af83b8044 service nova] Creating event network-changed:49ff73e4-16fb-448b-820c-0f2c523bc539 for instance f67d7145-9eba-4a60-9898-fa8bc142ba4b on n-h2-766726-30 May 19 04:36:30.927955 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d5b8647f-052d-4ab7-83ee-c1ed95240e38 req-bae322cc-bcff-4019-a8fa-844af83b8044 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088311 May 19 04:36:30.929538 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 681/1337] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:31.351778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c8e9f18f-65ad-488e-9121-5790234488dd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:31.352505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c8e9f18f-65ad-488e-9121-5790234488dd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:31.374202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e9f18f-65ad-488e-9121-5790234488dd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:31.387235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e9f18f-65ad-488e-9121-5790234488dd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:31.388262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e9f18f-65ad-488e-9121-5790234488dd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:31.388765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:36:31.389053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e9f18f-65ad-488e-9121-5790234488dd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:31.396251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61eeebcd-78b6-4888-9512-55e9be2cdbcf',volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:36:31.717407 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6a4f79b8-9252-40df-a76e-3a969e614ebf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.234793 May 19 04:36:31.719291 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 657/1338] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3237 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:36:31.726752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-123b4ec7-8d57-4d4c-b603-9f359f932038 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:31.728674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-123b4ec7-8d57-4d4c-b603-9f359f932038 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:31.750436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-123b4ec7-8d57-4d4c-b603-9f359f932038 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:31.751198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-123b4ec7-8d57-4d4c-b603-9f359f932038 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:31.752249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-123b4ec7-8d57-4d4c-b603-9f359f932038 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:31.753689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-123b4ec7-8d57-4d4c-b603-9f359f932038 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:32.530934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c8e9f18f-65ad-488e-9121-5790234488dd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:32.539687 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c8e9f18f-65ad-488e-9121-5790234488dd tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1325 microversion: 2.1 time: 1.216899 May 19 04:36:32.562219 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 682/1339] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:31 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1325 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:32.576739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7354331a-8347-4f14-835c-e0991f6cedd5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:32.577463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7354331a-8347-4f14-835c-e0991f6cedd5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:32.588068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-123b4ec7-8d57-4d4c-b603-9f359f932038 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:32.605416 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-123b4ec7-8d57-4d4c-b603-9f359f932038 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1323 microversion: 2.1 time: 0.876952 May 19 04:36:32.606086 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 658/1340] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:31 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1323 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:32.850974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7354331a-8347-4f14-835c-e0991f6cedd5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:32.862884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=31 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:32.873745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7354331a-8347-4f14-835c-e0991f6cedd5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:32.880209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7354331a-8347-4f14-835c-e0991f6cedd5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:32.881621 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7354331a-8347-4f14-835c-e0991f6cedd5 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1103 microversion: 2.25 time: 0.318324 May 19 04:36:32.885266 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 683/1341] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:32 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1103 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:32.896915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aebca836-2504-4826-a242-df2380c4e75c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:32.904248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aebca836-2504-4826-a242-df2380c4e75c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:32.933755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aebca836-2504-4826-a242-df2380c4e75c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:32.936351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aebca836-2504-4826-a242-df2380c4e75c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:32.939229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aebca836-2504-4826-a242-df2380c4e75c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:32.940884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aebca836-2504-4826-a242-df2380c4e75c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:33.024368 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aebca836-2504-4826-a242-df2380c4e75c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137749 May 19 04:36:33.028272 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 684/1342] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:32 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:33.042473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d11e71b2-780e-4d1a-ab36-8f4794cd3776 req-25720c2d-d598-4210-8828-bdc2c980e63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ab76d6-86a9-42fc-a669-dc49332ac3eb", "name": "network-vif-plugged", "status": "completed", "tag": "9e3e9227-b9b8-49cb-934b-a531e96647b8"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:33.046069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:33.077340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d11e71b2-780e-4d1a-ab36-8f4794cd3776 req-25720c2d-d598-4210-8828-bdc2c980e63f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:33.081891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d11e71b2-780e-4d1a-ab36-8f4794cd3776 req-25720c2d-d598-4210-8828-bdc2c980e63f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:33.131972 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d11e71b2-780e-4d1a-ab36-8f4794cd3776 req-25720c2d-d598-4210-8828-bdc2c980e63f service nova] Creating event network-vif-plugged:9e3e9227-b9b8-49cb-934b-a531e96647b8 for instance 05ab76d6-86a9-42fc-a669-dc49332ac3eb on n-h1-766726-30 May 19 04:36:33.170339 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d11e71b2-780e-4d1a-ab36-8f4794cd3776 req-25720c2d-d598-4210-8828-bdc2c980e63f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131941 May 19 04:36:33.171597 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 685/1343] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:33.179735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-be71a1db-1cc4-41b8-964f-44be85b5af33 req-68595641-d370-4a1e-989a-80398e4bc87f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03dc9c5d-005c-439e-ad75-c68584ab889e", "tag": "7a0ba22f-bad2-4aed-9c67-44a5c5d0f945"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:33.231599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-be71a1db-1cc4-41b8-964f-44be85b5af33 req-68595641-d370-4a1e-989a-80398e4bc87f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:33.234940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-be71a1db-1cc4-41b8-964f-44be85b5af33 req-68595641-d370-4a1e-989a-80398e4bc87f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:33.245537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-450721982", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:33.297753 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-be71a1db-1cc4-41b8-964f-44be85b5af33 req-68595641-d370-4a1e-989a-80398e4bc87f service nova] Creating event network-changed:7a0ba22f-bad2-4aed-9c67-44a5c5d0f945 for instance 03dc9c5d-005c-439e-ad75-c68584ab889e on n-h1-766726-30 May 19 04:36:33.318549 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-be71a1db-1cc4-41b8-964f-44be85b5af33 req-68595641-d370-4a1e-989a-80398e4bc87f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143851 May 19 04:36:33.324033 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 686/1344] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:33.358683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:36:33.561325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2918b9ef-f33d-4df4-9dc4-a068b78028ce tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:33.562963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2918b9ef-f33d-4df4-9dc4-a068b78028ce tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:33.601930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2918b9ef-f33d-4df4-9dc4-a068b78028ce tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:33.620726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2918b9ef-f33d-4df4-9dc4-a068b78028ce tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:33.622788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2918b9ef-f33d-4df4-9dc4-a068b78028ce tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:33.625439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2918b9ef-f33d-4df4-9dc4-a068b78028ce tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:34.254771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:36:34.257585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:36:34.262608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:36:34.264106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:36:34.266258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:36:34.294430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:34.296159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:34.301909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:34.303115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:34.388018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Getting quotas for project 2081dc484df3407c922b4da6e6c3520c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:34.394810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Getting quotas for user 8a6bfd5cc2344dd8b681eb4ee5a848fe and project 2081dc484df3407c922b4da6e6c3520c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:34.417255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:36:34.420314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:36:34.422709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2918b9ef-f33d-4df4-9dc4-a068b78028ce tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:34.432687 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2918b9ef-f33d-4df4-9dc4-a068b78028ce tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1325 microversion: 2.1 time: 0.878228 May 19 04:36:34.433257 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 687/1345] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:33 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1325 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:34.440211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee9d5774-e509-46ec-98d6-f19bfb1f138e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:34.441236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee9d5774-e509-46ec-98d6-f19bfb1f138e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:34.457932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee9d5774-e509-46ec-98d6-f19bfb1f138e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:34.458659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee9d5774-e509-46ec-98d6-f19bfb1f138e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:34.459763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee9d5774-e509-46ec-98d6-f19bfb1f138e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:34.460438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee9d5774-e509-46ec-98d6-f19bfb1f138e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:34.515425 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d6549e6-e613-4f74-b8d4-4512ff1cc1db tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906223 May 19 04:36:34.517804 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 659/1346] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:36:34.534633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:34.535502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:34.547877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:34.548382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:34.549393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:34.550556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:34.680209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:34.721908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:34.725361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:34.729252 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eeceee7e-c8f1-4664-97ab-3938eedb6a25 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1250 microversion: 2.25 time: 0.209005 May 19 04:36:34.732930 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 660/1347] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:34 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1250 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:34.746405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3c1ed664-aeab-4408-a518-ec9b06f8c2c9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:34.747674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3c1ed664-aeab-4408-a518-ec9b06f8c2c9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:34.775794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c1ed664-aeab-4408-a518-ec9b06f8c2c9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:34.776243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c1ed664-aeab-4408-a518-ec9b06f8c2c9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:34.777031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c1ed664-aeab-4408-a518-ec9b06f8c2c9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:34.777503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c1ed664-aeab-4408-a518-ec9b06f8c2c9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:34.887724 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3c1ed664-aeab-4408-a518-ec9b06f8c2c9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145915 May 19 04:36:34.897463 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 661/1348] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:34 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:34.912791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8331dcff-70cf-4bcd-9b68-878fce2cce10 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:34.913773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8331dcff-70cf-4bcd-9b68-878fce2cce10 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:34.936968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ee9d5774-e509-46ec-98d6-f19bfb1f138e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:34.955477 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee9d5774-e509-46ec-98d6-f19bfb1f138e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1323 microversion: 2.1 time: 0.519251 May 19 04:36:34.956186 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 688/1349] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:34 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1323 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:35.020389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8331dcff-70cf-4bcd-9b68-878fce2cce10 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:35.030959 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8331dcff-70cf-4bcd-9b68-878fce2cce10 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1215 microversion: 2.1 time: 0.131577 May 19 04:36:35.032654 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 662/1350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:34 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:35.450569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94dc15a3-ba74-428d-9774-e0084b4700aa tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:35.451222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-94dc15a3-ba74-428d-9774-e0084b4700aa tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:35.466020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94dc15a3-ba74-428d-9774-e0084b4700aa tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:35.466020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94dc15a3-ba74-428d-9774-e0084b4700aa tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:35.467149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94dc15a3-ba74-428d-9774-e0084b4700aa tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:35.467663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94dc15a3-ba74-428d-9774-e0084b4700aa tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:35.514858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-699499939", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:35.599602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:36:35.925524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94dc15a3-ba74-428d-9774-e0084b4700aa tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:35.940987 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94dc15a3-ba74-428d-9774-e0084b4700aa tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1325 microversion: 2.1 time: 0.493822 May 19 04:36:35.942440 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 663/1351] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:35 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1325 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:35.961752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:35.964353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:35.981058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:35.981832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:35.984417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:35.985603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:36.446966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:36:36.448756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:36:36.449543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:36:36.450204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:36:36.451918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:36:36.466374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:36.467538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:36.469058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:36.469776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:36.492593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:36.493570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:36.499510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:36.507439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:36.511666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:36.513117 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a19f3659-97c5-4fd5-917a-b12429835ea9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.567658 May 19 04:36:36.513954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:36:36.517062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:36:36.517434 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 664/1352] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:35 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:36.534272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ccf799a9-1461-4487-8d09-51f39166c05d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:36.541554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ccf799a9-1461-4487-8d09-51f39166c05d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:36.555461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ccf799a9-1461-4487-8d09-51f39166c05d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:36.557327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ccf799a9-1461-4487-8d09-51f39166c05d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:36.559483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ccf799a9-1461-4487-8d09-51f39166c05d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:36.559963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ccf799a9-1461-4487-8d09-51f39166c05d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:36.633963 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ccf799a9-1461-4487-8d09-51f39166c05d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114747 May 19 04:36:36.641926 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 665/1353] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:36 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:36.654669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bed02820-6d70-4a14-95e0-f90393871ec4 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:36.656804 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d852a824-8338-4231-9f6c-0f23123c6323 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383079 May 19 04:36:36.658483 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 689/1354] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:36:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:36:36.663002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bed02820-6d70-4a14-95e0-f90393871ec4 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:36.663273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d2253de-82a7-4c51-9423-bd29c1217d28 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:36.666682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d2253de-82a7-4c51-9423-bd29c1217d28 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:36.678484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bed02820-6d70-4a14-95e0-f90393871ec4 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:36.681436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bed02820-6d70-4a14-95e0-f90393871ec4 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:36.683135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d2253de-82a7-4c51-9423-bd29c1217d28 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:36.683458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d2253de-82a7-4c51-9423-bd29c1217d28 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:36.683724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bed02820-6d70-4a14-95e0-f90393871ec4 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:36.684182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bed02820-6d70-4a14-95e0-f90393871ec4 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:36.687458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d2253de-82a7-4c51-9423-bd29c1217d28 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:36.688761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d2253de-82a7-4c51-9423-bd29c1217d28 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:36.975578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6d2253de-82a7-4c51-9423-bd29c1217d28 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:37.008011 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d2253de-82a7-4c51-9423-bd29c1217d28 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1275 microversion: 2.1 time: 0.348392 May 19 04:36:37.021693 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 690/1355] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:36 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:37.044595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-72c8e176-a0da-4954-adaa-26cfda62c610 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:37.046405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72c8e176-a0da-4954-adaa-26cfda62c610 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:37.189498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bed02820-6d70-4a14-95e0-f90393871ec4 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:37.205809 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bed02820-6d70-4a14-95e0-f90393871ec4 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1323 microversion: 2.1 time: 0.562518 May 19 04:36:37.206414 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 666/1356] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:36 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1323 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:37.215407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fb0e9e91-f408-4ead-8348-94fdc5768633 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:37.215407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fb0e9e91-f408-4ead-8348-94fdc5768633 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:37.228225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb0e9e91-f408-4ead-8348-94fdc5768633 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:37.228752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb0e9e91-f408-4ead-8348-94fdc5768633 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:37.229699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb0e9e91-f408-4ead-8348-94fdc5768633 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:37.230214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb0e9e91-f408-4ead-8348-94fdc5768633 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:37.344085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-72c8e176-a0da-4954-adaa-26cfda62c610 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:37.360294 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-72c8e176-a0da-4954-adaa-26cfda62c610 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1216 microversion: 2.1 time: 0.337079 May 19 04:36:37.378632 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 691/1357] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:37 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1216 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:37.540789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:37.542579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:37.567638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:37.573101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:37.576018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:37.583671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:38.342061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:38.355676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:38.360157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:38.368342 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-969df483-7e33-4e4c-aeba-10d43bca6614 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.834882 May 19 04:36:38.373484 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 692/1358] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:37 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:38.388593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-83129922-e7b3-4b23-8ba3-b90a3c254538 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:38.398891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-83129922-e7b3-4b23-8ba3-b90a3c254538 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:38.417458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83129922-e7b3-4b23-8ba3-b90a3c254538 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:38.423511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83129922-e7b3-4b23-8ba3-b90a3c254538 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:38.425048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83129922-e7b3-4b23-8ba3-b90a3c254538 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:38.426961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83129922-e7b3-4b23-8ba3-b90a3c254538 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:38.498701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fb0e9e91-f408-4ead-8348-94fdc5768633 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:38.516367 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fb0e9e91-f408-4ead-8348-94fdc5768633 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1521 microversion: 2.1 time: 1.304714 May 19 04:36:38.516926 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 667/1359] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:37 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1521 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:38.537150 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-83129922-e7b3-4b23-8ba3-b90a3c254538 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161575 May 19 04:36:38.541472 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 693/1360] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:38 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:38.543604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-759210af-8203-424c-bbe7-b64e8526aa02 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:38.546461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-759210af-8203-424c-bbe7-b64e8526aa02 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:38.548218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-51861ab6-e33c-4bd7-a3a9-58a4a85d528e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:38.548848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-51861ab6-e33c-4bd7-a3a9-58a4a85d528e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:38.568910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51861ab6-e33c-4bd7-a3a9-58a4a85d528e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:38.569393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51861ab6-e33c-4bd7-a3a9-58a4a85d528e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:38.570186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51861ab6-e33c-4bd7-a3a9-58a4a85d528e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:38.570341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759210af-8203-424c-bbe7-b64e8526aa02 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:38.571187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51861ab6-e33c-4bd7-a3a9-58a4a85d528e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:38.574245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759210af-8203-424c-bbe7-b64e8526aa02 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:38.579838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759210af-8203-424c-bbe7-b64e8526aa02 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:38.580532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759210af-8203-424c-bbe7-b64e8526aa02 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:39.114931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-759210af-8203-424c-bbe7-b64e8526aa02 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:39.122989 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-759210af-8203-424c-bbe7-b64e8526aa02 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1315 microversion: 2.1 time: 0.604924 May 19 04:36:39.143435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-51861ab6-e33c-4bd7-a3a9-58a4a85d528e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:39.151698 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-51861ab6-e33c-4bd7-a3a9-58a4a85d528e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1323 microversion: 2.1 time: 0.609045 May 19 04:36:39.152295 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 694/1361] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:38 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1323 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:39.161374 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 668/1362] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:38 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:39.168555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2658322-7327-41be-a135-daa5ddc349e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:39.169104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c2658322-7327-41be-a135-daa5ddc349e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:39.176012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1324c04d-07f0-484b-832e-8619b741b499 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:39.176602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1324c04d-07f0-484b-832e-8619b741b499 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:39.192829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2658322-7327-41be-a135-daa5ddc349e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:39.193295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2658322-7327-41be-a135-daa5ddc349e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:39.194085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2658322-7327-41be-a135-daa5ddc349e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:39.194529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2658322-7327-41be-a135-daa5ddc349e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:39.200857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1324c04d-07f0-484b-832e-8619b741b499 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:39.201344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1324c04d-07f0-484b-832e-8619b741b499 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:39.202134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1324c04d-07f0-484b-832e-8619b741b499 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:39.202584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1324c04d-07f0-484b-832e-8619b741b499 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:39.290763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c2658322-7327-41be-a135-daa5ddc349e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:36:39.389237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:39.476593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:39.487751 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2658322-7327-41be-a135-daa5ddc349e0 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 204 len: 0 microversion: 2.1 time: 0.324739 May 19 04:36:39.488195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 669/1363] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:39 2022] DELETE /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:39.517510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:39.518403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:39.526516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:39.526977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:39.527794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:39.528201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:39.547026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1324c04d-07f0-484b-832e-8619b741b499 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:39.555855 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1324c04d-07f0-484b-832e-8619b741b499 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1274 microversion: 2.1 time: 0.390505 May 19 04:36:39.561240 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 695/1364] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:39 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1274 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:39.579033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64072e0a-0303-4318-9990-8fc6ffac7cd3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:39.579765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64072e0a-0303-4318-9990-8fc6ffac7cd3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:39.594582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64072e0a-0303-4318-9990-8fc6ffac7cd3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:39.596905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64072e0a-0303-4318-9990-8fc6ffac7cd3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:39.598584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64072e0a-0303-4318-9990-8fc6ffac7cd3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:39.600963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64072e0a-0303-4318-9990-8fc6ffac7cd3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.145630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:40.155181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:40.157037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:40.158785 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e13fef25-6c82-40a0-954a-bc9828dacf6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.656831 May 19 04:36:40.171923 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 670/1365] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:39 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:40.177138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f8497984-678c-4f6d-a042-3ab7e076374d req-23617440-c71e-45e4-9c7a-6b4562718574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c69174-954d-4b88-a428-a61230832bf6", "tag": "5ab68c34-992f-4bef-aac5-f50c840ecd54"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:40.190413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-64072e0a-0303-4318-9990-8fc6ffac7cd3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:40.193662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f8497984-678c-4f6d-a042-3ab7e076374d req-23617440-c71e-45e4-9c7a-6b4562718574 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.198802 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64072e0a-0303-4318-9990-8fc6ffac7cd3 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1527 microversion: 2.1 time: 0.635275 May 19 04:36:40.201638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f8497984-678c-4f6d-a042-3ab7e076374d req-23617440-c71e-45e4-9c7a-6b4562718574 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.208607 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 696/1366] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:39 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1527 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:40.214371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-581d1416-5dde-4bc7-8fa0-5fabdced8999 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:40.215422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-581d1416-5dde-4bc7-8fa0-5fabdced8999 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:40.220120 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f8497984-678c-4f6d-a042-3ab7e076374d req-23617440-c71e-45e4-9c7a-6b4562718574 service nova] Creating event network-changed:5ab68c34-992f-4bef-aac5-f50c840ecd54 for instance 31c69174-954d-4b88-a428-a61230832bf6 on n-h1-766726-30 May 19 04:36:40.222548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-581d1416-5dde-4bc7-8fa0-5fabdced8999 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.222869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-581d1416-5dde-4bc7-8fa0-5fabdced8999 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.223891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-581d1416-5dde-4bc7-8fa0-5fabdced8999 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.224482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-581d1416-5dde-4bc7-8fa0-5fabdced8999 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.231747 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f8497984-678c-4f6d-a042-3ab7e076374d req-23617440-c71e-45e4-9c7a-6b4562718574 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056599 May 19 04:36:40.236720 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 671/1367] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:40.247883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3cceda7e-ac83-458b-be1c-17932133983b req-46507053-e0fc-4d24-9da0-e13ad500013d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03dc9c5d-005c-439e-ad75-c68584ab889e", "name": "network-vif-plugged", "status": "completed", "tag": "7a0ba22f-bad2-4aed-9c67-44a5c5d0f945"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:40.260411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3cceda7e-ac83-458b-be1c-17932133983b req-46507053-e0fc-4d24-9da0-e13ad500013d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.261363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3cceda7e-ac83-458b-be1c-17932133983b req-46507053-e0fc-4d24-9da0-e13ad500013d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.265195 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-581d1416-5dde-4bc7-8fa0-5fabdced8999 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055372 May 19 04:36:40.275738 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 697/1368] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:40 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:40.277926 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3cceda7e-ac83-458b-be1c-17932133983b req-46507053-e0fc-4d24-9da0-e13ad500013d service nova] Creating event network-vif-plugged:7a0ba22f-bad2-4aed-9c67-44a5c5d0f945 for instance 03dc9c5d-005c-439e-ad75-c68584ab889e on n-h1-766726-30 May 19 04:36:40.280427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29ceb93c-6fbb-4fc0-a9a6-050cef89518b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:40.281049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-29ceb93c-6fbb-4fc0-a9a6-050cef89518b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:40.284131 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3cceda7e-ac83-458b-be1c-17932133983b req-46507053-e0fc-4d24-9da0-e13ad500013d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045010 May 19 04:36:40.285151 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 672/1369] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:40.292544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ae0c8b9-c882-48df-a01f-8fd22f6291a9 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:40.293692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6ae0c8b9-c882-48df-a01f-8fd22f6291a9 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:40.300313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29ceb93c-6fbb-4fc0-a9a6-050cef89518b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.300771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29ceb93c-6fbb-4fc0-a9a6-050cef89518b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.301304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ae0c8b9-c882-48df-a01f-8fd22f6291a9 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.301581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29ceb93c-6fbb-4fc0-a9a6-050cef89518b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.302028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29ceb93c-6fbb-4fc0-a9a6-050cef89518b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.302507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ae0c8b9-c882-48df-a01f-8fd22f6291a9 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.303488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ae0c8b9-c882-48df-a01f-8fd22f6291a9 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.304360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ae0c8b9-c882-48df-a01f-8fd22f6291a9 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.855500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6ae0c8b9-c882-48df-a01f-8fd22f6291a9 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:40.867187 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ae0c8b9-c882-48df-a01f-8fd22f6291a9 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1323 microversion: 2.1 time: 0.578540 May 19 04:36:40.873966 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 673/1370] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:40 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1323 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:40.882751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-bd177f79-9ac5-4bab-86bc-379fc0ed93c6 req-e63499ab-1079-41fd-8b1c-c5a635e2e8ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61799b1-3689-4c54-bb41-ac10d07bca57", "tag": "7745425f-977a-42db-8a3d-6a421e366558"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:40.900805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bd177f79-9ac5-4bab-86bc-379fc0ed93c6 req-e63499ab-1079-41fd-8b1c-c5a635e2e8ef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.901535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bd177f79-9ac5-4bab-86bc-379fc0ed93c6 req-e63499ab-1079-41fd-8b1c-c5a635e2e8ef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.920377 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-bd177f79-9ac5-4bab-86bc-379fc0ed93c6 req-e63499ab-1079-41fd-8b1c-c5a635e2e8ef service nova] Creating event network-changed:7745425f-977a-42db-8a3d-6a421e366558 for instance a61799b1-3689-4c54-bb41-ac10d07bca57 on n-h2-766726-30 May 19 04:36:40.927257 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-bd177f79-9ac5-4bab-86bc-379fc0ed93c6 req-e63499ab-1079-41fd-8b1c-c5a635e2e8ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051177 May 19 04:36:40.928813 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 674/1371] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:40.932107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-29ceb93c-6fbb-4fc0-a9a6-050cef89518b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:40.936074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:40.940589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5428c959-7252-4e10-af31-d74ee6212abf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:40.942475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5428c959-7252-4e10-af31-d74ee6212abf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:40.949514 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29ceb93c-6fbb-4fc0-a9a6-050cef89518b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1315 microversion: 2.1 time: 0.672637 May 19 04:36:40.952955 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 698/1372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:40 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:40.955051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5428c959-7252-4e10-af31-d74ee6212abf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.955193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5428c959-7252-4e10-af31-d74ee6212abf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:40.955927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5428c959-7252-4e10-af31-d74ee6212abf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:40.956538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5428c959-7252-4e10-af31-d74ee6212abf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:41.178480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:41.179312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:41.193318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:41.194339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:41.195836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:41.196720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:41.349774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5428c959-7252-4e10-af31-d74ee6212abf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:41.375014 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5428c959-7252-4e10-af31-d74ee6212abf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1316 microversion: 2.1 time: 0.444542 May 19 04:36:41.376792 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 675/1373] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:40 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:41.386149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-90e08753-d472-4743-a208-c9b78747e97a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:41.386778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-90e08753-d472-4743-a208-c9b78747e97a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:41.403862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90e08753-d472-4743-a208-c9b78747e97a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:41.408559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90e08753-d472-4743-a208-c9b78747e97a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:41.409494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90e08753-d472-4743-a208-c9b78747e97a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:41.409952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90e08753-d472-4743-a208-c9b78747e97a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:41.711341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:41.721853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:41.723833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:41.726605 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7284d187-0e9e-4ea1-a1a6-9e5b3dcd4a38 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.552665 May 19 04:36:41.731480 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 699/1374] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:41 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:36:41.754495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6b7e286-241b-4068-be77-c45711937ada tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:41.755856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b6b7e286-241b-4068-be77-c45711937ada tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:41.764252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6b7e286-241b-4068-be77-c45711937ada tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:41.765176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6b7e286-241b-4068-be77-c45711937ada tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:41.766310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6b7e286-241b-4068-be77-c45711937ada tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:41.766903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6b7e286-241b-4068-be77-c45711937ada tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:41.807458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6b7e286-241b-4068-be77-c45711937ada tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059267 May 19 04:36:41.809772 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 700/1375] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:41 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:41.892282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b15ff590-d85e-4994-ad69-4a0a9a9ba499 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:41.893825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b15ff590-d85e-4994-ad69-4a0a9a9ba499 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:41.906370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b15ff590-d85e-4994-ad69-4a0a9a9ba499 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:41.907122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b15ff590-d85e-4994-ad69-4a0a9a9ba499 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:41.908168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b15ff590-d85e-4994-ad69-4a0a9a9ba499 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:41.908777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b15ff590-d85e-4994-ad69-4a0a9a9ba499 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:42.100737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-90e08753-d472-4743-a208-c9b78747e97a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9afd2aff4344e6c8130cfd6b3305b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754f227f43646e7bc6e53e50d93365d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:42.114610 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-90e08753-d472-4743-a208-c9b78747e97a tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 200 len: 1527 microversion: 2.1 time: 0.731983 May 19 04:36:42.115849 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 676/1376] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:41 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 1527 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:42.121863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ae1a238-d425-4288-8253-291a3c655795 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:42.123201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8ae1a238-d425-4288-8253-291a3c655795 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:42.132625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ae1a238-d425-4288-8253-291a3c655795 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:42.133652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ae1a238-d425-4288-8253-291a3c655795 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:42.135189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ae1a238-d425-4288-8253-291a3c655795 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:42.135922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ae1a238-d425-4288-8253-291a3c655795 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:42.908214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b15ff590-d85e-4994-ad69-4a0a9a9ba499 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:42.926655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b15ff590-d85e-4994-ad69-4a0a9a9ba499 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1323 microversion: 2.1 time: 1.039566 May 19 04:36:42.930069 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 701/1377] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:41 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1323 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:36:42.950282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b5145349-761e-400f-aa9f-33f068cec92d req-ffc6b631-9177-4126-acf1-36cb1b52b29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ab76d6-86a9-42fc-a669-dc49332ac3eb", "name": "network-vif-deleted", "tag": "9e3e9227-b9b8-49cb-934b-a531e96647b8"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:42.964647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b5145349-761e-400f-aa9f-33f068cec92d req-ffc6b631-9177-4126-acf1-36cb1b52b29e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:42.965267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b5145349-761e-400f-aa9f-33f068cec92d req-ffc6b631-9177-4126-acf1-36cb1b52b29e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.002065 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b5145349-761e-400f-aa9f-33f068cec92d req-ffc6b631-9177-4126-acf1-36cb1b52b29e service nova] Creating event network-vif-deleted:9e3e9227-b9b8-49cb-934b-a531e96647b8 for instance 05ab76d6-86a9-42fc-a669-dc49332ac3eb on n-h1-766726-30 May 19 04:36:43.010211 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b5145349-761e-400f-aa9f-33f068cec92d req-ffc6b631-9177-4126-acf1-36cb1b52b29e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076103 May 19 04:36:43.015083 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 702/1378] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:43.022319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3242d431-2399-4e89-aa3a-6ba99ab83f80 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:43.023075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3242d431-2399-4e89-aa3a-6ba99ab83f80 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:43.034598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3242d431-2399-4e89-aa3a-6ba99ab83f80 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.036150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3242d431-2399-4e89-aa3a-6ba99ab83f80 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.037582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3242d431-2399-4e89-aa3a-6ba99ab83f80 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.038204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3242d431-2399-4e89-aa3a-6ba99ab83f80 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.064196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8ae1a238-d425-4288-8253-291a3c655795 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:43.074197 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ae1a238-d425-4288-8253-291a3c655795 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1315 microversion: 2.1 time: 0.956683 May 19 04:36:43.082977 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 677/1379] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:42 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:43.103931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:43.106311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:43.113296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.113752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.114525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.115450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.593943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3242d431-2399-4e89-aa3a-6ba99ab83f80 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:43.621688 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3242d431-2399-4e89-aa3a-6ba99ab83f80 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1316 microversion: 2.1 time: 0.589851 May 19 04:36:43.626033 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 703/1380] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:43 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:43.638096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-96a8a2f6-1159-4d38-8100-fe5fb7b3b357 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:43.643302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-96a8a2f6-1159-4d38-8100-fe5fb7b3b357 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:43.653913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96a8a2f6-1159-4d38-8100-fe5fb7b3b357 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.654570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96a8a2f6-1159-4d38-8100-fe5fb7b3b357 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.655791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96a8a2f6-1159-4d38-8100-fe5fb7b3b357 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.656058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:43.656630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96a8a2f6-1159-4d38-8100-fe5fb7b3b357 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.670475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:43.671889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:43.676659 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c096b416-1cdf-4645-8e1c-80b816c2217f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.592273 May 19 04:36:43.679390 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 678/1381] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:43 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:43.691562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:43.692606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 05ab76d6-86a9-42fc-a669-dc49332ac3eb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:43.709357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.709948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.711011 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-96a8a2f6-1159-4d38-8100-fe5fb7b3b357 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082889 May 19 04:36:43.711571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.711977 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 704/1382] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:36:43 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:36:43.717126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.734892 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Instance 05ab76d6-86a9-42fc-a669-dc49332ac3eb could not be found. May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb HTTP/1.1 May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 05ab76d6-86a9-42fc-a669-dc49332ac3eb could not be found. May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '05ab76d6-86a9-42fc-a669-dc49332ac3eb'} May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ab76d6-86a9-42fc-a669-dc49332ac3eb could not be found. May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ab76d6-86a9-42fc-a669-dc49332ac3eb could not be found. May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.736805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:43.741984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.741984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.741984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:43.741984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:43.741984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:43.741984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:43.741984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ab76d6-86a9-42fc-a669-dc49332ac3eb could not be found. May 19 04:36:43.741984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.742622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Instance 05ab76d6-86a9-42fc-a669-dc49332ac3eb could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:43.745118 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fadf3f77-3c58-4bd1-9fa3-fcb8b3d98bff tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb" status: 404 len: 111 microversion: 2.1 time: 0.062354 May 19 04:36:43.745118 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 679/1383] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:43 2022] GET /compute/v2.1/servers/05ab76d6-86a9-42fc-a669-dc49332ac3eb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:43.752424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ef0144b8-967a-4452-9570-5d64bd2b7ec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '.version_select at 0x7fd315b4ea60>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:43.777120 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-ef0144b8-967a-4452-9570-5d64bd2b7ec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Image not found. May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ef0144b8-967a-4452-9570-5d64bd2b7ec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/images/eb103ca1-4079-4648-8088-e52e652bdb84 HTTP/1.1 May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'eb103ca1-4079-4648-8088-e52e652bdb84'} May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eb103ca1-4079-4648-8088-e52e652bdb84 to delete May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eb103ca1-4079-4648-8088-e52e652bdb84 could not be found. May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:43.781041 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.787380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ef0144b8-967a-4452-9570-5d64bd2b7ec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:43.789810 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ef0144b8-967a-4452-9570-5d64bd2b7ec8 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/images/eb103ca1-4079-4648-8088-e52e652bdb84" status: 404 len: 62 microversion: 2.1 time: 0.034152 May 19 04:36:43.791910 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 705/1384] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:43 2022] DELETE /compute/v2.1/images/eb103ca1-4079-4648-8088-e52e652bdb84 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:43.798800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:43.799298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:43.814651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.814651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.814651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.814651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.842977 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee HTTP/1.1 May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '21238921-8bdc-42a0-a385-3f9e3dd13bee'} May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:43.844578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:43.849666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:43.854098 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c4256672-3103-44c2-b308-4a199ff2bb86 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 404 len: 111 microversion: 2.1 time: 0.051145 May 19 04:36:43.854742 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 680/1385] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:43 2022] DELETE /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:43.862967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:43.863842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 21238921-8bdc-42a0-a385-3f9e3dd13bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:43.878318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.879249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.880278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.880890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.921152 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee HTTP/1.1 May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '21238921-8bdc-42a0-a385-3f9e3dd13bee'} May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.923847 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:43.928217 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.928217 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:43.928217 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:43.928217 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:43.928217 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:43.928217 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:43.928217 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. May 19 04:36:43.928217 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:43.929988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Instance 21238921-8bdc-42a0-a385-3f9e3dd13bee could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:43.931630 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-41db64d2-88df-4ebf-8fd8-920026f45281 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee" status: 404 len: 111 microversion: 2.1 time: 0.072211 May 19 04:36:43.934736 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 706/1386] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:43 2022] GET /compute/v2.1/servers/21238921-8bdc-42a0-a385-3f9e3dd13bee => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:43.943807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e4660e99-3337-452b-acab-3bb4c9755a36 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '.version_select at 0x7fd315d29d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:43.946514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-26f42597-48e1-46c2-a7d0-b05bd18e5777 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:43.949719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-26f42597-48e1-46c2-a7d0-b05bd18e5777 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:43.957710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26f42597-48e1-46c2-a7d0-b05bd18e5777 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.958219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26f42597-48e1-46c2-a7d0-b05bd18e5777 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.959313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26f42597-48e1-46c2-a7d0-b05bd18e5777 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:43.959760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26f42597-48e1-46c2-a7d0-b05bd18e5777 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:43.994759 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e4660e99-3337-452b-acab-3bb4c9755a36 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492313153" status: 202 len: 0 microversion: 2.1 time: 0.055445 May 19 04:36:43.995728 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 681/1387] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 19 04:36:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492313153 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:36:44.101694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2f22fb9e-954d-4cdb-86d6-87e04ce2cd26 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:44.102305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2f22fb9e-954d-4cdb-86d6-87e04ce2cd26 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:44.118183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f22fb9e-954d-4cdb-86d6-87e04ce2cd26 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:44.119607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f22fb9e-954d-4cdb-86d6-87e04ce2cd26 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:44.122903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f22fb9e-954d-4cdb-86d6-87e04ce2cd26 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:44.124015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f22fb9e-954d-4cdb-86d6-87e04ce2cd26 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:44.360786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:44.403463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-26f42597-48e1-46c2-a7d0-b05bd18e5777 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:44.418146 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-26f42597-48e1-46c2-a7d0-b05bd18e5777 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 200 len: 1518 microversion: 2.1 time: 0.475897 May 19 04:36:44.418846 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 707/1388] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:43 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 1518 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:44.435845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Action: 'action', calling method: .version_select at 0x7fd3187b0ee0>, body: {"addFloatingIp": {"address": "172.25.4.97"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:44.437920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:44.452073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:44.452855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:44.453915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:44.454578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:44.474944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f22fb9e-954d-4cdb-86d6-87e04ce2cd26 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:44.488236 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2f22fb9e-954d-4cdb-86d6-87e04ce2cd26 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1315 microversion: 2.1 time: 0.391136 May 19 04:36:44.489458 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 682/1389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:44 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:36:44.621833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Acquired lock "refresh_cache-6092f529-4e24-4335-9922-76f287b8696d" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:36:44.645807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c52379eb-abbd-4e0a-ac70-3bb66f586c71 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:44.646538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c52379eb-abbd-4e0a-ac70-3bb66f586c71 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:44.661323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c52379eb-abbd-4e0a-ac70-3bb66f586c71 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:44.661323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c52379eb-abbd-4e0a-ac70-3bb66f586c71 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:44.661323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c52379eb-abbd-4e0a-ac70-3bb66f586c71 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:44.661323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c52379eb-abbd-4e0a-ac70-3bb66f586c71 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:45.025868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=13 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:45.531618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c52379eb-abbd-4e0a-ac70-3bb66f586c71 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:45.539713 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c52379eb-abbd-4e0a-ac70-3bb66f586c71 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1316 microversion: 2.1 time: 0.897721 May 19 04:36:45.559917 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 683/1390] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:44 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1316 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:36:45.564957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:45.565607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:45.585199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:45.585653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:45.586771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:45.587582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:46.010877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:46.021449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:46.022990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:46.024136 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39812c67-1bfe-4cff-ba5a-2121eb860b13 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.463088 May 19 04:36:46.024692 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 684/1391] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:45 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:46.121944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5ee62c33-7ec1-4996-9599-12548cd15ff7 req-3435dabe-fc4d-450a-bf07-0fae95d3b480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e626b1ac-a89d-4758-84dd-4367faa06cde", "tag": "47a0a6f7-38c1-49aa-a777-018dbc91cb33"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:46.133165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5ee62c33-7ec1-4996-9599-12548cd15ff7 req-3435dabe-fc4d-450a-bf07-0fae95d3b480 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:46.137399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5ee62c33-7ec1-4996-9599-12548cd15ff7 req-3435dabe-fc4d-450a-bf07-0fae95d3b480 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:46.149690 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5ee62c33-7ec1-4996-9599-12548cd15ff7 req-3435dabe-fc4d-450a-bf07-0fae95d3b480 service nova] Creating event network-changed:47a0a6f7-38c1-49aa-a777-018dbc91cb33 for instance e626b1ac-a89d-4758-84dd-4367faa06cde on n-h1-766726-30 May 19 04:36:46.155937 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5ee62c33-7ec1-4996-9599-12548cd15ff7 req-3435dabe-fc4d-450a-bf07-0fae95d3b480 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127578 May 19 04:36:46.157806 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 685/1392] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:46.167863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d462f1e-539f-490b-b2c8-53a96e0940ac tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:46.170216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d462f1e-539f-490b-b2c8-53a96e0940ac tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:46.179411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d462f1e-539f-490b-b2c8-53a96e0940ac tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:46.180238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d462f1e-539f-490b-b2c8-53a96e0940ac tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:46.186062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d462f1e-539f-490b-b2c8-53a96e0940ac tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:46.186772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d462f1e-539f-490b-b2c8-53a96e0940ac tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:46.455821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0d462f1e-539f-490b-b2c8-53a96e0940ac tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:46.471878 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d462f1e-539f-490b-b2c8-53a96e0940ac tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1315 microversion: 2.1 time: 0.312402 May 19 04:36:46.472474 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 686/1393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:46 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:46.481183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:46.501751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b87308e0-fa2e-4946-9789-c4900b525066 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '.version_select at 0x7fd315c45a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:46.535019 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b87308e0-fa2e-4946-9789-c4900b525066 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Image not found. May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b87308e0-fa2e-4946-9789-c4900b525066 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/images/e2f5ab1b-5adb-4404-9c59-9f5c406d5ae5 HTTP/1.1 May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: exception: Image not found. May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'e2f5ab1b-5adb-4404-9c59-9f5c406d5ae5'} May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e2f5ab1b-5adb-4404-9c59-9f5c406d5ae5 to delete May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e2f5ab1b-5adb-4404-9c59-9f5c406d5ae5 could not be found. May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:46.537594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:36:46.542490 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.544789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b87308e0-fa2e-4946-9789-c4900b525066 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Image not found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:46.546112 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b87308e0-fa2e-4946-9789-c4900b525066 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/images/e2f5ab1b-5adb-4404-9c59-9f5c406d5ae5" status: 404 len: 62 microversion: 2.1 time: 0.067039 May 19 04:36:46.547409 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 687/1394] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:46 2022] DELETE /compute/v2.1/images/e2f5ab1b-5adb-4404-9c59-9f5c406d5ae5 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:46.554964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:46.555531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:46.562608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:46.563054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:46.563837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:46.564268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:46.578606 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 HTTP/1.1 May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0'} May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:46.580165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5da36d9-1336-49cd-992d-ac44f01e7596 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 404 len: 111 microversion: 2.1 time: 0.030479 May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 688/1395] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:46 2022] DELETE /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94da41a8-ad1a-4e1e-9e7e-c97c41d8181b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:46.596390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-94da41a8-ad1a-4e1e-9e7e-c97c41d8181b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:46.598906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94da41a8-ad1a-4e1e-9e7e-c97c41d8181b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:46.599090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94da41a8-ad1a-4e1e-9e7e-c97c41d8181b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:46.601258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94da41a8-ad1a-4e1e-9e7e-c97c41d8181b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:46.601258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94da41a8-ad1a-4e1e-9e7e-c97c41d8181b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:47.265174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94da41a8-ad1a-4e1e-9e7e-c97c41d8181b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:47.274083 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94da41a8-ad1a-4e1e-9e7e-c97c41d8181b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1316 microversion: 2.1 time: 0.686627 May 19 04:36:47.277032 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 689/1396] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:46 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:47.289508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:47.293696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] [instance: 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:47.307873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:47.309695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:47.311320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:47.313118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:47.353628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=9 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:47.358174 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] HTTP exception thrown: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Request method failure captured: May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 HTTP/1.1 May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcjSLiGAIrOo9ig2VHdIHc0cbEzpGhQOTCUa2w7YyyMX_mVIKrTwpnkgpN_N8DGQd0znCJUqvHX2J1ucP7wKFlCCKb3_ZJxkpQK2CjEg0WhFAG33c7nmKVMuVYgV6J8patO1PZXuiDfNS2V04S9BzDI8Feu9dL_4SzRL1f4Wv0Ejfnc May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c754f227f43646e7bc6e53e50d93365d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: c754f227f43646e7bc6e53e50d93365d May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102 May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e9afd2aff4344e6c8130cfd6b3305b5f May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1572065102-project May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0'} May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:47.374578 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] Returning 404 to user: Instance 10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1620f910-bc54-475f-a267-0ddeae89b873 tempest-ImagesOneServerNegativeTestJSON-1572065102 tempest-ImagesOneServerNegativeTestJSON-1572065102-project] 10.222.0.58 "GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0" status: 404 len: 111 microversion: 2.1 time: 0.095494 May 19 04:36:47.378713 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 690/1397] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:47 2022] GET /compute/v2.1/servers/10a044d4-cc9d-4e25-a8b2-c7a8ae5878c0 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:36:47.381490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:47.382356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:47.394588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:47.395284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:47.396254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:47.396851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:47.904739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:47.915245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:47.924634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:47.926000 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4fbd399b-3a13-448e-9ef4-853230bf59c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.548342 May 19 04:36:47.929274 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 691/1398] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:47 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:47.939725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac60802d-bda6-4a38-8f46-acfa951a19dc tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:47.940357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac60802d-bda6-4a38-8f46-acfa951a19dc tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:47.972216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac60802d-bda6-4a38-8f46-acfa951a19dc tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:47.973725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac60802d-bda6-4a38-8f46-acfa951a19dc tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:47.975297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac60802d-bda6-4a38-8f46-acfa951a19dc tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:47.975761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac60802d-bda6-4a38-8f46-acfa951a19dc tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:48.456843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac60802d-bda6-4a38-8f46-acfa951a19dc tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:48.484699 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac60802d-bda6-4a38-8f46-acfa951a19dc tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1315 microversion: 2.1 time: 0.554473 May 19 04:36:48.496402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 692/1399] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:47 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:48.507880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b088ee47-1334-4f30-9a2f-dba9be6ee4ad tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:48.515986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b088ee47-1334-4f30-9a2f-dba9be6ee4ad tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:48.527329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b088ee47-1334-4f30-9a2f-dba9be6ee4ad tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:48.527802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b088ee47-1334-4f30-9a2f-dba9be6ee4ad tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:48.528612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b088ee47-1334-4f30-9a2f-dba9be6ee4ad tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:48.529335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b088ee47-1334-4f30-9a2f-dba9be6ee4ad tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:48.536769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:48.855213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Building network info cache for instance {{(pid=124819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:36:49.193743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b088ee47-1334-4f30-9a2f-dba9be6ee4ad tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:49.208921 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b088ee47-1334-4f30-9a2f-dba9be6ee4ad tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1316 microversion: 2.1 time: 0.710185 May 19 04:36:49.225040 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 693/1400] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:48 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1316 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:49.236643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1aad64db-2afa-45db-9ff4-4c13674ff949 req-b0638cd8-4b3d-45a5-8217-c885166a74c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6092f529-4e24-4335-9922-76f287b8696d", "tag": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:49.263565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1aad64db-2afa-45db-9ff4-4c13674ff949 req-b0638cd8-4b3d-45a5-8217-c885166a74c5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:49.264357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1aad64db-2afa-45db-9ff4-4c13674ff949 req-b0638cd8-4b3d-45a5-8217-c885166a74c5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:49.298736 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1aad64db-2afa-45db-9ff4-4c13674ff949 req-b0638cd8-4b3d-45a5-8217-c885166a74c5 service nova] Creating event network-changed:9cbf4581-2ce2-4cac-9676-5b95af59ddd6 for instance 6092f529-4e24-4335-9922-76f287b8696d on n-h1-766726-30 May 19 04:36:49.315561 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1aad64db-2afa-45db-9ff4-4c13674ff949 req-b0638cd8-4b3d-45a5-8217-c885166a74c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086456 May 19 04:36:49.317677 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 694/1401] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:49.344238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:49.349935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:49.366323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:49.370329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:49.372569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:49.373972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:50.457808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:50.473345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:50.481433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:50.482676 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-776ce2df-ed62-48bc-87bc-49b5dd819d40 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 1.143294 May 19 04:36:50.498174 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 695/1402] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:49 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:50.503270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-529a0005-e066-44e2-bcb6-471fd840618f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:50.505698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-529a0005-e066-44e2-bcb6-471fd840618f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:50.514608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-529a0005-e066-44e2-bcb6-471fd840618f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:50.515705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-529a0005-e066-44e2-bcb6-471fd840618f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:50.518311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-529a0005-e066-44e2-bcb6-471fd840618f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:50.518933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-529a0005-e066-44e2-bcb6-471fd840618f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:51.086681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-529a0005-e066-44e2-bcb6-471fd840618f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:51.096788 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-529a0005-e066-44e2-bcb6-471fd840618f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1315 microversion: 2.1 time: 0.596438 May 19 04:36:51.098332 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 696/1403] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:50 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:51.103871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1063fc5f-5447-4d6a-bad0-4641b6123056 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:51.112857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1063fc5f-5447-4d6a-bad0-4641b6123056 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:51.126310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1063fc5f-5447-4d6a-bad0-4641b6123056 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:51.126858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1063fc5f-5447-4d6a-bad0-4641b6123056 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:51.130849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1063fc5f-5447-4d6a-bad0-4641b6123056 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:51.131471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1063fc5f-5447-4d6a-bad0-4641b6123056 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:51.224163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Updating instance_info_cache with network_info: [{"id": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6", "address": "fa:16:3e:f5:d9:ca", "network": {"id": "3ba5e61a-5d01-4401-a0a2-9128eee8ac26", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-904786534-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f026983989674a98928e2c3645ed1ca3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9cbf4581-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:36:51.252570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Releasing lock "refresh_cache-6092f529-4e24-4335-9922-76f287b8696d" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:36:51.253807 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64629a68-78f0-4198-a371-4f1066f5212a tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "POST /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d/action" status: 202 len: 0 microversion: 2.1 time: 6.822527 May 19 04:36:51.256597 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 708/1404] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:36:44 2022] POST /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d/action => generated 0 bytes in 6826 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 04:36:51.558989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3912df29-bf65-41e6-9c1d-5a8d5aa68db3 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Action: 'create', calling method: .version_select at 0x7fd315b4eb80>, body: {"keypair": {"name": "tempest-keypair-2145039689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESnwq4rapjsaR1oJT0NYs2uDdnsF1zlcbxoJFiGBOpnz/Tt8eRQjpQ61hOHhJHr27dVt3t4AvSoBuefTLOWlQQuECv21l+sCUgv0XflOBH+jOISlwHHVAPJeGPqOfGXAg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:51.594181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3912df29-bf65-41e6-9c1d-5a8d5aa68db3 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:51.606970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3912df29-bf65-41e6-9c1d-5a8d5aa68db3 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for user 1673aa520a4342a0a79b54d954d46dc2 and project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:51.613880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1063fc5f-5447-4d6a-bad0-4641b6123056 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:51.628711 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1063fc5f-5447-4d6a-bad0-4641b6123056 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1316 microversion: 2.1 time: 0.527514 May 19 04:36:51.639424 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 697/1405] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:51 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:51.658332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f11d354d-d06d-4f0d-aa10-83a7cb08c30e req-7454e682-0cb9-4567-a2e1-299d40da0088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c69174-954d-4b88-a428-a61230832bf6", "name": "network-vif-plugged", "status": "completed", "tag": "5ab68c34-992f-4bef-aac5-f50c840ecd54"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:51.661046 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3912df29-bf65-41e6-9c1d-5a8d5aa68db3 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.402822 May 19 04:36:51.661788 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 709/1406] 10.222.0.58 () {62 vars in 1198 bytes} [Thu May 19 04:36:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 405 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 04:36:51.674245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.97"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:51.676214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f11d354d-d06d-4f0d-aa10-83a7cb08c30e req-7454e682-0cb9-4567-a2e1-299d40da0088 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:51.680354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f11d354d-d06d-4f0d-aa10-83a7cb08c30e req-7454e682-0cb9-4567-a2e1-299d40da0088 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:51.682461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:51.705607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:51.708782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:51.711490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:51.713296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:51.715931 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f11d354d-d06d-4f0d-aa10-83a7cb08c30e req-7454e682-0cb9-4567-a2e1-299d40da0088 service nova] Creating event network-vif-plugged:5ab68c34-992f-4bef-aac5-f50c840ecd54 for instance 31c69174-954d-4b88-a428-a61230832bf6 on n-h1-766726-30 May 19 04:36:51.732480 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f11d354d-d06d-4f0d-aa10-83a7cb08c30e req-7454e682-0cb9-4567-a2e1-299d40da0088 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091664 May 19 04:36:51.736360 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 698/1407] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:51.750342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:51.753110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:51.767092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Acquired lock "refresh_cache-03dc9c5d-005c-439e-ad75-c68584ab889e" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:36:51.769513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:51.773817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:51.775022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:51.775690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:52.481984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:52.492910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:52.494649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:52.496036 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eb2d9df0-9298-4462-9750-bd0f9a2a7e8b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.758158 May 19 04:36:52.508403 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 699/1408] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:51 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:52.513963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0bb5548-d8c1-45c9-98e2-cfa51956c988 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315dd43a0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:52.521961 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0bb5548-d8c1-45c9-98e2-cfa51956c988 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-2145039689" status: 200 len: 512 microversion: 2.2 time: 0.011681 May 19 04:36:52.529328 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 700/1409] 10.222.0.58 () {60 vars in 1257 bytes} [Thu May 19 04:36:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2145039689 => generated 512 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:52.534498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b46979e-6456-4b35-b766-bfd563dc7ad6 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:52.535408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b46979e-6456-4b35-b766-bfd563dc7ad6 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:52.543355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b46979e-6456-4b35-b766-bfd563dc7ad6 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:52.544445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b46979e-6456-4b35-b766-bfd563dc7ad6 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:52.545438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b46979e-6456-4b35-b766-bfd563dc7ad6 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:52.545984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b46979e-6456-4b35-b766-bfd563dc7ad6 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:52.767361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2b46979e-6456-4b35-b766-bfd563dc7ad6 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:52.785739 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b46979e-6456-4b35-b766-bfd563dc7ad6 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1315 microversion: 2.1 time: 0.251940 May 19 04:36:52.798154 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 701/1410] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:52 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:52.802890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-05cf0895-0840-405f-9cbb-28f95a71eded tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315c6c8b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:52.856715 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-05cf0895-0840-405f-9cbb-28f95a71eded tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145039689" status: 204 len: 0 microversion: 2.2 time: 0.064413 May 19 04:36:52.859458 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 702/1411] 10.222.0.58 () {60 vars in 1260 bytes} [Thu May 19 04:36:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145039689 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:52.870971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-17a6b686-37e6-4e82-b63f-111b6bac4fe3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:52.873343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-17a6b686-37e6-4e82-b63f-111b6bac4fe3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:52.888879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17a6b686-37e6-4e82-b63f-111b6bac4fe3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:52.889925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17a6b686-37e6-4e82-b63f-111b6bac4fe3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:52.891040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17a6b686-37e6-4e82-b63f-111b6bac4fe3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:52.891839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17a6b686-37e6-4e82-b63f-111b6bac4fe3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:53.191987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-17a6b686-37e6-4e82-b63f-111b6bac4fe3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:53.211773 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-17a6b686-37e6-4e82-b63f-111b6bac4fe3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1316 microversion: 2.1 time: 0.349975 May 19 04:36:53.213285 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 703/1412] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:52 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:53.224030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c832cc12-e00c-41f2-baf5-54e5d9ccaed6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Action: 'create', calling method: .version_select at 0x7fd315c954c0>, body: {"keypair": {"name": "tempest-keypair-455935001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7wGuOb/S1Tn/FKmMif4jrg61I8n7J2bmbKGW8BXKQ5iV4V89s+b2G6beL5We7PUzQ33mnliPupo7JsqOuBL265VYZQEAlDWkfm4jGoyrAoMLnfQWzBnSoW3/PqpcApg=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:53.258317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c832cc12-e00c-41f2-baf5-54e5d9ccaed6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:53.264393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c832cc12-e00c-41f2-baf5-54e5d9ccaed6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for user 1673aa520a4342a0a79b54d954d46dc2 and project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:53.299769 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c832cc12-e00c-41f2-baf5-54e5d9ccaed6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.081082 May 19 04:36:53.301190 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 704/1413] 10.222.0.58 () {62 vars in 1198 bytes} [Thu May 19 04:36:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 04:36:53.319957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3840aeea-b944-46d8-9198-40b431b5ddb2 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315c69160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:53.387324 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3840aeea-b944-46d8-9198-40b431b5ddb2 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455935001" status: 204 len: 0 microversion: 2.2 time: 0.077141 May 19 04:36:53.405551 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 705/1414] 10.222.0.58 () {60 vars in 1257 bytes} [Thu May 19 04:36:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455935001 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:53.436779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f406d234-491b-45ba-b609-49caa40fea64 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Action: 'create', calling method: .version_select at 0x7fd315c45790>, body: {"keypair": {"name": "tempest-keypair-21059599", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:53.511943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f406d234-491b-45ba-b609-49caa40fea64 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:53.530833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f406d234-491b-45ba-b609-49caa40fea64 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for user 1673aa520a4342a0a79b54d954d46dc2 and project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:53.583064 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f406d234-491b-45ba-b609-49caa40fea64 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.175542 May 19 04:36:53.584791 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 706/1415] 10.222.0.58 () {62 vars in 1198 bytes} [Thu May 19 04:36:53 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 04:36:53.831051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:53.832423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:53.837379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:53.845509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:53.846322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:53.847304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:53.847961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:54.057383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:54.066859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:54.075237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:54.076571 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-49493635-a789-4a8f-abad-8035a0d2f089 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.490585 May 19 04:36:54.079545 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 707/1416] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:53 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:54.090131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2d776be-6b6c-4a80-90af-acd39802b7c5 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315cebd30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:54.131058 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2d776be-6b6c-4a80-90af-acd39802b7c5 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-21059599" status: 204 len: 0 microversion: 2.2 time: 0.047878 May 19 04:36:54.141145 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 708/1417] 10.222.0.58 () {60 vars in 1254 bytes} [Thu May 19 04:36:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-21059599 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:54.151615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0ed02b6d-5541-42e3-be34-552e351a1987 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:54.153680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0ed02b6d-5541-42e3-be34-552e351a1987 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:54.166187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ed02b6d-5541-42e3-be34-552e351a1987 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:54.167098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ed02b6d-5541-42e3-be34-552e351a1987 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:54.168529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ed02b6d-5541-42e3-be34-552e351a1987 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:54.169626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ed02b6d-5541-42e3-be34-552e351a1987 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:54.487363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0ed02b6d-5541-42e3-be34-552e351a1987 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:54.496526 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0ed02b6d-5541-42e3-be34-552e351a1987 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1464 microversion: 2.1 time: 0.352544 May 19 04:36:54.504497 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 709/1418] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:54 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1464 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:54.594242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3d28dcc1-0c65-4fe6-8454-1865523616a3 req-8a1023a2-f4b2-4568-a896-ea02c41e1258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e626b1ac-a89d-4758-84dd-4367faa06cde", "name": "network-vif-plugged", "status": "completed", "tag": "47a0a6f7-38c1-49aa-a777-018dbc91cb33"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:54.613918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3d28dcc1-0c65-4fe6-8454-1865523616a3 req-8a1023a2-f4b2-4568-a896-ea02c41e1258 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:54.615726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3d28dcc1-0c65-4fe6-8454-1865523616a3 req-8a1023a2-f4b2-4568-a896-ea02c41e1258 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:54.675379 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3d28dcc1-0c65-4fe6-8454-1865523616a3 req-8a1023a2-f4b2-4568-a896-ea02c41e1258 service nova] Creating event network-vif-plugged:47a0a6f7-38c1-49aa-a777-018dbc91cb33 for instance e626b1ac-a89d-4758-84dd-4367faa06cde on n-h1-766726-30 May 19 04:36:54.687724 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3d28dcc1-0c65-4fe6-8454-1865523616a3 req-8a1023a2-f4b2-4568-a896-ea02c41e1258 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180264 May 19 04:36:54.715937 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 710/1419] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:54.728483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c3dc2a1-883d-45e4-a564-b795383239c6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Action: 'create', calling method: .version_select at 0x7fd315c45b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2000269083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe3LjSICw3oF4+iXf+IebA1DA08MmB/kBozoUVT+QqVTBVRtR/0QHeUtH3StXDLJp9V/aB0mlRznjy9c2Pk23OMQqfUkvyLqOt/ZTXN4KqcImS6blDapTVTFF3onaoqUw=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:54.772670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4c3dc2a1-883d-45e4-a564-b795383239c6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:54.780751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4c3dc2a1-883d-45e4-a564-b795383239c6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for user 1673aa520a4342a0a79b54d954d46dc2 and project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:54.814558 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c3dc2a1-883d-45e4-a564-b795383239c6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.094360 May 19 04:36:54.822215 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 711/1420] 10.222.0.58 () {62 vars in 1198 bytes} [Thu May 19 04:36:54 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 04:36:54.828882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-61f42002-2dc6-4b79-b5eb-7483f23db283 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:54.829679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-61f42002-2dc6-4b79-b5eb-7483f23db283 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:54.836845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f42002-2dc6-4b79-b5eb-7483f23db283 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:54.838230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f42002-2dc6-4b79-b5eb-7483f23db283 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:54.839079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f42002-2dc6-4b79-b5eb-7483f23db283 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:54.839569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f42002-2dc6-4b79-b5eb-7483f23db283 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:55.110478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-61f42002-2dc6-4b79-b5eb-7483f23db283 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:55.119602 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-61f42002-2dc6-4b79-b5eb-7483f23db283 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1316 microversion: 2.1 time: 0.295076 May 19 04:36:55.120958 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 712/1421] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:54 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:55.126467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e964e499-06b4-43fe-af0e-794d3339dad3 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:55.127070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e964e499-06b4-43fe-af0e-794d3339dad3 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:55.133877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e964e499-06b4-43fe-af0e-794d3339dad3 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:55.135073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e964e499-06b4-43fe-af0e-794d3339dad3 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:55.135966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e964e499-06b4-43fe-af0e-794d3339dad3 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:55.136496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e964e499-06b4-43fe-af0e-794d3339dad3 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:55.166544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e964e499-06b4-43fe-af0e-794d3339dad3 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:36:55.339085 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e964e499-06b4-43fe-af0e-794d3339dad3 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "DELETE /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 204 len: 0 microversion: 2.1 time: 0.214639 May 19 04:36:55.340171 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 713/1422] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:36:55 2022] DELETE /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:55.365783 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.network.neutron [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] re-assign floating IP 172.25.4.97 from instance 6092f529-4e24-4335-9922-76f287b8696d May 19 04:36:55.367555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-961517a4-7581-4a1c-88da-063a7987b15e tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Action: 'create', calling method: .version_select at 0x7fd315d29f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-133432430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZSPu8L1aPfYHesA/1ppIEld7QQtpW+VuDTvy3+/VuKtrLDZLbMX4U7p/YgeVLQazjr95i6P2B0FYBsuugy4WyNXNaFNJnrAbXEe3NVjL90K6hE5G3jzQvy/KHJirf/Aw=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:55.384252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-961517a4-7581-4a1c-88da-063a7987b15e tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:55.390463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-961517a4-7581-4a1c-88da-063a7987b15e tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for user 1673aa520a4342a0a79b54d954d46dc2 and project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:55.423060 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-961517a4-7581-4a1c-88da-063a7987b15e tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.077050 May 19 04:36:55.426424 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 714/1423] 10.222.0.58 () {62 vars in 1198 bytes} [Thu May 19 04:36:55 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 04:36:55.434768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:55.441809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:55.454659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:55.455248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:55.456422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:55.456969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:55.483286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Building network info cache for instance {{(pid=124819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:36:55.726762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:55.738637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:55.742288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:55.745763 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5fdd8a4f-543b-4082-a956-80deb0b56f70 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 0.318166 May 19 04:36:55.751465 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 715/1424] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:55 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:55.763980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4226ee9f-e8f3-4d8b-ad40-0743711a4dc0 req-b9d25a6a-88bc-40a0-bdc9-2b970055b6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6092f529-4e24-4335-9922-76f287b8696d", "tag": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:55.787382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4226ee9f-e8f3-4d8b-ad40-0743711a4dc0 req-b9d25a6a-88bc-40a0-bdc9-2b970055b6cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:55.787838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4226ee9f-e8f3-4d8b-ad40-0743711a4dc0 req-b9d25a6a-88bc-40a0-bdc9-2b970055b6cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:55.816637 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4226ee9f-e8f3-4d8b-ad40-0743711a4dc0 req-b9d25a6a-88bc-40a0-bdc9-2b970055b6cb service nova] Creating event network-changed:9cbf4581-2ce2-4cac-9676-5b95af59ddd6 for instance 6092f529-4e24-4335-9922-76f287b8696d on n-h1-766726-30 May 19 04:36:55.824425 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4226ee9f-e8f3-4d8b-ad40-0743711a4dc0 req-b9d25a6a-88bc-40a0-bdc9-2b970055b6cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071676 May 19 04:36:55.825943 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 716/1425] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:55.842936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-17bcb14d-b307-4429-b275-7bd932a4d216 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:55.847489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-17bcb14d-b307-4429-b275-7bd932a4d216 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:55.862047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17bcb14d-b307-4429-b275-7bd932a4d216 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:55.863528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17bcb14d-b307-4429-b275-7bd932a4d216 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:55.870151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17bcb14d-b307-4429-b275-7bd932a4d216 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:55.870730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17bcb14d-b307-4429-b275-7bd932a4d216 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:56.123956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-17bcb14d-b307-4429-b275-7bd932a4d216 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:56.134695 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-17bcb14d-b307-4429-b275-7bd932a4d216 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1470 microversion: 2.1 time: 0.305827 May 19 04:36:56.136789 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 717/1426] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:55 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:56.147825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a19ea201-1af5-47c9-8f38-d34e57d11c42 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Action: 'create', calling method: .version_select at 0x7fd315cebdc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-807164207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSjA2kmsmePACYn3YovDH7sHCHAkvRiAlqWhBnvGz+CboE7IA1BR/Wu+HZ0IxUY/VWv60lWu1ifEDXRkqY9/WJN5Pao3cPPtgvAejr+bBK1yMyIE9Nx039tuFyO0Syc3w=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:56.179671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a19ea201-1af5-47c9-8f38-d34e57d11c42 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:56.196889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a19ea201-1af5-47c9-8f38-d34e57d11c42 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for user 1673aa520a4342a0a79b54d954d46dc2 and project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:56.249610 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a19ea201-1af5-47c9-8f38-d34e57d11c42 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.111344 May 19 04:36:56.256352 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 718/1427] 10.222.0.58 () {62 vars in 1198 bytes} [Thu May 19 04:36:56 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 04:36:56.262176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-24f3e1b5-d77a-44c0-89f3-149cc1f798c9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:56.263106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-24f3e1b5-d77a-44c0-89f3-149cc1f798c9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:56.271832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24f3e1b5-d77a-44c0-89f3-149cc1f798c9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:56.272291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24f3e1b5-d77a-44c0-89f3-149cc1f798c9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:56.273115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24f3e1b5-d77a-44c0-89f3-149cc1f798c9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:56.273788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24f3e1b5-d77a-44c0-89f3-149cc1f798c9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:56.490033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Updating instance_info_cache with network_info: [{"id": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6", "address": "fa:16:3e:f5:d9:ca", "network": {"id": "3ba5e61a-5d01-4401-a0a2-9128eee8ac26", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-904786534-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f026983989674a98928e2c3645ed1ca3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9cbf4581-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:36:56.511557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Building network info cache for instance {{(pid=124819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:36:56.516967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-24f3e1b5-d77a-44c0-89f3-149cc1f798c9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:56.520672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:56.528744 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-24f3e1b5-d77a-44c0-89f3-149cc1f798c9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1316 microversion: 2.1 time: 0.271257 May 19 04:36:56.533222 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 719/1428] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:56 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:56.543664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-91f6ba88-2b05-4748-8daf-a0254857939f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315d808b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:56.551756 n-d-766726-30 devstack@n-api.service[124818]: WARNING oslo_db.sqlalchemy.utils [None req-91f6ba88-2b05-4748-8daf-a0254857939f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 04:36:56.570744 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-91f6ba88-2b05-4748-8daf-a0254857939f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.030498 May 19 04:36:56.573304 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 720/1429] 10.222.0.58 () {60 vars in 1176 bytes} [Thu May 19 04:36:56 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:56.584690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8c55499a-e29d-40ac-88f0-89c78b43d8f0 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315ceb820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:56.630903 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8c55499a-e29d-40ac-88f0-89c78b43d8f0 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-807164207" status: 204 len: 0 microversion: 2.2 time: 0.051265 May 19 04:36:56.632037 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 721/1430] 10.222.0.58 () {60 vars in 1317 bytes} [Thu May 19 04:36:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-807164207 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:56.640516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-777dc757-f6ec-4bca-ba9a-baca893a96c6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315c031f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:56.690368 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-777dc757-f6ec-4bca-ba9a-baca893a96c6 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-133432430" status: 204 len: 0 microversion: 2.2 time: 0.053423 May 19 04:36:56.691430 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 722/1431] 10.222.0.58 () {60 vars in 1317 bytes} [Thu May 19 04:36:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-133432430 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:36:56.702092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e1b1e270-a2f0-43fb-a2f1-19a6553396ac tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315bb18b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:56.734536 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e1b1e270-a2f0-43fb-a2f1-19a6553396ac tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2000269083" status: 204 len: 0 microversion: 2.2 time: 0.037089 May 19 04:36:56.736044 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 723/1432] 10.222.0.58 () {60 vars in 1320 bytes} [Thu May 19 04:36:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2000269083 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:36:56.753039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-44346e3c-2da6-41d1-a5dd-0af0e57e1e96 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Action: 'create', calling method: .version_select at 0x7fd315d800d0>, body: {"keypair": {"name": "tempest-keypair-421252634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC9HJdvHFnVcA1Lx9CeT09306Q6oyquV9mXj3ldHeuqZpdqFrSup4NFSuhz/qRV0Km1Gj0GsvYpBcN6zTsa/HvQVbF8yWdz+UiaNHEeLljwt7THS8USJL3py3B1loLNVQ=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:56.781231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-44346e3c-2da6-41d1-a5dd-0af0e57e1e96 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:56.791861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-44346e3c-2da6-41d1-a5dd-0af0e57e1e96 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for user 1673aa520a4342a0a79b54d954d46dc2 and project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:56.865896 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-44346e3c-2da6-41d1-a5dd-0af0e57e1e96 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.118296 May 19 04:36:56.867600 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 724/1433] 10.222.0.58 () {62 vars in 1198 bytes} [Thu May 19 04:36:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 04:36:56.878653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:56.879602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:56.900560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:56.902851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:56.907193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:56.907958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:57.936882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:57.965696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:57.971146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:57.973830 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c61939b-a814-47f3-8c63-9aeb29a10708 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1292 microversion: 2.25 time: 1.103933 May 19 04:36:57.975216 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 725/1434] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:56 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1292 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:36:57.992813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bb8656f4-decd-475e-bed1-b24fe96c6223 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315c03a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:58.003231 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bb8656f4-decd-475e-bed1-b24fe96c6223 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-421252634" status: 200 len: 512 microversion: 2.2 time: 0.014616 May 19 04:36:58.003792 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 726/1435] 10.222.0.58 () {60 vars in 1254 bytes} [Thu May 19 04:36:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-421252634 => generated 512 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:58.008703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-22d06b1e-7982-423c-bf22-45f131c93cb8 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:58.009794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-22d06b1e-7982-423c-bf22-45f131c93cb8 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:58.017521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22d06b1e-7982-423c-bf22-45f131c93cb8 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:58.018350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22d06b1e-7982-423c-bf22-45f131c93cb8 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:58.019343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22d06b1e-7982-423c-bf22-45f131c93cb8 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:58.019795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22d06b1e-7982-423c-bf22-45f131c93cb8 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:58.458906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22d06b1e-7982-423c-bf22-45f131c93cb8 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6bfd5cc2344dd8b681eb4ee5a848fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2081dc484df3407c922b4da6e6c3520c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:58.475737 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-22d06b1e-7982-423c-bf22-45f131c93cb8 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 200 len: 1470 microversion: 2.1 time: 0.470494 May 19 04:36:58.476135 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 727/1436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:58 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 1470 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:58.480692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eed255dd-43ce-4106-8d77-119b3a2739a2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:58.481336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eed255dd-43ce-4106-8d77-119b3a2739a2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:58.496846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eed255dd-43ce-4106-8d77-119b3a2739a2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:58.497541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eed255dd-43ce-4106-8d77-119b3a2739a2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:58.498991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eed255dd-43ce-4106-8d77-119b3a2739a2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:58.498991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eed255dd-43ce-4106-8d77-119b3a2739a2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:58.695022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Updating instance_info_cache with network_info: [{"id": "7a0ba22f-bad2-4aed-9c67-44a5c5d0f945", "address": "fa:16:3e:8a:36:2a", "network": {"id": "3ba5e61a-5d01-4401-a0a2-9128eee8ac26", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-904786534-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f026983989674a98928e2c3645ed1ca3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7a0ba22f-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:36:58.711356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Releasing lock "refresh_cache-03dc9c5d-005c-439e-ad75-c68584ab889e" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:36:58.712299 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f0d1f60-7c57-4055-b4f0-fbf4b32d71b0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "POST /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e/action" status: 202 len: 0 microversion: 2.1 time: 7.042009 May 19 04:36:58.712900 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 710/1437] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:36:51 2022] POST /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e/action => generated 0 bytes in 7051 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 04:36:58.724457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-cd568e2b-3866-49f0-a42d-57f28bb78abf req-4930b289-d9f2-402b-a052-6f2574706c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03dc9c5d-005c-439e-ad75-c68584ab889e", "tag": "7a0ba22f-bad2-4aed-9c67-44a5c5d0f945"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:58.756766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cd568e2b-3866-49f0-a42d-57f28bb78abf req-4930b289-d9f2-402b-a052-6f2574706c68 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:58.757538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cd568e2b-3866-49f0-a42d-57f28bb78abf req-4930b289-d9f2-402b-a052-6f2574706c68 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:58.779191 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cd568e2b-3866-49f0-a42d-57f28bb78abf req-4930b289-d9f2-402b-a052-6f2574706c68 service nova] Creating event network-changed:7a0ba22f-bad2-4aed-9c67-44a5c5d0f945 for instance 03dc9c5d-005c-439e-ad75-c68584ab889e on n-h1-766726-30 May 19 04:36:58.794439 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-cd568e2b-3866-49f0-a42d-57f28bb78abf req-4930b289-d9f2-402b-a052-6f2574706c68 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079408 May 19 04:36:58.795403 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 711/1438] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:58.813197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9c7349e0-9eb1-4146-9112-11dadabfb9d4 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315a9e4c0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:58.816275 n-d-766726-30 devstack@n-api.service[124819]: WARNING oslo_db.sqlalchemy.utils [None req-9c7349e0-9eb1-4146-9112-11dadabfb9d4 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 04:36:58.826256 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9c7349e0-9eb1-4146-9112-11dadabfb9d4 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.028954 May 19 04:36:58.828030 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 712/1439] 10.222.0.58 () {60 vars in 1176 bytes} [Thu May 19 04:36:58 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:36:58.833062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eed255dd-43ce-4106-8d77-119b3a2739a2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:36:58.837608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Action: 'action', calling method: .version_select at 0x7fd3187b0f70>, body: {"removeFloatingIp": {"address": "172.25.4.97"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:58.851806 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eed255dd-43ce-4106-8d77-119b3a2739a2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1466 microversion: 2.1 time: 0.374587 May 19 04:36:58.852404 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 728/1440] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:58 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1466 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:58.857274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-272de816-c618-4ec1-b161-2262771fe153 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315bb1280>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:58.883524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:36:58.900659 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-272de816-c618-4ec1-b161-2262771fe153 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-421252634" status: 204 len: 0 microversion: 2.2 time: 0.047072 May 19 04:36:58.901641 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 729/1441] 10.222.0.58 () {60 vars in 1257 bytes} [Thu May 19 04:36:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-421252634 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:36:59.141416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:59.149626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:59.150348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:59.154347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:59.155287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c093f406-8052-4c25-8659-c621f93c3187 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:59.156339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:59.156469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c093f406-8052-4c25-8659-c621f93c3187 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:59.174494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c093f406-8052-4c25-8659-c621f93c3187 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:59.174954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c093f406-8052-4c25-8659-c621f93c3187 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:59.184130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c093f406-8052-4c25-8659-c621f93c3187 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:59.185060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c093f406-8052-4c25-8659-c621f93c3187 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:59.543859 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] HTTP exception thrown: Floating IP 172.25.4.97 is not associated with instance 6092f529-4e24-4335-9922-76f287b8696d. May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Request method failure captured: May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d/action HTTP/1.1 May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 48 May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckiozPnzad17kci62WX8A1wpedpuOE0KUOaIigEz3qpSBagT2PGX80kbyK8ntkdv7hxdlXS81l-bXYMFXVm-c3N3ycoa-fS4cVFmEwpZhnxqqqFOXCMcVbUJCDH4IFDA-B8mPjFeaDkAFbfxas7NAiPfDdjeJ5KPWUuEN-gH4e7ZeY May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: f026983989674a98928e2c3645ed1ca3 May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f026983989674a98928e2c3645ed1ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: f026983989674a98928e2c3645ed1ca3 May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FloatingIPsAssociationTestJSON-2096527797-project May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: fcc8b342ef834d308f6503fa0daf66ec May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2096527797-project May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: {"removeFloatingIp": {"address": "172.25.4.97"}} May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: exception: Floating IP 172.25.4.97 is not associated with instance 6092f529-4e24-4335-9922-76f287b8696d. May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '6092f529-4e24-4335-9922-76f287b8696d', 'body': {'removeFloatingIp': {'address': '172.25.4.97'}}} May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.97 is not associated with instance 6092f529-4e24-4335-9922-76f287b8696d. May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.97 is not associated with instance 6092f529-4e24-4335-9922-76f287b8696d. May 19 04:36:59.547094 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:36:59.554763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Returning 409 to user: Floating IP 172.25.4.97 is not associated with instance 6092f529-4e24-4335-9922-76f287b8696d. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:36:59.557714 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c771f17-a7ea-40f7-85d9-b21e9f8e04b3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "POST /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d/action" status: 409 len: 145 microversion: 2.1 time: 0.726663 May 19 04:36:59.559050 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 713/1442] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:36:58 2022] POST /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d/action => generated 145 bytes in 730 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:36:59.569974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Action: 'create', calling method: .version_select at 0x7fd315a9eb80>, body: {"keypair": {"name": "tempest-keypair-1505128905", "type": "x509"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:36:59.590035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:36:59.596130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for user 1673aa520a4342a0a79b54d954d46dc2 and project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:36:59.621514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.processutils [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmplv3vsj8q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmplv3vsj8q/temp.key -subj /CN=1673aa520a4342a0a79b54d954d46dc2 -extensions v3_req_client {{(pid=124819) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 19 04:36:59.746246 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c093f406-8052-4c25-8659-c621f93c3187 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1619 microversion: 2.1 time: 0.843208 May 19 04:36:59.748184 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 730/1443] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:36:58 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1619 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:36:59.755006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:36:59.755853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:36:59.763038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:59.763748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:36:59.764796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:36:59.765516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:00.019738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:00.029794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:00.033208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:00.039149 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-03006eb8-43f1-489e-b6af-ff1695deaa1c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1280 microversion: 2.25 time: 0.288270 May 19 04:37:00.041965 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 731/1444] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:36:59 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1280 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:00.047532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:00.048095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:00.055309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:00.055818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:00.056885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:00.057552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:00.074680 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] HTTP exception thrown: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Request method failure captured: May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 HTTP/1.1 May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihclPUYFoDAqYUWOP-kdtRbnr_07_I4vTdFaMyzCE8AnNJgKtOll_tnMhWg98q2GR-yeENxD_KjPTcKOdzkoE3aIHm66S7fjgQUQl-740dzOZOelfn4dJcUNI9s5oeNCa6kZVuPsSUM68Z87RWCZJjCu6uvcLhabpZOCvzYUET08Cwaw May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 8a6bfd5cc2344dd8b681eb4ee5a848fe May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '31c69174-954d-4b88-a428-a61230832bf6'} May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:00.077335 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:00.081755 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.081755 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:00.081755 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:00.081755 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:00.081755 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:00.081755 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.081755 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:00.083601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Returning 404 to user: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:00.084996 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0ca71015-62ff-45e6-bbf9-c0676dc4e16b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 404 len: 111 microversion: 2.1 time: 0.041993 May 19 04:37:00.086325 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 732/1445] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:00 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:00.092396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Action: 'action', calling method: .version_select at 0x7fd3187b0f70>, body: {"removeFloatingIp": {"address": "172.25.4.97"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:00.249489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.processutils [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmplv3vsj8q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmplv3vsj8q/temp.key -subj /CN=1673aa520a4342a0a79b54d954d46dc2 -extensions v3_req_client" returned: 0 in 0.627s {{(pid=124819) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 19 04:37:00.251627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.processutils [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmplv3vsj8q/temp.key -password pass: {{(pid=124819) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 19 04:37:00.311061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.processutils [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] CMD "openssl pkcs12 -export -inkey /tmp/tmplv3vsj8q/temp.key -password pass:" returned: 0 in 0.059s {{(pid=124819) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 19 04:37:00.334378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:00.342590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:00.343510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:00.344505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:00.345428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:00.387950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:00.402773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Getting quotas for user 1673aa520a4342a0a79b54d954d46dc2 and project 39b021eca88745abb13f440cc8476a65. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:00.406960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:00.423464 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b61cb8f-3e04-4c88-9664-3502117b1c2f tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.862981 May 19 04:37:00.425105 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 714/1446] 10.222.0.58 () {62 vars in 1197 bytes} [Thu May 19 04:36:59 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 865 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 19 04:37:00.433890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-43757d7b-9d9e-41df-8b08-5d3a40338a85 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Action: 'create', calling method: .version_select at 0x7fd315a17ee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-967235423", "policies": ["affinity"]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:00.453401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-43757d7b-9d9e-41df-8b08-5d3a40338a85 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:00.459052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-43757d7b-9d9e-41df-8b08-5d3a40338a85 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:00.525598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-43757d7b-9d9e-41df-8b08-5d3a40338a85 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:00.534187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-43757d7b-9d9e-41df-8b08-5d3a40338a85 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:00.551526 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-43757d7b-9d9e-41df-8b08-5d3a40338a85 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.123994 May 19 04:37:00.552660 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 715/1447] 10.222.0.58 () {60 vars in 1173 bytes} [Thu May 19 04:37:00 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:00.567787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-263891893", "metadata": {"image_type": "test"}}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:00.569222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:00.590557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:00.591025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:00.591885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:00.592327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:00.631638 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] HTTP exception thrown: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Request method failure captured: May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6/action HTTP/1.1 May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 111 May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclPUYFoDAqYUWOP-kdtRbnr_07_I4vTdFaMyzCE8AnNJgKtOll_tnMhWg98q2GR-yeENxD_KjPTcKOdzkoE3aIHm66S7fjgQUQl-740dzOZOelfn4dJcUNI9s5oeNCa6kZVuPsSUM68Z87RWCZJjCu6uvcLhabpZOCvzYUET08Cwaw May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 8a6bfd5cc2344dd8b681eb4ee5a848fe May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-263891893", "metadata": {"image_type": "test"}}} May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '31c69174-954d-4b88-a428-a61230832bf6', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-263891893', 'metadata': {'image_type': 'test'}}}} May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 04:37:00.633442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Returning 404 to user: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-75ee8177-adb1-43a3-8e4f-36e06e8a795b tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "POST /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6/action" status: 404 len: 111 microversion: 2.1 time: 0.078815 May 19 04:37:00.638506 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 716/1448] 10.222.0.58 () {60 vars in 1278 bytes} [Thu May 19 04:37:00 2022] POST /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:00.640393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-584032f9-172c-4997-b80c-a2c45adbb07d tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd3159c2c10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:00.657967 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-584032f9-172c-4997-b80c-a2c45adbb07d tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1505128905" status: 200 len: 1534 microversion: 2.2 time: 0.021211 May 19 04:37:00.661162 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 717/1449] 10.222.0.58 () {60 vars in 1257 bytes} [Thu May 19 04:37:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1505128905 => generated 1534 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:00.668707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-334bcbae-919c-4e4e-94ef-921f7600c748 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1763683015", "metadata": {"image_type": "test"}}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:00.672042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-334bcbae-919c-4e4e-94ef-921f7600c748 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Failed to fetch instance by id tempest-invalid-1833232880 {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 04:37:00.675119 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-334bcbae-919c-4e4e-94ef-921f7600c748 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] HTTP exception thrown: Instance tempest-invalid-1833232880 could not be found. May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-334bcbae-919c-4e4e-94ef-921f7600c748 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Request method failure captured: May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/tempest-invalid-1833232880/action HTTP/1.1 May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 112 May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclPUYFoDAqYUWOP-kdtRbnr_07_I4vTdFaMyzCE8AnNJgKtOll_tnMhWg98q2GR-yeENxD_KjPTcKOdzkoE3aIHm66S7fjgQUQl-740dzOZOelfn4dJcUNI9s5oeNCa6kZVuPsSUM68Z87RWCZJjCu6uvcLhabpZOCvzYUET08Cwaw May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 8a6bfd5cc2344dd8b681eb4ee5a848fe May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1763683015", "metadata": {"image_type": "test"}}} May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance tempest-invalid-1833232880 could not be found. May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'tempest-invalid-1833232880', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1763683015', 'metadata': {'image_type': 'test'}}}} May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1833232880 could not be found. May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:00.676769 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1833232880 could not be found. May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1833232880 could not be found. May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-334bcbae-919c-4e4e-94ef-921f7600c748 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Returning 404 to user: Instance tempest-invalid-1833232880 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-334bcbae-919c-4e4e-94ef-921f7600c748 tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "POST /compute/v2.1/servers/tempest-invalid-1833232880/action" status: 404 len: 101 microversion: 2.1 time: 0.015882 May 19 04:37:00.680929 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 718/1450] 10.222.0.58 () {60 vars in 1248 bytes} [Thu May 19 04:37:00 2022] POST /compute/v2.1/servers/tempest-invalid-1833232880/action => generated 101 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:00.690272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8b745b05-1a6e-44fb-9659-7cf732c53fd2 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd315a74d30>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:00.693089 n-d-766726-30 devstack@n-api.service[124819]: WARNING oslo_db.sqlalchemy.utils [None req-8b745b05-1a6e-44fb-9659-7cf732c53fd2 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 04:37:00.704743 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8b745b05-1a6e-44fb-9659-7cf732c53fd2 tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.022657 May 19 04:37:00.715805 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 719/1451] 10.222.0.58 () {60 vars in 1176 bytes} [Thu May 19 04:37:00 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:00.721180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-667318e4-f7bc-4e0a-858a-993488f0a35a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-580422175"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:00.722188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-667318e4-f7bc-4e0a-858a-993488f0a35a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 04:37:00.722689 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-667318e4-f7bc-4e0a-858a-993488f0a35a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-667318e4-f7bc-4e0a-858a-993488f0a35a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Request method failure captured: May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 56 May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclPUYFoDAqYUWOP-kdtRbnr_07_I4vTdFaMyzCE8AnNJgKtOll_tnMhWg98q2GR-yeENxD_KjPTcKOdzkoE3aIHm66S7fjgQUQl-740dzOZOelfn4dJcUNI9s5oeNCa6kZVuPsSUM68Z87RWCZJjCu6uvcLhabpZOCvzYUET08Cwaw May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 8a6bfd5cc2344dd8b681eb4ee5a848fe May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: {"createImage": {"name": "tempest-test-snap-580422175"}} May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-580422175'}}} May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:00.724469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-667318e4-f7bc-4e0a-858a-993488f0a35a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:00.729371 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-667318e4-f7bc-4e0a-858a-993488f0a35a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009051 May 19 04:37:00.732494 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 720/1452] 10.222.0.58 () {60 vars in 1274 bytes} [Thu May 19 04:37:00 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:00.738612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1ada14b3-7961-4a1c-bb18-5ea3d77e8adb tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] Calling method '.version_select at 0x7fd3159e5430>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:00.765300 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1ada14b3-7961-4a1c-bb18-5ea3d77e8adb tempest-KeyPairsV22TestJSON-741242482 tempest-KeyPairsV22TestJSON-741242482-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505128905" status: 204 len: 0 microversion: 2.2 time: 0.031340 May 19 04:37:00.770544 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 721/1453] 10.222.0.58 () {60 vars in 1260 bytes} [Thu May 19 04:37:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505128905 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:37:00.783063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-3714708", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6607fa72-65ef-40a3-b920-b1c31c2f4729"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:00.911073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:37:00.919849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Acquired lock "refresh_cache-03dc9c5d-005c-439e-ad75-c68584ab889e" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:37:01.983418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:37:01.984774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:37:01.985471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:37:01.986074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:37:01.986671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:37:02.034038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:02.034471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:02.035688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:02.036504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:02.060556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:02.067454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:02.100324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Going to run 2 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:37:02.111682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:37:02.214808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=124819) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 19 04:37:02.261129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:02.282771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:02.426259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:02.456842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:02.491183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=a618bac6-bdc4-4730-93c3-d3f54367f21f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:37:02.651479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:02.664702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:02.713317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:02.826709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:02.834492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:02.911914 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a263e8d5-b08d-4d63-bd82-c4102c7c42f1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.137575 May 19 04:37:02.913556 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 722/1454] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:37:00 2022] POST /compute/v2.1/servers => generated 32 bytes in 2142 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 19 04:37:02.922072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d83b6b3-d533-4a6e-b311-f4f0daa9c71a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-771350656"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:02.923459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5d83b6b3-d533-4a6e-b311-f4f0daa9c71a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 04:37:02.925000 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5d83b6b3-d533-4a6e-b311-f4f0daa9c71a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d83b6b3-d533-4a6e-b311-f4f0daa9c71a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Request method failure captured: May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 56 May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclPUYFoDAqYUWOP-kdtRbnr_07_I4vTdFaMyzCE8AnNJgKtOll_tnMhWg98q2GR-yeENxD_KjPTcKOdzkoE3aIHm66S7fjgQUQl-740dzOZOelfn4dJcUNI9s5oeNCa6kZVuPsSUM68Z87RWCZJjCu6uvcLhabpZOCvzYUET08Cwaw May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 8a6bfd5cc2344dd8b681eb4ee5a848fe May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: {"createImage": {"name": "tempest-test-snap-771350656"}} May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-771350656'}}} May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:02.927732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:02.932963 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:02.932963 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:02.932963 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:02.932963 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:02.932963 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:02.932963 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:02.932963 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:02.932963 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 04:37:02.932963 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:02.935168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d83b6b3-d533-4a6e-b311-f4f0daa9c71a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:02.937670 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5d83b6b3-d533-4a6e-b311-f4f0daa9c71a tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.021518 May 19 04:37:02.943333 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 723/1455] 10.222.0.58 () {60 vars in 1280 bytes} [Thu May 19 04:37:02 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:02.951021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-953a1e34-d4d9-44c4-bc8e-40d95052aa02 req-85b3efd4-bd13-4b9e-bda3-63a6e6b27464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c69174-954d-4b88-a428-a61230832bf6", "name": "network-vif-deleted", "tag": "5ab68c34-992f-4bef-aac5-f50c840ecd54"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:02.963288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-953a1e34-d4d9-44c4-bc8e-40d95052aa02 req-85b3efd4-bd13-4b9e-bda3-63a6e6b27464 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:02.964339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-953a1e34-d4d9-44c4-bc8e-40d95052aa02 req-85b3efd4-bd13-4b9e-bda3-63a6e6b27464 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:02.992898 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-953a1e34-d4d9-44c4-bc8e-40d95052aa02 req-85b3efd4-bd13-4b9e-bda3-63a6e6b27464 service nova] Creating event network-vif-deleted:5ab68c34-992f-4bef-aac5-f50c840ecd54 for instance 31c69174-954d-4b88-a428-a61230832bf6 on n-h1-766726-30 May 19 04:37:03.011074 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-953a1e34-d4d9-44c4-bc8e-40d95052aa02 req-85b3efd4-bd13-4b9e-bda3-63a6e6b27464 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066033 May 19 04:37:03.012025 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 724/1456] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:03.018654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:03.019392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:03.042039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:03.042514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:03.043325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:03.043772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:03.777241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:03.789502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:03.795930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:03.797178 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae2652c0-e911-4721-a37f-a9cb99be6d47 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1280 microversion: 2.25 time: 0.783958 May 19 04:37:03.801579 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 725/1457] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:03 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1280 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:03.816344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1957cb5b-c585-4d7e-8d95-d68d0db882d3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:03.840929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1957cb5b-c585-4d7e-8d95-d68d0db882d3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:03.841751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1957cb5b-c585-4d7e-8d95-d68d0db882d3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Searching by: {'deleted': False, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:37:03.889200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1957cb5b-c585-4d7e-8d95-d68d0db882d3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:03.892534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1957cb5b-c585-4d7e-8d95-d68d0db882d3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:03.894011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1957cb5b-c585-4d7e-8d95-d68d0db882d3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:03.897187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1957cb5b-c585-4d7e-8d95-d68d0db882d3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:03.987613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Building network info cache for instance {{(pid=124818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:37:04.210105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-1957cb5b-c585-4d7e-8d95-d68d0db882d3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:37:04.894781 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1957cb5b-c585-4d7e-8d95-d68d0db882d3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 997 microversion: 2.1 time: 1.090757 May 19 04:37:04.896892 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 726/1458] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:37:03 2022] GET /compute/v2.1/servers => generated 997 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:04.905555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:04.906394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:04.915241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:04.916632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:04.917714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:04.918555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:04.950767 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] HTTP exception thrown: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Request method failure captured: May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 HTTP/1.1 May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclPUYFoDAqYUWOP-kdtRbnr_07_I4vTdFaMyzCE8AnNJgKtOll_tnMhWg98q2GR-yeENxD_KjPTcKOdzkoE3aIHm66S7fjgQUQl-740dzOZOelfn4dJcUNI9s5oeNCa6kZVuPsSUM68Z87RWCZJjCu6uvcLhabpZOCvzYUET08Cwaw May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 8a6bfd5cc2344dd8b681eb4ee5a848fe May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '31c69174-954d-4b88-a428-a61230832bf6'} May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:04.954836 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:04.959129 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:04.963728 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Returning 404 to user: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:04.964736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13c10465-a67f-4cc3-b1bc-d95eb7da18fb tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "DELETE /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 404 len: 111 microversion: 2.1 time: 0.066340 May 19 04:37:04.965592 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 727/1459] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:37:04 2022] DELETE /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:04.972701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b08fadaa-a97b-447b-8b42-d4d7ffa946e1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:04.973525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b08fadaa-a97b-447b-8b42-d4d7ffa946e1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:04.984801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b08fadaa-a97b-447b-8b42-d4d7ffa946e1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:04.985978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b08fadaa-a97b-447b-8b42-d4d7ffa946e1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:04.987194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b08fadaa-a97b-447b-8b42-d4d7ffa946e1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:04.988482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b08fadaa-a97b-447b-8b42-d4d7ffa946e1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:04.995392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:05.031255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b08fadaa-a97b-447b-8b42-d4d7ffa946e1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:37:05.214641 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b08fadaa-a97b-447b-8b42-d4d7ffa946e1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 204 len: 0 microversion: 2.1 time: 0.247382 May 19 04:37:05.216209 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 728/1460] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:37:04 2022] DELETE /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:37:05.458121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab3d9a4a-90f4-4baa-ab3d-6da981ce762e tempest-AZV2TestJSON-2038637199 tempest-AZV2TestJSON-2038637199-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:05.460206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab3d9a4a-90f4-4baa-ab3d-6da981ce762e tempest-AZV2TestJSON-2038637199 tempest-AZV2TestJSON-2038637199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:05.460734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab3d9a4a-90f4-4baa-ab3d-6da981ce762e tempest-AZV2TestJSON-2038637199 tempest-AZV2TestJSON-2038637199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:05.461699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab3d9a4a-90f4-4baa-ab3d-6da981ce762e tempest-AZV2TestJSON-2038637199 tempest-AZV2TestJSON-2038637199-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:05.462206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab3d9a4a-90f4-4baa-ab3d-6da981ce762e tempest-AZV2TestJSON-2038637199 tempest-AZV2TestJSON-2038637199-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:05.521607 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab3d9a4a-90f4-4baa-ab3d-6da981ce762e tempest-AZV2TestJSON-2038637199 tempest-AZV2TestJSON-2038637199-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.303703 May 19 04:37:05.530597 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 729/1461] 10.222.0.58 () {58 vars in 1163 bytes} [Thu May 19 04:37:05 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:37:05.555198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:05.557296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:05.592616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:05.593483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:05.594346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:05.594800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.513605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:06.526182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:06.532402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:06.533838 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-01c5474b-48e0-493e-baaf-5ea7812c4b41 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1280 microversion: 2.25 time: 1.006198 May 19 04:37:06.545043 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 730/1462] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:05 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1280 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:06.547898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2de6d5a8-39fd-4e71-8e91-8980bd61e96b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:06.548595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2de6d5a8-39fd-4e71-8e91-8980bd61e96b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:06.563523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2de6d5a8-39fd-4e71-8e91-8980bd61e96b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:06.564212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2de6d5a8-39fd-4e71-8e91-8980bd61e96b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.566604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2de6d5a8-39fd-4e71-8e91-8980bd61e96b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:06.567450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2de6d5a8-39fd-4e71-8e91-8980bd61e96b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.660684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Updating instance_info_cache with network_info: [{"id": "7a0ba22f-bad2-4aed-9c67-44a5c5d0f945", "address": "fa:16:3e:8a:36:2a", "network": {"id": "3ba5e61a-5d01-4401-a0a2-9128eee8ac26", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-904786534-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f026983989674a98928e2c3645ed1ca3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7a0ba22f-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:37:06.687952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Releasing lock "refresh_cache-03dc9c5d-005c-439e-ad75-c68584ab889e" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:37:06.688996 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-06047e74-3647-46df-b4d6-a05687e7e44e tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "POST /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e/action" status: 202 len: 0 microversion: 2.1 time: 6.601440 May 19 04:37:06.689785 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 733/1463] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:37:00 2022] POST /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e/action => generated 0 bytes in 6603 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 04:37:06.699501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:06.700976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] [instance: 31c69174-954d-4b88-a428-a61230832bf6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:06.742105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:06.742588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.743440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:06.744467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.759749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2de6d5a8-39fd-4e71-8e91-8980bd61e96b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:06.771066 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2de6d5a8-39fd-4e71-8e91-8980bd61e96b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 200 len: 1274 microversion: 2.1 time: 0.232973 May 19 04:37:06.775101 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 731/1464] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:06 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:06.786765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a6f0e7fd-119a-421a-b072-d40af170e070 req-306fec15-9f46-485c-bcc4-eb8f06f168cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03dc9c5d-005c-439e-ad75-c68584ab889e", "tag": "7a0ba22f-bad2-4aed-9c67-44a5c5d0f945"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:06.806958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=24 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:06.814259 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] HTTP exception thrown: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:06.817212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a6f0e7fd-119a-421a-b072-d40af170e070 req-306fec15-9f46-485c-bcc4-eb8f06f168cc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:06.817626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a6f0e7fd-119a-421a-b072-d40af170e070 req-306fec15-9f46-485c-bcc4-eb8f06f168cc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Request method failure captured: May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 HTTP/1.1 May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihclPUYFoDAqYUWOP-kdtRbnr_07_I4vTdFaMyzCE8AnNJgKtOll_tnMhWg98q2GR-yeENxD_KjPTcKOdzkoE3aIHm66S7fjgQUQl-740dzOZOelfn4dJcUNI9s5oeNCa6kZVuPsSUM68Z87RWCZJjCu6uvcLhabpZOCvzYUET08Cwaw May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2081dc484df3407c922b4da6e6c3520c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 2081dc484df3407c922b4da6e6c3520c May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-980540947 May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 8a6bfd5cc2344dd8b681eb4ee5a848fe May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ImagesNegativeTestJSON-980540947-project May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '31c69174-954d-4b88-a428-a61230832bf6'} May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:06.819030 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:06.823746 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:06.823746 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:06.823746 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:06.823746 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:06.823746 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:06.823746 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. May 19 04:37:06.823746 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:06.824618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] Returning 404 to user: Instance 31c69174-954d-4b88-a428-a61230832bf6 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:06.827704 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b7b7226d-a0d0-4b1a-aebc-f43f976a7e2f tempest-ImagesNegativeTestJSON-980540947 tempest-ImagesNegativeTestJSON-980540947-project] 10.222.0.58 "GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6" status: 404 len: 111 microversion: 2.1 time: 0.136479 May 19 04:37:06.838147 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 734/1465] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:06 2022] GET /compute/v2.1/servers/31c69174-954d-4b88-a428-a61230832bf6 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:06.839544 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a6f0e7fd-119a-421a-b072-d40af170e070 req-306fec15-9f46-485c-bcc4-eb8f06f168cc service nova] Creating event network-changed:7a0ba22f-bad2-4aed-9c67-44a5c5d0f945 for instance 03dc9c5d-005c-439e-ad75-c68584ab889e on n-h1-766726-30 May 19 04:37:06.849661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ba80988-43ad-4ed4-b948-cdd3237eb5f1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:06.851457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2ba80988-43ad-4ed4-b948-cdd3237eb5f1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:06.852196 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a6f0e7fd-119a-421a-b072-d40af170e070 req-306fec15-9f46-485c-bcc4-eb8f06f168cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074243 May 19 04:37:06.861680 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 732/1466] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:06.877472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-60ad85c1-49e4-42fc-b481-36717f484c3c tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:06.877986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60ad85c1-49e4-42fc-b481-36717f484c3c tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:06.878346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ba80988-43ad-4ed4-b948-cdd3237eb5f1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:06.878705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ba80988-43ad-4ed4-b948-cdd3237eb5f1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.881552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ba80988-43ad-4ed4-b948-cdd3237eb5f1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:06.884283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ba80988-43ad-4ed4-b948-cdd3237eb5f1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.894803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60ad85c1-49e4-42fc-b481-36717f484c3c tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:06.896780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60ad85c1-49e4-42fc-b481-36717f484c3c tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.897978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60ad85c1-49e4-42fc-b481-36717f484c3c tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:06.901015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60ad85c1-49e4-42fc-b481-36717f484c3c tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:06.966077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60ad85c1-49e4-42fc-b481-36717f484c3c tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:37:07.134841 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-60ad85c1-49e4-42fc-b481-36717f484c3c tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 204 len: 0 microversion: 2.1 time: 0.269504 May 19 04:37:07.136255 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 733/1467] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:37:06 2022] DELETE /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:37:07.155536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.97"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:07.158255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:07.174838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:07.175722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:07.176852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:07.177717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:07.227737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Acquired lock "refresh_cache-6092f529-4e24-4335-9922-76f287b8696d" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:37:08.067445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2ba80988-43ad-4ed4-b948-cdd3237eb5f1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:08.084466 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ba80988-43ad-4ed4-b948-cdd3237eb5f1 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1664 microversion: 2.1 time: 1.242976 May 19 04:37:08.095118 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 735/1468] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:06 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1664 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:08.095118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:08.095118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:08.112500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:08.112967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:08.113778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:08.114219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:08.694869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:08.735708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:08.739678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:08.747665 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0026325d-f45d-4d23-8646-f66696dcfaeb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1280 microversion: 2.25 time: 0.659963 May 19 04:37:08.752928 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 736/1469] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:08 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1280 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:08.785911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1296e7ce-2f67-4a22-a403-798aa42e4ea3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:08.788333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1296e7ce-2f67-4a22-a403-798aa42e4ea3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:08.846411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1296e7ce-2f67-4a22-a403-798aa42e4ea3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:08.851798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1296e7ce-2f67-4a22-a403-798aa42e4ea3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:08.856459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1296e7ce-2f67-4a22-a403-798aa42e4ea3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:08.857807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1296e7ce-2f67-4a22-a403-798aa42e4ea3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:09.645400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1296e7ce-2f67-4a22-a403-798aa42e4ea3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:09.657589 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1296e7ce-2f67-4a22-a403-798aa42e4ea3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 200 len: 1316 microversion: 2.1 time: 0.899268 May 19 04:37:09.684338 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 737/1470] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:08 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 1316 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:09.689418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fdfebc54-05c5-4466-b25b-5f0cb71341d5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Action: 'create', calling method: .version_select at 0x7fd315b6df70>, body: {"keypair": {"name": "tempest-keypair-794907459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2I0gxnFQoyOjXN9BX8gjpP3z5fcvjUlni0B4I1Le/kgFBCPj/XmTBGsjIaF2qDcTxXLTop/27wXM5MLCMQRhGaQOYHTPpDt2zNgTMcpkeXDXhhr1iQ20eLbi7axDd3UQ=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:09.754005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-fdfebc54-05c5-4466-b25b-5f0cb71341d5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Getting quotas for project 345f541c3285497685c0e59daa6a4c28. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:09.761711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-fdfebc54-05c5-4466-b25b-5f0cb71341d5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Getting quotas for user 0cc04e71de084662ac6afa2806664050 and project 345f541c3285497685c0e59daa6a4c28. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:09.835633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fdfebc54-05c5-4466-b25b-5f0cb71341d5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.150144 May 19 04:37:09.841400 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 738/1471] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 19 04:37:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 04:37:09.842537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9e14ace9-1822-4cdc-ba34-f6b499df040a req-d07482d9-2fe8-4302-8f62-44fdac91d5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61799b1-3689-4c54-bb41-ac10d07bca57", "name": "network-vif-plugged", "status": "completed", "tag": "7745425f-977a-42db-8a3d-6a421e366558"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:09.859932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9e14ace9-1822-4cdc-ba34-f6b499df040a req-d07482d9-2fe8-4302-8f62-44fdac91d5a6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:09.860389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9e14ace9-1822-4cdc-ba34-f6b499df040a req-d07482d9-2fe8-4302-8f62-44fdac91d5a6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:09.900077 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9e14ace9-1822-4cdc-ba34-f6b499df040a req-d07482d9-2fe8-4302-8f62-44fdac91d5a6 service nova] Creating event network-vif-plugged:7745425f-977a-42db-8a3d-6a421e366558 for instance a61799b1-3689-4c54-bb41-ac10d07bca57 on n-h2-766726-30 May 19 04:37:09.905376 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9e14ace9-1822-4cdc-ba34-f6b499df040a req-d07482d9-2fe8-4302-8f62-44fdac91d5a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066972 May 19 04:37:09.909042 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 739/1472] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:09.921178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-842f709d-c95e-438b-8c95-38bdb69ecf37 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:09.922071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-842f709d-c95e-438b-8c95-38bdb69ecf37 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:09.932046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-842f709d-c95e-438b-8c95-38bdb69ecf37 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:09.937745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-842f709d-c95e-438b-8c95-38bdb69ecf37 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:09.941279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-842f709d-c95e-438b-8c95-38bdb69ecf37 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:09.945410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-842f709d-c95e-438b-8c95-38bdb69ecf37 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:10.657782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-842f709d-c95e-438b-8c95-38bdb69ecf37 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a112a35379df43eaa46bdaadb126c022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c0500491454fa3af763f11c897104a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:10.670450 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-842f709d-c95e-438b-8c95-38bdb69ecf37 tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 200 len: 1598 microversion: 2.1 time: 0.757181 May 19 04:37:10.674617 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 740/1473] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:09 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 1598 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:10.685339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:10.688454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:10.705824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:10.708762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:10.711264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:10.712408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:11.156288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:11.172097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:11.177037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:11.185020 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e632de71-b804-4792-99cf-5ff5a3a4d7b4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1280 microversion: 2.25 time: 0.503486 May 19 04:37:11.188729 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 741/1474] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:10 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1280 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:11.224409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8605fde9-eeac-4d6f-b76f-136229f21a5d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:11.226323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8605fde9-eeac-4d6f-b76f-136229f21a5d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:11.234163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8605fde9-eeac-4d6f-b76f-136229f21a5d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:11.234928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8605fde9-eeac-4d6f-b76f-136229f21a5d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:11.236080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8605fde9-eeac-4d6f-b76f-136229f21a5d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:11.236740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8605fde9-eeac-4d6f-b76f-136229f21a5d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:12.812235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8605fde9-eeac-4d6f-b76f-136229f21a5d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:12.835883 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8605fde9-eeac-4d6f-b76f-136229f21a5d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 200 len: 1316 microversion: 2.1 time: 1.643289 May 19 04:37:12.843949 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 742/1475] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:11 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 1316 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:12.867574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=42 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:13.026288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cb3cf924-f6a5-4104-adb6-62eb22b46084 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Calling method '.version_select at 0x7fd315d0d790>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:13.060200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb3cf924-f6a5-4104-adb6-62eb22b46084 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:13.060664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb3cf924-f6a5-4104-adb6-62eb22b46084 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:13.061511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb3cf924-f6a5-4104-adb6-62eb22b46084 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:13.062202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb3cf924-f6a5-4104-adb6-62eb22b46084 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:13.094165 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cb3cf924-f6a5-4104-adb6-62eb22b46084 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.248961 May 19 04:37:13.094775 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 743/1476] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 19 04:37:12 2022] GET /compute/v2.1/limits => generated 511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:13.258094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3cd81e84-5649-4a6a-9340-f7095c8b71d6 req-a6f98b7a-10e4-481c-aa9a-46bab391e265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d7145-9eba-4a60-9898-fa8bc142ba4b", "name": "network-vif-deleted", "tag": "49ff73e4-16fb-448b-820c-0f2c523bc539"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:13.280789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3cd81e84-5649-4a6a-9340-f7095c8b71d6 req-a6f98b7a-10e4-481c-aa9a-46bab391e265 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:13.281280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3cd81e84-5649-4a6a-9340-f7095c8b71d6 req-a6f98b7a-10e4-481c-aa9a-46bab391e265 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:13.313459 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3cd81e84-5649-4a6a-9340-f7095c8b71d6 req-a6f98b7a-10e4-481c-aa9a-46bab391e265 service nova] Creating event network-vif-deleted:49ff73e4-16fb-448b-820c-0f2c523bc539 for instance f67d7145-9eba-4a60-9898-fa8bc142ba4b on n-h2-766726-30 May 19 04:37:13.321926 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3cd81e84-5649-4a6a-9340-f7095c8b71d6 req-a6f98b7a-10e4-481c-aa9a-46bab391e265 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224541 May 19 04:37:13.323185 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 744/1477] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:13.330063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:13.331107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] [instance: f67d7145-9eba-4a60-9898-fa8bc142ba4b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:13.339325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:13.339793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:13.342136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:13.346565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:13.369198 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] HTTP exception thrown: Instance f67d7145-9eba-4a60-9898-fa8bc142ba4b could not be found. May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Request method failure captured: May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b HTTP/1.1 May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckmsWA067vrOXaMTPpu_1OSaIF5KjMsVbAadYOGLHZQBsOLj9j_JaMZjl46YHe23xolexubbXDcRdYCLaBuPBxS_U6UaDKMvaC-oCQNXXPvJl14ALp3xXfebP93tOzrGG8C8A-4dHXgx_dz9r78U1IC6mmehbpVYBE6Nu9vMkIv8V4 May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: d0c0500491454fa3af763f11c897104a May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestFqdnHostnames-222034103 May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d0c0500491454fa3af763f11c897104a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0c0500491454fa3af763f11c897104a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0c0500491454fa3af763f11c897104a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d0c0500491454fa3af763f11c897104a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestFqdnHostnames-222034103 May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: d0c0500491454fa3af763f11c897104a May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-222034103 May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestFqdnHostnames-222034103-project May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a112a35379df43eaa46bdaadb126c022 May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestFqdnHostnames-222034103-project May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance f67d7145-9eba-4a60-9898-fa8bc142ba4b could not be found. May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'f67d7145-9eba-4a60-9898-fa8bc142ba4b'} May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67d7145-9eba-4a60-9898-fa8bc142ba4b could not be found. May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67d7145-9eba-4a60-9898-fa8bc142ba4b could not be found. May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:13.371750 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67d7145-9eba-4a60-9898-fa8bc142ba4b could not be found. May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Returning 404 to user: Instance f67d7145-9eba-4a60-9898-fa8bc142ba4b could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-12fc309e-20e3-406d-bb56-36b1f74dcfed tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b" status: 404 len: 111 microversion: 2.1 time: 0.049041 May 19 04:37:13.377697 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 745/1478] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:13 2022] GET /compute/v2.1/servers/f67d7145-9eba-4a60-9898-fa8bc142ba4b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:13.379262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e1577b35-2b7a-4207-b307-869a31926117 req-8b8026f1-1f68-4be6-8287-2395654935b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d7145-9eba-4a60-9898-fa8bc142ba4b", "name": "network-vif-unplugged", "status": "completed", "tag": "49ff73e4-16fb-448b-820c-0f2c523bc539"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:13.393046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e1577b35-2b7a-4207-b307-869a31926117 req-8b8026f1-1f68-4be6-8287-2395654935b8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:13.393468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e1577b35-2b7a-4207-b307-869a31926117 req-8b8026f1-1f68-4be6-8287-2395654935b8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:13.419807 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e1577b35-2b7a-4207-b307-869a31926117 req-8b8026f1-1f68-4be6-8287-2395654935b8 service nova] Creating event network-vif-unplugged:49ff73e4-16fb-448b-820c-0f2c523bc539 for instance f67d7145-9eba-4a60-9898-fa8bc142ba4b on n-h2-766726-30 May 19 04:37:13.439100 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e1577b35-2b7a-4207-b307-869a31926117 req-8b8026f1-1f68-4be6-8287-2395654935b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063241 May 19 04:37:13.439971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 746/1479] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:13.445412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:13.446121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:13.465230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:13.465698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:13.466506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:13.466956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:13.880822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Building network info cache for instance {{(pid=124819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:37:13.950514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:13.960185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:13.962925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:13.964356 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3e54b2c5-bc23-41ce-82f5-84d7b8651038 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1476 microversion: 2.25 time: 0.523256 May 19 04:37:13.980599 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 747/1480] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:13 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1476 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:13.986594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-208fc52b-595d-4146-bc05-1c3dec070147 req-cbb47357-de08-4672-a02a-f67cac9811fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa3483fa-2206-4bc1-87fa-94fb5afd1ee6", "tag": "02806464-d201-4fd4-86a1-709506da8214"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:13.995682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-208fc52b-595d-4146-bc05-1c3dec070147 req-cbb47357-de08-4672-a02a-f67cac9811fd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:13.996435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-208fc52b-595d-4146-bc05-1c3dec070147 req-cbb47357-de08-4672-a02a-f67cac9811fd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:14.009206 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-208fc52b-595d-4146-bc05-1c3dec070147 req-cbb47357-de08-4672-a02a-f67cac9811fd service nova] Creating event network-changed:02806464-d201-4fd4-86a1-709506da8214 for instance fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 on n-h1-766726-30 May 19 04:37:14.017188 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-208fc52b-595d-4146-bc05-1c3dec070147 req-cbb47357-de08-4672-a02a-f67cac9811fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034626 May 19 04:37:14.027516 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 748/1481] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:14.033707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1759a95f-cbac-4a6d-ab8b-29a5954ae5d7 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1524675897", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:14.132046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-1759a95f-cbac-4a6d-ab8b-29a5954ae5d7 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:37:14.520403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-1759a95f-cbac-4a6d-ab8b-29a5954ae5d7 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Getting quotas for project 4de1a45e4a4940a0a3e3e1263fd86cfd. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:14.534091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-1759a95f-cbac-4a6d-ab8b-29a5954ae5d7 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Getting quotas for user 7322fae4b49a4675926ff2f3eac6a563 and project 4de1a45e4a4940a0a3e3e1263fd86cfd. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:14.569166 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1759a95f-cbac-4a6d-ab8b-29a5954ae5d7 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1759a95f-cbac-4a6d-ab8b-29a5954ae5d7 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Request method failure captured: May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 1752 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcl2NJqqRV_nZkACLhEAMCMSLkrLsHk7UxvuZ7qAijZhOMfU_xpnpsNnFNmT9518k3Pzvp58j8FdEB6WWE3a1LBOl-Rf0DK8FC7wLUBkSnLVZ9OGJUsBY658CtOiSqeyVsvSk0FrzXnZOVO22sFU0fFav9LNcCiVBJOgFd2vmMmGaG0 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 4de1a45e4a4940a0a3e3e1263fd86cfd May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1900853101 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4de1a45e4a4940a0a3e3e1263fd86cfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4de1a45e4a4940a0a3e3e1263fd86cfd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4de1a45e4a4940a0a3e3e1263fd86cfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4de1a45e4a4940a0a3e3e1263fd86cfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1900853101 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 4de1a45e4a4940a0a3e3e1263fd86cfd May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1900853101 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7322fae4b49a4675926ff2f3eac6a563 May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1524675897", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:37:14.572336 n-d-766726-30 devstack@n-api.service[124818]: exception: Maximum number of metadata items exceeds 128 May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1524675897', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:14.574743 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 May 19 04:37:14.577648 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:14.580681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1759a95f-cbac-4a6d-ab8b-29a5954ae5d7 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:14.581886 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1759a95f-cbac-4a6d-ab8b-29a5954ae5d7 tempest-AbsoluteLimitsNegativeTestJSON-1900853101 tempest-AbsoluteLimitsNegativeTestJSON-1900853101-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.552787 May 19 04:37:14.583066 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 749/1482] 10.222.0.58 () {60 vars in 1147 bytes} [Thu May 19 04:37:14 2022] POST /compute/v2.1/servers => generated 87 bytes in 555 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) May 19 04:37:14.588284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2e2e52ae-ff9e-4a4a-aa88-d1db0cd7acfd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] Calling method '.version_select at 0x7fd315c36160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:14.614211 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2e2e52ae-ff9e-4a4a-aa88-d1db0cd7acfd tempest-ServersTestFqdnHostnames-222034103 tempest-ServersTestFqdnHostnames-222034103-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218920590" status: 202 len: 0 microversion: 2.1 time: 0.028610 May 19 04:37:14.616833 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 750/1483] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:37:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218920590 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:37:14.631641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-68344aea-f940-469b-a537-8d4ee897a773 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:14.636316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-68344aea-f940-469b-a537-8d4ee897a773 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:14.649168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68344aea-f940-469b-a537-8d4ee897a773 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:14.652083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68344aea-f940-469b-a537-8d4ee897a773 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:14.653419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68344aea-f940-469b-a537-8d4ee897a773 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:14.654110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68344aea-f940-469b-a537-8d4ee897a773 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:14.664484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:15.013920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Updating instance_info_cache with network_info: [{"id": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6", "address": "fa:16:3e:f5:d9:ca", "network": {"id": "3ba5e61a-5d01-4401-a0a2-9128eee8ac26", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-904786534-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f026983989674a98928e2c3645ed1ca3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9cbf4581-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:37:15.018534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-68344aea-f940-469b-a537-8d4ee897a773 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:15.036294 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-68344aea-f940-469b-a537-8d4ee897a773 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 200 len: 1316 microversion: 2.1 time: 0.417914 May 19 04:37:15.036936 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 751/1484] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:14 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:15.045757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Releasing lock "refresh_cache-6092f529-4e24-4335-9922-76f287b8696d" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:37:15.045757 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ea730742-aa09-485f-8ba2-bb38ba0025d3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "POST /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d/action" status: 202 len: 0 microversion: 2.1 time: 7.892276 May 19 04:37:15.045757 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 734/1485] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:37:07 2022] POST /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d/action => generated 0 bytes in 7894 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 04:37:15.048358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-349eaa5c-32f3-4b34-b0ce-cf3bb6047d34 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:15.049060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-349eaa5c-32f3-4b34-b0ce-cf3bb6047d34 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:15.052919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-45c2ce87-ebbe-45a2-aad1-61f47dd5d960 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '.version_select at 0x7fd315c36160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:15.062496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-349eaa5c-32f3-4b34-b0ce-cf3bb6047d34 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:15.063856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-349eaa5c-32f3-4b34-b0ce-cf3bb6047d34 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:15.065810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-349eaa5c-32f3-4b34-b0ce-cf3bb6047d34 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:15.066367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-349eaa5c-32f3-4b34-b0ce-cf3bb6047d34 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:15.466195 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-45c2ce87-ebbe-45a2-aad1-61f47dd5d960 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/6be446dc-4900-475a-8b8b-2065cb377313" status: 200 len: 183 microversion: 2.1 time: 0.418617 May 19 04:37:15.467141 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 752/1486] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:37:15 2022] GET /compute/v2.1/os-floating-ips/6be446dc-4900-475a-8b8b-2065cb377313 => generated 183 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:15.478843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.97"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:15.483149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:15.717439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-349eaa5c-32f3-4b34-b0ce-cf3bb6047d34 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid a61799b1-3689-4c54-bb41-ac10d07bca57 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:37:15.743112 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-349eaa5c-32f3-4b34-b0ce-cf3bb6047d34 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1970 microversion: 2.25 time: 0.698972 May 19 04:37:15.745248 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 735/1487] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:15 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1970 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:15.771833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c0cd474b-3d8e-47a7-8e4d-97aba14e4306 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:15.783003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c0cd474b-3d8e-47a7-8e4d-97aba14e4306 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:15.802946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0cd474b-3d8e-47a7-8e4d-97aba14e4306 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:15.809723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0cd474b-3d8e-47a7-8e4d-97aba14e4306 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:15.817368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0cd474b-3d8e-47a7-8e4d-97aba14e4306 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:15.821831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0cd474b-3d8e-47a7-8e4d-97aba14e4306 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:15.839991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:15.847625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:15.848093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:15.848885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:15.857116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:16.231161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-c0cd474b-3d8e-47a7-8e4d-97aba14e4306 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid a61799b1-3689-4c54-bb41-ac10d07bca57 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:37:16.267500 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c0cd474b-3d8e-47a7-8e4d-97aba14e4306 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1970 microversion: 2.25 time: 0.504793 May 19 04:37:16.268843 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 736/1488] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:15 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1970 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:16.273936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0c8d08f4-b08f-4a58-9414-7aa1f08bbdb4 req-06bd30cc-6ac7-4645-be1d-5ea0e1656b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03dc9c5d-005c-439e-ad75-c68584ab889e", "name": "network-vif-deleted", "tag": "7a0ba22f-bad2-4aed-9c67-44a5c5d0f945"}, {"name": "network-changed", "server_uuid": "a618bac6-bdc4-4730-93c3-d3f54367f21f", "tag": "9b546525-9634-438d-a80e-daad48bdf3ad"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:16.284976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0c8d08f4-b08f-4a58-9414-7aa1f08bbdb4 req-06bd30cc-6ac7-4645-be1d-5ea0e1656b83 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:16.285712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0c8d08f4-b08f-4a58-9414-7aa1f08bbdb4 req-06bd30cc-6ac7-4645-be1d-5ea0e1656b83 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:16.285894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Acquired lock "refresh_cache-6092f529-4e24-4335-9922-76f287b8696d" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:37:16.303978 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0c8d08f4-b08f-4a58-9414-7aa1f08bbdb4 req-06bd30cc-6ac7-4645-be1d-5ea0e1656b83 service nova] Creating event network-vif-deleted:7a0ba22f-bad2-4aed-9c67-44a5c5d0f945 for instance 03dc9c5d-005c-439e-ad75-c68584ab889e on n-h1-766726-30 May 19 04:37:16.304755 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0c8d08f4-b08f-4a58-9414-7aa1f08bbdb4 req-06bd30cc-6ac7-4645-be1d-5ea0e1656b83 service nova] Creating event network-changed:9b546525-9634-438d-a80e-daad48bdf3ad for instance a618bac6-bdc4-4730-93c3-d3f54367f21f on n-h1-766726-30 May 19 04:37:16.322772 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0c8d08f4-b08f-4a58-9414-7aa1f08bbdb4 req-06bd30cc-6ac7-4645-be1d-5ea0e1656b83 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051198 May 19 04:37:16.325394 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 737/1489] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:16.357331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7ac6986-6345-489d-91d9-42233535d6df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:16.362490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7ac6986-6345-489d-91d9-42233535d6df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:16.382370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ac6986-6345-489d-91d9-42233535d6df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:16.383268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ac6986-6345-489d-91d9-42233535d6df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:16.386699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ac6986-6345-489d-91d9-42233535d6df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:16.387412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ac6986-6345-489d-91d9-42233535d6df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:16.994534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7ac6986-6345-489d-91d9-42233535d6df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:17.036084 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7ac6986-6345-489d-91d9-42233535d6df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 200 len: 1316 microversion: 2.1 time: 0.709002 May 19 04:37:17.037797 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 738/1490] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:16 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:17.043615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-851d8680-132a-4944-8363-7901f98b25a2 req-b14a11f4-4d6e-491f-991d-f57d1ad1281d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6092f529-4e24-4335-9922-76f287b8696d", "tag": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:17.067155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-851d8680-132a-4944-8363-7901f98b25a2 req-b14a11f4-4d6e-491f-991d-f57d1ad1281d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:17.067891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-851d8680-132a-4944-8363-7901f98b25a2 req-b14a11f4-4d6e-491f-991d-f57d1ad1281d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:17.085114 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-851d8680-132a-4944-8363-7901f98b25a2 req-b14a11f4-4d6e-491f-991d-f57d1ad1281d service nova] Creating event network-changed:9cbf4581-2ce2-4cac-9676-5b95af59ddd6 for instance 6092f529-4e24-4335-9922-76f287b8696d on n-h1-766726-30 May 19 04:37:17.101386 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-851d8680-132a-4944-8363-7901f98b25a2 req-b14a11f4-4d6e-491f-991d-f57d1ad1281d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062001 May 19 04:37:17.102329 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 739/1491] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:17.119184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59df05b5-24bb-4802-821f-d55a00a5169a tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:17.125710 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:37:17.125710 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:37:17.127082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59df05b5-24bb-4802-821f-d55a00a5169a tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:17.127551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59df05b5-24bb-4802-821f-d55a00a5169a tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:17.128375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59df05b5-24bb-4802-821f-d55a00a5169a tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:17.130378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59df05b5-24bb-4802-821f-d55a00a5169a tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:17.243531 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59df05b5-24bb-4802-821f-d55a00a5169a tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.139772 May 19 04:37:17.245910 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 740/1492] 10.222.0.58 () {60 vars in 1216 bytes} [Thu May 19 04:37:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:37:17.256310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ebae8df5-3904-4b3b-931d-206e4933fa16 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-766726-30", "block_migration": "auto"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:17.268385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ebae8df5-3904-4b3b-931d-206e4933fa16 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:17.292095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebae8df5-3904-4b3b-931d-206e4933fa16 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:17.295106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebae8df5-3904-4b3b-931d-206e4933fa16 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:17.296670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebae8df5-3904-4b3b-931d-206e4933fa16 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:17.299986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebae8df5-3904-4b3b-931d-206e4933fa16 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:17.384812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-ebae8df5-3904-4b3b-931d-206e4933fa16 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'flavor' on Instance uuid a61799b1-3689-4c54-bb41-ac10d07bca57 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:37:17.402496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ebae8df5-3904-4b3b-931d-206e4933fa16 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Going to try to live migrate instance to n-h1-766726-30 {{(pid=124819) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 04:37:17.513045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:20.468831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Building network info cache for instance {{(pid=124818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:37:20.718201 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ebae8df5-3904-4b3b-931d-206e4933fa16 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57/action" status: 202 len: 0 microversion: 2.25 time: 3.466621 May 19 04:37:20.722324 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 741/1493] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:37:17 2022] POST /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57/action => generated 0 bytes in 3471 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:37:20.727740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab857e37-ce62-4f3b-addc-e14e09652e25 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:20.731269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ab857e37-ce62-4f3b-addc-e14e09652e25 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:20.758631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab857e37-ce62-4f3b-addc-e14e09652e25 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:20.761905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab857e37-ce62-4f3b-addc-e14e09652e25 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:20.765276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab857e37-ce62-4f3b-addc-e14e09652e25 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:20.767864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab857e37-ce62-4f3b-addc-e14e09652e25 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:21.111743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab857e37-ce62-4f3b-addc-e14e09652e25 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:21.122001 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab857e37-ce62-4f3b-addc-e14e09652e25 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 200 len: 1316 microversion: 2.1 time: 0.397219 May 19 04:37:21.125743 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 742/1494] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:20 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:21.133137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-982873217", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dcd5dbfd-05de-4a6a-b653-e8a62e019f20"}, {"port": "a3ad3b69-cf1a-43c4-8bd9-bf577643ec6f", "tag": "port-1"}, {"port": "eadc183f-7173-49b5-b11b-74d6ac02aa3f", "tag": "port-2"}, {"uuid": "09cf32d4-3cb9-42c7-967c-b9cefe853655", "tag": "net-1"}, {"uuid": "09cf32d4-3cb9-42c7-967c-b9cefe853655"}, {"uuid": "3548c473-f8d0-4ece-ad74-d8e27729f7c2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3548c473-f8d0-4ece-ad74-d8e27729f7c2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b42af2eb-4888-4f48-aa9a-8de2aad24d4d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0451b4d0-0583-401b-85ec-cec500e03db9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c53d238a-7f3b-4b0a-8acb-4b23cc9e7fed", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--570731047"}], "key_name": "tempest-keypair-794907459", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:21.718471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] validate_networks() for [('dcd5dbfd-05de-4a6a-b653-e8a62e019f20', None, None, None, None, None), (None, None, 'a3ad3b69-cf1a-43c4-8bd9-bf577643ec6f', None, None, None), (None, None, 'eadc183f-7173-49b5-b11b-74d6ac02aa3f', None, None, None), ('09cf32d4-3cb9-42c7-967c-b9cefe853655', None, None, None, None, None), ('09cf32d4-3cb9-42c7-967c-b9cefe853655', None, None, None, None, None), ('3548c473-f8d0-4ece-ad74-d8e27729f7c2', '10.2.2.100', None, None, None, None), ('3548c473-f8d0-4ece-ad74-d8e27729f7c2', '10.2.2.200', None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:37:21.839471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Updating instance_info_cache with network_info: [{"id": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6", "address": "fa:16:3e:f5:d9:ca", "network": {"id": "3ba5e61a-5d01-4401-a0a2-9128eee8ac26", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-904786534-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f026983989674a98928e2c3645ed1ca3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9cbf4581-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:37:21.847698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Releasing lock "refresh_cache-6092f529-4e24-4335-9922-76f287b8696d" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:37:21.848572 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a2f50962-1ecb-4278-9c3d-f6ab649ef245 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "POST /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d/action" status: 202 len: 0 microversion: 2.1 time: 6.374475 May 19 04:37:21.853793 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 753/1495] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:37:15 2022] POST /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d/action => generated 0 bytes in 6380 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) May 19 04:37:21.870111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9732f438-d6a6-4bb7-923f-c3549463b5d7 req-ddee82da-7499-4490-8881-502253c0e63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6092f529-4e24-4335-9922-76f287b8696d", "tag": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:21.879207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9732f438-d6a6-4bb7-923f-c3549463b5d7 req-ddee82da-7499-4490-8881-502253c0e63c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:21.881828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9732f438-d6a6-4bb7-923f-c3549463b5d7 req-ddee82da-7499-4490-8881-502253c0e63c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:21.908906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9732f438-d6a6-4bb7-923f-c3549463b5d7 req-ddee82da-7499-4490-8881-502253c0e63c service nova] Creating event network-changed:9cbf4581-2ce2-4cac-9676-5b95af59ddd6 for instance 6092f529-4e24-4335-9922-76f287b8696d on n-h1-766726-30 May 19 04:37:21.923737 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9732f438-d6a6-4bb7-923f-c3549463b5d7 req-ddee82da-7499-4490-8881-502253c0e63c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068598 May 19 04:37:21.928279 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 754/1496] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:21.939339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:21.943173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:21.964302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:21.965220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:21.966464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:21.969390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:22.474296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:22.490456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:22.499082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:22.500995 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a3d5701a-76b5-4831-a471-83d80c6f8651 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.571031 May 19 04:37:22.504649 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 755/1497] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:21 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:22.699638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8880caa3-cb6a-46c6-af9a-242fc9c9fe31 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315eaca60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2406029", "description": "tempest-description-1170104850"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:23.077136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:23.094391 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8880caa3-cb6a-46c6-af9a-242fc9c9fe31 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.588117 May 19 04:37:23.106013 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 756/1498] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:37:22 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:23.106013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:23.106013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:23.114448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:23.114957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:23.115820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:23.116266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:23.133664 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] HTTP exception thrown: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Request method failure captured: May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e HTTP/1.1 May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckiozPnzad17kci62WX8A1wpedpuOE0KUOaIigEz3qpSBagT2PGX80kbyK8ntkdv7hxdlXS81l-bXYMFXVm-c3N3ycoa-fS4cVFmEwpZhnxqqqFOXCMcVbUJCDH4IFDA-B8mPjFeaDkAFbfxas7NAiPfDdjeJ5KPWUuEN-gH4e7ZeY May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: f026983989674a98928e2c3645ed1ca3 May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f026983989674a98928e2c3645ed1ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: f026983989674a98928e2c3645ed1ca3 May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FloatingIPsAssociationTestJSON-2096527797-project May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: fcc8b342ef834d308f6503fa0daf66ec May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2096527797-project May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '03dc9c5d-005c-439e-ad75-c68584ab889e'} May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:23.135615 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Returning 404 to user: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:23.140491 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b0c5231f-f477-46a4-9f26-c1cbc2f53b07 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 404 len: 111 microversion: 2.1 time: 0.037797 May 19 04:37:23.141716 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 757/1499] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:37:23 2022] DELETE /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:23.146414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c652d722-15fd-4f40-a8e9-a4a59ed73feb req-14355657-a2f7-446f-b3d3-ba3a7d96beaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3483fa-2206-4bc1-87fa-94fb5afd1ee6", "name": "network-vif-plugged", "status": "completed", "tag": "02806464-d201-4fd4-86a1-709506da8214"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:23.158480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c652d722-15fd-4f40-a8e9-a4a59ed73feb req-14355657-a2f7-446f-b3d3-ba3a7d96beaf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:23.158949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c652d722-15fd-4f40-a8e9-a4a59ed73feb req-14355657-a2f7-446f-b3d3-ba3a7d96beaf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:23.180490 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c652d722-15fd-4f40-a8e9-a4a59ed73feb req-14355657-a2f7-446f-b3d3-ba3a7d96beaf service nova] Creating event network-vif-plugged:02806464-d201-4fd4-86a1-709506da8214 for instance fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 on n-h1-766726-30 May 19 04:37:23.186883 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c652d722-15fd-4f40-a8e9-a4a59ed73feb req-14355657-a2f7-446f-b3d3-ba3a7d96beaf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044526 May 19 04:37:23.188280 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 758/1500] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:23.196289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9564c3f6-97ac-4939-a431-abf99619f2bf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:23.197603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9564c3f6-97ac-4939-a431-abf99619f2bf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:23.207369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9564c3f6-97ac-4939-a431-abf99619f2bf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:23.207827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9564c3f6-97ac-4939-a431-abf99619f2bf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:23.208742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9564c3f6-97ac-4939-a431-abf99619f2bf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:23.209212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9564c3f6-97ac-4939-a431-abf99619f2bf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:23.507093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9564c3f6-97ac-4939-a431-abf99619f2bf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:23.525704 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9564c3f6-97ac-4939-a431-abf99619f2bf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 200 len: 1316 microversion: 2.1 time: 0.334728 May 19 04:37:23.533429 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 759/1501] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:23 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:23.538572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-837872138", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "46fb63e9-6b42-4dee-8db7-bccbd0d35392"}], "block_device_mapping_v2": [{"uuid": "b148dd4f-bb8a-43ae-a199-2008a21c56a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:23.618698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] validate_networks() for [('46fb63e9-6b42-4dee-8db7-bccbd0d35392', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:37:24.559013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=10 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:24.867963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:37:24.868400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:37:24.869661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:37:24.871009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:37:24.871583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:37:24.890365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:24.891463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:24.892467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:24.893103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:24.939359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Getting quotas for project b2425f9ddc1548958d45215e83aed84e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:24.947151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Getting quotas for user 75f651a13b474f09aa3877d1d66b8fc5 and project b2425f9ddc1548958d45215e83aed84e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:25.033349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:37:25.042505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b148dd4f-bb8a-43ae-a199-2008a21c56a2',volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:37:25.291364 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5384b724-b438-46e9-851b-bcd9a0faafc5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755479 May 19 04:37:25.292034 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 760/1502] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:37:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:37:25.302569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60d1aa0f-b754-4a02-b6cd-7493d869ecf8 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315eac820>, body: {"security_group_rule": {"parent_group_id": "a0f140ca-171d-4d0a-b46c-73518e77946b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:26.314640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:37:26.315596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:37:26.316277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:37:26.316857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:37:26.317466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:37:26.346746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:26.355463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:26.359915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:26.361495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:26.424320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Getting quotas for project 345f541c3285497685c0e59daa6a4c28. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:26.445365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Getting quotas for user 0cc04e71de084662ac6afa2806664050 and project 345f541c3285497685c0e59daa6a4c28. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:26.558257 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60d1aa0f-b754-4a02-b6cd-7493d869ecf8 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.263882 May 19 04:37:26.559636 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 761/1503] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:37:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:26.565557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:26.568550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 03dc9c5d-005c-439e-ad75-c68584ab889e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:26.599033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:26.599563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:26.612831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:26.613462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:26.640622 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] HTTP exception thrown: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Request method failure captured: May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e HTTP/1.1 May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckiozPnzad17kci62WX8A1wpedpuOE0KUOaIigEz3qpSBagT2PGX80kbyK8ntkdv7hxdlXS81l-bXYMFXVm-c3N3ycoa-fS4cVFmEwpZhnxqqqFOXCMcVbUJCDH4IFDA-B8mPjFeaDkAFbfxas7NAiPfDdjeJ5KPWUuEN-gH4e7ZeY May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: f026983989674a98928e2c3645ed1ca3 May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f026983989674a98928e2c3645ed1ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: f026983989674a98928e2c3645ed1ca3 May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FloatingIPsAssociationTestJSON-2096527797-project May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: fcc8b342ef834d308f6503fa0daf66ec May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2096527797-project May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '03dc9c5d-005c-439e-ad75-c68584ab889e'} May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:26.643149 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Returning 404 to user: Instance 03dc9c5d-005c-439e-ad75-c68584ab889e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e3dae2e3-711d-47dd-bd3d-6db068fcb7c0 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e" status: 404 len: 111 microversion: 2.1 time: 0.084210 May 19 04:37:26.648467 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 762/1504] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:26 2022] GET /compute/v2.1/servers/03dc9c5d-005c-439e-ad75-c68584ab889e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:26.652730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:26.653707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:26.656911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:26.663852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:26.664317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:26.665214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:26.667446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:26.789026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:37:26.802344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b42af2eb-4888-4f48-aa9a-8de2aad24d4d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0451b4d0-0583-401b-85ec-cec500e03db9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c53d238a-7f3b-4b0a-8acb-4b23cc9e7fed',volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:37:26.948475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:26.976823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:26.981670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:26.983369 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-850e4cc2-64be-42e0-baee-a38a12ad1b4f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.336033 May 19 04:37:26.993463 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 763/1505] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:26 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:26.999887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7ebea55f-47ae-4e78-96b6-b23240eeaa45 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:27.000895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7ebea55f-47ae-4e78-96b6-b23240eeaa45 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:27.018972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebea55f-47ae-4e78-96b6-b23240eeaa45 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:27.019835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebea55f-47ae-4e78-96b6-b23240eeaa45 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:27.020877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebea55f-47ae-4e78-96b6-b23240eeaa45 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:27.021575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebea55f-47ae-4e78-96b6-b23240eeaa45 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:27.313246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7ebea55f-47ae-4e78-96b6-b23240eeaa45 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:27.323021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7ebea55f-47ae-4e78-96b6-b23240eeaa45 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 200 len: 1465 microversion: 2.1 time: 0.327555 May 19 04:37:27.327418 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 764/1506] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:26 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 1465 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:27.349193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-387b2e79-0ab4-4624-9907-7c2a7647dba7 req-064f1bec-949d-4a71-ad1b-d7f488a368c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a618bac6-bdc4-4730-93c3-d3f54367f21f", "name": "network-vif-plugged", "status": "completed", "tag": "9b546525-9634-438d-a80e-daad48bdf3ad"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:27.377821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-387b2e79-0ab4-4624-9907-7c2a7647dba7 req-064f1bec-949d-4a71-ad1b-d7f488a368c4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:27.378728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-387b2e79-0ab4-4624-9907-7c2a7647dba7 req-064f1bec-949d-4a71-ad1b-d7f488a368c4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:27.409574 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-387b2e79-0ab4-4624-9907-7c2a7647dba7 req-064f1bec-949d-4a71-ad1b-d7f488a368c4 service nova] Creating event network-vif-plugged:9b546525-9634-438d-a80e-daad48bdf3ad for instance a618bac6-bdc4-4730-93c3-d3f54367f21f on n-h1-766726-30 May 19 04:37:27.424869 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-387b2e79-0ab4-4624-9907-7c2a7647dba7 req-064f1bec-949d-4a71-ad1b-d7f488a368c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085972 May 19 04:37:27.431369 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 765/1507] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:27.437324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c015290-e36d-4771-b00b-2f7d19777a7b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:27.441320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c015290-e36d-4771-b00b-2f7d19777a7b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:27.463717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c015290-e36d-4771-b00b-2f7d19777a7b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:27.464843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c015290-e36d-4771-b00b-2f7d19777a7b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:27.465961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c015290-e36d-4771-b00b-2f7d19777a7b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:27.466641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c015290-e36d-4771-b00b-2f7d19777a7b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:27.494705 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-675a561f-eccd-4718-96d2-25c5e2779ae5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.367599 May 19 04:37:27.502696 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 743/1508] 10.222.0.58 () {62 vars in 1188 bytes} [Thu May 19 04:37:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 6375 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:37:27.517223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fdbed630-3a9d-4bd3-a4dc-7f6c1098929a tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315de5a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2059416307", "description": "tempest-description-1104999381"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:27.695035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5c015290-e36d-4771-b00b-2f7d19777a7b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:27.704104 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c015290-e36d-4771-b00b-2f7d19777a7b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1168 microversion: 2.1 time: 0.270807 May 19 04:37:27.711734 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 766/1509] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:27 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1168 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:27.724837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f527d788-5c7f-41b9-9b4a-e1564b43afc3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '.version_select at 0x7fd315c36430>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:28.339725 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fdbed630-3a9d-4bd3-a4dc-7f6c1098929a tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.836273 May 19 04:37:28.347268 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 744/1510] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:37:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:28.353335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f3b95e6-7dc3-49ca-ab48-1e6d43e2cec6 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:28.354393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6f3b95e6-7dc3-49ca-ab48-1e6d43e2cec6 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:28.363671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f3b95e6-7dc3-49ca-ab48-1e6d43e2cec6 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:28.364290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f3b95e6-7dc3-49ca-ab48-1e6d43e2cec6 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:28.365295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f3b95e6-7dc3-49ca-ab48-1e6d43e2cec6 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:28.365988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f3b95e6-7dc3-49ca-ab48-1e6d43e2cec6 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:28.828762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6f3b95e6-7dc3-49ca-ab48-1e6d43e2cec6 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:28.845063 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f3b95e6-7dc3-49ca-ab48-1e6d43e2cec6 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f" status: 200 len: 1316 microversion: 2.1 time: 0.496313 May 19 04:37:28.845740 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 745/1511] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:28 2022] GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:28.858850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab5fd53f-22b8-4ea1-b13c-7a2047016339 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:28.868438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ab5fd53f-22b8-4ea1-b13c-7a2047016339 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:29.017356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab5fd53f-22b8-4ea1-b13c-7a2047016339 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:29.025416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab5fd53f-22b8-4ea1-b13c-7a2047016339 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:29.037397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab5fd53f-22b8-4ea1-b13c-7a2047016339 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:29.038783 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab5fd53f-22b8-4ea1-b13c-7a2047016339 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1284 microversion: 2.32 time: 0.187614 May 19 04:37:29.039384 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 746/1512] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:28 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:29.048651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:29.049638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:29.072966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:29.076022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:29.077747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:29.087636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:29.590506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:29.600911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:29.602783 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f527d788-5c7f-41b9-9b4a-e1564b43afc3 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/6be446dc-4900-475a-8b8b-2065cb377313" status: 202 len: 0 microversion: 2.1 time: 1.888968 May 19 04:37:29.604921 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 767/1513] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:37:27 2022] DELETE /compute/v2.1/os-floating-ips/6be446dc-4900-475a-8b8b-2065cb377313 => generated 0 bytes in 1892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:37:29.607079 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:29.608513 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ba11b124-b681-4420-8d92-fe060936876d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.567964 May 19 04:37:29.609123 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 747/1514] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:29 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:29.611895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b5690c4-e1f9-47de-8957-5431582bb551 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315c2a4c0>, body: {"security_group_rule": {"parent_group_id": "a0dcfc2e-8978-4440-b8fe-2505e9c3a806", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:29.628199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bbac71c8-3d5b-42b2-9e45-ea7a7343b5ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:29.628821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bbac71c8-3d5b-42b2-9e45-ea7a7343b5ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:29.651118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbac71c8-3d5b-42b2-9e45-ea7a7343b5ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:29.651565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbac71c8-3d5b-42b2-9e45-ea7a7343b5ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:29.652366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbac71c8-3d5b-42b2-9e45-ea7a7343b5ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:29.652803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbac71c8-3d5b-42b2-9e45-ea7a7343b5ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:29.812913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bbac71c8-3d5b-42b2-9e45-ea7a7343b5ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:29.826488 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bbac71c8-3d5b-42b2-9e45-ea7a7343b5ba tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1168 microversion: 2.1 time: 0.216236 May 19 04:37:29.829372 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 748/1515] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:29 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1168 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:29.842644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d65a545c-33cf-4edc-98db-e347eaeea2fa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:29.843940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d65a545c-33cf-4edc-98db-e347eaeea2fa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:29.858208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d65a545c-33cf-4edc-98db-e347eaeea2fa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:29.860073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d65a545c-33cf-4edc-98db-e347eaeea2fa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:29.862355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d65a545c-33cf-4edc-98db-e347eaeea2fa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:29.865278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d65a545c-33cf-4edc-98db-e347eaeea2fa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:29.932526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d65a545c-33cf-4edc-98db-e347eaeea2fa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:37:30.062802 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b5690c4-e1f9-47de-8957-5431582bb551 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.456462 May 19 04:37:30.063768 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 768/1516] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:37:29 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:30.069591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-921f5759-e92e-4a8e-b0f0-cb5a7ae111c4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:30.070230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-921f5759-e92e-4a8e-b0f0-cb5a7ae111c4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:30.084481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-921f5759-e92e-4a8e-b0f0-cb5a7ae111c4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:30.085005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-921f5759-e92e-4a8e-b0f0-cb5a7ae111c4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:30.085884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-921f5759-e92e-4a8e-b0f0-cb5a7ae111c4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:30.086330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-921f5759-e92e-4a8e-b0f0-cb5a7ae111c4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:30.127821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:30.167621 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d65a545c-33cf-4edc-98db-e347eaeea2fa tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 204 len: 0 microversion: 2.1 time: 0.334991 May 19 04:37:30.171067 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 749/1517] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:37:29 2022] DELETE /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:37:30.191216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:30.192299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:30.208104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:30.211640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:30.214303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:30.216412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:30.499795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:30.514457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:30.519263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:30.520560 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff74bfe0-84eb-483e-b8d9-9a0b25ce1542 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1582 microversion: 2.32 time: 0.346923 May 19 04:37:30.525911 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 750/1518] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:30 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1582 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:30.541767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1f84658-f0d4-4b7b-b8a4-c6a7ad17c55f tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315e03af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-421661378", "description": "tempest-description-1635066478"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:30.639575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-921f5759-e92e-4a8e-b0f0-cb5a7ae111c4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:30.652006 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-921f5759-e92e-4a8e-b0f0-cb5a7ae111c4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f" status: 200 len: 1465 microversion: 2.1 time: 0.587120 May 19 04:37:30.660291 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 769/1519] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:30 2022] GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f => generated 1465 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:30.678480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3d204e8c-d6d6-43ef-b73f-dda745fa8ead tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:30.679120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3d204e8c-d6d6-43ef-b73f-dda745fa8ead tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:30.705299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d204e8c-d6d6-43ef-b73f-dda745fa8ead tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:30.705767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d204e8c-d6d6-43ef-b73f-dda745fa8ead tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:30.706570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d204e8c-d6d6-43ef-b73f-dda745fa8ead tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:30.710724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d204e8c-d6d6-43ef-b73f-dda745fa8ead tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:31.527653 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1f84658-f0d4-4b7b-b8a4-c6a7ad17c55f tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.000374 May 19 04:37:31.528752 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 751/1520] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:37:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:31.534898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:31.535665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:31.549579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:31.550232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:31.552726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:31.554513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:31.721502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3d204e8c-d6d6-43ef-b73f-dda745fa8ead tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:31.739489 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3d204e8c-d6d6-43ef-b73f-dda745fa8ead tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1524 microversion: 2.1 time: 1.078176 May 19 04:37:31.740104 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 770/1521] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:30 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1524 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:31.761305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:31.773841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:31.776964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Searching by: {'reservation_id': 'r-27gfwhly', 'deleted': False, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:37:31.797372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:31.799045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:31.805716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:31.807818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:32.183239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:37:32.468459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:32.477747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:32.482516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:32.491801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:32.491998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:32.492653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:32.493374 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7a13ed03-52c9-4fe5-adc5-920d700d472b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.963402 May 19 04:37:32.506799 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 752/1522] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:31 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:32.516015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c98cb10a-bb95-4f3b-a9d8-ac0e0444a435 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:32.518019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c98cb10a-bb95-4f3b-a9d8-ac0e0444a435 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:32.536505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c98cb10a-bb95-4f3b-a9d8-ac0e0444a435 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:32.537262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c98cb10a-bb95-4f3b-a9d8-ac0e0444a435 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:32.537930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c98cb10a-bb95-4f3b-a9d8-ac0e0444a435 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:32.538389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c98cb10a-bb95-4f3b-a9d8-ac0e0444a435 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:32.985999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c98cb10a-bb95-4f3b-a9d8-ac0e0444a435 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:33.003635 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c98cb10a-bb95-4f3b-a9d8-ac0e0444a435 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.497371 May 19 04:37:33.005233 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 753/1523] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:32 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:33.015041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0eb0e456-fb9e-4531-b419-7fd0ba4a01c7 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315d80c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-655142422", "description": "tempest-description-1415473330"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:33.310366 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a1c94aa-218e-4f66-a617-83dc380ee506 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-27gfwhly" status: 200 len: 2923 microversion: 2.1 time: 1.561760 May 19 04:37:33.316767 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 771/1524] 10.222.0.58 () {58 vars in 1196 bytes} [Thu May 19 04:37:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-27gfwhly => generated 2923 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:33.345622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:33.346627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:33.360206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:33.361031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:33.362106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:33.363799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:33.928346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:33.942453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:33.945943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:33.951400 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9020adfb-7e6c-49ee-96c9-ae483af4c086 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1659 microversion: 2.32 time: 0.624775 May 19 04:37:33.952760 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 772/1525] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:33 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1659 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:33.960241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6172798c-ba60-4962-8338-867a09b4cc1a req-d42cb425-8780-4adc-b4ae-7ba4666c3317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3", "tag": "a9e4213a-1542-42bf-9830-906fd7d9a1a7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:33.979467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6172798c-ba60-4962-8338-867a09b4cc1a req-d42cb425-8780-4adc-b4ae-7ba4666c3317 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:33.989889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6172798c-ba60-4962-8338-867a09b4cc1a req-d42cb425-8780-4adc-b4ae-7ba4666c3317 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.016388 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6172798c-ba60-4962-8338-867a09b4cc1a req-d42cb425-8780-4adc-b4ae-7ba4666c3317 service nova] Creating event network-changed:a9e4213a-1542-42bf-9830-906fd7d9a1a7 for instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 on n-h2-766726-30 May 19 04:37:34.027276 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6172798c-ba60-4962-8338-867a09b4cc1a req-d42cb425-8780-4adc-b4ae-7ba4666c3317 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070537 May 19 04:37:34.028697 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 773/1526] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:34.034396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:34.040162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:34.063946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.081846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.083089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.083758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.105736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0eb0e456-fb9e-4531-b419-7fd0ba4a01c7 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.098794 May 19 04:37:34.112903 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 754/1527] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:37:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:34.112903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e64b6af-7633-421e-a4b1-32446cbe11b5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:34.161123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.161655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.164599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.compute.server_groups [None req-4e64b6af-7633-421e-a4b1-32446cbe11b5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Querying cell c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) for 2 instances {{(pid=124819) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 19 04:37:34.165494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e64b6af-7633-421e-a4b1-32446cbe11b5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.169570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e64b6af-7633-421e-a4b1-32446cbe11b5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.176029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lazy-loading 'fault' on Instance uuid 6092f529-4e24-4335-9922-76f287b8696d {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:37:34.267146 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e64b6af-7633-421e-a4b1-32446cbe11b5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/6607fa72-65ef-40a3-b920-b1c31c2f4729" status: 200 len: 265 microversion: 2.1 time: 0.158925 May 19 04:37:34.272724 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 755/1528] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:37:34 2022] GET /compute/v2.1/os-server-groups/6607fa72-65ef-40a3-b920-b1c31c2f4729 => generated 265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:34.277810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:34.278434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:34.311186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.311657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.312692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.313385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.382336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8b342ef834d308f6503fa0daf66ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f026983989674a98928e2c3645ed1ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:34.392636 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0e46dad8-795d-465d-8498-2a279c470e38 tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 200 len: 1313 microversion: 2.1 time: 0.362192 May 19 04:37:34.394049 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 774/1529] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:34 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:34.399627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-688f6b58-dcff-423e-9695-f11f2a38588d req-c6a9b4b1-ba2f-4941-b820-95f3c7193d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6092f529-4e24-4335-9922-76f287b8696d", "name": "network-vif-deleted", "tag": "9cbf4581-2ce2-4cac-9676-5b95af59ddd6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:34.410706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-688f6b58-dcff-423e-9695-f11f2a38588d req-c6a9b4b1-ba2f-4941-b820-95f3c7193d81 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.411578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-688f6b58-dcff-423e-9695-f11f2a38588d req-c6a9b4b1-ba2f-4941-b820-95f3c7193d81 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.427549 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-688f6b58-dcff-423e-9695-f11f2a38588d req-c6a9b4b1-ba2f-4941-b820-95f3c7193d81 service nova] Creating event network-vif-deleted:9cbf4581-2ce2-4cac-9676-5b95af59ddd6 for instance 6092f529-4e24-4335-9922-76f287b8696d on n-h1-766726-30 May 19 04:37:34.435337 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-688f6b58-dcff-423e-9695-f11f2a38588d req-c6a9b4b1-ba2f-4941-b820-95f3c7193d81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039430 May 19 04:37:34.436496 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 775/1530] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:34.444622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8c81a963-5c06-42fb-9767-ed963fbd8d86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:34.445688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8c81a963-5c06-42fb-9767-ed963fbd8d86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:34.454234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c81a963-5c06-42fb-9767-ed963fbd8d86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.454980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c81a963-5c06-42fb-9767-ed963fbd8d86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.456973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c81a963-5c06-42fb-9767-ed963fbd8d86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.457626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c81a963-5c06-42fb-9767-ed963fbd8d86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.485366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:34.777587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:34.793484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:34.798034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:34.802830 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dfd71f41-7774-49c0-bbcf-8cbdfd65437c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.528859 May 19 04:37:34.803442 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 756/1531] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:34 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:34.826678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a0db3b3-ba31-4a11-9169-d3ff26e90088 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315db1280>, body: {"security_group_rule": {"parent_group_id": "0adcd83a-5dfb-4326-9326-d7e4eb7e1454", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "96243747-25d1-49c0-9560-ff3debc1eb67"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:34.867108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8c81a963-5c06-42fb-9767-ed963fbd8d86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:34.888603 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8c81a963-5c06-42fb-9767-ed963fbd8d86 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.450253 May 19 04:37:34.890264 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 776/1532] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:34 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:34.898285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-759d06ff-489c-495c-8670-6c756b97108a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:34.899361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-759d06ff-489c-495c-8670-6c756b97108a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:34.922392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759d06ff-489c-495c-8670-6c756b97108a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.924616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759d06ff-489c-495c-8670-6c756b97108a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:34.927791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759d06ff-489c-495c-8670-6c756b97108a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:34.928338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759d06ff-489c-495c-8670-6c756b97108a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:35.401503 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-759d06ff-489c-495c-8670-6c756b97108a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f" status: 200 len: 1618 microversion: 2.1 time: 0.502001 May 19 04:37:35.403361 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 777/1533] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:34 2022] GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f => generated 1618 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:35.423598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:35.426921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:35.434778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:35.435551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:35.436746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:35.437529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:35.713327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:35.729258 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0a0db3b3-ba31-4a11-9169-d3ff26e90088 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.920734 May 19 04:37:35.729752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:35.737346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:35.737346 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aaef600d-6ba9-422a-a9be-80d28a04ebb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1705 microversion: 2.32 time: 0.315960 May 19 04:37:35.739089 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 757/1535] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:37:34 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:35.739220 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 778/1535] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:35 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1705 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:35.744723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:35.745600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] [instance: 6092f529-4e24-4335-9922-76f287b8696d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:35.748519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-200c0744-914d-448d-b731-a43e2fd15ae7 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:35.749866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-200c0744-914d-448d-b731-a43e2fd15ae7 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:35.753517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:35.754366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:35.755338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:35.755956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:35.767358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-200c0744-914d-448d-b731-a43e2fd15ae7 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:35.767916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-200c0744-914d-448d-b731-a43e2fd15ae7 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:35.768831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-200c0744-914d-448d-b731-a43e2fd15ae7 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:35.769536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-200c0744-914d-448d-b731-a43e2fd15ae7 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:35.776584 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] HTTP exception thrown: Instance 6092f529-4e24-4335-9922-76f287b8696d could not be found. May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Request method failure captured: May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d HTTP/1.1 May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihckiozPnzad17kci62WX8A1wpedpuOE0KUOaIigEz3qpSBagT2PGX80kbyK8ntkdv7hxdlXS81l-bXYMFXVm-c3N3ycoa-fS4cVFmEwpZhnxqqqFOXCMcVbUJCDH4IFDA-B8mPjFeaDkAFbfxas7NAiPfDdjeJ5KPWUuEN-gH4e7ZeY May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: f026983989674a98928e2c3645ed1ca3 May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f026983989674a98928e2c3645ed1ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f026983989674a98928e2c3645ed1ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: f026983989674a98928e2c3645ed1ca3 May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2096527797 May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FloatingIPsAssociationTestJSON-2096527797-project May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: fcc8b342ef834d308f6503fa0daf66ec May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2096527797-project May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 6092f529-4e24-4335-9922-76f287b8696d could not be found. May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '6092f529-4e24-4335-9922-76f287b8696d'} May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6092f529-4e24-4335-9922-76f287b8696d could not be found. May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6092f529-4e24-4335-9922-76f287b8696d could not be found. May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:35.779038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:35.784287 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:35.784287 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:35.784287 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:35.784287 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:35.784287 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:35.784287 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:35.784287 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6092f529-4e24-4335-9922-76f287b8696d could not be found. May 19 04:37:35.784287 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:35.787238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] Returning 404 to user: Instance 6092f529-4e24-4335-9922-76f287b8696d could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:35.789216 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c09e1229-a6a4-4e40-a7b6-22c98b46d2fd tempest-FloatingIPsAssociationTestJSON-2096527797 tempest-FloatingIPsAssociationTestJSON-2096527797-project] 10.222.0.58 "GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d" status: 404 len: 111 microversion: 2.1 time: 0.048639 May 19 04:37:35.790267 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 758/1536] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:35 2022] GET /compute/v2.1/servers/6092f529-4e24-4335-9922-76f287b8696d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:35.796238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-393d0196-66f0-4dad-a669-37628d755f8f tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315bbf700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-508414698", "description": "tempest-description-1454036226"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:36.390041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:36.763012 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-200c0744-914d-448d-b731-a43e2fd15ae7 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 200 len: 1618 microversion: 2.1 time: 1.020360 May 19 04:37:36.778101 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 779/1537] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:35 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 1618 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:36.789852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:36.791307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:36.802578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:36.803962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:36.805009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:36.805813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:37.014492 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-393d0196-66f0-4dad-a669-37628d755f8f tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.221950 May 19 04:37:37.030466 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 759/1538] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:37:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:37.058081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0cf7667-052b-41fa-80d6-720844007cc2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:37.065277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b0cf7667-052b-41fa-80d6-720844007cc2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:37.095802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0cf7667-052b-41fa-80d6-720844007cc2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:37.098689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0cf7667-052b-41fa-80d6-720844007cc2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:37.115795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0cf7667-052b-41fa-80d6-720844007cc2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:37.129214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0cf7667-052b-41fa-80d6-720844007cc2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:37.220167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:37.244514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:37.246628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:37.251275 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-941c57dd-f1db-486f-af3e-131e7cacf432 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.471547 May 19 04:37:37.254634 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 780/1539] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:36 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:37.270915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:37.271560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:37.291031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:37.291874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:37.292854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:37.309422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:37.643901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b0cf7667-052b-41fa-80d6-720844007cc2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:37.654821 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0cf7667-052b-41fa-80d6-720844007cc2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.622673 May 19 04:37:37.656574 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 760/1540] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:37 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:37.673655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-57bb9d63-998b-4f28-ad35-f9852a439df3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Action: 'create', calling method: .version_select at 0x7fd315db1af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-51816314", "policies": ["anti-affinity"]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:37.703038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-57bb9d63-998b-4f28-ad35-f9852a439df3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:37.711009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-57bb9d63-998b-4f28-ad35-f9852a439df3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:37.784024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-57bb9d63-998b-4f28-ad35-f9852a439df3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:37.789809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-57bb9d63-998b-4f28-ad35-f9852a439df3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:37.817642 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-57bb9d63-998b-4f28-ad35-f9852a439df3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.158267 May 19 04:37:37.839290 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 761/1541] 10.222.0.58 () {60 vars in 1173 bytes} [Thu May 19 04:37:37 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:37.850502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f5e1faf-7708-4871-9108-8eed18c7d023 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315e22160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-67059165", "description": "tempest-description-1347191220"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:37.913853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:37.928158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:37.930809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:37.933831 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f069ce0-0129-4cb1-967f-876d7b7c6688 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1751 microversion: 2.32 time: 0.677883 May 19 04:37:37.938278 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 781/1542] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:37 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1751 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:37.989359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1957204807", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "33b82acc-749b-4ac8-8e9b-41ea6ee8ac73"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:38.084862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:37:38.845810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:37:38.846226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:37:38.846760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:37:38.847165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:37:38.847581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:37:38.907198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:38.908830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:38.911845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:38.914571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:38.965580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:38.980240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:38.986224 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f5e1faf-7708-4871-9108-8eed18c7d023 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.145645 May 19 04:37:38.993127 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 762/1543] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:37:37 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:38.999225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:38.999915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:39.016633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Going to run 2 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:37:39.016805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:39.017587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:39.019799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:39.020613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:39.021794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 1e88a27f-1e50-491f-930a-9f759aad67f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:37:39.126610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=124818) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 19 04:37:39.164674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:39.172553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:39.257367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:39.259671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:39.265541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:39.269340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:39.272583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:39.274304 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-35873919-1ea6-4770-ad7c-fcb13e67f17d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.279403 May 19 04:37:39.286946 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 763/1544] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:38 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:39.300755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=1e88a27f-1e50-491f-930a-9f759aad67f1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:37:39.302572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97ed8caf-35ef-4b13-ba35-0272cb9a27c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:39.303292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97ed8caf-35ef-4b13-ba35-0272cb9a27c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:39.318900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97ed8caf-35ef-4b13-ba35-0272cb9a27c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:39.323786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97ed8caf-35ef-4b13-ba35-0272cb9a27c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:39.324778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97ed8caf-35ef-4b13-ba35-0272cb9a27c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:39.325578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97ed8caf-35ef-4b13-ba35-0272cb9a27c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:39.400871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:39.407307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:39.472858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:39.488092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:37:39.500285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:37:39.591739 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-faa6d50d-d695-481c-b5af-f410063f9ac0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.606972 May 19 04:37:39.592713 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 782/1545] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:37:37 2022] POST /compute/v2.1/servers => generated 32 bytes in 1608 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 19 04:37:39.597976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:39.598674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:39.605621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:39.606130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:39.606976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:39.607422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:40.023905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-97ed8caf-35ef-4b13-ba35-0272cb9a27c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:40.046617 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97ed8caf-35ef-4b13-ba35-0272cb9a27c2 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.753942 May 19 04:37:40.047371 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 764/1546] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:39 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:40.072944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c447008-a9e2-4da8-a400-3cf7ebd67a1d tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315e28a60>, body: {"security_group_rule": {"parent_group_id": "325fd3f5-36c5-4466-b48b-14aae6b38c45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:40.120906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:40.140889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:40.145120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:40.148387 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2f6f0f44-1385-406d-a343-3ffdb24740f9 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1797 microversion: 2.32 time: 0.554523 May 19 04:37:40.151246 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 783/1547] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:39 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1797 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:40.181977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3502fc48-91e6-454b-9ce0-9239eb00c60e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:40.205755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3502fc48-91e6-454b-9ce0-9239eb00c60e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:40.211664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3502fc48-91e6-454b-9ce0-9239eb00c60e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Searching by: {'deleted': False, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:37:40.272893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3502fc48-91e6-454b-9ce0-9239eb00c60e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:40.276090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3502fc48-91e6-454b-9ce0-9239eb00c60e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:40.279125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3502fc48-91e6-454b-9ce0-9239eb00c60e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:40.280894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3502fc48-91e6-454b-9ce0-9239eb00c60e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:40.584731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-3502fc48-91e6-454b-9ce0-9239eb00c60e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:37:40.708431 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3502fc48-91e6-454b-9ce0-9239eb00c60e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1659 microversion: 2.1 time: 0.553594 May 19 04:37:40.709803 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 784/1548] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:37:40 2022] GET /compute/v2.1/servers => generated 1659 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:40.729454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:40.731310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:40.746452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:40.753645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:40.757829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:40.758618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:41.044886 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c447008-a9e2-4da8-a400-3cf7ebd67a1d tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.985771 May 19 04:37:41.047683 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 765/1549] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:37:40 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:41.062274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-987ac3fb-c1f9-4be7-8017-74c9493cbeaf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:41.064897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-987ac3fb-c1f9-4be7-8017-74c9493cbeaf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:41.095569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-987ac3fb-c1f9-4be7-8017-74c9493cbeaf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:41.096341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-987ac3fb-c1f9-4be7-8017-74c9493cbeaf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:41.102092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-987ac3fb-c1f9-4be7-8017-74c9493cbeaf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:41.105455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-987ac3fb-c1f9-4be7-8017-74c9493cbeaf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:41.294995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-987ac3fb-c1f9-4be7-8017-74c9493cbeaf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:41.304041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:41.311752 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-987ac3fb-c1f9-4be7-8017-74c9493cbeaf tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1215 microversion: 2.1 time: 0.261093 May 19 04:37:41.315169 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 766/1550] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:41 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:41.324632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-920308f4-a8f7-4109-9d31-3a97c345b133 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315bf99d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:41.328681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:41.339031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:41.340946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:41.344418 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-52d77e7f-e5f6-419a-a0dd-de177ce63026 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.633196 May 19 04:37:41.346860 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 785/1551] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:40 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:41.352058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94c131cf-a2da-44c0-b6a0-951321566471 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:41.353013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-94c131cf-a2da-44c0-b6a0-951321566471 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:41.363282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94c131cf-a2da-44c0-b6a0-951321566471 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:41.364089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94c131cf-a2da-44c0-b6a0-951321566471 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:41.365156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94c131cf-a2da-44c0-b6a0-951321566471 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:41.366084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94c131cf-a2da-44c0-b6a0-951321566471 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:41.745929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94c131cf-a2da-44c0-b6a0-951321566471 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:41.779153 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94c131cf-a2da-44c0-b6a0-951321566471 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.430066 May 19 04:37:41.788306 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 786/1552] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:41 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:41.805740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:41.815509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:41.839240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:41.840233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:41.841555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:41.842623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:42.536787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:42.573551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:42.575569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:42.584386 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8a67a62a-af83-4678-a750-0ddff610c6cc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1797 microversion: 2.32 time: 0.797114 May 19 04:37:42.597632 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 787/1553] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:41 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1797 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:42.604000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-61f6e483-efd8-41a8-98be-701cf1f48724 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:42.604953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-61f6e483-efd8-41a8-98be-701cf1f48724 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:42.612399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f6e483-efd8-41a8-98be-701cf1f48724 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:42.613665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f6e483-efd8-41a8-98be-701cf1f48724 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:42.615382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f6e483-efd8-41a8-98be-701cf1f48724 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:42.619677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f6e483-efd8-41a8-98be-701cf1f48724 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:42.648211 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-920308f4-a8f7-4109-9d31-3a97c345b133 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9" status: 202 len: 0 microversion: 2.1 time: 1.330930 May 19 04:37:42.650553 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 767/1554] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:37:41 2022] DELETE /compute/v2.1/os-security-groups/b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 => generated 0 bytes in 1334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:37:42.659340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:42.660835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:42.681382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:42.682865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:42.684530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:42.693332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:43.000900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-61f6e483-efd8-41a8-98be-701cf1f48724 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:43.021658 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-61f6e483-efd8-41a8-98be-701cf1f48724 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1277 microversion: 2.1 time: 0.419745 May 19 04:37:43.022431 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 788/1555] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:42 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1277 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:43.035174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d171047-2077-4dc2-b679-4daaf3ee8948 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315d70ee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:43.227132 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d171047-2077-4dc2-b679-4daaf3ee8948 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/325fd3f5-36c5-4466-b48b-14aae6b38c45" status: 200 len: 247 microversion: 2.1 time: 0.199858 May 19 04:37:43.227954 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 789/1556] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:37:43 2022] GET /compute/v2.1/os-security-groups/325fd3f5-36c5-4466-b48b-14aae6b38c45 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:43.233260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a273d18d-79f5-4497-bbdf-df5336eeab54 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:43.234274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a273d18d-79f5-4497-bbdf-df5336eeab54 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:43.249099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a273d18d-79f5-4497-bbdf-df5336eeab54 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:43.249909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a273d18d-79f5-4497-bbdf-df5336eeab54 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:43.253820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a273d18d-79f5-4497-bbdf-df5336eeab54 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:43.260991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a273d18d-79f5-4497-bbdf-df5336eeab54 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:44.428654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a273d18d-79f5-4497-bbdf-df5336eeab54 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:44.438085 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a273d18d-79f5-4497-bbdf-df5336eeab54 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 1.208682 May 19 04:37:44.440179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:44.442925 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 790/1557] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:43 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:44.452064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:44.452817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a60260d6-cf28-4541-89b3-f31ab35683a1 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315dd4700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-990222521", "description": "tempest-description-402331106"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:44.464051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:44.465572 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c97ee33f-0cbf-4cc3-ba9b-a9ba334b82f6 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 1.813398 May 19 04:37:44.469788 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 768/1558] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:42 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:44.483199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:44.490074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:44.504534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:44.504999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:44.505824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:44.506278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:45.080136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:45.096426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:45.098818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:45.100461 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c7cd88d-5e2f-4546-9bd5-9319a278be33 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1843 microversion: 2.32 time: 0.629187 May 19 04:37:45.101418 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 769/1559] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:44 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1843 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:45.107595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-91765ba2-d71b-49f3-b0c4-e1d03b8813ba tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:45.108670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-91765ba2-d71b-49f3-b0c4-e1d03b8813ba tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:45.117567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-91765ba2-d71b-49f3-b0c4-e1d03b8813ba tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:45.118420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-91765ba2-d71b-49f3-b0c4-e1d03b8813ba tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:45.119848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-91765ba2-d71b-49f3-b0c4-e1d03b8813ba tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:45.132217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-91765ba2-d71b-49f3-b0c4-e1d03b8813ba tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:45.272114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-91765ba2-d71b-49f3-b0c4-e1d03b8813ba tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:45.284059 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-91765ba2-d71b-49f3-b0c4-e1d03b8813ba tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1277 microversion: 2.1 time: 0.181181 May 19 04:37:45.288135 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 770/1560] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:45 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:45.320556 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a60260d6-cf28-4541-89b3-f31ab35683a1 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.876021 May 19 04:37:45.335050 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 791/1561] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:37:44 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:45.336599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0883a3a-f1f1-49ae-83ce-da645e1f3a60 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd315e28d30>, body: {"security_group_rule": {"parent_group_id": "ae5f316c-bf40-4010-9a8c-2916d960f9e0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:45.460521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-17e324fa-8117-4c34-8ea1-58c771c822de tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:45.461544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-17e324fa-8117-4c34-8ea1-58c771c822de tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:45.473538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17e324fa-8117-4c34-8ea1-58c771c822de tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:45.473949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17e324fa-8117-4c34-8ea1-58c771c822de tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:45.474735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17e324fa-8117-4c34-8ea1-58c771c822de tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:45.475193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17e324fa-8117-4c34-8ea1-58c771c822de tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:45.890554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-17e324fa-8117-4c34-8ea1-58c771c822de tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:45.912457 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-17e324fa-8117-4c34-8ea1-58c771c822de tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.453251 May 19 04:37:45.926379 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 792/1562] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:45 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:45.944994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:45.946890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:45.963055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:45.964193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:45.968568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:45.970758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:46.215262 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0883a3a-f1f1-49ae-83ce-da645e1f3a60 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.883523 May 19 04:37:46.217487 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 771/1563] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:37:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:46.222620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:46.223598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:46.245478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:46.247530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:46.249355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:46.252070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:46.308476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:46.340222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:46.342000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:46.343288 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e5b769f-6f3c-47b8-8845-f7a1cb7135bc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.413688 May 19 04:37:46.343864 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 793/1564] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:45 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:46.356982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-217a8374-77f8-420f-a662-7475962fe0b2 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Action: 'create', calling method: .version_select at 0x7fd316033700>, body: {"security_group_rule": {"parent_group_id": "ae5f316c-bf40-4010-9a8c-2916d960f9e0", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:46.568617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:46.588345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:46.590618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:46.592213 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-043d637d-fe5e-42c6-b4b2-b628d87f806e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1843 microversion: 2.32 time: 0.373588 May 19 04:37:46.594069 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 772/1565] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:46 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1843 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:46.600294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a25a0df8-aeee-400e-a22c-6e80d55953d0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:46.601140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a25a0df8-aeee-400e-a22c-6e80d55953d0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:46.608678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a25a0df8-aeee-400e-a22c-6e80d55953d0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:46.609369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a25a0df8-aeee-400e-a22c-6e80d55953d0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:46.610410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a25a0df8-aeee-400e-a22c-6e80d55953d0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:46.611471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a25a0df8-aeee-400e-a22c-6e80d55953d0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:46.973181 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-217a8374-77f8-420f-a662-7475962fe0b2 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.628126 May 19 04:37:46.981097 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 794/1566] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:37:46 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:46.986835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-262467ef-0afe-438c-b7f7-e01dd7d00f71 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:46.987621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-262467ef-0afe-438c-b7f7-e01dd7d00f71 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:47.003340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-262467ef-0afe-438c-b7f7-e01dd7d00f71 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:47.003946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-262467ef-0afe-438c-b7f7-e01dd7d00f71 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:47.006342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-262467ef-0afe-438c-b7f7-e01dd7d00f71 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:47.008593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-262467ef-0afe-438c-b7f7-e01dd7d00f71 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:47.217892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a25a0df8-aeee-400e-a22c-6e80d55953d0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:47.227223 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a25a0df8-aeee-400e-a22c-6e80d55953d0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1319 microversion: 2.1 time: 0.630604 May 19 04:37:47.229768 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 773/1567] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:46 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1319 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:47.244166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2502447a-4b29-4e04-9980-7352fa9fa44f tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315db0040>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:47.490186 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2502447a-4b29-4e04-9980-7352fa9fa44f tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/ae5f316c-bf40-4010-9a8c-2916d960f9e0" status: 200 len: 663 microversion: 2.1 time: 0.253584 May 19 04:37:47.490727 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 774/1568] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:37:47 2022] GET /compute/v2.1/os-security-groups/ae5f316c-bf40-4010-9a8c-2916d960f9e0 => generated 663 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:47.501891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:47.502581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:47.509047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:47.509901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:47.510907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:47.511566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:47.511926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-262467ef-0afe-438c-b7f7-e01dd7d00f71 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:47.535127 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-262467ef-0afe-438c-b7f7-e01dd7d00f71 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.541752 May 19 04:37:47.535986 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 795/1569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:46 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:47.553013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a1c29166-145c-44bd-a804-e61c0d259702 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315ff5310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:47.796551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:47.805295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:47.807068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:47.808444 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9026e79-c0ca-4636-a665-421e569855a1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.310724 May 19 04:37:47.819430 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 775/1570] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:47 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:47.825268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:47.826105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:47.832039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=16 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:47.833871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:47.834488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:47.835481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:47.836090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:48.075334 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a1c29166-145c-44bd-a804-e61c0d259702 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/52869f07-e3a5-49c7-8708-3c304d3ca276" status: 202 len: 0 microversion: 2.1 time: 0.526092 May 19 04:37:48.076885 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 796/1571] 10.222.0.58 () {58 vars in 1286 bytes} [Thu May 19 04:37:47 2022] DELETE /compute/v2.1/os-security-group-rules/52869f07-e3a5-49c7-8708-3c304d3ca276 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:37:48.085923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8376314f-1548-4601-bc1f-4c473474a9a3 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315ff5820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:48.145861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:48.167056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:48.170692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:48.172292 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8088d20f-e999-49c4-bbed-14953a1a3be1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1843 microversion: 2.32 time: 0.351460 May 19 04:37:48.174748 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 776/1572] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:47 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1843 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:48.245247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-af90f085-d2ca-43f6-92b2-5aec66e6be11 req-d26078c2-be46-4b0d-b777-8f572d798ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e88a27f-1e50-491f-930a-9f759aad67f1", "tag": "eb06fa58-f656-4142-81af-c99f981eb02e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:48.275622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-af90f085-d2ca-43f6-92b2-5aec66e6be11 req-d26078c2-be46-4b0d-b777-8f572d798ae5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:48.276073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-af90f085-d2ca-43f6-92b2-5aec66e6be11 req-d26078c2-be46-4b0d-b777-8f572d798ae5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:48.307128 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-af90f085-d2ca-43f6-92b2-5aec66e6be11 req-d26078c2-be46-4b0d-b777-8f572d798ae5 service nova] Creating event network-changed:eb06fa58-f656-4142-81af-c99f981eb02e for instance 1e88a27f-1e50-491f-930a-9f759aad67f1 on n-h1-766726-30 May 19 04:37:48.339078 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-af90f085-d2ca-43f6-92b2-5aec66e6be11 req-d26078c2-be46-4b0d-b777-8f572d798ae5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100304 May 19 04:37:48.339705 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 777/1573] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:48.349926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9a7efc39-bd83-43bd-9530-87d95804a83c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:48.350779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9a7efc39-bd83-43bd-9530-87d95804a83c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:48.367868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a7efc39-bd83-43bd-9530-87d95804a83c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:48.368324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a7efc39-bd83-43bd-9530-87d95804a83c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:48.369832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a7efc39-bd83-43bd-9530-87d95804a83c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:48.370345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a7efc39-bd83-43bd-9530-87d95804a83c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:48.686924 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8376314f-1548-4601-bc1f-4c473474a9a3 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ae5f316c-bf40-4010-9a8c-2916d960f9e0" status: 202 len: 0 microversion: 2.1 time: 0.604879 May 19 04:37:48.688321 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 797/1574] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:37:48 2022] DELETE /compute/v2.1/os-security-groups/ae5f316c-bf40-4010-9a8c-2916d960f9e0 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:37:48.697860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f97cc9f2-779b-4de5-9112-9b004535c61d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:48.698995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f97cc9f2-779b-4de5-9112-9b004535c61d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:48.713818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f97cc9f2-779b-4de5-9112-9b004535c61d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:48.714893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f97cc9f2-779b-4de5-9112-9b004535c61d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:48.716016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f97cc9f2-779b-4de5-9112-9b004535c61d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:48.717965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f97cc9f2-779b-4de5-9112-9b004535c61d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:48.771770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9a7efc39-bd83-43bd-9530-87d95804a83c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:48.783515 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9a7efc39-bd83-43bd-9530-87d95804a83c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1319 microversion: 2.1 time: 0.442598 May 19 04:37:48.791009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:48.795576 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 778/1575] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:48 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:48.800687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab99d69b-e2ab-4ef6-b626-02ebac359f4b tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315df6700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:48.881211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-ab99d69b-e2ab-4ef6-b626-02ebac359f4b tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:37:48.883330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-ab99d69b-e2ab-4ef6-b626-02ebac359f4b tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Neutron security group b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:37:48.884179 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-ab99d69b-e2ab-4ef6-b626-02ebac359f4b tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] HTTP exception thrown: Security group b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 does not exist May 19 04:37:48.884179 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-ff8a7481-5a85-4355-abf2-b06893a18eaa'] May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab99d69b-e2ab-4ef6-b626-02ebac359f4b tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Request method failure captured: May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-security-groups/b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 HTTP/1.1 May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmAgGp_vEvZoYvRcp26ffrDLrJ7dcsa6aycUxHD7nNGqM7r0hsTGCDHcQ6o6IlAfttYll_n0KFgZ7Cxqd-xJW6Z27zwO7HzR6uDp4niNgitgc7MlPEK_Iz6YA51qNja5muAfjnrltsBhbSNH5uGHSFSkQ2daxIq4z2NTnpvCjAFS3w May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 346fd172a22b4a0e93d6756e5e57955a May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1949379514 May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/346fd172a22b4a0e93d6756e5e57955a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346fd172a22b4a0e93d6756e5e57955a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346fd172a22b4a0e93d6756e5e57955a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_346fd172a22b4a0e93d6756e5e57955a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1949379514 May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 346fd172a22b4a0e93d6756e5e57955a May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1949379514 May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupRulesTestJSON-1949379514-project May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 9f67e11c47424cbabf848c1b1ac31af1 May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1949379514-project May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 does not exist May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-ff8a7481-5a85-4355-abf2-b06893a18eaa'] May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9'} May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:37:48.890225 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 does not exist May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff8a7481-5a85-4355-abf2-b06893a18eaa'] May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 does not exist May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff8a7481-5a85-4355-abf2-b06893a18eaa'] May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 does not exist May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff8a7481-5a85-4355-abf2-b06893a18eaa'] May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 does not exist May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff8a7481-5a85-4355-abf2-b06893a18eaa'] May 19 04:37:48.894433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:37:48.898995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab99d69b-e2ab-4ef6-b626-02ebac359f4b tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Returning 404 to user: Security group b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 does not exist May 19 04:37:48.898995 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-ff8a7481-5a85-4355-abf2-b06893a18eaa'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:37:48.900362 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab99d69b-e2ab-4ef6-b626-02ebac359f4b tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9" status: 404 len: 194 microversion: 2.1 time: 0.103697 May 19 04:37:48.901192 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 779/1576] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:37:48 2022] DELETE /compute/v2.1/os-security-groups/b362b20c-ab14-49bd-8ac3-80bf7bfc7cd9 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:37:48.906654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:48.907543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:48.915389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:48.916716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:48.917786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:48.918791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:49.111240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f97cc9f2-779b-4de5-9112-9b004535c61d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:49.119622 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f97cc9f2-779b-4de5-9112-9b004535c61d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.429413 May 19 04:37:49.120195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 798/1577] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:48 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:49.136114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd2df82d-4ac4-4d06-bf9f-baff33149f1a tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315ff5a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:49.232588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:49.258502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:49.264495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:49.271203 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99fd7637-5aa1-422f-b0d3-e18ab47005dc tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.366666 May 19 04:37:49.271881 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 780/1578] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:48 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:49.293939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:49.294570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:49.303303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:49.304041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:49.305247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:49.305858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:49.527351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=30 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:49.651801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:49.662358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:49.671686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:49.673143 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8243ef28-9cc3-4e4d-ad56-dbf73884648c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1843 microversion: 2.32 time: 0.393337 May 19 04:37:49.676515 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 781/1579] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:49 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1843 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:49.732988 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd2df82d-4ac4-4d06-bf9f-baff33149f1a tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/325fd3f5-36c5-4466-b48b-14aae6b38c45" status: 202 len: 0 microversion: 2.1 time: 0.605968 May 19 04:37:49.737344 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 799/1580] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:37:49 2022] DELETE /compute/v2.1/os-security-groups/325fd3f5-36c5-4466-b48b-14aae6b38c45 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:37:49.747238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6813798c-c7b2-4d3b-8f2d-e21bbd82fe2a tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315eaac10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:49.813280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea4fbb38-8620-455c-b0e2-b423766714dc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:49.816793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ea4fbb38-8620-455c-b0e2-b423766714dc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:49.830723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb38-8620-455c-b0e2-b423766714dc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:49.831862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb38-8620-455c-b0e2-b423766714dc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:49.833015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb38-8620-455c-b0e2-b423766714dc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:49.834925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea4fbb38-8620-455c-b0e2-b423766714dc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:50.072269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ea4fbb38-8620-455c-b0e2-b423766714dc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:50.086281 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ea4fbb38-8620-455c-b0e2-b423766714dc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1319 microversion: 2.1 time: 0.285711 May 19 04:37:50.087784 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 800/1581] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:49 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:50.137785 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6813798c-c7b2-4d3b-8f2d-e21bbd82fe2a tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/96243747-25d1-49c0-9560-ff3debc1eb67" status: 202 len: 0 microversion: 2.1 time: 0.395885 May 19 04:37:50.139375 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 782/1582] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:37:49 2022] DELETE /compute/v2.1/os-security-groups/96243747-25d1-49c0-9560-ff3debc1eb67 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:37:50.144443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-58202371-8cb7-40f4-93fa-8695a083addd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:50.146441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-58202371-8cb7-40f4-93fa-8695a083addd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:50.147721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8b4a2828-ff17-4cb4-a2e3-bb76b051706d tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315a74670>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:50.156424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58202371-8cb7-40f4-93fa-8695a083addd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:50.157339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58202371-8cb7-40f4-93fa-8695a083addd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:50.158452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58202371-8cb7-40f4-93fa-8695a083addd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:50.159087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58202371-8cb7-40f4-93fa-8695a083addd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:50.428681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-58202371-8cb7-40f4-93fa-8695a083addd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:50.441832 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-58202371-8cb7-40f4-93fa-8695a083addd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.307073 May 19 04:37:50.443703 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 801/1583] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:50 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:50.458659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:50.459588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:50.464112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:50.469765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:50.470910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:50.472115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:50.472959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:50.569903 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8b4a2828-ff17-4cb4-a2e3-bb76b051706d tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/0adcd83a-5dfb-4326-9326-d7e4eb7e1454" status: 202 len: 0 microversion: 2.1 time: 0.423035 May 19 04:37:50.572562 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 783/1584] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:37:50 2022] DELETE /compute/v2.1/os-security-groups/0adcd83a-5dfb-4326-9326-d7e4eb7e1454 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:37:50.585422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c6792bd0-20d9-49d5-ba71-4cdd90ff8c46 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd31611cc10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:50.843305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:50.862015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:50.873415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:50.874906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-679b0caa-86bc-4610-b1d7-4c62707ff91f tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.429851 May 19 04:37:50.875600 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 802/1585] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:50 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:50.886314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:50.888865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:50.904894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:50.905650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:50.906693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:50.909181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:51.393540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:51.408711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:51.410271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:51.421236 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-004af620-9019-499a-9770-23c7291b500b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1843 microversion: 2.32 time: 0.534626 May 19 04:37:51.422344 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 803/1586] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:50 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1843 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:51.428970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-bfffab5b-1f2b-4fc8-953b-8a928e6b26ea req-4e768169-f52c-47d5-8fe9-54b7bca1653d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "tag": "1b45fa40-6dea-450d-9ca3-5940db1c12bf"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:51.458803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bfffab5b-1f2b-4fc8-953b-8a928e6b26ea req-4e768169-f52c-47d5-8fe9-54b7bca1653d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:51.459318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bfffab5b-1f2b-4fc8-953b-8a928e6b26ea req-4e768169-f52c-47d5-8fe9-54b7bca1653d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:51.519275 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-bfffab5b-1f2b-4fc8-953b-8a928e6b26ea req-4e768169-f52c-47d5-8fe9-54b7bca1653d service nova] Creating event network-changed:1b45fa40-6dea-450d-9ca3-5940db1c12bf for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:37:51.537235 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-bfffab5b-1f2b-4fc8-953b-8a928e6b26ea req-4e768169-f52c-47d5-8fe9-54b7bca1653d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113520 May 19 04:37:51.539055 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 804/1587] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:51.550794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5134840c-4403-4a2a-ad72-ad25bfadf2cd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:51.553192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5134840c-4403-4a2a-ad72-ad25bfadf2cd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:51.570839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5134840c-4403-4a2a-ad72-ad25bfadf2cd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:51.576405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5134840c-4403-4a2a-ad72-ad25bfadf2cd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:51.577393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5134840c-4403-4a2a-ad72-ad25bfadf2cd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:51.577914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5134840c-4403-4a2a-ad72-ad25bfadf2cd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:51.986214 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c6792bd0-20d9-49d5-ba71-4cdd90ff8c46 tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a0dcfc2e-8978-4440-b8fe-2505e9c3a806" status: 202 len: 0 microversion: 2.1 time: 1.408304 May 19 04:37:51.987036 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 784/1588] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:37:50 2022] DELETE /compute/v2.1/os-security-groups/a0dcfc2e-8978-4440-b8fe-2505e9c3a806 => generated 0 bytes in 1411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:37:51.993049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e91dd2fe-65ab-4398-94c3-a541571dc6e1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:51.994059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e91dd2fe-65ab-4398-94c3-a541571dc6e1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:52.013632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e91dd2fe-65ab-4398-94c3-a541571dc6e1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:52.014548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e91dd2fe-65ab-4398-94c3-a541571dc6e1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:52.016526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e91dd2fe-65ab-4398-94c3-a541571dc6e1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:52.017892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e91dd2fe-65ab-4398-94c3-a541571dc6e1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:52.199966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5134840c-4403-4a2a-ad72-ad25bfadf2cd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:52.214709 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5134840c-4403-4a2a-ad72-ad25bfadf2cd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1319 microversion: 2.1 time: 0.670481 May 19 04:37:52.215910 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 805/1589] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:51 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1319 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:52.227479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:52.229830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:52.249442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:52.249442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:52.249442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:52.249442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:52.875714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e91dd2fe-65ab-4398-94c3-a541571dc6e1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:52.889888 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e91dd2fe-65ab-4398-94c3-a541571dc6e1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.901609 May 19 04:37:52.893220 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 785/1590] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:51 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:52.917814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c2cde43-a3c6-41f9-b1df-91e8f825f42e tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] Calling method '.version_select at 0x7fd315eaa5e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:52.978737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:52.997812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:53.000471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:53.002198 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b7c56d6-ca5f-4ee4-9829-2ffd47c4f28c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.785221 May 19 04:37:53.005825 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 806/1591] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:52 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:53.011933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:53.012989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:53.029534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:53.030332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:53.034269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:53.035907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:53.444503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:53.454883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:53.462933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:53.470481 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-87a07e33-aca9-4ba0-acd8-b82eab815a66 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1843 microversion: 2.32 time: 0.462376 May 19 04:37:53.471470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 807/1592] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:53 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1843 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:53.479351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ebab2d81-3967-4549-bfd4-35d18dd25695 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:53.481977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ebab2d81-3967-4549-bfd4-35d18dd25695 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:53.498763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebab2d81-3967-4549-bfd4-35d18dd25695 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:53.499330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebab2d81-3967-4549-bfd4-35d18dd25695 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:53.500271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebab2d81-3967-4549-bfd4-35d18dd25695 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:53.501772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebab2d81-3967-4549-bfd4-35d18dd25695 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:53.683705 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c2cde43-a3c6-41f9-b1df-91e8f825f42e tempest-SecurityGroupRulesTestJSON-1949379514 tempest-SecurityGroupRulesTestJSON-1949379514-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a0f140ca-171d-4d0a-b46c-73518e77946b" status: 202 len: 0 microversion: 2.1 time: 0.787360 May 19 04:37:53.684716 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 786/1593] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:37:52 2022] DELETE /compute/v2.1/os-security-groups/a0f140ca-171d-4d0a-b46c-73518e77946b => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:37:53.757623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d68dd1ff-cb02-424e-a77c-96de4e448d2e req-c80ddfae-321c-4254-8e04-6dd8fd6d9802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4618f82-a86e-423e-b1bf-472f02820ac8", "tag": "b810212d-5ce7-4434-8f84-db7f46236bf8"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:53.768452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d68dd1ff-cb02-424e-a77c-96de4e448d2e req-c80ddfae-321c-4254-8e04-6dd8fd6d9802 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:53.769034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d68dd1ff-cb02-424e-a77c-96de4e448d2e req-c80ddfae-321c-4254-8e04-6dd8fd6d9802 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:53.787084 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d68dd1ff-cb02-424e-a77c-96de4e448d2e req-c80ddfae-321c-4254-8e04-6dd8fd6d9802 service nova] Creating event network-changed:b810212d-5ce7-4434-8f84-db7f46236bf8 for instance c4618f82-a86e-423e-b1bf-472f02820ac8 on n-h2-766726-30 May 19 04:37:53.802997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d68dd1ff-cb02-424e-a77c-96de4e448d2e req-c80ddfae-321c-4254-8e04-6dd8fd6d9802 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048771 May 19 04:37:53.803827 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 787/1594] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:37:53.819940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ebab2d81-3967-4549-bfd4-35d18dd25695 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:53.834784 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ebab2d81-3967-4549-bfd4-35d18dd25695 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1319 microversion: 2.1 time: 0.359293 May 19 04:37:53.837485 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 808/1595] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:53 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:53.910645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c6a315fe-5981-4432-a19d-d6c3bedaaed5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:53.911438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c6a315fe-5981-4432-a19d-d6c3bedaaed5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:53.925917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6a315fe-5981-4432-a19d-d6c3bedaaed5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:53.926442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6a315fe-5981-4432-a19d-d6c3bedaaed5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:53.927308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6a315fe-5981-4432-a19d-d6c3bedaaed5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:53.927818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6a315fe-5981-4432-a19d-d6c3bedaaed5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:54.028086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:54.030689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:54.049345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:54.051004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:54.052725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:54.055872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:55.105585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:55.123912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:55.130153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:55.134544 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ece78cc8-d946-4c3e-89cc-9f6720446414 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 1.113340 May 19 04:37:55.136542 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 809/1596] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:54 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:55.150919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c6a315fe-5981-4432-a19d-d6c3bedaaed5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:55.151906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:55.152532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:55.163004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:55.167912 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c6a315fe-5981-4432-a19d-d6c3bedaaed5 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 1.262367 May 19 04:37:55.171120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:55.172538 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 788/1597] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:53 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:55.182136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:55.182811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:55.185997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1200a014-c7d1-468e-9424-257a8f14b8cc req-265b89a4-bcb1-46aa-9832-b80969f22746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e88a27f-1e50-491f-930a-9f759aad67f1", "name": "network-vif-plugged", "status": "completed", "tag": "eb06fa58-f656-4142-81af-c99f981eb02e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:55.204025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1200a014-c7d1-468e-9424-257a8f14b8cc req-265b89a4-bcb1-46aa-9832-b80969f22746 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:55.206236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1200a014-c7d1-468e-9424-257a8f14b8cc req-265b89a4-bcb1-46aa-9832-b80969f22746 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:55.233274 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1200a014-c7d1-468e-9424-257a8f14b8cc req-265b89a4-bcb1-46aa-9832-b80969f22746 service nova] Creating event network-vif-plugged:eb06fa58-f656-4142-81af-c99f981eb02e for instance 1e88a27f-1e50-491f-930a-9f759aad67f1 on n-h1-766726-30 May 19 04:37:55.248523 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1200a014-c7d1-468e-9424-257a8f14b8cc req-265b89a4-bcb1-46aa-9832-b80969f22746 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074085 May 19 04:37:55.249752 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 789/1598] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:55.256841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32e8593c-cf62-4670-be3f-ac877c08ecd9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:55.270148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-32e8593c-cf62-4670-be3f-ac877c08ecd9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:55.278203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32e8593c-cf62-4670-be3f-ac877c08ecd9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:55.278920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32e8593c-cf62-4670-be3f-ac877c08ecd9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:55.282696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32e8593c-cf62-4670-be3f-ac877c08ecd9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:55.283380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32e8593c-cf62-4670-be3f-ac877c08ecd9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:56.121650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:56.137411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:56.142240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:56.144794 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bc3ea212-7d9e-4e45-b314-bc354fd57ef1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1864 microversion: 2.32 time: 1.006438 May 19 04:37:56.148028 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 810/1599] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:55 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1864 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:56.168374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:56.169472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:56.193643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:56.194080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:56.194969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:56.195421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:56.239946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-32e8593c-cf62-4670-be3f-ac877c08ecd9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:56.249585 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-32e8593c-cf62-4670-be3f-ac877c08ecd9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1319 microversion: 2.1 time: 0.998255 May 19 04:37:56.250186 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 790/1600] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:55 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1319 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:56.272973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0509d1ae-8193-4bac-89e6-846779ba8edd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:56.273933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0509d1ae-8193-4bac-89e6-846779ba8edd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:56.280559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0509d1ae-8193-4bac-89e6-846779ba8edd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:56.281380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0509d1ae-8193-4bac-89e6-846779ba8edd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:56.282870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0509d1ae-8193-4bac-89e6-846779ba8edd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:56.283654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0509d1ae-8193-4bac-89e6-846779ba8edd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:56.539423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:56.550384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:56.553504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:56.555424 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5d1d4a00-157b-424c-9354-250cd58605ec tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.401807 May 19 04:37:56.556365 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 811/1601] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:56 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:56.689760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0509d1ae-8193-4bac-89e6-846779ba8edd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:56.705971 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0509d1ae-8193-4bac-89e6-846779ba8edd tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.444255 May 19 04:37:56.707055 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 791/1602] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:56 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:57.173711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:57.174481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:57.194514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:57.205903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:57.208379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:57.211889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:57.267605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-25b07930-2feb-45f6-ad72-961816098fc0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:57.268390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-25b07930-2feb-45f6-ad72-961816098fc0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:57.282686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25b07930-2feb-45f6-ad72-961816098fc0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:57.286417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25b07930-2feb-45f6-ad72-961816098fc0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:57.291874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25b07930-2feb-45f6-ad72-961816098fc0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:57.301513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25b07930-2feb-45f6-ad72-961816098fc0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:58.057318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:58.101105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:58.102974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-25b07930-2feb-45f6-ad72-961816098fc0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:58.106322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:58.111188 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3f173613-a50f-47f0-bc34-161f06a34d93 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1864 microversion: 2.32 time: 0.938787 May 19 04:37:58.111859 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 812/1603] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:57 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1864 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:58.122998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:58.125092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:58.126229 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-25b07930-2feb-45f6-ad72-961816098fc0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1319 microversion: 2.1 time: 0.862629 May 19 04:37:58.139395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:58.140011 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 792/1604] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:57 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1319 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:58.142241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:58.143081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:58.144056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:58.150283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86bb23da-ea71-4827-8dd4-a03784753386 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:58.160715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-86bb23da-ea71-4827-8dd4-a03784753386 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:58.172365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86bb23da-ea71-4827-8dd4-a03784753386 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:58.173182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86bb23da-ea71-4827-8dd4-a03784753386 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:58.176151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86bb23da-ea71-4827-8dd4-a03784753386 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:58.178780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86bb23da-ea71-4827-8dd4-a03784753386 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:58.250351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:37:58.650645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:58.669254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:58.670983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:58.672212 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5cc817d4-aeab-487c-a560-a78cba2a430c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.559327 May 19 04:37:58.685322 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 813/1605] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:58 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:37:58.697879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-86bb23da-ea71-4827-8dd4-a03784753386 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:58.701044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9f1cd96b-2fd1-4c1f-96ce-a0302f3380a8 req-387a5725-da35-42d5-8326-c1c021be3f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "tag": "a3ad3b69-cf1a-43c4-8bd9-bf577643ec6f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:37:58.715995 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-86bb23da-ea71-4827-8dd4-a03784753386 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1210 microversion: 2.1 time: 0.574551 May 19 04:37:58.717705 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 793/1606] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:58 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1210 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:37:58.738639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9f1cd96b-2fd1-4c1f-96ce-a0302f3380a8 req-387a5725-da35-42d5-8326-c1c021be3f07 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:58.739092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9f1cd96b-2fd1-4c1f-96ce-a0302f3380a8 req-387a5725-da35-42d5-8326-c1c021be3f07 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:58.768021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9f1cd96b-2fd1-4c1f-96ce-a0302f3380a8 req-387a5725-da35-42d5-8326-c1c021be3f07 service nova] Creating event network-changed:a3ad3b69-cf1a-43c4-8bd9-bf577643ec6f for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:37:58.777211 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9f1cd96b-2fd1-4c1f-96ce-a0302f3380a8 req-387a5725-da35-42d5-8326-c1c021be3f07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089195 May 19 04:37:58.778415 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 814/1607] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:37:59.135931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:59.138848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:59.152175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e50a80d-d828-4da7-9f64-1cd87bb795ef tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:59.155165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4e50a80d-d828-4da7-9f64-1cd87bb795ef tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:59.155897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:59.158961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:59.162421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:59.163817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:59.176705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e50a80d-d828-4da7-9f64-1cd87bb795ef tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:59.179180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e50a80d-d828-4da7-9f64-1cd87bb795ef tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:59.180016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e50a80d-d828-4da7-9f64-1cd87bb795ef tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:59.180465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e50a80d-d828-4da7-9f64-1cd87bb795ef tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:59.817498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4e50a80d-d828-4da7-9f64-1cd87bb795ef tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:59.826715 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4e50a80d-d828-4da7-9f64-1cd87bb795ef tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1319 microversion: 2.1 time: 0.684353 May 19 04:37:59.838382 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 815/1608] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:37:59 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1319 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:37:59.843471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:37:59.844225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:37:59.859126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:59.859727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:59.860812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:37:59.861531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:37:59.968484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:59.991670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:37:59.998192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:00.004845 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-840d8369-f0b6-494f-80b4-5f88e7cdbe26 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1864 microversion: 2.32 time: 0.877434 May 19 04:38:00.019134 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 794/1609] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:59 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1864 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:00.038301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae371f03-a64d-4cc4-a738-f0b222f0ac53 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:00.039388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ae371f03-a64d-4cc4-a738-f0b222f0ac53 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:00.046580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae371f03-a64d-4cc4-a738-f0b222f0ac53 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:00.048088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae371f03-a64d-4cc4-a738-f0b222f0ac53 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:00.050065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae371f03-a64d-4cc4-a738-f0b222f0ac53 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:00.050693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae371f03-a64d-4cc4-a738-f0b222f0ac53 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:00.273842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:00.305279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:00.309560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:00.312976 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aaa1448b-28d0-48a6-99cd-b8dbc89cc511 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.471198 May 19 04:38:00.316936 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 816/1610] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:37:59 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:00.496233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae371f03-a64d-4cc4-a738-f0b222f0ac53 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:00.512554 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae371f03-a64d-4cc4-a738-f0b222f0ac53 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1198 microversion: 2.1 time: 0.489928 May 19 04:38:00.526587 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 795/1611] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:00 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1198 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:00.701891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4a69ff54-c1d7-4672-8ea0-77e254e3ab1c req-0102f16f-50c4-4e7d-95a3-558385f2b19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4618f82-a86e-423e-b1bf-472f02820ac8", "name": "network-vif-plugged", "status": "completed", "tag": "b810212d-5ce7-4434-8f84-db7f46236bf8"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:00.719535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4a69ff54-c1d7-4672-8ea0-77e254e3ab1c req-0102f16f-50c4-4e7d-95a3-558385f2b19f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:00.720644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4a69ff54-c1d7-4672-8ea0-77e254e3ab1c req-0102f16f-50c4-4e7d-95a3-558385f2b19f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:00.747672 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4a69ff54-c1d7-4672-8ea0-77e254e3ab1c req-0102f16f-50c4-4e7d-95a3-558385f2b19f service nova] Creating event network-vif-plugged:b810212d-5ce7-4434-8f84-db7f46236bf8 for instance c4618f82-a86e-423e-b1bf-472f02820ac8 on n-h2-766726-30 May 19 04:38:00.754582 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4a69ff54-c1d7-4672-8ea0-77e254e3ab1c req-0102f16f-50c4-4e7d-95a3-558385f2b19f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057857 May 19 04:38:00.756532 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 817/1612] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:00.856065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-84beddbd-bdfc-4962-8d26-88794ce287f5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:00.857737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-84beddbd-bdfc-4962-8d26-88794ce287f5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:00.872925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:00.879732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84beddbd-bdfc-4962-8d26-88794ce287f5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:00.883169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84beddbd-bdfc-4962-8d26-88794ce287f5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:00.888678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84beddbd-bdfc-4962-8d26-88794ce287f5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:00.890532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84beddbd-bdfc-4962-8d26-88794ce287f5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:01.028107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:01.029008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:01.041716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:01.053407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:01.054381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:01.055031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:01.060817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:01.380358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-84beddbd-bdfc-4962-8d26-88794ce287f5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:01.389653 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-84beddbd-bdfc-4962-8d26-88794ce287f5 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1319 microversion: 2.1 time: 0.539010 May 19 04:38:01.392680 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 796/1613] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:00 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1319 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:01.404495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:01.410667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:01.417881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:01.422981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:01.423964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:01.425226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:01.567871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:01.586131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:01.588231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:01.589466 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bf59f3ad-c2c9-431c-bd1c-4f67aede6ea4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1864 microversion: 2.32 time: 0.567261 May 19 04:38:01.590043 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 818/1614] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:01 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1864 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:01.606248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7ddd432e-4502-467c-81d3-e1bfff1f940a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:01.607172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7ddd432e-4502-467c-81d3-e1bfff1f940a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:01.622244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ddd432e-4502-467c-81d3-e1bfff1f940a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:01.622698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ddd432e-4502-467c-81d3-e1bfff1f940a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:01.623748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ddd432e-4502-467c-81d3-e1bfff1f940a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:01.624191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ddd432e-4502-467c-81d3-e1bfff1f940a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:01.779060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:01.796830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:01.798315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:01.799519 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-638a107b-92ba-4c17-8ac2-ec74ef06d848 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.402819 May 19 04:38:01.800578 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 797/1615] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:01 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:01.805445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e7cab73d-b633-40b0-9297-82ed2fa4d6f2 req-ccff97bf-9813-4198-90d6-95fc040e0954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61799b1-3689-4c54-bb41-ac10d07bca57", "name": "network-vif-unplugged", "status": "completed", "tag": "7745425f-977a-42db-8a3d-6a421e366558"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:01.824165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e7cab73d-b633-40b0-9297-82ed2fa4d6f2 req-ccff97bf-9813-4198-90d6-95fc040e0954 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:01.833238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e7cab73d-b633-40b0-9297-82ed2fa4d6f2 req-ccff97bf-9813-4198-90d6-95fc040e0954 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:01.848492 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e7cab73d-b633-40b0-9297-82ed2fa4d6f2 req-ccff97bf-9813-4198-90d6-95fc040e0954 service nova] Creating event network-vif-unplugged:7745425f-977a-42db-8a3d-6a421e366558 for instance a61799b1-3689-4c54-bb41-ac10d07bca57 on n-h2-766726-30 May 19 04:38:01.862768 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e7cab73d-b633-40b0-9297-82ed2fa4d6f2 req-ccff97bf-9813-4198-90d6-95fc040e0954 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060652 May 19 04:38:01.863377 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 798/1616] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:01.935937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7ddd432e-4502-467c-81d3-e1bfff1f940a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:01.944475 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7ddd432e-4502-467c-81d3-e1bfff1f940a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1198 microversion: 2.1 time: 0.342090 May 19 04:38:01.950011 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 819/1617] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:01 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1198 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:02.498022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-424407878", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "725f31b8-0e87-4064-94dc-266df6d4a8df"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:02.569094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8493c307-de5a-4df1-b406-b74d605c05a1 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: .version_select at 0x7fd315f974c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-714100973", "description": "tempest-description-1735907905"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:02.584813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] validate_networks() for [('725f31b8-0e87-4064-94dc-266df6d4a8df', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:38:03.210411 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8493c307-de5a-4df1-b406-b74d605c05a1 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.886186 May 19 04:38:03.212769 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 820/1618] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:38:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:03.218385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eefbecdd-4ba7-4868-85d9-3f138d80351d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:03.219284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eefbecdd-4ba7-4868-85d9-3f138d80351d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:03.236076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eefbecdd-4ba7-4868-85d9-3f138d80351d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:03.237767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eefbecdd-4ba7-4868-85d9-3f138d80351d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:03.239387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eefbecdd-4ba7-4868-85d9-3f138d80351d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:03.240254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eefbecdd-4ba7-4868-85d9-3f138d80351d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:03.495412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:38:03.495743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:38:03.496959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:38:03.497634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:38:03.498769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:38:03.514317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:03.516592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:03.522840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:03.523682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:03.563587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Getting quotas for project 68c54dd93b5d484cb22316eb239828d4. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:38:03.564231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eefbecdd-4ba7-4868-85d9-3f138d80351d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:03.569342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Getting quotas for user 366806f44fa34ba8a7ad0a2e84f314eb and project 68c54dd93b5d484cb22316eb239828d4. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:38:03.578441 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eefbecdd-4ba7-4868-85d9-3f138d80351d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1469 microversion: 2.1 time: 0.364224 May 19 04:38:03.581389 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 821/1619] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:03 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1469 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:03.595413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:38:03.597848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:03.598477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:03.606460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:38:03.615578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:03.618736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:03.619583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:03.620057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:03.724050 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-902e1c2b-13ce-4503-871c-ae090b66ad5e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443391 May 19 04:38:03.725130 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 799/1620] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:38:03.735204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:03.735866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:03.751775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:03.752202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:03.758223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:03.758813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:04.276638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:04.324299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:04.328418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:04.330972 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e73e6d5f-9e59-4e63-a820-7a5605ccd807 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.745073 May 19 04:38:04.347802 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 822/1621] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:03 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:04.356323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d3c1dd2e-76a3-46fa-ab00-ad512e38003f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:04.356995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d3c1dd2e-76a3-46fa-ab00-ad512e38003f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:04.372832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3c1dd2e-76a3-46fa-ab00-ad512e38003f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:04.373924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3c1dd2e-76a3-46fa-ab00-ad512e38003f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:04.374996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3c1dd2e-76a3-46fa-ab00-ad512e38003f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:04.380727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3c1dd2e-76a3-46fa-ab00-ad512e38003f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:04.382564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:04.398787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:04.402380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:04.408079 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5c2d1a5a-7139-479d-a73f-3c75375385bf tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.681790 May 19 04:38:04.411067 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 800/1622] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:03 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:04.433582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2e1613fb-4612-4291-8afd-45dea3325e4d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: .version_select at 0x7fd316503310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-839806423", "description": "tempest-description-2124843691"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:04.606223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d3c1dd2e-76a3-46fa-ab00-ad512e38003f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:04.628380 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d3c1dd2e-76a3-46fa-ab00-ad512e38003f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1198 microversion: 2.1 time: 0.279188 May 19 04:38:04.631210 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 823/1623] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:04 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1198 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:04.797750 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2e1613fb-4612-4291-8afd-45dea3325e4d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.385271 May 19 04:38:04.798352 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 801/1624] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:38:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:04.803580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c10b9ad5-f870-49d5-8e00-ff0e291fb713 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:04.804202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c10b9ad5-f870-49d5-8e00-ff0e291fb713 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 1e88a27f-1e50-491f-930a-9f759aad67f1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:04.816712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d258e492-ad14-44f6-aa3e-23745cf8d962 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Action: 'create', calling method: .version_select at 0x7fd316061b80>, body: {"keypair": {"name": "tempest-keypair-337937475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vgXTOpJZ+sccc5eIDaU+RuiqE7xXj7rJuQzFKXwTrhRT+BKg5wWhSsM/PjyHb1qd+b0Jcznw6Kpq33UT/pJfbZGNszAeKBhusFw4fsqfpm8F6GSLZmXDD8TF4OTy+Bg=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:04.823855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c10b9ad5-f870-49d5-8e00-ff0e291fb713 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:04.824326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c10b9ad5-f870-49d5-8e00-ff0e291fb713 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:04.825157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c10b9ad5-f870-49d5-8e00-ff0e291fb713 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:04.825849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c10b9ad5-f870-49d5-8e00-ff0e291fb713 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:04.852278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-d258e492-ad14-44f6-aa3e-23745cf8d962 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Getting quotas for project 5288075b50854cdeab0ea7f2a5ae5398. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:38:04.867233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-d258e492-ad14-44f6-aa3e-23745cf8d962 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Getting quotas for user 51afd277134b4917bc0edcd44443ef04 and project 5288075b50854cdeab0ea7f2a5ae5398. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:38:04.933013 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d258e492-ad14-44f6-aa3e-23745cf8d962 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.300438 May 19 04:38:04.934033 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 824/1625] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:38:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:04.944416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4cac5e47-0800-42fa-9ee5-db1e2edd0bb1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:04.945042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4cac5e47-0800-42fa-9ee5-db1e2edd0bb1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:04.962066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cac5e47-0800-42fa-9ee5-db1e2edd0bb1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:04.962813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cac5e47-0800-42fa-9ee5-db1e2edd0bb1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:04.973517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cac5e47-0800-42fa-9ee5-db1e2edd0bb1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:04.974646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cac5e47-0800-42fa-9ee5-db1e2edd0bb1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:05.116902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4cac5e47-0800-42fa-9ee5-db1e2edd0bb1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:05.125709 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4cac5e47-0800-42fa-9ee5-db1e2edd0bb1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1221 microversion: 2.1 time: 0.190552 May 19 04:38:05.128771 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 825/1626] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:04 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1221 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:05.134866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-739e2af4-7e3e-47b5-9097-27cf2ee9d35b req-ed29c4d9-ebf1-4e09-ab2e-18b0a4b1c3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61799b1-3689-4c54-bb41-ac10d07bca57", "tag": "7745425f-977a-42db-8a3d-6a421e366558"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:05.165366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-739e2af4-7e3e-47b5-9097-27cf2ee9d35b req-ed29c4d9-ebf1-4e09-ab2e-18b0a4b1c3e8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:05.166250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-739e2af4-7e3e-47b5-9097-27cf2ee9d35b req-ed29c4d9-ebf1-4e09-ab2e-18b0a4b1c3e8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:05.185383 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-739e2af4-7e3e-47b5-9097-27cf2ee9d35b req-ed29c4d9-ebf1-4e09-ab2e-18b0a4b1c3e8 service nova] Creating event network-changed:7745425f-977a-42db-8a3d-6a421e366558 for instance a61799b1-3689-4c54-bb41-ac10d07bca57 on n-h2-766726-30 May 19 04:38:05.202951 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-739e2af4-7e3e-47b5-9097-27cf2ee9d35b req-ed29c4d9-ebf1-4e09-ab2e-18b0a4b1c3e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072046 May 19 04:38:05.204230 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 826/1627] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:05.209940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2068142364", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "086db77f-147f-4c2e-996c-a366ebcb0f52"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:05.215674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c10b9ad5-f870-49d5-8e00-ff0e291fb713 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:05.224679 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c10b9ad5-f870-49d5-8e00-ff0e291fb713 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1" status: 200 len: 1469 microversion: 2.1 time: 0.425253 May 19 04:38:05.241587 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 802/1628] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:04 2022] GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1 => generated 1469 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:05.250328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:05.262429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:05.263708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Searching by: {'reservation_id': 'r-5lcuqze1', 'deleted': False, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:38:05.277642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:05.278514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:05.281724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:05.282512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:05.364827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] validate_networks() for [('086db77f-147f-4c2e-996c-a366ebcb0f52', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:38:05.439395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:38:05.573474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:05.591930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:05.592759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:06.011543 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c7c9a675-e02f-4fab-9b1e-168427ead505 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-5lcuqze1" status: 200 len: 2931 microversion: 2.1 time: 0.768179 May 19 04:38:06.020891 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 803/1629] 10.222.0.58 () {58 vars in 1196 bytes} [Thu May 19 04:38:05 2022] GET /compute/v2.1/servers/detail?reservation_id=r-5lcuqze1 => generated 2931 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:06.027727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:06.028359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:06.061915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:06.062992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:06.071053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:06.074190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:07.148766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:38:07.149365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:38:07.149679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:38:07.150641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:38:07.151051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:38:07.167086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:07.171466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:07.172558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:07.175053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:07.218160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:07.231614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Getting quotas for project 645df4342899445a910f1e00063507b4. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:38:07.236530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:07.240561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:07.241792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:07.247773 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-711f9862-37c6-4f6d-83b0-56d10d934f63 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 1.223239 May 19 04:38:07.256761 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 804/1630] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:06 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:07.257356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Getting quotas for user 80fcb65cf5734252970667c2ad2a8e86 and project 645df4342899445a910f1e00063507b4. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:38:07.272034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:07.274072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:07.296674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:07.298844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:07.302878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:07.303212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:38:07.306190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:07.308294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:38:07.442846 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a2824abe-e763-4b1d-b5aa-b26a95f1985d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.237029 May 19 04:38:07.443828 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 827/1631] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:38:07.449570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f5cc52ab-5b6b-4e6b-91f5-828fd178a05a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:07.450512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f5cc52ab-5b6b-4e6b-91f5-828fd178a05a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:07.459663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5cc52ab-5b6b-4e6b-91f5-828fd178a05a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:07.460459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5cc52ab-5b6b-4e6b-91f5-828fd178a05a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:07.461532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5cc52ab-5b6b-4e6b-91f5-828fd178a05a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:07.462240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5cc52ab-5b6b-4e6b-91f5-828fd178a05a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.014556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:08.026884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:08.037971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:08.039373 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c8aa3b0-a82b-4d58-984f-9456edaed183 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.780807 May 19 04:38:08.050782 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 805/1632] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:07 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:08.060970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-36ce5b70-fc70-4802-bee8-a2a21094994b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:08.094773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.compute.server_groups [None req-36ce5b70-fc70-4802-bee8-a2a21094994b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Querying cell c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) for 2 instances {{(pid=124819) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 19 04:38:08.095607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36ce5b70-fc70-4802-bee8-a2a21094994b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.096061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36ce5b70-fc70-4802-bee8-a2a21094994b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.160525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f5cc52ab-5b6b-4e6b-91f5-828fd178a05a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:08.169531 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f5cc52ab-5b6b-4e6b-91f5-828fd178a05a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1198 microversion: 2.1 time: 0.724318 May 19 04:38:08.172455 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 828/1633] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:07 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1198 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:08.184733 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-36ce5b70-fc70-4802-bee8-a2a21094994b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/33b82acc-749b-4ac8-8e9b-41ea6ee8ac73" status: 200 len: 269 microversion: 2.1 time: 0.129794 May 19 04:38:08.186889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96bab11b-5425-47f8-ad36-05f1c3e9e9e5 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:08.189157 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 806/1634] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:38:08 2022] GET /compute/v2.1/os-server-groups/33b82acc-749b-4ac8-8e9b-41ea6ee8ac73 => generated 269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:08.190126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96bab11b-5425-47f8-ad36-05f1c3e9e9e5 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:08.209654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96bab11b-5425-47f8-ad36-05f1c3e9e9e5 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.210780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-c492cbd6-6c02-4103-a706-d52d6f1b911d req-8ef62944-3456-4870-ae76-b2a0f5aa85b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "tag": "eadc183f-7173-49b5-b11b-74d6ac02aa3f"}, {"name": "network-changed", "server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "tag": "0d520ead-ade4-471e-93f7-b40ec3e08c30"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:08.222073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96bab11b-5425-47f8-ad36-05f1c3e9e9e5 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.225567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96bab11b-5425-47f8-ad36-05f1c3e9e9e5 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.232022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96bab11b-5425-47f8-ad36-05f1c3e9e9e5 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.242006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c492cbd6-6c02-4103-a706-d52d6f1b911d req-8ef62944-3456-4870-ae76-b2a0f5aa85b8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.285929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c492cbd6-6c02-4103-a706-d52d6f1b911d req-8ef62944-3456-4870-ae76-b2a0f5aa85b8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.329026 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-c492cbd6-6c02-4103-a706-d52d6f1b911d req-8ef62944-3456-4870-ae76-b2a0f5aa85b8 service nova] Creating event network-changed:eadc183f-7173-49b5-b11b-74d6ac02aa3f for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:38:08.330929 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-c492cbd6-6c02-4103-a706-d52d6f1b911d req-8ef62944-3456-4870-ae76-b2a0f5aa85b8 service nova] Creating event network-changed:0d520ead-ade4-471e-93f7-b40ec3e08c30 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:38:08.356629 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-c492cbd6-6c02-4103-a706-d52d6f1b911d req-8ef62944-3456-4870-ae76-b2a0f5aa85b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.166104 May 19 04:38:08.374843 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 807/1635] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:08.396813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-994a36eb-55b4-4e48-8bfd-3830ec1541a4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:08.402733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-994a36eb-55b4-4e48-8bfd-3830ec1541a4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:08.422358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-994a36eb-55b4-4e48-8bfd-3830ec1541a4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.422886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-994a36eb-55b4-4e48-8bfd-3830ec1541a4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.423751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-994a36eb-55b4-4e48-8bfd-3830ec1541a4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.424436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-994a36eb-55b4-4e48-8bfd-3830ec1541a4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.547011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-96bab11b-5425-47f8-ad36-05f1c3e9e9e5 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:08.561842 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96bab11b-5425-47f8-ad36-05f1c3e9e9e5 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1275 microversion: 2.1 time: 0.379188 May 19 04:38:08.578884 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 829/1636] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:08 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1275 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:08.586388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a884a9b-26da-4dca-a857-877ff0664e2d tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:08.588056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2a884a9b-26da-4dca-a857-877ff0664e2d tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] [instance: 1e88a27f-1e50-491f-930a-9f759aad67f1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:08.618170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a884a9b-26da-4dca-a857-877ff0664e2d tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.624602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a884a9b-26da-4dca-a857-877ff0664e2d tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.625857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a884a9b-26da-4dca-a857-877ff0664e2d tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.626494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a884a9b-26da-4dca-a857-877ff0664e2d tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.734249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-994a36eb-55b4-4e48-8bfd-3830ec1541a4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:08.748710 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-994a36eb-55b4-4e48-8bfd-3830ec1541a4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1220 microversion: 2.1 time: 0.368032 May 19 04:38:08.767487 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 808/1637] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:08 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1220 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:08.772925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:08.773994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:08.789128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.799872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:08.801115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:08.801792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:09.371276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:09.394180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:09.398340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:09.401895 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0aa9b185-7d17-4f31-a60f-719c22b15e38 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.631512 May 19 04:38:09.404265 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 809/1638] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:08 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:09.410284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:09.411131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:09.429309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:09.430732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:09.436026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:09.451358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:09.487973 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2a884a9b-26da-4dca-a857-877ff0664e2d tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1" status: 200 len: 1622 microversion: 2.1 time: 0.906125 May 19 04:38:09.490566 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 830/1639] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:08 2022] GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1 => generated 1622 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:09.501443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b91aac4b-d4cd-4a68-8bd6-772c563e7c3f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:09.502701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b91aac4b-d4cd-4a68-8bd6-772c563e7c3f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:09.518488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b91aac4b-d4cd-4a68-8bd6-772c563e7c3f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:09.519450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b91aac4b-d4cd-4a68-8bd6-772c563e7c3f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:09.531941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b91aac4b-d4cd-4a68-8bd6-772c563e7c3f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:09.532796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b91aac4b-d4cd-4a68-8bd6-772c563e7c3f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:09.934051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:09.952395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:09.955292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:09.959104 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae847376-b8d4-47a5-8330-01fec5f9b086 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.552681 May 19 04:38:09.959710 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 810/1640] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:09 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:09.973311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8502b2e-d40e-4209-8311-8ad4dc19b641 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:09.973934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e8502b2e-d40e-4209-8311-8ad4dc19b641 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:09.982944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8502b2e-d40e-4209-8311-8ad4dc19b641 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:09.983399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8502b2e-d40e-4209-8311-8ad4dc19b641 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:09.984201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8502b2e-d40e-4209-8311-8ad4dc19b641 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:09.984642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8502b2e-d40e-4209-8311-8ad4dc19b641 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:10.015185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b91aac4b-d4cd-4a68-8bd6-772c563e7c3f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:10.023612 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b91aac4b-d4cd-4a68-8bd6-772c563e7c3f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1198 microversion: 2.1 time: 0.530547 May 19 04:38:10.024219 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 831/1641] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:09 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1198 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:10.040577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-912f3171-d9b4-48fe-8927-4c7c0941682a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:10.041510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-912f3171-d9b4-48fe-8927-4c7c0941682a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:10.051563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-912f3171-d9b4-48fe-8927-4c7c0941682a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:10.051959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-912f3171-d9b4-48fe-8927-4c7c0941682a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:10.052743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-912f3171-d9b4-48fe-8927-4c7c0941682a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:10.053233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-912f3171-d9b4-48fe-8927-4c7c0941682a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:10.330633 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e8502b2e-d40e-4209-8311-8ad4dc19b641 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 200 len: 1622 microversion: 2.1 time: 0.368927 May 19 04:38:10.332429 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 811/1642] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:09 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 1622 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:10.352666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ef740de-e634-4235-a3f9-7b3611a3c5ef tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:10.355765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-912f3171-d9b4-48fe-8927-4c7c0941682a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:10.356886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9ef740de-e634-4235-a3f9-7b3611a3c5ef tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:10.369693 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-912f3171-d9b4-48fe-8927-4c7c0941682a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1317 microversion: 2.1 time: 0.337708 May 19 04:38:10.381882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ef740de-e634-4235-a3f9-7b3611a3c5ef tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:10.385832 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 832/1643] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:10 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:10.392833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ef740de-e634-4235-a3f9-7b3611a3c5ef tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:10.399263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ef740de-e634-4235-a3f9-7b3611a3c5ef tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:10.401319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ef740de-e634-4235-a3f9-7b3611a3c5ef tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:10.426329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:10.427235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:10.439583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:10.443817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:10.448273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:10.449044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:10.564631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9ef740de-e634-4235-a3f9-7b3611a3c5ef tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:10.583793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:10.593210 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ef740de-e634-4235-a3f9-7b3611a3c5ef tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1276 microversion: 2.1 time: 0.256834 May 19 04:38:10.607970 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 812/1644] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:10 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:10.617807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ce1faa02-42f0-4f7e-8ba6-2f4ee41428e2 req-72fd6725-42cd-4641-9150-9d1706da90be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "tag": "c98bb199-4633-4d92-8f73-35d11894ef17"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:10.647601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ce1faa02-42f0-4f7e-8ba6-2f4ee41428e2 req-72fd6725-42cd-4641-9150-9d1706da90be service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:10.649587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ce1faa02-42f0-4f7e-8ba6-2f4ee41428e2 req-72fd6725-42cd-4641-9150-9d1706da90be service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:10.685410 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ce1faa02-42f0-4f7e-8ba6-2f4ee41428e2 req-72fd6725-42cd-4641-9150-9d1706da90be service nova] Creating event network-changed:c98bb199-4633-4d92-8f73-35d11894ef17 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:38:10.699264 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ce1faa02-42f0-4f7e-8ba6-2f4ee41428e2 req-72fd6725-42cd-4641-9150-9d1706da90be service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096932 May 19 04:38:10.701645 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 813/1645] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:10.732534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1805781779", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "e626b1ac-a89d-4758-84dd-4367faa06cde"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:10.846864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:38:11.544548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:11.555428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:11.571995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:11.573543 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a958a353-70f8-40f3-b043-db4a6a61d038 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 1.153194 May 19 04:38:11.574626 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 833/1646] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:10 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:11.584053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:11.584740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:11.597828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:11.605844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:11.606978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:11.607600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:12.044413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:38:12.044990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:38:12.045363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:38:12.045730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:38:12.046144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:38:12.074993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:12.075954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:12.076951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:12.077617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:12.141518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:38:12.158488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:38:12.219124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:38:12.224492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:38:12.320635 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c5edf55-00a7-41a3-a551-c0dfab4ecc38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.615521 May 19 04:38:12.329975 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 814/1647] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:38:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:38:12.351451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4be55a0e-f7de-463e-a439-b5b5382711bf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:12.352503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4be55a0e-f7de-463e-a439-b5b5382711bf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:12.367911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be55a0e-f7de-463e-a439-b5b5382711bf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:12.371719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be55a0e-f7de-463e-a439-b5b5382711bf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:12.372599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be55a0e-f7de-463e-a439-b5b5382711bf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:12.376065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be55a0e-f7de-463e-a439-b5b5382711bf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:13.182204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:13.200108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:13.207575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:13.216481 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a9abe0d-debd-4797-aaf0-5993710d509c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 1.636837 May 19 04:38:13.217644 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 834/1648] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:11 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:13.232817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ffcea32f-c7ac-41ed-86ae-4e6f61a242a4 req-9665654b-6f1b-4121-a077-17fbffe28cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3", "name": "network-vif-plugged", "status": "completed", "tag": "a9e4213a-1542-42bf-9830-906fd7d9a1a7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:13.258635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ffcea32f-c7ac-41ed-86ae-4e6f61a242a4 req-9665654b-6f1b-4121-a077-17fbffe28cd7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:13.263557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ffcea32f-c7ac-41ed-86ae-4e6f61a242a4 req-9665654b-6f1b-4121-a077-17fbffe28cd7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:13.295975 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ffcea32f-c7ac-41ed-86ae-4e6f61a242a4 req-9665654b-6f1b-4121-a077-17fbffe28cd7 service nova] Creating event network-vif-plugged:a9e4213a-1542-42bf-9830-906fd7d9a1a7 for instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 on n-h2-766726-30 May 19 04:38:13.313671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ffcea32f-c7ac-41ed-86ae-4e6f61a242a4 req-9665654b-6f1b-4121-a077-17fbffe28cd7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090561 May 19 04:38:13.325749 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 835/1649] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:13.371574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1d195573-c11b-47e4-bb1e-4be484385c60 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:13.372929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1d195573-c11b-47e4-bb1e-4be484385c60 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:13.390587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d195573-c11b-47e4-bb1e-4be484385c60 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:13.391180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d195573-c11b-47e4-bb1e-4be484385c60 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:13.392047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d195573-c11b-47e4-bb1e-4be484385c60 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:13.393327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d195573-c11b-47e4-bb1e-4be484385c60 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:13.625730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4be55a0e-f7de-463e-a439-b5b5382711bf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:13.641673 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4be55a0e-f7de-463e-a439-b5b5382711bf tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1198 microversion: 2.1 time: 1.305811 May 19 04:38:13.643028 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 815/1650] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:12 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1198 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:13.661141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3177c0ac-f7f7-4a11-a8f4-dacb949675f6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:13.664033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3177c0ac-f7f7-4a11-a8f4-dacb949675f6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:13.687824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3177c0ac-f7f7-4a11-a8f4-dacb949675f6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:13.701732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3177c0ac-f7f7-4a11-a8f4-dacb949675f6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:13.702817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3177c0ac-f7f7-4a11-a8f4-dacb949675f6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:13.703954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3177c0ac-f7f7-4a11-a8f4-dacb949675f6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:13.792932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1d195573-c11b-47e4-bb1e-4be484385c60 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:13.802692 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1d195573-c11b-47e4-bb1e-4be484385c60 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1317 microversion: 2.1 time: 0.475268 May 19 04:38:13.817456 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 836/1651] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:13 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:13.829146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7521978e-cad9-41db-985c-2945fcc9c944 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:13.832707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7521978e-cad9-41db-985c-2945fcc9c944 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:13.850157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7521978e-cad9-41db-985c-2945fcc9c944 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:13.850406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7521978e-cad9-41db-985c-2945fcc9c944 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:13.851204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7521978e-cad9-41db-985c-2945fcc9c944 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:13.855009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7521978e-cad9-41db-985c-2945fcc9c944 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:14.094727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7521978e-cad9-41db-985c-2945fcc9c944 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:14.104081 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7521978e-cad9-41db-985c-2945fcc9c944 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1269 microversion: 2.1 time: 0.279427 May 19 04:38:14.111599 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 837/1652] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:13 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1269 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:14.116551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:14.121519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:14.132077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:14.137679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:14.138346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:14.138798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:14.190195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3177c0ac-f7f7-4a11-a8f4-dacb949675f6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:14.206962 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3177c0ac-f7f7-4a11-a8f4-dacb949675f6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1316 microversion: 2.1 time: 0.562250 May 19 04:38:14.207650 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 816/1653] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:13 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:14.221749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-130f5ad0-2373-444d-863e-db6e405fd3e0 req-2c01bd1f-4ff0-41d9-81ad-217978884691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2487ebd4-e36c-404c-9c5f-76aa7a3bf41b", "tag": "c03ba391-adc5-4ec1-8242-3aa5aca306ce"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:14.246775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-130f5ad0-2373-444d-863e-db6e405fd3e0 req-2c01bd1f-4ff0-41d9-81ad-217978884691 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:14.247230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-130f5ad0-2373-444d-863e-db6e405fd3e0 req-2c01bd1f-4ff0-41d9-81ad-217978884691 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:14.290482 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-130f5ad0-2373-444d-863e-db6e405fd3e0 req-2c01bd1f-4ff0-41d9-81ad-217978884691 service nova] Creating event network-changed:c03ba391-adc5-4ec1-8242-3aa5aca306ce for instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b on n-h1-766726-30 May 19 04:38:14.295431 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-130f5ad0-2373-444d-863e-db6e405fd3e0 req-2c01bd1f-4ff0-41d9-81ad-217978884691 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077281 May 19 04:38:14.296607 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 817/1654] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:14.302814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-564874347", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7c3cf126-899f-4ac7-b369-65d5c5b77d1d"}], "security_groups": [{"name": "tempest-securitygroup--482199818"}], "key_name": "tempest-keypair-337937475", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:14.521285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:14.524541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:14.536154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:14.545793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:14.551924 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60f843ca-8c50-4e55-8c93-386bf7c38ddc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.438849 May 19 04:38:14.553198 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 838/1655] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:14 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:14.567535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:14.568597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:14.585400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:14.586416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:14.589800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:14.590450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:14.725572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] validate_networks() for [('7c3cf126-899f-4ac7-b369-65d5c5b77d1d', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:38:15.006054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:15.015742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:15.021509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:15.027629 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-85140624-b2be-406b-8706-f7ba8dc7e34a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.472926 May 19 04:38:15.028263 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 839/1656] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:14 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:15.045413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1fd46577-52f8-45a3-bb76-0257523c1e4e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:15.046126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1fd46577-52f8-45a3-bb76-0257523c1e4e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:15.066334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fd46577-52f8-45a3-bb76-0257523c1e4e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.066937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fd46577-52f8-45a3-bb76-0257523c1e4e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.067807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fd46577-52f8-45a3-bb76-0257523c1e4e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.068493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fd46577-52f8-45a3-bb76-0257523c1e4e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.322712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1fd46577-52f8-45a3-bb76-0257523c1e4e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:15.334005 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1fd46577-52f8-45a3-bb76-0257523c1e4e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1198 microversion: 2.1 time: 0.304655 May 19 04:38:15.335115 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 840/1657] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:15 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1198 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:15.344262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2d34b56e-56c0-43b0-92e9-35e1a3a38096 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:15.349957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2d34b56e-56c0-43b0-92e9-35e1a3a38096 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:15.371699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d34b56e-56c0-43b0-92e9-35e1a3a38096 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.373696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d34b56e-56c0-43b0-92e9-35e1a3a38096 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.374735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d34b56e-56c0-43b0-92e9-35e1a3a38096 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.375410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d34b56e-56c0-43b0-92e9-35e1a3a38096 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.648940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Getting quotas for project 5288075b50854cdeab0ea7f2a5ae5398. Resources: dict_keys(['metadata_items']) {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:38:15.656098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Getting quotas for user 51afd277134b4917bc0edcd44443ef04 and project 5288075b50854cdeab0ea7f2a5ae5398. Resources: dict_keys(['metadata_items']) {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:38:15.659554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2d34b56e-56c0-43b0-92e9-35e1a3a38096 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:15.671212 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2d34b56e-56c0-43b0-92e9-35e1a3a38096 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1317 microversion: 2.1 time: 0.334763 May 19 04:38:15.678070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:38:15.678582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:38:15.679504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:38:15.680015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:38:15.680499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:38:15.686325 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 841/1658] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:15 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:15.693458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.693809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-21d83526-f422-4fa5-8bfc-0a87ac67c37b req-fd888aec-7ccb-4c13-ae3a-be61f5a10a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "tag": "4ade1fa2-1f84-447f-bdda-2b80cce5bf66"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:15.694517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.695715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.696452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.725721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Getting quotas for project 5288075b50854cdeab0ea7f2a5ae5398. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:38:15.734802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-21d83526-f422-4fa5-8bfc-0a87ac67c37b req-fd888aec-7ccb-4c13-ae3a-be61f5a10a8d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.735253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-21d83526-f422-4fa5-8bfc-0a87ac67c37b req-fd888aec-7ccb-4c13-ae3a-be61f5a10a8d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.736564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Getting quotas for user 51afd277134b4917bc0edcd44443ef04 and project 5288075b50854cdeab0ea7f2a5ae5398. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:38:15.757837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:38:15.762634 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-21d83526-f422-4fa5-8bfc-0a87ac67c37b req-fd888aec-7ccb-4c13-ae3a-be61f5a10a8d service nova] Creating event network-changed:4ade1fa2-1f84-447f-bdda-2b80cce5bf66 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:38:15.764793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:38:15.775983 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-21d83526-f422-4fa5-8bfc-0a87ac67c37b req-fd888aec-7ccb-4c13-ae3a-be61f5a10a8d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085101 May 19 04:38:15.779113 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 842/1659] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:15.809965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ff274202-f2de-47d1-ad1d-af71293f12f9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:15.812330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ff274202-f2de-47d1-ad1d-af71293f12f9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:15.831602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff274202-f2de-47d1-ad1d-af71293f12f9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.832905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff274202-f2de-47d1-ad1d-af71293f12f9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.833773 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-381c8d5e-c307-4d9a-be5f-bbda93579a84 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.535276 May 19 04:38:15.834755 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 818/1660] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:38:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:38:15.840847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff274202-f2de-47d1-ad1d-af71293f12f9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.842930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff274202-f2de-47d1-ad1d-af71293f12f9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.845380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-98beb18f-e525-443b-83fa-c9dbcf8a95bc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:15.846555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-98beb18f-e525-443b-83fa-c9dbcf8a95bc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:15.854752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:15.859498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98beb18f-e525-443b-83fa-c9dbcf8a95bc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.860341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98beb18f-e525-443b-83fa-c9dbcf8a95bc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:15.878265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98beb18f-e525-443b-83fa-c9dbcf8a95bc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:15.878805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98beb18f-e525-443b-83fa-c9dbcf8a95bc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:16.022445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ff274202-f2de-47d1-ad1d-af71293f12f9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:16.043192 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ff274202-f2de-47d1-ad1d-af71293f12f9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1275 microversion: 2.1 time: 0.246430 May 19 04:38:16.044602 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 843/1661] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:15 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:16.062455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:16.063105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:16.080628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:16.081103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:16.081889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:16.082330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:16.721772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:16.754020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:16.756707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:16.773574 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-448f46cf-891c-45b4-b40d-e83d0d6e85c6 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.725335 May 19 04:38:16.776194 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 844/1662] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:16 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:16.787999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-98beb18f-e525-443b-83fa-c9dbcf8a95bc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:16.791439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d7574a83-5435-436f-b43b-f7337426fdd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:16.793837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d7574a83-5435-436f-b43b-f7337426fdd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:16.798437 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-98beb18f-e525-443b-83fa-c9dbcf8a95bc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1316 microversion: 2.1 time: 0.961489 May 19 04:38:16.799027 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 819/1663] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:15 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1316 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:16.817386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7574a83-5435-436f-b43b-f7337426fdd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:16.819701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7574a83-5435-436f-b43b-f7337426fdd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:16.822581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7574a83-5435-436f-b43b-f7337426fdd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:16.824367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7574a83-5435-436f-b43b-f7337426fdd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:16.826619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:16.827236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:16.856926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:16.857413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:16.858207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:16.858650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:17.160955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d7574a83-5435-436f-b43b-f7337426fdd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:17.170545 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d7574a83-5435-436f-b43b-f7337426fdd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1280 microversion: 2.1 time: 0.392609 May 19 04:38:17.180089 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 845/1664] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:16 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1280 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:17.199853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7898627d-f5ec-490d-b07d-9b41dd3f59ec tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:17.200586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7898627d-f5ec-490d-b07d-9b41dd3f59ec tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:17.213955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:17.215516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7898627d-f5ec-490d-b07d-9b41dd3f59ec tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:17.220413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7898627d-f5ec-490d-b07d-9b41dd3f59ec tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:17.222063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7898627d-f5ec-490d-b07d-9b41dd3f59ec tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:17.225812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7898627d-f5ec-490d-b07d-9b41dd3f59ec tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:17.282413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=10 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:17.865607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7898627d-f5ec-490d-b07d-9b41dd3f59ec tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:17.880322 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7898627d-f5ec-490d-b07d-9b41dd3f59ec tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1380 microversion: 2.1 time: 0.699091 May 19 04:38:17.891630 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 846/1665] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:17 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1380 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:17.892005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-80eaba1b-e59f-49e1-a679-9f0b8eca1182 req-9f12f276-5eb0-4e66-97a9-65a9ec976e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37301659-d7ed-41fe-be72-46f2e9185650", "tag": "33fd5ca9-39f1-4823-9bb9-fd2d27226a63"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:17.919977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-80eaba1b-e59f-49e1-a679-9f0b8eca1182 req-9f12f276-5eb0-4e66-97a9-65a9ec976e7a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:17.924038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-80eaba1b-e59f-49e1-a679-9f0b8eca1182 req-9f12f276-5eb0-4e66-97a9-65a9ec976e7a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:17.943613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:17.966648 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-80eaba1b-e59f-49e1-a679-9f0b8eca1182 req-9f12f276-5eb0-4e66-97a9-65a9ec976e7a service nova] Creating event network-changed:33fd5ca9-39f1-4823-9bb9-fd2d27226a63 for instance 37301659-d7ed-41fe-be72-46f2e9185650 on n-h1-766726-30 May 19 04:38:17.966993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:17.978410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:17.981866 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-80eaba1b-e59f-49e1-a679-9f0b8eca1182 req-9f12f276-5eb0-4e66-97a9-65a9ec976e7a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095949 May 19 04:38:17.982584 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 847/1666] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:17.989118 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4802ad62-9a03-451a-9e7e-48875b3469cd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 1.164212 May 19 04:38:17.989863 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 820/1667] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:16 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:18.010380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3cc71e3-f7ef-4583-8891-3f6b5ec412f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:18.010625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a977f87-b96e-4618-b927-5f9ff6d4c2ce tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:18.011264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a977f87-b96e-4618-b927-5f9ff6d4c2ce tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:18.013425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3cc71e3-f7ef-4583-8891-3f6b5ec412f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:18.035154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a977f87-b96e-4618-b927-5f9ff6d4c2ce tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:18.035596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a977f87-b96e-4618-b927-5f9ff6d4c2ce tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:18.042312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a977f87-b96e-4618-b927-5f9ff6d4c2ce tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:18.047868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3cc71e3-f7ef-4583-8891-3f6b5ec412f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:18.048101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a977f87-b96e-4618-b927-5f9ff6d4c2ce tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:18.048825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3cc71e3-f7ef-4583-8891-3f6b5ec412f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:18.055603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3cc71e3-f7ef-4583-8891-3f6b5ec412f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:18.060411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3cc71e3-f7ef-4583-8891-3f6b5ec412f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:18.883939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3cc71e3-f7ef-4583-8891-3f6b5ec412f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:18.897499 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3cc71e3-f7ef-4583-8891-3f6b5ec412f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1317 microversion: 2.1 time: 0.903944 May 19 04:38:18.898440 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 821/1668] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:17 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:18.903561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:18.907641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:18.924036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:18.924513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:18.925212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a977f87-b96e-4618-b927-5f9ff6d4c2ce tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:18.928508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:18.928991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:18.941364 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a977f87-b96e-4618-b927-5f9ff6d4c2ce tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1317 microversion: 2.1 time: 0.957771 May 19 04:38:18.945690 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 848/1669] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:17 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1317 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:18.957861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7f6c85e8-c980-4b08-afde-0435c523fb03 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:18.959562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7f6c85e8-c980-4b08-afde-0435c523fb03 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:18.976702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f6c85e8-c980-4b08-afde-0435c523fb03 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:18.981033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f6c85e8-c980-4b08-afde-0435c523fb03 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:18.982696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f6c85e8-c980-4b08-afde-0435c523fb03 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:18.983281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f6c85e8-c980-4b08-afde-0435c523fb03 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:19.540374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7f6c85e8-c980-4b08-afde-0435c523fb03 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:19.556168 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7f6c85e8-c980-4b08-afde-0435c523fb03 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1316 microversion: 2.1 time: 0.607631 May 19 04:38:19.568058 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 849/1670] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:18 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:19.786439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d4dbcbc1-361e-43c8-89c4-90b196a002d6 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:19.787669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d4dbcbc1-361e-43c8-89c4-90b196a002d6 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:19.796297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4dbcbc1-361e-43c8-89c4-90b196a002d6 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:19.796766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4dbcbc1-361e-43c8-89c4-90b196a002d6 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:19.797709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4dbcbc1-361e-43c8-89c4-90b196a002d6 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:19.798152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4dbcbc1-361e-43c8-89c4-90b196a002d6 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:20.406361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:20.424998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:20.432514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:20.442607 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79554891-64ac-4c69-8fb9-a6588d9d9402 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 1.542882 May 19 04:38:20.443597 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 822/1671] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:18 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:20.472632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b90c24b5-df7b-439b-ac83-1d65f6f26544 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:20.477554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b90c24b5-df7b-439b-ac83-1d65f6f26544 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:20.499931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b90c24b5-df7b-439b-ac83-1d65f6f26544 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:20.500389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b90c24b5-df7b-439b-ac83-1d65f6f26544 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:20.501206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b90c24b5-df7b-439b-ac83-1d65f6f26544 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:20.501652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b90c24b5-df7b-439b-ac83-1d65f6f26544 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:20.674234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b90c24b5-df7b-439b-ac83-1d65f6f26544 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:20.688932 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b90c24b5-df7b-439b-ac83-1d65f6f26544 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1334 microversion: 2.1 time: 0.227665 May 19 04:38:20.689832 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 823/1672] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:20 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1334 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:20.697785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:20.706489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:20.722526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:20.723130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:20.724047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:20.724768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:20.729830 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d4dbcbc1-361e-43c8-89c4-90b196a002d6 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1533 microversion: 2.1 time: 1.168408 May 19 04:38:20.734373 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 850/1673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:19 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1533 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:20.746247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5cef8057-5e5c-46d0-89cf-cb81b871ef96 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:20.749467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5cef8057-5e5c-46d0-89cf-cb81b871ef96 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:20.766161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cef8057-5e5c-46d0-89cf-cb81b871ef96 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:20.767121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cef8057-5e5c-46d0-89cf-cb81b871ef96 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:20.771148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cef8057-5e5c-46d0-89cf-cb81b871ef96 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:20.771811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cef8057-5e5c-46d0-89cf-cb81b871ef96 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:21.119507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5cef8057-5e5c-46d0-89cf-cb81b871ef96 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:21.129969 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5cef8057-5e5c-46d0-89cf-cb81b871ef96 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1317 microversion: 2.1 time: 0.393323 May 19 04:38:21.132598 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 851/1674] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:20 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:21.146668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a71444b6-9b20-4e59-af83-e44a1cb5ed62 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:21.147716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a71444b6-9b20-4e59-af83-e44a1cb5ed62 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:21.176145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a71444b6-9b20-4e59-af83-e44a1cb5ed62 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:21.178392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a71444b6-9b20-4e59-af83-e44a1cb5ed62 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:21.182015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a71444b6-9b20-4e59-af83-e44a1cb5ed62 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:21.183149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a71444b6-9b20-4e59-af83-e44a1cb5ed62 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:21.252880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:21.267750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:21.273576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:21.275360 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4b25d8fa-a8af-49cb-9b93-cd71cc234c21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.584229 May 19 04:38:21.277234 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 824/1675] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:20 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:21.291744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e2c05a9f-97fd-4a2d-90d1-c0388df866f0 req-f499491a-969d-41ce-8bbf-76723b998432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "tag": "0fb435e5-06bc-4971-8e0d-ca6e92a30329"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:21.311566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e2c05a9f-97fd-4a2d-90d1-c0388df866f0 req-f499491a-969d-41ce-8bbf-76723b998432 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:21.312470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e2c05a9f-97fd-4a2d-90d1-c0388df866f0 req-f499491a-969d-41ce-8bbf-76723b998432 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:21.356724 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e2c05a9f-97fd-4a2d-90d1-c0388df866f0 req-f499491a-969d-41ce-8bbf-76723b998432 service nova] Creating event network-changed:0fb435e5-06bc-4971-8e0d-ca6e92a30329 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:38:21.376536 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e2c05a9f-97fd-4a2d-90d1-c0388df866f0 req-f499491a-969d-41ce-8bbf-76723b998432 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087584 May 19 04:38:21.377795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a71444b6-9b20-4e59-af83-e44a1cb5ed62 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:21.378387 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 825/1676] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:21.387794 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a71444b6-9b20-4e59-af83-e44a1cb5ed62 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1317 microversion: 2.1 time: 0.250353 May 19 04:38:21.388382 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 852/1677] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:21 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:21.391335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4477e49d-9891-4b23-ae23-f0ef7a91e0ac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:21.392295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4477e49d-9891-4b23-ae23-f0ef7a91e0ac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:21.403619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73ddc10e-3cd0-4a68-9177-3a0e01dc555d tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:21.404243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73ddc10e-3cd0-4a68-9177-3a0e01dc555d tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:21.407285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4477e49d-9891-4b23-ae23-f0ef7a91e0ac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:21.408731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4477e49d-9891-4b23-ae23-f0ef7a91e0ac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:21.409847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4477e49d-9891-4b23-ae23-f0ef7a91e0ac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:21.410526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4477e49d-9891-4b23-ae23-f0ef7a91e0ac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:21.412034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73ddc10e-3cd0-4a68-9177-3a0e01dc555d tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:21.412487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73ddc10e-3cd0-4a68-9177-3a0e01dc555d tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:21.413379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73ddc10e-3cd0-4a68-9177-3a0e01dc555d tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:21.413970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73ddc10e-3cd0-4a68-9177-3a0e01dc555d tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.129908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4477e49d-9891-4b23-ae23-f0ef7a91e0ac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:22.139657 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4477e49d-9891-4b23-ae23-f0ef7a91e0ac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1316 microversion: 2.1 time: 0.759779 May 19 04:38:22.143427 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 826/1678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:21 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1316 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:22.154183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:22.157822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:22.174143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.175222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.193349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.202190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.206092 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73ddc10e-3cd0-4a68-9177-3a0e01dc555d tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1533 microversion: 2.1 time: 0.805196 May 19 04:38:22.212097 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 853/1679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:21 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1533 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:22.243044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2a3c453-c3f0-4d54-8b8a-ac9cbf9c25a1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:22.244142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2a3c453-c3f0-4d54-8b8a-ac9cbf9c25a1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:22.260968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2a3c453-c3f0-4d54-8b8a-ac9cbf9c25a1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.263097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2a3c453-c3f0-4d54-8b8a-ac9cbf9c25a1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.264039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2a3c453-c3f0-4d54-8b8a-ac9cbf9c25a1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.267755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2a3c453-c3f0-4d54-8b8a-ac9cbf9c25a1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.428659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e2a3c453-c3f0-4d54-8b8a-ac9cbf9c25a1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:22.438993 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2a3c453-c3f0-4d54-8b8a-ac9cbf9c25a1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1334 microversion: 2.1 time: 0.224108 May 19 04:38:22.442178 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 854/1680] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:22 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1334 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:22.454168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18b9fcf8-18bd-49ab-9e84-792a48d49640 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:22.459232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-18b9fcf8-18bd-49ab-9e84-792a48d49640 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:22.470253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18b9fcf8-18bd-49ab-9e84-792a48d49640 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.474209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18b9fcf8-18bd-49ab-9e84-792a48d49640 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.475341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18b9fcf8-18bd-49ab-9e84-792a48d49640 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.480259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18b9fcf8-18bd-49ab-9e84-792a48d49640 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.795461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-18b9fcf8-18bd-49ab-9e84-792a48d49640 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:22.811544 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18b9fcf8-18bd-49ab-9e84-792a48d49640 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1317 microversion: 2.1 time: 0.367410 May 19 04:38:22.820697 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 855/1681] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:22 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:22.820697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7840167d-528f-4fb4-8c97-b9e6fced6268 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:22.826087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:22.837540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:22.838046 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:38:22.838046 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:38:22.841117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7840167d-528f-4fb4-8c97-b9e6fced6268 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.842262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:22.842870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7840167d-528f-4fb4-8c97-b9e6fced6268 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.844268 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a57ddfa8-360b-43ca-8680-12fec759ca00 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.698317 May 19 04:38:22.846226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7840167d-528f-4fb4-8c97-b9e6fced6268 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.847036 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 827/1682] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:22 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:22.848492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7840167d-528f-4fb4-8c97-b9e6fced6268 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.860713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:22.863020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:22.881618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.885703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.888174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.890972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.953313 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7840167d-528f-4fb4-8c97-b9e6fced6268 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.138216 May 19 04:38:22.962213 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 856/1683] 10.222.0.58 () {58 vars in 1175 bytes} [Thu May 19 04:38:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:22.968828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b8115630-6809-41ea-a37a-9c6a0363aa57 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:22.969987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b8115630-6809-41ea-a37a-9c6a0363aa57 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:22.977729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8115630-6809-41ea-a37a-9c6a0363aa57 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.978948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8115630-6809-41ea-a37a-9c6a0363aa57 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:22.980135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8115630-6809-41ea-a37a-9c6a0363aa57 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:22.980980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8115630-6809-41ea-a37a-9c6a0363aa57 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:23.055736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:23.295373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b8115630-6809-41ea-a37a-9c6a0363aa57 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:23.307558 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b8115630-6809-41ea-a37a-9c6a0363aa57 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1317 microversion: 2.1 time: 0.343116 May 19 04:38:23.308604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:23.317790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:23.322104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:23.327345 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 857/1684] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:22 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:23.329684 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da5f02de-7647-45ac-b1a8-0bc08aa6aa53 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.478347 May 19 04:38:23.333650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-382c5204-e022-4ab1-b910-5d54f0565255 req-fd145d43-9e62-4106-ac0c-ad642da6d08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2487ebd4-e36c-404c-9c5f-76aa7a3bf41b", "name": "network-vif-plugged", "status": "completed", "tag": "c03ba391-adc5-4ec1-8242-3aa5aca306ce"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:23.333827 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 828/1685] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:22 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:23.338474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00ad2769-82b4-4d90-9509-c2bc99b7e728 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-766726-30", "block_migration": false, "disk_over_commit": false}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:23.339681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00ad2769-82b4-4d90-9509-c2bc99b7e728 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:23.351128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-382c5204-e022-4ab1-b910-5d54f0565255 req-fd145d43-9e62-4106-ac0c-ad642da6d08d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:23.351700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-382c5204-e022-4ab1-b910-5d54f0565255 req-fd145d43-9e62-4106-ac0c-ad642da6d08d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:23.359382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00ad2769-82b4-4d90-9509-c2bc99b7e728 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:23.359835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00ad2769-82b4-4d90-9509-c2bc99b7e728 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:23.365006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00ad2769-82b4-4d90-9509-c2bc99b7e728 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:23.367772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00ad2769-82b4-4d90-9509-c2bc99b7e728 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:23.371780 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-382c5204-e022-4ab1-b910-5d54f0565255 req-fd145d43-9e62-4106-ac0c-ad642da6d08d service nova] Creating event network-vif-plugged:c03ba391-adc5-4ec1-8242-3aa5aca306ce for instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b on n-h1-766726-30 May 19 04:38:23.383596 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-382c5204-e022-4ab1-b910-5d54f0565255 req-fd145d43-9e62-4106-ac0c-ad642da6d08d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053197 May 19 04:38:23.385155 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 858/1686] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:23.394230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ec01245-2a57-4a13-a9f2-11b0b4f73822 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:23.395384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2ec01245-2a57-4a13-a9f2-11b0b4f73822 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:23.404358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ec01245-2a57-4a13-a9f2-11b0b4f73822 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:23.405910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ec01245-2a57-4a13-a9f2-11b0b4f73822 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:23.406994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ec01245-2a57-4a13-a9f2-11b0b4f73822 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:23.407662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ec01245-2a57-4a13-a9f2-11b0b4f73822 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:23.424879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-00ad2769-82b4-4d90-9509-c2bc99b7e728 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lazy-loading 'flavor' on Instance uuid a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:38:23.457863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00ad2769-82b4-4d90-9509-c2bc99b7e728 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Going to try to live migrate instance to n-h1-766726-30 {{(pid=124819) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 04:38:23.658137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2ec01245-2a57-4a13-a9f2-11b0b4f73822 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:23.674416 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ec01245-2a57-4a13-a9f2-11b0b4f73822 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1316 microversion: 2.1 time: 0.287009 May 19 04:38:23.675461 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 859/1687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:23 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:23.680371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2958a26-f302-4331-8313-3b5c895e99b5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:23.684370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2958a26-f302-4331-8313-3b5c895e99b5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:23.695779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2958a26-f302-4331-8313-3b5c895e99b5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:23.696296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2958a26-f302-4331-8313-3b5c895e99b5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:23.699237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2958a26-f302-4331-8313-3b5c895e99b5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:23.699710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2958a26-f302-4331-8313-3b5c895e99b5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:23.990628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e2958a26-f302-4331-8313-3b5c895e99b5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:24.004896 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2958a26-f302-4331-8313-3b5c895e99b5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1401 microversion: 2.1 time: 0.328068 May 19 04:38:24.005520 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 860/1688] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:23 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1401 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:24.021921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4a75626e-217a-4791-b473-8543cd1017cf req-28507f34-dcb0-4396-bdc6-32722b09911f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba26ee82-2a56-4414-8118-534237609704", "tag": "b8b1f96b-e595-45c8-a997-3182bd8f7367"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:24.033386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4a75626e-217a-4791-b473-8543cd1017cf req-28507f34-dcb0-4396-bdc6-32722b09911f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:24.034464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4a75626e-217a-4791-b473-8543cd1017cf req-28507f34-dcb0-4396-bdc6-32722b09911f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:24.054704 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4a75626e-217a-4791-b473-8543cd1017cf req-28507f34-dcb0-4396-bdc6-32722b09911f service nova] Creating event network-changed:b8b1f96b-e595-45c8-a997-3182bd8f7367 for instance ba26ee82-2a56-4414-8118-534237609704 on n-h2-766726-30 May 19 04:38:24.062140 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4a75626e-217a-4791-b473-8543cd1017cf req-28507f34-dcb0-4396-bdc6-32722b09911f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043200 May 19 04:38:24.062869 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 861/1689] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:24.070513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8d59aa2b-fc15-41cb-b443-f491f5ce7c4b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:24.072289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8d59aa2b-fc15-41cb-b443-f491f5ce7c4b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:24.080016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d59aa2b-fc15-41cb-b443-f491f5ce7c4b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:24.080477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d59aa2b-fc15-41cb-b443-f491f5ce7c4b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:24.081939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d59aa2b-fc15-41cb-b443-f491f5ce7c4b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:24.082383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d59aa2b-fc15-41cb-b443-f491f5ce7c4b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:24.272341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8d59aa2b-fc15-41cb-b443-f491f5ce7c4b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:24.281686 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8d59aa2b-fc15-41cb-b443-f491f5ce7c4b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1317 microversion: 2.1 time: 0.217038 May 19 04:38:24.292910 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 862/1690] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:24 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:24.298066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:24.298665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:24.307901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:24.307901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:24.308262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:24.308514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:24.615381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:24.628464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:24.630410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:24.631930 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5d16dfce-6eac-474f-9cf0-60d1bd3e20e3 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.337858 May 19 04:38:24.643846 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 863/1691] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:24 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:24.662934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dd059a37-22fe-4b64-9a72-0655b243f8af tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:24.665296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dd059a37-22fe-4b64-9a72-0655b243f8af tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:24.675487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd059a37-22fe-4b64-9a72-0655b243f8af tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:24.676307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd059a37-22fe-4b64-9a72-0655b243f8af tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:24.677368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd059a37-22fe-4b64-9a72-0655b243f8af tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:24.677977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd059a37-22fe-4b64-9a72-0655b243f8af tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:24.846823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dd059a37-22fe-4b64-9a72-0655b243f8af tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:24.872992 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dd059a37-22fe-4b64-9a72-0655b243f8af tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1317 microversion: 2.1 time: 0.227658 May 19 04:38:24.882791 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 864/1692] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:24 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:24.893519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:24.895516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:24.907687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:24.908297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:24.909803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:24.910357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:25.184941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:25.197192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:25.199966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:25.201962 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-56a57925-b422-4d6f-817d-aa76ff4f9c10 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1486 microversion: 2.25 time: 0.327097 May 19 04:38:25.202794 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 865/1693] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:24 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1486 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:25.208310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3008944d-be71-4c89-b71e-9a60f7e00fac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:25.208969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3008944d-be71-4c89-b71e-9a60f7e00fac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:25.223385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3008944d-be71-4c89-b71e-9a60f7e00fac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:25.225215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3008944d-be71-4c89-b71e-9a60f7e00fac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:25.227232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3008944d-be71-4c89-b71e-9a60f7e00fac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:25.228563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3008944d-be71-4c89-b71e-9a60f7e00fac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:25.418412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3008944d-be71-4c89-b71e-9a60f7e00fac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:25.432667 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3008944d-be71-4c89-b71e-9a60f7e00fac tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1316 microversion: 2.1 time: 0.228774 May 19 04:38:25.434133 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 866/1694] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:25 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:25.446095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-06e2c89d-c910-4f7d-bab1-a2218828786d tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:25.447272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-06e2c89d-c910-4f7d-bab1-a2218828786d tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:25.470164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06e2c89d-c910-4f7d-bab1-a2218828786d tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:25.470619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06e2c89d-c910-4f7d-bab1-a2218828786d tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:25.471437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06e2c89d-c910-4f7d-bab1-a2218828786d tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:25.471875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06e2c89d-c910-4f7d-bab1-a2218828786d tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:25.653462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-06e2c89d-c910-4f7d-bab1-a2218828786d tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:25.662232 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-06e2c89d-c910-4f7d-bab1-a2218828786d tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1401 microversion: 2.1 time: 0.219965 May 19 04:38:25.663483 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 867/1695] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:25 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1401 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:25.677337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-128676e5-e36f-4647-a17f-188b16f215af tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:25.677967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-128676e5-e36f-4647-a17f-188b16f215af tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:25.691086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-128676e5-e36f-4647-a17f-188b16f215af tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:25.691541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-128676e5-e36f-4647-a17f-188b16f215af tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:25.693714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-128676e5-e36f-4647-a17f-188b16f215af tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:25.694430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-128676e5-e36f-4647-a17f-188b16f215af tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:25.713030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:25.749297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=24 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:25.955354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-128676e5-e36f-4647-a17f-188b16f215af tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:25.969560 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-128676e5-e36f-4647-a17f-188b16f215af tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1317 microversion: 2.1 time: 0.304897 May 19 04:38:25.970469 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 868/1696] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:25 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:25.975867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c0f5246e-0823-4c59-90bf-1dce7ae82a0b req-c179620e-6aa8-4f32-9f80-330c628f6a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37301659-d7ed-41fe-be72-46f2e9185650", "name": "network-vif-plugged", "status": "completed", "tag": "33fd5ca9-39f1-4823-9bb9-fd2d27226a63"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:26.012428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c0f5246e-0823-4c59-90bf-1dce7ae82a0b req-c179620e-6aa8-4f32-9f80-330c628f6a5e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:26.012876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c0f5246e-0823-4c59-90bf-1dce7ae82a0b req-c179620e-6aa8-4f32-9f80-330c628f6a5e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:26.036268 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c0f5246e-0823-4c59-90bf-1dce7ae82a0b req-c179620e-6aa8-4f32-9f80-330c628f6a5e service nova] Creating event network-vif-plugged:33fd5ca9-39f1-4823-9bb9-fd2d27226a63 for instance 37301659-d7ed-41fe-be72-46f2e9185650 on n-h1-766726-30 May 19 04:38:26.046684 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c0f5246e-0823-4c59-90bf-1dce7ae82a0b req-c179620e-6aa8-4f32-9f80-330c628f6a5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074700 May 19 04:38:26.049943 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 869/1697] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:26.065047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:26.065895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:26.103464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:26.111406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:26.112486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:26.112999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:26.711323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:26.753971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:26.760486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:26.762732 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1fa9c86b-1d4a-4d5e-a4b1-f03f691abaa8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.703901 May 19 04:38:26.767224 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 870/1698] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:26 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:26.781564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-410c3b62-3044-4abc-bc68-a5d98ffc5918 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:26.784148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-410c3b62-3044-4abc-bc68-a5d98ffc5918 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:26.800590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-410c3b62-3044-4abc-bc68-a5d98ffc5918 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:26.801387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-410c3b62-3044-4abc-bc68-a5d98ffc5918 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:26.802392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-410c3b62-3044-4abc-bc68-a5d98ffc5918 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:26.803008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-410c3b62-3044-4abc-bc68-a5d98ffc5918 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:27.130497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-410c3b62-3044-4abc-bc68-a5d98ffc5918 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:27.144952 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-410c3b62-3044-4abc-bc68-a5d98ffc5918 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1506 microversion: 2.1 time: 0.374161 May 19 04:38:27.146872 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 871/1699] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:26 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:27.160636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:27.162604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:27.180500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:27.183361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:27.187974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:27.190555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:27.191015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:27.267647 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00ad2769-82b4-4d90-9509-c2bc99b7e728 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3/action" status: 202 len: 0 microversion: 2.1 time: 3.932706 May 19 04:38:27.268379 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 829/1700] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:38:23 2022] POST /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3/action => generated 0 bytes in 3934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:27.273558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a09633c2-4f88-456c-92e2-30662751ac99 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:27.274244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a09633c2-4f88-456c-92e2-30662751ac99 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:27.306478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a09633c2-4f88-456c-92e2-30662751ac99 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:27.310516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a09633c2-4f88-456c-92e2-30662751ac99 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:27.311433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a09633c2-4f88-456c-92e2-30662751ac99 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:27.311941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a09633c2-4f88-456c-92e2-30662751ac99 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:27.577459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:27.603172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:27.617371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:27.624673 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b297d3f0-7089-4ee3-a639-af6477c99e6a tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1476 microversion: 2.25 time: 0.472496 May 19 04:38:27.628708 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 872/1701] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:27 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1476 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:27.644507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2c0c1a34-5416-459a-87c6-481460aa64c3 req-261b14eb-50d5-4927-8cf9-160e665e5464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b71b11-ff6f-49dc-9fbd-cf68e47af55f", "tag": "4969e6d6-ab69-44db-b04b-336fe8d72fae"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:27.695323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a09633c2-4f88-456c-92e2-30662751ac99 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:27.695967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2c0c1a34-5416-459a-87c6-481460aa64c3 req-261b14eb-50d5-4927-8cf9-160e665e5464 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:27.697802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2c0c1a34-5416-459a-87c6-481460aa64c3 req-261b14eb-50d5-4927-8cf9-160e665e5464 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:27.708292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:27.713588 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2c0c1a34-5416-459a-87c6-481460aa64c3 req-261b14eb-50d5-4927-8cf9-160e665e5464 service nova] Creating event network-changed:4969e6d6-ab69-44db-b04b-336fe8d72fae for instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f on n-h1-766726-30 May 19 04:38:27.717553 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a09633c2-4f88-456c-92e2-30662751ac99 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1316 microversion: 2.1 time: 0.448127 May 19 04:38:27.720767 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2c0c1a34-5416-459a-87c6-481460aa64c3 req-261b14eb-50d5-4927-8cf9-160e665e5464 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089638 May 19 04:38:27.720934 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 830/1702] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:27 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:27.722143 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 873/1703] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:27.729896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-290e7920-7e66-4d03-8a8c-ed2d730a2a5c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:27.731046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-290e7920-7e66-4d03-8a8c-ed2d730a2a5c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:27.737851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3d64b55-902d-47a6-8c3c-8ddfc268aa1a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:27.738518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3d64b55-902d-47a6-8c3c-8ddfc268aa1a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:27.739816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-290e7920-7e66-4d03-8a8c-ed2d730a2a5c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:27.740505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-290e7920-7e66-4d03-8a8c-ed2d730a2a5c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:27.741649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-290e7920-7e66-4d03-8a8c-ed2d730a2a5c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:27.742324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-290e7920-7e66-4d03-8a8c-ed2d730a2a5c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:27.754176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3d64b55-902d-47a6-8c3c-8ddfc268aa1a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:27.754719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3d64b55-902d-47a6-8c3c-8ddfc268aa1a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:27.760941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3d64b55-902d-47a6-8c3c-8ddfc268aa1a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:27.761424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3d64b55-902d-47a6-8c3c-8ddfc268aa1a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.300406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d3d64b55-902d-47a6-8c3c-8ddfc268aa1a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:28.307424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-290e7920-7e66-4d03-8a8c-ed2d730a2a5c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:28.310247 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d3d64b55-902d-47a6-8c3c-8ddfc268aa1a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1401 microversion: 2.1 time: 0.588285 May 19 04:38:28.319119 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 831/1704] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:27 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1401 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:28.319443 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-290e7920-7e66-4d03-8a8c-ed2d730a2a5c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1317 microversion: 2.1 time: 0.593220 May 19 04:38:28.328979 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 874/1705] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:27 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:28.329215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-560282b9-e2c5-4b38-941c-0a3cd9b0b60f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:28.329215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-560282b9-e2c5-4b38-941c-0a3cd9b0b60f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:28.331866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8849ffd3-1c5c-4632-8cf7-ef55e88c102f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:28.333894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8849ffd3-1c5c-4632-8cf7-ef55e88c102f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:28.354245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8849ffd3-1c5c-4632-8cf7-ef55e88c102f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:28.354976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8849ffd3-1c5c-4632-8cf7-ef55e88c102f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.357196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8849ffd3-1c5c-4632-8cf7-ef55e88c102f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:28.358848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8849ffd3-1c5c-4632-8cf7-ef55e88c102f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.361306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-560282b9-e2c5-4b38-941c-0a3cd9b0b60f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:28.361763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-560282b9-e2c5-4b38-941c-0a3cd9b0b60f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.362635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-560282b9-e2c5-4b38-941c-0a3cd9b0b60f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:28.363173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-560282b9-e2c5-4b38-941c-0a3cd9b0b60f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.757750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8849ffd3-1c5c-4632-8cf7-ef55e88c102f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:28.761055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-560282b9-e2c5-4b38-941c-0a3cd9b0b60f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:28.770251 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8849ffd3-1c5c-4632-8cf7-ef55e88c102f tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.446875 May 19 04:38:28.772184 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 875/1706] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:28 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:28.778089 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-560282b9-e2c5-4b38-941c-0a3cd9b0b60f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1506 microversion: 2.1 time: 0.464601 May 19 04:38:28.778628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-002d808e-164e-4187-ad46-6e1e16d907e4 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '.version_select at 0x7fd3162183a0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:28.778783 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 832/1707] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:28 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:28.783490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:28.784412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:28.795754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-002d808e-164e-4187-ad46-6e1e16d907e4 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:28.796159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-002d808e-164e-4187-ad46-6e1e16d907e4 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.796827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:28.798398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.801035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:28.801765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.817521 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-002d808e-164e-4187-ad46-6e1e16d907e4 tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 3654 microversion: 2.25 time: 0.043945 May 19 04:38:28.818551 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 876/1708] 10.222.0.58 () {60 vars in 1183 bytes} [Thu May 19 04:38:28 2022] GET /compute/v2.1/os-migrations => generated 3654 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:28.827107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9d6e86ff-1af7-448f-92ce-cebdbaaa19e9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:28.827819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9d6e86ff-1af7-448f-92ce-cebdbaaa19e9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:28.838247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9d6e86ff-1af7-448f-92ce-cebdbaaa19e9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:28.838803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9d6e86ff-1af7-448f-92ce-cebdbaaa19e9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.839944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9d6e86ff-1af7-448f-92ce-cebdbaaa19e9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:28.840553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9d6e86ff-1af7-448f-92ce-cebdbaaa19e9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:28.875593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:29.150838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9d6e86ff-1af7-448f-92ce-cebdbaaa19e9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:29.151661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:29.159888 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9d6e86ff-1af7-448f-92ce-cebdbaaa19e9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1504 microversion: 2.1 time: 0.339917 May 19 04:38:29.162162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 877/1709] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:28 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:29.168150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "OS-DCF:diskConfig": "AUTO"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:29.169880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:29.174539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:29.177233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.177464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.177913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:29.178966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.179142 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-46b8ed7b-5501-490a-ad90-0d23f7c07c7b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.399474 May 19 04:38:29.179912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.180654 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 833/1710] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:28 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:29.189342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8f5daa60-c68d-4253-b3e6-0f534d35513d tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:29.189342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8f5daa60-c68d-4253-b3e6-0f534d35513d tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:29.199630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f5daa60-c68d-4253-b3e6-0f534d35513d tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.200464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f5daa60-c68d-4253-b3e6-0f534d35513d tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.201474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f5daa60-c68d-4253-b3e6-0f534d35513d tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.202123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f5daa60-c68d-4253-b3e6-0f534d35513d tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.302763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:38:29.303424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:38:29.304324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:38:29.304964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:38:29.305658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:38:29.400890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:29.414586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.414586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.415169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.416157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.418384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-8f5daa60-c68d-4253-b3e6-0f534d35513d tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] Lazy-loading 'services' on Instance uuid a61799b1-3689-4c54-bb41-ac10d07bca57 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:38:29.440406 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8f5daa60-c68d-4253-b3e6-0f534d35513d tempest-LiveAutoBlockMigrationV225Test-1947123587 tempest-LiveAutoBlockMigrationV225Test-1947123587-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1970 microversion: 2.25 time: 0.257953 May 19 04:38:29.442260 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 834/1711] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:29 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1970 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:29.447367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e4a5d838-30e4-4f2d-b1ee-fc76ce2aeb80 req-3357c9b0-69f5-4636-b706-fceeaaec972f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba26ee82-2a56-4414-8118-534237609704", "name": "network-vif-plugged", "status": "completed", "tag": "b8b1f96b-e595-45c8-a997-3182bd8f7367"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:29.476037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e4a5d838-30e4-4f2d-b1ee-fc76ce2aeb80 req-3357c9b0-69f5-4636-b706-fceeaaec972f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.476742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e4a5d838-30e4-4f2d-b1ee-fc76ce2aeb80 req-3357c9b0-69f5-4636-b706-fceeaaec972f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.489709 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e4a5d838-30e4-4f2d-b1ee-fc76ce2aeb80 req-3357c9b0-69f5-4636-b706-fceeaaec972f service nova] Creating event network-vif-plugged:b8b1f96b-e595-45c8-a997-3182bd8f7367 for instance ba26ee82-2a56-4414-8118-534237609704 on n-h2-766726-30 May 19 04:38:29.497148 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e4a5d838-30e4-4f2d-b1ee-fc76ce2aeb80 req-3357c9b0-69f5-4636-b706-fceeaaec972f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053021 May 19 04:38:29.498507 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 835/1712] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:29.502097 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b4f0f075-fe5d-451a-be7c-bb4aad7530fb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "POST /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b/action" status: 202 len: 1108 microversion: 2.1 time: 0.338454 May 19 04:38:29.505955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-158336af-bab5-4a69-9d62-6f423c515e66 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-714100973"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:29.506831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-158336af-bab5-4a69-9d62-6f423c515e66 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:29.514355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-158336af-bab5-4a69-9d62-6f423c515e66 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.515709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-158336af-bab5-4a69-9d62-6f423c515e66 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.516668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-158336af-bab5-4a69-9d62-6f423c515e66 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.517529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-158336af-bab5-4a69-9d62-6f423c515e66 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.542054 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 878/1713] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:38:29 2022] POST /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b/action => generated 1108 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 19 04:38:29.566067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7ea04a7-de14-426b-85e1-8ed6452c860a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:29.566474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7ea04a7-de14-426b-85e1-8ed6452c860a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:29.584067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7ea04a7-de14-426b-85e1-8ed6452c860a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.584910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7ea04a7-de14-426b-85e1-8ed6452c860a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.585924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7ea04a7-de14-426b-85e1-8ed6452c860a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.586294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7ea04a7-de14-426b-85e1-8ed6452c860a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.754607 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.network.security_group_api [None req-158336af-bab5-4a69-9d62-6f423c515e66 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Adding security group cd1cdace-54e8-4308-a5dc-617d1e0a02ad to port 33fd5ca9-39f1-4823-9bb9-fd2d27226a63 May 19 04:38:29.906421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a7ea04a7-de14-426b-85e1-8ed6452c860a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:29.914771 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7ea04a7-de14-426b-85e1-8ed6452c860a tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1401 microversion: 2.1 time: 0.371548 May 19 04:38:29.920470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 879/1714] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:29 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1401 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:29.930078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d660b28-832a-4d3b-97a2-7862b28193fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:29.932463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d660b28-832a-4d3b-97a2-7862b28193fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:29.948355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d660b28-832a-4d3b-97a2-7862b28193fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.949547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d660b28-832a-4d3b-97a2-7862b28193fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:29.954470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d660b28-832a-4d3b-97a2-7862b28193fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:29.956524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d660b28-832a-4d3b-97a2-7862b28193fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:30.296181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0d660b28-832a-4d3b-97a2-7862b28193fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:30.306397 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d660b28-832a-4d3b-97a2-7862b28193fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1317 microversion: 2.1 time: 0.384065 May 19 04:38:30.310982 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 880/1715] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:29 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:30.337610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-211ff621-2450-4ec9-92e4-63f364dae952 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:30.338458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-211ff621-2450-4ec9-92e4-63f364dae952 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:30.347592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-211ff621-2450-4ec9-92e4-63f364dae952 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:30.348313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-211ff621-2450-4ec9-92e4-63f364dae952 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:30.349372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-211ff621-2450-4ec9-92e4-63f364dae952 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:30.350726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-211ff621-2450-4ec9-92e4-63f364dae952 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:30.429032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-211ff621-2450-4ec9-92e4-63f364dae952 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:38:30.609238 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-211ff621-2450-4ec9-92e4-63f364dae952 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 204 len: 0 microversion: 2.25 time: 0.296631 May 19 04:38:30.613363 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 881/1716] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:38:30 2022] DELETE /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:38:30.617960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e17dd44-7fce-4444-a1ac-974b20d2bbc1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:30.620139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4e17dd44-7fce-4444-a1ac-974b20d2bbc1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:30.634903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e17dd44-7fce-4444-a1ac-974b20d2bbc1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:30.642497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e17dd44-7fce-4444-a1ac-974b20d2bbc1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:30.643630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e17dd44-7fce-4444-a1ac-974b20d2bbc1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:30.644242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e17dd44-7fce-4444-a1ac-974b20d2bbc1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:30.846413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-158336af-bab5-4a69-9d62-6f423c515e66 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650/action" status: 202 len: 0 microversion: 2.1 time: 1.346069 May 19 04:38:30.847579 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 836/1717] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:38:29 2022] POST /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650/action => generated 0 bytes in 1348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:30.857834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e876d2c-4c9e-4ae1-af5b-a7e3c0803bad tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:30.859023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e876d2c-4c9e-4ae1-af5b-a7e3c0803bad tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:30.867170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e876d2c-4c9e-4ae1-af5b-a7e3c0803bad tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:30.867908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e876d2c-4c9e-4ae1-af5b-a7e3c0803bad tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:30.869718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e876d2c-4c9e-4ae1-af5b-a7e3c0803bad tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:30.870333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e876d2c-4c9e-4ae1-af5b-a7e3c0803bad tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.032471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4e17dd44-7fce-4444-a1ac-974b20d2bbc1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:31.042292 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4e17dd44-7fce-4444-a1ac-974b20d2bbc1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.431238 May 19 04:38:31.054008 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 882/1718] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:30 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:31.068753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:31.069661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:31.093944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:31.094672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.095664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:31.097645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.162944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e876d2c-4c9e-4ae1-af5b-a7e3c0803bad tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:31.178962 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e876d2c-4c9e-4ae1-af5b-a7e3c0803bad tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.323420 May 19 04:38:31.189823 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 837/1719] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:30 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:31.200727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:31.213778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:31.227445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:31.228882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.235110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:31.235765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.539978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:31.560957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:31.564910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:31.567578 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-659d1093-d45a-4ec6-b3ce-4b1da7d24939 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.512263 May 19 04:38:31.569971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 883/1720] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:31 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:31.597773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c3c09124-25df-4e53-b589-5cbe9ab878a5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-839806423"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:31.598592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c3c09124-25df-4e53-b589-5cbe9ab878a5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:31.619651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3c09124-25df-4e53-b589-5cbe9ab878a5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:31.620373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3c09124-25df-4e53-b589-5cbe9ab878a5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.621658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3c09124-25df-4e53-b589-5cbe9ab878a5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:31.622295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3c09124-25df-4e53-b589-5cbe9ab878a5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.730207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:31.739301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:31.745304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:31.752217 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6969ae44-606e-4108-ab13-2fd3cd299554 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1482 microversion: 2.25 time: 0.560459 May 19 04:38:31.753672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 838/1721] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:31 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1482 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:31.778181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e4c28715-50fd-4316-bd52-fdeff6b3ddae req-e8699529-18c8-422e-b507-bff373265c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37301659-d7ed-41fe-be72-46f2e9185650", "tag": "33fd5ca9-39f1-4823-9bb9-fd2d27226a63"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:31.800811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e4c28715-50fd-4316-bd52-fdeff6b3ddae req-e8699529-18c8-422e-b507-bff373265c75 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:31.804412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e4c28715-50fd-4316-bd52-fdeff6b3ddae req-e8699529-18c8-422e-b507-bff373265c75 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.828904 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e4c28715-50fd-4316-bd52-fdeff6b3ddae req-e8699529-18c8-422e-b507-bff373265c75 service nova] Creating event network-changed:33fd5ca9-39f1-4823-9bb9-fd2d27226a63 for instance 37301659-d7ed-41fe-be72-46f2e9185650 on n-h1-766726-30 May 19 04:38:31.847763 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e4c28715-50fd-4316-bd52-fdeff6b3ddae req-e8699529-18c8-422e-b507-bff373265c75 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086286 May 19 04:38:31.849440 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 839/1722] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:31.860800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce9165ee-4216-4e0b-ac4e-f80a66487e25 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:31.863705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ce9165ee-4216-4e0b-ac4e-f80a66487e25 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:31.881161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce9165ee-4216-4e0b-ac4e-f80a66487e25 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:31.881890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce9165ee-4216-4e0b-ac4e-f80a66487e25 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.885184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce9165ee-4216-4e0b-ac4e-f80a66487e25 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:31.885843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce9165ee-4216-4e0b-ac4e-f80a66487e25 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:31.893890 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.network.security_group_api [None req-c3c09124-25df-4e53-b589-5cbe9ab878a5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Adding security group 7c29773f-631f-4841-a6b8-f0ed84772f3a to port 33fd5ca9-39f1-4823-9bb9-fd2d27226a63 May 19 04:38:32.805070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ce9165ee-4216-4e0b-ac4e-f80a66487e25 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:32.823177 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce9165ee-4216-4e0b-ac4e-f80a66487e25 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1401 microversion: 2.1 time: 0.972239 May 19 04:38:32.835401 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 840/1723] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:31 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1401 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:32.845808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33f0ca15-4ee8-480a-8f9b-d55e07ed498f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:32.848789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33f0ca15-4ee8-480a-8f9b-d55e07ed498f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:32.866338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f0ca15-4ee8-480a-8f9b-d55e07ed498f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:32.867482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:32.873125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f0ca15-4ee8-480a-8f9b-d55e07ed498f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:32.878034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f0ca15-4ee8-480a-8f9b-d55e07ed498f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:32.882833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33f0ca15-4ee8-480a-8f9b-d55e07ed498f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:32.908453 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c3c09124-25df-4e53-b589-5cbe9ab878a5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650/action" status: 202 len: 0 microversion: 2.1 time: 1.330836 May 19 04:38:32.913987 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 884/1724] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:38:31 2022] POST /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650/action => generated 0 bytes in 1337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:32.921360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-facc1758-60ee-4e0b-99e3-aa96cbdcf3ea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:32.922405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-facc1758-60ee-4e0b-99e3-aa96cbdcf3ea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:32.938228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-facc1758-60ee-4e0b-99e3-aa96cbdcf3ea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:32.943407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-facc1758-60ee-4e0b-99e3-aa96cbdcf3ea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:32.945681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-facc1758-60ee-4e0b-99e3-aa96cbdcf3ea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:32.947969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-facc1758-60ee-4e0b-99e3-aa96cbdcf3ea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:33.465229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-33f0ca15-4ee8-480a-8f9b-d55e07ed498f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:33.481478 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-33f0ca15-4ee8-480a-8f9b-d55e07ed498f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1467 microversion: 2.1 time: 0.644372 May 19 04:38:33.482096 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 841/1725] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:32 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1467 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:33.487238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-895ea75f-ba92-4237-82c7-995b700d3580 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:33.489866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-895ea75f-ba92-4237-82c7-995b700d3580 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:33.515031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-895ea75f-ba92-4237-82c7-995b700d3580 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:33.515781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-895ea75f-ba92-4237-82c7-995b700d3580 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:33.516817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-895ea75f-ba92-4237-82c7-995b700d3580 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:33.517534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-895ea75f-ba92-4237-82c7-995b700d3580 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:33.522350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-facc1758-60ee-4e0b-99e3-aa96cbdcf3ea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:33.535657 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-facc1758-60ee-4e0b-99e3-aa96cbdcf3ea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.618127 May 19 04:38:33.546498 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 885/1726] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:32 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:33.557405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:33.566850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:33.574939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:33.575791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:33.576812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:33.580980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:33.934381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-895ea75f-ba92-4237-82c7-995b700d3580 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:33.950621 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-895ea75f-ba92-4237-82c7-995b700d3580 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.466976 May 19 04:38:33.954092 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 842/1727] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:33 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:33.960233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:33.961984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:33.963545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:33.970045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:33.970821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:33.971780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:33.972381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:33.976844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:33.984469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:33.985976 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fe277910-7936-4bdc-9001-5170dd4896f0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.438015 May 19 04:38:33.993340 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 886/1728] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:33 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:33.999501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b6410f59-6ab0-4078-af40-31e3d24af1b9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:34.000200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b6410f59-6ab0-4078-af40-31e3d24af1b9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:34.006442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6410f59-6ab0-4078-af40-31e3d24af1b9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.007131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6410f59-6ab0-4078-af40-31e3d24af1b9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:34.008141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6410f59-6ab0-4078-af40-31e3d24af1b9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.008875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6410f59-6ab0-4078-af40-31e3d24af1b9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:34.057637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:34.067855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:34.070113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:34.072061 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f03bd23e-8df8-4c78-a37e-c070c72a76a0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.116093 May 19 04:38:34.083261 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 843/1729] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:33 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:34.088575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-47834ace-8bdf-4551-a4f3-21f239ea411b req-20dd66c7-058f-4319-94ba-6f0c196781ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61799b1-3689-4c54-bb41-ac10d07bca57", "name": "network-vif-deleted", "tag": "7745425f-977a-42db-8a3d-6a421e366558"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:34.097923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-47834ace-8bdf-4551-a4f3-21f239ea411b req-20dd66c7-058f-4319-94ba-6f0c196781ba service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.098685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-47834ace-8bdf-4551-a4f3-21f239ea411b req-20dd66c7-058f-4319-94ba-6f0c196781ba service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:34.114723 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-47834ace-8bdf-4551-a4f3-21f239ea411b req-20dd66c7-058f-4319-94ba-6f0c196781ba service nova] Creating event network-vif-deleted:7745425f-977a-42db-8a3d-6a421e366558 for instance a61799b1-3689-4c54-bb41-ac10d07bca57 on n-h1-766726-30 May 19 04:38:34.120431 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-47834ace-8bdf-4551-a4f3-21f239ea411b req-20dd66c7-058f-4319-94ba-6f0c196781ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035409 May 19 04:38:34.124240 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 844/1730] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:34.131393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17df5d8a-f3c9-42ca-a747-96cd5d02bb09 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:34.132223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17df5d8a-f3c9-42ca-a747-96cd5d02bb09 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:34.139582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17df5d8a-f3c9-42ca-a747-96cd5d02bb09 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.140331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17df5d8a-f3c9-42ca-a747-96cd5d02bb09 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:34.142032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17df5d8a-f3c9-42ca-a747-96cd5d02bb09 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.142769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17df5d8a-f3c9-42ca-a747-96cd5d02bb09 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:34.186661 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b6410f59-6ab0-4078-af40-31e3d24af1b9 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.191797 May 19 04:38:34.187918 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 887/1731] 10.222.0.58 () {58 vars in 1292 bytes} [Thu May 19 04:38:33 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650/os-security-groups => generated 1157 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:34.194160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f35475d8-43b5-485c-9cab-9eb1c445dd27 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:34.195242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f35475d8-43b5-485c-9cab-9eb1c445dd27 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:34.202971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f35475d8-43b5-485c-9cab-9eb1c445dd27 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.203962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f35475d8-43b5-485c-9cab-9eb1c445dd27 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:34.207961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f35475d8-43b5-485c-9cab-9eb1c445dd27 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.208669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f35475d8-43b5-485c-9cab-9eb1c445dd27 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:34.689585 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17df5d8a-f3c9-42ca-a747-96cd5d02bb09 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1620 microversion: 2.1 time: 0.561824 May 19 04:38:34.697263 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 845/1732] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:34 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1620 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:34.697263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6867460f-2f4d-43a1-b7c2-b4db4e8fcb03 req-76529d16-3c40-4d48-b469-c5df9994efd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37301659-d7ed-41fe-be72-46f2e9185650", "tag": "33fd5ca9-39f1-4823-9bb9-fd2d27226a63"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:34.715635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f35475d8-43b5-485c-9cab-9eb1c445dd27 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:34.719165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6867460f-2f4d-43a1-b7c2-b4db4e8fcb03 req-76529d16-3c40-4d48-b469-c5df9994efd2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.719615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6867460f-2f4d-43a1-b7c2-b4db4e8fcb03 req-76529d16-3c40-4d48-b469-c5df9994efd2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:34.725146 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f35475d8-43b5-485c-9cab-9eb1c445dd27 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1401 microversion: 2.1 time: 0.535904 May 19 04:38:34.731421 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 888/1733] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:34 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1401 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:34.733276 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6867460f-2f4d-43a1-b7c2-b4db4e8fcb03 req-76529d16-3c40-4d48-b469-c5df9994efd2 service nova] Creating event network-changed:33fd5ca9-39f1-4823-9bb9-fd2d27226a63 for instance 37301659-d7ed-41fe-be72-46f2e9185650 on n-h1-766726-30 May 19 04:38:34.743403 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6867460f-2f4d-43a1-b7c2-b4db4e8fcb03 req-76529d16-3c40-4d48-b469-c5df9994efd2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051881 May 19 04:38:34.744287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-80235730-c638-4efc-8bd0-ed2b109ff389 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: .version_select at 0x7fd315ff3670>, body: {"security_group": {"name": " tempest-securitygroup -1374670339 ", "description": "tempest-description-535889044"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:34.755612 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 846/1734] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:34.764224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-978b06bf-8d09-414c-a132-044015b5311f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:34.764930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-978b06bf-8d09-414c-a132-044015b5311f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:34.789443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-978b06bf-8d09-414c-a132-044015b5311f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.789443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-978b06bf-8d09-414c-a132-044015b5311f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:34.790150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-978b06bf-8d09-414c-a132-044015b5311f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:34.790660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-978b06bf-8d09-414c-a132-044015b5311f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.076138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-978b06bf-8d09-414c-a132-044015b5311f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:35.090490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-978b06bf-8d09-414c-a132-044015b5311f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.330286 May 19 04:38:35.091744 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 847/1735] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:34 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:35.097806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1088955131", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["e626b1ac-a89d-4758-84dd-4367faa06cde"]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:35.165144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:38:35.268690 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-80235730-c638-4efc-8bd0-ed2b109ff389 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.534288 May 19 04:38:35.275300 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 889/1736] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:38:34 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:35.275300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8e8a7b2f-ab61-48fb-9ae7-c7c414a12893 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:35.276061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e8a7b2f-ab61-48fb-9ae7-c7c414a12893 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:35.285579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e8a7b2f-ab61-48fb-9ae7-c7c414a12893 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:35.286297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e8a7b2f-ab61-48fb-9ae7-c7c414a12893 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.287282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e8a7b2f-ab61-48fb-9ae7-c7c414a12893 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:35.287875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e8a7b2f-ab61-48fb-9ae7-c7c414a12893 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.555027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e8a7b2f-ab61-48fb-9ae7-c7c414a12893 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:35.563464 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8e8a7b2f-ab61-48fb-9ae7-c7c414a12893 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.292309 May 19 04:38:35.565537 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 890/1737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:35 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:35.569256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:35.570183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:35.577107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:35.577692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.578576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:35.579133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.653454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:38:35.654130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:38:35.654607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:38:35.655172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:38:35.655601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:38:35.667057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:35.667837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.668910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:35.669691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.692620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:38:35.698521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:38:35.713839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:38:35.716495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:38:35.779334 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b16e14a3-05e8-4f47-ba43-6d0153cc1fd0 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685869 May 19 04:38:35.780688 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 848/1738] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:38:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:38:35.787305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a58c40e6-1f24-413c-a3cb-b3b66b2fe8dc req-2ab651ac-75d8-46df-a8a4-8d4963565095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b71b11-ff6f-49dc-9fbd-cf68e47af55f", "name": "network-vif-plugged", "status": "completed", "tag": "4969e6d6-ab69-44db-b04b-336fe8d72fae"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:35.800551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a58c40e6-1f24-413c-a3cb-b3b66b2fe8dc req-2ab651ac-75d8-46df-a8a4-8d4963565095 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:35.801538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a58c40e6-1f24-413c-a3cb-b3b66b2fe8dc req-2ab651ac-75d8-46df-a8a4-8d4963565095 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.821005 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a58c40e6-1f24-413c-a3cb-b3b66b2fe8dc req-2ab651ac-75d8-46df-a8a4-8d4963565095 service nova] Creating event network-vif-plugged:4969e6d6-ab69-44db-b04b-336fe8d72fae for instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f on n-h1-766726-30 May 19 04:38:35.830859 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a58c40e6-1f24-413c-a3cb-b3b66b2fe8dc req-2ab651ac-75d8-46df-a8a4-8d4963565095 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048270 May 19 04:38:35.836555 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 849/1739] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:35.860971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:35.861777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:35.862990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:35.873631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:35.875417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:35.876340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:35.877744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.878670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:35.879764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:35.885608 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-496de711-a93f-46ab-a960-7e6714bf96c7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.320283 May 19 04:38:35.887186 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 891/1740] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:35 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:35.897535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9663030-f676-479c-8ae3-b86f236677bf tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd3161df940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:36.002903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:36.013027 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a9663030-f676-479c-8ae3-b86f236677bf tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4" status: 200 len: 223 microversion: 2.1 time: 0.124455 May 19 04:38:36.019549 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 892/1741] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:38:35 2022] GET /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 => generated 223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:36.022042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:36.023890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:36.026458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5776e630-5981-4cce-b133-e7419ddde296 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.187567 May 19 04:38:36.029009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3d05a09e-d551-4923-a3f7-11d307dc1876 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:36.032511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3d05a09e-d551-4923-a3f7-11d307dc1876 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:36.038826 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 850/1742] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:35 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:36.042471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d05a09e-d551-4923-a3f7-11d307dc1876 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:36.043059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d05a09e-d551-4923-a3f7-11d307dc1876 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:36.044090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d05a09e-d551-4923-a3f7-11d307dc1876 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:36.044642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d05a09e-d551-4923-a3f7-11d307dc1876 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:36.046461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-85f7eda4-b5af-471a-8d7f-0206a0c3bb67 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:36.047245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-85f7eda4-b5af-471a-8d7f-0206a0c3bb67 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:36.075872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:36.119061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-85f7eda4-b5af-471a-8d7f-0206a0c3bb67 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:36.128701 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-85f7eda4-b5af-471a-8d7f-0206a0c3bb67 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1217 microversion: 2.1 time: 0.088202 May 19 04:38:36.130231 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 851/1743] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:36 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:36.135819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e137f08a-1b44-4080-8a59-39ad0ded3db2 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315fba820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:36.310020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3d05a09e-d551-4923-a3f7-11d307dc1876 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:36.320256 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3d05a09e-d551-4923-a3f7-11d307dc1876 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1401 microversion: 2.1 time: 0.304657 May 19 04:38:36.321106 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 893/1744] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:36 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1401 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:36.333783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-580c1814-2793-4a88-9bfb-99ce2b804c2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:36.338005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-580c1814-2793-4a88-9bfb-99ce2b804c2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:36.347312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-580c1814-2793-4a88-9bfb-99ce2b804c2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:36.349193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-580c1814-2793-4a88-9bfb-99ce2b804c2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:36.350387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-580c1814-2793-4a88-9bfb-99ce2b804c2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:36.351931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-580c1814-2793-4a88-9bfb-99ce2b804c2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:36.481269 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e137f08a-1b44-4080-8a59-39ad0ded3db2 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4" status: 202 len: 0 microversion: 2.1 time: 0.349731 May 19 04:38:36.481850 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 852/1745] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:38:36 2022] DELETE /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:36.489854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8d73f53c-144c-44f4-a22a-7166a4418c96 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315fe9c10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:36.536368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-8d73f53c-144c-44f4-a22a-7166a4418c96 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:38:36.537404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-8d73f53c-144c-44f4-a22a-7166a4418c96 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:38:36.538618 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-8d73f53c-144c-44f4-a22a-7166a4418c96 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:38:36.538618 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-36cebbb6-462b-4e1f-9e7c-804901c5987e'] May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8d73f53c-144c-44f4-a22a-7166a4418c96 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 HTTP/1.1 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-36cebbb6-462b-4e1f-9e7c-804901c5987e'] May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '1311f251-7c2c-4ecf-b55d-e5261b3ee7a4'} May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:38:36.543015 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36cebbb6-462b-4e1f-9e7c-804901c5987e'] May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36cebbb6-462b-4e1f-9e7c-804901c5987e'] May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36cebbb6-462b-4e1f-9e7c-804901c5987e'] May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36cebbb6-462b-4e1f-9e7c-804901c5987e'] May 19 04:38:36.551509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:36.559092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8d73f53c-144c-44f4-a22a-7166a4418c96 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:38:36.559092 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-36cebbb6-462b-4e1f-9e7c-804901c5987e'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:38:36.567736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8d73f53c-144c-44f4-a22a-7166a4418c96 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4" status: 404 len: 194 microversion: 2.1 time: 0.071193 May 19 04:38:36.568507 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 853/1746] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:38:36 2022] GET /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:38:36.571423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-580c1814-2793-4a88-9bfb-99ce2b804c2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:36.573678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-51f65685-705a-482a-8685-7324e9365c39 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: .version_select at 0x7fd3160b7430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1037148933", "description": "tempest-description-1387952818"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:36.583129 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-580c1814-2793-4a88-9bfb-99ce2b804c2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.258472 May 19 04:38:36.584293 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 894/1747] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:36 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:36.589495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8b05da4-3596-4732-b8b6-40c20a9ca551 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:36.590617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8b05da4-3596-4732-b8b6-40c20a9ca551 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:36.598871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8b05da4-3596-4732-b8b6-40c20a9ca551 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:36.599491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8b05da4-3596-4732-b8b6-40c20a9ca551 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:36.600841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8b05da4-3596-4732-b8b6-40c20a9ca551 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:36.601450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8b05da4-3596-4732-b8b6-40c20a9ca551 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:36.795141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8b05da4-3596-4732-b8b6-40c20a9ca551 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:36.804727 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8b05da4-3596-4732-b8b6-40c20a9ca551 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.219018 May 19 04:38:36.814776 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 895/1748] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:36 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:36.830803 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-51f65685-705a-482a-8685-7324e9365c39 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.261045 May 19 04:38:36.837479 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 854/1749] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:38:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:36.842617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dd453fb3-1afe-4a34-b0ce-8325ccc208e4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: .version_select at 0x7fd315dd49d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-81998944", "description": "tempest-description-1288727456"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:36.903925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:36.904549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:36.912253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:36.913055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:36.913943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:36.914744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:36.953923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:37.135319 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dd453fb3-1afe-4a34-b0ce-8325ccc208e4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.296251 May 19 04:38:37.136525 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 896/1750] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:38:36 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:37.142117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:37.143384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:37.152531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.153413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.154492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.155146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.251390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:37.262957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:37.266532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:37.271457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:37.272820 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1fe31187-4181-4432-af81-bf611aacac8d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.135155 May 19 04:38:37.276517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:37.281121 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 897/1751] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:37 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:37.284294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:37.285549 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6224820e-8290-4f0d-a936-bf3871a123e4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.385568 May 19 04:38:37.286139 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 855/1752] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:36 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:37.291959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d2c6d73f-1b0f-4d15-9f54-4679ecade5df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:37.293272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d2c6d73f-1b0f-4d15-9f54-4679ecade5df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:37.294113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d3f32897-6d9e-4cb7-82f9-787f35572bf5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: .version_select at 0x7fd3162638b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1109215804", "description": "tempest-description-1812111632"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:37.299845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c6d73f-1b0f-4d15-9f54-4679ecade5df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.300300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c6d73f-1b0f-4d15-9f54-4679ecade5df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.301093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c6d73f-1b0f-4d15-9f54-4679ecade5df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.301639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c6d73f-1b0f-4d15-9f54-4679ecade5df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.398557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d2c6d73f-1b0f-4d15-9f54-4679ecade5df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:37.426049 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d2c6d73f-1b0f-4d15-9f54-4679ecade5df tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1275 microversion: 2.1 time: 0.137118 May 19 04:38:37.426759 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 856/1753] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:37 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:37.442231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79fad26f-2a0c-45d1-8750-803c79598c79 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:37.442788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-79fad26f-2a0c-45d1-8750-803c79598c79 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:37.452647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79fad26f-2a0c-45d1-8750-803c79598c79 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.453353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79fad26f-2a0c-45d1-8750-803c79598c79 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.454338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79fad26f-2a0c-45d1-8750-803c79598c79 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.454971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79fad26f-2a0c-45d1-8750-803c79598c79 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.525852 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d3f32897-6d9e-4cb7-82f9-787f35572bf5 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.244495 May 19 04:38:37.526645 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 898/1754] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:38:37 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:37.540600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4685cd78-045e-434c-ae9b-0c5ccab71d84 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd31613faf0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:37.691474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-79fad26f-2a0c-45d1-8750-803c79598c79 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:37.708890 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79fad26f-2a0c-45d1-8750-803c79598c79 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1401 microversion: 2.1 time: 0.279449 May 19 04:38:37.709888 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 857/1755] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:37 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1401 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:37.716561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9a91dd9c-1ab7-4720-823b-7ee2c06212b9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:37.717611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9a91dd9c-1ab7-4720-823b-7ee2c06212b9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:37.727893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a91dd9c-1ab7-4720-823b-7ee2c06212b9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.729448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a91dd9c-1ab7-4720-823b-7ee2c06212b9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.730518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a91dd9c-1ab7-4720-823b-7ee2c06212b9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.731216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a91dd9c-1ab7-4720-823b-7ee2c06212b9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.912822 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4685cd78-045e-434c-ae9b-0c5ccab71d84 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.379447 May 19 04:38:37.913464 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 899/1756] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:38:37 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:37.924852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef0fe4ca-403b-4751-811b-8dfa3a2ab558 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:37.925513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef0fe4ca-403b-4751-811b-8dfa3a2ab558 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:37.931892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9a91dd9c-1ab7-4720-823b-7ee2c06212b9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:37.942191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef0fe4ca-403b-4751-811b-8dfa3a2ab558 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.942652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef0fe4ca-403b-4751-811b-8dfa3a2ab558 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.943433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9a91dd9c-1ab7-4720-823b-7ee2c06212b9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.232183 May 19 04:38:37.943565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef0fe4ca-403b-4751-811b-8dfa3a2ab558 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:37.943883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef0fe4ca-403b-4751-811b-8dfa3a2ab558 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:37.957013 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 858/1757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:37 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:37.962401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d10f6866-66d5-480c-9643-27ed15ded6a1 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315fc33a0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:38.218169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ef0fe4ca-403b-4751-811b-8dfa3a2ab558 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:38.247957 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef0fe4ca-403b-4751-811b-8dfa3a2ab558 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.318633 May 19 04:38:38.250904 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 900/1758] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:37 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:38.294995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:38.295971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:38.307274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:38.311717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:38.312867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:38.313556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:38.426787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:38.433251 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d10f6866-66d5-480c-9643-27ed15ded6a1 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/09d0d728-56b2-41ef-97e5-964a3848301c" status: 202 len: 0 microversion: 2.1 time: 0.474908 May 19 04:38:38.434183 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 859/1759] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:38:37 2022] DELETE /compute/v2.1/os-security-groups/09d0d728-56b2-41ef-97e5-964a3848301c => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:38.441552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:38.442676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:38.444302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:38.449304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:38.450816 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0bf712d6-064b-4d4f-baf9-42dc1fc089a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.160489 May 19 04:38:38.451669 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 901/1760] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:38 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:38.464223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:38.464663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b854293-6683-4269-ac78-31b6f4e52bd2 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd3161df940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:38.464821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:38.465595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:38.466036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:38.508685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG neutronclient.v2_0.client [None req-9b854293-6683-4269-ac78-31b6f4e52bd2 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist", "detail": ""}} {{(pid=124818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:38:38.509700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.security_group_api [None req-9b854293-6683-4269-ac78-31b6f4e52bd2 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group 09d0d728-56b2-41ef-97e5-964a3848301c not found {{(pid=124818) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:38:38.510538 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9b854293-6683-4269-ac78-31b6f4e52bd2 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:38:38.510538 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-a3f1480d-4017-4ffe-b364-21f07aa560dc'] May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b854293-6683-4269-ac78-31b6f4e52bd2 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-security-groups/09d0d728-56b2-41ef-97e5-964a3848301c HTTP/1.1 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: exception: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-a3f1480d-4017-4ffe-b364-21f07aa560dc'] May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '09d0d728-56b2-41ef-97e5-964a3848301c'} May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:38:38.513734 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f1480d-4017-4ffe-b364-21f07aa560dc'] May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f1480d-4017-4ffe-b364-21f07aa560dc'] May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f1480d-4017-4ffe-b364-21f07aa560dc'] May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f1480d-4017-4ffe-b364-21f07aa560dc'] May 19 04:38:38.518602 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:38:38.525898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b854293-6683-4269-ac78-31b6f4e52bd2 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:38:38.525898 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-a3f1480d-4017-4ffe-b364-21f07aa560dc'] {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:38:38.527524 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9b854293-6683-4269-ac78-31b6f4e52bd2 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/09d0d728-56b2-41ef-97e5-964a3848301c" status: 404 len: 194 microversion: 2.1 time: 0.074683 May 19 04:38:38.531791 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 902/1761] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:38:38 2022] GET /compute/v2.1/os-security-groups/09d0d728-56b2-41ef-97e5-964a3848301c => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:38:38.542459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-11e1696d-4180-4c03-ab09-14fc8947868b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:38.543350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-11e1696d-4180-4c03-ab09-14fc8947868b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:38.562522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11e1696d-4180-4c03-ab09-14fc8947868b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:38.563303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11e1696d-4180-4c03-ab09-14fc8947868b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:38.564345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11e1696d-4180-4c03-ab09-14fc8947868b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:38.565024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11e1696d-4180-4c03-ab09-14fc8947868b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:38.840841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:38.855277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:38.855850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-11e1696d-4180-4c03-ab09-14fc8947868b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:38.857435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:38.858828 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed70ce8d-9c74-48f5-a00a-68b2b7a3cb8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.423683 May 19 04:38:38.859421 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 860/1762] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:38 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:38.874103 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-11e1696d-4180-4c03-ab09-14fc8947868b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1317 microversion: 2.1 time: 0.340743 May 19 04:38:38.875384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8f7b9f8e-fc8e-452b-9e66-bb8903a628e1 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd31608bf70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:38.890331 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 903/1763] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:38 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:38.895524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c0158d98-80a6-4727-ab66-9a58183333fd tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:38.906585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c0158d98-80a6-4727-ab66-9a58183333fd tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:38.916164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0158d98-80a6-4727-ab66-9a58183333fd tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:38.916981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0158d98-80a6-4727-ab66-9a58183333fd tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:38.918079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0158d98-80a6-4727-ab66-9a58183333fd tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:38.919421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0158d98-80a6-4727-ab66-9a58183333fd tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.171415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c0158d98-80a6-4727-ab66-9a58183333fd tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:39.186257 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c0158d98-80a6-4727-ab66-9a58183333fd tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1587 microversion: 2.1 time: 0.294446 May 19 04:38:39.187504 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 904/1764] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:38 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1587 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:39.192514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e781ea4d-331a-4dbe-9910-d06bf23a9d46 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:39.193440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e781ea4d-331a-4dbe-9910-d06bf23a9d46 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:39.201258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e781ea4d-331a-4dbe-9910-d06bf23a9d46 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.202269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e781ea4d-331a-4dbe-9910-d06bf23a9d46 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.203282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e781ea4d-331a-4dbe-9910-d06bf23a9d46 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.203944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e781ea4d-331a-4dbe-9910-d06bf23a9d46 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.295478 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8f7b9f8e-fc8e-452b-9e66-bb8903a628e1 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8fb5dacb-821d-4059-a66d-fadcddd0c2a8" status: 202 len: 0 microversion: 2.1 time: 0.424153 May 19 04:38:39.296944 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 861/1765] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:38:38 2022] DELETE /compute/v2.1/os-security-groups/8fb5dacb-821d-4059-a66d-fadcddd0c2a8 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:39.308117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-04d9f329-a42c-4528-8932-c293187f91f7 req-74528506-6564-4ffb-a8ad-56b804a434a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6365b24-b115-45c9-985b-d60b956b759c", "tag": "f5b9e699-1c43-442e-9b20-c9e2e2ea35b8"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:39.322150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-04d9f329-a42c-4528-8932-c293187f91f7 req-74528506-6564-4ffb-a8ad-56b804a434a4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.322600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-04d9f329-a42c-4528-8932-c293187f91f7 req-74528506-6564-4ffb-a8ad-56b804a434a4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.379598 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-04d9f329-a42c-4528-8932-c293187f91f7 req-74528506-6564-4ffb-a8ad-56b804a434a4 service nova] Creating event network-changed:f5b9e699-1c43-442e-9b20-c9e2e2ea35b8 for instance c6365b24-b115-45c9-985b-d60b956b759c on n-h2-766726-30 May 19 04:38:39.389679 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-04d9f329-a42c-4528-8932-c293187f91f7 req-74528506-6564-4ffb-a8ad-56b804a434a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086896 May 19 04:38:39.390805 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 862/1766] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:39.402017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a920cbcd-880d-4b93-ab5c-dd80c3c00ac8 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:39.402614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a920cbcd-880d-4b93-ab5c-dd80c3c00ac8 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:39.414639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a920cbcd-880d-4b93-ab5c-dd80c3c00ac8 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.415050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a920cbcd-880d-4b93-ab5c-dd80c3c00ac8 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.416575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a920cbcd-880d-4b93-ab5c-dd80c3c00ac8 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.417152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a920cbcd-880d-4b93-ab5c-dd80c3c00ac8 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.508128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e781ea4d-331a-4dbe-9910-d06bf23a9d46 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:39.526829 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e781ea4d-331a-4dbe-9910-d06bf23a9d46 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.335770 May 19 04:38:39.529939 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 905/1767] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:39 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:39.541110 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a920cbcd-880d-4b93-ab5c-dd80c3c00ac8 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148351 May 19 04:38:39.542406 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 863/1768] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:38:39 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:39.544790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ce683387-b426-4622-bb50-0a7a2da528e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:39.545767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ce683387-b426-4622-bb50-0a7a2da528e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:39.547223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e58b55c7-d96f-4597-9956-ebd3bc686aba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315fc3b80>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:39.556089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce683387-b426-4622-bb50-0a7a2da528e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.556794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce683387-b426-4622-bb50-0a7a2da528e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.558631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce683387-b426-4622-bb50-0a7a2da528e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.559751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce683387-b426-4622-bb50-0a7a2da528e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.706876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-e58b55c7-d96f-4597-9956-ebd3bc686aba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:38:39.707740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-e58b55c7-d96f-4597-9956-ebd3bc686aba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:38:39.708269 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-e58b55c7-d96f-4597-9956-ebd3bc686aba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:38:39.708269 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-e28997ac-d22f-4f67-a2c3-e052c8892865'] May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e58b55c7-d96f-4597-9956-ebd3bc686aba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-security-groups/8fb5dacb-821d-4059-a66d-fadcddd0c2a8 HTTP/1.1 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-e28997ac-d22f-4f67-a2c3-e052c8892865'] May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '8fb5dacb-821d-4059-a66d-fadcddd0c2a8'} May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:38:39.710480 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e28997ac-d22f-4f67-a2c3-e052c8892865'] May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e28997ac-d22f-4f67-a2c3-e052c8892865'] May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e28997ac-d22f-4f67-a2c3-e052c8892865'] May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e28997ac-d22f-4f67-a2c3-e052c8892865'] May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e58b55c7-d96f-4597-9956-ebd3bc686aba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-e28997ac-d22f-4f67-a2c3-e052c8892865'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e58b55c7-d96f-4597-9956-ebd3bc686aba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/8fb5dacb-821d-4059-a66d-fadcddd0c2a8" status: 404 len: 194 microversion: 2.1 time: 0.168413 May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 864/1769] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:38:39 2022] GET /compute/v2.1/os-security-groups/8fb5dacb-821d-4059-a66d-fadcddd0c2a8 => generated 194 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:39.720970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:39.734444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.734444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.736053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.736255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.837141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:39.846072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:39.847860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:39.849113 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ec11d8ed-55f3-43e5-98cc-829792e4abe2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.135598 May 19 04:38:39.849690 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 865/1770] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:39 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:39.855059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da7e07b0-45c3-46ee-9b1b-1e972b6988e4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd3160c6040>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:39.921438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ce683387-b426-4622-bb50-0a7a2da528e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:39.930467 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ce683387-b426-4622-bb50-0a7a2da528e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.398573 May 19 04:38:39.931661 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 906/1771] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:39 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:39.936750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:39.937411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:39.943697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.944157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:39.944936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:39.945410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:40.342843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:40.354081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:40.355588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:40.356768 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7df4be8e-f4da-40b9-8c0b-4cdf3203de85 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.423712 May 19 04:38:40.357388 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 907/1772] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:39 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:40.362291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ae76e209-f50d-4ba5-8c90-b68a30b1d4e8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:40.363133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ae76e209-f50d-4ba5-8c90-b68a30b1d4e8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:40.370787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae76e209-f50d-4ba5-8c90-b68a30b1d4e8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:40.371111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae76e209-f50d-4ba5-8c90-b68a30b1d4e8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:40.371891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae76e209-f50d-4ba5-8c90-b68a30b1d4e8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:40.372328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae76e209-f50d-4ba5-8c90-b68a30b1d4e8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:40.476105 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da7e07b0-45c3-46ee-9b1b-1e972b6988e4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/9274d45b-7a6d-490b-b7f1-d8842681c093" status: 202 len: 0 microversion: 2.1 time: 0.625102 May 19 04:38:40.480741 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 866/1773] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:38:39 2022] DELETE /compute/v2.1/os-security-groups/9274d45b-7a6d-490b-b7f1-d8842681c093 => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:40.486133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b2bc393-0093-45eb-a8f8-d3dada34a0c6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd316054160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:40.545378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-5b2bc393-0093-45eb-a8f8-d3dada34a0c6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:38:40.549065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-5b2bc393-0093-45eb-a8f8-d3dada34a0c6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group 9274d45b-7a6d-490b-b7f1-d8842681c093 not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:38:40.550248 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5b2bc393-0093-45eb-a8f8-d3dada34a0c6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:38:40.550248 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-154fb572-be44-4384-906b-aff3041785ab'] May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b2bc393-0093-45eb-a8f8-d3dada34a0c6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-security-groups/9274d45b-7a6d-490b-b7f1-d8842681c093 HTTP/1.1 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-154fb572-be44-4384-906b-aff3041785ab'] May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '9274d45b-7a6d-490b-b7f1-d8842681c093'} May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:38:40.552938 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-154fb572-be44-4384-906b-aff3041785ab'] May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-154fb572-be44-4384-906b-aff3041785ab'] May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-154fb572-be44-4384-906b-aff3041785ab'] May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-154fb572-be44-4384-906b-aff3041785ab'] May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b2bc393-0093-45eb-a8f8-d3dada34a0c6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:38:40.558952 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-154fb572-be44-4384-906b-aff3041785ab'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:38:40.566997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5b2bc393-0093-45eb-a8f8-d3dada34a0c6 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/9274d45b-7a6d-490b-b7f1-d8842681c093" status: 404 len: 194 microversion: 2.1 time: 0.079311 May 19 04:38:40.566997 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 867/1774] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:38:40 2022] GET /compute/v2.1/os-security-groups/9274d45b-7a6d-490b-b7f1-d8842681c093 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:38:40.571552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ef7b165-f753-4b13-98e7-ede5107f236f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:40.572489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2ef7b165-f753-4b13-98e7-ede5107f236f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:40.577202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:40.583105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ef7b165-f753-4b13-98e7-ede5107f236f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:40.583741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ef7b165-f753-4b13-98e7-ede5107f236f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:40.584755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ef7b165-f753-4b13-98e7-ede5107f236f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:40.585327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ef7b165-f753-4b13-98e7-ede5107f236f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:40.745482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ae76e209-f50d-4ba5-8c90-b68a30b1d4e8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:40.754942 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ae76e209-f50d-4ba5-8c90-b68a30b1d4e8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1317 microversion: 2.1 time: 0.396287 May 19 04:38:40.755533 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 908/1775] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:40 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:40.760655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-810c2464-c9bc-4a30-a430-ab7f5273383b tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd3160895e0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:40.880328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ef7b165-f753-4b13-98e7-ede5107f236f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:40.895596 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ef7b165-f753-4b13-98e7-ede5107f236f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.331163 May 19 04:38:40.896498 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 868/1776] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:40 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:40.920839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:40.921901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:40.928506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:40.929247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:40.937190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:40.937882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:41.361112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:41.371241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:41.373226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:41.375122 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c5c77b14-c23d-4711-bba9-54d3c269c1a7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.477258 May 19 04:38:41.376167 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 869/1777] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:40 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:41.382211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e429f51-8c62-4456-a5fe-66ea92dad3ac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:41.383062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e429f51-8c62-4456-a5fe-66ea92dad3ac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:41.391630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e429f51-8c62-4456-a5fe-66ea92dad3ac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:41.392321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e429f51-8c62-4456-a5fe-66ea92dad3ac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:41.393323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e429f51-8c62-4456-a5fe-66ea92dad3ac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:41.394002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e429f51-8c62-4456-a5fe-66ea92dad3ac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:41.552920 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-810c2464-c9bc-4a30-a430-ab7f5273383b tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.796000 May 19 04:38:41.562616 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 909/1778] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:38:40 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:41.562616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:41.562616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:41.569418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:41.569915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:41.570772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:41.571316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:41.701974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e429f51-8c62-4456-a5fe-66ea92dad3ac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:41.711484 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e429f51-8c62-4456-a5fe-66ea92dad3ac tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.333954 May 19 04:38:41.722161 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 870/1779] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:41 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:41.722161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7846fa25-7aa5-4b50-9f4c-8d39c5b6fb1a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: .version_select at 0x7fd315fe9430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-743621687", "description": "tempest-description-699275796"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:41.971228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:41.983281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:41.985500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:41.987021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d5a4af3-2149-4c46-b892-8cfedd320092 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.431659 May 19 04:38:41.998402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 910/1780] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:41 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:42.005696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dc7b0688-e5be-452f-8415-93863a2d4391 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:42.006842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dc7b0688-e5be-452f-8415-93863a2d4391 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:42.017619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc7b0688-e5be-452f-8415-93863a2d4391 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.018840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc7b0688-e5be-452f-8415-93863a2d4391 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.019889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc7b0688-e5be-452f-8415-93863a2d4391 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.020725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc7b0688-e5be-452f-8415-93863a2d4391 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.085215 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7846fa25-7aa5-4b50-9f4c-8d39c5b6fb1a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.370827 May 19 04:38:42.092444 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 871/1781] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:38:41 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:42.098100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e6444fb5-baea-4b49-a5fe-90ead8fb83c3 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:42.099037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e6444fb5-baea-4b49-a5fe-90ead8fb83c3 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:42.105617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6444fb5-baea-4b49-a5fe-90ead8fb83c3 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.106400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6444fb5-baea-4b49-a5fe-90ead8fb83c3 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.107414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6444fb5-baea-4b49-a5fe-90ead8fb83c3 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.107933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6444fb5-baea-4b49-a5fe-90ead8fb83c3 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.267625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc7b0688-e5be-452f-8415-93863a2d4391 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:42.276051 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dc7b0688-e5be-452f-8415-93863a2d4391 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1317 microversion: 2.1 time: 0.274565 May 19 04:38:42.278709 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 911/1782] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:41 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:42.285206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2356b1b1-93d8-41f4-8f39-1fe273f93fde tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:42.286510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2356b1b1-93d8-41f4-8f39-1fe273f93fde tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:42.294205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2356b1b1-93d8-41f4-8f39-1fe273f93fde tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.294968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2356b1b1-93d8-41f4-8f39-1fe273f93fde tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.296043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2356b1b1-93d8-41f4-8f39-1fe273f93fde tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.296650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2356b1b1-93d8-41f4-8f39-1fe273f93fde tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.315805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e6444fb5-baea-4b49-a5fe-90ead8fb83c3 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:42.324706 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e6444fb5-baea-4b49-a5fe-90ead8fb83c3 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.230801 May 19 04:38:42.327045 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 872/1783] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:42 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:42.332168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2904889a-c88a-48b0-b906-272c1808d972 req-adf568d4-b670-4fe4-bcee-9585a9905eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b71b11-ff6f-49dc-9fbd-cf68e47af55f", "tag": "4969e6d6-ab69-44db-b04b-336fe8d72fae"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:42.341916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2904889a-c88a-48b0-b906-272c1808d972 req-adf568d4-b670-4fe4-bcee-9585a9905eba service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.342592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2904889a-c88a-48b0-b906-272c1808d972 req-adf568d4-b670-4fe4-bcee-9585a9905eba service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.361105 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2904889a-c88a-48b0-b906-272c1808d972 req-adf568d4-b670-4fe4-bcee-9585a9905eba service nova] Creating event network-changed:4969e6d6-ab69-44db-b04b-336fe8d72fae for instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f on n-h1-766726-30 May 19 04:38:42.366276 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2904889a-c88a-48b0-b906-272c1808d972 req-adf568d4-b670-4fe4-bcee-9585a9905eba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037840 May 19 04:38:42.367498 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 873/1784] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:42.374079 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f51e722d-bca4-4e2c-9b88-5fa099fba60a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: .version_select at 0x7fd316583e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-90667158", "description": "tempest-description-248862834"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:42.531684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2356b1b1-93d8-41f4-8f39-1fe273f93fde tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:42.546297 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2356b1b1-93d8-41f4-8f39-1fe273f93fde tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1587 microversion: 2.1 time: 0.265112 May 19 04:38:42.548251 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 912/1785] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:42 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1587 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:42.562994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:42.565973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:42.581548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.582018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.585371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.585943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.669472 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f51e722d-bca4-4e2c-9b88-5fa099fba60a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.299171 May 19 04:38:42.670302 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 874/1786] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:38:42 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:42.703418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:42.720585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:42.722223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:42.723360 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0401cb09-ac20-42c6-8125-2f4925f0806d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.171546 May 19 04:38:42.723920 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 913/1787] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:42 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:42.738679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1304691016", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "086db77f-147f-4c2e-996c-a366ebcb0f52"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:42.741711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-788b0bb9-f3d9-4128-bedb-15f2155b6d27 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:42.742556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-788b0bb9-f3d9-4128-bedb-15f2155b6d27 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:42.752987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-788b0bb9-f3d9-4128-bedb-15f2155b6d27 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.753482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-788b0bb9-f3d9-4128-bedb-15f2155b6d27 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.754274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-788b0bb9-f3d9-4128-bedb-15f2155b6d27 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:42.754718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-788b0bb9-f3d9-4128-bedb-15f2155b6d27 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:42.811744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] validate_networks() for [('086db77f-147f-4c2e-996c-a366ebcb0f52', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:38:42.928757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-788b0bb9-f3d9-4128-bedb-15f2155b6d27 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:42.938960 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-788b0bb9-f3d9-4128-bedb-15f2155b6d27 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.210273 May 19 04:38:42.940328 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 875/1788] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:42 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:43.010128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:43.011200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:43.019963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.020750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.021794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.022414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.346870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:43.363903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:43.367955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:43.370241 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cbad3ee6-eaaf-452f-abbb-fce7c4071d05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.365662 May 19 04:38:43.384713 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 876/1789] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:43 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:43.389995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-16552bdd-ad95-4583-b6f9-3f5b86d3f4fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:43.390985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-16552bdd-ad95-4583-b6f9-3f5b86d3f4fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:43.397997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16552bdd-ad95-4583-b6f9-3f5b86d3f4fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.398798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16552bdd-ad95-4583-b6f9-3f5b86d3f4fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.399834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16552bdd-ad95-4583-b6f9-3f5b86d3f4fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.401210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16552bdd-ad95-4583-b6f9-3f5b86d3f4fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.515004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:38:43.515672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:38:43.516213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:38:43.516710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:38:43.517286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:38:43.528635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.529325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.530269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.531034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.551198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Getting quotas for project 645df4342899445a910f1e00063507b4. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:38:43.556985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Getting quotas for user 80fcb65cf5734252970667c2ad2a8e86 and project 645df4342899445a910f1e00063507b4. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:38:43.570566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:38:43.573868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:38:43.593647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-16552bdd-ad95-4583-b6f9-3f5b86d3f4fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:43.602708 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-16552bdd-ad95-4583-b6f9-3f5b86d3f4fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1317 microversion: 2.1 time: 0.216548 May 19 04:38:43.606161 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 877/1790] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:43 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:43.612010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-52b8c8b2-e124-4efb-b64b-d4a819a9275e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:43.612629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-52b8c8b2-e124-4efb-b64b-d4a819a9275e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:43.620154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52b8c8b2-e124-4efb-b64b-d4a819a9275e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.621347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52b8c8b2-e124-4efb-b64b-d4a819a9275e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.622647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52b8c8b2-e124-4efb-b64b-d4a819a9275e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.623466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52b8c8b2-e124-4efb-b64b-d4a819a9275e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.646252 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-37145274-92d5-4979-ba0d-dffa12654ea7 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911264 May 19 04:38:43.647942 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 914/1791] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:38:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:38:43.662543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c9bdfbe9-21ec-4e1a-942c-36467b3629b8 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:43.663827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c9bdfbe9-21ec-4e1a-942c-36467b3629b8 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:43.774699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c9bdfbe9-21ec-4e1a-942c-36467b3629b8 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:43.783539 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c9bdfbe9-21ec-4e1a-942c-36467b3629b8 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1216 microversion: 2.1 time: 0.129576 May 19 04:38:43.797278 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 915/1792] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:43 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:43.811583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:43.812228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:43.828131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.828536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.830717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.831312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.867317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:43.870746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-52b8c8b2-e124-4efb-b64b-d4a819a9275e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:43.887246 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-52b8c8b2-e124-4efb-b64b-d4a819a9275e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.279487 May 19 04:38:43.888402 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 878/1793] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:43 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:43.928164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:43.937812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:43.939654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:43.941096 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8c30c3d-e0dd-4a8b-bc96-3f923594f20d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.141743 May 19 04:38:43.941879 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 916/1794] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:43 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:43.957629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6e9f98ef-96de-4ca6-a6f4-1a259d511bce tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:43.958172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6e9f98ef-96de-4ca6-a6f4-1a259d511bce tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:43.970261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e9f98ef-96de-4ca6-a6f4-1a259d511bce tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.970870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e9f98ef-96de-4ca6-a6f4-1a259d511bce tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:43.971796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e9f98ef-96de-4ca6-a6f4-1a259d511bce tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:43.972460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e9f98ef-96de-4ca6-a6f4-1a259d511bce tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.120305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6e9f98ef-96de-4ca6-a6f4-1a259d511bce tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:44.131724 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6e9f98ef-96de-4ca6-a6f4-1a259d511bce tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.178230 May 19 04:38:44.132324 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 879/1795] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:43 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:44.391315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:44.391928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:44.396090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:44.401781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.402234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.403322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.403871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.616844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:44.623483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-648b6d20-1ee8-4616-bf5b-de56e99424fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:44.624634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-648b6d20-1ee8-4616-bf5b-de56e99424fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:44.632350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-648b6d20-1ee8-4616-bf5b-de56e99424fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.632611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:44.632983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-648b6d20-1ee8-4616-bf5b-de56e99424fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.634017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-648b6d20-1ee8-4616-bf5b-de56e99424fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.635077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:44.635236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-648b6d20-1ee8-4616-bf5b-de56e99424fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.636272 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27d89d1b-342a-4f0b-b0c9-7b3b6ce600be tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.248936 May 19 04:38:44.637227 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 917/1796] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:44 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:44.792580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-648b6d20-1ee8-4616-bf5b-de56e99424fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:44.796209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:44.801337 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-648b6d20-1ee8-4616-bf5b-de56e99424fd tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1317 microversion: 2.1 time: 0.182639 May 19 04:38:44.802188 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 880/1797] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:44 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:44.804673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a1f14f71-8c0d-43a8-8543-055a63b8c6fc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:44.805474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a1f14f71-8c0d-43a8-8543-055a63b8c6fc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:44.814842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1f14f71-8c0d-43a8-8543-055a63b8c6fc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.816771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1f14f71-8c0d-43a8-8543-055a63b8c6fc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.817947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1f14f71-8c0d-43a8-8543-055a63b8c6fc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.818614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1f14f71-8c0d-43a8-8543-055a63b8c6fc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.891075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a1f14f71-8c0d-43a8-8543-055a63b8c6fc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:44.900539 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a1f14f71-8c0d-43a8-8543-055a63b8c6fc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1276 microversion: 2.1 time: 0.101713 May 19 04:38:44.905261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5aba11c7-52be-4c3e-aa38-e611d081a8ad tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:44.906637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5aba11c7-52be-4c3e-aa38-e611d081a8ad tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:44.910862 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 918/1798] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:44 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:44.919300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5aba11c7-52be-4c3e-aa38-e611d081a8ad tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.919756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5aba11c7-52be-4c3e-aa38-e611d081a8ad tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.922596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5aba11c7-52be-4c3e-aa38-e611d081a8ad tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.925064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5aba11c7-52be-4c3e-aa38-e611d081a8ad tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.960221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:44.960838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:44.968507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.969015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:44.969775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:44.970446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.064704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:45.075357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:45.078345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:45.079950 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6da2a635-7529-48ec-9b14-bbb6f8611f6d tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.123754 May 19 04:38:45.090717 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 919/1799] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:44 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:45.125342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5aba11c7-52be-4c3e-aa38-e611d081a8ad tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:45.134614 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5aba11c7-52be-4c3e-aa38-e611d081a8ad tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.234132 May 19 04:38:45.144751 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 881/1800] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:44 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:45.151647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bae5c107-273f-4bb4-aad4-e88aa6a5ae78 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:45.152523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bae5c107-273f-4bb4-aad4-e88aa6a5ae78 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:45.158923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bae5c107-273f-4bb4-aad4-e88aa6a5ae78 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:45.159498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bae5c107-273f-4bb4-aad4-e88aa6a5ae78 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.160490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bae5c107-273f-4bb4-aad4-e88aa6a5ae78 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:45.160993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bae5c107-273f-4bb4-aad4-e88aa6a5ae78 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.338903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bae5c107-273f-4bb4-aad4-e88aa6a5ae78 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:45.347423 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bae5c107-273f-4bb4-aad4-e88aa6a5ae78 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.200866 May 19 04:38:45.356722 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 920/1801] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:45 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:45.399138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a12e98b0-5d03-4ca3-b27b-6f35f3df8f83 req-c8c9bf2f-52f2-4915-872e-99ce4eacb86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6365b24-b115-45c9-985b-d60b956b759c", "name": "network-vif-plugged", "status": "completed", "tag": "f5b9e699-1c43-442e-9b20-c9e2e2ea35b8"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:45.409066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a12e98b0-5d03-4ca3-b27b-6f35f3df8f83 req-c8c9bf2f-52f2-4915-872e-99ce4eacb86c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:45.409863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a12e98b0-5d03-4ca3-b27b-6f35f3df8f83 req-c8c9bf2f-52f2-4915-872e-99ce4eacb86c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.430322 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a12e98b0-5d03-4ca3-b27b-6f35f3df8f83 req-c8c9bf2f-52f2-4915-872e-99ce4eacb86c service nova] Creating event network-vif-plugged:f5b9e699-1c43-442e-9b20-c9e2e2ea35b8 for instance c6365b24-b115-45c9-985b-d60b956b759c on n-h2-766726-30 May 19 04:38:45.438696 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a12e98b0-5d03-4ca3-b27b-6f35f3df8f83 req-c8c9bf2f-52f2-4915-872e-99ce4eacb86c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043171 May 19 04:38:45.439863 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 882/1802] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:45.656883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:45.658170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:45.667057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:45.668083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.669377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:45.669978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.816664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:45.821117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ca24a79-477e-4bb8-a549-0b608d3c2f92 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:45.822059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3ca24a79-477e-4bb8-a549-0b608d3c2f92 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:45.828613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ca24a79-477e-4bb8-a549-0b608d3c2f92 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:45.829058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ca24a79-477e-4bb8-a549-0b608d3c2f92 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.829845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ca24a79-477e-4bb8-a549-0b608d3c2f92 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:45.830451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ca24a79-477e-4bb8-a549-0b608d3c2f92 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.917861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:45.928603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:45.930135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:45.931891 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-09260903-b3b2-4e78-9c61-4917bf0e0afa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.279518 May 19 04:38:45.943134 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 921/1803] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:45 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:45.948098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f86238ea-6fcb-40ce-8877-29897b87bef4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:45.948725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f86238ea-6fcb-40ce-8877-29897b87bef4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:45.955057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f86238ea-6fcb-40ce-8877-29897b87bef4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:45.955520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f86238ea-6fcb-40ce-8877-29897b87bef4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.956301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f86238ea-6fcb-40ce-8877-29897b87bef4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:45.956744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f86238ea-6fcb-40ce-8877-29897b87bef4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:45.997040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3ca24a79-477e-4bb8-a549-0b608d3c2f92 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:46.005236 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ca24a79-477e-4bb8-a549-0b608d3c2f92 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1317 microversion: 2.1 time: 0.189899 May 19 04:38:46.005819 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 883/1804] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:45 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:46.100385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:46.101642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:46.111030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:46.111787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f86238ea-6fcb-40ce-8877-29897b87bef4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:46.112093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:46.113041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:46.113744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:46.122458 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f86238ea-6fcb-40ce-8877-29897b87bef4 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1316 microversion: 2.1 time: 0.177894 May 19 04:38:46.131859 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 922/1805] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:45 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:46.141788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:46.155347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51b189ad-3e8b-40a1-bede-02a217c09f73 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:46.157022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-51b189ad-3e8b-40a1-bede-02a217c09f73 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:46.169147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51b189ad-3e8b-40a1-bede-02a217c09f73 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:46.169592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51b189ad-3e8b-40a1-bede-02a217c09f73 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:46.170366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51b189ad-3e8b-40a1-bede-02a217c09f73 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:46.170800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51b189ad-3e8b-40a1-bede-02a217c09f73 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:46.201279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:46.209985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:46.212691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:46.214217 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-969fff82-9e4b-45ed-a3e0-995aaa62b189 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.119335 May 19 04:38:46.224200 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 884/1806] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:46 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:46.355179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-51b189ad-3e8b-40a1-bede-02a217c09f73 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:46.364226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5003fed0-bce9-4947-87b6-3ef9bd2a8b70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:46.365246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5003fed0-bce9-4947-87b6-3ef9bd2a8b70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:46.365694 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51b189ad-3e8b-40a1-bede-02a217c09f73 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.216938 May 19 04:38:46.368336 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 923/1807] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:46 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:46.372854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5003fed0-bce9-4947-87b6-3ef9bd2a8b70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:46.373626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5003fed0-bce9-4947-87b6-3ef9bd2a8b70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:46.374679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5003fed0-bce9-4947-87b6-3ef9bd2a8b70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:46.375119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5003fed0-bce9-4947-87b6-3ef9bd2a8b70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:46.523939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5003fed0-bce9-4947-87b6-3ef9bd2a8b70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:46.532361 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5003fed0-bce9-4947-87b6-3ef9bd2a8b70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.172461 May 19 04:38:46.533186 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 885/1808] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:46 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:46.564847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-bb6dace1-3a1e-4c74-8f47-bdc04004e406 req-c630163c-7857-44b6-80fa-430558e9f459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604b274a-2199-4a0b-a8fb-bb606625a781", "tag": "4e249990-c90b-46d6-9678-f92a6e092cc1"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:46.575673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bb6dace1-3a1e-4c74-8f47-bdc04004e406 req-c630163c-7857-44b6-80fa-430558e9f459 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:46.576443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bb6dace1-3a1e-4c74-8f47-bdc04004e406 req-c630163c-7857-44b6-80fa-430558e9f459 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:46.596319 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-bb6dace1-3a1e-4c74-8f47-bdc04004e406 req-c630163c-7857-44b6-80fa-430558e9f459 service nova] Creating event network-changed:4e249990-c90b-46d6-9678-f92a6e092cc1 for instance 604b274a-2199-4a0b-a8fb-bb606625a781 on n-h2-766726-30 May 19 04:38:46.601605 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-bb6dace1-3a1e-4c74-8f47-bdc04004e406 req-c630163c-7857-44b6-80fa-430558e9f459 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041009 May 19 04:38:46.602483 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 924/1809] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:46.950559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:46.951572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:46.959800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:46.960350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:46.961221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:46.961724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.024038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6b207d4e-d70e-4ac7-93a5-e7ad2e3f385a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:47.026423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6b207d4e-d70e-4ac7-93a5-e7ad2e3f385a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:47.037568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b207d4e-d70e-4ac7-93a5-e7ad2e3f385a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.044392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b207d4e-d70e-4ac7-93a5-e7ad2e3f385a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.045418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b207d4e-d70e-4ac7-93a5-e7ad2e3f385a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.045949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b207d4e-d70e-4ac7-93a5-e7ad2e3f385a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.215182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.234603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.238263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.240010 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99da0787-f82f-4218-8e0c-9c8286992f75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.293496 May 19 04:38:47.240837 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 886/1810] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:46 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:47.246296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-859d1f84-d0de-4a4d-ac59-c29f17e886ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:47.247287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-859d1f84-d0de-4a4d-ac59-c29f17e886ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:47.254520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-859d1f84-d0de-4a4d-ac59-c29f17e886ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.255261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-859d1f84-d0de-4a4d-ac59-c29f17e886ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.256412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-859d1f84-d0de-4a4d-ac59-c29f17e886ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.257058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-859d1f84-d0de-4a4d-ac59-c29f17e886ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.301050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6b207d4e-d70e-4ac7-93a5-e7ad2e3f385a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.320629 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6b207d4e-d70e-4ac7-93a5-e7ad2e3f385a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1466 microversion: 2.1 time: 0.302308 May 19 04:38:47.325236 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 925/1811] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:47 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1466 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:47.328704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:47.329542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:47.341579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.343741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.344668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.345266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.440100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.452947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.455884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.459802 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b9c85762-ae3c-4633-b340-b052f8e55ff4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.133755 May 19 04:38:47.459802 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 926/1812] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:47 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:47.465479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2ec054a-c51c-494d-b806-1e65fc226ea3 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:47.466837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d2ec054a-c51c-494d-b806-1e65fc226ea3 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:47.475374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2ec054a-c51c-494d-b806-1e65fc226ea3 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.475893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2ec054a-c51c-494d-b806-1e65fc226ea3 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.476806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2ec054a-c51c-494d-b806-1e65fc226ea3 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.477392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2ec054a-c51c-494d-b806-1e65fc226ea3 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.480942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-859d1f84-d0de-4a4d-ac59-c29f17e886ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.489910 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-859d1f84-d0de-4a4d-ac59-c29f17e886ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1316 microversion: 2.1 time: 0.247320 May 19 04:38:47.490509 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 887/1813] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:47 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:47.503894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-194dca15-fdee-44f3-bff4-647dccab3e34 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:47.504813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-194dca15-fdee-44f3-bff4-647dccab3e34 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:47.512989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-194dca15-fdee-44f3-bff4-647dccab3e34 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.517405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-194dca15-fdee-44f3-bff4-647dccab3e34 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.518257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-194dca15-fdee-44f3-bff4-647dccab3e34 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.518823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-194dca15-fdee-44f3-bff4-647dccab3e34 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.672511 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2ec054a-c51c-494d-b806-1e65fc226ea3 tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1619 microversion: 2.1 time: 0.211499 May 19 04:38:47.673287 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 927/1814] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:47 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1619 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:47.678252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-11be0663-2ac0-4839-9855-dabae843fbae tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:47.678913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-11be0663-2ac0-4839-9855-dabae843fbae tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:47.686286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11be0663-2ac0-4839-9855-dabae843fbae tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.686286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11be0663-2ac0-4839-9855-dabae843fbae tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.686937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11be0663-2ac0-4839-9855-dabae843fbae tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:47.687372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11be0663-2ac0-4839-9855-dabae843fbae tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:47.714097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-194dca15-fdee-44f3-bff4-647dccab3e34 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.723653 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-194dca15-fdee-44f3-bff4-647dccab3e34 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.226732 May 19 04:38:47.724784 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 888/1815] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:47 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:47.747121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-733189418", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e626b1ac-a89d-4758-84dd-4367faa06cde"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:47.803955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:38:47.887857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-11be0663-2ac0-4839-9855-dabae843fbae tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:47.895491 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-11be0663-2ac0-4839-9855-dabae843fbae tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.221251 May 19 04:38:47.900784 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 928/1816] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:47 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:48.061592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:38:48.062236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:38:48.062772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:38:48.063380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:38:48.063992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:38:48.075282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.075845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.076754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.077289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.096702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:38:48.102148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Getting quotas for user d4796ef3b2154a949d6b966e99055595 and project 381315a73f7f4999bfcc59ebcb6c4771. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:38:48.116318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:38:48.119416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:38:48.167611 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1163aed-d214-4f91-8cab-3a9284f282c8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.425403 May 19 04:38:48.173376 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 889/1817] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:38:48.179677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5bd5a6e-276c-4c75-9624-df309e437a9b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:48.181687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5bd5a6e-276c-4c75-9624-df309e437a9b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:48.260877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:48.261551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:48.266162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5bd5a6e-276c-4c75-9624-df309e437a9b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:48.272410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.273144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.274112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.275213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.275493 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5bd5a6e-276c-4c75-9624-df309e437a9b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1216 microversion: 2.1 time: 0.099717 May 19 04:38:48.285674 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 929/1818] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:48 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1216 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:48.476135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:48.477019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:48.500593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.501046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.504013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.511326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.536945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:48.547585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:48.549203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:48.550739 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64cf3e10-8063-4652-a25b-f79649e08cca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.294992 May 19 04:38:48.551783 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 890/1819] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:48 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:48.557379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ad80ec72-4d06-46df-afd5-8a19a9fed0ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:48.558054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ad80ec72-4d06-46df-afd5-8a19a9fed0ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:48.564625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad80ec72-4d06-46df-afd5-8a19a9fed0ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.565093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad80ec72-4d06-46df-afd5-8a19a9fed0ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.566042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad80ec72-4d06-46df-afd5-8a19a9fed0ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.566490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad80ec72-4d06-46df-afd5-8a19a9fed0ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.622441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:48.637155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:48.640772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:48.644960 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8950c97d-f170-4831-8732-097f64cd1613 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.172585 May 19 04:38:48.646281 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 930/1820] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:48 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:48.742600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35bad62f-b7a3-4ecc-aa7a-181ca77b2c9a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:48.743583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-35bad62f-b7a3-4ecc-aa7a-181ca77b2c9a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:48.753814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35bad62f-b7a3-4ecc-aa7a-181ca77b2c9a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.755129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35bad62f-b7a3-4ecc-aa7a-181ca77b2c9a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.756611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35bad62f-b7a3-4ecc-aa7a-181ca77b2c9a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.757421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35bad62f-b7a3-4ecc-aa7a-181ca77b2c9a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.894923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ad80ec72-4d06-46df-afd5-8a19a9fed0ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:48.911432 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ad80ec72-4d06-46df-afd5-8a19a9fed0ba tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1316 microversion: 2.1 time: 0.358414 May 19 04:38:48.913523 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 891/1821] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:48 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:48.927231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7602906f-e845-4a58-8291-313f5c453e9e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:48.928180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7602906f-e845-4a58-8291-313f5c453e9e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:48.944245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7602906f-e845-4a58-8291-313f5c453e9e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.945283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7602906f-e845-4a58-8291-313f5c453e9e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.946121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7602906f-e845-4a58-8291-313f5c453e9e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:48.948746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7602906f-e845-4a58-8291-313f5c453e9e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:48.999427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-35bad62f-b7a3-4ecc-aa7a-181ca77b2c9a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:49.008866 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-35bad62f-b7a3-4ecc-aa7a-181ca77b2c9a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.270649 May 19 04:38:49.019031 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 931/1822] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:48 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:49.227555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7602906f-e845-4a58-8291-313f5c453e9e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:49.244213 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7602906f-e845-4a58-8291-313f5c453e9e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.321404 May 19 04:38:49.244213 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 892/1823] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:48 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:49.292795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b0243ef1-876d-4efc-86e6-620aaafbee16 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:49.293458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b0243ef1-876d-4efc-86e6-620aaafbee16 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:49.307515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0243ef1-876d-4efc-86e6-620aaafbee16 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:49.307985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0243ef1-876d-4efc-86e6-620aaafbee16 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:49.308866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0243ef1-876d-4efc-86e6-620aaafbee16 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:49.309352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0243ef1-876d-4efc-86e6-620aaafbee16 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:49.425971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b0243ef1-876d-4efc-86e6-620aaafbee16 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:49.435754 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b0243ef1-876d-4efc-86e6-620aaafbee16 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1268 microversion: 2.1 time: 0.147517 May 19 04:38:49.436411 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 932/1824] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:49 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:49.572775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:49.575348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:49.599449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:49.600808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:49.602088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:49.602679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:49.670325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:49.671884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:49.686114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:49.686903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:49.687935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:49.688602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:49.901725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:49.932839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:49.940461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:49.944687 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c3dfae4e-b605-4cdb-8f77-6ba8d57613c7 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.280718 May 19 04:38:49.956451 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 933/1825] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:49 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:49.959667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-659d4c00-4de5-4b79-beb7-c09fd36bc481 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:49.960350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-659d4c00-4de5-4b79-beb7-c09fd36bc481 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:49.975424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-659d4c00-4de5-4b79-beb7-c09fd36bc481 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:49.978155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-659d4c00-4de5-4b79-beb7-c09fd36bc481 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:49.978993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-659d4c00-4de5-4b79-beb7-c09fd36bc481 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:49.982607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-659d4c00-4de5-4b79-beb7-c09fd36bc481 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:50.000903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:50.014299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:50.016290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:50.018684 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-681e7767-53d5-4135-96ea-51779ebf349e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.450906 May 19 04:38:50.031647 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 893/1826] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:49 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:50.043540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee7a9d7a-4340-4698-8325-1981d8bf67a2 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:50.045734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee7a9d7a-4340-4698-8325-1981d8bf67a2 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:50.064487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee7a9d7a-4340-4698-8325-1981d8bf67a2 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:50.065396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee7a9d7a-4340-4698-8325-1981d8bf67a2 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:50.066511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee7a9d7a-4340-4698-8325-1981d8bf67a2 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:50.069648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee7a9d7a-4340-4698-8325-1981d8bf67a2 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:50.308288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ee7a9d7a-4340-4698-8325-1981d8bf67a2 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:50.319770 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee7a9d7a-4340-4698-8325-1981d8bf67a2 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.283912 May 19 04:38:50.320512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-659d4c00-4de5-4b79-beb7-c09fd36bc481 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:50.324416 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 894/1827] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:50 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:50.336855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cc2eb6f7-e255-4d36-a2cb-e65aeec12c76 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:50.338535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cc2eb6f7-e255-4d36-a2cb-e65aeec12c76 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:50.351014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:50.353948 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-659d4c00-4de5-4b79-beb7-c09fd36bc481 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1316 microversion: 2.1 time: 0.405272 May 19 04:38:50.354085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc2eb6f7-e255-4d36-a2cb-e65aeec12c76 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:50.354433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc2eb6f7-e255-4d36-a2cb-e65aeec12c76 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:50.355226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc2eb6f7-e255-4d36-a2cb-e65aeec12c76 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:50.355687 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 934/1828] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:49 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:50.359768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc2eb6f7-e255-4d36-a2cb-e65aeec12c76 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:50.455072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e5f14657-8097-4fd9-9831-e5cf3c15bd38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:50.456313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e5f14657-8097-4fd9-9831-e5cf3c15bd38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:50.469912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5f14657-8097-4fd9-9831-e5cf3c15bd38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:50.472671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5f14657-8097-4fd9-9831-e5cf3c15bd38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:50.473804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5f14657-8097-4fd9-9831-e5cf3c15bd38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:50.476495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5f14657-8097-4fd9-9831-e5cf3c15bd38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:50.596629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e5f14657-8097-4fd9-9831-e5cf3c15bd38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:50.610575 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e5f14657-8097-4fd9-9831-e5cf3c15bd38 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1274 microversion: 2.1 time: 0.160000 May 19 04:38:50.613501 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 935/1829] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:50 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:50.635377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cc2eb6f7-e255-4d36-a2cb-e65aeec12c76 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:50.643337 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cc2eb6f7-e255-4d36-a2cb-e65aeec12c76 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.317424 May 19 04:38:50.643926 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 895/1830] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:50 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:50.965088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:50.965717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:50.974851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:50.976212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:50.980300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:50.980811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.038886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:51.039662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:51.051714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.052167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.052960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.061943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.138429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:51.148508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:51.150254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:51.157614 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b49a7fe-5099-4eb7-a522-551244978b4c tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.191324 May 19 04:38:51.158756 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 936/1831] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:50 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:51.344521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f6a67ec4-e1d4-4876-8b90-5b62d6a86cbf tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:51.348905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f6a67ec4-e1d4-4876-8b90-5b62d6a86cbf tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:51.380509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6a67ec4-e1d4-4876-8b90-5b62d6a86cbf tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.383807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6a67ec4-e1d4-4876-8b90-5b62d6a86cbf tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.387559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6a67ec4-e1d4-4876-8b90-5b62d6a86cbf tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.388251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6a67ec4-e1d4-4876-8b90-5b62d6a86cbf tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.483878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:51.519542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:51.525839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:51.527793 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-93d6b3c7-fefc-448b-90f8-278083b0331f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.492970 May 19 04:38:51.545601 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 896/1832] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:51 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:51.560986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-346290ac-adef-4788-81d5-920e1372d026 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:51.566832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-346290ac-adef-4788-81d5-920e1372d026 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:51.578557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-346290ac-adef-4788-81d5-920e1372d026 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.579491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-346290ac-adef-4788-81d5-920e1372d026 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.580671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-346290ac-adef-4788-81d5-920e1372d026 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.581385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-346290ac-adef-4788-81d5-920e1372d026 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.790366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f6a67ec4-e1d4-4876-8b90-5b62d6a86cbf tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:51.802131 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f6a67ec4-e1d4-4876-8b90-5b62d6a86cbf tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.465369 May 19 04:38:51.803997 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 937/1833] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:51 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:51.815450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fcd098d6-248f-4861-9b56-94eb077b0a08 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:51.817216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fcd098d6-248f-4861-9b56-94eb077b0a08 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:51.829907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcd098d6-248f-4861-9b56-94eb077b0a08 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.830799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcd098d6-248f-4861-9b56-94eb077b0a08 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.831874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcd098d6-248f-4861-9b56-94eb077b0a08 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.832564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcd098d6-248f-4861-9b56-94eb077b0a08 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.893017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-346290ac-adef-4788-81d5-920e1372d026 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:51.907989 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-346290ac-adef-4788-81d5-920e1372d026 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1316 microversion: 2.1 time: 0.357947 May 19 04:38:51.911490 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 897/1834] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:51 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:51.926593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c13097e1-cb54-46e7-953f-a8f94bcdd6b1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:51.932790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c13097e1-cb54-46e7-953f-a8f94bcdd6b1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:51.951443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c13097e1-cb54-46e7-953f-a8f94bcdd6b1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.952489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c13097e1-cb54-46e7-953f-a8f94bcdd6b1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:51.955302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c13097e1-cb54-46e7-953f-a8f94bcdd6b1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:51.957649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c13097e1-cb54-46e7-953f-a8f94bcdd6b1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.206106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fcd098d6-248f-4861-9b56-94eb077b0a08 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:52.218252 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fcd098d6-248f-4861-9b56-94eb077b0a08 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1316 microversion: 2.1 time: 0.411152 May 19 04:38:52.219272 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 938/1835] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:51 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:52.230497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8863e521-6195-45bc-9bb1-1b2efdc5e794 req-9d0b5eb2-caed-47e0-88e1-b2adedb15c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604b274a-2199-4a0b-a8fb-bb606625a781", "name": "network-vif-plugged", "status": "completed", "tag": "4e249990-c90b-46d6-9678-f92a6e092cc1"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:52.258840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c13097e1-cb54-46e7-953f-a8f94bcdd6b1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:52.263034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:52.269638 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c13097e1-cb54-46e7-953f-a8f94bcdd6b1 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.353345 May 19 04:38:52.272276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8863e521-6195-45bc-9bb1-1b2efdc5e794 req-9d0b5eb2-caed-47e0-88e1-b2adedb15c91 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.272716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8863e521-6195-45bc-9bb1-1b2efdc5e794 req-9d0b5eb2-caed-47e0-88e1-b2adedb15c91 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.277672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 898/1836] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:51 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:52.282491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:52.283105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:52.295607 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8863e521-6195-45bc-9bb1-1b2efdc5e794 req-9d0b5eb2-caed-47e0-88e1-b2adedb15c91 service nova] Creating event network-vif-plugged:4e249990-c90b-46d6-9678-f92a6e092cc1 for instance 604b274a-2199-4a0b-a8fb-bb606625a781 on n-h2-766726-30 May 19 04:38:52.300971 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8863e521-6195-45bc-9bb1-1b2efdc5e794 req-9d0b5eb2-caed-47e0-88e1-b2adedb15c91 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080248 May 19 04:38:52.301952 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 939/1837] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:52.311063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.311514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.312296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.312731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.421585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:52.434054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:52.435589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:52.437130 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bfc138ed-7c43-4105-8f2f-d08c266ed995 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.158302 May 19 04:38:52.439807 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 899/1838] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:52 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:52.553402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:52.554111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:52.565591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.566049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.566838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.567282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.817493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-dea86aff-68c9-417c-b617-f647eca92c3b req-d160805d-74ce-4dc7-832f-84440d4a0c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04caa3a3-67cf-40dc-b42a-ac4543914180", "tag": "aa86ac9d-46ba-47f0-8ce4-f9dc8032c39e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:52.853439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:52.861707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dea86aff-68c9-417c-b617-f647eca92c3b req-d160805d-74ce-4dc7-832f-84440d4a0c57 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.862312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dea86aff-68c9-417c-b617-f647eca92c3b req-d160805d-74ce-4dc7-832f-84440d4a0c57 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.864274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:52.866228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:52.867743 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c781932c-0877-47e0-be84-01b764f2f64e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.319055 May 19 04:38:52.881389 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 940/1839] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:52 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:52.887489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-70dab54e-b34d-45f4-9797-04d5c948f89e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:52.887957 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-dea86aff-68c9-417c-b617-f647eca92c3b req-d160805d-74ce-4dc7-832f-84440d4a0c57 service nova] Creating event network-changed:aa86ac9d-46ba-47f0-8ce4-f9dc8032c39e for instance 04caa3a3-67cf-40dc-b42a-ac4543914180 on n-h1-766726-30 May 19 04:38:52.888594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-70dab54e-b34d-45f4-9797-04d5c948f89e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:52.898762 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-dea86aff-68c9-417c-b617-f647eca92c3b req-d160805d-74ce-4dc7-832f-84440d4a0c57 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086543 May 19 04:38:52.899560 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 900/1840] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:52.903011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70dab54e-b34d-45f4-9797-04d5c948f89e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.903698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70dab54e-b34d-45f4-9797-04d5c948f89e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.905645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70dab54e-b34d-45f4-9797-04d5c948f89e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.906329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70dab54e-b34d-45f4-9797-04d5c948f89e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.927162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c8c337f6-19ca-4631-b93a-6c834b6c82d0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:52.928033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c8c337f6-19ca-4631-b93a-6c834b6c82d0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:52.940750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8c337f6-19ca-4631-b93a-6c834b6c82d0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.941299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8c337f6-19ca-4631-b93a-6c834b6c82d0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:52.942124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8c337f6-19ca-4631-b93a-6c834b6c82d0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:52.946234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8c337f6-19ca-4631-b93a-6c834b6c82d0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:53.125668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-70dab54e-b34d-45f4-9797-04d5c948f89e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:53.135616 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-70dab54e-b34d-45f4-9797-04d5c948f89e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.252700 May 19 04:38:53.145402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 941/1841] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:52 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:53.154196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c8c337f6-19ca-4631-b93a-6c834b6c82d0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:53.162272 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c8c337f6-19ca-4631-b93a-6c834b6c82d0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1316 microversion: 2.1 time: 0.239220 May 19 04:38:53.163189 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 901/1842] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:52 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:53.235364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c1ff241c-b913-4d77-b37a-b7fa02305430 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:53.236142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c1ff241c-b913-4d77-b37a-b7fa02305430 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:53.242265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1ff241c-b913-4d77-b37a-b7fa02305430 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:53.243001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1ff241c-b913-4d77-b37a-b7fa02305430 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:53.244441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1ff241c-b913-4d77-b37a-b7fa02305430 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:53.244989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1ff241c-b913-4d77-b37a-b7fa02305430 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:53.294539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-60d34c28-4aec-4f8d-96db-b7e70d62fdd0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:53.295461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60d34c28-4aec-4f8d-96db-b7e70d62fdd0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:53.301958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60d34c28-4aec-4f8d-96db-b7e70d62fdd0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:53.302615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60d34c28-4aec-4f8d-96db-b7e70d62fdd0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:53.303566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60d34c28-4aec-4f8d-96db-b7e70d62fdd0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:53.304166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60d34c28-4aec-4f8d-96db-b7e70d62fdd0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:53.454220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c1ff241c-b913-4d77-b37a-b7fa02305430 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:53.463784 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c1ff241c-b913-4d77-b37a-b7fa02305430 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1316 microversion: 2.1 time: 0.232247 May 19 04:38:53.464502 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 942/1843] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:53 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:53.469375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:53.470100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:53.476075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:53.476739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:53.478402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:53.478926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:53.483700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60d34c28-4aec-4f8d-96db-b7e70d62fdd0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:53.491728 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-60d34c28-4aec-4f8d-96db-b7e70d62fdd0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.201669 May 19 04:38:53.492450 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 902/1844] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:53 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:53.543471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:53.545814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:53.553113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:53.554665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:53.555901 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-75b3bc4b-f108-4b32-b922-3b20f11604cb tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.090064 May 19 04:38:53.556464 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 943/1845] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:53 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:53.888688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:53.889324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:53.895609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:53.896053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:53.896829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:53.897298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.083803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:54.094283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:54.095768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:54.096915 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c5e92399-2881-4e50-8572-2ff4fe41cb59 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.212766 May 19 04:38:54.097512 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 903/1846] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:53 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:54.153144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f6552c63-45ae-4239-a616-1e7c3f99fe2d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:54.153850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f6552c63-45ae-4239-a616-1e7c3f99fe2d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:54.161142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6552c63-45ae-4239-a616-1e7c3f99fe2d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.161839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6552c63-45ae-4239-a616-1e7c3f99fe2d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.162623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6552c63-45ae-4239-a616-1e7c3f99fe2d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.163060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6552c63-45ae-4239-a616-1e7c3f99fe2d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.180709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e0d7d4b9-69d0-4275-ad16-d55f0cc343fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:54.182035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e0d7d4b9-69d0-4275-ad16-d55f0cc343fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:54.189554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4b9-69d0-4275-ad16-d55f0cc343fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.190004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4b9-69d0-4275-ad16-d55f0cc343fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.190767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4b9-69d0-4275-ad16-d55f0cc343fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.191377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0d7d4b9-69d0-4275-ad16-d55f0cc343fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.376237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f6552c63-45ae-4239-a616-1e7c3f99fe2d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:54.379034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e0d7d4b9-69d0-4275-ad16-d55f0cc343fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:54.384822 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f6552c63-45ae-4239-a616-1e7c3f99fe2d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.235155 May 19 04:38:54.385507 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 944/1847] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:54 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:54.394170 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e0d7d4b9-69d0-4275-ad16-d55f0cc343fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1504 microversion: 2.1 time: 0.212000 May 19 04:38:54.394170 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 904/1848] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:54 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:54.404408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c3cf611-d301-4e48-9017-70af553f7efc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-743621687"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:54.404940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c3cf611-d301-4e48-9017-70af553f7efc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:54.410937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c3cf611-d301-4e48-9017-70af553f7efc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.411380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c3cf611-d301-4e48-9017-70af553f7efc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.412136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c3cf611-d301-4e48-9017-70af553f7efc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.412565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c3cf611-d301-4e48-9017-70af553f7efc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.480924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8527347f-a2cd-4811-9443-c9ed3e44e687 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:54.481686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8527347f-a2cd-4811-9443-c9ed3e44e687 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:54.487764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8527347f-a2cd-4811-9443-c9ed3e44e687 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.488214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8527347f-a2cd-4811-9443-c9ed3e44e687 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.488983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8527347f-a2cd-4811-9443-c9ed3e44e687 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.489441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8527347f-a2cd-4811-9443-c9ed3e44e687 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.590466 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.network.security_group_api [None req-0c3cf611-d301-4e48-9017-70af553f7efc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Adding security group 5db76d90-11a0-4771-bf65-84bc0d500faa to port 4e249990-c90b-46d6-9678-f92a6e092cc1 May 19 04:38:54.723780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8527347f-a2cd-4811-9443-c9ed3e44e687 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:54.734087 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8527347f-a2cd-4811-9443-c9ed3e44e687 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1316 microversion: 2.1 time: 0.257816 May 19 04:38:54.735056 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 945/1849] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:54 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:54.741125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fa3eab9a-d23c-467a-817f-baa176d332a0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:54.742148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fa3eab9a-d23c-467a-817f-baa176d332a0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:54.750277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3eab9a-d23c-467a-817f-baa176d332a0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.751184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3eab9a-d23c-467a-817f-baa176d332a0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.752217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3eab9a-d23c-467a-817f-baa176d332a0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:54.752890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3eab9a-d23c-467a-817f-baa176d332a0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:54.989866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fa3eab9a-d23c-467a-817f-baa176d332a0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:55.000904 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fa3eab9a-d23c-467a-817f-baa176d332a0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.264341 May 19 04:38:55.001817 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 946/1850] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:54 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:55.006651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:55.007615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:55.014574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.015103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.015966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.016483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.086580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:55.095592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:55.097342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:55.098712 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1399b1ec-7e8e-40ef-b6a2-8b2482cb0dde tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.095567 May 19 04:38:55.099504 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 947/1851] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:55 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:55.115742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:55.116367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:55.123401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.124119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.124900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.125375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.152841 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c3cf611-d301-4e48-9017-70af553f7efc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781/action" status: 202 len: 0 microversion: 2.1 time: 0.752704 May 19 04:38:55.156639 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 905/1852] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:38:54 2022] POST /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:55.162712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5cbad701-a11a-4c0a-946f-82d39faf3765 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd3161fa310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:55.425573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-5cbad701-a11a-4c0a-946f-82d39faf3765 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5db76d90-11a0-4771-bf65-84bc0d500faa in use.", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:38:55.426714 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5cbad701-a11a-4c0a-946f-82d39faf3765 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security Group 5db76d90-11a0-4771-bf65-84bc0d500faa in use. May 19 04:38:55.426714 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-b78f3130-c836-444b-a6d7-dd68a5424e7b'] May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5cbad701-a11a-4c0a-946f-82d39faf3765 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-security-groups/5db76d90-11a0-4771-bf65-84bc0d500faa HTTP/1.1 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: exception: Security Group 5db76d90-11a0-4771-bf65-84bc0d500faa in use. May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-b78f3130-c836-444b-a6d7-dd68a5424e7b'] May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '5db76d90-11a0-4771-bf65-84bc0d500faa'} May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:38:55.429549 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5db76d90-11a0-4771-bf65-84bc0d500faa in use. May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b78f3130-c836-444b-a6d7-dd68a5424e7b'] May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5db76d90-11a0-4771-bf65-84bc0d500faa in use. May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b78f3130-c836-444b-a6d7-dd68a5424e7b'] May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5db76d90-11a0-4771-bf65-84bc0d500faa in use. May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b78f3130-c836-444b-a6d7-dd68a5424e7b'] May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5db76d90-11a0-4771-bf65-84bc0d500faa in use. May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b78f3130-c836-444b-a6d7-dd68a5424e7b'] May 19 04:38:55.435483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:55.441272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:55.441627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5cbad701-a11a-4c0a-946f-82d39faf3765 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 400 to user: Security Group 5db76d90-11a0-4771-bf65-84bc0d500faa in use. May 19 04:38:55.441627 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-b78f3130-c836-444b-a6d7-dd68a5424e7b'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:38:55.442090 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5cbad701-a11a-4c0a-946f-82d39faf3765 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5db76d90-11a0-4771-bf65-84bc0d500faa" status: 400 len: 185 microversion: 2.1 time: 0.281992 May 19 04:38:55.442829 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 906/1853] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:38:55 2022] DELETE /compute/v2.1/os-security-groups/5db76d90-11a0-4771-bf65-84bc0d500faa => generated 185 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:38:55.445606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:55.449606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-32904ccb-621b-45b7-b041-e9ff234a7c9c req-d5f0b51c-e480-4d51-9e00-6105dddacac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604b274a-2199-4a0b-a8fb-bb606625a781", "tag": "4e249990-c90b-46d6-9678-f92a6e092cc1"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:55.451122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:55.452352 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d523b41c-143c-4705-98e3-2e448361a38a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.340560 May 19 04:38:55.453266 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 948/1854] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:55 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:55.460534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-92d26930-4db4-4323-aa58-6de5a7fd3547 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:55.461192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-92d26930-4db4-4323-aa58-6de5a7fd3547 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:55.462076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-32904ccb-621b-45b7-b041-e9ff234a7c9c req-d5f0b51c-e480-4d51-9e00-6105dddacac2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.462707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-32904ccb-621b-45b7-b041-e9ff234a7c9c req-d5f0b51c-e480-4d51-9e00-6105dddacac2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.468191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92d26930-4db4-4323-aa58-6de5a7fd3547 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.469120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92d26930-4db4-4323-aa58-6de5a7fd3547 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.470783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92d26930-4db4-4323-aa58-6de5a7fd3547 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.471291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92d26930-4db4-4323-aa58-6de5a7fd3547 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.475755 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-32904ccb-621b-45b7-b041-e9ff234a7c9c req-d5f0b51c-e480-4d51-9e00-6105dddacac2 service nova] Creating event network-changed:4e249990-c90b-46d6-9678-f92a6e092cc1 for instance 604b274a-2199-4a0b-a8fb-bb606625a781 on n-h2-766726-30 May 19 04:38:55.482637 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-32904ccb-621b-45b7-b041-e9ff234a7c9c req-d5f0b51c-e480-4d51-9e00-6105dddacac2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037755 May 19 04:38:55.483804 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 907/1855] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:55.491019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7dd0666d-7f64-4032-ba7b-1e56ed35ef45 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:55.493906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7dd0666d-7f64-4032-ba7b-1e56ed35ef45 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:55.503629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dd0666d-7f64-4032-ba7b-1e56ed35ef45 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.504952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dd0666d-7f64-4032-ba7b-1e56ed35ef45 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.506063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dd0666d-7f64-4032-ba7b-1e56ed35ef45 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.506981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dd0666d-7f64-4032-ba7b-1e56ed35ef45 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.635153 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7dd0666d-7f64-4032-ba7b-1e56ed35ef45 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781/action" status: 202 len: 0 microversion: 2.1 time: 0.149620 May 19 04:38:55.635893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-92d26930-4db4-4323-aa58-6de5a7fd3547 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:55.640281 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 908/1856] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:38:55 2022] POST /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:55.647343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ebac55e2-5757-4ca2-9b7e-fcc3f251d4bb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:55.648365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ebac55e2-5757-4ca2-9b7e-fcc3f251d4bb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:55.658565 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-92d26930-4db4-4323-aa58-6de5a7fd3547 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.204065 May 19 04:38:55.660213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebac55e2-5757-4ca2-9b7e-fcc3f251d4bb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.660903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebac55e2-5757-4ca2-9b7e-fcc3f251d4bb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.662674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebac55e2-5757-4ca2-9b7e-fcc3f251d4bb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.664512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebac55e2-5757-4ca2-9b7e-fcc3f251d4bb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.668792 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 949/1857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:55 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:55.751382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1d4f0015-4d25-4c74-a046-ff4a0df20a1a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:55.752805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1d4f0015-4d25-4c74-a046-ff4a0df20a1a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:55.764103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d4f0015-4d25-4c74-a046-ff4a0df20a1a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.767926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d4f0015-4d25-4c74-a046-ff4a0df20a1a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.768884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d4f0015-4d25-4c74-a046-ff4a0df20a1a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:55.770051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d4f0015-4d25-4c74-a046-ff4a0df20a1a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:55.871546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ebac55e2-5757-4ca2-9b7e-fcc3f251d4bb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:55.880080 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ebac55e2-5757-4ca2-9b7e-fcc3f251d4bb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1574 microversion: 2.1 time: 0.237821 May 19 04:38:55.880664 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 909/1858] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:55 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:56.019028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ba526587-a9be-4e89-8bc7-63d1ea3f9288 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:56.020077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba526587-a9be-4e89-8bc7-63d1ea3f9288 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:56.028776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1d4f0015-4d25-4c74-a046-ff4a0df20a1a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:56.031110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba526587-a9be-4e89-8bc7-63d1ea3f9288 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:56.031990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba526587-a9be-4e89-8bc7-63d1ea3f9288 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:56.036675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba526587-a9be-4e89-8bc7-63d1ea3f9288 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:56.038766 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1d4f0015-4d25-4c74-a046-ff4a0df20a1a tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1316 microversion: 2.1 time: 0.291373 May 19 04:38:56.039674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba526587-a9be-4e89-8bc7-63d1ea3f9288 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:56.044188 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 950/1859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:55 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:56.117822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:56.119404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:56.135044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:56.135780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:56.137019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:56.137428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:56.490759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:56.504273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:56.508610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:56.512402 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-742ac660-5221-4a29-9f24-f236a480add3 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.398506 May 19 04:38:56.513323 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 951/1860] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:56 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:56.527879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:56.529419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:56.544076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:56.544907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:56.545985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:56.548657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:56.563620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:56.737819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ba526587-a9be-4e89-8bc7-63d1ea3f9288 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:56.747176 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ba526587-a9be-4e89-8bc7-63d1ea3f9288 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.732292 May 19 04:38:56.757645 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 910/1861] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:56 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:56.763847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-73355cd3-acb3-4536-ab61-2f2c3b869f99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:56.764678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-73355cd3-acb3-4536-ab61-2f2c3b869f99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:56.772138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73355cd3-acb3-4536-ab61-2f2c3b869f99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:56.772857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73355cd3-acb3-4536-ab61-2f2c3b869f99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:56.773916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73355cd3-acb3-4536-ab61-2f2c3b869f99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:56.775075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73355cd3-acb3-4536-ab61-2f2c3b869f99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:56.978608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:56.989055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:56.991018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:56.993853 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d333cd4a-68b8-4348-a95d-aae9c5184f2a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.478049 May 19 04:38:56.995039 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 952/1862] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:56 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:57.000115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fdb834f7-2d6d-4e68-9d88-bd825a7a0582 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:57.000975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fdb834f7-2d6d-4e68-9d88-bd825a7a0582 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:57.008418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdb834f7-2d6d-4e68-9d88-bd825a7a0582 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:57.009926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdb834f7-2d6d-4e68-9d88-bd825a7a0582 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:57.011167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdb834f7-2d6d-4e68-9d88-bd825a7a0582 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:57.011894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdb834f7-2d6d-4e68-9d88-bd825a7a0582 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:57.065303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-73355cd3-acb3-4536-ab61-2f2c3b869f99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:57.078380 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-73355cd3-acb3-4536-ab61-2f2c3b869f99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.319103 May 19 04:38:57.087692 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 911/1863] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:56 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:57.087692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3b50548-1369-464b-ba1f-388af6d28b7e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:57.087692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3b50548-1369-464b-ba1f-388af6d28b7e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:57.095624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3b50548-1369-464b-ba1f-388af6d28b7e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:57.107452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3b50548-1369-464b-ba1f-388af6d28b7e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:57.108782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3b50548-1369-464b-ba1f-388af6d28b7e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:57.109467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3b50548-1369-464b-ba1f-388af6d28b7e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:57.403676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fdb834f7-2d6d-4e68-9d88-bd825a7a0582 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:57.412068 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fdb834f7-2d6d-4e68-9d88-bd825a7a0582 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1574 microversion: 2.1 time: 0.415748 May 19 04:38:57.412805 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 953/1864] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:56 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1574 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:57.433070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3b50548-1369-464b-ba1f-388af6d28b7e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:57.441619 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3b50548-1369-464b-ba1f-388af6d28b7e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1316 microversion: 2.1 time: 0.361016 May 19 04:38:57.442345 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 912/1865] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:57 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:57.502342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b6fd6bc0-a3e3-4468-87ba-1a444e4f423d req-a28e01d9-70b0-443e-b85f-838a963313e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3", "name": "network-vif-unplugged", "status": "completed", "tag": "a9e4213a-1542-42bf-9830-906fd7d9a1a7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:57.513161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b6fd6bc0-a3e3-4468-87ba-1a444e4f423d req-a28e01d9-70b0-443e-b85f-838a963313e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:57.513640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b6fd6bc0-a3e3-4468-87ba-1a444e4f423d req-a28e01d9-70b0-443e-b85f-838a963313e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:57.530512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:57.531134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:57.537643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:57.538100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:57.541046 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b6fd6bc0-a3e3-4468-87ba-1a444e4f423d req-a28e01d9-70b0-443e-b85f-838a963313e1 service nova] Creating event network-vif-unplugged:a9e4213a-1542-42bf-9830-906fd7d9a1a7 for instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 on n-h2-766726-30 May 19 04:38:57.543210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:57.543553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:57.549803 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b6fd6bc0-a3e3-4468-87ba-1a444e4f423d req-a28e01d9-70b0-443e-b85f-838a963313e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051718 May 19 04:38:57.555315 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 954/1866] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:38:57.653055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:57.662608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:57.664882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:57.666816 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49bd5950-079c-4c3a-910f-4ffeec78f8e9 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.140349 May 19 04:38:57.668096 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 913/1867] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:57 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:57.764305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c0ced3d-68f9-4ada-93f3-a56c95439f7c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:57.765348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c0ced3d-68f9-4ada-93f3-a56c95439f7c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:57.772085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c0ced3d-68f9-4ada-93f3-a56c95439f7c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:57.772828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c0ced3d-68f9-4ada-93f3-a56c95439f7c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:57.773824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c0ced3d-68f9-4ada-93f3-a56c95439f7c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:57.774425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c0ced3d-68f9-4ada-93f3-a56c95439f7c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:57.935107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5c0ced3d-68f9-4ada-93f3-a56c95439f7c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:57.944490 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c0ced3d-68f9-4ada-93f3-a56c95439f7c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.184214 May 19 04:38:57.945524 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 955/1868] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:57 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:58.018345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:58.019340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:58.022461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:58.027389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.028075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.029299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.029956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.062485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ac26b369-de33-4ec6-aab5-91574cbc02e3 req-b6d5ab70-aed3-429b-8984-b3dbd8022f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04caa3a3-67cf-40dc-b42a-ac4543914180", "name": "network-vif-plugged", "status": "completed", "tag": "aa86ac9d-46ba-47f0-8ce4-f9dc8032c39e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:58.074121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ac26b369-de33-4ec6-aab5-91574cbc02e3 req-b6d5ab70-aed3-429b-8984-b3dbd8022f95 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.075526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ac26b369-de33-4ec6-aab5-91574cbc02e3 req-b6d5ab70-aed3-429b-8984-b3dbd8022f95 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.086152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:58.090472 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ac26b369-de33-4ec6-aab5-91574cbc02e3 req-b6d5ab70-aed3-429b-8984-b3dbd8022f95 service nova] Creating event network-vif-plugged:aa86ac9d-46ba-47f0-8ce4-f9dc8032c39e for instance 04caa3a3-67cf-40dc-b42a-ac4543914180 on n-h1-766726-30 May 19 04:38:58.096462 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ac26b369-de33-4ec6-aab5-91574cbc02e3 req-b6d5ab70-aed3-429b-8984-b3dbd8022f95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040769 May 19 04:38:58.097545 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 956/1869] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:38:58.103995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b0872b0b-0e15-44c9-a7e1-5d72be38218c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:58.104694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b0872b0b-0e15-44c9-a7e1-5d72be38218c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:58.110264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:58.121682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0872b0b-0e15-44c9-a7e1-5d72be38218c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.122144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0872b0b-0e15-44c9-a7e1-5d72be38218c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.122938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0872b0b-0e15-44c9-a7e1-5d72be38218c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.127630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0872b0b-0e15-44c9-a7e1-5d72be38218c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.274889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=10 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:58.381541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:58.392555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:58.393781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:58.395550 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c07dc44-b769-4ef0-9593-4d330c46638b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.381410 May 19 04:38:58.396995 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 914/1870] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:58 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:58.427419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b0872b0b-0e15-44c9-a7e1-5d72be38218c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:58.436337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3d5347d5-57ba-4b44-9ee8-012adb796f35 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:58.436946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3d5347d5-57ba-4b44-9ee8-012adb796f35 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:58.443230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d5347d5-57ba-4b44-9ee8-012adb796f35 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.443760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d5347d5-57ba-4b44-9ee8-012adb796f35 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.443881 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b0872b0b-0e15-44c9-a7e1-5d72be38218c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.344985 May 19 04:38:58.444617 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 957/1871] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:58 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:58.444740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d5347d5-57ba-4b44-9ee8-012adb796f35 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.445192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d5347d5-57ba-4b44-9ee8-012adb796f35 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.459693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a608cc0b-4589-467e-ba0a-5aa6924d188f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:58.460824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a608cc0b-4589-467e-ba0a-5aa6924d188f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:58.468227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a608cc0b-4589-467e-ba0a-5aa6924d188f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.468679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a608cc0b-4589-467e-ba0a-5aa6924d188f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.469586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a608cc0b-4589-467e-ba0a-5aa6924d188f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.469925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a608cc0b-4589-467e-ba0a-5aa6924d188f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.661446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3d5347d5-57ba-4b44-9ee8-012adb796f35 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:58.664792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a608cc0b-4589-467e-ba0a-5aa6924d188f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:58.670663 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3d5347d5-57ba-4b44-9ee8-012adb796f35 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1572 microversion: 2.1 time: 0.238046 May 19 04:38:58.671659 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 915/1872] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:58 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1572 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:58.673342 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a608cc0b-4589-467e-ba0a-5aa6924d188f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1316 microversion: 2.1 time: 0.217456 May 19 04:38:58.679021 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 958/1873] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:58 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:58.690479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-358f42f2-fe1a-450d-b7f8-7ae04008a484 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-90667158"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:58.691098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-358f42f2-fe1a-450d-b7f8-7ae04008a484 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:58.692419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:58.693392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:58.697678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-358f42f2-fe1a-450d-b7f8-7ae04008a484 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.698332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-358f42f2-fe1a-450d-b7f8-7ae04008a484 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.699120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-358f42f2-fe1a-450d-b7f8-7ae04008a484 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.699657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-358f42f2-fe1a-450d-b7f8-7ae04008a484 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.700143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.700593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.701608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.702062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.792646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:58.800969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:58.802484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:58.803627 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af11d434-fb15-4c76-b2b8-2f06c63be4ff tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.119611 May 19 04:38:58.804396 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 916/1874] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:58 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:38:58.859751 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.network.security_group_api [None req-358f42f2-fe1a-450d-b7f8-7ae04008a484 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Adding security group d7273bec-8355-4994-9f04-b93929912314 to port 4e249990-c90b-46d6-9678-f92a6e092cc1 May 19 04:38:58.962694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ec0fd3e-2def-45cd-88ba-ad59f1987650 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:58.963474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4ec0fd3e-2def-45cd-88ba-ad59f1987650 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:58.972416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ec0fd3e-2def-45cd-88ba-ad59f1987650 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.973032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ec0fd3e-2def-45cd-88ba-ad59f1987650 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.973948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ec0fd3e-2def-45cd-88ba-ad59f1987650 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:58.974497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ec0fd3e-2def-45cd-88ba-ad59f1987650 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:58.980823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:38:59.190493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4ec0fd3e-2def-45cd-88ba-ad59f1987650 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:59.203287 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4ec0fd3e-2def-45cd-88ba-ad59f1987650 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.245053 May 19 04:38:59.204362 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 917/1875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:58 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:38:59.365622 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-358f42f2-fe1a-450d-b7f8-7ae04008a484 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781/action" status: 202 len: 0 microversion: 2.1 time: 0.678746 May 19 04:38:59.366840 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 959/1876] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:38:58 2022] POST /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:38:59.377104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6b3e9f02-9124-43c2-b5a3-aa820f06cee0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315b4eb80>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:59.414423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:59.415600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:59.423112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:59.424946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:59.426014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:59.426675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:59.597388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-6b3e9f02-9124-43c2-b5a3-aa820f06cee0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d7273bec-8355-4994-9f04-b93929912314 in use.", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:38:59.598089 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-6b3e9f02-9124-43c2-b5a3-aa820f06cee0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security Group d7273bec-8355-4994-9f04-b93929912314 in use. May 19 04:38:59.598089 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-6d39782a-066f-4b79-a75b-d8583a7c7d4f'] May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6b3e9f02-9124-43c2-b5a3-aa820f06cee0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-security-groups/d7273bec-8355-4994-9f04-b93929912314 HTTP/1.1 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: exception: Security Group d7273bec-8355-4994-9f04-b93929912314 in use. May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-6d39782a-066f-4b79-a75b-d8583a7c7d4f'] May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'd7273bec-8355-4994-9f04-b93929912314'} May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:38:59.600326 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d7273bec-8355-4994-9f04-b93929912314 in use. May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d39782a-066f-4b79-a75b-d8583a7c7d4f'] May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d7273bec-8355-4994-9f04-b93929912314 in use. May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d39782a-066f-4b79-a75b-d8583a7c7d4f'] May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d7273bec-8355-4994-9f04-b93929912314 in use. May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d39782a-066f-4b79-a75b-d8583a7c7d4f'] May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d7273bec-8355-4994-9f04-b93929912314 in use. May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d39782a-066f-4b79-a75b-d8583a7c7d4f'] May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6b3e9f02-9124-43c2-b5a3-aa820f06cee0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 400 to user: Security Group d7273bec-8355-4994-9f04-b93929912314 in use. May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-6d39782a-066f-4b79-a75b-d8583a7c7d4f'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6b3e9f02-9124-43c2-b5a3-aa820f06cee0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d7273bec-8355-4994-9f04-b93929912314" status: 400 len: 185 microversion: 2.1 time: 0.230435 May 19 04:38:59.607732 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 918/1877] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:38:59 2022] DELETE /compute/v2.1/os-security-groups/d7273bec-8355-4994-9f04-b93929912314 => generated 185 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:38:59.617885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30f783e5-f648-49b3-958a-e7e2ea410148 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:59.617885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-30f783e5-f648-49b3-958a-e7e2ea410148 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:59.632942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30f783e5-f648-49b3-958a-e7e2ea410148 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:59.633595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30f783e5-f648-49b3-958a-e7e2ea410148 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:59.634832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30f783e5-f648-49b3-958a-e7e2ea410148 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:59.635271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30f783e5-f648-49b3-958a-e7e2ea410148 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:59.713519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:59.727204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:59.730625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:59.742387 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bcee5188-9958-4e1b-89f4-1bb90adcd536 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.331784 May 19 04:38:59.753210 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 960/1878] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:38:59 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:38:59.753210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b9fb0a44-6134-47b5-8a34-5b35bd4bb319 req-ca5b7040-4353-426b-8a6f-37390c0fd188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3", "tag": "a9e4213a-1542-42bf-9830-906fd7d9a1a7"}, {"name": "network-changed", "server_uuid": "604b274a-2199-4a0b-a8fb-bb606625a781", "tag": "4e249990-c90b-46d6-9678-f92a6e092cc1"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:38:59.764373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b9fb0a44-6134-47b5-8a34-5b35bd4bb319 req-ca5b7040-4353-426b-8a6f-37390c0fd188 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:59.765030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b9fb0a44-6134-47b5-8a34-5b35bd4bb319 req-ca5b7040-4353-426b-8a6f-37390c0fd188 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:59.788245 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b9fb0a44-6134-47b5-8a34-5b35bd4bb319 req-ca5b7040-4353-426b-8a6f-37390c0fd188 service nova] Creating event network-changed:a9e4213a-1542-42bf-9830-906fd7d9a1a7 for instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 on n-h2-766726-30 May 19 04:38:59.789583 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b9fb0a44-6134-47b5-8a34-5b35bd4bb319 req-ca5b7040-4353-426b-8a6f-37390c0fd188 service nova] Creating event network-changed:4e249990-c90b-46d6-9678-f92a6e092cc1 for instance 604b274a-2199-4a0b-a8fb-bb606625a781 on n-h2-766726-30 May 19 04:38:59.814886 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b9fb0a44-6134-47b5-8a34-5b35bd4bb319 req-ca5b7040-4353-426b-8a6f-37390c0fd188 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.067119 May 19 04:38:59.818624 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 961/1879] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:38:59.831762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c1147778-d8d5-4e10-9956-ab77734a1d1f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:59.832567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c1147778-d8d5-4e10-9956-ab77734a1d1f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:59.854862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1147778-d8d5-4e10-9956-ab77734a1d1f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:59.855357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1147778-d8d5-4e10-9956-ab77734a1d1f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:59.856186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1147778-d8d5-4e10-9956-ab77734a1d1f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:59.856631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1147778-d8d5-4e10-9956-ab77734a1d1f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:59.882972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-30f783e5-f648-49b3-958a-e7e2ea410148 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:38:59.892933 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-30f783e5-f648-49b3-958a-e7e2ea410148 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.286400 May 19 04:38:59.894159 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 919/1880] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:59 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:38:59.900552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be2624fa-7fb7-409c-ada8-4d182ad204b1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:38:59.901430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be2624fa-7fb7-409c-ada8-4d182ad204b1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:38:59.908467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be2624fa-7fb7-409c-ada8-4d182ad204b1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:59.909242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be2624fa-7fb7-409c-ada8-4d182ad204b1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:59.910201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be2624fa-7fb7-409c-ada8-4d182ad204b1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:38:59.910835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be2624fa-7fb7-409c-ada8-4d182ad204b1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:38:59.944772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c1147778-d8d5-4e10-9956-ab77734a1d1f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:00.119052 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c1147778-d8d5-4e10-9956-ab77734a1d1f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 204 len: 0 microversion: 2.1 time: 0.297582 May 19 04:39:00.122544 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 962/1881] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:38:59 2022] DELETE /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:00.135323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:00.136428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:00.152095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:00.158278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.158947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.160918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.163126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.228537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-be2624fa-7fb7-409c-ada8-4d182ad204b1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:00.241879 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be2624fa-7fb7-409c-ada8-4d182ad204b1 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1466 microversion: 2.1 time: 0.345142 May 19 04:39:00.251172 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 920/1882] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:38:59 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1466 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:00.251172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69ec412f-4954-4350-b41c-485cf132c617 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:00.251172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-69ec412f-4954-4350-b41c-485cf132c617 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:00.257048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69ec412f-4954-4350-b41c-485cf132c617 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.257802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69ec412f-4954-4350-b41c-485cf132c617 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.258737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69ec412f-4954-4350-b41c-485cf132c617 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.259675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69ec412f-4954-4350-b41c-485cf132c617 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.296080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:00.305191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:00.307368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:00.308835 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c833530c-7d9b-47c6-88da-637920e1ec06 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.184913 May 19 04:39:00.309911 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 963/1883] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:00 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:00.314522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-08e8a92d-d000-4c38-a1c8-1976fe67172c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:00.315254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-08e8a92d-d000-4c38-a1c8-1976fe67172c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:00.322399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08e8a92d-d000-4c38-a1c8-1976fe67172c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.334607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08e8a92d-d000-4c38-a1c8-1976fe67172c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.335606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08e8a92d-d000-4c38-a1c8-1976fe67172c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.336158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08e8a92d-d000-4c38-a1c8-1976fe67172c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.579908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08e8a92d-d000-4c38-a1c8-1976fe67172c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:00.584614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69ec412f-4954-4350-b41c-485cf132c617 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:00.594515 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-08e8a92d-d000-4c38-a1c8-1976fe67172c tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.283251 May 19 04:39:00.594938 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69ec412f-4954-4350-b41c-485cf132c617 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1645 microversion: 2.1 time: 0.350972 May 19 04:39:00.605120 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 921/1884] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:00 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1645 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:00.605343 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 964/1885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:00 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:00.610390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43e50c2d-cb84-4562-93d7-65e1cd901a3a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:00.611834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43e50c2d-cb84-4562-93d7-65e1cd901a3a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:00.622332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43e50c2d-cb84-4562-93d7-65e1cd901a3a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.622990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43e50c2d-cb84-4562-93d7-65e1cd901a3a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.624520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43e50c2d-cb84-4562-93d7-65e1cd901a3a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.625119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43e50c2d-cb84-4562-93d7-65e1cd901a3a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.765988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:00.766688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:00.774228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.775225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.776161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.776868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.814510 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43e50c2d-cb84-4562-93d7-65e1cd901a3a tempest-ServersOnMultiNodesTest-542739208 tempest-ServersOnMultiNodesTest-542739208-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1619 microversion: 2.1 time: 0.216945 May 19 04:39:00.815714 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 965/1886] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:00 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1619 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:00.836664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-46b3411f-84fb-4507-8438-a2b3c68a73aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:00.837499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-46b3411f-84fb-4507-8438-a2b3c68a73aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:00.844762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46b3411f-84fb-4507-8438-a2b3c68a73aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.845497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46b3411f-84fb-4507-8438-a2b3c68a73aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.848021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46b3411f-84fb-4507-8438-a2b3c68a73aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:00.848778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46b3411f-84fb-4507-8438-a2b3c68a73aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:00.884079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-46b3411f-84fb-4507-8438-a2b3c68a73aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:00.984718 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-46b3411f-84fb-4507-8438-a2b3c68a73aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 204 len: 0 microversion: 2.1 time: 0.151044 May 19 04:39:00.986098 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 966/1887] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:00 2022] DELETE /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:00.994795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:00.999522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-30dddbae-6000-4214-ac46-b60da58eb336 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:01.000604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-30dddbae-6000-4214-ac46-b60da58eb336 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:01.007483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:01.007832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30dddbae-6000-4214-ac46-b60da58eb336 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.008423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30dddbae-6000-4214-ac46-b60da58eb336 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.009528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30dddbae-6000-4214-ac46-b60da58eb336 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.010126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30dddbae-6000-4214-ac46-b60da58eb336 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.011178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:01.012647 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f9da5238-bb25-4ebb-a0ee-225e1e4c4d8b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.250907 May 19 04:39:01.026566 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 922/1888] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:00 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:01.032667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b1ab0b6-18c4-491c-b0c8-b6d11fa1f2aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:01.033666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5b1ab0b6-18c4-491c-b0c8-b6d11fa1f2aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:01.041717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b1ab0b6-18c4-491c-b0c8-b6d11fa1f2aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.044583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b1ab0b6-18c4-491c-b0c8-b6d11fa1f2aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.045697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b1ab0b6-18c4-491c-b0c8-b6d11fa1f2aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.046123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b1ab0b6-18c4-491c-b0c8-b6d11fa1f2aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.262581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-30dddbae-6000-4214-ac46-b60da58eb336 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:01.264937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:01.267092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5b1ab0b6-18c4-491c-b0c8-b6d11fa1f2aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:01.272944 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-30dddbae-6000-4214-ac46-b60da58eb336 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.285386 May 19 04:39:01.278043 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 967/1889] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:00 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:01.282706 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5b1ab0b6-18c4-491c-b0c8-b6d11fa1f2aa tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1472 microversion: 2.1 time: 0.253994 May 19 04:39:01.292952 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 923/1890] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:01 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:01.327811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:01.329000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:01.339924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.340670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.341826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.342286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.409228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:01.418745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:01.420535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:01.422098 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-487dc011-84c5-4e1d-822e-5ed690426045 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1265 microversion: 2.25 time: 0.098418 May 19 04:39:01.422857 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 968/1891] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:01 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:01.614398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f0620233-6c73-4ec9-bdf4-a70f3564fe31 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:01.615334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f0620233-6c73-4ec9-bdf4-a70f3564fe31 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:01.615810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb1748e2-62cc-45a6-9f56-e7d386e98979 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:01.616437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eb1748e2-62cc-45a6-9f56-e7d386e98979 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:01.623731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb1748e2-62cc-45a6-9f56-e7d386e98979 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.624452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb1748e2-62cc-45a6-9f56-e7d386e98979 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.625267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb1748e2-62cc-45a6-9f56-e7d386e98979 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.625703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb1748e2-62cc-45a6-9f56-e7d386e98979 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.628154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0620233-6c73-4ec9-bdf4-a70f3564fe31 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.629461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0620233-6c73-4ec9-bdf4-a70f3564fe31 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.631542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0620233-6c73-4ec9-bdf4-a70f3564fe31 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:01.632177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0620233-6c73-4ec9-bdf4-a70f3564fe31 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:01.880069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eb1748e2-62cc-45a6-9f56-e7d386e98979 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:01.889167 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eb1748e2-62cc-45a6-9f56-e7d386e98979 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.277019 May 19 04:39:01.889777 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 969/1892] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:01 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:01.936189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f0620233-6c73-4ec9-bdf4-a70f3564fe31 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:01.952295 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f0620233-6c73-4ec9-bdf4-a70f3564fe31 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1645 microversion: 2.1 time: 0.338541 May 19 04:39:01.954046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 924/1893] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:01 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1645 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:02.035757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:02.036735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:02.046033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.046537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.047992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.049799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.295042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0e191997-fce9-4d61-9724-3fe9d5a5d342 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:02.296338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0e191997-fce9-4d61-9724-3fe9d5a5d342 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:02.306527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e191997-fce9-4d61-9724-3fe9d5a5d342 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.307305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e191997-fce9-4d61-9724-3fe9d5a5d342 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.308093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e191997-fce9-4d61-9724-3fe9d5a5d342 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.308534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e191997-fce9-4d61-9724-3fe9d5a5d342 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.409577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:02.420473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:02.422179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:02.424321 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-063d114d-3b7c-4434-b6f9-0cd199828d13 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.392301 May 19 04:39:02.437849 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 970/1894] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:02 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:02.445536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-22578589-c41e-4188-9916-339f4d8d6470 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:02.446976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-22578589-c41e-4188-9916-339f4d8d6470 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:02.456579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22578589-c41e-4188-9916-339f4d8d6470 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.457362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22578589-c41e-4188-9916-339f4d8d6470 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.458424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22578589-c41e-4188-9916-339f4d8d6470 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.459110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22578589-c41e-4188-9916-339f4d8d6470 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.640722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0e191997-fce9-4d61-9724-3fe9d5a5d342 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:02.651138 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0e191997-fce9-4d61-9724-3fe9d5a5d342 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1513 microversion: 2.1 time: 0.360888 May 19 04:39:02.652637 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 925/1895] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:02 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:39:02.657656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:02.658563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:02.667015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.667808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.668818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.669465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.714214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.714893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.715532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lazy-loading 'fault' on Instance uuid a61799b1-3689-4c54-bb41-ac10d07bca57 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:39:02.772331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:02.781178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22578589-c41e-4188-9916-339f4d8d6470 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:02.797757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:02.798482 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-22578589-c41e-4188-9916-339f4d8d6470 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1472 microversion: 2.1 time: 0.357689 May 19 04:39:02.800241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:02.810891 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 971/1896] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:02 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:02.813151 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7eaf5ef5-93bc-4efd-99d6-f5074f388142 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 200 len: 1270 microversion: 2.25 time: 0.147946 May 19 04:39:02.829245 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 926/1897] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:02 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:02.907905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3bdbcd82-e2d3-4bb7-ada7-638cd00d2de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:02.908582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3bdbcd82-e2d3-4bb7-ada7-638cd00d2de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:02.927710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3bdbcd82-e2d3-4bb7-ada7-638cd00d2de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.928174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3bdbcd82-e2d3-4bb7-ada7-638cd00d2de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.932617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3bdbcd82-e2d3-4bb7-ada7-638cd00d2de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.934728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3bdbcd82-e2d3-4bb7-ada7-638cd00d2de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.972160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f83b3a1c-e5d6-41b3-9b9e-0661cdb5289d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:02.973070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f83b3a1c-e5d6-41b3-9b9e-0661cdb5289d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:02.980817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f83b3a1c-e5d6-41b3-9b9e-0661cdb5289d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.981467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f83b3a1c-e5d6-41b3-9b9e-0661cdb5289d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:02.982540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f83b3a1c-e5d6-41b3-9b9e-0661cdb5289d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:02.983132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f83b3a1c-e5d6-41b3-9b9e-0661cdb5289d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:03.133302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f83b3a1c-e5d6-41b3-9b9e-0661cdb5289d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:03.146929 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f83b3a1c-e5d6-41b3-9b9e-0661cdb5289d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1468 microversion: 2.1 time: 0.178327 May 19 04:39:03.148512 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 927/1898] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:02 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1468 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:03.362227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-692c4815-7339-4777-b582-c92140ffadfb req-b7a8294e-f40f-44ac-8a23-19ec0d03c77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604b274a-2199-4a0b-a8fb-bb606625a781", "name": "network-vif-deleted", "tag": "4e249990-c90b-46d6-9678-f92a6e092cc1"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:03.379176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-692c4815-7339-4777-b582-c92140ffadfb req-b7a8294e-f40f-44ac-8a23-19ec0d03c77c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:03.381050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-692c4815-7339-4777-b582-c92140ffadfb req-b7a8294e-f40f-44ac-8a23-19ec0d03c77c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:03.383194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3bdbcd82-e2d3-4bb7-ada7-638cd00d2de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:03.392157 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3bdbcd82-e2d3-4bb7-ada7-638cd00d2de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.488786 May 19 04:39:03.397033 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 972/1899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:02 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:03.406856 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-692c4815-7339-4777-b582-c92140ffadfb req-b7a8294e-f40f-44ac-8a23-19ec0d03c77c service nova] Creating event network-vif-deleted:4e249990-c90b-46d6-9678-f92a6e092cc1 for instance 604b274a-2199-4a0b-a8fb-bb606625a781 on n-h2-766726-30 May 19 04:39:03.413748 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-692c4815-7339-4777-b582-c92140ffadfb req-b7a8294e-f40f-44ac-8a23-19ec0d03c77c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055167 May 19 04:39:03.418914 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 928/1900] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:39:03.444672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:03.445508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:03.456758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:03.458650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:03.459696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:03.462592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:03.674809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8340760-6407-4e96-9954-4df63ac8e5bc tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:03.675932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f8340760-6407-4e96-9954-4df63ac8e5bc tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:03.689698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8340760-6407-4e96-9954-4df63ac8e5bc tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:03.691396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8340760-6407-4e96-9954-4df63ac8e5bc tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:03.694000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8340760-6407-4e96-9954-4df63ac8e5bc tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:03.695277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8340760-6407-4e96-9954-4df63ac8e5bc tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:03.940879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:03.951215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:03.952715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:03.954155 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2be1ec2a-fe60-489b-82ab-652800cee3b8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.513793 May 19 04:39:03.954726 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 973/1901] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:03 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:03.959390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b23a4478-9fea-4382-98b4-e4c1cb8b5b9c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:03.959999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b23a4478-9fea-4382-98b4-e4c1cb8b5b9c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:03.966153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b23a4478-9fea-4382-98b4-e4c1cb8b5b9c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:03.966608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b23a4478-9fea-4382-98b4-e4c1cb8b5b9c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:03.967382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b23a4478-9fea-4382-98b4-e4c1cb8b5b9c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:03.967817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b23a4478-9fea-4382-98b4-e4c1cb8b5b9c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:04.061881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f8340760-6407-4e96-9954-4df63ac8e5bc tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:04.073258 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f8340760-6407-4e96-9954-4df63ac8e5bc tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1519 microversion: 2.1 time: 0.406322 May 19 04:39:04.074453 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 929/1902] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:03 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1519 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:04.082693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:04.083590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: a61799b1-3689-4c54-bb41-ac10d07bca57] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:04.092240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:04.093256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:04.094579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:04.095282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:04.110938 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] HTTP exception thrown: Instance a61799b1-3689-4c54-bb41-ac10d07bca57 could not be found. May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Request method failure captured: May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 HTTP/1.1 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg0RFjMAPzZNe6AaoYRsLgtq0HUSW-mWHffkxrGhBjwCGGhg63YZBHFU8lLkl1FlXqLpb5d70_kw-EpAWGKzzLG3KH1K_WWf4ub9ZlIQ4zoqPUQSHIKagCTCYKJJvXALpYq2BzRtrhBv9JkaKruEAaWhxHTKRoGBdcOdSkAgsWfjFY May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.25 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 6d01f77aa473464b8e32d47e9b9d2a98 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 6d01f77aa473464b8e32d47e9b9d2a98 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-LiveAutoBlockMigrationV225Test-1514156105-project May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 249e284f0cfe4ecda820efeb5956701f May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105-project May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance a61799b1-3689-4c54-bb41-ac10d07bca57 could not be found. May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'a61799b1-3689-4c54-bb41-ac10d07bca57'} May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a61799b1-3689-4c54-bb41-ac10d07bca57 could not be found. May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a61799b1-3689-4c54-bb41-ac10d07bca57 could not be found. May 19 04:39:04.112806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a61799b1-3689-4c54-bb41-ac10d07bca57 could not be found. May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Returning 404 to user: Instance a61799b1-3689-4c54-bb41-ac10d07bca57 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:04.120019 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-83cd041e-a1ad-4f32-a151-a64a02b8dea4 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57" status: 404 len: 111 microversion: 2.25 time: 0.036650 May 19 04:39:04.130444 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 930/1903] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:04 2022] GET /compute/v2.1/servers/a61799b1-3689-4c54-bb41-ac10d07bca57 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:39:04.166550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:04.167510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:04.183862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:04.185002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:04.185878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:04.188829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:04.260499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:04.265777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:04.266448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lazy-loading 'fault' on Instance uuid 604b274a-2199-4a0b-a8fb-bb606625a781 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:39:04.335949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b23a4478-9fea-4382-98b4-e4c1cb8b5b9c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:04.344609 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b23a4478-9fea-4382-98b4-e4c1cb8b5b9c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1472 microversion: 2.1 time: 0.388669 May 19 04:39:04.345260 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 974/1904] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:03 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1472 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:04.376885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:04.385118 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1dbc914c-3628-4e6e-8ced-2ce0fd1085d3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 200 len: 1306 microversion: 2.1 time: 0.223744 May 19 04:39:04.385694 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 931/1905] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:04 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 1306 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:04.411322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9fa27163-c83a-4368-ab9a-726764dd262b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:04.411940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9fa27163-c83a-4368-ab9a-726764dd262b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:04.420745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fa27163-c83a-4368-ab9a-726764dd262b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:04.421235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fa27163-c83a-4368-ab9a-726764dd262b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:04.422013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fa27163-c83a-4368-ab9a-726764dd262b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:04.422508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fa27163-c83a-4368-ab9a-726764dd262b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:04.828668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9fa27163-c83a-4368-ab9a-726764dd262b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:04.837906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9fa27163-c83a-4368-ab9a-726764dd262b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.432009 May 19 04:39:04.839339 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 975/1906] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:04 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:04.973269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:04.974291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:04.980549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:04.981040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:04.981908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:04.982549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:05.094129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e5412faa-14b4-495c-9bfb-59218ceb95f7 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:05.095841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e5412faa-14b4-495c-9bfb-59218ceb95f7 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:05.106429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5412faa-14b4-495c-9bfb-59218ceb95f7 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:05.107207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5412faa-14b4-495c-9bfb-59218ceb95f7 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:05.108161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5412faa-14b4-495c-9bfb-59218ceb95f7 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:05.109577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5412faa-14b4-495c-9bfb-59218ceb95f7 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:05.724484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e5412faa-14b4-495c-9bfb-59218ceb95f7 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:05.732428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:05.739501 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e5412faa-14b4-495c-9bfb-59218ceb95f7 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1519 microversion: 2.1 time: 0.651120 May 19 04:39:05.741357 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 976/1907] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:05 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1519 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:05.744827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:05.748209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be32d1f3-7bf5-4d16-a48e-fd820faaf26f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:05.753364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be32d1f3-7bf5-4d16-a48e-fd820faaf26f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:05.756349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:05.757732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b63262d1-e67b-4de2-8c8e-8c62846540f8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.788577 May 19 04:39:05.758731 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 932/1908] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:04 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:05.765646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:05.767289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:05.770785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be32d1f3-7bf5-4d16-a48e-fd820faaf26f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:05.771713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be32d1f3-7bf5-4d16-a48e-fd820faaf26f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:05.773054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be32d1f3-7bf5-4d16-a48e-fd820faaf26f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:05.773587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be32d1f3-7bf5-4d16-a48e-fd820faaf26f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:05.787381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:05.787825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:05.788604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:05.801800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:05.818413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 HTTP/1.1 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '604b274a-2199-4a0b-a8fb-bb606625a781'} May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:05.826594 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-62ef50ed-26b5-406c-b15c-227f19d0d53a tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 404 len: 111 microversion: 2.1 time: 0.068014 May 19 04:39:05.835491 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 933/1909] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:05 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:05.845812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13be92e4-5b4c-4e96-81ca-c8e206f595dc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315b3ff70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:06.132328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be32d1f3-7bf5-4d16-a48e-fd820faaf26f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:06.144606 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be32d1f3-7bf5-4d16-a48e-fd820faaf26f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 200 len: 1472 microversion: 2.1 time: 0.401574 May 19 04:39:06.147687 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 977/1910] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:05 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:06.160196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1d9f4897-02bc-49d1-88e6-f85796ad76e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:06.164618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1d9f4897-02bc-49d1-88e6-f85796ad76e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:06.185321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d9f4897-02bc-49d1-88e6-f85796ad76e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:06.197966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d9f4897-02bc-49d1-88e6-f85796ad76e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:06.205762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d9f4897-02bc-49d1-88e6-f85796ad76e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:06.206461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d9f4897-02bc-49d1-88e6-f85796ad76e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:06.472317 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13be92e4-5b4c-4e96-81ca-c8e206f595dc tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5db76d90-11a0-4771-bf65-84bc0d500faa" status: 202 len: 0 microversion: 2.1 time: 0.638850 May 19 04:39:06.473258 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 934/1911] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:05 2022] DELETE /compute/v2.1/os-security-groups/5db76d90-11a0-4771-bf65-84bc0d500faa => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:39:06.478966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1975a32c-7385-44b2-8f7e-f9e0f862aca2 req-a0af41ee-9826-4969-97c8-d4039dfe62f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04caa3a3-67cf-40dc-b42a-ac4543914180", "name": "network-vif-deleted", "tag": "aa86ac9d-46ba-47f0-8ce4-f9dc8032c39e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:06.503158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1d9f4897-02bc-49d1-88e6-f85796ad76e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:06.506926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1975a32c-7385-44b2-8f7e-f9e0f862aca2 req-a0af41ee-9826-4969-97c8-d4039dfe62f0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:06.507386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1975a32c-7385-44b2-8f7e-f9e0f862aca2 req-a0af41ee-9826-4969-97c8-d4039dfe62f0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:06.515806 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1d9f4897-02bc-49d1-88e6-f85796ad76e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.366749 May 19 04:39:06.527215 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 978/1912] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:06 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:06.534527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-670b79d8-dea3-4d7b-8766-189757e3e2cb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315c94670>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:06.538526 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1975a32c-7385-44b2-8f7e-f9e0f862aca2 req-a0af41ee-9826-4969-97c8-d4039dfe62f0 service nova] Creating event network-vif-deleted:aa86ac9d-46ba-47f0-8ce4-f9dc8032c39e for instance 04caa3a3-67cf-40dc-b42a-ac4543914180 on n-h1-766726-30 May 19 04:39:06.551168 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1975a32c-7385-44b2-8f7e-f9e0f862aca2 req-a0af41ee-9826-4969-97c8-d4039dfe62f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076161 May 19 04:39:06.552696 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 935/1913] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:06.757887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7ca5d5c2-041d-4d50-b3f5-aa658eacc073 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:06.759781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7ca5d5c2-041d-4d50-b3f5-aa658eacc073 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:06.774229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ca5d5c2-041d-4d50-b3f5-aa658eacc073 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:06.777215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ca5d5c2-041d-4d50-b3f5-aa658eacc073 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:06.779746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ca5d5c2-041d-4d50-b3f5-aa658eacc073 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:06.780549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ca5d5c2-041d-4d50-b3f5-aa658eacc073 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:06.787205 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-670b79d8-dea3-4d7b-8766-189757e3e2cb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d7273bec-8355-4994-9f04-b93929912314" status: 202 len: 0 microversion: 2.1 time: 0.258458 May 19 04:39:06.787845 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 979/1914] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:06 2022] DELETE /compute/v2.1/os-security-groups/d7273bec-8355-4994-9f04-b93929912314 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:39:06.793388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:06.794266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:06.834996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:06.837020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:06.839173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:06.844035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:07.166779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7ca5d5c2-041d-4d50-b3f5-aa658eacc073 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:07.178769 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7ca5d5c2-041d-4d50-b3f5-aa658eacc073 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1519 microversion: 2.1 time: 0.426239 May 19 04:39:07.180079 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 936/1915] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:06 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1519 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:07.187649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-de5a210c-a600-4041-9b3b-1457f7994693 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'create', calling method: .version_select at 0x7fd316138ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2103618577", "description": "tempest-description-635002677"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:07.221039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:07.236120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:07.240879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:07.243379 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eafb4612-870c-4875-b216-a725ecbaa486 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.454522 May 19 04:39:07.246891 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 980/1916] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:06 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:07.253041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:07.254448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 04caa3a3-67cf-40dc-b42a-ac4543914180] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:07.264453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:07.265178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:07.266300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:07.267586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:07.297456 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] HTTP exception thrown: Instance 04caa3a3-67cf-40dc-b42a-ac4543914180 could not be found. May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Request method failure captured: May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 HTTP/1.1 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihclRoW7E27Xam7UhIYUqTz0omQCd52r-1-9bqqfF23c3JDxaoOoqvok9Sn0wLu7UK-BhTck9LqHJWadsecu-YmtpQUu0odDmQdPJDmi4o3qwTfKN4NmpuMtiltNPmTr3i6o3b-a4zhsUDEp6_TShxAuF2mL2R8JOVjMGMgptpEhryBI May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d4796ef3b2154a949d6b966e99055595 May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 04caa3a3-67cf-40dc-b42a-ac4543914180 could not be found. May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '04caa3a3-67cf-40dc-b42a-ac4543914180'} May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04caa3a3-67cf-40dc-b42a-ac4543914180 could not be found. May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04caa3a3-67cf-40dc-b42a-ac4543914180 could not be found. May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:07.304004 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:07.308776 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:07.308776 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:07.308776 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:07.308776 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:07.308776 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:07.308776 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04caa3a3-67cf-40dc-b42a-ac4543914180 could not be found. May 19 04:39:07.308776 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:07.310896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Returning 404 to user: Instance 04caa3a3-67cf-40dc-b42a-ac4543914180 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:07.314358 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-98fe2040-1e2b-4c8b-87af-f9c5522ec4f4 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180" status: 404 len: 111 microversion: 2.1 time: 0.065567 May 19 04:39:07.318288 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 981/1917] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:07 2022] GET /compute/v2.1/servers/04caa3a3-67cf-40dc-b42a-ac4543914180 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:07.326891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cecd3866-52ea-4f61-8caf-85b732b35ed2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:07.329683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cecd3866-52ea-4f61-8caf-85b732b35ed2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:07.342613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cecd3866-52ea-4f61-8caf-85b732b35ed2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:07.346371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cecd3866-52ea-4f61-8caf-85b732b35ed2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:07.347483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cecd3866-52ea-4f61-8caf-85b732b35ed2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:07.351639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cecd3866-52ea-4f61-8caf-85b732b35ed2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:07.419135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cecd3866-52ea-4f61-8caf-85b732b35ed2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:07.600243 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-de5a210c-a600-4041-9b3b-1457f7994693 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.418029 May 19 04:39:07.606611 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 937/1918] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:39:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:07.615221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b5d9f18a-94da-4d4a-ae45-6329ae70eae6 req-28dbffa6-8149-478f-9dd5-c253966e866b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2487ebd4-e36c-404c-9c5f-76aa7a3bf41b", "name": "network-vif-unplugged", "status": "completed", "tag": "c03ba391-adc5-4ec1-8242-3aa5aca306ce"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:07.630776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b5d9f18a-94da-4d4a-ae45-6329ae70eae6 req-28dbffa6-8149-478f-9dd5-c253966e866b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:07.631217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b5d9f18a-94da-4d4a-ae45-6329ae70eae6 req-28dbffa6-8149-478f-9dd5-c253966e866b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:07.634832 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cecd3866-52ea-4f61-8caf-85b732b35ed2 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 204 len: 0 microversion: 2.1 time: 0.314400 May 19 04:39:07.635427 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 982/1919] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:07 2022] DELETE /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:07.644811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c1e13801-4b7c-4b41-b6cf-348bb1080199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:07.645638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c1e13801-4b7c-4b41-b6cf-348bb1080199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:07.667756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1e13801-4b7c-4b41-b6cf-348bb1080199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:07.670223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1e13801-4b7c-4b41-b6cf-348bb1080199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:07.671169 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b5d9f18a-94da-4d4a-ae45-6329ae70eae6 req-28dbffa6-8149-478f-9dd5-c253966e866b service nova] Creating event network-vif-unplugged:c03ba391-adc5-4ec1-8242-3aa5aca306ce for instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b on n-h1-766726-30 May 19 04:39:07.673262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1e13801-4b7c-4b41-b6cf-348bb1080199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:07.677727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1e13801-4b7c-4b41-b6cf-348bb1080199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:07.685268 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b5d9f18a-94da-4d4a-ae45-6329ae70eae6 req-28dbffa6-8149-478f-9dd5-c253966e866b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076873 May 19 04:39:07.687487 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 938/1920] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:07.702194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5978316b-decf-4671-8fa2-154e13d203ea tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Action: 'update', calling method: .version_select at 0x7fd315fc3e50>, body: {"security_group": {"name": "tempest-sg-hth-1548190412", "description": "tempest-description-hth-646309778"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:07.962574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c1e13801-4b7c-4b41-b6cf-348bb1080199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:07.978322 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c1e13801-4b7c-4b41-b6cf-348bb1080199 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.337826 May 19 04:39:07.989403 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 983/1921] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:07 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:08.003451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9bd41123-875a-4399-933c-41ced5010d02 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:08.006214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9bd41123-875a-4399-933c-41ced5010d02 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:08.022924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd41123-875a-4399-933c-41ced5010d02 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.025153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd41123-875a-4399-933c-41ced5010d02 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.027811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd41123-875a-4399-933c-41ced5010d02 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.029300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd41123-875a-4399-933c-41ced5010d02 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.057279 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5978316b-decf-4671-8fa2-154e13d203ea tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/a8e1603c-bd62-41fd-9ecf-3b82e9ca69dd" status: 200 len: 217 microversion: 2.1 time: 0.366161 May 19 04:39:08.059431 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 939/1922] 10.222.0.58 () {60 vars in 1289 bytes} [Thu May 19 04:39:07 2022] PUT /compute/v2.1/os-security-groups/a8e1603c-bd62-41fd-9ecf-3b82e9ca69dd => generated 217 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:08.069609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24b83786-1e7a-4b92-abdc-d913ceeb3d82 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315a66e50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:08.078845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:08.154391 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-24b83786-1e7a-4b92-abdc-d913ceeb3d82 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/a8e1603c-bd62-41fd-9ecf-3b82e9ca69dd" status: 200 len: 217 microversion: 2.1 time: 0.088427 May 19 04:39:08.156527 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 940/1923] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:39:08 2022] GET /compute/v2.1/os-security-groups/a8e1603c-bd62-41fd-9ecf-3b82e9ca69dd => generated 217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:39:08.170760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87be272c-f635-4e5e-b21f-8b0b9aade45f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315b3f0d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:08.500298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9bd41123-875a-4399-933c-41ced5010d02 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:08.516196 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9bd41123-875a-4399-933c-41ced5010d02 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1472 microversion: 2.1 time: 0.523771 May 19 04:39:08.518182 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 984/1924] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:07 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1472 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:08.528199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9cb5525f-491e-4295-b15d-e55d4ec05799 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:08.529976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9cb5525f-491e-4295-b15d-e55d4ec05799 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:08.547846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cb5525f-491e-4295-b15d-e55d4ec05799 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.550314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cb5525f-491e-4295-b15d-e55d4ec05799 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.551605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cb5525f-491e-4295-b15d-e55d4ec05799 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.552943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cb5525f-491e-4295-b15d-e55d4ec05799 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.748874 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87be272c-f635-4e5e-b21f-8b0b9aade45f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a8e1603c-bd62-41fd-9ecf-3b82e9ca69dd" status: 202 len: 0 microversion: 2.1 time: 0.583696 May 19 04:39:08.749762 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 941/1925] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:08 2022] DELETE /compute/v2.1/os-security-groups/a8e1603c-bd62-41fd-9ecf-3b82e9ca69dd => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:39:08.757747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:08.758637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:08.776468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.776925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.777759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.778201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.819820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9cb5525f-491e-4295-b15d-e55d4ec05799 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:08.823380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:08.834719 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9cb5525f-491e-4295-b15d-e55d4ec05799 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1519 microversion: 2.1 time: 0.315173 May 19 04:39:08.835954 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 985/1926] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:08 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1519 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:08.841424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:08.843837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:08.855642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.857255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.858185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.858731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.905763 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 HTTP/1.1 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '604b274a-2199-4a0b-a8fb-bb606625a781'} May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:08.907805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.913214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.914866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:08.915960 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e230f391-5110-4f33-84e9-da6d4570160d tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 404 len: 111 microversion: 2.1 time: 0.078966 May 19 04:39:08.922159 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 986/1927] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:08 2022] DELETE /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:08.930510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:08.931175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 604b274a-2199-4a0b-a8fb-bb606625a781] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:08.942406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.942912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.943656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:08.944102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:08.984426 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 HTTP/1.1 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '604b274a-2199-4a0b-a8fb-bb606625a781'} May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:08.986594 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.992039 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:08.992039 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:08.992039 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:08.992039 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:08.992039 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:08.992039 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. May 19 04:39:08.992039 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:08.995221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Instance 604b274a-2199-4a0b-a8fb-bb606625a781 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:08.998331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14358831-79d7-4f65-9da9-e5ac2ea84e26 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781" status: 404 len: 111 microversion: 2.1 time: 0.072355 May 19 04:39:09.002526 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 987/1928] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:08 2022] GET /compute/v2.1/servers/604b274a-2199-4a0b-a8fb-bb606625a781 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:39:09.022092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bba4ce57-5c3f-42dc-9438-9c30b3e72c95 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:09.022730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bba4ce57-5c3f-42dc-9438-9c30b3e72c95 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:09.037024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bba4ce57-5c3f-42dc-9438-9c30b3e72c95 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:09.037750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bba4ce57-5c3f-42dc-9438-9c30b3e72c95 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:09.039316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bba4ce57-5c3f-42dc-9438-9c30b3e72c95 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:09.039961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bba4ce57-5c3f-42dc-9438-9c30b3e72c95 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:09.311547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:09.321524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:09.323169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:09.326431 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ad2e1acf-cefd-45c8-beae-f5ad87700562 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.572628 May 19 04:39:09.333936 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 942/1929] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:08 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:09.340409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00d3c534-846e-48e5-823d-d1fe08b57475 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315a66040>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:09.766059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bba4ce57-5c3f-42dc-9438-9c30b3e72c95 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:09.777116 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bba4ce57-5c3f-42dc-9438-9c30b3e72c95 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.773472 May 19 04:39:09.777688 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 988/1930] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:09 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:09.794432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bacef2bc-6df0-4e27-84e2-c7ebb56a1ecc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:09.795172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bacef2bc-6df0-4e27-84e2-c7ebb56a1ecc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:09.809750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bacef2bc-6df0-4e27-84e2-c7ebb56a1ecc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:09.810132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bacef2bc-6df0-4e27-84e2-c7ebb56a1ecc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:09.810931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bacef2bc-6df0-4e27-84e2-c7ebb56a1ecc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:09.811376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bacef2bc-6df0-4e27-84e2-c7ebb56a1ecc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:09.840512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-00d3c534-846e-48e5-823d-d1fe08b57475 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7273bec-8355-4994-9f04-b93929912314 does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:39:09.841479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-00d3c534-846e-48e5-823d-d1fe08b57475 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group d7273bec-8355-4994-9f04-b93929912314 not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:39:09.842246 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-00d3c534-846e-48e5-823d-d1fe08b57475 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group d7273bec-8355-4994-9f04-b93929912314 does not exist May 19 04:39:09.842246 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-5cc3414f-aa98-4c47-8b95-82c72fa4e59b'] May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00d3c534-846e-48e5-823d-d1fe08b57475 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-security-groups/d7273bec-8355-4994-9f04-b93929912314 HTTP/1.1 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group d7273bec-8355-4994-9f04-b93929912314 does not exist May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-5cc3414f-aa98-4c47-8b95-82c72fa4e59b'] May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'd7273bec-8355-4994-9f04-b93929912314'} May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:39:09.846781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7273bec-8355-4994-9f04-b93929912314 does not exist May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cc3414f-aa98-4c47-8b95-82c72fa4e59b'] May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7273bec-8355-4994-9f04-b93929912314 does not exist May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cc3414f-aa98-4c47-8b95-82c72fa4e59b'] May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7273bec-8355-4994-9f04-b93929912314 does not exist May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cc3414f-aa98-4c47-8b95-82c72fa4e59b'] May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7273bec-8355-4994-9f04-b93929912314 does not exist May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cc3414f-aa98-4c47-8b95-82c72fa4e59b'] May 19 04:39:09.851069 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:09.860725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00d3c534-846e-48e5-823d-d1fe08b57475 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group d7273bec-8355-4994-9f04-b93929912314 does not exist May 19 04:39:09.860725 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-5cc3414f-aa98-4c47-8b95-82c72fa4e59b'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:09.860725 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00d3c534-846e-48e5-823d-d1fe08b57475 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d7273bec-8355-4994-9f04-b93929912314" status: 404 len: 194 microversion: 2.1 time: 0.524800 May 19 04:39:09.861631 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 943/1931] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:09 2022] DELETE /compute/v2.1/os-security-groups/d7273bec-8355-4994-9f04-b93929912314 => generated 194 bytes in 527 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:09.866504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cdac8672-aa5a-4182-a6c0-0f4a456aaf67 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Action: 'create', calling method: .version_select at 0x7fd315b3f3a0>, body: {"keypair": {"name": "tempest-keypair-1346713678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPu3SXhIYr4hebxom8rMV1yz7WGSMBcx6zydeK0t+1oiif+ATR/N4VN6Kx+0gCSDo52kehz6Pz35WO/crbp0R0d1k/QKEo3G8u4/7Nc4+kbZQFjri0gpA5eL1vTmXr+twg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:09.919256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cdac8672-aa5a-4182-a6c0-0f4a456aaf67 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Getting quotas for project ce47f533f04d498c872d7eebd936dd7a. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:39:09.941389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cdac8672-aa5a-4182-a6c0-0f4a456aaf67 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Getting quotas for user c8bd8feb841f4876a7f1519525cf3fb4 and project ce47f533f04d498c872d7eebd936dd7a. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:39:09.985943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bacef2bc-6df0-4e27-84e2-c7ebb56a1ecc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:09.998345 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bacef2bc-6df0-4e27-84e2-c7ebb56a1ecc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 200 len: 1430 microversion: 2.1 time: 0.218495 May 19 04:39:09.999257 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 989/1932] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:09 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 1430 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:10.012085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f6dc0b9d-1df9-4526-8760-56cb96b8e6b6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:10.013035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f6dc0b9d-1df9-4526-8760-56cb96b8e6b6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:10.022792 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cdac8672-aa5a-4182-a6c0-0f4a456aaf67 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.159859 May 19 04:39:10.023839 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 944/1933] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 19 04:39:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 04:39:10.032275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6dc0b9d-1df9-4526-8760-56cb96b8e6b6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:10.035497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6dc0b9d-1df9-4526-8760-56cb96b8e6b6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:10.036405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6dc0b9d-1df9-4526-8760-56cb96b8e6b6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:10.036861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6dc0b9d-1df9-4526-8760-56cb96b8e6b6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:10.053108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d38f0bb-7901-4215-bac0-65bf64873a02 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315b88f70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:10.086912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-4d38f0bb-7901-4215-bac0-65bf64873a02 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5db76d90-11a0-4771-bf65-84bc0d500faa does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:39:10.087802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-4d38f0bb-7901-4215-bac0-65bf64873a02 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group 5db76d90-11a0-4771-bf65-84bc0d500faa not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:39:10.088588 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-4d38f0bb-7901-4215-bac0-65bf64873a02 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group 5db76d90-11a0-4771-bf65-84bc0d500faa does not exist May 19 04:39:10.088588 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-44e3a611-f41f-40b6-9979-4bcc0553f08b'] May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d38f0bb-7901-4215-bac0-65bf64873a02 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-security-groups/5db76d90-11a0-4771-bf65-84bc0d500faa HTTP/1.1 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group 5db76d90-11a0-4771-bf65-84bc0d500faa does not exist May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-44e3a611-f41f-40b6-9979-4bcc0553f08b'] May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '5db76d90-11a0-4771-bf65-84bc0d500faa'} May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:39:10.090799 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5db76d90-11a0-4771-bf65-84bc0d500faa does not exist May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44e3a611-f41f-40b6-9979-4bcc0553f08b'] May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5db76d90-11a0-4771-bf65-84bc0d500faa does not exist May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44e3a611-f41f-40b6-9979-4bcc0553f08b'] May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5db76d90-11a0-4771-bf65-84bc0d500faa does not exist May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44e3a611-f41f-40b6-9979-4bcc0553f08b'] May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5db76d90-11a0-4771-bf65-84bc0d500faa does not exist May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44e3a611-f41f-40b6-9979-4bcc0553f08b'] May 19 04:39:10.095119 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.102372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d38f0bb-7901-4215-bac0-65bf64873a02 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group 5db76d90-11a0-4771-bf65-84bc0d500faa does not exist May 19 04:39:10.102372 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-44e3a611-f41f-40b6-9979-4bcc0553f08b'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:10.103720 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4d38f0bb-7901-4215-bac0-65bf64873a02 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5db76d90-11a0-4771-bf65-84bc0d500faa" status: 404 len: 194 microversion: 2.1 time: 0.078671 May 19 04:39:10.104843 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 945/1934] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:10 2022] DELETE /compute/v2.1/os-security-groups/5db76d90-11a0-4771-bf65-84bc0d500faa => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:10.110911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-c47f7d2b-9736-4ced-8614-416a5c59b939 req-8d793fa1-afd8-4cbd-ae1f-8f7dc91152df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6365b24-b115-45c9-985b-d60b956b759c", "name": "network-vif-deleted", "tag": "f5b9e699-1c43-442e-9b20-c9e2e2ea35b8"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:10.148457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c47f7d2b-9736-4ced-8614-416a5c59b939 req-8d793fa1-afd8-4cbd-ae1f-8f7dc91152df service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:10.149397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c47f7d2b-9736-4ced-8614-416a5c59b939 req-8d793fa1-afd8-4cbd-ae1f-8f7dc91152df service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:10.189021 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-c47f7d2b-9736-4ced-8614-416a5c59b939 req-8d793fa1-afd8-4cbd-ae1f-8f7dc91152df service nova] Creating event network-vif-deleted:f5b9e699-1c43-442e-9b20-c9e2e2ea35b8 for instance c6365b24-b115-45c9-985b-d60b956b759c on n-h2-766726-30 May 19 04:39:10.204371 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-c47f7d2b-9736-4ced-8614-416a5c59b939 req-8d793fa1-afd8-4cbd-ae1f-8f7dc91152df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097903 May 19 04:39:10.205804 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 946/1935] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:10.213625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ec25c8c-5897-4be7-8b0a-2b38d79428b0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd316138310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:10.322506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-9ec25c8c-5897-4be7-8b0a-2b38d79428b0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:39:10.323244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-9ec25c8c-5897-4be7-8b0a-2b38d79428b0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group 9274d45b-7a6d-490b-b7f1-d8842681c093 not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:39:10.323973 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-9ec25c8c-5897-4be7-8b0a-2b38d79428b0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:39:10.323973 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-08050575-e24d-48cb-ade0-50316c0e5368'] May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ec25c8c-5897-4be7-8b0a-2b38d79428b0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-security-groups/9274d45b-7a6d-490b-b7f1-d8842681c093 HTTP/1.1 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-08050575-e24d-48cb-ade0-50316c0e5368'] May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '9274d45b-7a6d-490b-b7f1-d8842681c093'} May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:39:10.327001 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08050575-e24d-48cb-ade0-50316c0e5368'] May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08050575-e24d-48cb-ade0-50316c0e5368'] May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08050575-e24d-48cb-ade0-50316c0e5368'] May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08050575-e24d-48cb-ade0-50316c0e5368'] May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ec25c8c-5897-4be7-8b0a-2b38d79428b0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group 9274d45b-7a6d-490b-b7f1-d8842681c093 does not exist May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-08050575-e24d-48cb-ade0-50316c0e5368'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ec25c8c-5897-4be7-8b0a-2b38d79428b0 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/9274d45b-7a6d-490b-b7f1-d8842681c093" status: 404 len: 194 microversion: 2.1 time: 0.123952 May 19 04:39:10.332388 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 947/1936] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:10 2022] DELETE /compute/v2.1/os-security-groups/9274d45b-7a6d-490b-b7f1-d8842681c093 => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:10.352000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9188b29-cc99-4a11-9b7b-c2bc26264bf3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315b885e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:10.502622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-a9188b29-cc99-4a11-9b7b-c2bc26264bf3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:39:10.503309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-a9188b29-cc99-4a11-9b7b-c2bc26264bf3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:39:10.504182 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-a9188b29-cc99-4a11-9b7b-c2bc26264bf3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:39:10.504182 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-f42955bf-cae3-4b54-a236-643c494cbfe0'] May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9188b29-cc99-4a11-9b7b-c2bc26264bf3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-security-groups/8fb5dacb-821d-4059-a66d-fadcddd0c2a8 HTTP/1.1 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-f42955bf-cae3-4b54-a236-643c494cbfe0'] May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '8fb5dacb-821d-4059-a66d-fadcddd0c2a8'} May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:39:10.506430 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f42955bf-cae3-4b54-a236-643c494cbfe0'] May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f42955bf-cae3-4b54-a236-643c494cbfe0'] May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f42955bf-cae3-4b54-a236-643c494cbfe0'] May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f42955bf-cae3-4b54-a236-643c494cbfe0'] May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9188b29-cc99-4a11-9b7b-c2bc26264bf3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group 8fb5dacb-821d-4059-a66d-fadcddd0c2a8 does not exist May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-f42955bf-cae3-4b54-a236-643c494cbfe0'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:10.512368 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9188b29-cc99-4a11-9b7b-c2bc26264bf3 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8fb5dacb-821d-4059-a66d-fadcddd0c2a8" status: 404 len: 194 microversion: 2.1 time: 0.169531 May 19 04:39:10.516982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f6dc0b9d-1df9-4526-8760-56cb96b8e6b6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:10.517281 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 948/1937] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:10 2022] DELETE /compute/v2.1/os-security-groups/8fb5dacb-821d-4059-a66d-fadcddd0c2a8 => generated 194 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:10.521465 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f6dc0b9d-1df9-4526-8760-56cb96b8e6b6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1519 microversion: 2.1 time: 0.516623 May 19 04:39:10.521465 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 990/1938] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:10 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1519 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:10.525413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-547b7e3d-9798-4530-80ca-62a03dc8fd6c tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315c45b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:10.541051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:10.541887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:10.549682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG neutronclient.v2_0.client [None req-547b7e3d-9798-4530-80ca-62a03dc8fd6c tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist", "detail": ""}} {{(pid=124818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:39:10.550297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.security_group_api [None req-547b7e3d-9798-4530-80ca-62a03dc8fd6c tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group 09d0d728-56b2-41ef-97e5-964a3848301c not found {{(pid=124818) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:39:10.550834 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-547b7e3d-9798-4530-80ca-62a03dc8fd6c tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:39:10.550834 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-b1217941-cc8e-4f0a-81a9-23b7d8604851'] May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-547b7e3d-9798-4530-80ca-62a03dc8fd6c tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/os-security-groups/09d0d728-56b2-41ef-97e5-964a3848301c HTTP/1.1 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: exception: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-b1217941-cc8e-4f0a-81a9-23b7d8604851'] May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '09d0d728-56b2-41ef-97e5-964a3848301c'} May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:39:10.552669 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1217941-cc8e-4f0a-81a9-23b7d8604851'] May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1217941-cc8e-4f0a-81a9-23b7d8604851'] May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1217941-cc8e-4f0a-81a9-23b7d8604851'] May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1217941-cc8e-4f0a-81a9-23b7d8604851'] May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-547b7e3d-9798-4530-80ca-62a03dc8fd6c tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group 09d0d728-56b2-41ef-97e5-964a3848301c does not exist May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-b1217941-cc8e-4f0a-81a9-23b7d8604851'] {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-547b7e3d-9798-4530-80ca-62a03dc8fd6c tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/09d0d728-56b2-41ef-97e5-964a3848301c" status: 404 len: 194 microversion: 2.1 time: 0.033412 May 19 04:39:10.558289 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 991/1939] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:10 2022] DELETE /compute/v2.1/os-security-groups/09d0d728-56b2-41ef-97e5-964a3848301c => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:10.566254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0fc1e5fd-2015-4e6a-968d-ebfaeff6e786 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315d299d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:10.576553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:10.588024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:10.595209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:10.596036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG neutronclient.v2_0.client [None req-0fc1e5fd-2015-4e6a-968d-ebfaeff6e786 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist", "detail": ""}} {{(pid=124818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:39:10.596755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.security_group_api [None req-0fc1e5fd-2015-4e6a-968d-ebfaeff6e786 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Neutron security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 not found {{(pid=124818) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:39:10.598882 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-0fc1e5fd-2015-4e6a-968d-ebfaeff6e786 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:39:10.598882 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-f85ccc0f-1a61-47cc-914e-3fa0c8d46a29'] May 19 04:39:10.599486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0fc1e5fd-2015-4e6a-968d-ebfaeff6e786 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 HTTP/1.1 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: exception: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-f85ccc0f-1a61-47cc-914e-3fa0c8d46a29'] May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '1311f251-7c2c-4ecf-b55d-e5261b3ee7a4'} May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:39:10.601690 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f85ccc0f-1a61-47cc-914e-3fa0c8d46a29'] May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f85ccc0f-1a61-47cc-914e-3fa0c8d46a29'] May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f85ccc0f-1a61-47cc-914e-3fa0c8d46a29'] May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f85ccc0f-1a61-47cc-914e-3fa0c8d46a29'] May 19 04:39:10.606859 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:10.617031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0fc1e5fd-2015-4e6a-968d-ebfaeff6e786 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Security group 1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 does not exist May 19 04:39:10.617031 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-f85ccc0f-1a61-47cc-914e-3fa0c8d46a29'] {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:10.618252 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0fc1e5fd-2015-4e6a-968d-ebfaeff6e786 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4" status: 404 len: 194 microversion: 2.1 time: 0.057565 May 19 04:39:10.620361 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 992/1940] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:10 2022] DELETE /compute/v2.1/os-security-groups/1311f251-7c2c-4ecf-b55d-e5261b3ee7a4 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:10.632170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3148943c-559b-48e9-b2bc-15dd7f1f76fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:10.634543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3148943c-559b-48e9-b2bc-15dd7f1f76fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:10.645241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3148943c-559b-48e9-b2bc-15dd7f1f76fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:10.645844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3148943c-559b-48e9-b2bc-15dd7f1f76fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:10.646749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3148943c-559b-48e9-b2bc-15dd7f1f76fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:10.647371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3148943c-559b-48e9-b2bc-15dd7f1f76fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:10.711609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3148943c-559b-48e9-b2bc-15dd7f1f76fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:10.899105 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3148943c-559b-48e9-b2bc-15dd7f1f76fb tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 204 len: 0 microversion: 2.1 time: 0.271368 May 19 04:39:10.900839 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 993/1941] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:10 2022] DELETE /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:10.906817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ae020de6-d8de-45ae-b91d-56eb6cba5dda tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:10.908004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ae020de6-d8de-45ae-b91d-56eb6cba5dda tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:10.924795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae020de6-d8de-45ae-b91d-56eb6cba5dda tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:10.925723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae020de6-d8de-45ae-b91d-56eb6cba5dda tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:10.926847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae020de6-d8de-45ae-b91d-56eb6cba5dda tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:10.931448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae020de6-d8de-45ae-b91d-56eb6cba5dda tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:11.433779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ae020de6-d8de-45ae-b91d-56eb6cba5dda tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:11.458840 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ae020de6-d8de-45ae-b91d-56eb6cba5dda tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.553878 May 19 04:39:11.462861 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 994/1942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:10 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:11.478060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1de3c83a-f42c-4b0c-ad91-e6671841245f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:11.479333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1de3c83a-f42c-4b0c-ad91-e6671841245f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:11.490042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:11.505874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1de3c83a-f42c-4b0c-ad91-e6671841245f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:11.506336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1de3c83a-f42c-4b0c-ad91-e6671841245f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:11.507133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1de3c83a-f42c-4b0c-ad91-e6671841245f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:11.507579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1de3c83a-f42c-4b0c-ad91-e6671841245f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:11.508080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:11.517017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:11.519958 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd6f2f14-f76f-459e-9241-93c6b30a1938 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 1.006124 May 19 04:39:11.520556 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 949/1943] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:10 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:11.540508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:11.541432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c6365b24-b115-45c9-985b-d60b956b759c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:11.558622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:11.563018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:11.564085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:11.565017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:11.583425 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] HTTP exception thrown: Instance c6365b24-b115-45c9-985b-d60b956b759c could not be found. May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Request method failure captured: May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c HTTP/1.1 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclRoW7E27Xam7UhIYUqTz0omQCd52r-1-9bqqfF23c3JDxaoOoqvok9Sn0wLu7UK-BhTck9LqHJWadsecu-YmtpQUu0odDmQdPJDmi4o3qwTfKN4NmpuMtiltNPmTr3i6o3b-a4zhsUDEp6_TShxAuF2mL2R8JOVjMGMgptpEhryBI May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d4796ef3b2154a949d6b966e99055595 May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c6365b24-b115-45c9-985b-d60b956b759c could not be found. May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c6365b24-b115-45c9-985b-d60b956b759c'} May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6365b24-b115-45c9-985b-d60b956b759c could not be found. May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6365b24-b115-45c9-985b-d60b956b759c could not be found. May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:11.585379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:11.591143 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:11.591143 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:11.591143 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:11.591143 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:11.591143 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:11.591143 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6365b24-b115-45c9-985b-d60b956b759c could not be found. May 19 04:39:11.591143 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:11.592562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Returning 404 to user: Instance c6365b24-b115-45c9-985b-d60b956b759c could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:11.593926 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5523676e-890f-4e1f-82d6-e26dcf136ce3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c" status: 404 len: 111 microversion: 2.1 time: 0.070702 May 19 04:39:11.598676 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 950/1944] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:11 2022] GET /compute/v2.1/servers/c6365b24-b115-45c9-985b-d60b956b759c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:11.604638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3d977069-aa3e-4d64-b5d9-c4d67d84adae tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:11.605650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3d977069-aa3e-4d64-b5d9-c4d67d84adae tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:11.627808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d977069-aa3e-4d64-b5d9-c4d67d84adae tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:11.628571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d977069-aa3e-4d64-b5d9-c4d67d84adae tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:11.629588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d977069-aa3e-4d64-b5d9-c4d67d84adae tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:11.634561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d977069-aa3e-4d64-b5d9-c4d67d84adae tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:11.851667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3d977069-aa3e-4d64-b5d9-c4d67d84adae tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:11.863699 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3d977069-aa3e-4d64-b5d9-c4d67d84adae tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1519 microversion: 2.1 time: 0.263571 May 19 04:39:11.874314 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 951/1945] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:11 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1519 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:11.884397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7acb90c8-ec40-4631-af77-7a94c22a7089 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:11.889046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7acb90c8-ec40-4631-af77-7a94c22a7089 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:11.902505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7acb90c8-ec40-4631-af77-7a94c22a7089 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:11.902975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7acb90c8-ec40-4631-af77-7a94c22a7089 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:11.903806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7acb90c8-ec40-4631-af77-7a94c22a7089 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:11.904247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7acb90c8-ec40-4631-af77-7a94c22a7089 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:11.922275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1de3c83a-f42c-4b0c-ad91-e6671841245f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:11.935267 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1de3c83a-f42c-4b0c-ad91-e6671841245f tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1646 microversion: 2.1 time: 0.468929 May 19 04:39:11.948286 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 995/1946] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:11 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1646 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:11.964295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7acb90c8-ec40-4631-af77-7a94c22a7089 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:12.120370 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7acb90c8-ec40-4631-af77-7a94c22a7089 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 204 len: 0 microversion: 2.1 time: 0.244657 May 19 04:39:12.121597 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 952/1947] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:11 2022] DELETE /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:12.132894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-452a4696-d9cf-4d47-819d-95ff5c3b245b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:12.140002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-452a4696-d9cf-4d47-819d-95ff5c3b245b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:12.169845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-452a4696-d9cf-4d47-819d-95ff5c3b245b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:12.170860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-452a4696-d9cf-4d47-819d-95ff5c3b245b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:12.174542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-452a4696-d9cf-4d47-819d-95ff5c3b245b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:12.175377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-452a4696-d9cf-4d47-819d-95ff5c3b245b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:12.479436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3382177d-ce41-49e3-ba4e-c774944a1da9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:12.480390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3382177d-ce41-49e3-ba4e-c774944a1da9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:12.496309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3382177d-ce41-49e3-ba4e-c774944a1da9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:12.504501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3382177d-ce41-49e3-ba4e-c774944a1da9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:12.505631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3382177d-ce41-49e3-ba4e-c774944a1da9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:12.508766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3382177d-ce41-49e3-ba4e-c774944a1da9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:12.858779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-452a4696-d9cf-4d47-819d-95ff5c3b245b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:12.876456 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-452a4696-d9cf-4d47-819d-95ff5c3b245b tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1473 microversion: 2.1 time: 0.750192 May 19 04:39:12.878238 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 996/1948] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:12 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1473 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:12.888013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:12.889134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:12.896559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:12.897329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:12.898450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:12.899318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:13.168654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3382177d-ce41-49e3-ba4e-c774944a1da9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:13.183433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3382177d-ce41-49e3-ba4e-c774944a1da9 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.709425 May 19 04:39:13.184658 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 953/1949] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:12 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:39:13.200758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d80817e4-a86c-4c0a-9af4-e56a2bcedf2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:13.218659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d80817e4-a86c-4c0a-9af4-e56a2bcedf2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:13.231735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d80817e4-a86c-4c0a-9af4-e56a2bcedf2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:13.237881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d80817e4-a86c-4c0a-9af4-e56a2bcedf2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:13.238994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d80817e4-a86c-4c0a-9af4-e56a2bcedf2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:13.239452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d80817e4-a86c-4c0a-9af4-e56a2bcedf2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:13.869028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:13.880331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:13.887075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:13.892480 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0eec4485-5f64-4273-9c09-c9a8d15a4b54 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 1.012743 May 19 04:39:13.893621 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 997/1950] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:12 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:13.908651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e1635933-9891-4b93-a59e-9b1131a95a94 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:13.909587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e1635933-9891-4b93-a59e-9b1131a95a94 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:13.922576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1635933-9891-4b93-a59e-9b1131a95a94 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:13.927512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1635933-9891-4b93-a59e-9b1131a95a94 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:13.928580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1635933-9891-4b93-a59e-9b1131a95a94 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:13.929225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1635933-9891-4b93-a59e-9b1131a95a94 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:14.164034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d80817e4-a86c-4c0a-9af4-e56a2bcedf2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:14.174161 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d80817e4-a86c-4c0a-9af4-e56a2bcedf2e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1519 microversion: 2.1 time: 0.987836 May 19 04:39:14.175067 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 954/1951] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:13 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1519 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:14.180522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-da53951b-672f-4538-8bec-37111d7a679f req-8620c4d1-75d0-47ab-8641-8646f2992486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2487ebd4-e36c-404c-9c5f-76aa7a3bf41b", "name": "network-vif-plugged", "status": "completed", "tag": "c03ba391-adc5-4ec1-8242-3aa5aca306ce"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:14.192012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-da53951b-672f-4538-8bec-37111d7a679f req-8620c4d1-75d0-47ab-8641-8646f2992486 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:14.192697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-da53951b-672f-4538-8bec-37111d7a679f req-8620c4d1-75d0-47ab-8641-8646f2992486 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:14.207448 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-da53951b-672f-4538-8bec-37111d7a679f req-8620c4d1-75d0-47ab-8641-8646f2992486 service nova] Creating event network-vif-plugged:c03ba391-adc5-4ec1-8242-3aa5aca306ce for instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b on n-h1-766726-30 May 19 04:39:14.214208 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-da53951b-672f-4538-8bec-37111d7a679f req-8620c4d1-75d0-47ab-8641-8646f2992486 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037603 May 19 04:39:14.215677 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 955/1952] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:14.224179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-304320637", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "fc08017c-f259-4573-8a62-956e4b0d86cd"}, {"port": "712746b0-d242-41be-a8d0-753db84e4e8f", "tag": "port-1"}, {"port": "b5c9ee41-8f79-451c-8e52-3f34832d4eb8", "tag": "port-2"}, {"uuid": "3e06e774-98be-41d5-a41d-8af13c23acc2", "tag": "net-1"}, {"uuid": "3e06e774-98be-41d5-a41d-8af13c23acc2"}, {"uuid": "085105ae-fdae-4746-93e3-cbbd10c6e877", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "085105ae-fdae-4746-93e3-cbbd10c6e877", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0a541386-79f0-4c18-8c23-1dee60171d2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "98cc5d41-13b1-4f12-aa6c-96b610b03892", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c602c926-bb86-4a81-ac23-2f17d6e3c118", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1670670671"}], "key_name": "tempest-keypair-1346713678", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:14.571105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e1635933-9891-4b93-a59e-9b1131a95a94 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80fcb65cf5734252970667c2ad2a8e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645df4342899445a910f1e00063507b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:14.608797 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e1635933-9891-4b93-a59e-9b1131a95a94 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 200 len: 1646 microversion: 2.1 time: 0.711519 May 19 04:39:14.615175 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 998/1953] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:13 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 1646 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:14.630369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed2b0f8a-4b42-456c-92c9-10563a8cede3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:14.631326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ed2b0f8a-4b42-456c-92c9-10563a8cede3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:14.657013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed2b0f8a-4b42-456c-92c9-10563a8cede3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:14.662125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] validate_networks() for [('fc08017c-f259-4573-8a62-956e4b0d86cd', None, None, None, None, None), (None, None, '712746b0-d242-41be-a8d0-753db84e4e8f', None, None, None), (None, None, 'b5c9ee41-8f79-451c-8e52-3f34832d4eb8', None, None, None), ('3e06e774-98be-41d5-a41d-8af13c23acc2', None, None, None, None, None), ('3e06e774-98be-41d5-a41d-8af13c23acc2', None, None, None, None, None), ('085105ae-fdae-4746-93e3-cbbd10c6e877', '10.2.2.100', None, None, None, None), ('085105ae-fdae-4746-93e3-cbbd10c6e877', '10.2.2.200', None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:39:14.663411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed2b0f8a-4b42-456c-92c9-10563a8cede3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:14.664257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed2b0f8a-4b42-456c-92c9-10563a8cede3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:14.664706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed2b0f8a-4b42-456c-92c9-10563a8cede3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:15.112666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ed2b0f8a-4b42-456c-92c9-10563a8cede3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:15.128629 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ed2b0f8a-4b42-456c-92c9-10563a8cede3 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 200 len: 1473 microversion: 2.1 time: 0.510870 May 19 04:39:15.142082 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 999/1954] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:14 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 1473 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:15.142082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ebbd869a-2f59-4f03-aa02-c5671cec3b15 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:15.144796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ebbd869a-2f59-4f03-aa02-c5671cec3b15 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:15.159035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebbd869a-2f59-4f03-aa02-c5671cec3b15 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:15.161602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebbd869a-2f59-4f03-aa02-c5671cec3b15 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:15.162408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebbd869a-2f59-4f03-aa02-c5671cec3b15 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:15.164261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebbd869a-2f59-4f03-aa02-c5671cec3b15 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:15.678434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ebbd869a-2f59-4f03-aa02-c5671cec3b15 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:15.691149 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ebbd869a-2f59-4f03-aa02-c5671cec3b15 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.553233 May 19 04:39:15.691792 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1000/1955] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:15 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:15.705002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:15.705654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:15.718745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:15.719189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:15.719962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:15.720446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:16.545981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:16.558585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:16.560374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:16.562169 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0aca9052-4ca0-490c-861d-334f168523c4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.868220 May 19 04:39:16.563955 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1001/1956] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:15 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:16.577878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b5fe0561-d96f-4bf4-a059-ebb5b8c79820 req-eb1fa540-23a8-4fa7-a0b5-3686457d2bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37301659-d7ed-41fe-be72-46f2e9185650", "name": "network-vif-deleted", "tag": "33fd5ca9-39f1-4823-9bb9-fd2d27226a63"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:16.594321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b5fe0561-d96f-4bf4-a059-ebb5b8c79820 req-eb1fa540-23a8-4fa7-a0b5-3686457d2bf4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:16.598259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b5fe0561-d96f-4bf4-a059-ebb5b8c79820 req-eb1fa540-23a8-4fa7-a0b5-3686457d2bf4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:16.628842 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b5fe0561-d96f-4bf4-a059-ebb5b8c79820 req-eb1fa540-23a8-4fa7-a0b5-3686457d2bf4 service nova] Creating event network-vif-deleted:33fd5ca9-39f1-4823-9bb9-fd2d27226a63 for instance 37301659-d7ed-41fe-be72-46f2e9185650 on n-h1-766726-30 May 19 04:39:16.640953 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b5fe0561-d96f-4bf4-a059-ebb5b8c79820 req-eb1fa540-23a8-4fa7-a0b5-3686457d2bf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075192 May 19 04:39:16.644447 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1002/1957] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:16.656713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1bec0e6f-6dd9-499f-99cc-2f8fdbb99938 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:16.661254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1bec0e6f-6dd9-499f-99cc-2f8fdbb99938 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:16.691265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bec0e6f-6dd9-499f-99cc-2f8fdbb99938 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:16.694794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bec0e6f-6dd9-499f-99cc-2f8fdbb99938 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:16.695843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bec0e6f-6dd9-499f-99cc-2f8fdbb99938 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:16.697933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bec0e6f-6dd9-499f-99cc-2f8fdbb99938 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:16.739848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:17.611226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1bec0e6f-6dd9-499f-99cc-2f8fdbb99938 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:17.622770 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1bec0e6f-6dd9-499f-99cc-2f8fdbb99938 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1504 microversion: 2.1 time: 0.975827 May 19 04:39:17.628160 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1003/1958] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:16 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1504 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:17.640807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:17.648984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] [instance: 37301659-d7ed-41fe-be72-46f2e9185650] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:17.668928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:17.669627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:17.670611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:17.672175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:17.711972 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] HTTP exception thrown: Instance 37301659-d7ed-41fe-be72-46f2e9185650 could not be found. May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Request method failure captured: May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 HTTP/1.1 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmqaJvJuFyRBQjFb9DT9IEuQELlL2Sh94FRNgJp09Ic3RdvojgPlVmha8F05iwxwi0zHC1vKQd9XAV5osuGe0wNb43-wnE5_I7SAuyW2c6bCRwtUfsTRoiKyBvwAJD7IPv6zEbuar2JHcQVW3bAUvAmVmiCeeNd7kV4JNR0mhKkVUA May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/645df4342899445a910f1e00063507b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/645df4342899445a910f1e00063507b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_645df4342899445a910f1e00063507b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 645df4342899445a910f1e00063507b4 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-371793670 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 80fcb65cf5734252970667c2ad2a8e86 May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupsTestJSON-371793670-project May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 37301659-d7ed-41fe-be72-46f2e9185650 could not be found. May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '37301659-d7ed-41fe-be72-46f2e9185650'} May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37301659-d7ed-41fe-be72-46f2e9185650 could not be found. May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37301659-d7ed-41fe-be72-46f2e9185650 could not be found. May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:17.715709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.724714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:17.724714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:17.724714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:17.724714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:17.724714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:17.724714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37301659-d7ed-41fe-be72-46f2e9185650 could not be found. May 19 04:39:17.724714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.733787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Returning 404 to user: Instance 37301659-d7ed-41fe-be72-46f2e9185650 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:17.734975 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-649cb9fa-7d46-4630-8fd6-1be465100129 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650" status: 404 len: 111 microversion: 2.1 time: 0.105640 May 19 04:39:17.736221 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1004/1959] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:17 2022] GET /compute/v2.1/servers/37301659-d7ed-41fe-be72-46f2e9185650 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:17.741595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:17.746547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: ba26ee82-2a56-4414-8118-534237609704] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:17.766759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:17.767622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:17.768665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:17.769322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:17.794158 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] HTTP exception thrown: Instance ba26ee82-2a56-4414-8118-534237609704 could not be found. May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Request method failure captured: May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 HTTP/1.1 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihclRoW7E27Xam7UhIYUqTz0omQCd52r-1-9bqqfF23c3JDxaoOoqvok9Sn0wLu7UK-BhTck9LqHJWadsecu-YmtpQUu0odDmQdPJDmi4o3qwTfKN4NmpuMtiltNPmTr3i6o3b-a4zhsUDEp6_TShxAuF2mL2R8JOVjMGMgptpEhryBI May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d4796ef3b2154a949d6b966e99055595 May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance ba26ee82-2a56-4414-8118-534237609704 could not be found. May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'ba26ee82-2a56-4414-8118-534237609704'} May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba26ee82-2a56-4414-8118-534237609704 could not be found. May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba26ee82-2a56-4414-8118-534237609704 could not be found. May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:17.808701 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.814168 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:17.814168 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:17.814168 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:17.814168 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:17.814168 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:17.814168 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba26ee82-2a56-4414-8118-534237609704 could not be found. May 19 04:39:17.814168 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:17.815386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Returning 404 to user: Instance ba26ee82-2a56-4414-8118-534237609704 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:17.816413 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fa3fdf62-6da6-4add-8863-218f2e680804 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704" status: 404 len: 111 microversion: 2.1 time: 0.079094 May 19 04:39:17.820960 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1005/1960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:17 2022] GET /compute/v2.1/servers/ba26ee82-2a56-4414-8118-534237609704 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:17.825859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0945c23e-b9b5-43e3-a804-87fc4bfaf7f6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:17.829818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0945c23e-b9b5-43e3-a804-87fc4bfaf7f6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:17.846986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0945c23e-b9b5-43e3-a804-87fc4bfaf7f6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:17.848155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0945c23e-b9b5-43e3-a804-87fc4bfaf7f6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:17.849161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0945c23e-b9b5-43e3-a804-87fc4bfaf7f6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:17.849769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0945c23e-b9b5-43e3-a804-87fc4bfaf7f6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:18.096836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0945c23e-b9b5-43e3-a804-87fc4bfaf7f6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:18.108521 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0945c23e-b9b5-43e3-a804-87fc4bfaf7f6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.286226 May 19 04:39:18.113297 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1006/1961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:17 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:18.120381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:18.122259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:18.128689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:18.130562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:18.131191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:18.132275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:18.132901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:19.225595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:19.247679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:19.251239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:19.252881 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99eb5203-9847-47b2-9c75-12f8217ea2a4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 1.137427 May 19 04:39:19.266535 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1007/1962] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:18 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:19.312668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-864f0796-9416-4dff-aba0-ae4bda3fdd4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:19.313803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-864f0796-9416-4dff-aba0-ae4bda3fdd4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:19.323208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-864f0796-9416-4dff-aba0-ae4bda3fdd4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:19.324694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-864f0796-9416-4dff-aba0-ae4bda3fdd4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:19.325885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-864f0796-9416-4dff-aba0-ae4bda3fdd4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:19.329450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-864f0796-9416-4dff-aba0-ae4bda3fdd4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:19.704363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-864f0796-9416-4dff-aba0-ae4bda3fdd4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:19.743664 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-864f0796-9416-4dff-aba0-ae4bda3fdd4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 200 len: 1504 microversion: 2.1 time: 0.473878 May 19 04:39:19.758140 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1008/1963] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:19 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 1504 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:19.769002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c4709e3-4f4a-449c-8cfb-14b8857ddb36 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315d29dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:19.968583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:20.074295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:39:20.074982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:39:20.075652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:39:20.076434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:39:20.077034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:39:20.100366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:20.102953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:20.106276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:20.107460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:20.131879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Getting quotas for project ce47f533f04d498c872d7eebd936dd7a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:39:20.142193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Getting quotas for user c8bd8feb841f4876a7f1519525cf3fb4 and project ce47f533f04d498c872d7eebd936dd7a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:39:20.242508 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c4709e3-4f4a-449c-8cfb-14b8857ddb36 tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/7c29773f-631f-4841-a6b8-f0ed84772f3a" status: 202 len: 0 microversion: 2.1 time: 0.479165 May 19 04:39:20.244517 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1009/1964] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:19 2022] DELETE /compute/v2.1/os-security-groups/7c29773f-631f-4841-a6b8-f0ed84772f3a => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:39:20.250980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2714651-4f3a-42cb-9a2b-0d92d1362d5f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:20.251789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2714651-4f3a-42cb-9a2b-0d92d1362d5f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 1e88a27f-1e50-491f-930a-9f759aad67f1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:20.271371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2714651-4f3a-42cb-9a2b-0d92d1362d5f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:20.272377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2714651-4f3a-42cb-9a2b-0d92d1362d5f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:20.275522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2714651-4f3a-42cb-9a2b-0d92d1362d5f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:20.275990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2714651-4f3a-42cb-9a2b-0d92d1362d5f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:20.337178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2714651-4f3a-42cb-9a2b-0d92d1362d5f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 1e88a27f-1e50-491f-930a-9f759aad67f1] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:20.419812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:39:20.423499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0a541386-79f0-4c18-8c23-1dee60171d2d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='98cc5d41-13b1-4f12-aa6c-96b610b03892',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c602c926-bb86-4a81-ac23-2f17d6e3c118',volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:39:20.465306 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2714651-4f3a-42cb-9a2b-0d92d1362d5f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1" status: 204 len: 0 microversion: 2.1 time: 0.218969 May 19 04:39:20.465864 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1010/1965] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:20 2022] DELETE /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:20.471993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-32323eef-bb35-4ee3-a918-08cfee04c5de req-bec5b4e7-d0ec-4b6e-b038-553bbc594ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba26ee82-2a56-4414-8118-534237609704", "name": "network-vif-deleted", "tag": "b8b1f96b-e595-45c8-a997-3182bd8f7367"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:20.483517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-32323eef-bb35-4ee3-a918-08cfee04c5de req-bec5b4e7-d0ec-4b6e-b038-553bbc594ca9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:20.483966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-32323eef-bb35-4ee3-a918-08cfee04c5de req-bec5b4e7-d0ec-4b6e-b038-553bbc594ca9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:20.502911 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-32323eef-bb35-4ee3-a918-08cfee04c5de req-bec5b4e7-d0ec-4b6e-b038-553bbc594ca9 service nova] Creating event network-vif-deleted:b8b1f96b-e595-45c8-a997-3182bd8f7367 for instance ba26ee82-2a56-4414-8118-534237609704 on n-h2-766726-30 May 19 04:39:20.509739 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-32323eef-bb35-4ee3-a918-08cfee04c5de req-bec5b4e7-d0ec-4b6e-b038-553bbc594ca9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042247 May 19 04:39:20.515508 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1011/1966] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:20.524965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f990eb95-2bd6-4e1b-9c93-82a7051b1b9a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:20.526115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f990eb95-2bd6-4e1b-9c93-82a7051b1b9a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:20.534211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f990eb95-2bd6-4e1b-9c93-82a7051b1b9a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:20.534723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f990eb95-2bd6-4e1b-9c93-82a7051b1b9a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:20.535503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f990eb95-2bd6-4e1b-9c93-82a7051b1b9a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:20.535995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f990eb95-2bd6-4e1b-9c93-82a7051b1b9a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:20.818854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f990eb95-2bd6-4e1b-9c93-82a7051b1b9a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:20.831361 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f990eb95-2bd6-4e1b-9c93-82a7051b1b9a tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.310047 May 19 04:39:20.844742 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1012/1967] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:20 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:20.851057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-59d0b969-77b7-429c-84a1-60bcb2dca000 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:20.855252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-59d0b969-77b7-429c-84a1-60bcb2dca000 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:20.867883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59d0b969-77b7-429c-84a1-60bcb2dca000 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:20.873659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59d0b969-77b7-429c-84a1-60bcb2dca000 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:20.874898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59d0b969-77b7-429c-84a1-60bcb2dca000 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:20.875424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59d0b969-77b7-429c-84a1-60bcb2dca000 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:20.902187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:20.935340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-59d0b969-77b7-429c-84a1-60bcb2dca000 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:20.968599 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af1e8faf-6324-4710-a745-9a2a9f668984 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 6.751123 May 19 04:39:20.975071 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 956/1968] 10.222.0.58 () {62 vars in 1188 bytes} [Thu May 19 04:39:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 6759 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:39:20.987026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-47e737dc-a9b3-43b0-89d3-9a94138c98b2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:20.991287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-47e737dc-a9b3-43b0-89d3-9a94138c98b2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:21.007548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-47e737dc-a9b3-43b0-89d3-9a94138c98b2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:21.017390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-47e737dc-a9b3-43b0-89d3-9a94138c98b2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:21.018868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-47e737dc-a9b3-43b0-89d3-9a94138c98b2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:21.019480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-47e737dc-a9b3-43b0-89d3-9a94138c98b2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:21.068412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-47e737dc-a9b3-43b0-89d3-9a94138c98b2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:21.100004 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-59d0b969-77b7-429c-84a1-60bcb2dca000 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 204 len: 0 microversion: 2.1 time: 0.252910 May 19 04:39:21.102753 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1013/1969] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:20 2022] DELETE /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:21.120651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35d2d5d7-e188-410e-b6a5-4537776f1eee tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] Calling method '.version_select at 0x7fd315665af0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:21.224533 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-47e737dc-a9b3-43b0-89d3-9a94138c98b2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 204 len: 0 microversion: 2.25 time: 0.247583 May 19 04:39:21.225253 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 957/1970] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:39:20 2022] DELETE /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:39:21.231425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:21.232287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:21.238968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:21.239756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:21.240753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:21.241401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:21.622415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:21.633425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:21.638423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:21.644290 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7e8a9bc-f270-47a8-8465-255dac400d61 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.417511 May 19 04:39:21.645162 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 958/1971] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:21 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:21.650080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1eeb138c-8676-4e99-b34a-d51a4611d658 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:21.650582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1eeb138c-8676-4e99-b34a-d51a4611d658 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:21.664069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1eeb138c-8676-4e99-b34a-d51a4611d658 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:21.670688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1eeb138c-8676-4e99-b34a-d51a4611d658 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:21.671920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1eeb138c-8676-4e99-b34a-d51a4611d658 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:21.674703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1eeb138c-8676-4e99-b34a-d51a4611d658 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:21.702808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1eeb138c-8676-4e99-b34a-d51a4611d658 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:21.707934 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-35d2d5d7-e188-410e-b6a5-4537776f1eee tempest-SecurityGroupsTestJSON-371793670 tempest-SecurityGroupsTestJSON-371793670-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/cd1cdace-54e8-4308-a5dc-617d1e0a02ad" status: 202 len: 0 microversion: 2.1 time: 0.602749 May 19 04:39:21.709394 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1014/1972] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:39:21 2022] DELETE /compute/v2.1/os-security-groups/cd1cdace-54e8-4308-a5dc-617d1e0a02ad => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:39:21.716659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ab55c29e-56ff-4481-8a0b-cfc4d186c46f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:21.717628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ab55c29e-56ff-4481-8a0b-cfc4d186c46f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:21.833959 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1eeb138c-8676-4e99-b34a-d51a4611d658 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 204 len: 0 microversion: 2.1 time: 0.187264 May 19 04:39:21.838377 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 959/1973] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:21 2022] DELETE /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:21.852203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab55c29e-56ff-4481-8a0b-cfc4d186c46f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:21.871444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1194881943", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "725f31b8-0e87-4064-94dc-266df6d4a8df"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:21.876644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab55c29e-56ff-4481-8a0b-cfc4d186c46f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:21.881766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab55c29e-56ff-4481-8a0b-cfc4d186c46f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:21.885906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ab55c29e-56ff-4481-8a0b-cfc4d186c46f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1285 microversion: 2.42 time: 0.172435 May 19 04:39:21.886669 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1015/1974] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:21 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:21.898955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:21.899956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:21.908374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:21.908831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:21.909792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:21.910336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:21.959980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] validate_networks() for [('725f31b8-0e87-4064-94dc-266df6d4a8df', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:39:22.230865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:22.239581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:22.241106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:22.242290 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c500c48-8905-4a4e-a484-1ae32535a2ea tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1565 microversion: 2.25 time: 0.354873 May 19 04:39:22.243968 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1016/1975] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:21 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1565 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:22.250182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9210a918-e0a4-478b-8898-24c14659a16e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:22.251101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9210a918-e0a4-478b-8898-24c14659a16e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 1e88a27f-1e50-491f-930a-9f759aad67f1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:22.257834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9210a918-e0a4-478b-8898-24c14659a16e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.258300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9210a918-e0a4-478b-8898-24c14659a16e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:22.260723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9210a918-e0a4-478b-8898-24c14659a16e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.261511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9210a918-e0a4-478b-8898-24c14659a16e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:22.505019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9210a918-e0a4-478b-8898-24c14659a16e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:22.516441 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9210a918-e0a4-478b-8898-24c14659a16e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1" status: 200 len: 1475 microversion: 2.1 time: 0.271291 May 19 04:39:22.526814 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1017/1976] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:22 2022] GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1 => generated 1475 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:22.532330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-584f0f80-bd94-4c9f-bc5e-698d87cd2338 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:22.533063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-584f0f80-bd94-4c9f-bc5e-698d87cd2338 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:22.541026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-584f0f80-bd94-4c9f-bc5e-698d87cd2338 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.541652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-584f0f80-bd94-4c9f-bc5e-698d87cd2338 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:22.542586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-584f0f80-bd94-4c9f-bc5e-698d87cd2338 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.543141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-584f0f80-bd94-4c9f-bc5e-698d87cd2338 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:22.739921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-584f0f80-bd94-4c9f-bc5e-698d87cd2338 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:22.748425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:39:22.749373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:39:22.750020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:39:22.750567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:39:22.751200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:39:22.752672 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-584f0f80-bd94-4c9f-bc5e-698d87cd2338 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 0.224464 May 19 04:39:22.753305 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1018/1977] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:22 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:22.758243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:22.759244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:22.766596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.767509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:22.768036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.768490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:22.769737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.770354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:22.776500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.777220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:22.801142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Getting quotas for project 68c54dd93b5d484cb22316eb239828d4. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:39:22.806930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Getting quotas for user 366806f44fa34ba8a7ad0a2e84f314eb and project 68c54dd93b5d484cb22316eb239828d4. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:39:22.819780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:39:22.822507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:39:22.911210 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e8cf513f-cee5-4f3c-afc0-f9ffb9ed2868 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070658 May 19 04:39:22.914984 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 960/1978] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:39:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:39:22.929808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:22.930952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:22.946512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.947324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:22.948378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:22.951190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:23.221818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:23.239046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:23.246093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:23.250837 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d3e1df34-b2ab-4339-be6c-bbdabc827516 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1527 microversion: 2.42 time: 0.331832 May 19 04:39:23.265030 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 961/1979] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:22 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1527 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:23.277282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5f701e61-adab-49c3-b2c9-abf5ce707f98 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:23.278110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5f701e61-adab-49c3-b2c9-abf5ce707f98 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:23.523325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5f701e61-adab-49c3-b2c9-abf5ce707f98 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:23.532576 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5f701e61-adab-49c3-b2c9-abf5ce707f98 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1218 microversion: 2.1 time: 0.266321 May 19 04:39:23.535780 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 962/1980] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:23 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:23.552869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:23.557024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:23.575363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:23.576752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:23.578978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:23.579648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:23.616111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:23.633495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:23.633863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:23.639603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:23.641144 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b059817-c3c3-42c7-9958-5e68aaa36578 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1885 microversion: 2.32 time: 0.886663 May 19 04:39:23.656955 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1019/1981] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:22 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1885 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:23.662610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4517df16-fe9c-4157-afdb-460454af4e9d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:23.663512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4517df16-fe9c-4157-afdb-460454af4e9d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 1e88a27f-1e50-491f-930a-9f759aad67f1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:23.671704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4517df16-fe9c-4157-afdb-460454af4e9d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:23.672651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4517df16-fe9c-4157-afdb-460454af4e9d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:23.673635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4517df16-fe9c-4157-afdb-460454af4e9d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:23.674446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4517df16-fe9c-4157-afdb-460454af4e9d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:24.696818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4517df16-fe9c-4157-afdb-460454af4e9d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:24.753473 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4517df16-fe9c-4157-afdb-460454af4e9d tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1" status: 200 len: 1475 microversion: 2.1 time: 1.094850 May 19 04:39:24.757956 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1020/1982] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:23 2022] GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1 => generated 1475 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:24.786909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-035cd019-7485-43cf-823d-c7adeb064f11 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:24.788299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-035cd019-7485-43cf-823d-c7adeb064f11 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:24.824190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-035cd019-7485-43cf-823d-c7adeb064f11 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:24.833918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-035cd019-7485-43cf-823d-c7adeb064f11 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:24.835222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-035cd019-7485-43cf-823d-c7adeb064f11 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:24.843042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-035cd019-7485-43cf-823d-c7adeb064f11 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:24.907685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:24.922126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:24.923672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:24.924923 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d63561d3-2e1a-4e9f-b570-615adf9aaafd tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1565 microversion: 2.25 time: 1.386181 May 19 04:39:24.937824 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 963/1983] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:23 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1565 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:24.951140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:24.952117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:24.995747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:24.997647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:24.999054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:25.000675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:25.454568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:25.491208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:25.500359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:25.506661 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-76ed6d30-98d3-4657-8678-a61183da1b46 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1593 microversion: 2.42 time: 0.565388 May 19 04:39:25.509921 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 964/1984] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:24 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1593 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:25.535359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74eec3d2-1660-4e14-9b56-a0ae19982542 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:25.543094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74eec3d2-1660-4e14-9b56-a0ae19982542 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:25.572361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74eec3d2-1660-4e14-9b56-a0ae19982542 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:25.574166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74eec3d2-1660-4e14-9b56-a0ae19982542 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:25.575812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74eec3d2-1660-4e14-9b56-a0ae19982542 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:25.577523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74eec3d2-1660-4e14-9b56-a0ae19982542 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.042325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74eec3d2-1660-4e14-9b56-a0ae19982542 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:26.058019 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74eec3d2-1660-4e14-9b56-a0ae19982542 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1276 microversion: 2.1 time: 0.534559 May 19 04:39:26.060888 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 965/1985] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:25 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1276 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:26.068584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:26.072832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:26.126745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.128667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.131978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.134375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.437282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-035cd019-7485-43cf-823d-c7adeb064f11 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:26.450512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:26.453990 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-035cd019-7485-43cf-823d-c7adeb064f11 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1390 microversion: 2.1 time: 1.693985 May 19 04:39:26.467693 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1021/1986] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:24 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1390 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:26.483248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a48b69fe-bf4e-490e-b349-24a32ef6bc07 req-134a4302-813f-4433-9969-47be81d65042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2487ebd4-e36c-404c-9c5f-76aa7a3bf41b", "name": "network-vif-deleted", "tag": "c03ba391-adc5-4ec1-8242-3aa5aca306ce"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:26.504554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a48b69fe-bf4e-490e-b349-24a32ef6bc07 req-134a4302-813f-4433-9969-47be81d65042 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.505484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a48b69fe-bf4e-490e-b349-24a32ef6bc07 req-134a4302-813f-4433-9969-47be81d65042 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.527859 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a48b69fe-bf4e-490e-b349-24a32ef6bc07 req-134a4302-813f-4433-9969-47be81d65042 service nova] Creating event network-vif-deleted:c03ba391-adc5-4ec1-8242-3aa5aca306ce for instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b on n-h1-766726-30 May 19 04:39:26.538135 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a48b69fe-bf4e-490e-b349-24a32ef6bc07 req-134a4302-813f-4433-9969-47be81d65042 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067998 May 19 04:39:26.539150 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1022/1987] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:26.547864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:26.548960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 1e88a27f-1e50-491f-930a-9f759aad67f1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:26.558724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.559711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.560726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.561414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.608303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.609156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.609821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lazy-loading 'fault' on Instance uuid 1e88a27f-1e50-491f-930a-9f759aad67f1 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:39:26.787667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:26.793461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:26.803089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:26.807519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:26.807867 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2e12f266-5a8a-4ad3-a401-116ca35e6eee tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1" status: 200 len: 1309 microversion: 2.1 time: 0.266437 May 19 04:39:26.808541 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1023/1988] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:26 2022] GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1 => generated 1309 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:26.822576 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-739d68cb-f6bc-401c-90d3-d57442a25473 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.760404 May 19 04:39:26.824070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:26.824970 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 966/1989] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:26 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:26.827398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:26.832612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-26d4aac6-3fa4-4f10-9037-42b6f81da26c tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:26.841888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.842449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.845481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-26d4aac6-3fa4-4f10-9037-42b6f81da26c tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:26.845969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.846436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.847335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-26d4aac6-3fa4-4f10-9037-42b6f81da26c tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Searching by: {'deleted': False, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:39:26.859765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26d4aac6-3fa4-4f10-9037-42b6f81da26c tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.865486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26d4aac6-3fa4-4f10-9037-42b6f81da26c tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.866829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26d4aac6-3fa4-4f10-9037-42b6f81da26c tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.874622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26d4aac6-3fa4-4f10-9037-42b6f81da26c tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.919731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:26.920045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:26.920924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lazy-loading 'fault' on Instance uuid 4bc44755-e968-4e75-a8ce-76d6ab964726 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:39:26.935952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-26d4aac6-3fa4-4f10-9037-42b6f81da26c tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:39:27.007585 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-26d4aac6-3fa4-4f10-9037-42b6f81da26c tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.178734 May 19 04:39:27.008891 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 967/1990] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:39:26 2022] GET /compute/v2.1/servers => generated 339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:27.023111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-fae1c823-2bf5-4af7-bd33-3b891e4d3263 req-ce4e304e-5f56-41d8-a034-4740b9ec4b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc44755-e968-4e75-a8ce-76d6ab964726", "name": "network-vif-deleted", "tag": "5bac3271-c20e-44db-a594-acca0467ed52"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:27.043089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fae1c823-2bf5-4af7-bd33-3b891e4d3263 req-ce4e304e-5f56-41d8-a034-4740b9ec4b8e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.044433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fae1c823-2bf5-4af7-bd33-3b891e4d3263 req-ce4e304e-5f56-41d8-a034-4740b9ec4b8e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.073684 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-fae1c823-2bf5-4af7-bd33-3b891e4d3263 req-ce4e304e-5f56-41d8-a034-4740b9ec4b8e service nova] Creating event network-vif-deleted:5bac3271-c20e-44db-a594-acca0467ed52 for instance 4bc44755-e968-4e75-a8ce-76d6ab964726 on n-h2-766726-30 May 19 04:39:27.083904 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-fae1c823-2bf5-4af7-bd33-3b891e4d3263 req-ce4e304e-5f56-41d8-a034-4740b9ec4b8e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070784 May 19 04:39:27.084043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.086610 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 968/1991] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:27.099504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.100273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:27.101069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:27.103879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.116531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.119486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.120616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.128510 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6732dc54-8072-405b-ba90-1412a0493fa0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 200 len: 1352 microversion: 2.25 time: 0.295573 May 19 04:39:27.129038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.129977 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1024/1992] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:26 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 1352 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:27.153045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:27.162931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.170254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Searching by: {'deleted': False, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:39:27.185645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.188112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.190944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.195336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.297063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.326633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.333463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.340396 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ccbbbf33-8400-4bca-bf26-b275dfd06d39 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1593 microversion: 2.42 time: 0.251106 May 19 04:39:27.354347 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 969/1993] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:27 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1593 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:27.368962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-18158f95-83b1-45f3-b5a4-393481188661 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:27.370098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-18158f95-83b1-45f3-b5a4-393481188661 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:27.389279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18158f95-83b1-45f3-b5a4-393481188661 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.390315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18158f95-83b1-45f3-b5a4-393481188661 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.391418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18158f95-83b1-45f3-b5a4-393481188661 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.392114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18158f95-83b1-45f3-b5a4-393481188661 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.400842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:39:27.517484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.526357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-18158f95-83b1-45f3-b5a4-393481188661 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.538468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.539076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.541240 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-18158f95-83b1-45f3-b5a4-393481188661 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1276 microversion: 2.1 time: 0.175097 May 19 04:39:27.542894 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 970/1994] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:27 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:27.549000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0f43a5dc-35a8-444f-8ac4-4649fe668881 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:27.550213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0f43a5dc-35a8-444f-8ac4-4649fe668881 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:27.570900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f43a5dc-35a8-444f-8ac4-4649fe668881 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.572459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f43a5dc-35a8-444f-8ac4-4649fe668881 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.573639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f43a5dc-35a8-444f-8ac4-4649fe668881 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.574200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f43a5dc-35a8-444f-8ac4-4649fe668881 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.882687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0f43a5dc-35a8-444f-8ac4-4649fe668881 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:27.894824 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0f43a5dc-35a8-444f-8ac4-4649fe668881 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1380 microversion: 2.1 time: 0.348411 May 19 04:39:27.896743 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 971/1995] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:27 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1380 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:27.909614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:27.910213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: 1e88a27f-1e50-491f-930a-9f759aad67f1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:27.929528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.930020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.932149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.932595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.956680 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] HTTP exception thrown: Instance 1e88a27f-1e50-491f-930a-9f759aad67f1 could not be found. May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Request method failure captured: May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1 HTTP/1.1 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclRoW7E27Xam7UhIYUqTz0omQCd52r-1-9bqqfF23c3JDxaoOoqvok9Sn0wLu7UK-BhTck9LqHJWadsecu-YmtpQUu0odDmQdPJDmi4o3qwTfKN4NmpuMtiltNPmTr3i6o3b-a4zhsUDEp6_TShxAuF2mL2R8JOVjMGMgptpEhryBI May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d4796ef3b2154a949d6b966e99055595 May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 1e88a27f-1e50-491f-930a-9f759aad67f1 could not be found. May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '1e88a27f-1e50-491f-930a-9f759aad67f1'} May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e88a27f-1e50-491f-930a-9f759aad67f1 could not be found. May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e88a27f-1e50-491f-930a-9f759aad67f1 could not be found. May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:27.959161 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:27.965602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:27.965602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:27.965602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:27.965602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:27.965602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:27.965602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e88a27f-1e50-491f-930a-9f759aad67f1 could not be found. May 19 04:39:27.965602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:27.966239 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aaee04f6-8cdf-44ac-99db-e8ee34529c0e tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.825046 May 19 04:39:27.968478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Returning 404 to user: Instance 1e88a27f-1e50-491f-930a-9f759aad67f1 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:27.969740 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97c1d48d-32b0-4d5b-a911-c682cba015f8 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1" status: 404 len: 111 microversion: 2.1 time: 0.071798 May 19 04:39:27.970866 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 972/1996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:27 2022] GET /compute/v2.1/servers/1e88a27f-1e50-491f-930a-9f759aad67f1 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:27.971160 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1025/1997] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:39:27 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:27.981817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:27.982314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-543c0f30-1c6a-4444-b2ea-db64bf9fad16 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '.version_select at 0x7fd315c94ee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:27.982937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:27.984880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-543c0f30-1c6a-4444-b2ea-db64bf9fad16 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.985370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-543c0f30-1c6a-4444-b2ea-db64bf9fad16 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.991398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.992075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:27.993263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:27.993880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.012190 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-543c0f30-1c6a-4444-b2ea-db64bf9fad16 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2342 microversion: 2.1 time: 0.037668 May 19 04:39:28.016765 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1026/1998] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:39:27 2022] GET /compute/v2.1/os-migrations => generated 2342 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:28.029413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:28.030212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: c4618f82-a86e-423e-b1bf-472f02820ac8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:28.042897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.043406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.044193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.051381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.075326 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] HTTP exception thrown: Instance c4618f82-a86e-423e-b1bf-472f02820ac8 could not be found. May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Request method failure captured: May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 HTTP/1.1 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihclRoW7E27Xam7UhIYUqTz0omQCd52r-1-9bqqfF23c3JDxaoOoqvok9Sn0wLu7UK-BhTck9LqHJWadsecu-YmtpQUu0odDmQdPJDmi4o3qwTfKN4NmpuMtiltNPmTr3i6o3b-a4zhsUDEp6_TShxAuF2mL2R8JOVjMGMgptpEhryBI May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d4796ef3b2154a949d6b966e99055595 May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c4618f82-a86e-423e-b1bf-472f02820ac8 could not be found. May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c4618f82-a86e-423e-b1bf-472f02820ac8'} May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4618f82-a86e-423e-b1bf-472f02820ac8 could not be found. May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4618f82-a86e-423e-b1bf-472f02820ac8 could not be found. May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:28.078884 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:28.083799 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:28.083799 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:28.083799 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:28.083799 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:28.083799 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:28.083799 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4618f82-a86e-423e-b1bf-472f02820ac8 could not be found. May 19 04:39:28.083799 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:28.086220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Returning 404 to user: Instance c4618f82-a86e-423e-b1bf-472f02820ac8 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:28.088221 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2a9d37c-500f-448b-94d2-8ee45ad0b6d9 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8" status: 404 len: 111 microversion: 2.1 time: 0.070293 May 19 04:39:28.090522 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1027/1999] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:28 2022] GET /compute/v2.1/servers/c4618f82-a86e-423e-b1bf-472f02820ac8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:28.096637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b695bff-2e0a-4b32-9bd2-030bfdebb8ee tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:28.110056 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b695bff-2e0a-4b32-9bd2-030bfdebb8ee tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018160 May 19 04:39:28.115814 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1028/2000] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:39:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:28.128819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-54932d5d-cbe3-4010-9264-773ac195f011 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:28.129787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-54932d5d-cbe3-4010-9264-773ac195f011 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:28.138696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54932d5d-cbe3-4010-9264-773ac195f011 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.142406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54932d5d-cbe3-4010-9264-773ac195f011 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.143538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54932d5d-cbe3-4010-9264-773ac195f011 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.144910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54932d5d-cbe3-4010-9264-773ac195f011 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.342217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:28.360886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:28.376866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:28.379006 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-191468ee-1a3f-45ff-b964-2bf7c579f234 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.406514 May 19 04:39:28.406468 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 973/2001] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:27 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:28.431643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-978ec5e3-ef45-4c8a-be76-afa8b60716fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:28.500453 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-978ec5e3-ef45-4c8a-be76-afa8b60716fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/33b82acc-749b-4ac8-8e9b-41ea6ee8ac73" status: 204 len: 0 microversion: 2.1 time: 0.092392 May 19 04:39:28.501144 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 974/2002] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:39:28 2022] DELETE /compute/v2.1/os-server-groups/33b82acc-749b-4ac8-8e9b-41ea6ee8ac73 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:28.513377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:28.514842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 4bc44755-e968-4e75-a8ce-76d6ab964726] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:28.527689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.528772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.531141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.532178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.563494 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] HTTP exception thrown: Instance 4bc44755-e968-4e75-a8ce-76d6ab964726 could not be found. May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Request method failure captured: May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 HTTP/1.1 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg0RFjMAPzZNe6AaoYRsLgtq0HUSW-mWHffkxrGhBjwCGGhg63YZBHFU8lLkl1FlXqLpb5d70_kw-EpAWGKzzLG3KH1K_WWf4ub9ZlIQ4zoqPUQSHIKagCTCYKJJvXALpYq2BzRtrhBv9JkaKruEAaWhxHTKRoGBdcOdSkAgsWfjFY May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.25 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 6d01f77aa473464b8e32d47e9b9d2a98 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 6d01f77aa473464b8e32d47e9b9d2a98 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-LiveAutoBlockMigrationV225Test-1514156105-project May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 249e284f0cfe4ecda820efeb5956701f May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105-project May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 4bc44755-e968-4e75-a8ce-76d6ab964726 could not be found. May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '4bc44755-e968-4e75-a8ce-76d6ab964726'} May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc44755-e968-4e75-a8ce-76d6ab964726 could not be found. May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc44755-e968-4e75-a8ce-76d6ab964726 could not be found. May 19 04:39:28.568962 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:28.578641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:28.578641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:28.578641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:28.578641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:28.578641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:28.578641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:28.578641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:28.578641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc44755-e968-4e75-a8ce-76d6ab964726 could not be found. May 19 04:39:28.578641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:28.582090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Returning 404 to user: Instance 4bc44755-e968-4e75-a8ce-76d6ab964726 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:28.583169 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6cf9bc29-e5dc-447d-a1db-0f51ad1c2b21 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726" status: 404 len: 111 microversion: 2.25 time: 0.080256 May 19 04:39:28.589878 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 975/2003] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:28 2022] GET /compute/v2.1/servers/4bc44755-e968-4e75-a8ce-76d6ab964726 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:39:28.599209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:28.600758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:28.611822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.612901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.614556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.615541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.728955 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-54932d5d-cbe3-4010-9264-773ac195f011 tempest-LiveMigrationTest-1465807771 tempest-LiveMigrationTest-1465807771-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1533 microversion: 2.1 time: 0.611307 May 19 04:39:28.730259 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1029/2004] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:28 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1533 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:28.735926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e20ee3ec-04d8-4d3f-bab5-e77795cf6948 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:28.736803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e20ee3ec-04d8-4d3f-bab5-e77795cf6948 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:28.753441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e20ee3ec-04d8-4d3f-bab5-e77795cf6948 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.754332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e20ee3ec-04d8-4d3f-bab5-e77795cf6948 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.755234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e20ee3ec-04d8-4d3f-bab5-e77795cf6948 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.755686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e20ee3ec-04d8-4d3f-bab5-e77795cf6948 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.795366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e20ee3ec-04d8-4d3f-bab5-e77795cf6948 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:28.964148 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e20ee3ec-04d8-4d3f-bab5-e77795cf6948 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 204 len: 0 microversion: 2.1 time: 0.232364 May 19 04:39:28.969974 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1030/2005] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:28 2022] DELETE /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:28.976883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82c05316-c3b4-4ee7-9761-a97608eea235 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:28.977600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82c05316-c3b4-4ee7-9761-a97608eea235 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:28.992284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c05316-c3b4-4ee7-9761-a97608eea235 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.995083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c05316-c3b4-4ee7-9761-a97608eea235 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:28.995933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c05316-c3b4-4ee7-9761-a97608eea235 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:28.996387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c05316-c3b4-4ee7-9761-a97608eea235 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.076120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82c05316-c3b4-4ee7-9761-a97608eea235 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:29.099085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:29.111715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:29.121158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:29.132546 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2bbafa05-812d-42dd-9702-02af66f788d2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1661 microversion: 2.42 time: 0.540713 May 19 04:39:29.135277 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 976/2006] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:28 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1661 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:29.151338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-53692064-1c99-4211-958d-bb35d29a341f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:29.152073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-53692064-1c99-4211-958d-bb35d29a341f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:29.174520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53692064-1c99-4211-958d-bb35d29a341f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.175008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53692064-1c99-4211-958d-bb35d29a341f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.175840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53692064-1c99-4211-958d-bb35d29a341f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.176279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53692064-1c99-4211-958d-bb35d29a341f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.273325 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82c05316-c3b4-4ee7-9761-a97608eea235 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f" status: 204 len: 0 microversion: 2.1 time: 0.300823 May 19 04:39:29.274506 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1031/2007] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:28 2022] DELETE /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:29.294524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6bae204a-397c-486d-b367-02bd2c32b9a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:29.295570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6bae204a-397c-486d-b367-02bd2c32b9a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:29.307043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bae204a-397c-486d-b367-02bd2c32b9a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.307584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bae204a-397c-486d-b367-02bd2c32b9a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.309357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bae204a-397c-486d-b367-02bd2c32b9a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.309913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bae204a-397c-486d-b367-02bd2c32b9a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.361801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6bae204a-397c-486d-b367-02bd2c32b9a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:29.493884 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6bae204a-397c-486d-b367-02bd2c32b9a2 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "DELETE /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 204 len: 0 microversion: 2.25 time: 0.214994 May 19 04:39:29.497552 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1032/2008] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:39:29 2022] DELETE /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:39:29.505626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-055ba4af-4b9f-47a1-bacb-02f33169a279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:29.508960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-055ba4af-4b9f-47a1-bacb-02f33169a279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:29.521432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-055ba4af-4b9f-47a1-bacb-02f33169a279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.522116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-055ba4af-4b9f-47a1-bacb-02f33169a279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.524693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-055ba4af-4b9f-47a1-bacb-02f33169a279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.525258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-055ba4af-4b9f-47a1-bacb-02f33169a279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.527609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-53692064-1c99-4211-958d-bb35d29a341f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:29.541838 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-53692064-1c99-4211-958d-bb35d29a341f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1318 microversion: 2.1 time: 0.405338 May 19 04:39:29.550893 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 977/2009] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:29 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:29.550893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-22090857-4ae6-4641-bed5-0cb91d534586 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:29.550893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-22090857-4ae6-4641-bed5-0cb91d534586 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:29.560326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22090857-4ae6-4641-bed5-0cb91d534586 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.567748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22090857-4ae6-4641-bed5-0cb91d534586 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.568598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22090857-4ae6-4641-bed5-0cb91d534586 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.569047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22090857-4ae6-4641-bed5-0cb91d534586 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.588718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-055ba4af-4b9f-47a1-bacb-02f33169a279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:29.672311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:29.720852 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-055ba4af-4b9f-47a1-bacb-02f33169a279 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 204 len: 0 microversion: 2.1 time: 0.224046 May 19 04:39:29.724455 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1033/2010] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:29 2022] DELETE /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:29.730951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f98f2106-d24c-4b5c-bcf6-77a4a74f904e req-e82b45c0-55e7-436a-b40d-513a3aea2e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4618f82-a86e-423e-b1bf-472f02820ac8", "name": "network-vif-deleted", "tag": "b810212d-5ce7-4434-8f84-db7f46236bf8"}, {"server_uuid": "1e88a27f-1e50-491f-930a-9f759aad67f1", "name": "network-vif-deleted", "tag": "eb06fa58-f656-4142-81af-c99f981eb02e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:29.752443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f98f2106-d24c-4b5c-bcf6-77a4a74f904e req-e82b45c0-55e7-436a-b40d-513a3aea2e45 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.752808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f98f2106-d24c-4b5c-bcf6-77a4a74f904e req-e82b45c0-55e7-436a-b40d-513a3aea2e45 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.776311 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f98f2106-d24c-4b5c-bcf6-77a4a74f904e req-e82b45c0-55e7-436a-b40d-513a3aea2e45 service nova] Creating event network-vif-deleted:b810212d-5ce7-4434-8f84-db7f46236bf8 for instance c4618f82-a86e-423e-b1bf-472f02820ac8 on n-h2-766726-30 May 19 04:39:29.776990 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f98f2106-d24c-4b5c-bcf6-77a4a74f904e req-e82b45c0-55e7-436a-b40d-513a3aea2e45 service nova] Creating event network-vif-deleted:eb06fa58-f656-4142-81af-c99f981eb02e for instance 1e88a27f-1e50-491f-930a-9f759aad67f1 on n-h1-766726-30 May 19 04:39:29.787482 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f98f2106-d24c-4b5c-bcf6-77a4a74f904e req-e82b45c0-55e7-436a-b40d-513a3aea2e45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063770 May 19 04:39:29.788726 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1034/2011] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:29.797933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ec3dda4f-f858-4140-a3c6-325007e9b96f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:29.798851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ec3dda4f-f858-4140-a3c6-325007e9b96f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:29.815204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec3dda4f-f858-4140-a3c6-325007e9b96f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.818244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec3dda4f-f858-4140-a3c6-325007e9b96f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.819113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec3dda4f-f858-4140-a3c6-325007e9b96f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:29.820972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec3dda4f-f858-4140-a3c6-325007e9b96f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:29.854724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ec3dda4f-f858-4140-a3c6-325007e9b96f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:29.872016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-22090857-4ae6-4641-bed5-0cb91d534586 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:29.881248 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-22090857-4ae6-4641-bed5-0cb91d534586 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1712 microversion: 2.1 time: 0.337031 May 19 04:39:29.883308 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 978/2012] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:29 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1712 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:29.986633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=7 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:29.999751 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ec3dda4f-f858-4140-a3c6-325007e9b96f tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 204 len: 0 microversion: 2.1 time: 0.204431 May 19 04:39:30.003071 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1035/2013] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:29 2022] DELETE /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:30.014500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:30.018191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:30.037201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:30.037663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:30.040576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:30.041708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:30.064683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1849684470", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "82486771-750f-463d-af9e-4ddde36ad06d"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:30.129723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] validate_networks() for [('82486771-750f-463d-af9e-4ddde36ad06d', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:39:30.735410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:30.759693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:30.761475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:30.762785 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-826dd770-6600-48dd-8e5e-9ffcb6a0ade4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.758533 May 19 04:39:30.776052 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1036/2014] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:30 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:30.783751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:30.784623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:30.791438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:30.792121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:30.793099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:30.793718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:31.526754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:31.538069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:31.540752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:31.543712 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f723125a-9f2c-4037-a52d-08de0ecd5a46 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1548 microversion: 2.25 time: 0.765687 May 19 04:39:31.545219 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1037/2015] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:30 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1548 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:31.550504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb3581f6-235a-434e-9c66-88a0bb8358e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:31.551363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eb3581f6-235a-434e-9c66-88a0bb8358e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:31.558700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb3581f6-235a-434e-9c66-88a0bb8358e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:31.559531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb3581f6-235a-434e-9c66-88a0bb8358e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:31.560567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb3581f6-235a-434e-9c66-88a0bb8358e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:31.561271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb3581f6-235a-434e-9c66-88a0bb8358e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:31.672947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:39:31.675108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:39:31.677407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:39:31.679927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:39:31.681342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:39:31.703339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:31.704170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:31.705435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:31.706123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:31.740113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Getting quotas for project 37434a18d2d140a99d6d77f3bf3c8c79. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:39:31.746058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Getting quotas for user 86edb676803a41b2bd11bda3b33650a7 and project 37434a18d2d140a99d6d77f3bf3c8c79. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:39:31.760686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:39:31.765063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:39:31.796984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eb3581f6-235a-434e-9c66-88a0bb8358e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:31.822525 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eb3581f6-235a-434e-9c66-88a0bb8358e3 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1386 microversion: 2.1 time: 0.274450 May 19 04:39:31.833146 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1038/2016] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:31 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:31.839268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-630f050f-f8bc-442e-b55b-a46619f7eaf9 req-a0323290-1314-45cf-b9b8-a562eb1da6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c372099a-9a88-4652-88c9-5d254a243f77", "tag": "67957cc5-98f3-41de-897b-bf1663fe7167"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:31.867475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-630f050f-f8bc-442e-b55b-a46619f7eaf9 req-a0323290-1314-45cf-b9b8-a562eb1da6c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:31.868205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-630f050f-f8bc-442e-b55b-a46619f7eaf9 req-a0323290-1314-45cf-b9b8-a562eb1da6c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:31.871797 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-60dc39f7-cff5-41df-83e7-5fc015e43332 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.985381 May 19 04:39:31.873744 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 979/2017] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:39:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:39:31.880183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-187ecb9e-e0a9-4296-8b36-c0946e28a457 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:31.881223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-187ecb9e-e0a9-4296-8b36-c0946e28a457 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:31.894792 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-630f050f-f8bc-442e-b55b-a46619f7eaf9 req-a0323290-1314-45cf-b9b8-a562eb1da6c1 service nova] Creating event network-changed:67957cc5-98f3-41de-897b-bf1663fe7167 for instance c372099a-9a88-4652-88c9-5d254a243f77 on n-h2-766726-30 May 19 04:39:31.903895 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-630f050f-f8bc-442e-b55b-a46619f7eaf9 req-a0323290-1314-45cf-b9b8-a562eb1da6c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075106 May 19 04:39:31.907200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-187ecb9e-e0a9-4296-8b36-c0946e28a457 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:31.914212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-187ecb9e-e0a9-4296-8b36-c0946e28a457 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:31.916128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-187ecb9e-e0a9-4296-8b36-c0946e28a457 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:31.916886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-187ecb9e-e0a9-4296-8b36-c0946e28a457 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:31.922521 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1039/2018] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:31.928233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:31.929018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:31.935969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:31.936429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:31.937260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:31.937706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.209775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:32.223061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:32.232145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-187ecb9e-e0a9-4296-8b36-c0946e28a457 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:32.234885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:32.236229 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-776a812e-49ee-4c3f-8ced-ea5569e5ff64 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1849 microversion: 2.42 time: 0.312376 May 19 04:39:32.236797 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1040/2019] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:31 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1849 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:32.247361 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-187ecb9e-e0a9-4296-8b36-c0946e28a457 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f" status: 200 len: 1471 microversion: 2.1 time: 0.366023 May 19 04:39:32.247361 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 980/2020] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:31 2022] GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f => generated 1471 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:32.250472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-917096c4-0bdd-4906-9618-e22b67029db4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:32.251095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-917096c4-0bdd-4906-9618-e22b67029db4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:32.253816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fa2c479d-b1fe-4be5-9522-8cf53ca9b290 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:32.254786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fa2c479d-b1fe-4be5-9522-8cf53ca9b290 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:32.257925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-917096c4-0bdd-4906-9618-e22b67029db4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.258468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-917096c4-0bdd-4906-9618-e22b67029db4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.259771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-917096c4-0bdd-4906-9618-e22b67029db4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.260203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-917096c4-0bdd-4906-9618-e22b67029db4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.263611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa2c479d-b1fe-4be5-9522-8cf53ca9b290 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.264368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa2c479d-b1fe-4be5-9522-8cf53ca9b290 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.265456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa2c479d-b1fe-4be5-9522-8cf53ca9b290 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.265910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa2c479d-b1fe-4be5-9522-8cf53ca9b290 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.608984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-917096c4-0bdd-4906-9618-e22b67029db4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:32.624745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fa2c479d-b1fe-4be5-9522-8cf53ca9b290 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:32.640356 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fa2c479d-b1fe-4be5-9522-8cf53ca9b290 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1712 microversion: 2.1 time: 0.389754 May 19 04:39:32.643910 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-917096c4-0bdd-4906-9618-e22b67029db4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1318 microversion: 2.1 time: 0.397048 May 19 04:39:32.653091 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 981/2021] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:32 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:32.654086 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1041/2022] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:32 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1712 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:32.658644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:32.658806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a26c8e25-fc94-4cf9-a812-ac15b57a57dd tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:32.659493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a26c8e25-fc94-4cf9-a812-ac15b57a57dd tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:32.660034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:32.664312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:32.668340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.668517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a26c8e25-fc94-4cf9-a812-ac15b57a57dd tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.668830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a26c8e25-fc94-4cf9-a812-ac15b57a57dd tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.669597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.669730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a26c8e25-fc94-4cf9-a812-ac15b57a57dd tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.670169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a26c8e25-fc94-4cf9-a812-ac15b57a57dd tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.670974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.671655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.814402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a26c8e25-fc94-4cf9-a812-ac15b57a57dd tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:32.842780 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a26c8e25-fc94-4cf9-a812-ac15b57a57dd tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1221 microversion: 2.1 time: 0.187641 May 19 04:39:32.856437 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1042/2023] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:32 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1221 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:32.861564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:32.862393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:32.874883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.877229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.878799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.879430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.935750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:32.936582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:32.937518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lazy-loading 'fault' on Instance uuid 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:39:33.046160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.058913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.063794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.068757 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-176bd8a3-7a30-451c-b7c7-43c446afa1df tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 200 len: 1351 microversion: 2.25 time: 0.207314 May 19 04:39:33.069447 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1043/2024] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:32 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 1351 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:33.074430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d95c0f8c-8b69-4485-9581-9ab01800990b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:33.083384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d95c0f8c-8b69-4485-9581-9ab01800990b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:33.094366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d95c0f8c-8b69-4485-9581-9ab01800990b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:33.094821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d95c0f8c-8b69-4485-9581-9ab01800990b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:33.105748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d95c0f8c-8b69-4485-9581-9ab01800990b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:33.106727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d95c0f8c-8b69-4485-9581-9ab01800990b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:33.149090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.163019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.166029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.171447 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3215d0d8-b2da-4d34-a4db-878b7f6abd30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.520854 May 19 04:39:33.175170 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 982/2025] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:32 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:33.255910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:33.257123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:33.264630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:33.276832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:33.278099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:33.278826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:33.313986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:33.585847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d95c0f8c-8b69-4485-9581-9ab01800990b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.591966 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d95c0f8c-8b69-4485-9581-9ab01800990b tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1386 microversion: 2.1 time: 0.521176 May 19 04:39:33.592552 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1044/2026] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:33 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1386 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:33.607749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-398e7ad7-3b5d-49d0-b7c8-bc5715719482 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:33.608371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-398e7ad7-3b5d-49d0-b7c8-bc5715719482 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:33.615851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-398e7ad7-3b5d-49d0-b7c8-bc5715719482 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:33.616885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-398e7ad7-3b5d-49d0-b7c8-bc5715719482 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:33.617822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-398e7ad7-3b5d-49d0-b7c8-bc5715719482 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:33.618823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-398e7ad7-3b5d-49d0-b7c8-bc5715719482 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:33.696921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.715866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.718399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.719784 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a69216ac-4338-435b-9b90-9995914d714b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1849 microversion: 2.42 time: 0.468388 May 19 04:39:33.720410 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 983/2027] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:33 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1849 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:39:33.731741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-268d99b1-cb79-4108-bf65-a79d4c94e7bc req-e1048b41-6244-4e4a-b1cd-f42e56add2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "tag": "11827578-b39a-4078-b09c-f790673f88b0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:33.752954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-268d99b1-cb79-4108-bf65-a79d4c94e7bc req-e1048b41-6244-4e4a-b1cd-f42e56add2ff service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:33.753841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-268d99b1-cb79-4108-bf65-a79d4c94e7bc req-e1048b41-6244-4e4a-b1cd-f42e56add2ff service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:33.780473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-268d99b1-cb79-4108-bf65-a79d4c94e7bc req-e1048b41-6244-4e4a-b1cd-f42e56add2ff service nova] Creating event network-changed:11827578-b39a-4078-b09c-f790673f88b0 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:39:33.790473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-268d99b1-cb79-4108-bf65-a79d4c94e7bc req-e1048b41-6244-4e4a-b1cd-f42e56add2ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068395 May 19 04:39:33.791140 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 984/2028] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:33.810727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dca5fd08-24f9-4e33-a786-3f8c501b3dd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:33.811755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dca5fd08-24f9-4e33-a786-3f8c501b3dd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:33.820595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dca5fd08-24f9-4e33-a786-3f8c501b3dd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:33.822549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dca5fd08-24f9-4e33-a786-3f8c501b3dd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:33.823753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dca5fd08-24f9-4e33-a786-3f8c501b3dd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:33.824830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dca5fd08-24f9-4e33-a786-3f8c501b3dd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:33.975767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-398e7ad7-3b5d-49d0-b7c8-bc5715719482 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:33.988365 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-398e7ad7-3b5d-49d0-b7c8-bc5715719482 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f" status: 200 len: 1471 microversion: 2.1 time: 0.385756 May 19 04:39:33.988995 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1045/2029] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:33 2022] GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:34.014130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1ebafd09-0ba4-404e-83b8-5e8a1aafed72 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:34.015034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1ebafd09-0ba4-404e-83b8-5e8a1aafed72 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:34.023526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ebafd09-0ba4-404e-83b8-5e8a1aafed72 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.023993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ebafd09-0ba4-404e-83b8-5e8a1aafed72 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.024896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ebafd09-0ba4-404e-83b8-5e8a1aafed72 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.033256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ebafd09-0ba4-404e-83b8-5e8a1aafed72 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.554624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dca5fd08-24f9-4e33-a786-3f8c501b3dd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:34.568129 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dca5fd08-24f9-4e33-a786-3f8c501b3dd6 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1712 microversion: 2.1 time: 0.774056 May 19 04:39:34.568759 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 985/2030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:33 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1712 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:34.580830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1421d1f7-c6f6-4d02-86b5-e970e275b67d tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:34.585962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1421d1f7-c6f6-4d02-86b5-e970e275b67d tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:34.597175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1421d1f7-c6f6-4d02-86b5-e970e275b67d tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.599328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1421d1f7-c6f6-4d02-86b5-e970e275b67d tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.601797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1421d1f7-c6f6-4d02-86b5-e970e275b67d tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.602824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1421d1f7-c6f6-4d02-86b5-e970e275b67d tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.634200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1ebafd09-0ba4-404e-83b8-5e8a1aafed72 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:34.642947 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1ebafd09-0ba4-404e-83b8-5e8a1aafed72 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1318 microversion: 2.1 time: 0.632425 May 19 04:39:34.654161 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1046/2031] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:33 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1318 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:34.660486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-d4616540-502f-4415-b2b9-52fb3543ec95 req-78e9eaf9-d523-47ee-be56-52216e4a4c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5", "name": "network-vif-deleted", "tag": "73456bb4-887e-4a14-b2f8-54b8006ad0bc"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:34.673347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d4616540-502f-4415-b2b9-52fb3543ec95 req-78e9eaf9-d523-47ee-be56-52216e4a4c2e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.675897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d4616540-502f-4415-b2b9-52fb3543ec95 req-78e9eaf9-d523-47ee-be56-52216e4a4c2e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.682894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1421d1f7-c6f6-4d02-86b5-e970e275b67d tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:34.690371 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1421d1f7-c6f6-4d02-86b5-e970e275b67d tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1275 microversion: 2.1 time: 0.116575 May 19 04:39:34.690966 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 986/2032] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:34 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:34.691452 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-d4616540-502f-4415-b2b9-52fb3543ec95 req-78e9eaf9-d523-47ee-be56-52216e4a4c2e service nova] Creating event network-vif-deleted:73456bb4-887e-4a14-b2f8-54b8006ad0bc for instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 on n-h2-766726-30 May 19 04:39:34.700348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:34.701959 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-d4616540-502f-4415-b2b9-52fb3543ec95 req-78e9eaf9-d523-47ee-be56-52216e4a4c2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045909 May 19 04:39:34.702718 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1047/2033] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:34.704816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:34.715141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:34.717530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:34.722899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.723367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.724173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.724622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.731994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.733192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.736536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.738582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.762474 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] HTTP exception thrown: Instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 could not be found. May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Request method failure captured: May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 HTTP/1.1 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcg0RFjMAPzZNe6AaoYRsLgtq0HUSW-mWHffkxrGhBjwCGGhg63YZBHFU8lLkl1FlXqLpb5d70_kw-EpAWGKzzLG3KH1K_WWf4ub9ZlIQ4zoqPUQSHIKagCTCYKJJvXALpYq2BzRtrhBv9JkaKruEAaWhxHTKRoGBdcOdSkAgsWfjFY May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.25 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 6d01f77aa473464b8e32d47e9b9d2a98 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 6d01f77aa473464b8e32d47e9b9d2a98 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-LiveAutoBlockMigrationV225Test-1514156105-project May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 249e284f0cfe4ecda820efeb5956701f May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105-project May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 could not be found. May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5'} May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 could not be found. May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 could not be found. May 19 04:39:34.764632 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:34.770095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:34.770095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:34.770095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:34.770095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:34.770095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:34.770095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:34.770095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:34.770095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 could not be found. May 19 04:39:34.770095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:34.773951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Returning 404 to user: Instance 60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:34.782162 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f206bf3b-307e-4b11-8251-385cc75bc78b tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5" status: 404 len: 111 microversion: 2.25 time: 0.090172 May 19 04:39:34.785786 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 987/2034] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:34 2022] GET /compute/v2.1/servers/60b0dfb1-d8b7-4c2f-ab90-20ac12d34ea5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:39:34.798682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62f7928a-d8c6-4852-a9fc-c9a6ebd14de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:34.799574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62f7928a-d8c6-4852-a9fc-c9a6ebd14de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:34.816734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62f7928a-d8c6-4852-a9fc-c9a6ebd14de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.817531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62f7928a-d8c6-4852-a9fc-c9a6ebd14de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:34.818563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62f7928a-d8c6-4852-a9fc-c9a6ebd14de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:34.819222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62f7928a-d8c6-4852-a9fc-c9a6ebd14de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:35.279206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:35.293548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:35.296571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:35.298008 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-321f0e92-ccf2-4994-9d6b-f19cec0b9745 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.594095 May 19 04:39:35.299400 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1048/2035] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:34 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:35.304801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:35.306545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:35.312998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-62f7928a-d8c6-4852-a9fc-c9a6ebd14de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:35.318456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:35.319821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:35.321185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:35.323348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:35.323509 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-62f7928a-d8c6-4852-a9fc-c9a6ebd14de7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1386 microversion: 2.1 time: 0.536331 May 19 04:39:35.323962 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 988/2036] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:34 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1386 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:35.337657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1116e703-9eba-4eae-97bc-c99dd2e98ee1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:35.349557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1116e703-9eba-4eae-97bc-c99dd2e98ee1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:35.382489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1116e703-9eba-4eae-97bc-c99dd2e98ee1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:35.390196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1116e703-9eba-4eae-97bc-c99dd2e98ee1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:35.391281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1116e703-9eba-4eae-97bc-c99dd2e98ee1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:35.391956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1116e703-9eba-4eae-97bc-c99dd2e98ee1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:35.447096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1116e703-9eba-4eae-97bc-c99dd2e98ee1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:35.623430 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1116e703-9eba-4eae-97bc-c99dd2e98ee1 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 204 len: 0 microversion: 2.25 time: 0.289367 May 19 04:39:35.625328 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 989/2037] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:39:35 2022] DELETE /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:39:35.630986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d3d0c32-896f-4637-b04f-82e980c85581 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:35.631995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1d3d0c32-896f-4637-b04f-82e980c85581 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:35.650314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d3d0c32-896f-4637-b04f-82e980c85581 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:35.651057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d3d0c32-896f-4637-b04f-82e980c85581 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:35.652056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d3d0c32-896f-4637-b04f-82e980c85581 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:35.652687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d3d0c32-896f-4637-b04f-82e980c85581 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:36.151322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1d3d0c32-896f-4637-b04f-82e980c85581 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:36.162553 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d3d0c32-896f-4637-b04f-82e980c85581 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f" status: 200 len: 1429 microversion: 2.1 time: 0.535503 May 19 04:39:36.163054 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 990/2038] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:35 2022] GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f => generated 1429 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:36.176897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a972e2c-bdcf-497c-8df9-0d77a5f1c6d5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:36.182021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2a972e2c-bdcf-497c-8df9-0d77a5f1c6d5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:36.200927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a972e2c-bdcf-497c-8df9-0d77a5f1c6d5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:36.203951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a972e2c-bdcf-497c-8df9-0d77a5f1c6d5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:36.205156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a972e2c-bdcf-497c-8df9-0d77a5f1c6d5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:36.212421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a972e2c-bdcf-497c-8df9-0d77a5f1c6d5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:36.554241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2a972e2c-bdcf-497c-8df9-0d77a5f1c6d5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:36.568858 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a972e2c-bdcf-497c-8df9-0d77a5f1c6d5 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1645 microversion: 2.1 time: 0.395603 May 19 04:39:36.571412 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 991/2039] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:36 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1645 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:36.582059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:36.583363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:36.584614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:36.601853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:36.604391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:36.606024 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e09fad78-bdac-4a9c-9736-f0b4707a315a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1849 microversion: 2.42 time: 1.305465 May 19 04:39:36.606904 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1049/2040] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:35 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1849 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:36.609340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:36.609789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:36.612441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b8f57545-09f1-4ad5-af2f-c4c10aa8ae12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:36.614520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:36.615111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:36.625955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b8f57545-09f1-4ad5-af2f-c4c10aa8ae12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:36.633597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8f57545-09f1-4ad5-af2f-c4c10aa8ae12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:36.634468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8f57545-09f1-4ad5-af2f-c4c10aa8ae12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:36.635496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8f57545-09f1-4ad5-af2f-c4c10aa8ae12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:36.636779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8f57545-09f1-4ad5-af2f-c4c10aa8ae12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:36.641771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:37.258087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:37.312803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:37.322816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:37.326083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:37.327564 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a0299358-60fb-4f90-ab51-38a49b215093 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1564 microversion: 2.25 time: 0.754540 May 19 04:39:37.341382 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 992/2041] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:36 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1564 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:37.360628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b8f57545-09f1-4ad5-af2f-c4c10aa8ae12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:37.369973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8efe4e35-0491-46cc-91c9-9ac9366a5273 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:37.374509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8efe4e35-0491-46cc-91c9-9ac9366a5273 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:37.387738 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b8f57545-09f1-4ad5-af2f-c4c10aa8ae12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1318 microversion: 2.1 time: 0.779498 May 19 04:39:37.396703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8efe4e35-0491-46cc-91c9-9ac9366a5273 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:37.396703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8efe4e35-0491-46cc-91c9-9ac9366a5273 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:37.396703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8efe4e35-0491-46cc-91c9-9ac9366a5273 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:37.396703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8efe4e35-0491-46cc-91c9-9ac9366a5273 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:37.397227 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1050/2042] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:36 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:37.409882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0b82f1f9-410a-43b3-b26c-474bb16b88a0 req-b4ccec26-0fa5-494f-a2e9-f8145f5d293d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3483fa-2206-4bc1-87fa-94fb5afd1ee6", "name": "network-vif-deleted", "tag": "02806464-d201-4fd4-86a1-709506da8214"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:37.429878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0b82f1f9-410a-43b3-b26c-474bb16b88a0 req-b4ccec26-0fa5-494f-a2e9-f8145f5d293d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:37.431051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0b82f1f9-410a-43b3-b26c-474bb16b88a0 req-b4ccec26-0fa5-494f-a2e9-f8145f5d293d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:37.448812 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0b82f1f9-410a-43b3-b26c-474bb16b88a0 req-b4ccec26-0fa5-494f-a2e9-f8145f5d293d service nova] Creating event network-vif-deleted:02806464-d201-4fd4-86a1-709506da8214 for instance fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 on n-h1-766726-30 May 19 04:39:37.455447 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0b82f1f9-410a-43b3-b26c-474bb16b88a0 req-b4ccec26-0fa5-494f-a2e9-f8145f5d293d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061471 May 19 04:39:37.456485 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1051/2043] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:37.464205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:37.465581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:37.473121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:37.473833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:37.474783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:37.475434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:37.518190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:38.195035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:38.221417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:38.228130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:38.231091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27b85bf5-e77b-45cc-b84c-1d640b82196a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.773103 May 19 04:39:38.235989 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1052/2044] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:37 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:38.248911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6506b76e-f9e2-4e41-a28f-51fb2d93e1fc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:38.250233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6506b76e-f9e2-4e41-a28f-51fb2d93e1fc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:38.265408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6506b76e-f9e2-4e41-a28f-51fb2d93e1fc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.266487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6506b76e-f9e2-4e41-a28f-51fb2d93e1fc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.267841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6506b76e-f9e2-4e41-a28f-51fb2d93e1fc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.269611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6506b76e-f9e2-4e41-a28f-51fb2d93e1fc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.410448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6506b76e-f9e2-4e41-a28f-51fb2d93e1fc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:38.424397 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6506b76e-f9e2-4e41-a28f-51fb2d93e1fc tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1183 microversion: 2.1 time: 0.186134 May 19 04:39:38.435748 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1053/2045] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:38 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:38.444108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c44fd1ad-97f4-45cd-8d99-3abf1c9e0473 req-ec60d433-5a20-4618-b6be-84999d4c2b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372099a-9a88-4652-88c9-5d254a243f77", "name": "network-vif-plugged", "status": "completed", "tag": "67957cc5-98f3-41de-897b-bf1663fe7167"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:38.446665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8efe4e35-0491-46cc-91c9-9ac9366a5273 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:38.462573 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8efe4e35-0491-46cc-91c9-9ac9366a5273 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1317 microversion: 2.1 time: 1.118441 May 19 04:39:38.464093 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 993/2046] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:37 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1317 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:38.467892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c44fd1ad-97f4-45cd-8d99-3abf1c9e0473 req-ec60d433-5a20-4618-b6be-84999d4c2b53 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.468665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c44fd1ad-97f4-45cd-8d99-3abf1c9e0473 req-ec60d433-5a20-4618-b6be-84999d4c2b53 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.482343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:38.483195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: a618bac6-bdc4-4730-93c3-d3f54367f21f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:38.494580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.495911 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c44fd1ad-97f4-45cd-8d99-3abf1c9e0473 req-ec60d433-5a20-4618-b6be-84999d4c2b53 service nova] Creating event network-vif-plugged:67957cc5-98f3-41de-897b-bf1663fe7167 for instance c372099a-9a88-4652-88c9-5d254a243f77 on n-h2-766726-30 May 19 04:39:38.496300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.497874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.498972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.520559 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c44fd1ad-97f4-45cd-8d99-3abf1c9e0473 req-ec60d433-5a20-4618-b6be-84999d4c2b53 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081528 May 19 04:39:38.522914 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1054/2047] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:38.534362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:38.543366 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] HTTP exception thrown: Instance a618bac6-bdc4-4730-93c3-d3f54367f21f could not be found. May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Request method failure captured: May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f HTTP/1.1 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclRoW7E27Xam7UhIYUqTz0omQCd52r-1-9bqqfF23c3JDxaoOoqvok9Sn0wLu7UK-BhTck9LqHJWadsecu-YmtpQUu0odDmQdPJDmi4o3qwTfKN4NmpuMtiltNPmTr3i6o3b-a4zhsUDEp6_TShxAuF2mL2R8JOVjMGMgptpEhryBI May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d4796ef3b2154a949d6b966e99055595 May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance a618bac6-bdc4-4730-93c3-d3f54367f21f could not be found. May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'a618bac6-bdc4-4730-93c3-d3f54367f21f'} May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a618bac6-bdc4-4730-93c3-d3f54367f21f could not be found. May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a618bac6-bdc4-4730-93c3-d3f54367f21f could not be found. May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:38.545693 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:38.551187 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:38.551187 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:38.551187 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:38.551187 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:38.551187 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:38.551187 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a618bac6-bdc4-4730-93c3-d3f54367f21f could not be found. May 19 04:39:38.551187 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:38.551782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:38.554270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Returning 404 to user: Instance a618bac6-bdc4-4730-93c3-d3f54367f21f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:38.555414 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-75d861df-61f3-49d1-a6d3-da3d81f565fc tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f" status: 404 len: 111 microversion: 2.1 time: 0.080013 May 19 04:39:38.556547 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 994/2048] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:38 2022] GET /compute/v2.1/servers/a618bac6-bdc4-4730-93c3-d3f54367f21f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:38.564776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:38.565701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:38.566467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.566467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.567992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.567992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.589253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.590154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.592528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.593766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.663165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.663925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.665916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lazy-loading 'fault' on Instance uuid e6b71b11-ff6f-49dc-9fbd-cf68e47af55f {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:39:38.812872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afd277134b4917bc0edcd44443ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5288075b50854cdeab0ea7f2a5ae5398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:38.830677 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6790e4a3-f5ad-451e-b25b-a41b354de9df tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 200 len: 1366 microversion: 2.1 time: 0.303451 May 19 04:39:38.842524 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1055/2049] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:38 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:38.856397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0f399d77-9073-4a2f-b4f6-5887c239f8f6 req-b65f7358-f804-418b-855e-e3f2c465e28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b71b11-ff6f-49dc-9fbd-cf68e47af55f", "name": "network-vif-deleted", "tag": "4969e6d6-ab69-44db-b04b-336fe8d72fae"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:38.878275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0f399d77-9073-4a2f-b4f6-5887c239f8f6 req-b65f7358-f804-418b-855e-e3f2c465e28a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.878778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0f399d77-9073-4a2f-b4f6-5887c239f8f6 req-b65f7358-f804-418b-855e-e3f2c465e28a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.916961 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0f399d77-9073-4a2f-b4f6-5887c239f8f6 req-b65f7358-f804-418b-855e-e3f2c465e28a service nova] Creating event network-vif-deleted:4969e6d6-ab69-44db-b04b-336fe8d72fae for instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f on n-h1-766726-30 May 19 04:39:38.933719 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0f399d77-9073-4a2f-b4f6-5887c239f8f6 req-b65f7358-f804-418b-855e-e3f2c465e28a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088279 May 19 04:39:38.937908 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1056/2050] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:38.951033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:38.951834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:38.965201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.965668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:38.971018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:38.972015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:39.138363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.157902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.163344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '249e284f0cfe4ecda820efeb5956701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d01f77aa473464b8e32d47e9b9d2a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.172304 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f4c03288-1bb4-474c-9388-b081f96bcdd0 tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 200 len: 1522 microversion: 2.25 time: 0.229764 May 19 04:39:39.173471 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1057/2051] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:38 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:39.186089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-257480b3-24f8-4662-8358-0dcd57a76c05 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:39.187455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-257480b3-24f8-4662-8358-0dcd57a76c05 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:39.189824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.205060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-257480b3-24f8-4662-8358-0dcd57a76c05 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:39.209383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-257480b3-24f8-4662-8358-0dcd57a76c05 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:39.212632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-257480b3-24f8-4662-8358-0dcd57a76c05 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:39.217094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.217368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-257480b3-24f8-4662-8358-0dcd57a76c05 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:39.222992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.230215 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c6ca2720-109a-4113-abec-728abeaac8b6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.667453 May 19 04:39:39.230864 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 995/2052] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:38 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:39.263995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:39.266175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: fa3483fa-2206-4bc1-87fa-94fb5afd1ee6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:39.316269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:39.316790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:39.317808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:39.318298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:39.364135 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] HTTP exception thrown: Instance fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 could not be found. May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Request method failure captured: May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 HTTP/1.1 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclRoW7E27Xam7UhIYUqTz0omQCd52r-1-9bqqfF23c3JDxaoOoqvok9Sn0wLu7UK-BhTck9LqHJWadsecu-YmtpQUu0odDmQdPJDmi4o3qwTfKN4NmpuMtiltNPmTr3i6o3b-a4zhsUDEp6_TShxAuF2mL2R8JOVjMGMgptpEhryBI May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d4796ef3b2154a949d6b966e99055595 May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 could not be found. May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'fa3483fa-2206-4bc1-87fa-94fb5afd1ee6'} May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 could not be found. May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 could not be found. May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:39.372237 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:39.377378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:39.377378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:39.377378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:39.377378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:39.377378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:39.377378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 could not be found. May 19 04:39:39.377378 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:39.377378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Returning 404 to user: Instance fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:39.377378 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a53cfc88-1505-4624-8939-029ea5137105 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6" status: 404 len: 111 microversion: 2.1 time: 0.123538 May 19 04:39:39.382494 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 996/2053] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:39 2022] GET /compute/v2.1/servers/fa3483fa-2206-4bc1-87fa-94fb5afd1ee6 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:39.391623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:39.392495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:39.405453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:39.405965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:39.407081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:39.407804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:39.863448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-257480b3-24f8-4662-8358-0dcd57a76c05 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.872559 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-257480b3-24f8-4662-8358-0dcd57a76c05 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1318 microversion: 2.1 time: 0.696176 May 19 04:39:39.873158 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1058/2054] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:39 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1318 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:39.888562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ffc9c9a-b276-445e-bb6a-e08146a83336 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:39.891336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.920962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.929644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:39.932054 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d74003f3-5432-4faf-a41c-ab8fb4ca6aa7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.548421 May 19 04:39:39.937236 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ffc9c9a-b276-445e-bb6a-e08146a83336 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/6607fa72-65ef-40a3-b920-b1c31c2f4729" status: 204 len: 0 microversion: 2.1 time: 0.053460 May 19 04:39:39.944447 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1059/2055] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:39:39 2022] DELETE /compute/v2.1/os-server-groups/6607fa72-65ef-40a3-b920-b1c31c2f4729 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:39.950162 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 997/2056] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:39 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:39.969883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-348160cc-2ba9-49a4-98e7-207cee6dca40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:39.971602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3f340c2f-e766-4230-9d62-3a006723536f req-638a8c23-a3ca-41d5-a8d0-c3b7771c9024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a618bac6-bdc4-4730-93c3-d3f54367f21f", "name": "network-vif-deleted", "tag": "9b546525-9634-438d-a80e-daad48bdf3ad"}, {"server_uuid": "a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3", "name": "network-vif-deleted", "tag": "a9e4213a-1542-42bf-9830-906fd7d9a1a7"}, {"name": "network-changed", "server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "tag": "712746b0-d242-41be-a8d0-753db84e4e8f"}, {"name": "network-changed", "server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "tag": "b5c9ee41-8f79-451c-8e52-3f34832d4eb8"}, {"name": "network-changed", "server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "tag": "251915bf-6825-4c34-bd81-cf630c80845a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:39.972707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-348160cc-2ba9-49a4-98e7-207cee6dca40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:39.989678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-348160cc-2ba9-49a4-98e7-207cee6dca40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:39.990197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-348160cc-2ba9-49a4-98e7-207cee6dca40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:39.994037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-348160cc-2ba9-49a4-98e7-207cee6dca40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:39.994585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-348160cc-2ba9-49a4-98e7-207cee6dca40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.013481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3f340c2f-e766-4230-9d62-3a006723536f req-638a8c23-a3ca-41d5-a8d0-c3b7771c9024 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.016061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3f340c2f-e766-4230-9d62-3a006723536f req-638a8c23-a3ca-41d5-a8d0-c3b7771c9024 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.049473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3f340c2f-e766-4230-9d62-3a006723536f req-638a8c23-a3ca-41d5-a8d0-c3b7771c9024 service nova] Creating event network-vif-deleted:9b546525-9634-438d-a80e-daad48bdf3ad for instance a618bac6-bdc4-4730-93c3-d3f54367f21f on n-h1-766726-30 May 19 04:39:40.050313 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3f340c2f-e766-4230-9d62-3a006723536f req-638a8c23-a3ca-41d5-a8d0-c3b7771c9024 service nova] Creating event network-vif-deleted:a9e4213a-1542-42bf-9830-906fd7d9a1a7 for instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 on n-h1-766726-30 May 19 04:39:40.051479 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3f340c2f-e766-4230-9d62-3a006723536f req-638a8c23-a3ca-41d5-a8d0-c3b7771c9024 service nova] Creating event network-changed:712746b0-d242-41be-a8d0-753db84e4e8f for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:39:40.052667 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3f340c2f-e766-4230-9d62-3a006723536f req-638a8c23-a3ca-41d5-a8d0-c3b7771c9024 service nova] Creating event network-changed:b5c9ee41-8f79-451c-8e52-3f34832d4eb8 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:39:40.053645 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3f340c2f-e766-4230-9d62-3a006723536f req-638a8c23-a3ca-41d5-a8d0-c3b7771c9024 service nova] Creating event network-changed:251915bf-6825-4c34-bd81-cf630c80845a for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:39:40.065910 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3f340c2f-e766-4230-9d62-3a006723536f req-638a8c23-a3ca-41d5-a8d0-c3b7771c9024 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 855 microversion: 2.1 time: 0.110782 May 19 04:39:40.067590 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 998/2057] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 855 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:40.075196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3be11b8c-a354-4e56-8ca3-85c3f0dee5e9 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:40.079026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3be11b8c-a354-4e56-8ca3-85c3f0dee5e9 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:40.104089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be11b8c-a354-4e56-8ca3-85c3f0dee5e9 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.106852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be11b8c-a354-4e56-8ca3-85c3f0dee5e9 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.107865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be11b8c-a354-4e56-8ca3-85c3f0dee5e9 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.110791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3be11b8c-a354-4e56-8ca3-85c3f0dee5e9 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.434426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-348160cc-2ba9-49a4-98e7-207cee6dca40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:40.443920 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-348160cc-2ba9-49a4-98e7-207cee6dca40 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1183 microversion: 2.1 time: 0.497562 May 19 04:39:40.462681 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1060/2058] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:39 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:40.480117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:40.480793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] [instance: e6b71b11-ff6f-49dc-9fbd-cf68e47af55f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:40.500279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.500745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.501607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.502272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.540280 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] HTTP exception thrown: Instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f could not be found. May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Request method failure captured: May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f HTTP/1.1 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmrid3HLvkUc0Hk9vlC6eOsfkDGE8IufNAQm-t9phTlQM88BQ6yy6AM8y3-pboDRTOVVONaR-XUv2StKyIdaxdM_3Q7sqhfYxmahBNOfLnmP6DYc7Gd__ZqJhgd5rx0oHlW6gVYOY2CMKNIu5ay52hN37PgRrlAQHMNYm8m_B1W7mk May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 5288075b50854cdeab0ea7f2a5ae5398 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestManualDisk-1243475172 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5288075b50854cdeab0ea7f2a5ae5398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5288075b50854cdeab0ea7f2a5ae5398"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5288075b50854cdeab0ea7f2a5ae5398"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5288075b50854cdeab0ea7f2a5ae5398"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestManualDisk-1243475172 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 5288075b50854cdeab0ea7f2a5ae5398 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestManualDisk-1243475172 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestManualDisk-1243475172-project May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 51afd277134b4917bc0edcd44443ef04 May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestManualDisk-1243475172-project May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f could not be found. May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'e6b71b11-ff6f-49dc-9fbd-cf68e47af55f'} May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f could not be found. May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f could not be found. May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:40.542286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.547870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:40.547870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:40.547870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:40.547870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:40.547870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:40.547870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f could not be found. May 19 04:39:40.547870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.550247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Returning 404 to user: Instance e6b71b11-ff6f-49dc-9fbd-cf68e47af55f could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:40.551149 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5f19590f-5461-46b0-af2c-503e4810326b tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f" status: 404 len: 111 microversion: 2.1 time: 0.087395 May 19 04:39:40.560518 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1061/2059] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:40 2022] GET /compute/v2.1/servers/e6b71b11-ff6f-49dc-9fbd-cf68e47af55f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:40.565749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-785e8e70-59f5-4725-b05b-ac470e6db370 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:40.566363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-785e8e70-59f5-4725-b05b-ac470e6db370 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:40.584390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-785e8e70-59f5-4725-b05b-ac470e6db370 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.584856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-785e8e70-59f5-4725-b05b-ac470e6db370 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.585682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-785e8e70-59f5-4725-b05b-ac470e6db370 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.586126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-785e8e70-59f5-4725-b05b-ac470e6db370 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.635724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-785e8e70-59f5-4725-b05b-ac470e6db370 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:39:40.843705 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-785e8e70-59f5-4725-b05b-ac470e6db370 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 204 len: 0 microversion: 2.1 time: 0.281643 May 19 04:39:40.847198 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1062/2060] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:39:40 2022] DELETE /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:39:40.856695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:40.858082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] [instance: 99310c06-abbf-4e4f-b3c4-4b686b2f6139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:40.878398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.879627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.880841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.881768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.922167 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] HTTP exception thrown: Instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 could not be found. May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Request method failure captured: May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 HTTP/1.1 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcg0RFjMAPzZNe6AaoYRsLgtq0HUSW-mWHffkxrGhBjwCGGhg63YZBHFU8lLkl1FlXqLpb5d70_kw-EpAWGKzzLG3KH1K_WWf4ub9ZlIQ4zoqPUQSHIKagCTCYKJJvXALpYq2BzRtrhBv9JkaKruEAaWhxHTKRoGBdcOdSkAgsWfjFY May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.25 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 6d01f77aa473464b8e32d47e9b9d2a98 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6d01f77aa473464b8e32d47e9b9d2a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 6d01f77aa473464b8e32d47e9b9d2a98 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105 May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-LiveAutoBlockMigrationV225Test-1514156105-project May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 249e284f0cfe4ecda820efeb5956701f May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1514156105-project May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 could not be found. May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '99310c06-abbf-4e4f-b3c4-4b686b2f6139'} May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 could not be found. May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 could not be found. May 19 04:39:40.925150 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.931166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:40.931166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.931166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:40.931166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:40.931166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:40.931166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:40.931166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:40.931166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 could not be found. May 19 04:39:40.931166 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:40.934892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] Returning 404 to user: Instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:40.937028 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-269e49ad-3e4a-44fd-81ce-6432213d95db tempest-LiveAutoBlockMigrationV225Test-1514156105 tempest-LiveAutoBlockMigrationV225Test-1514156105-project] 10.222.0.58 "GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139" status: 404 len: 111 microversion: 2.25 time: 0.091276 May 19 04:39:40.940824 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1063/2061] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:40 2022] GET /compute/v2.1/servers/99310c06-abbf-4e4f-b3c4-4b686b2f6139 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:39:40.954084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:40.955008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:40.971681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.974991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:40.975978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:40.978038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:41.090150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3be11b8c-a354-4e56-8ca3-85c3f0dee5e9 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:41.103448 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3be11b8c-a354-4e56-8ca3-85c3f0dee5e9 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1317 microversion: 2.1 time: 1.032830 May 19 04:39:41.104049 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 999/2062] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:40 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1317 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:41.108996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c2a2f92c-20e2-4bc1-9591-0ac9902d22e1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] Calling method '.version_select at 0x7fd315c43d30>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:41.153436 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c2a2f92c-20e2-4bc1-9591-0ac9902d22e1 tempest-ServersTestManualDisk-1243475172 tempest-ServersTestManualDisk-1243475172-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337937475" status: 202 len: 0 microversion: 2.1 time: 0.047814 May 19 04:39:41.154613 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1000/2063] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:39:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337937475 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:39:41.178546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-309814bf-839f-403c-9094-cf56770a6d5e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:41.181498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-309814bf-839f-403c-9094-cf56770a6d5e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:41.193374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-309814bf-839f-403c-9094-cf56770a6d5e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:41.195622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-309814bf-839f-403c-9094-cf56770a6d5e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:41.197937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-309814bf-839f-403c-9094-cf56770a6d5e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:41.198758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-309814bf-839f-403c-9094-cf56770a6d5e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:41.562426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-309814bf-839f-403c-9094-cf56770a6d5e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:41.571389 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-309814bf-839f-403c-9094-cf56770a6d5e tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1472 microversion: 2.1 time: 0.414607 May 19 04:39:41.588473 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1001/2064] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:41 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1472 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:41.596694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ad23f85a-9dac-4237-b564-e7398276dc99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:41.597606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ad23f85a-9dac-4237-b564-e7398276dc99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:41.606323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad23f85a-9dac-4237-b564-e7398276dc99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:41.607022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad23f85a-9dac-4237-b564-e7398276dc99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:41.607986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad23f85a-9dac-4237-b564-e7398276dc99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:41.608914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad23f85a-9dac-4237-b564-e7398276dc99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:41.701305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:41.717297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:41.718822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:41.720020 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fc92bed8-1b5e-449a-a478-2c095d03c65f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.777994 May 19 04:39:41.720587 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1064/2065] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:40 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:41.733452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:41.737287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:41.738201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:41.756263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=20 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:41.757170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:41.757895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:41.759592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:41.760285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:43.042893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ad23f85a-9dac-4237-b564-e7398276dc99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:43.047321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:43.057140 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ad23f85a-9dac-4237-b564-e7398276dc99 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1507 microversion: 2.1 time: 1.467239 May 19 04:39:43.059408 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1002/2066] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:41 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1507 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:43.064668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bc38a11a-5d7c-4f7b-9820-391c5dc3bf83 req-62b4cbac-3aa5-4b54-83e5-fbf0a020b29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99310c06-abbf-4e4f-b3c4-4b686b2f6139", "name": "network-vif-deleted", "tag": "bd629c36-b208-4288-ae36-bf8a28f018d8"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:43.075843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bc38a11a-5d7c-4f7b-9820-391c5dc3bf83 req-62b4cbac-3aa5-4b54-83e5-fbf0a020b29a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:43.076696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bc38a11a-5d7c-4f7b-9820-391c5dc3bf83 req-62b4cbac-3aa5-4b54-83e5-fbf0a020b29a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:43.095782 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bc38a11a-5d7c-4f7b-9820-391c5dc3bf83 req-62b4cbac-3aa5-4b54-83e5-fbf0a020b29a service nova] Creating event network-vif-deleted:bd629c36-b208-4288-ae36-bf8a28f018d8 for instance 99310c06-abbf-4e4f-b3c4-4b686b2f6139 on n-h2-766726-30 May 19 04:39:43.104459 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bc38a11a-5d7c-4f7b-9820-391c5dc3bf83 req-62b4cbac-3aa5-4b54-83e5-fbf0a020b29a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043554 May 19 04:39:43.105667 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1003/2067] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:43.112825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2714c993-b382-4a10-86f5-91a2590ca954 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:43.115215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2714c993-b382-4a10-86f5-91a2590ca954 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:43.126308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2714c993-b382-4a10-86f5-91a2590ca954 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:43.127004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2714c993-b382-4a10-86f5-91a2590ca954 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:43.128142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2714c993-b382-4a10-86f5-91a2590ca954 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:43.129037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2714c993-b382-4a10-86f5-91a2590ca954 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:43.478472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2714c993-b382-4a10-86f5-91a2590ca954 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:43.494152 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2714c993-b382-4a10-86f5-91a2590ca954 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1183 microversion: 2.1 time: 0.384251 May 19 04:39:43.495129 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1004/2068] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:43 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:43.500602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-63f203a8-a9ec-4a10-8495-a4f3ddf5129e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:43.501680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-63f203a8-a9ec-4a10-8495-a4f3ddf5129e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:43.509887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63f203a8-a9ec-4a10-8495-a4f3ddf5129e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:43.510598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63f203a8-a9ec-4a10-8495-a4f3ddf5129e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:43.512247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63f203a8-a9ec-4a10-8495-a4f3ddf5129e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:43.512882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63f203a8-a9ec-4a10-8495-a4f3ddf5129e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:43.565861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:43.575740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:43.577279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:43.578764 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-52499307-5ee9-4dc3-8b83-ec0472b997d4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 1.846433 May 19 04:39:43.579502 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1065/2069] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:41 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:43.583899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-eb444a6f-7736-40de-8140-a3d3e9b32235 req-64cae6c8-9cfc-406e-92df-2b7fa8f282df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "tag": "ae40130a-66c8-4231-8905-bf545db96c13"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:43.599041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-eb444a6f-7736-40de-8140-a3d3e9b32235 req-64cae6c8-9cfc-406e-92df-2b7fa8f282df service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:43.599779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-eb444a6f-7736-40de-8140-a3d3e9b32235 req-64cae6c8-9cfc-406e-92df-2b7fa8f282df service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:43.613261 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-eb444a6f-7736-40de-8140-a3d3e9b32235 req-64cae6c8-9cfc-406e-92df-2b7fa8f282df service nova] Creating event network-changed:ae40130a-66c8-4231-8905-bf545db96c13 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:39:43.620622 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-eb444a6f-7736-40de-8140-a3d3e9b32235 req-64cae6c8-9cfc-406e-92df-2b7fa8f282df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039428 May 19 04:39:43.621731 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1066/2070] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:43.627748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98d99fdb-cabb-402b-80bd-e8f387a2f9ca tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:43.628455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-98d99fdb-cabb-402b-80bd-e8f387a2f9ca tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:43.636176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98d99fdb-cabb-402b-80bd-e8f387a2f9ca tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:43.636559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98d99fdb-cabb-402b-80bd-e8f387a2f9ca tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:43.637441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98d99fdb-cabb-402b-80bd-e8f387a2f9ca tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:43.638069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98d99fdb-cabb-402b-80bd-e8f387a2f9ca tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:44.169175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-63f203a8-a9ec-4a10-8495-a4f3ddf5129e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:44.177947 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-63f203a8-a9ec-4a10-8495-a4f3ddf5129e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1317 microversion: 2.1 time: 0.681345 May 19 04:39:44.178808 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1005/2071] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:43 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1317 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:44.184448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:44.185421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:44.194436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:44.195108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:44.196493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:44.197165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:44.300792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-98d99fdb-cabb-402b-80bd-e8f387a2f9ca tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:44.308424 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-98d99fdb-cabb-402b-80bd-e8f387a2f9ca tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1472 microversion: 2.1 time: 0.685277 May 19 04:39:44.309298 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1067/2072] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:43 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1472 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:44.313919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e4f73cb-0a70-498f-9adb-6901d2e6d99e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:44.314708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7e4f73cb-0a70-498f-9adb-6901d2e6d99e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:44.321579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e4f73cb-0a70-498f-9adb-6901d2e6d99e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:44.322249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e4f73cb-0a70-498f-9adb-6901d2e6d99e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:44.323007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e4f73cb-0a70-498f-9adb-6901d2e6d99e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:44.324394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e4f73cb-0a70-498f-9adb-6901d2e6d99e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:44.941125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:44.970046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:44.972962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:44.975695 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a6f1ecad-abf0-4fbe-ba71-c745f2f83184 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.795686 May 19 04:39:44.991039 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1006/2073] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:44 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:45.002407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-618d4ce1-662a-4e2a-8d47-10a1c2b0ce44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:45.003276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-618d4ce1-662a-4e2a-8d47-10a1c2b0ce44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:45.020169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-618d4ce1-662a-4e2a-8d47-10a1c2b0ce44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:45.020623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-618d4ce1-662a-4e2a-8d47-10a1c2b0ce44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:45.021447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-618d4ce1-662a-4e2a-8d47-10a1c2b0ce44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:45.022109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-618d4ce1-662a-4e2a-8d47-10a1c2b0ce44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:45.063038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7e4f73cb-0a70-498f-9adb-6901d2e6d99e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:45.071471 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e4f73cb-0a70-498f-9adb-6901d2e6d99e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1507 microversion: 2.1 time: 0.760871 May 19 04:39:45.072691 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1068/2074] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:44 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1507 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:45.086218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:45.086886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:45.093733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:45.094458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:45.095429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:45.096053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:45.637233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-618d4ce1-662a-4e2a-8d47-10a1c2b0ce44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:45.646473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-618d4ce1-662a-4e2a-8d47-10a1c2b0ce44 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1183 microversion: 2.1 time: 0.653808 May 19 04:39:45.647669 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1007/2075] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:44 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1183 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:45.652589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-789cbde9-71a3-44e9-942f-f58bebc6e163 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:45.653979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-789cbde9-71a3-44e9-942f-f58bebc6e163 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:45.660551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-789cbde9-71a3-44e9-942f-f58bebc6e163 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:45.661010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-789cbde9-71a3-44e9-942f-f58bebc6e163 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:45.661831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-789cbde9-71a3-44e9-942f-f58bebc6e163 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:45.662273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-789cbde9-71a3-44e9-942f-f58bebc6e163 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:45.847468 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-789cbde9-71a3-44e9-942f-f58bebc6e163 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "PUT /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1079 microversion: 2.1 time: 0.198664 May 19 04:39:45.853248 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1008/2076] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 04:39:45 2022] PUT /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1079 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:45.861501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a30123ba-23f1-4057-b059-a8939e8330c4 req-1514fe9b-44c3-4b9f-9e2d-70e94ab3a775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1", "tag": "935fb3b9-60f2-42b5-8103-989ebd060dbd"}, {"server_uuid": "e626b1ac-a89d-4758-84dd-4367faa06cde", "name": "network-vif-deleted", "tag": "47a0a6f7-38c1-49aa-a777-018dbc91cb33"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:45.881027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a30123ba-23f1-4057-b059-a8939e8330c4 req-1514fe9b-44c3-4b9f-9e2d-70e94ab3a775 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:45.885233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a30123ba-23f1-4057-b059-a8939e8330c4 req-1514fe9b-44c3-4b9f-9e2d-70e94ab3a775 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:45.911362 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a30123ba-23f1-4057-b059-a8939e8330c4 req-1514fe9b-44c3-4b9f-9e2d-70e94ab3a775 service nova] Creating event network-changed:935fb3b9-60f2-42b5-8103-989ebd060dbd for instance d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 on n-h1-766726-30 May 19 04:39:45.914081 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a30123ba-23f1-4057-b059-a8939e8330c4 req-1514fe9b-44c3-4b9f-9e2d-70e94ab3a775 service nova] Creating event network-vif-deleted:47a0a6f7-38c1-49aa-a777-018dbc91cb33 for instance e626b1ac-a89d-4758-84dd-4367faa06cde on n-h1-766726-30 May 19 04:39:45.928915 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a30123ba-23f1-4057-b059-a8939e8330c4 req-1514fe9b-44c3-4b9f-9e2d-70e94ab3a775 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070840 May 19 04:39:45.930143 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1009/2077] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:45.940071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-de7eb11a-903c-4c23-952e-f95b352f81e6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:45.954673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-de7eb11a-903c-4c23-952e-f95b352f81e6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:45.969886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de7eb11a-903c-4c23-952e-f95b352f81e6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:45.970727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de7eb11a-903c-4c23-952e-f95b352f81e6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:45.972234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de7eb11a-903c-4c23-952e-f95b352f81e6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:45.972975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de7eb11a-903c-4c23-952e-f95b352f81e6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:46.383144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:46.387881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:46.397097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:46.409944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:46.411440 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e9871a1b-593d-4c86-bf45-6f1c919a7e2e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 1.337588 May 19 04:39:46.426535 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1069/2078] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:45 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:46.432110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:46.440910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:46.459490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:46.464963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:46.467378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:46.471399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:46.523739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-de7eb11a-903c-4c23-952e-f95b352f81e6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:46.533624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:46.534088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:46.534560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lazy-loading 'fault' on Instance uuid e626b1ac-a89d-4758-84dd-4367faa06cde {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:39:46.552927 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-de7eb11a-903c-4c23-952e-f95b352f81e6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1317 microversion: 2.1 time: 0.620476 May 19 04:39:46.571394 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1010/2079] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:45 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:46.577708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-68b22c6f-f0eb-4458-b16a-fbd9295987ea req-f9d6681b-ddbf-45ed-b738-fff3bfe45daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "tag": "081b7f90-40d2-45cb-88dd-efe0b2900ed6"}, {"name": "network-changed", "server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "tag": "8dc19ac8-4427-4f73-aaa7-05481bc13e94"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:46.598560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-68b22c6f-f0eb-4458-b16a-fbd9295987ea req-f9d6681b-ddbf-45ed-b738-fff3bfe45daf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:46.598808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-68b22c6f-f0eb-4458-b16a-fbd9295987ea req-f9d6681b-ddbf-45ed-b738-fff3bfe45daf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:46.627285 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-68b22c6f-f0eb-4458-b16a-fbd9295987ea req-f9d6681b-ddbf-45ed-b738-fff3bfe45daf service nova] Creating event network-changed:081b7f90-40d2-45cb-88dd-efe0b2900ed6 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:39:46.628204 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-68b22c6f-f0eb-4458-b16a-fbd9295987ea req-f9d6681b-ddbf-45ed-b738-fff3bfe45daf service nova] Creating event network-changed:8dc19ac8-4427-4f73-aaa7-05481bc13e94 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:39:46.641976 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-68b22c6f-f0eb-4458-b16a-fbd9295987ea req-f9d6681b-ddbf-45ed-b738-fff3bfe45daf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.067803 May 19 04:39:46.643641 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1011/2080] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:46.650934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2ac8cbe-46aa-4e9c-aa47-b522d8036a01 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:46.653491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b2ac8cbe-46aa-4e9c-aa47-b522d8036a01 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:46.663881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ac8cbe-46aa-4e9c-aa47-b522d8036a01 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:46.664327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ac8cbe-46aa-4e9c-aa47-b522d8036a01 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:46.666320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ac8cbe-46aa-4e9c-aa47-b522d8036a01 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:46.670290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ac8cbe-46aa-4e9c-aa47-b522d8036a01 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:46.829796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4796ef3b2154a949d6b966e99055595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381315a73f7f4999bfcc59ebcb6c4771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:46.843087 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-42e71614-a2be-4721-8333-3e12a7cd9638 tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 200 len: 1306 microversion: 2.1 time: 0.415015 May 19 04:39:46.844881 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1070/2081] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:46 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 1306 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:46.851131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:46.852974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:46.881935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:46.882638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:46.885804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:46.887274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:47.359707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b2ac8cbe-46aa-4e9c-aa47-b522d8036a01 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:47.373258 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b2ac8cbe-46aa-4e9c-aa47-b522d8036a01 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1505 microversion: 2.1 time: 0.727942 May 19 04:39:47.374893 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1012/2082] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:46 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1505 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:47.382261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c2fa56e6-cd36-4727-82a9-34eed2aa7cb6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:47.383313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c2fa56e6-cd36-4727-82a9-34eed2aa7cb6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:47.394843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2fa56e6-cd36-4727-82a9-34eed2aa7cb6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:47.395680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2fa56e6-cd36-4727-82a9-34eed2aa7cb6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:47.397398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2fa56e6-cd36-4727-82a9-34eed2aa7cb6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:47.398477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2fa56e6-cd36-4727-82a9-34eed2aa7cb6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:47.514536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:47.541278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:47.548951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:47.550427 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6cb44a7c-21f1-4f8f-8792-148933a85d85 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.704146 May 19 04:39:47.553648 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1071/2083] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:46 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:47.554637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2fa56e6-cd36-4727-82a9-34eed2aa7cb6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:47.566277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-32c8735a-55e0-4e6f-aa44-c8a234d0b4d8 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:47.566911 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c2fa56e6-cd36-4727-82a9-34eed2aa7cb6 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1183 microversion: 2.1 time: 0.190671 May 19 04:39:47.567795 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1013/2084] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:47 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:47.568711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-32c8735a-55e0-4e6f-aa44-c8a234d0b4d8 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:47.575021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:47.583753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32c8735a-55e0-4e6f-aa44-c8a234d0b4d8 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:47.584824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:47.588049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32c8735a-55e0-4e6f-aa44-c8a234d0b4d8 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:47.589104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32c8735a-55e0-4e6f-aa44-c8a234d0b4d8 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:47.590788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32c8735a-55e0-4e6f-aa44-c8a234d0b4d8 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:47.593411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:47.595720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:47.600722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:47.601397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.288937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32c8735a-55e0-4e6f-aa44-c8a234d0b4d8 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:48.307168 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-32c8735a-55e0-4e6f-aa44-c8a234d0b4d8 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1505 microversion: 2.1 time: 0.752154 May 19 04:39:48.313834 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1072/2085] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:47 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1505 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:48.323202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df28dfaf-d2f2-44a6-90f6-5b54bc5fa659 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:48.324441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df28dfaf-d2f2-44a6-90f6-5b54bc5fa659 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:48.340509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df28dfaf-d2f2-44a6-90f6-5b54bc5fa659 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.341433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df28dfaf-d2f2-44a6-90f6-5b54bc5fa659 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.343070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df28dfaf-d2f2-44a6-90f6-5b54bc5fa659 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.343744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df28dfaf-d2f2-44a6-90f6-5b54bc5fa659 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.410422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:48.420732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:48.422548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:48.423915 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bb4bdcc7-a1a6-4755-aba4-45835bfafd87 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.853247 May 19 04:39:48.435454 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1014/2086] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:47 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:48.440491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:48.441371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] [instance: e626b1ac-a89d-4758-84dd-4367faa06cde] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:48.447664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.448332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.449307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.449914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.465274 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] HTTP exception thrown: Instance e626b1ac-a89d-4758-84dd-4367faa06cde could not be found. May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Request method failure captured: May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde HTTP/1.1 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihclRoW7E27Xam7UhIYUqTz0omQCd52r-1-9bqqfF23c3JDxaoOoqvok9Sn0wLu7UK-BhTck9LqHJWadsecu-YmtpQUu0odDmQdPJDmi4o3qwTfKN4NmpuMtiltNPmTr3i6o3b-a4zhsUDEp6_TShxAuF2mL2R8JOVjMGMgptpEhryBI May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_381315a73f7f4999bfcc59ebcb6c4771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 381315a73f7f4999bfcc59ebcb6c4771 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1137719215 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d4796ef3b2154a949d6b966e99055595 May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersOnMultiNodesTest-1137719215-project May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance e626b1ac-a89d-4758-84dd-4367faa06cde could not be found. May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'e626b1ac-a89d-4758-84dd-4367faa06cde'} May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e626b1ac-a89d-4758-84dd-4367faa06cde could not be found. May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e626b1ac-a89d-4758-84dd-4367faa06cde could not be found. May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:48.466913 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e626b1ac-a89d-4758-84dd-4367faa06cde could not be found. May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] Returning 404 to user: Instance e626b1ac-a89d-4758-84dd-4367faa06cde could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7654592c-004e-4a88-9b46-815f1cd40a0c tempest-ServersOnMultiNodesTest-1137719215 tempest-ServersOnMultiNodesTest-1137719215-project] 10.222.0.58 "GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde" status: 404 len: 111 microversion: 2.1 time: 0.031646 May 19 04:39:48.472779 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1015/2087] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:48 2022] GET /compute/v2.1/servers/e626b1ac-a89d-4758-84dd-4367faa06cde => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:48.476547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:48.479470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:48.491693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.492523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.495617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.497173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.640639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:39:48.641402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:39:48.641874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:39:48.642584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:39:48.643153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:39:48.716977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-df28dfaf-d2f2-44a6-90f6-5b54bc5fa659 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:48.719414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:48.725720 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df28dfaf-d2f2-44a6-90f6-5b54bc5fa659 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1317 microversion: 2.1 time: 0.410463 May 19 04:39:48.727720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.728396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.735271 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1073/2088] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:48 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:48.742502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.743024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.782461 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1bbc6c17-184d-41ca-930c-333b901f6f18 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "POST /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77/action" status: 202 len: 1111 microversion: 2.1 time: 0.309435 May 19 04:39:48.784082 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1016/2089] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:39:48 2022] POST /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77/action => generated 1111 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 19 04:39:48.804437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:48.807046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:48.819070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.819522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:48.822544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:48.822999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:49.230787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:49.233444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-493799340", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:49.239775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:49.241291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:49.242462 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c466fda4-2167-4e67-b9bd-4adda621787c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.456892 May 19 04:39:49.259914 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1017/2090] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:48 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:49.281539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-354d1017-acac-4e59-8809-4dc587bba9ab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:49.282608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-354d1017-acac-4e59-8809-4dc587bba9ab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:49.304367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-354d1017-acac-4e59-8809-4dc587bba9ab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:49.308594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-354d1017-acac-4e59-8809-4dc587bba9ab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:49.314617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-354d1017-acac-4e59-8809-4dc587bba9ab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:49.315348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-354d1017-acac-4e59-8809-4dc587bba9ab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:49.321606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:39:49.723942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-354d1017-acac-4e59-8809-4dc587bba9ab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:49.747771 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-354d1017-acac-4e59-8809-4dc587bba9ab tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1183 microversion: 2.1 time: 0.483182 May 19 04:39:49.748769 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1018/2091] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:49 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1183 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:49.753965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0f0e1650-7c78-42da-8b5a-d853649d81a6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:49.754802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0f0e1650-7c78-42da-8b5a-d853649d81a6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:49.765625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f0e1650-7c78-42da-8b5a-d853649d81a6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:49.768801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f0e1650-7c78-42da-8b5a-d853649d81a6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:49.769844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f0e1650-7c78-42da-8b5a-d853649d81a6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:49.771135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f0e1650-7c78-42da-8b5a-d853649d81a6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:49.814778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:50.351511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0f0e1650-7c78-42da-8b5a-d853649d81a6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:50.371745 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0f0e1650-7c78-42da-8b5a-d853649d81a6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1516 microversion: 2.1 time: 0.621387 May 19 04:39:50.373068 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1019/2092] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:49 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1516 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:50.391958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:50.392826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:50.403295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:50.403824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:50.407035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:50.407804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:50.441122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:39:50.442368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:39:50.443613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:39:50.453431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:39:50.453880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:39:50.482103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:50.482478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:50.484449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:50.485388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:50.523785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:50.537367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Getting quotas for project 57c8b320a11d43269f93125f76d2221a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:39:50.554230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Getting quotas for user 1470c059ef4e4e87a114209a9c934b6f and project 57c8b320a11d43269f93125f76d2221a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:39:50.580244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:39:50.598405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:39:50.691489 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-543ed5e1-6f05-476b-883a-03a74a08c9b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.954421 May 19 04:39:50.692538 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1074/2093] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:39:50.701167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3c68205e-0ce8-43a5-b1ba-ffbd5dce6d6a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:50.703948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3c68205e-0ce8-43a5-b1ba-ffbd5dce6d6a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:50.738808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c68205e-0ce8-43a5-b1ba-ffbd5dce6d6a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:50.740915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c68205e-0ce8-43a5-b1ba-ffbd5dce6d6a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:50.742227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c68205e-0ce8-43a5-b1ba-ffbd5dce6d6a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:50.743030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c68205e-0ce8-43a5-b1ba-ffbd5dce6d6a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:51.228559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:51.272082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:51.276500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:51.281021 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2de9ac94-b0b4-4b9a-a91e-25aaa142b521 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.906713 May 19 04:39:51.283981 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1020/2094] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:50 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:51.299124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:51.299753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:51.313553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3c68205e-0ce8-43a5-b1ba-ffbd5dce6d6a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:51.319124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:51.319848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:51.322066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:51.325741 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3c68205e-0ce8-43a5-b1ba-ffbd5dce6d6a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1317 microversion: 2.1 time: 0.628200 May 19 04:39:51.329504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:51.335267 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1075/2095] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:50 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1317 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:51.344288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef59279d-8623-4a1a-90b9-8447f3bbae35 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:51.350041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef59279d-8623-4a1a-90b9-8447f3bbae35 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:51.478974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ef59279d-8623-4a1a-90b9-8447f3bbae35 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:51.486811 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef59279d-8623-4a1a-90b9-8447f3bbae35 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1218 microversion: 2.1 time: 0.150052 May 19 04:39:51.488168 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1076/2096] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:51 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:51.506401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0af3b554-be49-431b-833e-3e2984b61393 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:51.507200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0af3b554-be49-431b-833e-3e2984b61393 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:51.514030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af3b554-be49-431b-833e-3e2984b61393 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:51.514643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af3b554-be49-431b-833e-3e2984b61393 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:51.515508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af3b554-be49-431b-833e-3e2984b61393 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:51.516777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af3b554-be49-431b-833e-3e2984b61393 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:51.843451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:51.861010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0af3b554-be49-431b-833e-3e2984b61393 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:51.872816 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0af3b554-be49-431b-833e-3e2984b61393 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 200 len: 1183 microversion: 2.1 time: 0.370377 May 19 04:39:51.873452 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1077/2097] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:51 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 1183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:51.874078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:51.881848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:51.886748 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a6ab2d57-145c-4a84-86d4-e36449967f71 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.599616 May 19 04:39:51.887569 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1021/2098] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:51 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:51.892395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-932b1582-4e49-4b79-b3a6-b2382d4991d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:51.896898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-932b1582-4e49-4b79-b3a6-b2382d4991d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:51.899986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f161a59f-471d-4087-a62f-0387a5c5077d req-4e3a7776-4cd5-492b-8537-3d0a7d910e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1", "name": "network-vif-plugged", "status": "completed", "tag": "935fb3b9-60f2-42b5-8103-989ebd060dbd"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:51.911292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-932b1582-4e49-4b79-b3a6-b2382d4991d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:51.911808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-932b1582-4e49-4b79-b3a6-b2382d4991d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:51.912536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-932b1582-4e49-4b79-b3a6-b2382d4991d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:51.912981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-932b1582-4e49-4b79-b3a6-b2382d4991d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:51.929442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f161a59f-471d-4087-a62f-0387a5c5077d req-4e3a7776-4cd5-492b-8537-3d0a7d910e6b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:51.929942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f161a59f-471d-4087-a62f-0387a5c5077d req-4e3a7776-4cd5-492b-8537-3d0a7d910e6b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:51.961121 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f161a59f-471d-4087-a62f-0387a5c5077d req-4e3a7776-4cd5-492b-8537-3d0a7d910e6b service nova] Creating event network-vif-plugged:935fb3b9-60f2-42b5-8103-989ebd060dbd for instance d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 on n-h1-766726-30 May 19 04:39:51.982831 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f161a59f-471d-4087-a62f-0387a5c5077d req-4e3a7776-4cd5-492b-8537-3d0a7d910e6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093260 May 19 04:39:51.983519 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1022/2099] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:52.301727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:52.302515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:52.323309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:52.323931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:52.325646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:52.326100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:52.406577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-932b1582-4e49-4b79-b3a6-b2382d4991d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:52.415794 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-932b1582-4e49-4b79-b3a6-b2382d4991d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1516 microversion: 2.1 time: 0.532418 May 19 04:39:52.420298 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1078/2100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:51 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1516 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:52.425860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cdb63520-3299-4cd0-b221-b6fd69667283 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:52.435105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cdb63520-3299-4cd0-b221-b6fd69667283 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:52.452013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cdb63520-3299-4cd0-b221-b6fd69667283 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:52.452801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cdb63520-3299-4cd0-b221-b6fd69667283 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:52.453822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cdb63520-3299-4cd0-b221-b6fd69667283 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:52.454501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cdb63520-3299-4cd0-b221-b6fd69667283 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:52.965606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cdb63520-3299-4cd0-b221-b6fd69667283 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:52.973173 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cdb63520-3299-4cd0-b221-b6fd69667283 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1317 microversion: 2.1 time: 0.551054 May 19 04:39:52.979833 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1079/2101] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:52 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:52.990167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98d3cbfc-f4ee-4e8f-a2b8-9b7273c97ee4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:52.991037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-98d3cbfc-f4ee-4e8f-a2b8-9b7273c97ee4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:53.010606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98d3cbfc-f4ee-4e8f-a2b8-9b7273c97ee4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:53.011370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98d3cbfc-f4ee-4e8f-a2b8-9b7273c97ee4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:53.013022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98d3cbfc-f4ee-4e8f-a2b8-9b7273c97ee4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:53.013670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98d3cbfc-f4ee-4e8f-a2b8-9b7273c97ee4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:53.220558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-98d3cbfc-f4ee-4e8f-a2b8-9b7273c97ee4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:53.232774 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-98d3cbfc-f4ee-4e8f-a2b8-9b7273c97ee4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1276 microversion: 2.1 time: 0.251750 May 19 04:39:53.233483 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1080/2102] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:52 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:53.246143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:53.256282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:53.257448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:53.273018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:53.273728 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:53.275539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:53.277269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:53.280509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:53.281115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:53.285907 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d800008-7bdf-4619-97d0-d68041ddea2d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.989816 May 19 04:39:53.288951 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1023/2103] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:52 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:53.315732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:53.316471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:53.345023 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] HTTP exception thrown: Instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 could not be found. May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Request method failure captured: May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 HTTP/1.1 May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchT7h-6a02Rw3HRYmqQi_9QypgwZOm9yQbqrNw5mZhQx1wosfqi5zmGumOtd-06fKRAM-oI45zczLGHk2vCQ1-ncAD7KNIHUslU87F2TgfGWPdj3aLZ5e8vVIgeb0hMHtMCeCS2ZspNgXz2hltRjRv45h9jZjDpA91kSALApkcmbRk May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: b2425f9ddc1548958d45215e83aed84e May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-LiveMigrationTest-1115174210 May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-LiveMigrationTest-1115174210 May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: b2425f9ddc1548958d45215e83aed84e May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-LiveMigrationTest-1115174210 May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-LiveMigrationTest-1115174210-project May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 75f651a13b474f09aa3877d1d66b8fc5 May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-LiveMigrationTest-1115174210-project May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 could not be found. May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3'} May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 could not be found. May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 could not be found. May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:39:53.346783 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:53.352668 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:39:53.352668 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:39:53.352668 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:39:53.352668 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:39:53.352668 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:39:53.352668 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 could not be found. May 19 04:39:53.352668 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:39:53.352668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Returning 404 to user: Instance a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:39:53.352668 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-24ed70bd-c89d-441e-ae86-a1a9609f580e tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3" status: 404 len: 111 microversion: 2.1 time: 0.108950 May 19 04:39:53.356095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:53.356224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:53.356979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:53.357464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:53.360398 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1081/2104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:53 2022] GET /compute/v2.1/servers/a1bbd79e-9240-423b-9e3a-8a1eb9a5efe3 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:39:53.436863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8568a80-72a0-4628-bf98-5f17cd733eea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:53.437922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8568a80-72a0-4628-bf98-5f17cd733eea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:53.448921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8568a80-72a0-4628-bf98-5f17cd733eea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:53.467236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8568a80-72a0-4628-bf98-5f17cd733eea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:53.468129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8568a80-72a0-4628-bf98-5f17cd733eea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:53.468603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8568a80-72a0-4628-bf98-5f17cd733eea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:54.221287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:54.232517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:54.261261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:54.262713 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3831891-0ae5-473e-8d37-1c4a3111358e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.968409 May 19 04:39:54.273460 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1024/2105] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:53 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:54.282442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5da7b0b9-5af6-4af7-bdf8-3ba1edcbd118 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:54.283071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5da7b0b9-5af6-4af7-bdf8-3ba1edcbd118 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:54.303715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5da7b0b9-5af6-4af7-bdf8-3ba1edcbd118 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:54.304176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5da7b0b9-5af6-4af7-bdf8-3ba1edcbd118 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:54.304972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5da7b0b9-5af6-4af7-bdf8-3ba1edcbd118 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:54.305483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5da7b0b9-5af6-4af7-bdf8-3ba1edcbd118 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:54.414362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8568a80-72a0-4628-bf98-5f17cd733eea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:54.445458 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8568a80-72a0-4628-bf98-5f17cd733eea tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1516 microversion: 2.1 time: 1.007698 May 19 04:39:54.446175 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1082/2106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:53 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1516 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:39:54.460772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e581169c-6d3f-4be1-b193-5c4d4f4461ba req-b3c5ac0f-02de-4254-8272-150a0bf3af5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-plugged", "status": "completed", "tag": "1b45fa40-6dea-450d-9ca3-5940db1c12bf"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:54.489756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e581169c-6d3f-4be1-b193-5c4d4f4461ba req-b3c5ac0f-02de-4254-8272-150a0bf3af5a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:54.489756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e581169c-6d3f-4be1-b193-5c4d4f4461ba req-b3c5ac0f-02de-4254-8272-150a0bf3af5a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:54.510668 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e581169c-6d3f-4be1-b193-5c4d4f4461ba req-b3c5ac0f-02de-4254-8272-150a0bf3af5a service nova] Creating event network-vif-plugged:1b45fa40-6dea-450d-9ca3-5940db1c12bf for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:39:54.522317 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e581169c-6d3f-4be1-b193-5c4d4f4461ba req-b3c5ac0f-02de-4254-8272-150a0bf3af5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063002 May 19 04:39:54.522974 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1083/2107] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:54.528819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-606a26ee-1321-492a-b3fa-4de8633db359 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:54.529567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-606a26ee-1321-492a-b3fa-4de8633db359 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:54.550805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-606a26ee-1321-492a-b3fa-4de8633db359 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:54.551263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-606a26ee-1321-492a-b3fa-4de8633db359 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:54.556690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-606a26ee-1321-492a-b3fa-4de8633db359 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:54.557235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-606a26ee-1321-492a-b3fa-4de8633db359 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:54.929209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-606a26ee-1321-492a-b3fa-4de8633db359 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:54.941131 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-606a26ee-1321-492a-b3fa-4de8633db359 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1276 microversion: 2.1 time: 0.416881 May 19 04:39:54.941736 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1084/2108] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:54 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1276 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:54.953974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:54.954673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:54.968616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:54.969098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:54.969909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:54.970366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:55.309882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5da7b0b9-5af6-4af7-bdf8-3ba1edcbd118 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:55.323270 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5da7b0b9-5af6-4af7-bdf8-3ba1edcbd118 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1317 microversion: 2.1 time: 1.048067 May 19 04:39:55.325969 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1025/2109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:54 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1317 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:55.334589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:55.338422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:55.352792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:55.360611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:55.361455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:55.362508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:55.363003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:55.521454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:55.541969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:55.543742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:55.544964 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-db0b1acf-e35a-426d-b397-93b56134849d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.602286 May 19 04:39:55.552622 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1085/2110] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:54 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:55.557658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8c95da23-05de-4b89-9bd6-3715739de32a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:55.558270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8c95da23-05de-4b89-9bd6-3715739de32a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:55.576024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c95da23-05de-4b89-9bd6-3715739de32a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:55.579344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c95da23-05de-4b89-9bd6-3715739de32a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:55.580379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c95da23-05de-4b89-9bd6-3715739de32a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:55.581022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c95da23-05de-4b89-9bd6-3715739de32a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:56.051881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:56.067188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:56.069030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:56.072426 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a1d3ca4a-04c0-4d3e-bba7-d43adb63f2ee tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.745181 May 19 04:39:56.072987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8c95da23-05de-4b89-9bd6-3715739de32a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:56.077339 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1026/2111] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:55 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:56.087013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b7dc93ea-debb-445b-9634-016d76430f44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:56.089793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b7dc93ea-debb-445b-9634-016d76430f44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:56.094972 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8c95da23-05de-4b89-9bd6-3715739de32a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1516 microversion: 2.1 time: 0.541075 May 19 04:39:56.106961 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1086/2112] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:55 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1516 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:56.114548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7dc93ea-debb-445b-9634-016d76430f44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:56.119428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7dc93ea-debb-445b-9634-016d76430f44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:56.120483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7dc93ea-debb-445b-9634-016d76430f44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:56.121180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7dc93ea-debb-445b-9634-016d76430f44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:56.340013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c437892a-7446-4282-9efb-deeac27e0a16 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:56.341227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c437892a-7446-4282-9efb-deeac27e0a16 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:56.356135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c437892a-7446-4282-9efb-deeac27e0a16 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:56.357091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c437892a-7446-4282-9efb-deeac27e0a16 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:56.360423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c437892a-7446-4282-9efb-deeac27e0a16 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:56.361197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c437892a-7446-4282-9efb-deeac27e0a16 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:56.694225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b7dc93ea-debb-445b-9634-016d76430f44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:56.716899 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b7dc93ea-debb-445b-9634-016d76430f44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1318 microversion: 2.1 time: 0.636440 May 19 04:39:56.719483 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1027/2113] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:56 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1318 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:56.761553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:56.763289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:56.801737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:56.802920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:56.803944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:56.807267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:56.918261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c437892a-7446-4282-9efb-deeac27e0a16 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:56.936386 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c437892a-7446-4282-9efb-deeac27e0a16 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1506 microversion: 2.1 time: 0.599262 May 19 04:39:56.943886 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1087/2114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:56 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:39:56.976116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-28aad456-cad2-4683-9e24-002c14803909 req-9e3fe514-f225-4c50-aa6b-d296d0305067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-plugged", "status": "completed", "tag": "c98bb199-4633-4d92-8f73-35d11894ef17"}, {"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-plugged", "status": "completed", "tag": "0d520ead-ade4-471e-93f7-b40ec3e08c30"}, {"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-plugged", "status": "completed", "tag": "a3ad3b69-cf1a-43c4-8bd9-bf577643ec6f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:56.998121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-28aad456-cad2-4683-9e24-002c14803909 req-9e3fe514-f225-4c50-aa6b-d296d0305067 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:56.998812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-28aad456-cad2-4683-9e24-002c14803909 req-9e3fe514-f225-4c50-aa6b-d296d0305067 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:57.027418 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-28aad456-cad2-4683-9e24-002c14803909 req-9e3fe514-f225-4c50-aa6b-d296d0305067 service nova] Creating event network-vif-plugged:c98bb199-4633-4d92-8f73-35d11894ef17 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:39:57.031313 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-28aad456-cad2-4683-9e24-002c14803909 req-9e3fe514-f225-4c50-aa6b-d296d0305067 service nova] Creating event network-vif-plugged:0d520ead-ade4-471e-93f7-b40ec3e08c30 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:39:57.032757 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-28aad456-cad2-4683-9e24-002c14803909 req-9e3fe514-f225-4c50-aa6b-d296d0305067 service nova] Creating event network-vif-plugged:a3ad3b69-cf1a-43c4-8bd9-bf577643ec6f for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:39:57.047674 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-28aad456-cad2-4683-9e24-002c14803909 req-9e3fe514-f225-4c50-aa6b-d296d0305067 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.102162 May 19 04:39:57.049064 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1088/2115] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:57.056738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b389fd0-d273-44c1-a923-1e7fec502bf6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:57.058293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b389fd0-d273-44c1-a923-1e7fec502bf6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:57.067079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b389fd0-d273-44c1-a923-1e7fec502bf6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:57.067861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b389fd0-d273-44c1-a923-1e7fec502bf6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:57.069418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b389fd0-d273-44c1-a923-1e7fec502bf6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:57.070056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b389fd0-d273-44c1-a923-1e7fec502bf6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:57.110994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:39:57.115073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b389fd0-d273-44c1-a923-1e7fec502bf6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:57.116543 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b389fd0-d273-44c1-a923-1e7fec502bf6 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1/os-instance-actions/req-60dc39f7-cff5-41df-83e7-5fc015e43332" status: 200 len: 313 microversion: 2.1 time: 0.066024 May 19 04:39:57.118405 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1089/2116] 10.222.0.58 () {58 vars in 1418 bytes} [Thu May 19 04:39:57 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1/os-instance-actions/req-60dc39f7-cff5-41df-83e7-5fc015e43332 => generated 313 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:39:57.123524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:57.125591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:57.138179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:57.139202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:57.162949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:57.164377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:57.640465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:57.654783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:57.662063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:57.666035 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bae2d78c-ac94-4f28-81c4-fe0e13a14b1a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.944618 May 19 04:39:57.668566 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1028/2117] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:56 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:57.678818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3b3757a0-cfbc-4fa6-ac78-359559ff6823 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:57.681841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3b3757a0-cfbc-4fa6-ac78-359559ff6823 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:57.691134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b3757a0-cfbc-4fa6-ac78-359559ff6823 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:57.693549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b3757a0-cfbc-4fa6-ac78-359559ff6823 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:57.694598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b3757a0-cfbc-4fa6-ac78-359559ff6823 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:57.695159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b3757a0-cfbc-4fa6-ac78-359559ff6823 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:57.808706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:57.825286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:57.827771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:57.829218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b74cabb-8e12-45b2-b43c-1573da8e3764 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.709607 May 19 04:39:57.832876 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1090/2118] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:57 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:39:57.842497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-30f28bb1-3c94-4133-a48c-59cb0b5fda57 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:57.848923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-30f28bb1-3c94-4133-a48c-59cb0b5fda57 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:57.862560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30f28bb1-3c94-4133-a48c-59cb0b5fda57 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:57.863200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30f28bb1-3c94-4133-a48c-59cb0b5fda57 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:57.864344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30f28bb1-3c94-4133-a48c-59cb0b5fda57 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:57.864956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30f28bb1-3c94-4133-a48c-59cb0b5fda57 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:58.019045 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-30f28bb1-3c94-4133-a48c-59cb0b5fda57 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "POST /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.184697 May 19 04:39:58.022394 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1091/2119] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:39:57 2022] POST /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:39:58.157444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3b3757a0-cfbc-4fa6-ac78-359559ff6823 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:58.169195 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3b3757a0-cfbc-4fa6-ac78-359559ff6823 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1516 microversion: 2.1 time: 0.497725 May 19 04:39:58.170056 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1029/2120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:57 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1516 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:58.174965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-10b2e2fa-fde2-4abf-8bf4-b60eac3d9999 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:58.186177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-10b2e2fa-fde2-4abf-8bf4-b60eac3d9999 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:58.193898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10b2e2fa-fde2-4abf-8bf4-b60eac3d9999 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:58.195757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10b2e2fa-fde2-4abf-8bf4-b60eac3d9999 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:58.198068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10b2e2fa-fde2-4abf-8bf4-b60eac3d9999 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:58.206823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10b2e2fa-fde2-4abf-8bf4-b60eac3d9999 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:58.324636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1404678724", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "b80160b5-70f4-4c06-8003-16882a562144"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:39:58.395677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] validate_networks() for [('b80160b5-70f4-4c06-8003-16882a562144', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:39:58.815009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-10b2e2fa-fde2-4abf-8bf4-b60eac3d9999 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:58.837017 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-10b2e2fa-fde2-4abf-8bf4-b60eac3d9999 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1318 microversion: 2.1 time: 0.664678 May 19 04:39:58.838648 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1030/2121] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:58 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:58.848980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31b3b9cb-6141-4cd5-ae12-3b97879f339e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:58.852179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31b3b9cb-6141-4cd5-ae12-3b97879f339e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:58.863608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31b3b9cb-6141-4cd5-ae12-3b97879f339e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:58.864638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31b3b9cb-6141-4cd5-ae12-3b97879f339e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:58.865864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31b3b9cb-6141-4cd5-ae12-3b97879f339e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:58.866555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31b3b9cb-6141-4cd5-ae12-3b97879f339e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:59.869851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31b3b9cb-6141-4cd5-ae12-3b97879f339e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:39:59.879412 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31b3b9cb-6141-4cd5-ae12-3b97879f339e tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1508 microversion: 2.1 time: 1.038210 May 19 04:39:59.889180 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1031/2122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:39:58 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1508 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:39:59.894146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:39:59.894757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:39:59.900852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:59.901551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:39:59.902532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:39:59.903140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:00.159496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:40:00.160000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:40:00.160956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:40:00.161517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:40:00.162050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:40:00.172031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:00.172681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:00.173965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:00.174411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:00.193314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Getting quotas for project 961c8d32b8d5449b859441346fb0b234. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:00.198147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Getting quotas for user 8b053bf022854871a6d4754a546f8582 and project 961c8d32b8d5449b859441346fb0b234. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:00.212936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:40:00.215350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:00.271552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-294a42d1-a3a3-4bff-a8eb-2b67032b2410 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.247327 May 19 04:40:00.272405 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1092/2123] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:39:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:40:00.279600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:00.280240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:00.291960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:00.292450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:00.294784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:00.295247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:00.357766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:00.384236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:00.392850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:00.394899 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-30421353-e30e-4183-b82c-5ac43bda962b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.504445 May 19 04:40:00.397052 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1032/2124] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:39:59 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:00.417736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2180b9e8-8354-415f-ae0d-0a41c7d52159 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:00.419819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2180b9e8-8354-415f-ae0d-0a41c7d52159 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:00.426539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2180b9e8-8354-415f-ae0d-0a41c7d52159 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:00.427056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2180b9e8-8354-415f-ae0d-0a41c7d52159 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:00.427883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2180b9e8-8354-415f-ae0d-0a41c7d52159 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:00.428588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2180b9e8-8354-415f-ae0d-0a41c7d52159 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:00.847482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:00.871606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:00.873169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:00.874672 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f9ae4af1-5447-41fe-a9b2-1d9d11b77710 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.600974 May 19 04:40:00.885571 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1093/2125] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:00 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:00.896630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-10374143-58ff-4240-87d4-42f5ad418c97 req-e6347eb2-fc14-41aa-9c86-0411d431663d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-plugged", "status": "completed", "tag": "4ade1fa2-1f84-447f-bdda-2b80cce5bf66"}, {"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-plugged", "status": "completed", "tag": "0fb435e5-06bc-4971-8e0d-ca6e92a30329"}, {"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-plugged", "status": "completed", "tag": "eadc183f-7173-49b5-b11b-74d6ac02aa3f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:00.906888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-10374143-58ff-4240-87d4-42f5ad418c97 req-e6347eb2-fc14-41aa-9c86-0411d431663d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:00.915447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2180b9e8-8354-415f-ae0d-0a41c7d52159 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:00.915996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-10374143-58ff-4240-87d4-42f5ad418c97 req-e6347eb2-fc14-41aa-9c86-0411d431663d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:00.927639 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2180b9e8-8354-415f-ae0d-0a41c7d52159 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1516 microversion: 2.1 time: 0.528742 May 19 04:40:00.936358 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-10374143-58ff-4240-87d4-42f5ad418c97 req-e6347eb2-fc14-41aa-9c86-0411d431663d service nova] Creating event network-vif-plugged:4ade1fa2-1f84-447f-bdda-2b80cce5bf66 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:40:00.936877 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-10374143-58ff-4240-87d4-42f5ad418c97 req-e6347eb2-fc14-41aa-9c86-0411d431663d service nova] Creating event network-vif-plugged:0fb435e5-06bc-4971-8e0d-ca6e92a30329 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:40:00.937418 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-10374143-58ff-4240-87d4-42f5ad418c97 req-e6347eb2-fc14-41aa-9c86-0411d431663d service nova] Creating event network-vif-plugged:eadc183f-7173-49b5-b11b-74d6ac02aa3f for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:40:00.938696 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1033/2126] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:00 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1516 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:00.955068 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-10374143-58ff-4240-87d4-42f5ad418c97 req-e6347eb2-fc14-41aa-9c86-0411d431663d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.067648 May 19 04:40:00.955707 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1094/2127] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:00.968866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cff9de01-a66b-416c-9989-b8529ef16895 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:00.969621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cff9de01-a66b-416c-9989-b8529ef16895 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:00.987017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cff9de01-a66b-416c-9989-b8529ef16895 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:00.987391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cff9de01-a66b-416c-9989-b8529ef16895 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:00.988197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cff9de01-a66b-416c-9989-b8529ef16895 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:00.993370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cff9de01-a66b-416c-9989-b8529ef16895 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:01.265970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1131130301", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "56a7f773-0e0a-4675-b687-c0077a456785"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:01.323736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] validate_networks() for [('56a7f773-0e0a-4675-b687-c0077a456785', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:40:01.546800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cff9de01-a66b-416c-9989-b8529ef16895 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:01.556245 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cff9de01-a66b-416c-9989-b8529ef16895 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1318 microversion: 2.1 time: 0.599033 May 19 04:40:01.567474 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1095/2128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:00 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:01.574282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-633f040b-1283-45b7-8500-316bece4f7c5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:01.575167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-633f040b-1283-45b7-8500-316bece4f7c5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:01.581581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-633f040b-1283-45b7-8500-316bece4f7c5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:01.582037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-633f040b-1283-45b7-8500-316bece4f7c5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:01.583040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-633f040b-1283-45b7-8500-316bece4f7c5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:01.583497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-633f040b-1283-45b7-8500-316bece4f7c5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:01.669295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-633f040b-1283-45b7-8500-316bece4f7c5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:01.687894 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-633f040b-1283-45b7-8500-316bece4f7c5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1270 microversion: 2.1 time: 0.118831 May 19 04:40:01.688481 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1096/2129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:01 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:01.695880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-400e9a70-2dce-4e53-b030-e97827a23783 req-5a6575ea-8e05-4648-87b4-cff4d01e0148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b3d9b3-2703-4a85-8d75-33f3e571ebcd", "tag": "d96f3070-0604-4f74-a673-446dab173c40"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:01.714946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-400e9a70-2dce-4e53-b030-e97827a23783 req-5a6575ea-8e05-4648-87b4-cff4d01e0148 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:01.715694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-400e9a70-2dce-4e53-b030-e97827a23783 req-5a6575ea-8e05-4648-87b4-cff4d01e0148 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:01.730571 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-400e9a70-2dce-4e53-b030-e97827a23783 req-5a6575ea-8e05-4648-87b4-cff4d01e0148 service nova] Creating event network-changed:d96f3070-0604-4f74-a673-446dab173c40 for instance 06b3d9b3-2703-4a85-8d75-33f3e571ebcd on n-h1-766726-30 May 19 04:40:01.736567 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-400e9a70-2dce-4e53-b030-e97827a23783 req-5a6575ea-8e05-4648-87b4-cff4d01e0148 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045320 May 19 04:40:01.738342 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1097/2130] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:01.746075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-010cd210-e97d-43cc-9c16-51a348e2b964 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:01.747213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-010cd210-e97d-43cc-9c16-51a348e2b964 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:01.756432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-010cd210-e97d-43cc-9c16-51a348e2b964 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:01.757189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-010cd210-e97d-43cc-9c16-51a348e2b964 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:01.759315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-010cd210-e97d-43cc-9c16-51a348e2b964 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:01.760175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-010cd210-e97d-43cc-9c16-51a348e2b964 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:02.234328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:40:02.236429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:40:02.237754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:40:02.238369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:40:02.238659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-010cd210-e97d-43cc-9c16-51a348e2b964 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:02.239180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:40:02.246901 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-010cd210-e97d-43cc-9c16-51a348e2b964 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1506 microversion: 2.1 time: 0.507069 May 19 04:40:02.251343 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1098/2131] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:01 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:02.259363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:02.260242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:02.263442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:02.264336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:02.264772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:02.265927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:02.273601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:02.274325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:02.275281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:02.275899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:02.309552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:02.320381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for user 1e14ea8dad314974bf5f4e8e51b88349 and project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:02.343652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:40:02.345967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:02.398844 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f55a550b-19fb-4d89-a3dc-8ab755ba3857 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.458205 May 19 04:40:02.400510 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1034/2132] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:40:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:40:02.406640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:02.407725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:02.418654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:02.419678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:02.420883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:02.421678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:02.790355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:02.801655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:02.804008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:02.805512 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-31ae13e5-e48a-409f-aa6a-ce03f28f2b30 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1873 microversion: 2.32 time: 0.552907 May 19 04:40:02.817903 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1099/2133] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:02 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1873 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:02.825161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-448dce70-ae16-469e-804c-432ddbac6c2b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:02.826070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-448dce70-ae16-469e-804c-432ddbac6c2b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:02.838614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-448dce70-ae16-469e-804c-432ddbac6c2b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:02.839136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-448dce70-ae16-469e-804c-432ddbac6c2b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:02.839870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-448dce70-ae16-469e-804c-432ddbac6c2b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:02.840423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-448dce70-ae16-469e-804c-432ddbac6c2b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:02.970927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:02.985838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:02.997217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:03.001863 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e51f096-bcb4-4acb-a761-1463c4745cbf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.599429 May 19 04:40:03.016688 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1035/2134] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:02 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:03.028230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-641f6e91-d4b2-4d4f-8c6e-66dcf26163e4 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '.version_select at 0x7fd31b801ca0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:03.029521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-641f6e91-d4b2-4d4f-8c6e-66dcf26163e4 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:03.037679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-641f6e91-d4b2-4d4f-8c6e-66dcf26163e4 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.038134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-641f6e91-d4b2-4d4f-8c6e-66dcf26163e4 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.039236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-641f6e91-d4b2-4d4f-8c6e-66dcf26163e4 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.039640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-641f6e91-d4b2-4d4f-8c6e-66dcf26163e4 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.100413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-641f6e91-d4b2-4d4f-8c6e-66dcf26163e4 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.081654 May 19 04:40:03.101394 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1036/2135] 10.222.0.58 () {58 vars in 1295 bytes} [Thu May 19 04:40:03 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1/os-instance-actions => generated 611 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:03.106227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0598fa25-b692-4d55-a546-4da6a3da2030 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:03.107386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0598fa25-b692-4d55-a546-4da6a3da2030 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:03.110772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-448dce70-ae16-469e-804c-432ddbac6c2b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:03.114301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0598fa25-b692-4d55-a546-4da6a3da2030 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.114911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0598fa25-b692-4d55-a546-4da6a3da2030 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.115869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0598fa25-b692-4d55-a546-4da6a3da2030 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.116471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0598fa25-b692-4d55-a546-4da6a3da2030 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.120501 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-448dce70-ae16-469e-804c-432ddbac6c2b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1516 microversion: 2.1 time: 0.300648 May 19 04:40:03.121829 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1100/2136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:02 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:03.127828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef06deab-038f-49b3-968e-c2728c6d68bd tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:03.128887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef06deab-038f-49b3-968e-c2728c6d68bd tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:03.137660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef06deab-038f-49b3-968e-c2728c6d68bd tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.138682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef06deab-038f-49b3-968e-c2728c6d68bd tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.139835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef06deab-038f-49b3-968e-c2728c6d68bd tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.140605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef06deab-038f-49b3-968e-c2728c6d68bd tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.165374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:03.598616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0598fa25-b692-4d55-a546-4da6a3da2030 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:03.610858 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0598fa25-b692-4d55-a546-4da6a3da2030 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1219 microversion: 2.1 time: 0.507604 May 19 04:40:03.613051 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1037/2137] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:03 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1219 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:03.618907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2dc44ceb-453f-409a-b748-a2bb0d2cc61d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:03.619997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2dc44ceb-453f-409a-b748-a2bb0d2cc61d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:03.635691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2dc44ceb-453f-409a-b748-a2bb0d2cc61d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.636573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2dc44ceb-453f-409a-b748-a2bb0d2cc61d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.637848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2dc44ceb-453f-409a-b748-a2bb0d2cc61d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.638528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2dc44ceb-453f-409a-b748-a2bb0d2cc61d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.731037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ef06deab-038f-49b3-968e-c2728c6d68bd tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:03.739013 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef06deab-038f-49b3-968e-c2728c6d68bd tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1318 microversion: 2.1 time: 0.615928 May 19 04:40:03.754479 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1101/2138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:03 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:03.759400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-69d785b4-a79a-4c22-97f3-4fd965fd776a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:03.759912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-69d785b4-a79a-4c22-97f3-4fd965fd776a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:03.766528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69d785b4-a79a-4c22-97f3-4fd965fd776a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.766985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69d785b4-a79a-4c22-97f3-4fd965fd776a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.767762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69d785b4-a79a-4c22-97f3-4fd965fd776a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.768209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69d785b4-a79a-4c22-97f3-4fd965fd776a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.771872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2dc44ceb-453f-409a-b748-a2bb0d2cc61d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:03.784986 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2dc44ceb-453f-409a-b748-a2bb0d2cc61d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1276 microversion: 2.1 time: 0.170375 May 19 04:40:03.786953 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1038/2139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:03 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:03.817723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-69d785b4-a79a-4c22-97f3-4fd965fd776a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:03.828335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:03.829132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:03.842996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.843616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.846609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.857514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.931104 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-69d785b4-a79a-4c22-97f3-4fd965fd776a tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 204 len: 0 microversion: 2.1 time: 0.174463 May 19 04:40:03.932139 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1102/2140] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:03 2022] DELETE /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:03.941947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-412ea0c0-0958-41f2-9e66-6adb8475f171 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:03.943220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-412ea0c0-0958-41f2-9e66-6adb8475f171 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:03.951117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-412ea0c0-0958-41f2-9e66-6adb8475f171 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.951785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-412ea0c0-0958-41f2-9e66-6adb8475f171 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:03.953253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-412ea0c0-0958-41f2-9e66-6adb8475f171 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:03.953950 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-412ea0c0-0958-41f2-9e66-6adb8475f171 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:04.317020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-412ea0c0-0958-41f2-9e66-6adb8475f171 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:04.351074 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-412ea0c0-0958-41f2-9e66-6adb8475f171 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1512 microversion: 2.1 time: 0.413532 May 19 04:40:04.351965 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1103/2141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:03 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:04.366623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:04.367395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:04.381882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:04.382594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:04.386811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:04.387426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:04.390628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:04.401701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:04.404101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:04.405397 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5e6e9c9e-56a2-415b-92d7-273ddf631edd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2820 microversion: 2.32 time: 0.581504 May 19 04:40:04.406371 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1039/2142] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:03 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2820 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:40:04.415282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d24a789b-537d-48ea-b865-841217eda851 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:04.425877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d24a789b-537d-48ea-b865-841217eda851 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:04.434634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d24a789b-537d-48ea-b865-841217eda851 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:04.435093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d24a789b-537d-48ea-b865-841217eda851 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:04.438818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d24a789b-537d-48ea-b865-841217eda851 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:04.443305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d24a789b-537d-48ea-b865-841217eda851 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:04.836059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d24a789b-537d-48ea-b865-841217eda851 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:04.845570 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d24a789b-537d-48ea-b865-841217eda851 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1516 microversion: 2.1 time: 0.437937 May 19 04:40:04.855181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:04.856494 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1040/2143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:04 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1516 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:04.861795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa8b4ca2-bf0d-46e8-b5f0-90bf5aeabf0c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:04.862491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa8b4ca2-bf0d-46e8-b5f0-90bf5aeabf0c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:04.871383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa8b4ca2-bf0d-46e8-b5f0-90bf5aeabf0c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:04.871836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa8b4ca2-bf0d-46e8-b5f0-90bf5aeabf0c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:04.872621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa8b4ca2-bf0d-46e8-b5f0-90bf5aeabf0c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:04.872747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:04.873062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa8b4ca2-bf0d-46e8-b5f0-90bf5aeabf0c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:04.878473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:04.882541 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-21cb3f9f-f241-4d86-8208-6ede915878c2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.529416 May 19 04:40:04.897618 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1104/2144] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:04 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:04.905252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-97c41483-e853-403f-b1ba-33b23fee922e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:04.907644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-97c41483-e853-403f-b1ba-33b23fee922e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:04.918182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97c41483-e853-403f-b1ba-33b23fee922e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:04.918897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97c41483-e853-403f-b1ba-33b23fee922e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:04.919865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97c41483-e853-403f-b1ba-33b23fee922e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:04.920484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97c41483-e853-403f-b1ba-33b23fee922e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:05.023507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-97c41483-e853-403f-b1ba-33b23fee922e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:05.033572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:05.036600 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-97c41483-e853-403f-b1ba-33b23fee922e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1219 microversion: 2.1 time: 0.137591 May 19 04:40:05.037823 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1105/2145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:04 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:05.044567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f5795ac-2c37-4320-973c-237ce5bb22c4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:05.045721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f5795ac-2c37-4320-973c-237ce5bb22c4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:05.059302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f5795ac-2c37-4320-973c-237ce5bb22c4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:05.060061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f5795ac-2c37-4320-973c-237ce5bb22c4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:05.063262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f5795ac-2c37-4320-973c-237ce5bb22c4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:05.063899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f5795ac-2c37-4320-973c-237ce5bb22c4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:05.103130 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fa8b4ca2-bf0d-46e8-b5f0-90bf5aeabf0c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c/os-interface" status: 200 len: 1827 microversion: 2.32 time: 0.245185 May 19 04:40:05.103737 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1041/2146] 10.222.0.58 () {60 vars in 1315 bytes} [Thu May 19 04:40:04 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c/os-interface => generated 1827 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:05.117762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a124e957-f572-4343-98b2-b748b83e5625 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:05.118702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a124e957-f572-4343-98b2-b748b83e5625 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:05.131232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a124e957-f572-4343-98b2-b748b83e5625 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:05.131682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a124e957-f572-4343-98b2-b748b83e5625 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:05.132471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a124e957-f572-4343-98b2-b748b83e5625 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:05.133052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a124e957-f572-4343-98b2-b748b83e5625 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:05.828989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f5795ac-2c37-4320-973c-237ce5bb22c4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:05.844910 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f5795ac-2c37-4320-973c-237ce5bb22c4 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1318 microversion: 2.1 time: 0.805724 May 19 04:40:05.845961 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1106/2147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:05 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1318 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:05.860404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-053491fd-01a2-471b-b188-8d8c04ae3350 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:05.861958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-053491fd-01a2-471b-b188-8d8c04ae3350 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:05.882715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-053491fd-01a2-471b-b188-8d8c04ae3350 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:05.885211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-053491fd-01a2-471b-b188-8d8c04ae3350 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:05.886774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-053491fd-01a2-471b-b188-8d8c04ae3350 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:05.887238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-053491fd-01a2-471b-b188-8d8c04ae3350 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:06.058348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a124e957-f572-4343-98b2-b748b83e5625 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:06.069564 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a124e957-f572-4343-98b2-b748b83e5625 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.964464 May 19 04:40:06.076252 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1042/2148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:05 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1318 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:06.088281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e6705f9-806d-4281-a8fd-d4830cbb0e1e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:06.089299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e6705f9-806d-4281-a8fd-d4830cbb0e1e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:06.111229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e6705f9-806d-4281-a8fd-d4830cbb0e1e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:06.111997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e6705f9-806d-4281-a8fd-d4830cbb0e1e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:06.115049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e6705f9-806d-4281-a8fd-d4830cbb0e1e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:06.115722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e6705f9-806d-4281-a8fd-d4830cbb0e1e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:07.084174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e6705f9-806d-4281-a8fd-d4830cbb0e1e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:07.093420 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e6705f9-806d-4281-a8fd-d4830cbb0e1e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1522 microversion: 2.1 time: 1.015497 May 19 04:40:07.094027 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1043/2149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:06 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1522 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:07.111228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:07.112158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:07.119989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:07.120733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:07.121763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:07.122382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:07.760505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-053491fd-01a2-471b-b188-8d8c04ae3350 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86edb676803a41b2bd11bda3b33650a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37434a18d2d140a99d6d77f3bf3c8c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:07.773097 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-053491fd-01a2-471b-b188-8d8c04ae3350 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 200 len: 1512 microversion: 2.1 time: 1.925708 May 19 04:40:07.777728 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1107/2150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:05 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 1512 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:07.787813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b8a2e4cb-e354-4fbc-9999-986bd6cdd107 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:07.788614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b8a2e4cb-e354-4fbc-9999-986bd6cdd107 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:07.803102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:07.806158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8a2e4cb-e354-4fbc-9999-986bd6cdd107 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:07.806620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8a2e4cb-e354-4fbc-9999-986bd6cdd107 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:07.807434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8a2e4cb-e354-4fbc-9999-986bd6cdd107 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:07.807873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8a2e4cb-e354-4fbc-9999-986bd6cdd107 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:08.141558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:08.163662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:08.167863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:08.181773 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a100d54d-46a2-468d-b45a-ccca5794650c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 1.066040 May 19 04:40:08.184841 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1044/2151] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:07 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:08.198020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d2da294c-b7a4-47b4-ae99-7ade07cec5f2 req-cd5a5b4f-a2e9-47b4-8e5d-beb5276edf2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3946eaf6-225d-46e4-b381-85acfabcb9d7", "tag": "7c061226-abfd-4367-b257-a2b57b8dfb01"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:08.232652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d2da294c-b7a4-47b4-ae99-7ade07cec5f2 req-cd5a5b4f-a2e9-47b4-8e5d-beb5276edf2a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:08.233047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d2da294c-b7a4-47b4-ae99-7ade07cec5f2 req-cd5a5b4f-a2e9-47b4-8e5d-beb5276edf2a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:08.263700 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d2da294c-b7a4-47b4-ae99-7ade07cec5f2 req-cd5a5b4f-a2e9-47b4-8e5d-beb5276edf2a service nova] Creating event network-changed:7c061226-abfd-4367-b257-a2b57b8dfb01 for instance 3946eaf6-225d-46e4-b381-85acfabcb9d7 on n-h2-766726-30 May 19 04:40:08.272114 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d2da294c-b7a4-47b4-ae99-7ade07cec5f2 req-cd5a5b4f-a2e9-47b4-8e5d-beb5276edf2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085799 May 19 04:40:08.275592 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1045/2152] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:08.282224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0297538d-8f93-4306-9f03-d0b0ab07709b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:08.282937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0297538d-8f93-4306-9f03-d0b0ab07709b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:08.303132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0297538d-8f93-4306-9f03-d0b0ab07709b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:08.303655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0297538d-8f93-4306-9f03-d0b0ab07709b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:08.304517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0297538d-8f93-4306-9f03-d0b0ab07709b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:08.304972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0297538d-8f93-4306-9f03-d0b0ab07709b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:08.344259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b8a2e4cb-e354-4fbc-9999-986bd6cdd107 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:08.361187 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b8a2e4cb-e354-4fbc-9999-986bd6cdd107 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1315 microversion: 2.1 time: 0.574631 May 19 04:40:08.362831 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1108/2153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:07 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:08.381218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fbf8896-639c-471b-b29f-cb28d118fc79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:08.381421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4fbf8896-639c-471b-b29f-cb28d118fc79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:08.395165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fbf8896-639c-471b-b29f-cb28d118fc79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:08.395555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fbf8896-639c-471b-b29f-cb28d118fc79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:08.396341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fbf8896-639c-471b-b29f-cb28d118fc79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:08.396799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fbf8896-639c-471b-b29f-cb28d118fc79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:09.038914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0297538d-8f93-4306-9f03-d0b0ab07709b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:09.049447 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0297538d-8f93-4306-9f03-d0b0ab07709b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1318 microversion: 2.1 time: 0.772517 May 19 04:40:09.050047 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1046/2154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:08 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1318 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:09.065717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-7dd817bd-c54a-42a6-8f54-cd9c2b144439 req-1605c436-972a-426f-9d20-07568d0dd226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "tag": "1b45fa40-6dea-450d-9ca3-5940db1c12bf"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:09.093424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7dd817bd-c54a-42a6-8f54-cd9c2b144439 req-1605c436-972a-426f-9d20-07568d0dd226 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:09.097246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7dd817bd-c54a-42a6-8f54-cd9c2b144439 req-1605c436-972a-426f-9d20-07568d0dd226 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:09.133813 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-7dd817bd-c54a-42a6-8f54-cd9c2b144439 req-1605c436-972a-426f-9d20-07568d0dd226 service nova] Creating event network-changed:1b45fa40-6dea-450d-9ca3-5940db1c12bf for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:40:09.146601 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-7dd817bd-c54a-42a6-8f54-cd9c2b144439 req-1605c436-972a-426f-9d20-07568d0dd226 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093856 May 19 04:40:09.149847 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1047/2155] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:09.152687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fbf8896-639c-471b-b29f-cb28d118fc79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:09.157397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-26bae451-7206-44ae-a68b-bc5a611aa9dd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:09.158421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-26bae451-7206-44ae-a68b-bc5a611aa9dd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:09.167476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26bae451-7206-44ae-a68b-bc5a611aa9dd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:09.168382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26bae451-7206-44ae-a68b-bc5a611aa9dd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:09.169533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26bae451-7206-44ae-a68b-bc5a611aa9dd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:09.170267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26bae451-7206-44ae-a68b-bc5a611aa9dd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:09.182170 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4fbf8896-639c-471b-b29f-cb28d118fc79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.818158 May 19 04:40:09.199063 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1109/2156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:08 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:09.217005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:09.224892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] [instance: d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:09.259547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:09.262757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:09.264057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:09.264899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:09.287148 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] HTTP exception thrown: Instance d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 could not be found. May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Request method failure captured: May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 HTTP/1.1 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcoBdukPD8bBRqhA302IOk2sDX9CQc-AtU995j6M7StQy4VXrdL6J-69DiQ1wL7WF4-nZlRZvIpocwVjRQjpz_7gnL8TMw9gOKH5E8ydHOcQwN432TwhYjTzyZ22yvkL9A2sKeodtfpa5OSMT-lYIdh-twopbfXE9gOzPH6fSQj266k May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 37434a18d2d140a99d6d77f3bf3c8c79 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-InstanceActionsTestJSON-1073819707 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/37434a18d2d140a99d6d77f3bf3c8c79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37434a18d2d140a99d6d77f3bf3c8c79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37434a18d2d140a99d6d77f3bf3c8c79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_37434a18d2d140a99d6d77f3bf3c8c79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-InstanceActionsTestJSON-1073819707 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 37434a18d2d140a99d6d77f3bf3c8c79 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1073819707 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-InstanceActionsTestJSON-1073819707-project May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 86edb676803a41b2bd11bda3b33650a7 May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-InstanceActionsTestJSON-1073819707-project May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 could not be found. May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'd64cfa48-5ee4-48a9-b3f5-fe56fc509bf1'} May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 could not be found. May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 could not be found. May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:09.289153 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:09.296703 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:09.296703 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:09.296703 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:09.296703 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:09.296703 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:09.296703 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 could not be found. May 19 04:40:09.296703 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:09.301503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] Returning 404 to user: Instance d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:09.301503 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60dbc7c0-bcc9-48d6-8624-254e002d1630 tempest-InstanceActionsTestJSON-1073819707 tempest-InstanceActionsTestJSON-1073819707-project] 10.222.0.58 "GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1" status: 404 len: 111 microversion: 2.1 time: 0.098193 May 19 04:40:09.301503 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1110/2157] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:09 2022] GET /compute/v2.1/servers/d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:09.309260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:09.310158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:09.317683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:09.318480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:09.319749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:09.320403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:10.183476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:10.207585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=14 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:10.594865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:10.618175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:10.620011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:10.621294 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-187c911e-40e7-48c0-b4e3-603be432f6ea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 1.318309 May 19 04:40:10.634210 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1111/2158] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:09 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:10.647531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a906971-caaf-4d93-9972-b78dc8ade20d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:10.661843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a906971-caaf-4d93-9972-b78dc8ade20d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:10.678862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a906971-caaf-4d93-9972-b78dc8ade20d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:10.679321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a906971-caaf-4d93-9972-b78dc8ade20d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:10.680681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a906971-caaf-4d93-9972-b78dc8ade20d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:10.689147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a906971-caaf-4d93-9972-b78dc8ade20d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:10.856667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-26bae451-7206-44ae-a68b-bc5a611aa9dd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:10.865571 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-26bae451-7206-44ae-a68b-bc5a611aa9dd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1522 microversion: 2.1 time: 1.713765 May 19 04:40:10.866092 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1048/2159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:09 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1522 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:10.880852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b428a370-3460-44f2-b8ca-1d97b6de4b67 req-4272e45a-77c3-4f78-a5ac-f7ebdc7c4394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b3d9b3-2703-4a85-8d75-33f3e571ebcd", "name": "network-vif-plugged", "status": "completed", "tag": "d96f3070-0604-4f74-a673-446dab173c40"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:10.896586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b428a370-3460-44f2-b8ca-1d97b6de4b67 req-4272e45a-77c3-4f78-a5ac-f7ebdc7c4394 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:10.902811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b428a370-3460-44f2-b8ca-1d97b6de4b67 req-4272e45a-77c3-4f78-a5ac-f7ebdc7c4394 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:10.951379 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b428a370-3460-44f2-b8ca-1d97b6de4b67 req-4272e45a-77c3-4f78-a5ac-f7ebdc7c4394 service nova] Creating event network-vif-plugged:d96f3070-0604-4f74-a673-446dab173c40 for instance 06b3d9b3-2703-4a85-8d75-33f3e571ebcd on n-h1-766726-30 May 19 04:40:10.965308 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b428a370-3460-44f2-b8ca-1d97b6de4b67 req-4272e45a-77c3-4f78-a5ac-f7ebdc7c4394 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088285 May 19 04:40:10.969949 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1049/2160] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:10.982033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8a525f9-5834-4236-9927-aa284ae15f76 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:10.990683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8a525f9-5834-4236-9927-aa284ae15f76 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:11.009474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8a525f9-5834-4236-9927-aa284ae15f76 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.014349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8a525f9-5834-4236-9927-aa284ae15f76 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.016477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8a525f9-5834-4236-9927-aa284ae15f76 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.017255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8a525f9-5834-4236-9927-aa284ae15f76 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.225960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0a906971-caaf-4d93-9972-b78dc8ade20d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:11.238920 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a906971-caaf-4d93-9972-b78dc8ade20d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1315 microversion: 2.1 time: 0.599830 May 19 04:40:11.240034 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1112/2161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:10 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:11.244915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c9663c7e-f4f3-4ad3-a923-47801c406c3d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:11.245712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c9663c7e-f4f3-4ad3-a923-47801c406c3d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:11.252618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9663c7e-f4f3-4ad3-a923-47801c406c3d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.253327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9663c7e-f4f3-4ad3-a923-47801c406c3d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.255920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9663c7e-f4f3-4ad3-a923-47801c406c3d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.256551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9663c7e-f4f3-4ad3-a923-47801c406c3d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.606853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8a525f9-5834-4236-9927-aa284ae15f76 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:11.618330 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8a525f9-5834-4236-9927-aa284ae15f76 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1318 microversion: 2.1 time: 0.646213 May 19 04:40:11.619520 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1050/2162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:10 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:11.622274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c9663c7e-f4f3-4ad3-a923-47801c406c3d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:11.626143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-069901e9-dc4d-4a57-ba99-7771f56b620e req-255366af-afa5-4b99-b5e9-4574ca5bb9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1", "name": "network-vif-deleted", "tag": "935fb3b9-60f2-42b5-8103-989ebd060dbd"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:11.643655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-069901e9-dc4d-4a57-ba99-7771f56b620e req-255366af-afa5-4b99-b5e9-4574ca5bb9cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.644496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-069901e9-dc4d-4a57-ba99-7771f56b620e req-255366af-afa5-4b99-b5e9-4574ca5bb9cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.652455 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c9663c7e-f4f3-4ad3-a923-47801c406c3d tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.410922 May 19 04:40:11.653058 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1113/2163] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:11 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:11.665031 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-069901e9-dc4d-4a57-ba99-7771f56b620e req-255366af-afa5-4b99-b5e9-4574ca5bb9cb service nova] Creating event network-vif-deleted:935fb3b9-60f2-42b5-8103-989ebd060dbd for instance d64cfa48-5ee4-48a9-b3f5-fe56fc509bf1 on n-h1-766726-30 May 19 04:40:11.670677 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-069901e9-dc4d-4a57-ba99-7771f56b620e req-255366af-afa5-4b99-b5e9-4574ca5bb9cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049635 May 19 04:40:11.672023 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1051/2164] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:11.675451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c9fdced-245b-41ff-848a-f113e834b4e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:11.676259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4c9fdced-245b-41ff-848a-f113e834b4e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:11.687846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-69aca651-a9d4-4c4b-a01c-f29b2c896dc7 req-c065683e-94b0-4756-af29-91568f8d73f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e655f22-e04e-407c-8d23-85c8a9356b7e", "tag": "7f864820-c0e5-4eaf-85ee-c0e459b07173"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:11.692664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c9fdced-245b-41ff-848a-f113e834b4e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.693141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c9fdced-245b-41ff-848a-f113e834b4e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.696383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c9fdced-245b-41ff-848a-f113e834b4e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.697026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c9fdced-245b-41ff-848a-f113e834b4e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.700008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-69aca651-a9d4-4c4b-a01c-f29b2c896dc7 req-c065683e-94b0-4756-af29-91568f8d73f3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.702313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-69aca651-a9d4-4c4b-a01c-f29b2c896dc7 req-c065683e-94b0-4756-af29-91568f8d73f3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.731336 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-69aca651-a9d4-4c4b-a01c-f29b2c896dc7 req-c065683e-94b0-4756-af29-91568f8d73f3 service nova] Creating event network-changed:7f864820-c0e5-4eaf-85ee-c0e459b07173 for instance 3e655f22-e04e-407c-8d23-85c8a9356b7e on n-h1-766726-30 May 19 04:40:11.739645 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-69aca651-a9d4-4c4b-a01c-f29b2c896dc7 req-c065683e-94b0-4756-af29-91568f8d73f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065924 May 19 04:40:11.741536 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1052/2165] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:11.752089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4c9fdced-245b-41ff-848a-f113e834b4e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:11.755032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:11.760189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:11.773037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.775877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.778315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.778990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.906515 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c9fdced-245b-41ff-848a-f113e834b4e7 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 204 len: 0 microversion: 2.1 time: 0.247418 May 19 04:40:11.907210 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1114/2166] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:11 2022] DELETE /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:11.912731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4cc01e8-d3a8-4804-9215-b53cc51c0ad0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:11.913530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c4cc01e8-d3a8-4804-9215-b53cc51c0ad0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:11.931262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4cc01e8-d3a8-4804-9215-b53cc51c0ad0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.932061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4cc01e8-d3a8-4804-9215-b53cc51c0ad0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:11.933052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4cc01e8-d3a8-4804-9215-b53cc51c0ad0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:11.933700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4cc01e8-d3a8-4804-9215-b53cc51c0ad0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:12.293837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:12.339922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:12.582088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c4cc01e8-d3a8-4804-9215-b53cc51c0ad0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:12.592245 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c4cc01e8-d3a8-4804-9215-b53cc51c0ad0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1522 microversion: 2.1 time: 0.683688 May 19 04:40:12.595904 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1115/2167] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:11 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:12.606621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55030195-3309-42d4-aa53-5f1e8d7b8def tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:12.611113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-55030195-3309-42d4-aa53-5f1e8d7b8def tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:12.627795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55030195-3309-42d4-aa53-5f1e8d7b8def tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:12.635337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55030195-3309-42d4-aa53-5f1e8d7b8def tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:12.636498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55030195-3309-42d4-aa53-5f1e8d7b8def tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:12.637301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55030195-3309-42d4-aa53-5f1e8d7b8def tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:12.762087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:12.793061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:12.800016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:12.821468 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4a864641-c528-43c1-872f-fd259b550e19 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 1.071389 May 19 04:40:12.823097 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1053/2168] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:11 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:12.845145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eb5c8d0c-cc54-4576-93da-102c97e164a4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:12.845825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eb5c8d0c-cc54-4576-93da-102c97e164a4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:12.865907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb5c8d0c-cc54-4576-93da-102c97e164a4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:12.867375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb5c8d0c-cc54-4576-93da-102c97e164a4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:12.871353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb5c8d0c-cc54-4576-93da-102c97e164a4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:12.872193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb5c8d0c-cc54-4576-93da-102c97e164a4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:13.458663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55030195-3309-42d4-aa53-5f1e8d7b8def tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:13.472931 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-55030195-3309-42d4-aa53-5f1e8d7b8def tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 200 len: 1499 microversion: 2.1 time: 0.875315 May 19 04:40:13.473743 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1116/2169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:12 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 1499 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:13.489625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eb5c8d0c-cc54-4576-93da-102c97e164a4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:13.490192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4454267c-d30b-40b9-a698-e4dcd064da44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:13.490335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4454267c-d30b-40b9-a698-e4dcd064da44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:13.500611 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eb5c8d0c-cc54-4576-93da-102c97e164a4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1315 microversion: 2.1 time: 0.675483 May 19 04:40:13.501402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4454267c-d30b-40b9-a698-e4dcd064da44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:13.502336 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1054/2170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:12 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:13.503169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4454267c-d30b-40b9-a698-e4dcd064da44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:13.504288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4454267c-d30b-40b9-a698-e4dcd064da44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:13.505281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4454267c-d30b-40b9-a698-e4dcd064da44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:13.514229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b34e236-a817-4ff2-9aff-53600b4d8d48 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:13.516068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b34e236-a817-4ff2-9aff-53600b4d8d48 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:13.533573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b34e236-a817-4ff2-9aff-53600b4d8d48 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:13.536017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b34e236-a817-4ff2-9aff-53600b4d8d48 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:13.537097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b34e236-a817-4ff2-9aff-53600b4d8d48 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:13.538691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b34e236-a817-4ff2-9aff-53600b4d8d48 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.038224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4454267c-d30b-40b9-a698-e4dcd064da44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:14.052474 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4454267c-d30b-40b9-a698-e4dcd064da44 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1318 microversion: 2.1 time: 0.572045 May 19 04:40:14.053069 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1117/2171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:13 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:14.072826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-15adb20e-5baf-4464-985b-e05d261c48f0 req-846035dc-6bf7-4ff1-a134-5257ca1ce6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372099a-9a88-4652-88c9-5d254a243f77", "name": "network-vif-plugged", "status": "completed", "tag": "67957cc5-98f3-41de-897b-bf1663fe7167"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:14.101343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-15adb20e-5baf-4464-985b-e05d261c48f0 req-846035dc-6bf7-4ff1-a134-5257ca1ce6f3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.102322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-15adb20e-5baf-4464-985b-e05d261c48f0 req-846035dc-6bf7-4ff1-a134-5257ca1ce6f3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.118037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b34e236-a817-4ff2-9aff-53600b4d8d48 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:14.127280 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b34e236-a817-4ff2-9aff-53600b4d8d48 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.622989 May 19 04:40:14.127881 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1055/2172] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:13 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:14.128751 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-15adb20e-5baf-4464-985b-e05d261c48f0 req-846035dc-6bf7-4ff1-a134-5257ca1ce6f3 service nova] Creating event network-vif-plugged:67957cc5-98f3-41de-897b-bf1663fe7167 for instance c372099a-9a88-4652-88c9-5d254a243f77 on n-h2-766726-30 May 19 04:40:14.145397 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-15adb20e-5baf-4464-985b-e05d261c48f0 req-846035dc-6bf7-4ff1-a134-5257ca1ce6f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083702 May 19 04:40:14.147366 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1118/2173] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:14.167724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-924f6064-e192-4ef6-8638-eaba4298ebd0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:14.168284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:14.168519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-924f6064-e192-4ef6-8638-eaba4298ebd0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:14.169318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:14.182612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-924f6064-e192-4ef6-8638-eaba4298ebd0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.183075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-924f6064-e192-4ef6-8638-eaba4298ebd0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.183875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-924f6064-e192-4ef6-8638-eaba4298ebd0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.184322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-924f6064-e192-4ef6-8638-eaba4298ebd0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.208160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.208160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.208160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.208160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.784625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-924f6064-e192-4ef6-8638-eaba4298ebd0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:14.793425 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-924f6064-e192-4ef6-8638-eaba4298ebd0 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1522 microversion: 2.1 time: 0.651131 May 19 04:40:14.798997 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1056/2174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:14 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1522 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:14.810430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:14.812223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-503bf3cf-6b2c-40c4-b089-8d2dafcb76a8 req-b4c1889a-5be4-443f-9e61-f6c6530ca731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2ae1de-c359-4358-ba9a-a978ce719a40", "name": "network-vif-deleted", "tag": "a90ed039-62ad-4f8b-b460-aeb6755cd08f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:14.819817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:14.822973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-503bf3cf-6b2c-40c4-b089-8d2dafcb76a8 req-b4c1889a-5be4-443f-9e61-f6c6530ca731 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.823473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-503bf3cf-6b2c-40c4-b089-8d2dafcb76a8 req-b4c1889a-5be4-443f-9e61-f6c6530ca731 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.830246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:14.831546 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5deda0f0-d530-412b-8844-7b589d4dee63 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.676342 May 19 04:40:14.838267 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-503bf3cf-6b2c-40c4-b089-8d2dafcb76a8 req-b4c1889a-5be4-443f-9e61-f6c6530ca731 service nova] Creating event network-vif-deleted:a90ed039-62ad-4f8b-b460-aeb6755cd08f for instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 on n-h2-766726-30 May 19 04:40:14.842015 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1119/2175] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:14 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:14.844252 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-503bf3cf-6b2c-40c4-b089-8d2dafcb76a8 req-b4c1889a-5be4-443f-9e61-f6c6530ca731 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043386 May 19 04:40:14.845175 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1057/2176] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:14.850870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7b5263e-84f8-4a24-aa37-8a5a80fbae70 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:14.851211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:14.851872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 7f2ae1de-c359-4358-ba9a-a978ce719a40] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:14.852425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e7b5263e-84f8-4a24-aa37-8a5a80fbae70 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:14.860698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7b5263e-84f8-4a24-aa37-8a5a80fbae70 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.861550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7b5263e-84f8-4a24-aa37-8a5a80fbae70 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.863083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7b5263e-84f8-4a24-aa37-8a5a80fbae70 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.863759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7b5263e-84f8-4a24-aa37-8a5a80fbae70 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.872840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.873339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.874188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.874902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.900381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:14.902552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] HTTP exception thrown: Instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 could not be found. May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Request method failure captured: May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 HTTP/1.1 May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchT7h-6a02Rw3HRYmqQi_9QypgwZOm9yQbqrNw5mZhQx1wosfqi5zmGumOtd-06fKRAM-oI45zczLGHk2vCQ1-ncAD7KNIHUslU87F2TgfGWPdj3aLZ5e8vVIgeb0hMHtMCeCS2ZspNgXz2hltRjRv45h9jZjDpA91kSALApkcmbRk May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: b2425f9ddc1548958d45215e83aed84e May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-LiveMigrationTest-1115174210 May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-LiveMigrationTest-1115174210 May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: b2425f9ddc1548958d45215e83aed84e May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-LiveMigrationTest-1115174210 May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-LiveMigrationTest-1115174210-project May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 75f651a13b474f09aa3877d1d66b8fc5 May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-LiveMigrationTest-1115174210-project May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 could not be found. May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '7f2ae1de-c359-4358-ba9a-a978ce719a40'} May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 could not be found. May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 could not be found. May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:14.904347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:14.910088 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:14.910088 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:14.910088 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:14.910088 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:14.910088 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:14.910088 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 could not be found. May 19 04:40:14.910088 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:14.910088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Returning 404 to user: Instance 7f2ae1de-c359-4358-ba9a-a978ce719a40 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:14.910088 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-13ad8585-52fd-457f-b0a1-e7349e7c214d tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40" status: 404 len: 111 microversion: 2.1 time: 0.062713 May 19 04:40:14.913177 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1120/2177] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:14 2022] GET /compute/v2.1/servers/7f2ae1de-c359-4358-ba9a-a978ce719a40 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:14.918496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b1efe92b-555c-4427-b7e5-7346af5c8230 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:14.919008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b1efe92b-555c-4427-b7e5-7346af5c8230 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:14.941535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1efe92b-555c-4427-b7e5-7346af5c8230 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.943378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1efe92b-555c-4427-b7e5-7346af5c8230 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:14.944449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1efe92b-555c-4427-b7e5-7346af5c8230 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:14.945288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1efe92b-555c-4427-b7e5-7346af5c8230 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.001042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b1efe92b-555c-4427-b7e5-7346af5c8230 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:15.052352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7b5263e-84f8-4a24-aa37-8a5a80fbae70 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:15.061490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7b5263e-84f8-4a24-aa37-8a5a80fbae70 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1315 microversion: 2.1 time: 0.214793 May 19 04:40:15.062570 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1058/2178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:14 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:15.070422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b406d8f-fa36-4273-97a2-d507e3b309eb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:15.071437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b406d8f-fa36-4273-97a2-d507e3b309eb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:15.078693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b406d8f-fa36-4273-97a2-d507e3b309eb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.079344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b406d8f-fa36-4273-97a2-d507e3b309eb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.080418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b406d8f-fa36-4273-97a2-d507e3b309eb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.080994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b406d8f-fa36-4273-97a2-d507e3b309eb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.100878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:15.161237 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b1efe92b-555c-4427-b7e5-7346af5c8230 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "DELETE /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 204 len: 0 microversion: 2.1 time: 0.246525 May 19 04:40:15.163494 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1121/2179] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:14 2022] DELETE /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:15.173277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-681eed4f-5f5e-4714-aef9-142ed81722fa tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:15.174272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-681eed4f-5f5e-4714-aef9-142ed81722fa tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:15.182499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-681eed4f-5f5e-4714-aef9-142ed81722fa tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.183277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-681eed4f-5f5e-4714-aef9-142ed81722fa tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.184231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-681eed4f-5f5e-4714-aef9-142ed81722fa tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.184897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-681eed4f-5f5e-4714-aef9-142ed81722fa tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.368284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b406d8f-fa36-4273-97a2-d507e3b309eb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:15.377473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b406d8f-fa36-4273-97a2-d507e3b309eb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1468 microversion: 2.1 time: 0.311396 May 19 04:40:15.389390 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1059/2180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:15 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1468 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:15.395748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ba440dde-3f8b-4dac-bbd9-94abcadf1e70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:15.396383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba440dde-3f8b-4dac-bbd9-94abcadf1e70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:15.404659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba440dde-3f8b-4dac-bbd9-94abcadf1e70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.405168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba440dde-3f8b-4dac-bbd9-94abcadf1e70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.405996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba440dde-3f8b-4dac-bbd9-94abcadf1e70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.406476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba440dde-3f8b-4dac-bbd9-94abcadf1e70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.453508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-681eed4f-5f5e-4714-aef9-142ed81722fa tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:15.462999 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-681eed4f-5f5e-4714-aef9-142ed81722fa tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.294445 May 19 04:40:15.463862 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1122/2181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:15 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:15.682510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ba440dde-3f8b-4dac-bbd9-94abcadf1e70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:15.692340 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ba440dde-3f8b-4dac-bbd9-94abcadf1e70 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1483 microversion: 2.1 time: 0.300471 May 19 04:40:15.697762 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1060/2182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:15 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1483 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:15.744712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2104785032", "block_migration": true, "disk_over_commit": false}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:15.746321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:15.753507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.754252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.755465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.756201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.788484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lazy-loading 'flavor' on Instance uuid 06b3d9b3-2703-4a85-8d75-33f3e571ebcd {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:40:15.802201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Going to try to live migrate instance to tempest-host-2104785032 {{(pid=124818) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 04:40:15.811183 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] HTTP exception thrown: Compute host tempest-host-2104785032 could not be found. May 19 04:40:15.813143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d7c5f97e-d92f-488f-957c-adf8b083a3de tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:15.814348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d7c5f97e-d92f-488f-957c-adf8b083a3de tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Request method failure captured: May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd/action HTTP/1.1 May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 107 May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcoUvBOQNanq549fa4wegbItZKtiBAhGLIFzGX49rakQIPCajEdE8Iun_dQxTS52JtrXIwSe_aljicWhwfUH7whuJwITW6tzD58dOLL8jAWrW8mtxhjONe5sb9XwuT7UJd42GJCOad7eL1y4hArQT6TUomm0E1omIl5cZpoe4TYrZRI May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: cd0172d4838f4366b009e5bc8c968b5f May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-LiveMigrationNegativeTest-931950932 May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd0172d4838f4366b009e5bc8c968b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd0172d4838f4366b009e5bc8c968b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd0172d4838f4366b009e5bc8c968b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd0172d4838f4366b009e5bc8c968b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-LiveMigrationNegativeTest-931950932 May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: cd0172d4838f4366b009e5bc8c968b5f May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-931950932 May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-LiveMigrationNegativeTest-931950932-project-admin May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 9b2e372728124ee18523158df4cfc8e2 May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-LiveMigrationNegativeTest-931950932-project-admin May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: {"os-migrateLive": {"host": "tempest-host-2104785032", "block_migration": true, "disk_over_commit": false}} May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: exception: Compute host tempest-host-2104785032 could not be found. May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '06b3d9b3-2703-4a85-8d75-33f3e571ebcd', 'body': {'os-migrateLive': {'host': 'tempest-host-2104785032', 'block_migration': True, 'disk_over_commit': False}}} May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host May 19 04:40:15.815165 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2104785032 could not be found. May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2104785032 could not be found. May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2104785032 could not be found. May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Returning 400 to user: Compute host tempest-host-2104785032 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:15.821682 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f12a3c3-300e-4b90-822a-7a9bf6f41f41 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd/action" status: 400 len: 100 microversion: 2.1 time: 0.354325 May 19 04:40:15.825369 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1123/2183] 10.222.0.58 () {60 vars in 1278 bytes} [Thu May 19 04:40:15 2022] POST /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd/action => generated 100 bytes in 359 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:40:15.831397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba47a2d2-bfe9-45cd-b9e9-990938037864 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:15.832170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba47a2d2-bfe9-45cd-b9e9-990938037864 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:15.833059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7c5f97e-d92f-488f-957c-adf8b083a3de tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.833719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7c5f97e-d92f-488f-957c-adf8b083a3de tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.834932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7c5f97e-d92f-488f-957c-adf8b083a3de tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.836037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7c5f97e-d92f-488f-957c-adf8b083a3de tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.840699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba47a2d2-bfe9-45cd-b9e9-990938037864 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.841336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba47a2d2-bfe9-45cd-b9e9-990938037864 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:15.842229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba47a2d2-bfe9-45cd-b9e9-990938037864 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:15.842813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba47a2d2-bfe9-45cd-b9e9-990938037864 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:16.065336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d7c5f97e-d92f-488f-957c-adf8b083a3de tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:16.080332 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d7c5f97e-d92f-488f-957c-adf8b083a3de tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1522 microversion: 2.1 time: 0.270327 May 19 04:40:16.080974 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1061/2184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:15 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:16.089569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:16.091374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:16.098898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba47a2d2-bfe9-45cd-b9e9-990938037864 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:16.109683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:16.110795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:16.111791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:16.112411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:16.114760 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba47a2d2-bfe9-45cd-b9e9-990938037864 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1468 microversion: 2.1 time: 0.287343 May 19 04:40:16.131287 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1124/2185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:15 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1468 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:16.139319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c650f72-da10-421a-863a-f68b93911edc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:16.141802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c650f72-da10-421a-863a-f68b93911edc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:16.162316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c650f72-da10-421a-863a-f68b93911edc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:16.162921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c650f72-da10-421a-863a-f68b93911edc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:16.163823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c650f72-da10-421a-863a-f68b93911edc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:16.168989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c650f72-da10-421a-863a-f68b93911edc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:16.493964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c650f72-da10-421a-863a-f68b93911edc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:16.499193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:16.511519 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c650f72-da10-421a-863a-f68b93911edc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1315 microversion: 2.1 time: 0.378930 May 19 04:40:16.513195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1125/2186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:16 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:16.517468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:16.519403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3c0c2f92-cdf6-4b5c-993d-355dfdc54585 req-68bfcbe5-cab6-4aeb-b2b3-051f09f0dab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3946eaf6-225d-46e4-b381-85acfabcb9d7", "name": "network-vif-plugged", "status": "completed", "tag": "7c061226-abfd-4367-b257-a2b57b8dfb01"}, {"server_uuid": "3e655f22-e04e-407c-8d23-85c8a9356b7e", "name": "network-vif-plugged", "status": "completed", "tag": "7f864820-c0e5-4eaf-85ee-c0e459b07173"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:16.524811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:16.529713 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3cc9619d-55b1-4fc2-8482-c28674f2f1fd tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.446082 May 19 04:40:16.531453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3c0c2f92-cdf6-4b5c-993d-355dfdc54585 req-68bfcbe5-cab6-4aeb-b2b3-051f09f0dab7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:16.532086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3c0c2f92-cdf6-4b5c-993d-355dfdc54585 req-68bfcbe5-cab6-4aeb-b2b3-051f09f0dab7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:16.532642 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1062/2187] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:16 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:16.552173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1998412386", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:16.565815 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3c0c2f92-cdf6-4b5c-993d-355dfdc54585 req-68bfcbe5-cab6-4aeb-b2b3-051f09f0dab7 service nova] Creating event network-vif-plugged:7c061226-abfd-4367-b257-a2b57b8dfb01 for instance 3946eaf6-225d-46e4-b381-85acfabcb9d7 on n-h2-766726-30 May 19 04:40:16.566584 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3c0c2f92-cdf6-4b5c-993d-355dfdc54585 req-68bfcbe5-cab6-4aeb-b2b3-051f09f0dab7 service nova] Creating event network-vif-plugged:7f864820-c0e5-4eaf-85ee-c0e459b07173 for instance 3e655f22-e04e-407c-8d23-85c8a9356b7e on n-h1-766726-30 May 19 04:40:16.579248 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3c0c2f92-cdf6-4b5c-993d-355dfdc54585 req-68bfcbe5-cab6-4aeb-b2b3-051f09f0dab7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063612 May 19 04:40:16.581261 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1126/2188] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:16.591244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e409e96f-f6ae-4ec2-90ca-1a7f24abeb2c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:16.593712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e409e96f-f6ae-4ec2-90ca-1a7f24abeb2c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:16.612857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e409e96f-f6ae-4ec2-90ca-1a7f24abeb2c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:16.613930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e409e96f-f6ae-4ec2-90ca-1a7f24abeb2c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:16.619679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e409e96f-f6ae-4ec2-90ca-1a7f24abeb2c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:16.622720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e409e96f-f6ae-4ec2-90ca-1a7f24abeb2c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:16.694377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:40:17.123109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e409e96f-f6ae-4ec2-90ca-1a7f24abeb2c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:17.137404 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e409e96f-f6ae-4ec2-90ca-1a7f24abeb2c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.553924 May 19 04:40:17.145173 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1127/2189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:16 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:17.177954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:17.179002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:17.194585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:17.196674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:17.214989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:17.215578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:17.254262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:17.254835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:17.255744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lazy-loading 'fault' on Instance uuid 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:40:17.287051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:40:17.289066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:40:17.289802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:40:17.290398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:40:17.290994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:40:17.303449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:17.303972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:17.304404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:17.304946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:17.305474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:17.313307 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b7a2df9-d84c-4340-a3c6-f72660bf4181 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 200 len: 1300 microversion: 2.1 time: 0.163049 May 19 04:40:17.314472 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1128/2190] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:17 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 1300 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:17.319577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-439bacd2-dde6-49df-93fa-460673c16d88 req-a4b84333-747a-4a64-8f07-8dfb4f7343f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287", "name": "network-vif-deleted", "tag": "25a0cf3f-ffa4-47ce-9022-693353a6c37c"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:17.335549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-439bacd2-dde6-49df-93fa-460673c16d88 req-a4b84333-747a-4a64-8f07-8dfb4f7343f9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:17.338207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-439bacd2-dde6-49df-93fa-460673c16d88 req-a4b84333-747a-4a64-8f07-8dfb4f7343f9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:17.350403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Getting quotas for project 57c8b320a11d43269f93125f76d2221a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:17.353383 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-439bacd2-dde6-49df-93fa-460673c16d88 req-a4b84333-747a-4a64-8f07-8dfb4f7343f9 service nova] Creating event network-vif-deleted:25a0cf3f-ffa4-47ce-9022-693353a6c37c for instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 on n-h2-766726-30 May 19 04:40:17.356931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Getting quotas for user 1470c059ef4e4e87a114209a9c934b6f and project 57c8b320a11d43269f93125f76d2221a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:17.358528 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-439bacd2-dde6-49df-93fa-460673c16d88 req-a4b84333-747a-4a64-8f07-8dfb4f7343f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042786 May 19 04:40:17.359899 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1129/2191] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:17.375920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:40:17.378556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:17.391413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:17.425286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1718196205", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "edd8c5ae-a498-4ad6-bfb1-39bb503f757b"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:17.459254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-794d8d2d-b8b4-4347-bf6e-7c1afbb5e909 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924801 May 19 04:40:17.463395 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1063/2192] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:40:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:40:17.473345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-98d76bcf-3116-46bc-bebe-2d9d7bae111f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:17.477616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-98d76bcf-3116-46bc-bebe-2d9d7bae111f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:17.496152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] validate_networks() for [('edd8c5ae-a498-4ad6-bfb1-39bb503f757b', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:40:17.510563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98d76bcf-3116-46bc-bebe-2d9d7bae111f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:17.512387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98d76bcf-3116-46bc-bebe-2d9d7bae111f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:17.513740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98d76bcf-3116-46bc-bebe-2d9d7bae111f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:17.514454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98d76bcf-3116-46bc-bebe-2d9d7bae111f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.119829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-98d76bcf-3116-46bc-bebe-2d9d7bae111f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:18.128199 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-98d76bcf-3116-46bc-bebe-2d9d7bae111f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1507 microversion: 2.1 time: 0.662267 May 19 04:40:18.129054 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1064/2193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:17 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1507 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:18.145967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afcaf6af-7b8e-4401-936e-dc50b20c66b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:18.146997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-afcaf6af-7b8e-4401-936e-dc50b20c66b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:18.154917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcaf6af-7b8e-4401-936e-dc50b20c66b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.155641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcaf6af-7b8e-4401-936e-dc50b20c66b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.156612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcaf6af-7b8e-4401-936e-dc50b20c66b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.157266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcaf6af-7b8e-4401-936e-dc50b20c66b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.368221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afcaf6af-7b8e-4401-936e-dc50b20c66b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:18.380308 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afcaf6af-7b8e-4401-936e-dc50b20c66b3 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1223 microversion: 2.1 time: 0.235651 May 19 04:40:18.383949 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1065/2194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:18 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1223 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:18.388969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79cf15cf-80c4-46e7-b34f-ed4a7841a371 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:18.392152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-79cf15cf-80c4-46e7-b34f-ed4a7841a371 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:18.408375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79cf15cf-80c4-46e7-b34f-ed4a7841a371 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.410909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79cf15cf-80c4-46e7-b34f-ed4a7841a371 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.412003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79cf15cf-80c4-46e7-b34f-ed4a7841a371 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.414187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79cf15cf-80c4-46e7-b34f-ed4a7841a371 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.661797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:40:18.662876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:40:18.663640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:40:18.664762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:40:18.665556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:40:18.668620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-79cf15cf-80c4-46e7-b34f-ed4a7841a371 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:18.676339 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79cf15cf-80c4-46e7-b34f-ed4a7841a371 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1315 microversion: 2.1 time: 0.291125 May 19 04:40:18.677779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.678410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.679403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.680585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.686671 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1066/2195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:18 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:18.692566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:18.693508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:18.699799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.700316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Getting quotas for project 277beeca952b478ebfc6d0bb55d89de2. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:18.700795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.701811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.702474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.705445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Getting quotas for user f1beed6ea3284f8ba5449b9e1c4fc37c and project 277beeca952b478ebfc6d0bb55d89de2. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:18.720878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Going to run 3 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:40:18.723336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:18.760934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=59ece96d-d36d-4e0e-8065-8055d12bfafb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:18.811200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=a7b1ec1b-3115-4cd6-ab4b-e430266a6147,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:18.935814 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4ddf511b-2b76-499f-b5fa-85f06907ec5e tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574199 May 19 04:40:18.936397 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1130/2196] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:40:18.941120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cb6c8098-a130-4fa3-806b-8335cc310bb9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:18.944436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb6c8098-a130-4fa3-806b-8335cc310bb9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:18.958028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb6c8098-a130-4fa3-806b-8335cc310bb9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.960371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb6c8098-a130-4fa3-806b-8335cc310bb9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:18.962636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb6c8098-a130-4fa3-806b-8335cc310bb9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:18.963274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb6c8098-a130-4fa3-806b-8335cc310bb9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.081849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:19.101343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:19.109952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:19.116092 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c35b0c0d-9f64-4258-9804-4dedf57b0bea tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.425127 May 19 04:40:19.121132 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1067/2197] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:18 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:19.134390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b15913f4-5357-4311-87b5-721b9fcfe390 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:19.139062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b15913f4-5357-4311-87b5-721b9fcfe390 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:19.158669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b15913f4-5357-4311-87b5-721b9fcfe390 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.159602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b15913f4-5357-4311-87b5-721b9fcfe390 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.162917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b15913f4-5357-4311-87b5-721b9fcfe390 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.164968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b15913f4-5357-4311-87b5-721b9fcfe390 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.317751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cb6c8098-a130-4fa3-806b-8335cc310bb9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:19.330260 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cb6c8098-a130-4fa3-806b-8335cc310bb9 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 200 len: 1507 microversion: 2.1 time: 0.388555 May 19 04:40:19.331274 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1131/2198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:18 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:19.345952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:19.346894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:19.357377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.358298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.360407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.380867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.439736 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] HTTP exception thrown: Instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 could not be found. May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Request method failure captured: May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 HTTP/1.1 May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihchT7h-6a02Rw3HRYmqQi_9QypgwZOm9yQbqrNw5mZhQx1wosfqi5zmGumOtd-06fKRAM-oI45zczLGHk2vCQ1-ncAD7KNIHUslU87F2TgfGWPdj3aLZ5e8vVIgeb0hMHtMCeCS2ZspNgXz2hltRjRv45h9jZjDpA91kSALApkcmbRk May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: b2425f9ddc1548958d45215e83aed84e May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-LiveMigrationTest-1115174210 May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-LiveMigrationTest-1115174210 May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: b2425f9ddc1548958d45215e83aed84e May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-LiveMigrationTest-1115174210 May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-LiveMigrationTest-1115174210-project May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 75f651a13b474f09aa3877d1d66b8fc5 May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-LiveMigrationTest-1115174210-project May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 could not be found. May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287'} May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 could not be found. May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 could not be found. May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:19.443745 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 could not be found. May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Returning 404 to user: Instance 29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2cbf46aa-94cf-4062-b883-e719d413b347 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287" status: 404 len: 111 microversion: 2.1 time: 0.115000 May 19 04:40:19.454348 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1132/2199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:19 2022] GET /compute/v2.1/servers/29ddc0f1-3a3a-460b-a5a1-7ce6c8dc3287 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:19.457142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fcfb1478-c923-4ba1-bb11-7a54f784c9fc tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:19.458311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fcfb1478-c923-4ba1-bb11-7a54f784c9fc tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:19.459092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fcfb1478-c923-4ba1-bb11-7a54f784c9fc tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Searching by: {'deleted': False, 'project_id': '277beeca952b478ebfc6d0bb55d89de2'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:40:19.489796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcfb1478-c923-4ba1-bb11-7a54f784c9fc tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.491231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcfb1478-c923-4ba1-bb11-7a54f784c9fc tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.492077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcfb1478-c923-4ba1-bb11-7a54f784c9fc tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.492587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcfb1478-c923-4ba1-bb11-7a54f784c9fc tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.503172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b15913f4-5357-4311-87b5-721b9fcfe390 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:19.511583 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b15913f4-5357-4311-87b5-721b9fcfe390 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1507 microversion: 2.1 time: 0.385743 May 19 04:40:19.512159 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1068/2200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:19 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:19.529466 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fcfb1478-c923-4ba1-bb11-7a54f784c9fc tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.080169 May 19 04:40:19.530474 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1133/2201] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:40:19 2022] GET /compute/v2.1/servers => generated 1018 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:19.539638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b4faf46-7ef1-4854-82c9-3644df579cbb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:19.540169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b4faf46-7ef1-4854-82c9-3644df579cbb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:19.544671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-432e3c41-f9e0-4f0b-8349-b98fd1005dcb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:19.545303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-432e3c41-f9e0-4f0b-8349-b98fd1005dcb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:19.550245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b4faf46-7ef1-4854-82c9-3644df579cbb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.550898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b4faf46-7ef1-4854-82c9-3644df579cbb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.552562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b4faf46-7ef1-4854-82c9-3644df579cbb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.555842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b4faf46-7ef1-4854-82c9-3644df579cbb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.576205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432e3c41-f9e0-4f0b-8349-b98fd1005dcb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.577052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432e3c41-f9e0-4f0b-8349-b98fd1005dcb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.578012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432e3c41-f9e0-4f0b-8349-b98fd1005dcb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.580071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432e3c41-f9e0-4f0b-8349-b98fd1005dcb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.594385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b4faf46-7ef1-4854-82c9-3644df579cbb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:19.712311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-432e3c41-f9e0-4f0b-8349-b98fd1005dcb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:19.722248 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-432e3c41-f9e0-4f0b-8349-b98fd1005dcb tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1277 microversion: 2.1 time: 0.181237 May 19 04:40:19.733975 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1069/2202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:19 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:19.739137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f2b35812-0b0b-4108-b2ab-19e8c2ee7526 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:19.739367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f2b35812-0b0b-4108-b2ab-19e8c2ee7526 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:19.739914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b4faf46-7ef1-4854-82c9-3644df579cbb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 204 len: 0 microversion: 2.1 time: 0.207082 May 19 04:40:19.741534 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1134/2203] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:19 2022] DELETE /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:19.763275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2b35812-0b0b-4108-b2ab-19e8c2ee7526 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.763734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2b35812-0b0b-4108-b2ab-19e8c2ee7526 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.766893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2b35812-0b0b-4108-b2ab-19e8c2ee7526 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:19.768097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2b35812-0b0b-4108-b2ab-19e8c2ee7526 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:19.780835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7fbf2545-ebec-469b-9027-96a0b82c6f27 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:19.781688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7fbf2545-ebec-469b-9027-96a0b82c6f27 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:19.835226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f2b35812-0b0b-4108-b2ab-19e8c2ee7526 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:19.964777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7fbf2545-ebec-469b-9027-96a0b82c6f27 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:19.973324 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7fbf2545-ebec-469b-9027-96a0b82c6f27 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1223 microversion: 2.1 time: 0.229194 May 19 04:40:19.973900 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1135/2204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:19 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1223 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:19.996629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e133726-091e-4f33-9d3a-5e117443210f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:20.007145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7e133726-091e-4f33-9d3a-5e117443210f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:20.014779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=9 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:20.026795 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f2b35812-0b0b-4108-b2ab-19e8c2ee7526 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 204 len: 0 microversion: 2.1 time: 0.291340 May 19 04:40:20.027645 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1070/2205] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:19 2022] DELETE /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:20.029204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e133726-091e-4f33-9d3a-5e117443210f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:20.036179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1440269933", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "725f31b8-0e87-4064-94dc-266df6d4a8df"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:20.043114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e133726-091e-4f33-9d3a-5e117443210f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:20.044384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e133726-091e-4f33-9d3a-5e117443210f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:20.045018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e133726-091e-4f33-9d3a-5e117443210f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:20.110519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] validate_networks() for [('725f31b8-0e87-4064-94dc-266df6d4a8df', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:40:20.652000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7e133726-091e-4f33-9d3a-5e117443210f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:20.670367 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e133726-091e-4f33-9d3a-5e117443210f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1502 microversion: 2.1 time: 0.692073 May 19 04:40:20.673228 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1136/2206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:19 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1502 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:20.682917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c855253d-3413-4914-a769-4bb0f0f10127 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:20.683901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c855253d-3413-4914-a769-4bb0f0f10127 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:20.711054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c855253d-3413-4914-a769-4bb0f0f10127 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:20.712476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c855253d-3413-4914-a769-4bb0f0f10127 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:20.713551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c855253d-3413-4914-a769-4bb0f0f10127 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:20.714233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c855253d-3413-4914-a769-4bb0f0f10127 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:21.085531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c855253d-3413-4914-a769-4bb0f0f10127 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f651a13b474f09aa3877d1d66b8fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2425f9ddc1548958d45215e83aed84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:21.096529 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c855253d-3413-4914-a769-4bb0f0f10127 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 200 len: 1500 microversion: 2.1 time: 0.421989 May 19 04:40:21.102136 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1137/2207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:20 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 1500 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:21.107517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:21.110426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:21.128803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:21.131747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:21.132552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:21.133561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:21.726351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:21.728827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:40:21.730077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:40:21.730573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:40:21.734984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:40:21.734984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:40:21.746818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:21.748818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:21.750659 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b1f44211-d0cf-444a-be8d-7368c00bf42f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.647291 May 19 04:40:21.763659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:21.763659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:21.763659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:21.763659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:21.764918 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1138/2208] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:21 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:21.770436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8df7df13-4c24-4580-b6f0-646282d4c4fc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:21.771305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8df7df13-4c24-4580-b6f0-646282d4c4fc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:21.779648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8df7df13-4c24-4580-b6f0-646282d4c4fc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:21.780909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8df7df13-4c24-4580-b6f0-646282d4c4fc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:21.782379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8df7df13-4c24-4580-b6f0-646282d4c4fc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:21.783071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8df7df13-4c24-4580-b6f0-646282d4c4fc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:21.803448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Getting quotas for project 68c54dd93b5d484cb22316eb239828d4. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:21.813886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Getting quotas for user 366806f44fa34ba8a7ad0a2e84f314eb and project 68c54dd93b5d484cb22316eb239828d4. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:21.833447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8df7df13-4c24-4580-b6f0-646282d4c4fc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:21.840611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:21.850430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:40:21.859991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:21.982745 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8df7df13-4c24-4580-b6f0-646282d4c4fc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 204 len: 0 microversion: 2.1 time: 0.216053 May 19 04:40:21.985022 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-baa2ac7b-5a90-4a13-91a8-66bacab4539f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.954722 May 19 04:40:21.986750 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1139/2209] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:21 2022] DELETE /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:21.987957 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1071/2210] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:40:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:40:21.995247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ce987350-4b82-44b8-a420-8d5f137ff765 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:21.999235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-843bba87-b1b4-4dfd-b00f-821ca80812b4 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:22.000994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ce987350-4b82-44b8-a420-8d5f137ff765 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:22.002894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-843bba87-b1b4-4dfd-b00f-821ca80812b4 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:22.017973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce987350-4b82-44b8-a420-8d5f137ff765 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:22.018787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce987350-4b82-44b8-a420-8d5f137ff765 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:22.019766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce987350-4b82-44b8-a420-8d5f137ff765 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:22.020375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce987350-4b82-44b8-a420-8d5f137ff765 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:22.022933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-843bba87-b1b4-4dfd-b00f-821ca80812b4 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:22.023388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-843bba87-b1b4-4dfd-b00f-821ca80812b4 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:22.026044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-843bba87-b1b4-4dfd-b00f-821ca80812b4 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:22.030477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-843bba87-b1b4-4dfd-b00f-821ca80812b4 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:22.466825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-843bba87-b1b4-4dfd-b00f-821ca80812b4 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:22.479172 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-843bba87-b1b4-4dfd-b00f-821ca80812b4 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1283 microversion: 2.1 time: 0.489982 May 19 04:40:22.479770 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1072/2211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:21 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1283 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:22.497318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-71774b90-4272-44bb-8e94-1d06c5a0a770 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:22.497960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-71774b90-4272-44bb-8e94-1d06c5a0a770 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:22.512739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71774b90-4272-44bb-8e94-1d06c5a0a770 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:22.514305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71774b90-4272-44bb-8e94-1d06c5a0a770 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:22.515238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71774b90-4272-44bb-8e94-1d06c5a0a770 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:22.515660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71774b90-4272-44bb-8e94-1d06c5a0a770 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.076372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ce987350-4b82-44b8-a420-8d5f137ff765 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:23.085749 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ce987350-4b82-44b8-a420-8d5f137ff765 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1319 microversion: 2.1 time: 1.097394 May 19 04:40:23.086986 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1140/2212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:21 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1319 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:23.099290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1e37554e-a893-4db2-80c7-e53d55ff6b8f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:23.099515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1e37554e-a893-4db2-80c7-e53d55ff6b8f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:23.112253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e37554e-a893-4db2-80c7-e53d55ff6b8f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.112702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e37554e-a893-4db2-80c7-e53d55ff6b8f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.113509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e37554e-a893-4db2-80c7-e53d55ff6b8f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.114087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e37554e-a893-4db2-80c7-e53d55ff6b8f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.156538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-71774b90-4272-44bb-8e94-1d06c5a0a770 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:23.166920 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-71774b90-4272-44bb-8e94-1d06c5a0a770 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1508 microversion: 2.1 time: 0.686085 May 19 04:40:23.167516 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1073/2213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:22 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1508 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:23.184932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:23.185833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] [instance: ae28e440-afaa-461c-ad2e-9c119c468147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:23.192678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.193443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.194287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.194725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.210747 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] HTTP exception thrown: Instance ae28e440-afaa-461c-ad2e-9c119c468147 could not be found. May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Request method failure captured: May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 HTTP/1.1 May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihchT7h-6a02Rw3HRYmqQi_9QypgwZOm9yQbqrNw5mZhQx1wosfqi5zmGumOtd-06fKRAM-oI45zczLGHk2vCQ1-ncAD7KNIHUslU87F2TgfGWPdj3aLZ5e8vVIgeb0hMHtMCeCS2ZspNgXz2hltRjRv45h9jZjDpA91kSALApkcmbRk May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: b2425f9ddc1548958d45215e83aed84e May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-LiveMigrationTest-1115174210 May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b2425f9ddc1548958d45215e83aed84e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-LiveMigrationTest-1115174210 May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: b2425f9ddc1548958d45215e83aed84e May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-LiveMigrationTest-1115174210 May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-LiveMigrationTest-1115174210-project May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 75f651a13b474f09aa3877d1d66b8fc5 May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-LiveMigrationTest-1115174210-project May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance ae28e440-afaa-461c-ad2e-9c119c468147 could not be found. May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'ae28e440-afaa-461c-ad2e-9c119c468147'} May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae28e440-afaa-461c-ad2e-9c119c468147 could not be found. May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae28e440-afaa-461c-ad2e-9c119c468147 could not be found. May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:23.213276 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:23.218918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:23.218918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:23.218918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:23.218918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:23.218918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:23.218918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae28e440-afaa-461c-ad2e-9c119c468147 could not be found. May 19 04:40:23.218918 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:23.222503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] Returning 404 to user: Instance ae28e440-afaa-461c-ad2e-9c119c468147 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:23.223672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2bfd3b5f-3273-4728-a6fc-d9cc0bb4eff0 tempest-LiveMigrationTest-1115174210 tempest-LiveMigrationTest-1115174210-project] 10.222.0.58 "GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147" status: 404 len: 111 microversion: 2.1 time: 0.043020 May 19 04:40:23.239620 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1074/2214] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:23 2022] GET /compute/v2.1/servers/ae28e440-afaa-461c-ad2e-9c119c468147 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:23.253727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e61c5300-27c6-4473-a5e6-dd367b3ec9ad tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4a90922-cbe0-4932-b830-19c2a74931bd"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:23.256523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e61c5300-27c6-4473-a5e6-dd367b3ec9ad tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:23.271581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e61c5300-27c6-4473-a5e6-dd367b3ec9ad tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.272441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e61c5300-27c6-4473-a5e6-dd367b3ec9ad tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.274370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e61c5300-27c6-4473-a5e6-dd367b3ec9ad tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.275043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e61c5300-27c6-4473-a5e6-dd367b3ec9ad tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.312264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:23.454363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1e37554e-a893-4db2-80c7-e53d55ff6b8f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:23.465858 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1e37554e-a893-4db2-80c7-e53d55ff6b8f tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1222 microversion: 2.1 time: 0.370883 May 19 04:40:23.467824 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1141/2215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:23 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1222 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:23.477550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-cbd76e43-b53c-4bda-86bc-6c6137662834 req-3eb748a0-af93-4abf-9d90-fd94f5a786e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae28e440-afaa-461c-ad2e-9c119c468147", "name": "network-vif-deleted", "tag": "8bc99dbc-616c-4771-aa9d-9afa83a872a9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:23.495741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-cbd76e43-b53c-4bda-86bc-6c6137662834 req-3eb748a0-af93-4abf-9d90-fd94f5a786e5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.496646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-cbd76e43-b53c-4bda-86bc-6c6137662834 req-3eb748a0-af93-4abf-9d90-fd94f5a786e5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.513735 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-cbd76e43-b53c-4bda-86bc-6c6137662834 req-3eb748a0-af93-4abf-9d90-fd94f5a786e5 service nova] Creating event network-vif-deleted:8bc99dbc-616c-4771-aa9d-9afa83a872a9 for instance ae28e440-afaa-461c-ad2e-9c119c468147 on n-h2-766726-30 May 19 04:40:23.522979 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-cbd76e43-b53c-4bda-86bc-6c6137662834 req-3eb748a0-af93-4abf-9d90-fd94f5a786e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053078 May 19 04:40:23.525580 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1142/2216] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:23.539929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:23.557152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:23.574336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.576132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.578464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.580363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.740429 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e61c5300-27c6-4473-a5e6-dd367b3ec9ad tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "POST /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493176 May 19 04:40:23.746544 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1075/2217] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:40:23 2022] POST /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 194 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:23.754178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f34ceda-4fd9-445b-b4bc-b845ffaefb3d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:23.759618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7f34ceda-4fd9-445b-b4bc-b845ffaefb3d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:23.776005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f34ceda-4fd9-445b-b4bc-b845ffaefb3d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.778720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f34ceda-4fd9-445b-b4bc-b845ffaefb3d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:23.780845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f34ceda-4fd9-445b-b4bc-b845ffaefb3d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:23.781883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f34ceda-4fd9-445b-b4bc-b845ffaefb3d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:25.040560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7f34ceda-4fd9-445b-b4bc-b845ffaefb3d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:25.055684 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7f34ceda-4fd9-445b-b4bc-b845ffaefb3d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1281 microversion: 2.1 time: 1.304509 May 19 04:40:25.061580 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1076/2218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:23 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1281 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:25.073298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee5dbf9f-0c4d-4875-98b7-e6094d0c6411 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:25.079694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee5dbf9f-0c4d-4875-98b7-e6094d0c6411 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:25.118169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee5dbf9f-0c4d-4875-98b7-e6094d0c6411 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:25.118879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee5dbf9f-0c4d-4875-98b7-e6094d0c6411 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:25.120377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee5dbf9f-0c4d-4875-98b7-e6094d0c6411 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:25.121003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee5dbf9f-0c4d-4875-98b7-e6094d0c6411 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:25.646088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:25.699696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:25.708996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:25.714081 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-08f76d3e-f4bc-4625-8490-f5f8831b5ad8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 2.184186 May 19 04:40:25.716320 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1143/2219] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:23 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:25.736755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-478a1793-bfa2-4646-89fa-24e0c605918e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:25.749147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-478a1793-bfa2-4646-89fa-24e0c605918e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:25.786356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-478a1793-bfa2-4646-89fa-24e0c605918e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:25.787131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-478a1793-bfa2-4646-89fa-24e0c605918e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:25.802883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-478a1793-bfa2-4646-89fa-24e0c605918e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:25.805602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-478a1793-bfa2-4646-89fa-24e0c605918e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:25.957476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-478a1793-bfa2-4646-89fa-24e0c605918e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:25.974288 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-478a1793-bfa2-4646-89fa-24e0c605918e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 200 len: 1466 microversion: 2.1 time: 0.252976 May 19 04:40:25.974991 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1144/2220] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:25 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 1466 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:25.984586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a54d74e-45a4-4e44-ac80-c65e42a0c5b1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:25.984586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a54d74e-45a4-4e44-ac80-c65e42a0c5b1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:25.993844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a54d74e-45a4-4e44-ac80-c65e42a0c5b1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:25.998320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a54d74e-45a4-4e44-ac80-c65e42a0c5b1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:25.999702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a54d74e-45a4-4e44-ac80-c65e42a0c5b1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:26.001659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a54d74e-45a4-4e44-ac80-c65e42a0c5b1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:26.153476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ee5dbf9f-0c4d-4875-98b7-e6094d0c6411 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:26.167646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0a54d74e-45a4-4e44-ac80-c65e42a0c5b1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:26.170966 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee5dbf9f-0c4d-4875-98b7-e6094d0c6411 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1319 microversion: 2.1 time: 1.106010 May 19 04:40:26.174330 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1077/2221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:25 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1319 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:26.184326 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a54d74e-45a4-4e44-ac80-c65e42a0c5b1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1276 microversion: 2.1 time: 0.207658 May 19 04:40:26.185578 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1145/2222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:25 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:26.192757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5edfa189-b9d1-4e61-983c-60cfbd04743f req-4a9fa6bf-af46-44ee-8704-bb10da3b075f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e655f22-e04e-407c-8d23-85c8a9356b7e", "name": "network-vif-deleted", "tag": "7f864820-c0e5-4eaf-85ee-c0e459b07173"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:26.201102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-cb35c3ec-29bb-408a-88e5-68db94f1db44 req-81c18fca-415c-47ef-8b4b-ef3d8d2d3440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372099a-9a88-4652-88c9-5d254a243f77", "name": "network-vif-deleted", "tag": "67957cc5-98f3-41de-897b-bf1663fe7167"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:26.236009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5edfa189-b9d1-4e61-983c-60cfbd04743f req-4a9fa6bf-af46-44ee-8704-bb10da3b075f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:26.236927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5edfa189-b9d1-4e61-983c-60cfbd04743f req-4a9fa6bf-af46-44ee-8704-bb10da3b075f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:26.244655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cb35c3ec-29bb-408a-88e5-68db94f1db44 req-81c18fca-415c-47ef-8b4b-ef3d8d2d3440 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:26.245133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cb35c3ec-29bb-408a-88e5-68db94f1db44 req-81c18fca-415c-47ef-8b4b-ef3d8d2d3440 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:26.266787 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5edfa189-b9d1-4e61-983c-60cfbd04743f req-4a9fa6bf-af46-44ee-8704-bb10da3b075f service nova] Creating event network-vif-deleted:7f864820-c0e5-4eaf-85ee-c0e459b07173 for instance 3e655f22-e04e-407c-8d23-85c8a9356b7e on n-h1-766726-30 May 19 04:40:26.268759 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cb35c3ec-29bb-408a-88e5-68db94f1db44 req-81c18fca-415c-47ef-8b4b-ef3d8d2d3440 service nova] Creating event network-vif-deleted:67957cc5-98f3-41de-897b-bf1663fe7167 for instance c372099a-9a88-4652-88c9-5d254a243f77 on n-h2-766726-30 May 19 04:40:26.279306 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5edfa189-b9d1-4e61-983c-60cfbd04743f req-4a9fa6bf-af46-44ee-8704-bb10da3b075f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089538 May 19 04:40:26.287015 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-cb35c3ec-29bb-408a-88e5-68db94f1db44 req-81c18fca-415c-47ef-8b4b-ef3d8d2d3440 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111018 May 19 04:40:26.288229 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1078/2223] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:26.299511 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1146/2224] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:26.309273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b780c5c-a00d-4da9-b550-4227e047da86 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:26.309892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1b780c5c-a00d-4da9-b550-4227e047da86 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:26.316407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b780c5c-a00d-4da9-b550-4227e047da86 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:26.316863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b780c5c-a00d-4da9-b550-4227e047da86 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:26.317680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b780c5c-a00d-4da9-b550-4227e047da86 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:26.318135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b780c5c-a00d-4da9-b550-4227e047da86 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:26.507582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1b780c5c-a00d-4da9-b550-4227e047da86 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:26.527563 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1b780c5c-a00d-4da9-b550-4227e047da86 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1281 microversion: 2.1 time: 0.237310 May 19 04:40:26.528482 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1079/2225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:26 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:26.738192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:26.741018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:26.781213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:26.782909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:26.785706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:26.788773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:26.991815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:26.993394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:27.005934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:27.006472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:27.010432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:27.010971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:27.035469 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e HTTP/1.1 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '3e655f22-e04e-407c-8d23-85c8a9356b7e'} May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:27.037268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:27.042688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:27.042688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:27.042688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:27.042688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:27.042688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:27.042688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:40:27.042688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:27.042688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:27.042688 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-40068b0e-22f6-4bd2-b949-4cfe35c8887b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 404 len: 111 microversion: 2.1 time: 0.050890 May 19 04:40:27.065048 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1080/2226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:26 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:40:27.206391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a96ad0a8-4747-4d60-914f-c3769caa38a2 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:27.206970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a96ad0a8-4747-4d60-914f-c3769caa38a2 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:27.214604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a96ad0a8-4747-4d60-914f-c3769caa38a2 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:27.215427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a96ad0a8-4747-4d60-914f-c3769caa38a2 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:27.216217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a96ad0a8-4747-4d60-914f-c3769caa38a2 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:27.216704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a96ad0a8-4747-4d60-914f-c3769caa38a2 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:27.512647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:27.527198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:27.531279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:27.536229 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f8f1e3be-a928-4a98-be6d-8b250b6b90d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1891 microversion: 2.42 time: 0.802912 May 19 04:40:27.540860 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1147/2227] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:26 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1891 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:27.548326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e151a75f-fd54-4b6f-9020-6db8d3e59c4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:27.554119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e151a75f-fd54-4b6f-9020-6db8d3e59c4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:27.568169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e151a75f-fd54-4b6f-9020-6db8d3e59c4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:27.569281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e151a75f-fd54-4b6f-9020-6db8d3e59c4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:27.573230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e151a75f-fd54-4b6f-9020-6db8d3e59c4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:27.574050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e151a75f-fd54-4b6f-9020-6db8d3e59c4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:27.931490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a96ad0a8-4747-4d60-914f-c3769caa38a2 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:27.941561 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a96ad0a8-4747-4d60-914f-c3769caa38a2 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1319 microversion: 2.1 time: 0.753381 May 19 04:40:27.957273 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1081/2228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:27 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1319 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:27.973293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1825764217", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "56a7f773-0e0a-4675-b687-c0077a456785"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:28.063652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] validate_networks() for [('56a7f773-0e0a-4675-b687-c0077a456785', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:40:28.136826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e151a75f-fd54-4b6f-9020-6db8d3e59c4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:28.145264 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e151a75f-fd54-4b6f-9020-6db8d3e59c4d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1318 microversion: 2.1 time: 0.602126 May 19 04:40:28.149785 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1148/2229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:27 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:28.154715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-24cb6509-5ae3-4c6a-a2cf-a49f9a7fbd5f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:28.155535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-24cb6509-5ae3-4c6a-a2cf-a49f9a7fbd5f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:28.161934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24cb6509-5ae3-4c6a-a2cf-a49f9a7fbd5f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:28.162625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24cb6509-5ae3-4c6a-a2cf-a49f9a7fbd5f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:28.163588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24cb6509-5ae3-4c6a-a2cf-a49f9a7fbd5f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:28.164254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24cb6509-5ae3-4c6a-a2cf-a49f9a7fbd5f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:28.975316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-24cb6509-5ae3-4c6a-a2cf-a49f9a7fbd5f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:28.985604 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-24cb6509-5ae3-4c6a-a2cf-a49f9a7fbd5f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1323 microversion: 2.1 time: 0.834309 May 19 04:40:28.986195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1149/2230] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:28 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1323 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:28.991946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-7f2b49be-5f89-4929-9a45-8fa6d2955993 req-0b26a476-a313-4b97-b176-dad35749db77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07db7246-3187-41a6-afc2-aa8befff8701", "tag": "29c2f817-6863-4ebe-9dbf-066d9a3ce3d9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:29.002267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7f2b49be-5f89-4929-9a45-8fa6d2955993 req-0b26a476-a313-4b97-b176-dad35749db77 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:29.002799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7f2b49be-5f89-4929-9a45-8fa6d2955993 req-0b26a476-a313-4b97-b176-dad35749db77 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:29.018398 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7f2b49be-5f89-4929-9a45-8fa6d2955993 req-0b26a476-a313-4b97-b176-dad35749db77 service nova] Creating event network-changed:29c2f817-6863-4ebe-9dbf-066d9a3ce3d9 for instance 07db7246-3187-41a6-afc2-aa8befff8701 on n-h1-766726-30 May 19 04:40:29.026400 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-7f2b49be-5f89-4929-9a45-8fa6d2955993 req-0b26a476-a313-4b97-b176-dad35749db77 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038083 May 19 04:40:29.026983 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1150/2231] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:29.033408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fc0d8c24-8015-4a14-95c1-6c9df8c90d72 req-a29a322a-4583-4d5b-a29f-d38ee4aea802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59ece96d-d36d-4e0e-8065-8055d12bfafb", "tag": "964499cb-b208-4bca-b40a-c866afc7c177"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:29.043839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fc0d8c24-8015-4a14-95c1-6c9df8c90d72 req-a29a322a-4583-4d5b-a29f-d38ee4aea802 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:29.044396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fc0d8c24-8015-4a14-95c1-6c9df8c90d72 req-a29a322a-4583-4d5b-a29f-d38ee4aea802 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:29.068884 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fc0d8c24-8015-4a14-95c1-6c9df8c90d72 req-a29a322a-4583-4d5b-a29f-d38ee4aea802 service nova] Creating event network-changed:964499cb-b208-4bca-b40a-c866afc7c177 for instance 59ece96d-d36d-4e0e-8065-8055d12bfafb on n-h2-766726-30 May 19 04:40:29.076812 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fc0d8c24-8015-4a14-95c1-6c9df8c90d72 req-a29a322a-4583-4d5b-a29f-d38ee4aea802 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048063 May 19 04:40:29.078553 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1151/2232] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:29.100463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:29.103110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:29.114363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:29.115169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:29.119229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:29.120147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:29.515902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:29.806207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:29.817784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:29.819917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:29.822331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a4ba0a8-4905-410f-9916-0351eac1bf0b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.740832 May 19 04:40:29.823869 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1152/2233] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:29 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:29.829360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3d45cb9d-8eba-4f0b-a83c-aa56ad4486f6 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:29.830360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3d45cb9d-8eba-4f0b-a83c-aa56ad4486f6 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:29.838870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d45cb9d-8eba-4f0b-a83c-aa56ad4486f6 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:29.840292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d45cb9d-8eba-4f0b-a83c-aa56ad4486f6 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:29.841812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d45cb9d-8eba-4f0b-a83c-aa56ad4486f6 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:29.842838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d45cb9d-8eba-4f0b-a83c-aa56ad4486f6 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:29.907009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:40:29.907527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:40:29.907895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:40:29.908312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:40:29.908720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:40:29.919583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:29.920479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:29.921556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:29.922248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:29.969867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:29.985328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:29.998174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for user 1e14ea8dad314974bf5f4e8e51b88349 and project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:30.034214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:40:30.036526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:30.099385 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6fb5771c-fc2d-499d-8e85-d3704341084d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140544 May 19 04:40:30.100730 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1082/2234] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:40:30.107174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fde593ff-a842-4559-bd0b-a5a7a21f675c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:30.108137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fde593ff-a842-4559-bd0b-a5a7a21f675c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:30.116786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fde593ff-a842-4559-bd0b-a5a7a21f675c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:30.117604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fde593ff-a842-4559-bd0b-a5a7a21f675c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:30.118688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fde593ff-a842-4559-bd0b-a5a7a21f675c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:30.119709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fde593ff-a842-4559-bd0b-a5a7a21f675c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:30.552034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3d45cb9d-8eba-4f0b-a83c-aa56ad4486f6 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:30.567853 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3d45cb9d-8eba-4f0b-a83c-aa56ad4486f6 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1319 microversion: 2.1 time: 0.742511 May 19 04:40:30.578513 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1153/2235] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:29 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:30.580708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f5ec98c-46c3-4adf-a4ae-ea3ec660144f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:30.584211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f5ec98c-46c3-4adf-a4ae-ea3ec660144f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:30.598515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f5ec98c-46c3-4adf-a4ae-ea3ec660144f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:30.602850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f5ec98c-46c3-4adf-a4ae-ea3ec660144f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:30.603951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f5ec98c-46c3-4adf-a4ae-ea3ec660144f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:30.604620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f5ec98c-46c3-4adf-a4ae-ea3ec660144f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:30.943566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fde593ff-a842-4559-bd0b-a5a7a21f675c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:30.952722 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fde593ff-a842-4559-bd0b-a5a7a21f675c tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1318 microversion: 2.1 time: 0.849720 May 19 04:40:30.958468 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1083/2236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:30 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1318 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:30.972094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-68d81e23-efe1-4dd5-994e-67d40827e218 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:30.973154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-68d81e23-efe1-4dd5-994e-67d40827e218 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:30.984586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68d81e23-efe1-4dd5-994e-67d40827e218 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:30.989828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68d81e23-efe1-4dd5-994e-67d40827e218 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:30.991177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68d81e23-efe1-4dd5-994e-67d40827e218 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:30.997755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68d81e23-efe1-4dd5-994e-67d40827e218 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:31.157205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-68d81e23-efe1-4dd5-994e-67d40827e218 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:31.170097 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-68d81e23-efe1-4dd5-994e-67d40827e218 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1211 microversion: 2.1 time: 0.208996 May 19 04:40:31.176653 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1084/2237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:30 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1211 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:31.203097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:31.206816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:31.246350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f5ec98c-46c3-4adf-a4ae-ea3ec660144f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:31.251872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:31.252641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:31.256607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:31.257141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:31.258660 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f5ec98c-46c3-4adf-a4ae-ea3ec660144f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1323 microversion: 2.1 time: 0.688186 May 19 04:40:31.259277 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1154/2238] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:30 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1323 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:31.282704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-de95068e-66ba-4078-a63f-cc8fcd58f1a8 req-c39af268-a843-4b40-b3d7-97208edaf0de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b1ec1b-3115-4cd6-ab4b-e430266a6147", "tag": "ca85c40e-7474-4a04-a51f-acd3567f6990"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:31.304262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-de95068e-66ba-4078-a63f-cc8fcd58f1a8 req-c39af268-a843-4b40-b3d7-97208edaf0de service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:31.305309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-de95068e-66ba-4078-a63f-cc8fcd58f1a8 req-c39af268-a843-4b40-b3d7-97208edaf0de service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:31.333761 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-de95068e-66ba-4078-a63f-cc8fcd58f1a8 req-c39af268-a843-4b40-b3d7-97208edaf0de service nova] Creating event network-changed:ca85c40e-7474-4a04-a51f-acd3567f6990 for instance a7b1ec1b-3115-4cd6-ab4b-e430266a6147 on n-h1-766726-30 May 19 04:40:31.349665 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-de95068e-66ba-4078-a63f-cc8fcd58f1a8 req-c39af268-a843-4b40-b3d7-97208edaf0de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074802 May 19 04:40:31.352460 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1155/2239] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:31.367013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2eca2c8c-e20b-439f-a151-3343e6fcf749 req-35f72229-79b3-4067-bdc4-71f41e787b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163dcde2-c67f-4794-a106-f1bace4d6c80", "tag": "80651dbd-c4e5-49d2-8d93-351e469e9c30"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:31.386715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2eca2c8c-e20b-439f-a151-3343e6fcf749 req-35f72229-79b3-4067-bdc4-71f41e787b31 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:31.387167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2eca2c8c-e20b-439f-a151-3343e6fcf749 req-35f72229-79b3-4067-bdc4-71f41e787b31 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:31.400457 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2eca2c8c-e20b-439f-a151-3343e6fcf749 req-35f72229-79b3-4067-bdc4-71f41e787b31 service nova] Creating event network-changed:80651dbd-c4e5-49d2-8d93-351e469e9c30 for instance 163dcde2-c67f-4794-a106-f1bace4d6c80 on n-h1-766726-30 May 19 04:40:31.406518 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2eca2c8c-e20b-439f-a151-3343e6fcf749 req-35f72229-79b3-4067-bdc4-71f41e787b31 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052447 May 19 04:40:31.410525 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1156/2240] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:31.590403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d347d5b5-4c89-417b-bb23-df0386b89bef tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:31.591127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d347d5b5-4c89-417b-bb23-df0386b89bef tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:31.609743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d347d5b5-4c89-417b-bb23-df0386b89bef tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:31.611504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d347d5b5-4c89-417b-bb23-df0386b89bef tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:31.615497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d347d5b5-4c89-417b-bb23-df0386b89bef tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:31.616153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d347d5b5-4c89-417b-bb23-df0386b89bef tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:31.671734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:31.695612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:31.697616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:31.699123 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e4374a08-e80f-43cb-b70b-a823f0f228a3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.519857 May 19 04:40:31.700331 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1085/2241] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:31 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:31.976310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e911d1f3-b974-4f9d-8045-b7e53a70d873 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:31.978593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e911d1f3-b974-4f9d-8045-b7e53a70d873 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:31.992374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e911d1f3-b974-4f9d-8045-b7e53a70d873 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:31.994385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e911d1f3-b974-4f9d-8045-b7e53a70d873 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:31.998166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e911d1f3-b974-4f9d-8045-b7e53a70d873 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:32.000052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e911d1f3-b974-4f9d-8045-b7e53a70d873 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:32.198364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d347d5b5-4c89-417b-bb23-df0386b89bef tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:32.221968 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d347d5b5-4c89-417b-bb23-df0386b89bef tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1319 microversion: 2.1 time: 0.635110 May 19 04:40:32.225252 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1157/2242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:31 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:32.236363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39551f3b-d99c-4697-be32-659f8ddf8bdd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:32.237602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39551f3b-d99c-4697-be32-659f8ddf8bdd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:32.245025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39551f3b-d99c-4697-be32-659f8ddf8bdd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:32.245915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39551f3b-d99c-4697-be32-659f8ddf8bdd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:32.247725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39551f3b-d99c-4697-be32-659f8ddf8bdd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:32.248487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39551f3b-d99c-4697-be32-659f8ddf8bdd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:32.482307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39551f3b-d99c-4697-be32-659f8ddf8bdd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:32.490925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:32.496007 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39551f3b-d99c-4697-be32-659f8ddf8bdd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1273 microversion: 2.1 time: 0.268872 May 19 04:40:32.497813 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1158/2243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:32 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:32.504595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-75233846-8fa1-4c1e-bf1d-b42d369095f7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:32.505590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-75233846-8fa1-4c1e-bf1d-b42d369095f7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:32.515687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75233846-8fa1-4c1e-bf1d-b42d369095f7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:32.516490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75233846-8fa1-4c1e-bf1d-b42d369095f7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:32.518180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75233846-8fa1-4c1e-bf1d-b42d369095f7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:32.519031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75233846-8fa1-4c1e-bf1d-b42d369095f7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:32.846432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e911d1f3-b974-4f9d-8045-b7e53a70d873 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:32.858740 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e911d1f3-b974-4f9d-8045-b7e53a70d873 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1318 microversion: 2.1 time: 0.887466 May 19 04:40:32.860241 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1086/2244] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:31 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:32.865506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:32.867192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:32.877867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:32.878999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:32.880100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:32.881611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:33.520551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-75233846-8fa1-4c1e-bf1d-b42d369095f7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:33.540689 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-75233846-8fa1-4c1e-bf1d-b42d369095f7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1323 microversion: 2.1 time: 1.038716 May 19 04:40:33.541747 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1159/2245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:32 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1323 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:33.554033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6c1d071c-50b3-4a91-abe8-66cda5c59f1c req-1b9871c9-459f-4f88-940f-0c3ce23f6c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ece96d-d36d-4e0e-8065-8055d12bfafb", "name": "network-vif-plugged", "status": "completed", "tag": "964499cb-b208-4bca-b40a-c866afc7c177"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:33.575886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6c1d071c-50b3-4a91-abe8-66cda5c59f1c req-1b9871c9-459f-4f88-940f-0c3ce23f6c19 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:33.576756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6c1d071c-50b3-4a91-abe8-66cda5c59f1c req-1b9871c9-459f-4f88-940f-0c3ce23f6c19 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:33.608675 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6c1d071c-50b3-4a91-abe8-66cda5c59f1c req-1b9871c9-459f-4f88-940f-0c3ce23f6c19 service nova] Creating event network-vif-plugged:964499cb-b208-4bca-b40a-c866afc7c177 for instance 59ece96d-d36d-4e0e-8065-8055d12bfafb on n-h2-766726-30 May 19 04:40:33.621882 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6c1d071c-50b3-4a91-abe8-66cda5c59f1c req-1b9871c9-459f-4f88-940f-0c3ce23f6c19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076439 May 19 04:40:33.625068 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1160/2246] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:33.723254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:33.733989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:33.735686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:33.736937 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5b56b27e-d5c5-43a8-8af1-44da59f7fb4f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.875496 May 19 04:40:33.738090 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1087/2247] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:32 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:33.743747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e365e017-3288-43a9-afff-21a3a2b1b285 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:33.744556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e365e017-3288-43a9-afff-21a3a2b1b285 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:33.758225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e365e017-3288-43a9-afff-21a3a2b1b285 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:33.759038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e365e017-3288-43a9-afff-21a3a2b1b285 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:33.760085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e365e017-3288-43a9-afff-21a3a2b1b285 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:33.761679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e365e017-3288-43a9-afff-21a3a2b1b285 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:33.812105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0ddb657c-c27d-4772-85c7-921f940dde2f tempest-QuotaClassesAdminTestJSON-1331655053 tempest-QuotaClassesAdminTestJSON-1331655053-project-admin] Calling method '.version_select at 0x7fd315d29ee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:33.813479 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:33.813479 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:40:33.827249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0ddb657c-c27d-4772-85c7-921f940dde2f tempest-QuotaClassesAdminTestJSON-1331655053 tempest-QuotaClassesAdminTestJSON-1331655053-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.200664 May 19 04:40:33.828021 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1161/2248] 10.222.0.58 () {58 vars in 1184 bytes} [Thu May 19 04:40:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:33.841967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c4044e02-e79e-43f7-b1dc-c4307d91dc30 req-cdb12969-80f9-4439-a779-b3da60d1dd4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28e3b5b-0420-466c-b3ee-98ed2ab1e101", "tag": "0709d4db-9bd2-49ff-a5ad-cfcd318873d3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:33.853509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c4044e02-e79e-43f7-b1dc-c4307d91dc30 req-cdb12969-80f9-4439-a779-b3da60d1dd4a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:33.854360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c4044e02-e79e-43f7-b1dc-c4307d91dc30 req-cdb12969-80f9-4439-a779-b3da60d1dd4a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:33.873726 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c4044e02-e79e-43f7-b1dc-c4307d91dc30 req-cdb12969-80f9-4439-a779-b3da60d1dd4a service nova] Creating event network-changed:0709d4db-9bd2-49ff-a5ad-cfcd318873d3 for instance b28e3b5b-0420-466c-b3ee-98ed2ab1e101 on n-h2-766726-30 May 19 04:40:33.880646 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c4044e02-e79e-43f7-b1dc-c4307d91dc30 req-cdb12969-80f9-4439-a779-b3da60d1dd4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049813 May 19 04:40:33.881967 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1162/2249] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:33.889897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e7e9f4a-0e61-4d0a-87b7-f8c5db5bc9b4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:33.891408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9e7e9f4a-0e61-4d0a-87b7-f8c5db5bc9b4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:33.908798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e7e9f4a-0e61-4d0a-87b7-f8c5db5bc9b4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:33.909736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e7e9f4a-0e61-4d0a-87b7-f8c5db5bc9b4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:33.911998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e7e9f4a-0e61-4d0a-87b7-f8c5db5bc9b4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:33.912748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e7e9f4a-0e61-4d0a-87b7-f8c5db5bc9b4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:34.032910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e365e017-3288-43a9-afff-21a3a2b1b285 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:34.041928 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e365e017-3288-43a9-afff-21a3a2b1b285 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1319 microversion: 2.1 time: 0.302495 May 19 04:40:34.045004 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1088/2250] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:33 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:34.067641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b24f39ee-86a6-46d2-935f-0e9af9c7bfb7 tempest-QuotaClassesAdminTestJSON-1331655053 tempest-QuotaClassesAdminTestJSON-1331655053-project-admin] Action: 'update', calling method: .version_select at 0x7fd31b717e50>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:34.071195 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:34.071195 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:40:34.145298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9e7e9f4a-0e61-4d0a-87b7-f8c5db5bc9b4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:34.154382 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e7e9f4a-0e61-4d0a-87b7-f8c5db5bc9b4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1315 microversion: 2.1 time: 0.270930 May 19 04:40:34.155576 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1163/2251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:33 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:34.160464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d7bed696-a490-473f-a171-e20cef0adb67 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:34.161124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d7bed696-a490-473f-a171-e20cef0adb67 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:34.168535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7bed696-a490-473f-a171-e20cef0adb67 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:34.169238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7bed696-a490-473f-a171-e20cef0adb67 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:34.170219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7bed696-a490-473f-a171-e20cef0adb67 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:34.170840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7bed696-a490-473f-a171-e20cef0adb67 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:34.184753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=85,nova_api:UPDATE=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:34.325970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d7bed696-a490-473f-a171-e20cef0adb67 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:34.337389 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d7bed696-a490-473f-a171-e20cef0adb67 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1318 microversion: 2.1 time: 0.180276 May 19 04:40:34.338552 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1164/2252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:34 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:34.346051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3a782a63-7aff-4a96-8516-9b6cf2d7a396 req-c8bf8e94-a6b4-47a8-9dec-fcf3b031e968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb877d5d-0195-476d-b98e-214237ab958e", "tag": "15705a77-261b-4a61-915d-6329807f2d66"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:34.359295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3a782a63-7aff-4a96-8516-9b6cf2d7a396 req-c8bf8e94-a6b4-47a8-9dec-fcf3b031e968 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:34.360103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3a782a63-7aff-4a96-8516-9b6cf2d7a396 req-c8bf8e94-a6b4-47a8-9dec-fcf3b031e968 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:34.372901 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3a782a63-7aff-4a96-8516-9b6cf2d7a396 req-c8bf8e94-a6b4-47a8-9dec-fcf3b031e968 service nova] Creating event network-changed:15705a77-261b-4a61-915d-6329807f2d66 for instance cb877d5d-0195-476d-b98e-214237ab958e on n-h2-766726-30 May 19 04:40:34.379666 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3a782a63-7aff-4a96-8516-9b6cf2d7a396 req-c8bf8e94-a6b4-47a8-9dec-fcf3b031e968 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037449 May 19 04:40:34.380878 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1165/2253] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:34.393303 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b24f39ee-86a6-46d2-935f-0e9af9c7bfb7 tempest-QuotaClassesAdminTestJSON-1331655053 tempest-QuotaClassesAdminTestJSON-1331655053-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.335468 May 19 04:40:34.394302 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1089/2254] 10.222.0.58 () {60 vars in 1205 bytes} [Thu May 19 04:40:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:34.405247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4477a703-288d-4cb5-807e-32c6e5bff3c6 tempest-QuotaClassesAdminTestJSON-1331655053 tempest-QuotaClassesAdminTestJSON-1331655053-project-admin] Calling method '.version_select at 0x7fd315c69160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:34.406314 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:34.406314 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:40:34.417849 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4477a703-288d-4cb5-807e-32c6e5bff3c6 tempest-QuotaClassesAdminTestJSON-1331655053 tempest-QuotaClassesAdminTestJSON-1331655053-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016635 May 19 04:40:34.418670 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1166/2255] 10.222.0.58 () {58 vars in 1184 bytes} [Thu May 19 04:40:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:34.428988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-67487485-3c7c-4f1f-8684-3194a1a1a335 tempest-QuotaClassesAdminTestJSON-1331655053 tempest-QuotaClassesAdminTestJSON-1331655053-project-admin] Action: 'update', calling method: .version_select at 0x7fd31b74f700>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:34.549343 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-67487485-3c7c-4f1f-8684-3194a1a1a335 tempest-QuotaClassesAdminTestJSON-1331655053 tempest-QuotaClassesAdminTestJSON-1331655053-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.123841 May 19 04:40:34.550319 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1090/2256] 10.222.0.58 () {60 vars in 1205 bytes} [Thu May 19 04:40:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:40:34.561473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5cc9e618-9bf9-4c57-ba7d-4c54c823dbd6 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:34.562279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5cc9e618-9bf9-4c57-ba7d-4c54c823dbd6 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:34.568793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cc9e618-9bf9-4c57-ba7d-4c54c823dbd6 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:34.569355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cc9e618-9bf9-4c57-ba7d-4c54c823dbd6 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:34.570784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cc9e618-9bf9-4c57-ba7d-4c54c823dbd6 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:34.571515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5cc9e618-9bf9-4c57-ba7d-4c54c823dbd6 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:34.761663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:34.762475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:34.770095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:34.770652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:34.772517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:34.772893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:34.846373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5cc9e618-9bf9-4c57-ba7d-4c54c823dbd6 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:34.863620 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5cc9e618-9bf9-4c57-ba7d-4c54c823dbd6 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1323 microversion: 2.1 time: 0.310275 May 19 04:40:34.864221 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1167/2257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:34 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:35.064319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7556335e-1c0d-44cd-abe1-20a219799139 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:35.065789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7556335e-1c0d-44cd-abe1-20a219799139 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:35.090254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7556335e-1c0d-44cd-abe1-20a219799139 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:35.092136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7556335e-1c0d-44cd-abe1-20a219799139 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:35.093351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7556335e-1c0d-44cd-abe1-20a219799139 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:35.095198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7556335e-1c0d-44cd-abe1-20a219799139 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:35.478967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:35.491703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:35.493846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:35.495783 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ef71f565-a2e8-4038-933c-e5b0f5d23db5 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.740744 May 19 04:40:35.507938 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1091/2258] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:34 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:40:35.512820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-50fcbf9c-8584-4a44-bf5b-a71423f2fd59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:35.513899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-50fcbf9c-8584-4a44-bf5b-a71423f2fd59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:35.529731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50fcbf9c-8584-4a44-bf5b-a71423f2fd59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:35.533717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50fcbf9c-8584-4a44-bf5b-a71423f2fd59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:35.534790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50fcbf9c-8584-4a44-bf5b-a71423f2fd59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:35.540188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50fcbf9c-8584-4a44-bf5b-a71423f2fd59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:35.650440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7556335e-1c0d-44cd-abe1-20a219799139 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:35.662074 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7556335e-1c0d-44cd-abe1-20a219799139 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1319 microversion: 2.1 time: 0.603522 May 19 04:40:35.663257 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1168/2259] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:35 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:35.672074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a288f991-4dc1-42b0-888e-b7fc7c3104cd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:35.673025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a288f991-4dc1-42b0-888e-b7fc7c3104cd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:35.681560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a288f991-4dc1-42b0-888e-b7fc7c3104cd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:35.682445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a288f991-4dc1-42b0-888e-b7fc7c3104cd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:35.684888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a288f991-4dc1-42b0-888e-b7fc7c3104cd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:35.685958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a288f991-4dc1-42b0-888e-b7fc7c3104cd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:36.084269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-50fcbf9c-8584-4a44-bf5b-a71423f2fd59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:36.097445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a288f991-4dc1-42b0-888e-b7fc7c3104cd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:36.110471 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-50fcbf9c-8584-4a44-bf5b-a71423f2fd59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1315 microversion: 2.1 time: 0.599024 May 19 04:40:36.123122 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1092/2260] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:35 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:36.128566 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a288f991-4dc1-42b0-888e-b7fc7c3104cd tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1318 microversion: 2.1 time: 0.462414 May 19 04:40:36.130905 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1169/2261] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:35 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:36.140231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-941f4472-2cae-45a0-815a-6f6f41d2078e req-b70fae3f-ba82-492d-8a2e-d7cd7cb82493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07db7246-3187-41a6-afc2-aa8befff8701", "name": "network-vif-plugged", "status": "completed", "tag": "29c2f817-6863-4ebe-9dbf-066d9a3ce3d9"}, {"server_uuid": "163dcde2-c67f-4794-a106-f1bace4d6c80", "name": "network-vif-plugged", "status": "completed", "tag": "80651dbd-c4e5-49d2-8d93-351e469e9c30"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:36.143307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-027d2567-c27f-49b8-af17-0abbdbe38b64 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:36.163588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-027d2567-c27f-49b8-af17-0abbdbe38b64 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:36.193250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-941f4472-2cae-45a0-815a-6f6f41d2078e req-b70fae3f-ba82-492d-8a2e-d7cd7cb82493 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:36.194365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-027d2567-c27f-49b8-af17-0abbdbe38b64 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:36.195158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-027d2567-c27f-49b8-af17-0abbdbe38b64 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:36.196700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-941f4472-2cae-45a0-815a-6f6f41d2078e req-b70fae3f-ba82-492d-8a2e-d7cd7cb82493 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:36.198537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-027d2567-c27f-49b8-af17-0abbdbe38b64 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:36.199471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-027d2567-c27f-49b8-af17-0abbdbe38b64 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:36.239086 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-941f4472-2cae-45a0-815a-6f6f41d2078e req-b70fae3f-ba82-492d-8a2e-d7cd7cb82493 service nova] Creating event network-vif-plugged:29c2f817-6863-4ebe-9dbf-066d9a3ce3d9 for instance 07db7246-3187-41a6-afc2-aa8befff8701 on n-h1-766726-30 May 19 04:40:36.239629 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-941f4472-2cae-45a0-815a-6f6f41d2078e req-b70fae3f-ba82-492d-8a2e-d7cd7cb82493 service nova] Creating event network-vif-plugged:80651dbd-c4e5-49d2-8d93-351e469e9c30 for instance 163dcde2-c67f-4794-a106-f1bace4d6c80 on n-h1-766726-30 May 19 04:40:36.257313 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-941f4472-2cae-45a0-815a-6f6f41d2078e req-b70fae3f-ba82-492d-8a2e-d7cd7cb82493 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.130008 May 19 04:40:36.262534 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1093/2262] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:36.519595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:36.520558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:36.544437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:36.546781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:36.550130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:36.552225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:36.677169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-027d2567-c27f-49b8-af17-0abbdbe38b64 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:36.688976 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-027d2567-c27f-49b8-af17-0abbdbe38b64 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1323 microversion: 2.1 time: 0.556625 May 19 04:40:36.689698 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1170/2263] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:36 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1323 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:36.715132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1559eee9-5b43-4193-8507-1b2cafbe59d0 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:36.716289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1559eee9-5b43-4193-8507-1b2cafbe59d0 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:36.732121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1559eee9-5b43-4193-8507-1b2cafbe59d0 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:36.732895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1559eee9-5b43-4193-8507-1b2cafbe59d0 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:36.733917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1559eee9-5b43-4193-8507-1b2cafbe59d0 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:36.734606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1559eee9-5b43-4193-8507-1b2cafbe59d0 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:37.102331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1559eee9-5b43-4193-8507-1b2cafbe59d0 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:37.115474 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1559eee9-5b43-4193-8507-1b2cafbe59d0 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1319 microversion: 2.1 time: 0.402669 May 19 04:40:37.118699 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1171/2264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:36 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:37.132962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-59f77f9f-126f-4055-823b-7b9509ae993b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:37.136092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-59f77f9f-126f-4055-823b-7b9509ae993b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:37.140042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:37.152364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59f77f9f-126f-4055-823b-7b9509ae993b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:37.153820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59f77f9f-126f-4055-823b-7b9509ae993b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:37.156158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59f77f9f-126f-4055-823b-7b9509ae993b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:37.156357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:37.157694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59f77f9f-126f-4055-823b-7b9509ae993b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:37.158458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:37.159917 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-674ef122-fd31-4d44-8029-6f1048744a5c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.647908 May 19 04:40:37.162272 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1094/2265] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:36 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:37.229380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a9ac0dd-a53b-43c7-a760-67b4ddcf1a04 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:37.230181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3a9ac0dd-a53b-43c7-a760-67b4ddcf1a04 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:37.239079 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a9ac0dd-a53b-43c7-a760-67b4ddcf1a04 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:37.239536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a9ac0dd-a53b-43c7-a760-67b4ddcf1a04 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:37.240437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a9ac0dd-a53b-43c7-a760-67b4ddcf1a04 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:37.240890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a9ac0dd-a53b-43c7-a760-67b4ddcf1a04 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:37.269004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:37.517014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-59f77f9f-126f-4055-823b-7b9509ae993b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:37.530987 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-59f77f9f-126f-4055-823b-7b9509ae993b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1315 microversion: 2.1 time: 0.404157 May 19 04:40:37.539337 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1172/2266] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:37 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:37.546077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3a9ac0dd-a53b-43c7-a760-67b4ddcf1a04 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:37.554422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a9ac0dd-a53b-43c7-a760-67b4ddcf1a04 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1318 microversion: 2.1 time: 0.329352 May 19 04:40:37.563673 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1095/2267] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:37 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:37.708053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2f44659-defa-4092-ad3a-7375e62094d9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:37.708892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2f44659-defa-4092-ad3a-7375e62094d9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:37.716800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2f44659-defa-4092-ad3a-7375e62094d9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:37.717782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2f44659-defa-4092-ad3a-7375e62094d9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:37.718879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2f44659-defa-4092-ad3a-7375e62094d9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:37.719569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2f44659-defa-4092-ad3a-7375e62094d9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:37.931472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e2f44659-defa-4092-ad3a-7375e62094d9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:37.940345 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2f44659-defa-4092-ad3a-7375e62094d9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1323 microversion: 2.1 time: 0.237491 May 19 04:40:37.941439 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1173/2268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:37 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1323 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:38.137233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-54def704-ba65-49e5-8794-ae773f001936 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:38.137985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-54def704-ba65-49e5-8794-ae773f001936 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:38.146918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54def704-ba65-49e5-8794-ae773f001936 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.149640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54def704-ba65-49e5-8794-ae773f001936 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.150447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54def704-ba65-49e5-8794-ae773f001936 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.150891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54def704-ba65-49e5-8794-ae773f001936 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.179571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:38.180819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:38.190447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.191862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.192891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.193531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.444150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-54def704-ba65-49e5-8794-ae773f001936 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:38.452469 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-54def704-ba65-49e5-8794-ae773f001936 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1319 microversion: 2.1 time: 0.319387 May 19 04:40:38.456467 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1096/2269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:38 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:38.496348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:38.509508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:38.512120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:38.514053 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-78048104-eb22-4ef8-94b8-d000280a308a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.338051 May 19 04:40:38.529587 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1174/2270] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:38 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:38.553300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d7f86d19-217b-4f84-b29d-70b721fa3989 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:38.554262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d7f86d19-217b-4f84-b29d-70b721fa3989 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:38.560895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7f86d19-217b-4f84-b29d-70b721fa3989 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.561646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7f86d19-217b-4f84-b29d-70b721fa3989 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.562806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7f86d19-217b-4f84-b29d-70b721fa3989 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.563538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7f86d19-217b-4f84-b29d-70b721fa3989 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.570881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-23aaf41a-a7b3-4a2a-b51a-2f2fa0a9ceec tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:38.571505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-23aaf41a-a7b3-4a2a-b51a-2f2fa0a9ceec tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:38.582145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23aaf41a-a7b3-4a2a-b51a-2f2fa0a9ceec tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.582562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23aaf41a-a7b3-4a2a-b51a-2f2fa0a9ceec tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.583557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23aaf41a-a7b3-4a2a-b51a-2f2fa0a9ceec tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.584058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23aaf41a-a7b3-4a2a-b51a-2f2fa0a9ceec tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.806083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23aaf41a-a7b3-4a2a-b51a-2f2fa0a9ceec tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:38.808358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d7f86d19-217b-4f84-b29d-70b721fa3989 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:38.814732 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-23aaf41a-a7b3-4a2a-b51a-2f2fa0a9ceec tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1507 microversion: 2.1 time: 0.247672 May 19 04:40:38.815964 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1175/2271] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:38 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:38.821926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-bb64b01c-b6a4-40f8-97c3-88ed50e6b155 req-53041110-d1e6-4df4-bdde-939b27d7a100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28e3b5b-0420-466c-b3ee-98ed2ab1e101", "name": "network-vif-plugged", "status": "completed", "tag": "0709d4db-9bd2-49ff-a5ad-cfcd318873d3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:38.827505 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d7f86d19-217b-4f84-b29d-70b721fa3989 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1315 microversion: 2.1 time: 0.276536 May 19 04:40:38.828542 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1097/2272] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:38 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:38.832849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bb64b01c-b6a4-40f8-97c3-88ed50e6b155 req-53041110-d1e6-4df4-bdde-939b27d7a100 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.835207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bb64b01c-b6a4-40f8-97c3-88ed50e6b155 req-53041110-d1e6-4df4-bdde-939b27d7a100 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.852116 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-bb64b01c-b6a4-40f8-97c3-88ed50e6b155 req-53041110-d1e6-4df4-bdde-939b27d7a100 service nova] Creating event network-vif-plugged:0709d4db-9bd2-49ff-a5ad-cfcd318873d3 for instance b28e3b5b-0420-466c-b3ee-98ed2ab1e101 on n-h2-766726-30 May 19 04:40:38.860701 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-bb64b01c-b6a4-40f8-97c3-88ed50e6b155 req-53041110-d1e6-4df4-bdde-939b27d7a100 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042896 May 19 04:40:38.862482 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1176/2273] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:38.870143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9f205ed0-e164-44d6-ac97-801bc725cd03 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:38.871618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9f205ed0-e164-44d6-ac97-801bc725cd03 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:38.880161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f205ed0-e164-44d6-ac97-801bc725cd03 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.881159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f205ed0-e164-44d6-ac97-801bc725cd03 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:38.882425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f205ed0-e164-44d6-ac97-801bc725cd03 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:38.883842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f205ed0-e164-44d6-ac97-801bc725cd03 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.037254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-872a3987-0221-4b5b-b180-078f39fa3bca tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.038809 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:39.038809 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:40:39.041022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-872a3987-0221-4b5b-b180-078f39fa3bca tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.041618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-872a3987-0221-4b5b-b180-078f39fa3bca tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.042543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-872a3987-0221-4b5b-b180-078f39fa3bca tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.043239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-872a3987-0221-4b5b-b180-078f39fa3bca tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.092539 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-872a3987-0221-4b5b-b180-078f39fa3bca tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.262485 May 19 04:40:39.094020 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1098/2274] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:40:38 2022] GET /compute/v2.1/os-services => generated 949 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:39.098724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-80af5b13-9358-4513-ae42-16cf359a68a0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.099341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-80af5b13-9358-4513-ae42-16cf359a68a0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:39.107513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80af5b13-9358-4513-ae42-16cf359a68a0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.107972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80af5b13-9358-4513-ae42-16cf359a68a0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.108753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80af5b13-9358-4513-ae42-16cf359a68a0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.109219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80af5b13-9358-4513-ae42-16cf359a68a0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.124904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9f205ed0-e164-44d6-ac97-801bc725cd03 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:39.134433 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9f205ed0-e164-44d6-ac97-801bc725cd03 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1507 microversion: 2.1 time: 0.270527 May 19 04:40:39.135609 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1177/2275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:38 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:39.142649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7826e8b0-0d08-4eba-8655-0f27ef35adec tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.144283 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:39.144283 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:40:39.145804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7826e8b0-0d08-4eba-8655-0f27ef35adec tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.146462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7826e8b0-0d08-4eba-8655-0f27ef35adec tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.147461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7826e8b0-0d08-4eba-8655-0f27ef35adec tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.148097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7826e8b0-0d08-4eba-8655-0f27ef35adec tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.185660 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7826e8b0-0d08-4eba-8655-0f27ef35adec tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.048691 May 19 04:40:39.193981 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1178/2276] 10.222.0.58 () {58 vars in 1169 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:39.200229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d4c4b138-f2fc-4055-8170-01a64092e793 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:39.202213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d4c4b138-f2fc-4055-8170-01a64092e793 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:39.212916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4c4b138-f2fc-4055-8170-01a64092e793 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.214600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4c4b138-f2fc-4055-8170-01a64092e793 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.215815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4c4b138-f2fc-4055-8170-01a64092e793 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.216438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4c4b138-f2fc-4055-8170-01a64092e793 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.279948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-80af5b13-9358-4513-ae42-16cf359a68a0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:39.290444 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-80af5b13-9358-4513-ae42-16cf359a68a0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1323 microversion: 2.1 time: 0.194832 May 19 04:40:39.291747 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1099/2277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:39.296969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c2caf92-7bc6-40df-a191-e8246df5e0a6 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.298382 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:39.298382 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:40:39.299841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c2caf92-7bc6-40df-a191-e8246df5e0a6 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.300490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c2caf92-7bc6-40df-a191-e8246df5e0a6 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.302151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c2caf92-7bc6-40df-a191-e8246df5e0a6 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.302799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c2caf92-7bc6-40df-a191-e8246df5e0a6 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.310395 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d4c4b138-f2fc-4055-8170-01a64092e793 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "PUT /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1079 microversion: 2.1 time: 0.114878 May 19 04:40:39.313069 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1179/2278] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 04:40:39 2022] PUT /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1079 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:39.327731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fb7c7c57-08ef-4d70-987d-a34ffd4f5b91 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.328717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fb7c7c57-08ef-4d70-987d-a34ffd4f5b91 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:39.338394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb7c7c57-08ef-4d70-987d-a34ffd4f5b91 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.339318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb7c7c57-08ef-4d70-987d-a34ffd4f5b91 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.340427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb7c7c57-08ef-4d70-987d-a34ffd4f5b91 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.341405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb7c7c57-08ef-4d70-987d-a34ffd4f5b91 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.347164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:39.349426 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c2caf92-7bc6-40df-a191-e8246df5e0a6 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.056096 May 19 04:40:39.350464 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1100/2279] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/os-services => generated 949 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:39.361436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0e72bd16-6f7f-4594-b272-c9ea53c3cfcf tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.363992 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:39.363992 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:40:39.366568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e72bd16-6f7f-4594-b272-c9ea53c3cfcf tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.367561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e72bd16-6f7f-4594-b272-c9ea53c3cfcf tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.368394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e72bd16-6f7f-4594-b272-c9ea53c3cfcf tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.368833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e72bd16-6f7f-4594-b272-c9ea53c3cfcf tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.394742 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0e72bd16-6f7f-4594-b272-c9ea53c3cfcf tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-766726-30&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.037457 May 19 04:40:39.401246 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1101/2280] 10.222.0.58 () {58 vars in 1195 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/os-services?host=n-d-766726-30&binary=xxx => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:40:39.406685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-003cf06f-16db-4926-a887-d83b4f315278 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.408444 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:39.408444 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:40:39.409684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-003cf06f-16db-4926-a887-d83b4f315278 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.410141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-003cf06f-16db-4926-a887-d83b4f315278 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.410947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-003cf06f-16db-4926-a887-d83b4f315278 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.411386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-003cf06f-16db-4926-a887-d83b4f315278 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.438301 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-003cf06f-16db-4926-a887-d83b4f315278 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.035051 May 19 04:40:39.439194 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1102/2281] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/os-services => generated 949 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:39.453481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9992ed75-550b-49f5-9d72-8cb7eca41727 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.455011 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:39.455011 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 04:40:39.456482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9992ed75-550b-49f5-9d72-8cb7eca41727 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.457014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9992ed75-550b-49f5-9d72-8cb7eca41727 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.458122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9992ed75-550b-49f5-9d72-8cb7eca41727 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.458928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9992ed75-550b-49f5-9d72-8cb7eca41727 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.484728 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9992ed75-550b-49f5-9d72-8cb7eca41727 tempest-ServicesAdminNegativeTestJSON-315879768 tempest-ServicesAdminNegativeTestJSON-315879768-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.038220 May 19 04:40:39.491381 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1103/2282] 10.222.0.58 () {58 vars in 1197 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:40:39.495416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dba5bf4f-d399-4471-a10a-9be88077e89e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.496045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dba5bf4f-d399-4471-a10a-9be88077e89e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:39.502815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dba5bf4f-d399-4471-a10a-9be88077e89e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.503271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dba5bf4f-d399-4471-a10a-9be88077e89e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.504050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dba5bf4f-d399-4471-a10a-9be88077e89e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.504703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dba5bf4f-d399-4471-a10a-9be88077e89e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.518153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fb7c7c57-08ef-4d70-987d-a34ffd4f5b91 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:39.526451 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fb7c7c57-08ef-4d70-987d-a34ffd4f5b91 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1505 microversion: 2.1 time: 0.202806 May 19 04:40:39.527141 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1180/2283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:39.667937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64d6f62e-e169-452c-bb68-225aa4bc9567 tempest-ServicesAdminNegativeTestJSON-435302883 tempest-ServicesAdminNegativeTestJSON-435302883-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.668395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dba5bf4f-d399-4471-a10a-9be88077e89e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:39.669350 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:39.669350 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:40:39.670711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-64d6f62e-e169-452c-bb68-225aa4bc9567 tempest-ServicesAdminNegativeTestJSON-435302883 tempest-ServicesAdminNegativeTestJSON-435302883-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9b7284ebdad444b29f885ca7dd614496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7304ba15a8d640c4a2c01c180b407555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64d6f62e-e169-452c-bb68-225aa4bc9567 tempest-ServicesAdminNegativeTestJSON-435302883 tempest-ServicesAdminNegativeTestJSON-435302883-project] Request method failure captured: May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-services HTTP/1.1 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpFZzWot2PWwU3GjpLK6HejoBZIF9Ri-vv48zgKT48_uQBwWM7Jd12_3nYnQB6TtlsNsT_i8c26X4Y1h5nvL-JogNg4-3gsC40vFiS20ka4UMfdPnA0ejd_A8RRvgoZdNf0ZNQuMSgjwoH69QusXKcUsLo59Ni6IRyLQrohl4sNXBM May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 7304ba15a8d640c4a2c01c180b407555 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-435302883 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7304ba15a8d640c4a2c01c180b407555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7304ba15a8d640c4a2c01c180b407555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7304ba15a8d640c4a2c01c180b407555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7304ba15a8d640c4a2c01c180b407555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-435302883 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 7304ba15a8d640c4a2c01c180b407555 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-435302883 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServicesAdminNegativeTestJSON-435302883-project May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 9b7284ebdad444b29f885ca7dd614496 May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-435302883-project May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: action_args: {} May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 04:40:39.672366 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64d6f62e-e169-452c-bb68-225aa4bc9567 tempest-ServicesAdminNegativeTestJSON-435302883 tempest-ServicesAdminNegativeTestJSON-435302883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64d6f62e-e169-452c-bb68-225aa4bc9567 tempest-ServicesAdminNegativeTestJSON-435302883 tempest-ServicesAdminNegativeTestJSON-435302883-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.138901 May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1181/2284] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/os-services => generated 112 bytes in 141 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.683322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:39.687496 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dba5bf4f-d399-4471-a10a-9be88077e89e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1467 microversion: 2.1 time: 0.200552 May 19 04:40:39.688282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.688749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.689580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.690032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.701638 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1104/2285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1467 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:39.707760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7db96f0d-7023-4640-a3d4-685f6951b88b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:39.707760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7db96f0d-7023-4640-a3d4-685f6951b88b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:39.711547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:UPDATE=21,nova_api:SELECT=74,nova_api:INSERT=5 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:39.716926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7db96f0d-7023-4640-a3d4-685f6951b88b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.717665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7db96f0d-7023-4640-a3d4-685f6951b88b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.718583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7db96f0d-7023-4640-a3d4-685f6951b88b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:39.719111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7db96f0d-7023-4640-a3d4-685f6951b88b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:39.999684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7db96f0d-7023-4640-a3d4-685f6951b88b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:40.008466 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7db96f0d-7023-4640-a3d4-685f6951b88b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1505 microversion: 2.1 time: 0.305569 May 19 04:40:40.009990 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1105/2286] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:40.017058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40c322b5-7a5d-4b4d-9b80-8ba27978d9fd tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:40.018074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-40c322b5-7a5d-4b4d-9b80-8ba27978d9fd tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:40.033622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:40.035050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40c322b5-7a5d-4b4d-9b80-8ba27978d9fd tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.035521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40c322b5-7a5d-4b4d-9b80-8ba27978d9fd tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.036380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40c322b5-7a5d-4b4d-9b80-8ba27978d9fd tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.037044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40c322b5-7a5d-4b4d-9b80-8ba27978d9fd tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.048399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:40.050145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:40.051630 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5125e1a8-7b78-456a-80a7-d172d588a845 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.376047 May 19 04:40:40.052495 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1182/2287] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:39 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:40.058969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88b831be-0aae-4b33-8410-2e6dc1f40cf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:40.059684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-88b831be-0aae-4b33-8410-2e6dc1f40cf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:40.064619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-40c322b5-7a5d-4b4d-9b80-8ba27978d9fd tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lazy-loading 'flavor' on Instance uuid 07db7246-3187-41a6-afc2-aa8befff8701 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:40:40.065885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:40.068462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88b831be-0aae-4b33-8410-2e6dc1f40cf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.068999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88b831be-0aae-4b33-8410-2e6dc1f40cf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.072038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88b831be-0aae-4b33-8410-2e6dc1f40cf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.072491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88b831be-0aae-4b33-8410-2e6dc1f40cf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.154952 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-40c322b5-7a5d-4b4d-9b80-8ba27978d9fd tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701/action" status: 202 len: 0 microversion: 2.1 time: 0.143163 May 19 04:40:40.155967 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1106/2288] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:40:40 2022] POST /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:40:40.162331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24c63d75-e116-4e16-b0ee-aacd786322d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:40.164001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-24c63d75-e116-4e16-b0ee-aacd786322d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:40.180810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24c63d75-e116-4e16-b0ee-aacd786322d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.181671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24c63d75-e116-4e16-b0ee-aacd786322d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.182674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24c63d75-e116-4e16-b0ee-aacd786322d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.186410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24c63d75-e116-4e16-b0ee-aacd786322d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.262877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-88b831be-0aae-4b33-8410-2e6dc1f40cf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:40.263139 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-24c63d75-e116-4e16-b0ee-aacd786322d4 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "PUT /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1081 microversion: 2.1 time: 0.105395 May 19 04:40:40.264231 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1107/2289] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 04:40:40 2022] PUT /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1081 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:40.272215 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88b831be-0aae-4b33-8410-2e6dc1f40cf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1315 microversion: 2.1 time: 0.218544 May 19 04:40:40.273137 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1183/2290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:40 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:40.280210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41297078-ee32-4320-9b84-8f814fa7967a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:40.280348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-383ab10f-6b4b-403a-81b2-3637b00a6e0d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:40.281368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-383ab10f-6b4b-403a-81b2-3637b00a6e0d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:40.281933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-41297078-ee32-4320-9b84-8f814fa7967a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:40.290798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41297078-ee32-4320-9b84-8f814fa7967a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.291571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41297078-ee32-4320-9b84-8f814fa7967a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.292436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41297078-ee32-4320-9b84-8f814fa7967a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.293493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-383ab10f-6b4b-403a-81b2-3637b00a6e0d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.293652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41297078-ee32-4320-9b84-8f814fa7967a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.295714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-383ab10f-6b4b-403a-81b2-3637b00a6e0d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.296649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-383ab10f-6b4b-403a-81b2-3637b00a6e0d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.297146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-383ab10f-6b4b-403a-81b2-3637b00a6e0d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.594516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-41297078-ee32-4320-9b84-8f814fa7967a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:40.604462 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-41297078-ee32-4320-9b84-8f814fa7967a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1507 microversion: 2.1 time: 0.328964 May 19 04:40:40.605962 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1184/2291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:40 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:40.611011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea958e89-4589-4e4c-b75c-966572f69aa7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:40.611921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ea958e89-4589-4e4c-b75c-966572f69aa7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:40.614030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-383ab10f-6b4b-403a-81b2-3637b00a6e0d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:40.622418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea958e89-4589-4e4c-b75c-966572f69aa7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.623631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea958e89-4589-4e4c-b75c-966572f69aa7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.623942 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-383ab10f-6b4b-403a-81b2-3637b00a6e0d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1475 microversion: 2.1 time: 0.358609 May 19 04:40:40.626653 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1108/2292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:40 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1475 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:40.632705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-357610af-364a-400f-af23-2f5e0eb127e6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:40.634729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea958e89-4589-4e4c-b75c-966572f69aa7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.635442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea958e89-4589-4e4c-b75c-966572f69aa7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.637464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-357610af-364a-400f-af23-2f5e0eb127e6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:40.647327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-357610af-364a-400f-af23-2f5e0eb127e6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.652705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-357610af-364a-400f-af23-2f5e0eb127e6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.652705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-357610af-364a-400f-af23-2f5e0eb127e6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.652705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-357610af-364a-400f-af23-2f5e0eb127e6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.877597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ea958e89-4589-4e4c-b75c-966572f69aa7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:40.886503 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ea958e89-4589-4e4c-b75c-966572f69aa7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 200 len: 1515 microversion: 2.1 time: 0.279238 May 19 04:40:40.887088 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1185/2293] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:40 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:40.892828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6ef99c0e-2752-4b5e-85fb-520b7135bd8b req-3ad2133a-2745-4e13-81a5-49a28e117da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b1ec1b-3115-4cd6-ab4b-e430266a6147", "name": "network-vif-plugged", "status": "completed", "tag": "ca85c40e-7474-4a04-a51f-acd3567f6990"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:40.902289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6ef99c0e-2752-4b5e-85fb-520b7135bd8b req-3ad2133a-2745-4e13-81a5-49a28e117da6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.903030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6ef99c0e-2752-4b5e-85fb-520b7135bd8b req-3ad2133a-2745-4e13-81a5-49a28e117da6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.918742 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6ef99c0e-2752-4b5e-85fb-520b7135bd8b req-3ad2133a-2745-4e13-81a5-49a28e117da6 service nova] Creating event network-vif-plugged:ca85c40e-7474-4a04-a51f-acd3567f6990 for instance a7b1ec1b-3115-4cd6-ab4b-e430266a6147 on n-h1-766726-30 May 19 04:40:40.920008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-357610af-364a-400f-af23-2f5e0eb127e6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:40.924561 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6ef99c0e-2752-4b5e-85fb-520b7135bd8b req-3ad2133a-2745-4e13-81a5-49a28e117da6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036304 May 19 04:40:40.925591 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1186/2294] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:40.933266 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-357610af-364a-400f-af23-2f5e0eb127e6 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1507 microversion: 2.1 time: 0.305197 May 19 04:40:40.933976 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1109/2295] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:40 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:40.934346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f557ac9-2cdd-4884-b2fe-5889768d2058 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:40.936246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f557ac9-2cdd-4884-b2fe-5889768d2058 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:40.944448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f557ac9-2cdd-4884-b2fe-5889768d2058 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.946147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f557ac9-2cdd-4884-b2fe-5889768d2058 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.948190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f557ac9-2cdd-4884-b2fe-5889768d2058 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.948835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f557ac9-2cdd-4884-b2fe-5889768d2058 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.956061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e0b431f-c84e-4ccd-9c3e-ccbda331db5b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:40.956583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e0b431f-c84e-4ccd-9c3e-ccbda331db5b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:40.967623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e0b431f-c84e-4ccd-9c3e-ccbda331db5b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.968344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e0b431f-c84e-4ccd-9c3e-ccbda331db5b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.969334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e0b431f-c84e-4ccd-9c3e-ccbda331db5b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:40.970065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e0b431f-c84e-4ccd-9c3e-ccbda331db5b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:40.998417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e0b431f-c84e-4ccd-9c3e-ccbda331db5b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:41.108257 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e0b431f-c84e-4ccd-9c3e-ccbda331db5b tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "DELETE /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 204 len: 0 microversion: 2.1 time: 0.160953 May 19 04:40:41.115213 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1110/2296] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:40 2022] DELETE /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:41.122558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:41.123634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:41.130895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.131856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.133339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.134711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.156776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:41.201929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0f557ac9-2cdd-4884-b2fe-5889768d2058 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:41.211751 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f557ac9-2cdd-4884-b2fe-5889768d2058 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147" status: 200 len: 1323 microversion: 2.1 time: 0.283665 May 19 04:40:41.212264 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1187/2297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:40 2022] GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147 => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:41.217127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a05e2ea-150b-4f42-98b6-f597ff0c28c1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:41.217841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a05e2ea-150b-4f42-98b6-f597ff0c28c1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:41.225288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a05e2ea-150b-4f42-98b6-f597ff0c28c1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.226417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a05e2ea-150b-4f42-98b6-f597ff0c28c1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.227306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a05e2ea-150b-4f42-98b6-f597ff0c28c1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.227761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a05e2ea-150b-4f42-98b6-f597ff0c28c1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.255193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a05e2ea-150b-4f42-98b6-f597ff0c28c1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:41.303288 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-7a05e2ea-150b-4f42-98b6-f597ff0c28c1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Instance is already in deleting state, ignoring this request May 19 04:40:41.304056 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a05e2ea-150b-4f42-98b6-f597ff0c28c1 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "DELETE /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 204 len: 0 microversion: 2.1 time: 0.090771 May 19 04:40:41.308476 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1188/2298] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:41 2022] DELETE /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:41.312474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8ae069f-39b3-45aa-9bf5-2a67273157d9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:41.313567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8ae069f-39b3-45aa-9bf5-2a67273157d9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:41.321792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ae069f-39b3-45aa-9bf5-2a67273157d9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.322475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ae069f-39b3-45aa-9bf5-2a67273157d9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.323953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ae069f-39b3-45aa-9bf5-2a67273157d9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.324579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ae069f-39b3-45aa-9bf5-2a67273157d9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.368441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:41.381893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:41.384012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:41.385415 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b259925c-4d55-4ea0-b014-e53edca781f1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.273345 May 19 04:40:41.385990 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1111/2299] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:41 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:41.390883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c2ad9a3f-6da2-492f-acec-d3c72f9ede25 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:41.391785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c2ad9a3f-6da2-492f-acec-d3c72f9ede25 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:41.398971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2ad9a3f-6da2-492f-acec-d3c72f9ede25 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.399815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2ad9a3f-6da2-492f-acec-d3c72f9ede25 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.400821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2ad9a3f-6da2-492f-acec-d3c72f9ede25 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.401359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2ad9a3f-6da2-492f-acec-d3c72f9ede25 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.524889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8ae069f-39b3-45aa-9bf5-2a67273157d9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:41.547914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8ae069f-39b3-45aa-9bf5-2a67273157d9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1315 microversion: 2.1 time: 0.241554 May 19 04:40:41.548517 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1189/2300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:41 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:41.560863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2ad9a3f-6da2-492f-acec-d3c72f9ede25 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:41.568982 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c2ad9a3f-6da2-492f-acec-d3c72f9ede25 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1513 microversion: 2.1 time: 0.181755 May 19 04:40:41.569581 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1112/2301] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:41 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:41.641640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a47a2880-604e-4b32-b53c-8c102abb7e27 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:41.642269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a47a2880-604e-4b32-b53c-8c102abb7e27 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:41.649337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a47a2880-604e-4b32-b53c-8c102abb7e27 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.649944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a47a2880-604e-4b32-b53c-8c102abb7e27 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.653965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a47a2880-604e-4b32-b53c-8c102abb7e27 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.653965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a47a2880-604e-4b32-b53c-8c102abb7e27 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.794921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a47a2880-604e-4b32-b53c-8c102abb7e27 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:41.802529 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a47a2880-604e-4b32-b53c-8c102abb7e27 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1458 microversion: 2.1 time: 0.164801 May 19 04:40:41.803114 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1190/2302] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:41 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1458 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:41.819468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-765780bf-8ddd-4a90-9577-33db6be62c1e tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:41.820135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-765780bf-8ddd-4a90-9577-33db6be62c1e tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:41.826293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-765780bf-8ddd-4a90-9577-33db6be62c1e tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.826750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-765780bf-8ddd-4a90-9577-33db6be62c1e tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:41.827526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-765780bf-8ddd-4a90-9577-33db6be62c1e tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:41.827967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-765780bf-8ddd-4a90-9577-33db6be62c1e tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.056724 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-765780bf-8ddd-4a90-9577-33db6be62c1e tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1611 microversion: 2.1 time: 0.240774 May 19 04:40:42.057483 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1113/2303] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:41 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1611 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:42.073352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e805c8a-3af5-4271-98e9-56b87be1ef2b tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:42.074699 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:40:42.074699 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:40:42.076220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e805c8a-3af5-4271-98e9-56b87be1ef2b tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.076691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e805c8a-3af5-4271-98e9-56b87be1ef2b tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.077532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e805c8a-3af5-4271-98e9-56b87be1ef2b tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.077974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e805c8a-3af5-4271-98e9-56b87be1ef2b tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.103016 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3e805c8a-3af5-4271-98e9-56b87be1ef2b tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.033639 May 19 04:40:42.103628 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1191/2304] 10.222.0.58 () {58 vars in 1175 bytes} [Thu May 19 04:40:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:42.114260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-766726-30", "block_migration": true, "disk_over_commit": false}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:42.115543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:42.123809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.124263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.125316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.125754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.152497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Lazy-loading 'flavor' on Instance uuid 07db7246-3187-41a6-afc2-aa8befff8701 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:40:42.165496 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 07db7246-3187-41a6-afc2-aa8befff8701 while it is in vm_state suspended May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Request method failure captured: May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701/action HTTP/1.1 May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 98 May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcoUvBOQNanq549fa4wegbItZKtiBAhGLIFzGX49rakQIPCajEdE8Iun_dQxTS52JtrXIwSe_aljicWhwfUH7whuJwITW6tzD58dOLL8jAWrW8mtxhjONe5sb9XwuT7UJd42GJCOad7eL1y4hArQT6TUomm0E1omIl5cZpoe4TYrZRI May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: cd0172d4838f4366b009e5bc8c968b5f May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-LiveMigrationNegativeTest-931950932 May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd0172d4838f4366b009e5bc8c968b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd0172d4838f4366b009e5bc8c968b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd0172d4838f4366b009e5bc8c968b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd0172d4838f4366b009e5bc8c968b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-LiveMigrationNegativeTest-931950932 May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: cd0172d4838f4366b009e5bc8c968b5f May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-931950932 May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-LiveMigrationNegativeTest-931950932-project-admin May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 9b2e372728124ee18523158df4cfc8e2 May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-LiveMigrationNegativeTest-931950932-project-admin May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: {"os-migrateLive": {"host": "n-h2-766726-30", "block_migration": true, "disk_over_commit": false}} May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: exception: Cannot 'os-migrateLive' instance 07db7246-3187-41a6-afc2-aa8befff8701 while it is in vm_state suspended May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '07db7246-3187-41a6-afc2-aa8befff8701', 'body': {'os-migrateLive': {'host': 'n-h2-766726-30', 'block_migration': True, 'disk_over_commit': False}}} May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07db7246-3187-41a6-afc2-aa8befff8701 in vm_state suspended. Cannot live_migrate while the instance is in this state. May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:42.167504 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 07db7246-3187-41a6-afc2-aa8befff8701 while it is in vm_state suspended May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 07db7246-3187-41a6-afc2-aa8befff8701 while it is in vm_state suspended May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 07db7246-3187-41a6-afc2-aa8befff8701 while it is in vm_state suspended {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-32b71067-68fc-4718-8c4f-71556f9a3259 tempest-LiveMigrationNegativeTest-931950932 tempest-LiveMigrationNegativeTest-931950932-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701/action" status: 409 len: 155 microversion: 2.1 time: 0.058645 May 19 04:40:42.172334 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1114/2305] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:40:42 2022] POST /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701/action => generated 155 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 19 04:40:42.182764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b692c208-5526-4b22-b365-6a48de13a29a tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:42.183282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b692c208-5526-4b22-b365-6a48de13a29a tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:42.189701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b692c208-5526-4b22-b365-6a48de13a29a tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.190154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b692c208-5526-4b22-b365-6a48de13a29a tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.190920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b692c208-5526-4b22-b365-6a48de13a29a tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.191498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b692c208-5526-4b22-b365-6a48de13a29a tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.218546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b692c208-5526-4b22-b365-6a48de13a29a tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:42.229202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-370a37ad-dc29-42a7-8fd8-9483e90fd7b0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:42.229979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-370a37ad-dc29-42a7-8fd8-9483e90fd7b0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:42.236342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-370a37ad-dc29-42a7-8fd8-9483e90fd7b0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.237014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-370a37ad-dc29-42a7-8fd8-9483e90fd7b0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.237993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-370a37ad-dc29-42a7-8fd8-9483e90fd7b0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.238638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-370a37ad-dc29-42a7-8fd8-9483e90fd7b0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.315784 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b692c208-5526-4b22-b365-6a48de13a29a tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "DELETE /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 204 len: 0 microversion: 2.1 time: 0.137410 May 19 04:40:42.319280 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1192/2306] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:42 2022] DELETE /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:42.328884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4a821597-8189-4bc6-a628-13f4b1e54da7 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:42.328884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4a821597-8189-4bc6-a628-13f4b1e54da7 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:42.336977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a821597-8189-4bc6-a628-13f4b1e54da7 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.337857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a821597-8189-4bc6-a628-13f4b1e54da7 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.339815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a821597-8189-4bc6-a628-13f4b1e54da7 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.340190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a821597-8189-4bc6-a628-13f4b1e54da7 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.725450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-370a37ad-dc29-42a7-8fd8-9483e90fd7b0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:42.733447 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-370a37ad-dc29-42a7-8fd8-9483e90fd7b0 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147" status: 200 len: 1323 microversion: 2.1 time: 0.508816 May 19 04:40:42.734108 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1115/2307] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:42 2022] GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147 => generated 1323 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:42.741922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:42.742890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:42.750298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.750794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.751547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.752042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.836754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4a821597-8189-4bc6-a628-13f4b1e54da7 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:42.845048 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4a821597-8189-4bc6-a628-13f4b1e54da7 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1464 microversion: 2.1 time: 0.524536 May 19 04:40:42.845787 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1193/2308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:42 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1464 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:42.850628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-50a53bd0-e7dc-4b2c-aa6d-fcec6ced2aab tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:42.852026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-50a53bd0-e7dc-4b2c-aa6d-fcec6ced2aab tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:42.858071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50a53bd0-e7dc-4b2c-aa6d-fcec6ced2aab tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.858605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50a53bd0-e7dc-4b2c-aa6d-fcec6ced2aab tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:42.859437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50a53bd0-e7dc-4b2c-aa6d-fcec6ced2aab tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:42.859994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50a53bd0-e7dc-4b2c-aa6d-fcec6ced2aab tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:43.004146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:43.013417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:43.015073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:43.016429 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ad092656-66b9-4dac-a574-e02a7932feb6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.281060 May 19 04:40:43.017099 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1116/2309] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:42 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:43.021773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b149c60-6604-402c-b3b4-5d925b46369d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:43.022479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b149c60-6604-402c-b3b4-5d925b46369d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:43.032031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-50a53bd0-e7dc-4b2c-aa6d-fcec6ced2aab tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:43.032697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b149c60-6604-402c-b3b4-5d925b46369d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:43.033247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b149c60-6604-402c-b3b4-5d925b46369d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:43.034030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b149c60-6604-402c-b3b4-5d925b46369d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:43.034469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b149c60-6604-402c-b3b4-5d925b46369d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:43.040312 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-50a53bd0-e7dc-4b2c-aa6d-fcec6ced2aab tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1315 microversion: 2.1 time: 0.193210 May 19 04:40:43.040892 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1194/2310] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:42 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:43.162732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b149c60-6604-402c-b3b4-5d925b46369d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:43.163298 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c46dd0be-5574-44a3-9e4f-4a51fb23cab3 tempest-TenantUsagesNegativeTestJSON-1094821544 tempest-TenantUsagesNegativeTestJSON-1094821544-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-18T04%3A40%3A42.925820&end=2022-05-20T04%3A40%3A42.925820" status: 404 len: 112 microversion: - time: 0.121356 May 19 04:40:43.163839 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1195/2311] 10.222.0.58 () {58 vars in 1315 bytes} [Thu May 19 04:40:43 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-18T04%3A40%3A42.925820&end=2022-05-20T04%3A40%3A42.925820 => generated 112 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 04:40:43.169442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1a1163b6-571b-4475-a1eb-006006ce5034 req-67891119-bc59-443f-96a3-0d88645d5b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb877d5d-0195-476d-b98e-214237ab958e", "name": "network-vif-plugged", "status": "completed", "tag": "15705a77-261b-4a61-915d-6329807f2d66"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:43.170787 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b149c60-6604-402c-b3b4-5d925b46369d tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1513 microversion: 2.1 time: 0.152631 May 19 04:40:43.171351 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1117/2312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:43 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:43.175754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e85657f3-43b8-4683-b5f3-f3637d523dae tempest-TenantUsagesNegativeTestJSON-1094821544 tempest-TenantUsagesNegativeTestJSON-1094821544-project-admin] Calling method '.version_select at 0x7fd31b76ce50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:43.180234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1a1163b6-571b-4475-a1eb-006006ce5034 req-67891119-bc59-443f-96a3-0d88645d5b18 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:43.181454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1a1163b6-571b-4475-a1eb-006006ce5034 req-67891119-bc59-443f-96a3-0d88645d5b18 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:43.181836 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-e85657f3-43b8-4683-b5f3-f3637d523dae tempest-TenantUsagesNegativeTestJSON-1094821544 tempest-TenantUsagesNegativeTestJSON-1094821544-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e85657f3-43b8-4683-b5f3-f3637d523dae tempest-TenantUsagesNegativeTestJSON-1094821544 tempest-TenantUsagesNegativeTestJSON-1094821544-project-admin] Request method failure captured: May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-simple-tenant-usage/4f690f8d9e0045238538d8df25ac467a?start=2022-05-20T04%3A40%3A42.925820&end=2022-05-18T04%3A40%3A42.925820 HTTP/1.1 May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpKkUMo_9oa_d27zGs37cfQV8fHC4fDg7D7n53_dEIQuxwGY57Vlwci3gVH9qDYfTlBV2SI8cCEtiSe9Xdl4jjhnGkQOwZ1VvM-6xWL6_cNbK1ULHCV9bOId_gPH5iQsw1vL7itJ460c8cpHrjc19GfTXepBI3TyX9DIk6U3egxfJo May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a32efc2ae20b487fa1b4b515a238f835 May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1094821544 May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a32efc2ae20b487fa1b4b515a238f835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a32efc2ae20b487fa1b4b515a238f835"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a32efc2ae20b487fa1b4b515a238f835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a32efc2ae20b487fa1b4b515a238f835"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1094821544 May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a32efc2ae20b487fa1b4b515a238f835 May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1094821544 May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TenantUsagesNegativeTestJSON-1094821544-project-admin May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 064af52bea5a47a28b495d978cd2f94e May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1094821544-project-admin May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid start time. The start time cannot occur after the end time. May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '4f690f8d9e0045238538d8df25ac467a'} May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. May 19 04:40:43.183407 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:43.188815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e85657f3-43b8-4683-b5f3-f3637d523dae tempest-TenantUsagesNegativeTestJSON-1094821544 tempest-TenantUsagesNegativeTestJSON-1094821544-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:43.188815 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e85657f3-43b8-4683-b5f3-f3637d523dae tempest-TenantUsagesNegativeTestJSON-1094821544 tempest-TenantUsagesNegativeTestJSON-1094821544-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/4f690f8d9e0045238538d8df25ac467a?start=2022-05-20T04%3A40%3A42.925820&end=2022-05-18T04%3A40%3A42.925820" status: 400 len: 111 microversion: 2.1 time: 0.012697 May 19 04:40:43.188815 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1118/2313] 10.222.0.58 () {58 vars in 1411 bytes} [Thu May 19 04:40:43 2022] GET /compute/v2.1/os-simple-tenant-usage/4f690f8d9e0045238538d8df25ac467a?start=2022-05-20T04%3A40%3A42.925820&end=2022-05-18T04%3A40%3A42.925820 => generated 111 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:40:43.197489 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1a1163b6-571b-4475-a1eb-006006ce5034 req-67891119-bc59-443f-96a3-0d88645d5b18 service nova] Creating event network-vif-plugged:15705a77-261b-4a61-915d-6329807f2d66 for instance cb877d5d-0195-476d-b98e-214237ab958e on n-h2-766726-30 May 19 04:40:43.203711 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1a1163b6-571b-4475-a1eb-006006ce5034 req-67891119-bc59-443f-96a3-0d88645d5b18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038259 May 19 04:40:43.204625 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1196/2314] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:43.305727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-08c9e507-fdfa-4a98-bcff-6406bb17562e tempest-TenantUsagesNegativeTestJSON-278489188 tempest-TenantUsagesNegativeTestJSON-278489188-project] Calling method '.version_select at 0x7fd31b782ca0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:43.307934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-08c9e507-fdfa-4a98-bcff-6406bb17562e tempest-TenantUsagesNegativeTestJSON-278489188 tempest-TenantUsagesNegativeTestJSON-278489188-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '1dcf77c189a84cc099e52bde3115ba48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f690f8d9e0045238538d8df25ac467a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-08c9e507-fdfa-4a98-bcff-6406bb17562e tempest-TenantUsagesNegativeTestJSON-278489188 tempest-TenantUsagesNegativeTestJSON-278489188-project] Request method failure captured: May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T04%3A40%3A42.925820&end=2022-05-20T04%3A40%3A42.925820&detailed=1 HTTP/1.1 May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpKqixueWzGzX7lPxXiV0kgOxg1Tm56GlVAEzdqH5C-kNH7UnXJPnMMqLQwMiDSbXqo-vAyCnMoSSgotUwh_zK6OqpB-rGzxts9zoHK_92_n82J34_xXyz4-4nDAiepC8rshpsH8xMAovBvc9CLxdTRQoqt3CSuaTQpFPU4_ir3ynU May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 4f690f8d9e0045238538d8df25ac467a May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-278489188 May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f690f8d9e0045238538d8df25ac467a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f690f8d9e0045238538d8df25ac467a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f690f8d9e0045238538d8df25ac467a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f690f8d9e0045238538d8df25ac467a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-278489188 May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 4f690f8d9e0045238538d8df25ac467a May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-278489188 May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TenantUsagesNegativeTestJSON-278489188-project May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1dcf77c189a84cc099e52bde3115ba48 May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-278489188-project May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: action_args: {} May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._index(req) May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise self.value May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 04:40:43.309898 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-08c9e507-fdfa-4a98-bcff-6406bb17562e tempest-TenantUsagesNegativeTestJSON-278489188 tempest-TenantUsagesNegativeTestJSON-278489188-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-08c9e507-fdfa-4a98-bcff-6406bb17562e tempest-TenantUsagesNegativeTestJSON-278489188 tempest-TenantUsagesNegativeTestJSON-278489188-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T04%3A40%3A42.925820&end=2022-05-20T04%3A40%3A42.925820&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.120236 May 19 04:40:43.314828 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1119/2315] 10.222.0.58 () {58 vars in 1334 bytes} [Thu May 19 04:40:43 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T04%3A40%3A42.925820&end=2022-05-20T04%3A40%3A42.925820&detailed=1 => generated 123 bytes in 121 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 19 04:40:43.751408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-36160485-711a-4205-a439-903d45032a41 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:43.752330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-36160485-711a-4205-a439-903d45032a41 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:43.759079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36160485-711a-4205-a439-903d45032a41 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:43.759526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36160485-711a-4205-a439-903d45032a41 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:43.760488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36160485-711a-4205-a439-903d45032a41 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:43.760925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36160485-711a-4205-a439-903d45032a41 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:43.864346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92c0a575-a7ea-4623-8f34-4ffa184d0d2d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:43.865210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-92c0a575-a7ea-4623-8f34-4ffa184d0d2d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:43.871656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92c0a575-a7ea-4623-8f34-4ffa184d0d2d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:43.872228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92c0a575-a7ea-4623-8f34-4ffa184d0d2d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:43.873320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92c0a575-a7ea-4623-8f34-4ffa184d0d2d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:43.873892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92c0a575-a7ea-4623-8f34-4ffa184d0d2d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:43.911101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-36160485-711a-4205-a439-903d45032a41 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:43.916064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:43.922386 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-36160485-711a-4205-a439-903d45032a41 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147" status: 200 len: 1323 microversion: 2.1 time: 0.175436 May 19 04:40:43.923295 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1197/2316] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:43 2022] GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147 => generated 1323 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:44.016984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-92c0a575-a7ea-4623-8f34-4ffa184d0d2d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:44.025111 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92c0a575-a7ea-4623-8f34-4ffa184d0d2d tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1464 microversion: 2.1 time: 0.164943 May 19 04:40:44.025690 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1120/2317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:43 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:44.035739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:44.036437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:44.043815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:44.044367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:44.045243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:44.045869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:44.058220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-adbc674f-268c-42ba-b4c2-1055561eecc3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:44.059150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-adbc674f-268c-42ba-b4c2-1055561eecc3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:44.066037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adbc674f-268c-42ba-b4c2-1055561eecc3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:44.066514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adbc674f-268c-42ba-b4c2-1055561eecc3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:44.067272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adbc674f-268c-42ba-b4c2-1055561eecc3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:44.067713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adbc674f-268c-42ba-b4c2-1055561eecc3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:44.314025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-adbc674f-268c-42ba-b4c2-1055561eecc3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:44.318925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:44.323997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-adbc674f-268c-42ba-b4c2-1055561eecc3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1315 microversion: 2.1 time: 0.270396 May 19 04:40:44.333929 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1121/2318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:44 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:44.340187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f88f701-b34c-465f-b089-2c720549237a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:44.340867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7f88f701-b34c-465f-b089-2c720549237a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:44.344008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:44.345641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:44.347078 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5892bdf-f22b-44ab-94fb-d8c02555bd97 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.315494 May 19 04:40:44.347580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f88f701-b34c-465f-b089-2c720549237a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:44.358189 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1198/2319] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:44 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:44.358378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f88f701-b34c-465f-b089-2c720549237a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:44.358378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f88f701-b34c-465f-b089-2c720549237a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:44.358378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f88f701-b34c-465f-b089-2c720549237a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:44.546521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=43,nova_cell0:UPDATE=7 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:44.563893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7f88f701-b34c-465f-b089-2c720549237a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366806f44fa34ba8a7ad0a2e84f314eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c54dd93b5d484cb22316eb239828d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:44.582494 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7f88f701-b34c-465f-b089-2c720549237a tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 200 len: 1513 microversion: 2.1 time: 0.246459 May 19 04:40:44.584536 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1122/2320] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:44 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:44.939824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:44.946707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bdf6bd7a-ffbd-4a0d-9d73-0376deee8786 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:44.950834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bdf6bd7a-ffbd-4a0d-9d73-0376deee8786 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:44.962476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdf6bd7a-ffbd-4a0d-9d73-0376deee8786 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:44.964064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdf6bd7a-ffbd-4a0d-9d73-0376deee8786 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:44.967206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdf6bd7a-ffbd-4a0d-9d73-0376deee8786 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:44.969060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdf6bd7a-ffbd-4a0d-9d73-0376deee8786 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.044018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e4fd314a-694f-4925-b911-8c7e844ed969 req-3dce9e24-49c9-401a-8fad-4dd4e3535c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163dcde2-c67f-4794-a106-f1bace4d6c80", "name": "network-vif-deleted", "tag": "80651dbd-c4e5-49d2-8d93-351e469e9c30"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:45.058453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e4fd314a-694f-4925-b911-8c7e844ed969 req-3dce9e24-49c9-401a-8fad-4dd4e3535c44 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.059364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e4fd314a-694f-4925-b911-8c7e844ed969 req-3dce9e24-49c9-401a-8fad-4dd4e3535c44 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.071915 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e4fd314a-694f-4925-b911-8c7e844ed969 req-3dce9e24-49c9-401a-8fad-4dd4e3535c44 service nova] Creating event network-vif-deleted:80651dbd-c4e5-49d2-8d93-351e469e9c30 for instance 163dcde2-c67f-4794-a106-f1bace4d6c80 on n-h1-766726-30 May 19 04:40:45.081210 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e4fd314a-694f-4925-b911-8c7e844ed969 req-3dce9e24-49c9-401a-8fad-4dd4e3535c44 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047209 May 19 04:40:45.090059 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1123/2321] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:45.095996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-903e34ba-21cf-4b0e-aa1b-bb99fe754b82 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:45.096714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-903e34ba-21cf-4b0e-aa1b-bb99fe754b82 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:45.118175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903e34ba-21cf-4b0e-aa1b-bb99fe754b82 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.118749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903e34ba-21cf-4b0e-aa1b-bb99fe754b82 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.119426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903e34ba-21cf-4b0e-aa1b-bb99fe754b82 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.119878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903e34ba-21cf-4b0e-aa1b-bb99fe754b82 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.248599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bdf6bd7a-ffbd-4a0d-9d73-0376deee8786 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:45.259799 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bdf6bd7a-ffbd-4a0d-9d73-0376deee8786 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147" status: 200 len: 1516 microversion: 2.1 time: 0.320564 May 19 04:40:45.264137 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1199/2322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:44 2022] GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147 => generated 1516 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:45.277463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-584a3f06-affb-4448-a846-5f0108e3eb26 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:45.277992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-584a3f06-affb-4448-a846-5f0108e3eb26 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:45.286065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-584a3f06-affb-4448-a846-5f0108e3eb26 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.286756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-584a3f06-affb-4448-a846-5f0108e3eb26 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.288362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-584a3f06-affb-4448-a846-5f0108e3eb26 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.289930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-584a3f06-affb-4448-a846-5f0108e3eb26 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.375898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-903e34ba-21cf-4b0e-aa1b-bb99fe754b82 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:45.392647 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-903e34ba-21cf-4b0e-aa1b-bb99fe754b82 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 200 len: 1464 microversion: 2.1 time: 0.297930 May 19 04:40:45.394074 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1124/2323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:45 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 1464 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:45.410894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df14b918-62dd-43ca-801e-00cf78d1a9c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:45.422024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-df14b918-62dd-43ca-801e-00cf78d1a9c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:45.436404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df14b918-62dd-43ca-801e-00cf78d1a9c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.436876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df14b918-62dd-43ca-801e-00cf78d1a9c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.437726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df14b918-62dd-43ca-801e-00cf78d1a9c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.450376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df14b918-62dd-43ca-801e-00cf78d1a9c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.577239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-584a3f06-affb-4448-a846-5f0108e3eb26 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:45.588151 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-584a3f06-affb-4448-a846-5f0108e3eb26 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb" status: 200 len: 1515 microversion: 2.1 time: 0.315491 May 19 04:40:45.599850 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1200/2324] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:45 2022] GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:45.605126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:45.613704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:45.625624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.626077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.626929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.627366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.816634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df14b918-62dd-43ca-801e-00cf78d1a9c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:45.825389 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-df14b918-62dd-43ca-801e-00cf78d1a9c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1501 microversion: 2.1 time: 0.427956 May 19 04:40:45.837098 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1125/2325] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:45 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1501 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:45.837098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:45.837098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 163dcde2-c67f-4794-a106-f1bace4d6c80] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:45.842399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.842944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.843810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.844389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.867152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:45.877265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:45.878940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:45.880213 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2bdd911-8af5-4a1a-b667-1a4929636a02 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.278981 May 19 04:40:45.890660 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1201/2326] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:45 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:45.898106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-01555d2d-3c78-41ae-9393-e4a4c0731eaf req-57f3942a-d185-4d64-ab99-ace5f83fee20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07db7246-3187-41a6-afc2-aa8befff8701", "name": "network-vif-deleted", "tag": "29c2f817-6863-4ebe-9dbf-066d9a3ce3d9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:45.908199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-01555d2d-3c78-41ae-9393-e4a4c0731eaf req-57f3942a-d185-4d64-ab99-ace5f83fee20 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.908748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-01555d2d-3c78-41ae-9393-e4a4c0731eaf req-57f3942a-d185-4d64-ab99-ace5f83fee20 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.924159 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-01555d2d-3c78-41ae-9393-e4a4c0731eaf req-57f3942a-d185-4d64-ab99-ace5f83fee20 service nova] Creating event network-vif-deleted:29c2f817-6863-4ebe-9dbf-066d9a3ce3d9 for instance 07db7246-3187-41a6-afc2-aa8befff8701 on n-h1-766726-30 May 19 04:40:45.930770 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-01555d2d-3c78-41ae-9393-e4a4c0731eaf req-57f3942a-d185-4d64-ab99-ace5f83fee20 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038665 May 19 04:40:45.931507 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1202/2327] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:45.937229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a48f1bee-eeab-432b-bc82-09eccb7511e7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:45.937903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a48f1bee-eeab-432b-bc82-09eccb7511e7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:45.945023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a48f1bee-eeab-432b-bc82-09eccb7511e7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.946354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a48f1bee-eeab-432b-bc82-09eccb7511e7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.946961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a48f1bee-eeab-432b-bc82-09eccb7511e7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:45.947408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a48f1bee-eeab-432b-bc82-09eccb7511e7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:45.974922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a48f1bee-eeab-432b-bc82-09eccb7511e7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:46.061596 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a48f1bee-eeab-432b-bc82-09eccb7511e7 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "DELETE /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb" status: 204 len: 0 microversion: 2.1 time: 0.128482 May 19 04:40:46.062533 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1203/2328] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:45 2022] DELETE /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:46.083652 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] HTTP exception thrown: Instance 163dcde2-c67f-4794-a106-f1bace4d6c80 could not be found. May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Request method failure captured: May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 HTTP/1.1 May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqc781WfQjlfWtilev3AENWzyFZadqFEq1xHz2Bfgu3Pc8weykKHe38gCb2sgTWetBTcHggslzCHB6_u14EyYQosF71gfgENbmwPSksfe32MQJfAbSzf65qQtDdHCR12e7udq8JnWB6Eoq0A4BMYFUZq5fbZnvxtwB-JXoiBkQe9E May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 366806f44fa34ba8a7ad0a2e84f314eb May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 163dcde2-c67f-4794-a106-f1bace4d6c80 could not be found. May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '163dcde2-c67f-4794-a106-f1bace4d6c80'} May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 163dcde2-c67f-4794-a106-f1bace4d6c80 could not be found. May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 163dcde2-c67f-4794-a106-f1bace4d6c80 could not be found. May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.085976 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.091645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.091645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.091645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.091645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:46.091645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:46.091645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 163dcde2-c67f-4794-a106-f1bace4d6c80 could not be found. May 19 04:40:46.091645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.092975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Returning 404 to user: Instance 163dcde2-c67f-4794-a106-f1bace4d6c80 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:46.094046 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d4aa3ffd-dbf2-47bf-bec9-9cd898965ebb tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80" status: 404 len: 111 microversion: 2.1 time: 0.266947 May 19 04:40:46.097803 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1126/2329] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:45 2022] GET /compute/v2.1/servers/163dcde2-c67f-4794-a106-f1bace4d6c80 => generated 111 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:46.102598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d7222fa-407f-4612-bfc1-bcc96f550299 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.103255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4d7222fa-407f-4612-bfc1-bcc96f550299 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:46.109520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d7222fa-407f-4612-bfc1-bcc96f550299 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.109958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d7222fa-407f-4612-bfc1-bcc96f550299 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.110869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d7222fa-407f-4612-bfc1-bcc96f550299 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.111308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d7222fa-407f-4612-bfc1-bcc96f550299 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.255580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3cb46872-c613-4f4f-a1fc-b9846a1eb843 tempest-FlavorsV2NegativeTest-1526714790 tempest-FlavorsV2NegativeTest-1526714790-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.266453 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3cb46872-c613-4f4f-a1fc-b9846a1eb843 tempest-FlavorsV2NegativeTest-1526714790 tempest-FlavorsV2NegativeTest-1526714790-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.199885 May 19 04:40:46.267401 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1204/2330] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:40:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:46.272980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.273787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:46.282047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.282526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.283568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.283960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.300053 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] HTTP exception thrown: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Request method failure captured: May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 HTTP/1.1 May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmqc781WfQjlfWtilev3AENWzyFZadqFEq1xHz2Bfgu3Pc8weykKHe38gCb2sgTWetBTcHggslzCHB6_u14EyYQosF71gfgENbmwPSksfe32MQJfAbSzf65qQtDdHCR12e7udq8JnWB6Eoq0A4BMYFUZq5fbZnvxtwB-JXoiBkQe9E May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 366806f44fa34ba8a7ad0a2e84f314eb May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c372099a-9a88-4652-88c9-5d254a243f77'} May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:46.302053 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.308142 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.309128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4d7222fa-407f-4612-bfc1-bcc96f550299 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:46.310247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Returning 404 to user: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:46.311454 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-374105d5-7c00-4c83-8d3c-3aeabd1bba19 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 404 len: 111 microversion: 2.1 time: 0.043026 May 19 04:40:46.312535 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1205/2331] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:46 2022] DELETE /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:46.320638 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4d7222fa-407f-4612-bfc1-bcc96f550299 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb" status: 200 len: 1521 microversion: 2.1 time: 0.221588 May 19 04:40:46.321697 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1127/2332] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:46 2022] GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:46.323541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.324401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: c372099a-9a88-4652-88c9-5d254a243f77] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:46.331812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.332597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.333798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.336671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.354532 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] HTTP exception thrown: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Request method failure captured: May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 HTTP/1.1 May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmqc781WfQjlfWtilev3AENWzyFZadqFEq1xHz2Bfgu3Pc8weykKHe38gCb2sgTWetBTcHggslzCHB6_u14EyYQosF71gfgENbmwPSksfe32MQJfAbSzf65qQtDdHCR12e7udq8JnWB6Eoq0A4BMYFUZq5fbZnvxtwB-JXoiBkQe9E May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 366806f44fa34ba8a7ad0a2e84f314eb May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c372099a-9a88-4652-88c9-5d254a243f77'} May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.356418 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Returning 404 to user: Instance c372099a-9a88-4652-88c9-5d254a243f77 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1155dd58-4c36-458d-8880-5eb947143c12 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77" status: 404 len: 111 microversion: 2.1 time: 0.041336 May 19 04:40:46.362667 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1206/2333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:46 2022] GET /compute/v2.1/servers/c372099a-9a88-4652-88c9-5d254a243f77 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:40:46.370592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.371411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:46.379829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.380423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.382146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.382847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.399246 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] HTTP exception thrown: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Request method failure captured: May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b HTTP/1.1 May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqc781WfQjlfWtilev3AENWzyFZadqFEq1xHz2Bfgu3Pc8weykKHe38gCb2sgTWetBTcHggslzCHB6_u14EyYQosF71gfgENbmwPSksfe32MQJfAbSzf65qQtDdHCR12e7udq8JnWB6Eoq0A4BMYFUZq5fbZnvxtwB-JXoiBkQe9E May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 366806f44fa34ba8a7ad0a2e84f314eb May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2487ebd4-e36c-404c-9c5f-76aa7a3bf41b'} May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:46.401186 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Returning 404 to user: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17a119cf-990a-4011-9b3d-16f2d43ce107 tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 404 len: 111 microversion: 2.1 time: 0.038031 May 19 04:40:46.408047 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1128/2334] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:46 2022] DELETE /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:46.415466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.416443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 07db7246-3187-41a6-afc2-aa8befff8701] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:46.419594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.420514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] [instance: 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:46.425461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.425461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.426154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.426595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.434372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.434832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.435630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.436074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.444475 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] HTTP exception thrown: Instance 07db7246-3187-41a6-afc2-aa8befff8701 could not be found. May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Request method failure captured: May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 HTTP/1.1 May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcoTVGGj-46cn5-yT35y11fOOMnmZa94Y3Yv01APIzdMkgZSJUsiK_i7Y07v-Op5iyvrp9X7Ryfle0yw3ksXgqi8E_eQdvt5mRMyC1Zljh1ctrSIvOOC1g4aeYBUuTE_iQ9wvKlIFekBFbtU5um-S4zgAzpx4v_xaTPK3sGrOGWPXgQ May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 57c8b320a11d43269f93125f76d2221a May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-LiveMigrationNegativeTest-956192945 May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/57c8b320a11d43269f93125f76d2221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57c8b320a11d43269f93125f76d2221a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57c8b320a11d43269f93125f76d2221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_57c8b320a11d43269f93125f76d2221a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-LiveMigrationNegativeTest-956192945 May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 57c8b320a11d43269f93125f76d2221a May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-956192945 May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-LiveMigrationNegativeTest-956192945-project May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1470c059ef4e4e87a114209a9c934b6f May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-LiveMigrationNegativeTest-956192945-project May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 07db7246-3187-41a6-afc2-aa8befff8701 could not be found. May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '07db7246-3187-41a6-afc2-aa8befff8701'} May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07db7246-3187-41a6-afc2-aa8befff8701 could not be found. May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07db7246-3187-41a6-afc2-aa8befff8701 could not be found. May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.446360 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.453369 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.453369 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.453369 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.453369 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:46.453369 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:46.453369 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07db7246-3187-41a6-afc2-aa8befff8701 could not be found. May 19 04:40:46.453369 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:46.457384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Returning 404 to user: Instance 07db7246-3187-41a6-afc2-aa8befff8701 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:46.458623 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b38d3ddc-9ee6-44b6-bb37-5e3907c3e599 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701" status: 404 len: 111 microversion: 2.1 time: 0.048170 May 19 04:40:46.459439 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1207/2335] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:46 2022] GET /compute/v2.1/servers/07db7246-3187-41a6-afc2-aa8befff8701 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:46.459571 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] HTTP exception thrown: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Request method failure captured: May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b HTTP/1.1 May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmqc781WfQjlfWtilev3AENWzyFZadqFEq1xHz2Bfgu3Pc8weykKHe38gCb2sgTWetBTcHggslzCHB6_u14EyYQosF71gfgENbmwPSksfe32MQJfAbSzf65qQtDdHCR12e7udq8JnWB6Eoq0A4BMYFUZq5fbZnvxtwB-JXoiBkQe9E May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_68c54dd93b5d484cb22316eb239828d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 68c54dd93b5d484cb22316eb239828d4 May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-515193649 May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 366806f44fa34ba8a7ad0a2e84f314eb May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerDiskConfigTestJSON-515193649-project May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2487ebd4-e36c-404c-9c5f-76aa7a3bf41b'} May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:46.461288 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] Returning 404 to user: Instance 2487ebd4-e36c-404c-9c5f-76aa7a3bf41b could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3cb5eb60-ce7b-458d-b46e-a08458c6090e tempest-ServerDiskConfigTestJSON-515193649 tempest-ServerDiskConfigTestJSON-515193649-project] 10.222.0.58 "GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b" status: 404 len: 111 microversion: 2.1 time: 0.050287 May 19 04:40:46.466197 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1129/2336] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:46 2022] GET /compute/v2.1/servers/2487ebd4-e36c-404c-9c5f-76aa7a3bf41b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:46.473861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09058987-47d9-4014-a5ff-029d9c098a99 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.474609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-09058987-47d9-4014-a5ff-029d9c098a99 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:46.485179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09058987-47d9-4014-a5ff-029d9c098a99 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.485628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09058987-47d9-4014-a5ff-029d9c098a99 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.486418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09058987-47d9-4014-a5ff-029d9c098a99 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.486859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09058987-47d9-4014-a5ff-029d9c098a99 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.531428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-09058987-47d9-4014-a5ff-029d9c098a99 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:46.626890 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-09058987-47d9-4014-a5ff-029d9c098a99 tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 204 len: 0 microversion: 2.1 time: 0.156207 May 19 04:40:46.630524 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1208/2337] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:46 2022] DELETE /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:46.636759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6fa7e3ec-4003-4999-88da-15dfa62b4e7b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.637454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6fa7e3ec-4003-4999-88da-15dfa62b4e7b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:46.647153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa7e3ec-4003-4999-88da-15dfa62b4e7b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.647819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa7e3ec-4003-4999-88da-15dfa62b4e7b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.653023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa7e3ec-4003-4999-88da-15dfa62b4e7b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.653507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa7e3ec-4003-4999-88da-15dfa62b4e7b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.877838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6fa7e3ec-4003-4999-88da-15dfa62b4e7b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:46.885997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6fa7e3ec-4003-4999-88da-15dfa62b4e7b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1474 microversion: 2.1 time: 0.254011 May 19 04:40:46.887146 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1130/2338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:46 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1474 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:46.905316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:46.906453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:46.914420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.915294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.916940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:46.917737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:46.984228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9ce7812-b8d7-497e-8f33-6af79deb82bf tempest-FlavorsV2NegativeTest-1526714790 tempest-FlavorsV2NegativeTest-1526714790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1360633578", "imageRef": "af143891-f4df-4a6c-ad13-9e7f42f76d8c", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:47.036731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-a9ce7812-b8d7-497e-8f33-6af79deb82bf tempest-FlavorsV2NegativeTest-1526714790 tempest-FlavorsV2NegativeTest-1526714790-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:40:47.280371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:47.297755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:47.299286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:47.300706 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd94c780-43d2-4497-a172-0334f60833f3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.402833 May 19 04:40:47.301305 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1209/2339] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:46 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:47.341155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-24284241-4991-4be0-a6dc-be089875130d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:47.341786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-24284241-4991-4be0-a6dc-be089875130d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:47.349026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24284241-4991-4be0-a6dc-be089875130d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:47.349582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24284241-4991-4be0-a6dc-be089875130d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:47.350809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24284241-4991-4be0-a6dc-be089875130d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:47.351465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24284241-4991-4be0-a6dc-be089875130d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:47.519093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-a9ce7812-b8d7-497e-8f33-6af79deb82bf tempest-FlavorsV2NegativeTest-1526714790 tempest-FlavorsV2NegativeTest-1526714790-project] HTTP exception thrown: Flavor's memory is too small for requested image. May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9ce7812-b8d7-497e-8f33-6af79deb82bf tempest-FlavorsV2NegativeTest-1526714790 tempest-FlavorsV2NegativeTest-1526714790-project] Request method failure captured: May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 143 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpNXU4owtlKKqUS8ISp3RRpHTcjTToYWqZYI6f1sOGCRvwwB8JiWpdPtL4CF6ltX7x8FU_bHXqyAsnMPeeyUtHYil0VlR8-o97K_CUIS8b_9EwSnGE6UatqyKMGi7zuFAofnx_QwhzspNdi6gvLoU4A1cwthzESR9fzYEFo8DO4PJc May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: acecf5e39182480e95713b465c7edd39 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FlavorsV2NegativeTest-1526714790 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/acecf5e39182480e95713b465c7edd39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/acecf5e39182480e95713b465c7edd39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/acecf5e39182480e95713b465c7edd39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_acecf5e39182480e95713b465c7edd39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FlavorsV2NegativeTest-1526714790 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: acecf5e39182480e95713b465c7edd39 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1526714790 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FlavorsV2NegativeTest-1526714790-project May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5c0ddcc9957f44569dfcd03b3e6185d9 May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FlavorsV2NegativeTest-1526714790-project May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1360633578", "imageRef": "af143891-f4df-4a6c-ad13-9e7f42f76d8c", "flavorRef": "452"}} May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: exception: Flavor's memory is too small for requested image. May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1360633578', 'imageRef': 'af143891-f4df-4a6c-ad13-9e7f42f76d8c', 'flavorRef': '452'}}} May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:47.523165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 870, in create May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9ce7812-b8d7-497e-8f33-6af79deb82bf tempest-FlavorsV2NegativeTest-1526714790 tempest-FlavorsV2NegativeTest-1526714790-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9ce7812-b8d7-497e-8f33-6af79deb82bf tempest-FlavorsV2NegativeTest-1526714790 tempest-FlavorsV2NegativeTest-1526714790-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.544777 May 19 04:40:47.531081 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1131/2340] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:40:46 2022] POST /compute/v2.1/servers => generated 93 bytes in 549 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 19 04:40:47.604696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-24284241-4991-4be0-a6dc-be089875130d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:47.614186 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-24284241-4991-4be0-a6dc-be089875130d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb" status: 200 len: 1521 microversion: 2.1 time: 0.278456 May 19 04:40:47.614781 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1210/2341] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:47 2022] GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:47.903413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21362b49-9ebd-46c0-a46e-2eaf9aeca16b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:47.904104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-21362b49-9ebd-46c0-a46e-2eaf9aeca16b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:47.911418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21362b49-9ebd-46c0-a46e-2eaf9aeca16b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:47.911933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21362b49-9ebd-46c0-a46e-2eaf9aeca16b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:47.912758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21362b49-9ebd-46c0-a46e-2eaf9aeca16b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:47.913387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21362b49-9ebd-46c0-a46e-2eaf9aeca16b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:48.081473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-21362b49-9ebd-46c0-a46e-2eaf9aeca16b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:48.089433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21362b49-9ebd-46c0-a46e-2eaf9aeca16b tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1474 microversion: 2.1 time: 0.189909 May 19 04:40:48.090157 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1132/2342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:47 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1474 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:48.319882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:48.320509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:48.331310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:48.335407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:48.336979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:48.342534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:48.410518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a31f55b3-e8ed-4865-916a-ff9ce6c99e86 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61a89322-361b-4661-ba83-6574f9672811"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:48.411814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a31f55b3-e8ed-4865-916a-ff9ce6c99e86 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:48.426758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a31f55b3-e8ed-4865-916a-ff9ce6c99e86 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:48.427524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a31f55b3-e8ed-4865-916a-ff9ce6c99e86 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:48.428617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a31f55b3-e8ed-4865-916a-ff9ce6c99e86 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:48.432892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a31f55b3-e8ed-4865-916a-ff9ce6c99e86 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:48.570885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:48.808900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:48.827092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:48.828892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:48.830270 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5d8150c-5fb8-4253-b06f-81c35a259e10 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.514388 May 19 04:40:48.831494 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1211/2343] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:48 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:48.836736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-989ce4d2-b40a-4881-aa01-efc248de0c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:48.837387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-989ce4d2-b40a-4881-aa01-efc248de0c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:48.847736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-989ce4d2-b40a-4881-aa01-efc248de0c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:48.848132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-989ce4d2-b40a-4881-aa01-efc248de0c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:48.848933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-989ce4d2-b40a-4881-aa01-efc248de0c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:48.850023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-989ce4d2-b40a-4881-aa01-efc248de0c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:49.169331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-989ce4d2-b40a-4881-aa01-efc248de0c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:49.187732 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-989ce4d2-b40a-4881-aa01-efc248de0c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb" status: 200 len: 1521 microversion: 2.1 time: 0.349421 May 19 04:40:49.189790 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1212/2344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:48 2022] GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:49.209762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-30f4732e-dacb-4c37-a6fd-f79cd9290bb0 req-e15bbda0-82e4-4f1d-8065-271918caedea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b3d9b3-2703-4a85-8d75-33f3e571ebcd", "name": "network-vif-deleted", "tag": "d96f3070-0604-4f74-a673-446dab173c40"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:49.240546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-30f4732e-dacb-4c37-a6fd-f79cd9290bb0 req-e15bbda0-82e4-4f1d-8065-271918caedea service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:49.241321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-30f4732e-dacb-4c37-a6fd-f79cd9290bb0 req-e15bbda0-82e4-4f1d-8065-271918caedea service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:49.276580 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-30f4732e-dacb-4c37-a6fd-f79cd9290bb0 req-e15bbda0-82e4-4f1d-8065-271918caedea service nova] Creating event network-vif-deleted:d96f3070-0604-4f74-a673-446dab173c40 for instance 06b3d9b3-2703-4a85-8d75-33f3e571ebcd on n-h1-766726-30 May 19 04:40:49.287935 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a31f55b3-e8ed-4865-916a-ff9ce6c99e86 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881335 May 19 04:40:49.288583 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1133/2345] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:40:48 2022] POST /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:49.289593 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-30f4732e-dacb-4c37-a6fd-f79cd9290bb0 req-e15bbda0-82e4-4f1d-8065-271918caedea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093592 May 19 04:40:49.292601 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1213/2346] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:49.338295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:49.339379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:49.372818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:49.373322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:49.375338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:49.380484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:49.460560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:49.462995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:49.463835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lazy-loading 'fault' on Instance uuid 06b3d9b3-2703-4a85-8d75-33f3e571ebcd {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:40:49.473737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=16 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:49.600653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470c059ef4e4e87a114209a9c934b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b320a11d43269f93125f76d2221a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:49.612880 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ffab1f26-5c6a-4b61-afd3-3a4cd3a0720e tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 200 len: 1308 microversion: 2.1 time: 0.320149 May 19 04:40:49.627540 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1134/2347] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:49 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:49.860173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:49.861389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:49.895901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:49.898057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:49.903871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:49.905193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.187830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:50.192849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:50.205909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:50.206650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.209168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:50.209950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.333069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:50.409479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:50.417410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:50.421477 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f503e709-bbc2-4906-8c95-8b6b8f1c9de3 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.572764 May 19 04:40:50.425468 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1214/2348] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:49 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:50.440626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9a61e8f8-0aef-48a3-83ab-306241b18687 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:50.443308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9a61e8f8-0aef-48a3-83ab-306241b18687 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:50.463171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9a61e8f8-0aef-48a3-83ab-306241b18687 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:50.466904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9a61e8f8-0aef-48a3-83ab-306241b18687 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.469432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9a61e8f8-0aef-48a3-83ab-306241b18687 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:50.470150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9a61e8f8-0aef-48a3-83ab-306241b18687 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.477454 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] HTTP exception thrown: Volume e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae could not be found. May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Request method failure captured: May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments/d4a90922-cbe0-4932-b830-19c2a74931bd HTTP/1.1 May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 74 May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcodLP9q2r_HpKRb7ZapSoz2bvIF7hTpU_xeJWRdoIHky3oGvwFwr046UecAfKyZ4Mz--fY5C_TRikBL-hiuTOrJCdKAyJeKfKCFM6D7UHTUvNZTl_E3mW_yNTzdX3-6US8BvAd12lQd09ReWMCEzHBQAvxRwCfMKoZA_xFgK6FPFUM May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: dda442cfe23c474f93eb279f232da438 May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-VolumesAdminNegativeTest-185099497 May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dda442cfe23c474f93eb279f232da438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dda442cfe23c474f93eb279f232da438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dda442cfe23c474f93eb279f232da438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dda442cfe23c474f93eb279f232da438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-VolumesAdminNegativeTest-185099497 May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: dda442cfe23c474f93eb279f232da438 May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-185099497 May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-VolumesAdminNegativeTest-185099497-project-admin May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 9b4d2d54f3254e6fa0b134f9c3d63c3c May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-VolumesAdminNegativeTest-185099497-project-admin May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: {"volumeAttachment": {"volumeId": "e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae"}} May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: exception: Volume e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae could not be found. May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'server_id': '3946eaf6-225d-46e4-b381-85acfabcb9d7', 'id': 'd4a90922-cbe0-4932-b830-19c2a74931bd', 'body': {'volumeAttachment': {'volumeId': 'e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae'}}} May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae could not be found. (HTTP 404) (Request-ID: req-4ce105c2-651f-4e6e-acf6-76e41690aefc) May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:40:50.502602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae could not be found. May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae could not be found. May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae could not be found. May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:50.511005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Returning 400 to user: Volume e3a6a3d4-ca37-4af7-8a32-66d9868ae9ae could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:50.520128 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-566e123f-f79c-4a35-a8d7-47fb3375876d tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments/d4a90922-cbe0-4932-b830-19c2a74931bd" status: 400 len: 107 microversion: 2.1 time: 0.559505 May 19 04:40:50.520128 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1135/2349] 10.222.0.58 () {60 vars in 1432 bytes} [Thu May 19 04:40:49 2022] PUT /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments/d4a90922-cbe0-4932-b830-19c2a74931bd => generated 107 bytes in 561 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 04:40:50.533873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:50.800320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-126f69ad-cf01-45e5-a207-d49d1bd2dc17 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Action: 'create', calling method: .version_select at 0x7fd31b748b80>, body: {"keypair": {"name": "tempest-keypair-1703052398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPqWvGZqxshe/whSjTbFxyYDfm444klOK+/dqX8RmzhrWRusYM7D8D9mFSAPm/HQLGh6q9MgYSrkTzgLuo/OVFOLHlowVeyCnOSbhd41jB21hbWhLvZm8JKlnLWBGMXZg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:50.833351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9a61e8f8-0aef-48a3-83ab-306241b18687 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:50.844675 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9a61e8f8-0aef-48a3-83ab-306241b18687 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb" status: 200 len: 1479 microversion: 2.1 time: 0.414665 May 19 04:40:50.845335 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1215/2350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:50 2022] GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb => generated 1479 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:50.850860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:50.852304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] [instance: 06b3d9b3-2703-4a85-8d75-33f3e571ebcd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:50.855388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-126f69ad-cf01-45e5-a207-d49d1bd2dc17 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:50.858732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:50.859392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.860342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:50.861003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-126f69ad-cf01-45e5-a207-d49d1bd2dc17 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for user 2906e0322cff4a4795273872a0de345e and project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:50.861640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.880292 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] HTTP exception thrown: Instance 06b3d9b3-2703-4a85-8d75-33f3e571ebcd could not be found. May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Request method failure captured: May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd HTTP/1.1 May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcoTVGGj-46cn5-yT35y11fOOMnmZa94Y3Yv01APIzdMkgZSJUsiK_i7Y07v-Op5iyvrp9X7Ryfle0yw3ksXgqi8E_eQdvt5mRMyC1Zljh1ctrSIvOOC1g4aeYBUuTE_iQ9wvKlIFekBFbtU5um-S4zgAzpx4v_xaTPK3sGrOGWPXgQ May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 57c8b320a11d43269f93125f76d2221a May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-LiveMigrationNegativeTest-956192945 May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/57c8b320a11d43269f93125f76d2221a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57c8b320a11d43269f93125f76d2221a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/57c8b320a11d43269f93125f76d2221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_57c8b320a11d43269f93125f76d2221a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-LiveMigrationNegativeTest-956192945 May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 57c8b320a11d43269f93125f76d2221a May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-956192945 May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-LiveMigrationNegativeTest-956192945-project May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1470c059ef4e4e87a114209a9c934b6f May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-LiveMigrationNegativeTest-956192945-project May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 06b3d9b3-2703-4a85-8d75-33f3e571ebcd could not be found. May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '06b3d9b3-2703-4a85-8d75-33f3e571ebcd'} May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b3d9b3-2703-4a85-8d75-33f3e571ebcd could not be found. May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b3d9b3-2703-4a85-8d75-33f3e571ebcd could not be found. May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:50.882474 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:50.886353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:50.886353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:50.886353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:50.886353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:50.886353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:50.886353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b3d9b3-2703-4a85-8d75-33f3e571ebcd could not be found. May 19 04:40:50.886353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:50.887658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] Returning 404 to user: Instance 06b3d9b3-2703-4a85-8d75-33f3e571ebcd could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:50.888749 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-641a8873-e0f7-4c9b-a5de-a722f8b891fc tempest-LiveMigrationNegativeTest-956192945 tempest-LiveMigrationNegativeTest-956192945-project] 10.222.0.58 "GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd" status: 404 len: 111 microversion: 2.1 time: 0.042201 May 19 04:40:50.889509 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1216/2351] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:50 2022] GET /compute/v2.1/servers/06b3d9b3-2703-4a85-8d75-33f3e571ebcd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:50.897322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a5884eea-5996-4da8-8b06-4cc2a33290e6 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:50.898312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a5884eea-5996-4da8-8b06-4cc2a33290e6 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:50.906728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5884eea-5996-4da8-8b06-4cc2a33290e6 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:50.907367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5884eea-5996-4da8-8b06-4cc2a33290e6 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.908353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5884eea-5996-4da8-8b06-4cc2a33290e6 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:50.908988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5884eea-5996-4da8-8b06-4cc2a33290e6 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.912888 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-126f69ad-cf01-45e5-a207-d49d1bd2dc17 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.326992 May 19 04:40:50.918697 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1136/2352] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:40:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:40:50.918985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-4b05a54b-d1fc-438c-985b-9ad7d5565ac3 req-27f39727-b019-407c-9b12-507cff35632d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ece96d-d36d-4e0e-8065-8055d12bfafb", "name": "network-vif-deleted", "tag": "964499cb-b208-4bca-b40a-c866afc7c177"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:50.938625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4b05a54b-d1fc-438c-985b-9ad7d5565ac3 req-27f39727-b019-407c-9b12-507cff35632d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:50.939071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4b05a54b-d1fc-438c-985b-9ad7d5565ac3 req-27f39727-b019-407c-9b12-507cff35632d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:50.962337 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-4b05a54b-d1fc-438c-985b-9ad7d5565ac3 req-27f39727-b019-407c-9b12-507cff35632d service nova] Creating event network-vif-deleted:964499cb-b208-4bca-b40a-c866afc7c177 for instance 59ece96d-d36d-4e0e-8065-8055d12bfafb on n-h2-766726-30 May 19 04:40:50.987344 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-4b05a54b-d1fc-438c-985b-9ad7d5565ac3 req-27f39727-b019-407c-9b12-507cff35632d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071706 May 19 04:40:50.987948 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1137/2353] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:51.013227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0fdfeee-1e2b-4e82-9802-942c9ae855a4 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Calling method '.version_select at 0x7fd31b7b65e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:51.024655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d0fdfeee-1e2b-4e82-9802-942c9ae855a4 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1703052398" status: 200 len: 498 microversion: 2.1 time: 0.035467 May 19 04:40:51.025253 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1138/2354] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:40:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1703052398 => generated 498 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:51.028641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-a5884eea-5996-4da8-8b06-4cc2a33290e6 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lazy-loading 'services' on Instance uuid 3946eaf6-225d-46e4-b381-85acfabcb9d7 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:40:51.036533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70980032-f57c-4ae3-b86c-110278031823 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Calling method '.version_select at 0x7fd31b7f7e50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:51.102836 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-70980032-f57c-4ae3-b86c-110278031823 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703052398" status: 202 len: 0 microversion: 2.1 time: 0.068775 May 19 04:40:51.112097 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1139/2355] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 19 04:40:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703052398 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:40:51.125786 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a5884eea-5996-4da8-8b06-4cc2a33290e6 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments/d4a90922-cbe0-4932-b830-19c2a74931bd" status: 202 len: 0 microversion: 2.1 time: 0.234660 May 19 04:40:51.126606 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1217/2356] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 04:40:50 2022] DELETE /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments/d4a90922-cbe0-4932-b830-19c2a74931bd => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:40:51.133324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-de2874c2-8d3d-4cba-9b58-ab38183a00ed tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Action: 'create', calling method: .version_select at 0x7fd31b7f1670>, body: {"keypair": {"name": "tempest-keypair-1570210558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbFxuLKx1K39+uUVpe3UBFWZ0nx0f1IgiM2j8rT7AVvLZROc2v6rwM3vSwoPAuB22loX31atW3qIQaxX9EU5bBtjgJGF16QQBj6Od4X2iAp0hu6b9gUslej3vjEloqk+A=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:51.138182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fcf3787f-c3c6-4d8f-94bf-eb5d4d279ef4 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:51.140472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fcf3787f-c3c6-4d8f-94bf-eb5d4d279ef4 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:51.159861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcf3787f-c3c6-4d8f-94bf-eb5d4d279ef4 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:51.160906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcf3787f-c3c6-4d8f-94bf-eb5d4d279ef4 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:51.162740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcf3787f-c3c6-4d8f-94bf-eb5d4d279ef4 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:51.163566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcf3787f-c3c6-4d8f-94bf-eb5d4d279ef4 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:51.171406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-de2874c2-8d3d-4cba-9b58-ab38183a00ed tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:51.191700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-de2874c2-8d3d-4cba-9b58-ab38183a00ed tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for user 2906e0322cff4a4795273872a0de345e and project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:51.221313 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fcf3787f-c3c6-4d8f-94bf-eb5d4d279ef4 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090160 May 19 04:40:51.227524 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1218/2357] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:40:51 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:40:51.259237 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-de2874c2-8d3d-4cba-9b58-ab38183a00ed tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143999 May 19 04:40:51.261995 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1140/2358] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:40:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:51.278097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f854e36c-b58b-4353-a975-1bce8597ac8a tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Calling method '.version_select at 0x7fd31b7d21f0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:51.302815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:51.313893 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f854e36c-b58b-4353-a975-1bce8597ac8a tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570210558" status: 202 len: 0 microversion: 2.1 time: 0.044119 May 19 04:40:51.314982 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1141/2359] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 19 04:40:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570210558 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:40:51.333441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c611515-3b81-405e-9d15-89b873c0920b tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Action: 'create', calling method: .version_select at 0x7fd31b7f7dc0>, body: {"keypair": {"name": "tempest-keypair-746066669", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:51.358356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1391234630", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "2350f186-d2f0-4409-a87f-9cdb97927e15"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:51.404790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-5c611515-3b81-405e-9d15-89b873c0920b tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:51.424779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-5c611515-3b81-405e-9d15-89b873c0920b tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for user 2906e0322cff4a4795273872a0de345e and project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:51.472315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] validate_networks() for [('2350f186-d2f0-4409-a87f-9cdb97927e15', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:40:51.479307 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5c611515-3b81-405e-9d15-89b873c0920b tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.156923 May 19 04:40:51.485260 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1142/2360] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:40:51 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:51.491017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:51.491921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:51.500698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:51.501220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:51.502106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:51.502703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:51.973525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:51.988876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:51.991383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:51.997584 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bc724335-cb68-4436-8905-936f76945c83 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.512463 May 19 04:40:52.000367 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1143/2361] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:51 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:52.020122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-84d4bd90-2d43-4e31-83e9-b66a37fcc019 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Calling method '.version_select at 0x7fd31b6d4e50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.065704 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-84d4bd90-2d43-4e31-83e9-b66a37fcc019 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-746066669" status: 202 len: 0 microversion: 2.1 time: 0.051186 May 19 04:40:52.067367 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1144/2362] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-746066669 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:40:52.081090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.082121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:52.083988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:52.090820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.091587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.092681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.093426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.113856 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] HTTP exception thrown: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Request method failure captured: May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb HTTP/1.1 May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcowZhSpGkm09H8WUakL-y4Eh1Jv2At570KS53GeKkVGnDvnbwGc3I94tn3hsnD1w8DtHxBKyKWxdjBZ7TuFgZ17rG4i716jOykkdGGPsghNdGzCVE4Uqjcya7MwwH6MhRgTmW4SHjSfFy52oDU8hrJPH_g8aOly4KSRYuOeAxjWxNw May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f1beed6ea3284f8ba5449b9e1c4fc37c May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '59ece96d-d36d-4e0e-8065-8055d12bfafb'} May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:52.116308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.121410 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.121410 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:52.121410 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:52.121410 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:52.121410 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:52.121410 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:52.121410 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.122586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Returning 404 to user: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:52.123624 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d3f51b85-29cf-4e65-875e-c5b763d2c185 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb" status: 404 len: 111 microversion: 2.1 time: 0.054471 May 19 04:40:52.128815 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1145/2363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:52.136094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ad4be594-d91f-44b2-8254-3bc8029b9f8f tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Action: 'create', calling method: .version_select at 0x7fd31b7f7670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-372968564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1KdaC6jR3jk3ZolWlSJQ9JrAGyPnh43L9o3yTopZ/D/EpoAYSui0G3X1KMKk6ijnPL1STskbfIkJdHSQM+DDRlfztIEOrYTFVPO3i120QkOUWfG6vPDRGqw9ERtqRurg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:52.156305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ad4be594-d91f-44b2-8254-3bc8029b9f8f tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:52.163522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ad4be594-d91f-44b2-8254-3bc8029b9f8f tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for user 2906e0322cff4a4795273872a0de345e and project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:52.209655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ad4be594-d91f-44b2-8254-3bc8029b9f8f tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.074531 May 19 04:40:52.211046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1146/2364] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:40:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:52.224951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f2725c15-78d6-4fc3-bb19-adcc40d2e446 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.233448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f2725c15-78d6-4fc3-bb19-adcc40d2e446 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:52.240196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f2725c15-78d6-4fc3-bb19-adcc40d2e446 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '277beeca952b478ebfc6d0bb55d89de2'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:40:52.253283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2725c15-78d6-4fc3-bb19-adcc40d2e446 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.256732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2725c15-78d6-4fc3-bb19-adcc40d2e446 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.258293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2725c15-78d6-4fc3-bb19-adcc40d2e446 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.259102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f2725c15-78d6-4fc3-bb19-adcc40d2e446 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.312785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:40:52.313582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:40:52.314277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:40:52.314837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:40:52.315456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:40:52.332235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.332859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.333976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.335062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.364455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Getting quotas for project 9326a3ab36f0429ab18ba9e6ab0fa687. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:52.373461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Getting quotas for user 536d76934fe64cdfa8817c11fd8367eb and project 9326a3ab36f0429ab18ba9e6ab0fa687. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:52.388997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:52.398245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:40:52.400694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:52.407058 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f2725c15-78d6-4fc3-bb19-adcc40d2e446 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.194469 May 19 04:40:52.409281 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1147/2365] 10.222.0.58 () {58 vars in 1229 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:40:52.418278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e89fd43f-8622-4abc-b31c-0ff623bb9613 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Action: 'create', calling method: .version_select at 0x7fd31b7f7430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-169348735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQkmUrwREb4meWJq5Xq9eaNdPhYLqfhZcf0aWbxhqzp2EGefdjE0Z3DuAhj7Sp38jI8mPOf35Pz7dwJEO82xr4hQV/LkTR/N34Ct8ZYbOSITp+79eaHA5MMTScN7bY2bg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:52.442261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e89fd43f-8622-4abc-b31c-0ff623bb9613 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:52.454197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e89fd43f-8622-4abc-b31c-0ff623bb9613 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for user 2906e0322cff4a4795273872a0de345e and project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:52.478123 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43ee0ac4-2798-45bb-ae93-7c4eb45c8183 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.248650 May 19 04:40:52.479262 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1219/2366] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:40:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:40:52.488896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-efbcd9cd-e7ee-4fec-ba58-4acc4bb11e37 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.491057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-efbcd9cd-e7ee-4fec-ba58-4acc4bb11e37 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:52.501019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efbcd9cd-e7ee-4fec-ba58-4acc4bb11e37 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.501905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efbcd9cd-e7ee-4fec-ba58-4acc4bb11e37 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.503317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efbcd9cd-e7ee-4fec-ba58-4acc4bb11e37 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.504254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efbcd9cd-e7ee-4fec-ba58-4acc4bb11e37 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.506329 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e89fd43f-8622-4abc-b31c-0ff623bb9613 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.094223 May 19 04:40:52.515608 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1148/2367] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:40:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:52.522113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8b4875d6-bff3-40be-a0c1-bc7ab4c06204 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8b4875d6-bff3-40be-a0c1-bc7ab4c06204 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Request method failure captured: May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcowZhSpGkm09H8WUakL-y4Eh1Jv2At570KS53GeKkVGnDvnbwGc3I94tn3hsnD1w8DtHxBKyKWxdjBZ7TuFgZ17rG4i716jOykkdGGPsghNdGzCVE4Uqjcya7MwwH6MhRgTmW4SHjSfFy52oDU8hrJPH_g8aOly4KSRYuOeAxjWxNw May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f1beed6ea3284f8ba5449b9e1c4fc37c May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: action_args: {} May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance[0]: May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi '2011/01/01' May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 19 04:40:52.525840 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 19 04:40:52.529838 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.532078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8b4875d6-bff3-40be-a0c1-bc7ab4c06204 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:52.533309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8b4875d6-bff3-40be-a0c1-bc7ab4c06204 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016253 May 19 04:40:52.534414 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1149/2368] 10.222.0.58 () {58 vars in 1181 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:40:52.543815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-63de91b5-368d-49da-8777-941120341ddb tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.544630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-63de91b5-368d-49da-8777-941120341ddb tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:52.578470 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-efbcd9cd-e7ee-4fec-ba58-4acc4bb11e37 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097820 May 19 04:40:52.580058 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1220/2369] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:52.588964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f824f13e-df55-44ed-ac38-592011fcad4b tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Action: 'create', calling method: .version_select at 0x7fd315e92b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-519293895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMlIGafa0GJpx7BNf3PNqaQN50Zcu9i8DrF+9ZnanSBk3lhaZ00PMquPwrfEw26b5U3SGPUSd2xOEUGcpeW7T+gjPFOHljCzTy0IFICmMciTyARfCHuKC49l75O8lqMAw=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:52.607538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f824f13e-df55-44ed-ac38-592011fcad4b tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:52.614974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-63de91b5-368d-49da-8777-941120341ddb tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:52.617891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f824f13e-df55-44ed-ac38-592011fcad4b tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Getting quotas for user 2906e0322cff4a4795273872a0de345e and project 5fd730a4c3ce4969b418ccfebc2af51f. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:52.625785 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-63de91b5-368d-49da-8777-941120341ddb tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1225 microversion: 2.1 time: 0.088806 May 19 04:40:52.627295 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1150/2370] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:52.643129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0b55d73-6802-437e-a0c4-df7c5f20d903 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.649285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b0b55d73-6802-437e-a0c4-df7c5f20d903 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:52.650303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b0b55d73-6802-437e-a0c4-df7c5f20d903 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Searching by: {'deleted': False, 'project_id': '277beeca952b478ebfc6d0bb55d89de2'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:40:52.658409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0b55d73-6802-437e-a0c4-df7c5f20d903 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.659515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0b55d73-6802-437e-a0c4-df7c5f20d903 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.660609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0b55d73-6802-437e-a0c4-df7c5f20d903 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.661057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0b55d73-6802-437e-a0c4-df7c5f20d903 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.661828 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f824f13e-df55-44ed-ac38-592011fcad4b tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.080383 May 19 04:40:52.666285 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1221/2371] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:40:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:52.681780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa895971-a271-4111-9b1f-e49b7bc67207 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Calling method '.version_select at 0x7fd315f97b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.689891 n-d-766726-30 devstack@n-api.service[124818]: WARNING oslo_db.sqlalchemy.utils [None req-aa895971-a271-4111-9b1f-e49b7bc67207 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 04:40:52.699292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-b0b55d73-6802-437e-a0c4-df7c5f20d903 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:40:52.702989 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa895971-a271-4111-9b1f-e49b7bc67207 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.029097 May 19 04:40:52.704698 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1222/2372] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:52.721039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e1732076-8c14-4138-be5b-dbbd5678e9ed tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Calling method '.version_select at 0x7fd3160a91f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.746318 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0b55d73-6802-437e-a0c4-df7c5f20d903 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.117345 May 19 04:40:52.746910 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1151/2373] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers => generated 683 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:52.764135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.769585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:52.770498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.compute.servers [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Removing options 'limit' from query {{(pid=124819) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} May 19 04:40:52.771465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Searching by: {'deleted': False, 'project_id': '277beeca952b478ebfc6d0bb55d89de2'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:40:52.784382 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e1732076-8c14-4138-be5b-dbbd5678e9ed tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-519293895" status: 202 len: 0 microversion: 2.1 time: 0.071419 May 19 04:40:52.785527 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1223/2374] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-519293895 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:40:52.795490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b264c06b-ed7a-445c-b4d7-580899eec586 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Calling method '.version_select at 0x7fd315665550>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.797062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.797575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.798788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:52.799239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:52.836373 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b264c06b-ed7a-445c-b4d7-580899eec586 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-169348735" status: 202 len: 0 microversion: 2.1 time: 0.043715 May 19 04:40:52.841403 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1224/2375] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-169348735 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:40:52.848474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad82ccfe-2963-43fb-9184-3d826b303724 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] Calling method '.version_select at 0x7fd316033dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.855213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:40:52.889664 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad82ccfe-2963-43fb-9184-3d826b303724 tempest-KeyPairsV2TestJSON-567290529 tempest-KeyPairsV2TestJSON-567290529-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-372968564" status: 202 len: 0 microversion: 2.1 time: 0.046880 May 19 04:40:52.891710 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1225/2376] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-372968564 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:40:52.934825 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49bfbcae-8a2f-48bb-a5aa-e932dd54953f tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.180958 May 19 04:40:52.941995 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1152/2377] 10.222.0.58 () {58 vars in 1143 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:52.951628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db0fb1a4-9976-4b38-be11-9310b3ba76ee tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db0fb1a4-9976-4b38-be11-9310b3ba76ee tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Request method failure captured: May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcowZhSpGkm09H8WUakL-y4Eh1Jv2At570KS53GeKkVGnDvnbwGc3I94tn3hsnD1w8DtHxBKyKWxdjBZ7TuFgZ17rG4i716jOykkdGGPsghNdGzCVE4Uqjcya7MwwH6MhRgTmW4SHjSfFy52oDU8hrJPH_g8aOly4KSRYuOeAxjWxNw May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: f1beed6ea3284f8ba5449b9e1c4fc37c May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: action_args: {} May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance[0]: May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi '-1' May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 19 04:40:52.954984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db0fb1a4-9976-4b38-be11-9310b3ba76ee tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:52.958320 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-db0fb1a4-9976-4b38-be11-9310b3ba76ee tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.013727 May 19 04:40:52.963769 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1226/2378] 10.222.0.58 () {58 vars in 1141 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:40:52.968298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a02f099-6122-4450-825a-1d5de63bdf67 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a02f099-6122-4450-825a-1d5de63bdf67 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Request method failure captured: May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcowZhSpGkm09H8WUakL-y4Eh1Jv2At570KS53GeKkVGnDvnbwGc3I94tn3hsnD1w8DtHxBKyKWxdjBZ7TuFgZ17rG4i716jOykkdGGPsghNdGzCVE4Uqjcya7MwwH6MhRgTmW4SHjSfFy52oDU8hrJPH_g8aOly4KSRYuOeAxjWxNw May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f1beed6ea3284f8ba5449b9e1c4fc37c May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: action_args: {} May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance[0]: May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'testing' May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 19 04:40:52.973841 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 19 04:40:52.981330 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:52.983932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a02f099-6122-4450-825a-1d5de63bdf67 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:52.984954 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a02f099-6122-4450-825a-1d5de63bdf67 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.021378 May 19 04:40:52.986069 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1153/2379] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:40:52.996817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-87504f71-561c-49f2-83cc-626f910ad4fb tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:53.001903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87504f71-561c-49f2-83cc-626f910ad4fb tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.002928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-87504f71-561c-49f2-83cc-626f910ad4fb tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '277beeca952b478ebfc6d0bb55d89de2'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:40:53.012305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.compute.servers [None req-87504f71-561c-49f2-83cc-626f910ad4fb tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Flavor 'non_existing_flavor' could not be found {{(pid=124818) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:338}} May 19 04:40:53.019837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:53.020561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:53.032190 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-87504f71-561c-49f2-83cc-626f910ad4fb tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.037320 May 19 04:40:53.041127 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1227/2380] 10.222.0.58 () {58 vars in 1177 bytes} [Thu May 19 04:40:52 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:40:53.041290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.045803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.048842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.049372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.069531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-433c8101-ebff-4ade-ae72-61745630fdce tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:53.074750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-433c8101-ebff-4ade-ae72-61745630fdce tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.088870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-433c8101-ebff-4ade-ae72-61745630fdce tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '277beeca952b478ebfc6d0bb55d89de2'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:40:53.101021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-433c8101-ebff-4ade-ae72-61745630fdce tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.103293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-433c8101-ebff-4ade-ae72-61745630fdce tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.104985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-433c8101-ebff-4ade-ae72-61745630fdce tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.105758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-433c8101-ebff-4ade-ae72-61745630fdce tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.273870 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-433c8101-ebff-4ade-ae72-61745630fdce tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.229023 May 19 04:40:53.275232 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1228/2381] 10.222.0.58 () {58 vars in 1173 bytes} [Thu May 19 04:40:53 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:40:53.286213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-45169862-382c-4e5b-940c-6f54ab008a35 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:53.291797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-45169862-382c-4e5b-940c-6f54ab008a35 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.292717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-45169862-382c-4e5b-940c-6f54ab008a35 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '277beeca952b478ebfc6d0bb55d89de2'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:40:53.298360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45169862-382c-4e5b-940c-6f54ab008a35 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.299091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45169862-382c-4e5b-940c-6f54ab008a35 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.300114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45169862-382c-4e5b-940c-6f54ab008a35 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.300781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45169862-382c-4e5b-940c-6f54ab008a35 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.411955 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-45169862-382c-4e5b-940c-6f54ab008a35 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.129648 May 19 04:40:53.419513 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1229/2382] 10.222.0.58 () {58 vars in 1183 bytes} [Thu May 19 04:40:53 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:40:53.424871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:53.428470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.430285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Searching by: {'deleted': False, 'project_id': '277beeca952b478ebfc6d0bb55d89de2'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:40:53.435739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.436344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.437389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.437927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.470366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:40:53.518566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.528899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.529382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.556369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.579825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.589755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.591547 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1826f041-349d-4e35-8c0a-ed8a0a10ed3b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.576267 May 19 04:40:53.594175 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1154/2383] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:53 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:40:53.605543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a03becdd-3c86-4f87-a17a-ea85f7937972 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:53.609258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a03becdd-3c86-4f87-a17a-ea85f7937972 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:53.622502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a03becdd-3c86-4f87-a17a-ea85f7937972 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.622960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a03becdd-3c86-4f87-a17a-ea85f7937972 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.625665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a03becdd-3c86-4f87-a17a-ea85f7937972 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.626351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a03becdd-3c86-4f87-a17a-ea85f7937972 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.686169 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a03becdd-3c86-4f87-a17a-ea85f7937972 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089125 May 19 04:40:53.688197 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1155/2384] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:40:53 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:53.694479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1810034-1d51-49e7-9a08-002b75879f25 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:53.695524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d1810034-1d51-49e7-9a08-002b75879f25 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:53.704243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1810034-1d51-49e7-9a08-002b75879f25 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.705639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1810034-1d51-49e7-9a08-002b75879f25 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.706705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1810034-1d51-49e7-9a08-002b75879f25 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.707589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1810034-1d51-49e7-9a08-002b75879f25 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.791965 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b2d230b-d697-424a-b066-6600d75e2c9a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.371081 May 19 04:40:53.793466 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1230/2385] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:40:53 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:53.817799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b93cbca-c604-4099-bbce-4e29b0cd996d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:53.822125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2b93cbca-c604-4099-bbce-4e29b0cd996d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.837233 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b93cbca-c604-4099-bbce-4e29b0cd996d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.018423 May 19 04:40:53.838638 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1231/2386] 10.222.0.58 () {58 vars in 1177 bytes} [Thu May 19 04:40:53 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:40:53.850538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d28116af-dfb0-43d6-839d-762c25bad239 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:53.855409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d28116af-dfb0-43d6-839d-762c25bad239 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.859243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d28116af-dfb0-43d6-839d-762c25bad239 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Searching by: {'deleted': False, 'project_id': '277beeca952b478ebfc6d0bb55d89de2'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:40:53.869435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1810034-1d51-49e7-9a08-002b75879f25 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:53.870512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d28116af-dfb0-43d6-839d-762c25bad239 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.870813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d28116af-dfb0-43d6-839d-762c25bad239 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.871632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d28116af-dfb0-43d6-839d-762c25bad239 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:53.872073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d28116af-dfb0-43d6-839d-762c25bad239 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:53.884267 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d1810034-1d51-49e7-9a08-002b75879f25 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1277 microversion: 2.1 time: 0.194253 May 19 04:40:53.885623 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1156/2387] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:53 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:53.937203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-d28116af-dfb0-43d6-839d-762c25bad239 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:40:53.989615 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d28116af-dfb0-43d6-839d-762c25bad239 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.144225 May 19 04:40:53.997357 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1232/2388] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:40:53 2022] GET /compute/v2.1/servers => generated 683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:40:54.002186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:54.002766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:54.017638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.018107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.019137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.019591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.066609 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] HTTP exception thrown: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Request method failure captured: May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb HTTP/1.1 May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcowZhSpGkm09H8WUakL-y4Eh1Jv2At570KS53GeKkVGnDvnbwGc3I94tn3hsnD1w8DtHxBKyKWxdjBZ7TuFgZ17rG4i716jOykkdGGPsghNdGzCVE4Uqjcya7MwwH6MhRgTmW4SHjSfFy52oDU8hrJPH_g8aOly4KSRYuOeAxjWxNw May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f1beed6ea3284f8ba5449b9e1c4fc37c May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '59ece96d-d36d-4e0e-8065-8055d12bfafb'} May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:54.068284 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Returning 404 to user: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c21b88ab-5b59-430f-b4d9-b54dcdc6f44c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "DELETE /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb" status: 404 len: 111 microversion: 2.1 time: 0.072047 May 19 04:40:54.074946 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1157/2389] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:53 2022] DELETE /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:54.079952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-899b3698-89e9-4b53-bbf3-df94b71a5bf9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:54.080460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-899b3698-89e9-4b53-bbf3-df94b71a5bf9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:54.098306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-899b3698-89e9-4b53-bbf3-df94b71a5bf9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.099073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-899b3698-89e9-4b53-bbf3-df94b71a5bf9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.100182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-899b3698-89e9-4b53-bbf3-df94b71a5bf9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.100604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-899b3698-89e9-4b53-bbf3-df94b71a5bf9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.169035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-899b3698-89e9-4b53-bbf3-df94b71a5bf9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:54.417627 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-899b3698-89e9-4b53-bbf3-df94b71a5bf9 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147" status: 204 len: 0 microversion: 2.1 time: 0.341394 May 19 04:40:54.418461 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1233/2390] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:54 2022] DELETE /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:54.426956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4970a033-597e-4392-9eed-6e8af4d5e635 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:54.427464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4970a033-597e-4392-9eed-6e8af4d5e635 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:54.448464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4970a033-597e-4392-9eed-6e8af4d5e635 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.448675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4970a033-597e-4392-9eed-6e8af4d5e635 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.449436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4970a033-597e-4392-9eed-6e8af4d5e635 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.449933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4970a033-597e-4392-9eed-6e8af4d5e635 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.528893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4970a033-597e-4392-9eed-6e8af4d5e635 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:40:54.614813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:54.615566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:54.629658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.633811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.638573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.639237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.738354 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4970a033-597e-4392-9eed-6e8af4d5e635 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 204 len: 0 microversion: 2.1 time: 0.313744 May 19 04:40:54.740424 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1158/2391] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:40:54 2022] DELETE /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:40:54.753757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff9bfe4e-523f-4452-a88b-8a75abba040b tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:54.757257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff9bfe4e-523f-4452-a88b-8a75abba040b tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:54.789814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff9bfe4e-523f-4452-a88b-8a75abba040b tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.790293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff9bfe4e-523f-4452-a88b-8a75abba040b tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.792214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff9bfe4e-523f-4452-a88b-8a75abba040b tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.792656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff9bfe4e-523f-4452-a88b-8a75abba040b tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.893286 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff9bfe4e-523f-4452-a88b-8a75abba040b tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149575 May 19 04:40:54.899545 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1159/2392] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:40:54 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:54.916461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:54.917142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: 59ece96d-d36d-4e0e-8065-8055d12bfafb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:54.925492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.925950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.926792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:54.927320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:54.959535 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] HTTP exception thrown: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Request method failure captured: May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb HTTP/1.1 May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcowZhSpGkm09H8WUakL-y4Eh1Jv2At570KS53GeKkVGnDvnbwGc3I94tn3hsnD1w8DtHxBKyKWxdjBZ7TuFgZ17rG4i716jOykkdGGPsghNdGzCVE4Uqjcya7MwwH6MhRgTmW4SHjSfFy52oDU8hrJPH_g8aOly4KSRYuOeAxjWxNw May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f1beed6ea3284f8ba5449b9e1c4fc37c May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '59ece96d-d36d-4e0e-8065-8055d12bfafb'} May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:54.964201 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.968254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:54.968254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:54.968254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:54.968254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:54.968254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:54.968254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. May 19 04:40:54.968254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:54.968254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Returning 404 to user: Instance 59ece96d-d36d-4e0e-8065-8055d12bfafb could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:54.969127 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9bb9de24-bb90-4355-8993-380868c3d23d tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb" status: 404 len: 111 microversion: 2.1 time: 0.069164 May 19 04:40:54.974084 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1160/2393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:54 2022] GET /compute/v2.1/servers/59ece96d-d36d-4e0e-8065-8055d12bfafb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:54.989452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0bc9e3f4-caea-41aa-b569-4a6ad1147730 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:54.991123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0bc9e3f4-caea-41aa-b569-4a6ad1147730 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:55.005319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0bc9e3f4-caea-41aa-b569-4a6ad1147730 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:55.008670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0bc9e3f4-caea-41aa-b569-4a6ad1147730 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:55.010546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0bc9e3f4-caea-41aa-b569-4a6ad1147730 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:55.011547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0bc9e3f4-caea-41aa-b569-4a6ad1147730 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:55.146580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0bc9e3f4-caea-41aa-b569-4a6ad1147730 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:55.158981 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0bc9e3f4-caea-41aa-b569-4a6ad1147730 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1283 microversion: 2.1 time: 0.183473 May 19 04:40:55.160889 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1161/2394] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:54 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1283 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:55.166673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-edff57f5-d6d9-4e68-be04-e50dfb9ba95a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:55.175815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:55.181995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-edff57f5-d6d9-4e68-be04-e50dfb9ba95a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:55.195217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:55.201371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:55.202641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edff57f5-d6d9-4e68-be04-e50dfb9ba95a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:55.203960 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-476d0d1b-dd4f-46eb-99a3-b982bbc74a0c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.594092 May 19 04:40:55.204737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edff57f5-d6d9-4e68-be04-e50dfb9ba95a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:55.205984 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1234/2395] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:54 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:55.206761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edff57f5-d6d9-4e68-be04-e50dfb9ba95a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:55.207428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edff57f5-d6d9-4e68-be04-e50dfb9ba95a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:55.213918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:55.449934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-edff57f5-d6d9-4e68-be04-e50dfb9ba95a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:55.459652 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-edff57f5-d6d9-4e68-be04-e50dfb9ba95a tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147" status: 200 len: 1522 microversion: 2.1 time: 0.297791 May 19 04:40:55.462612 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1162/2396] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:55 2022] GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:55.930240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ba7716e-d080-4784-80be-9586403467f9 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:55.932183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ba7716e-d080-4784-80be-9586403467f9 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:55.958804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ba7716e-d080-4784-80be-9586403467f9 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:55.959274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ba7716e-d080-4784-80be-9586403467f9 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:55.960073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ba7716e-d080-4784-80be-9586403467f9 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:55.960517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ba7716e-d080-4784-80be-9586403467f9 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:56.053754 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ba7716e-d080-4784-80be-9586403467f9 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146367 May 19 04:40:56.055606 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1163/2397] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:40:55 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:56.180937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d989da40-9c45-47d7-9592-bc020f706ede tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:56.181682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d989da40-9c45-47d7-9592-bc020f706ede tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:56.191873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d989da40-9c45-47d7-9592-bc020f706ede tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:56.195631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d989da40-9c45-47d7-9592-bc020f706ede tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:56.197238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d989da40-9c45-47d7-9592-bc020f706ede tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:56.198827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d989da40-9c45-47d7-9592-bc020f706ede tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:56.381502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1877172274", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:56.451447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:40:56.567402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d989da40-9c45-47d7-9592-bc020f706ede tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:56.586190 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d989da40-9c45-47d7-9592-bc020f706ede tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1325 microversion: 2.1 time: 0.410681 May 19 04:40:56.587171 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1164/2398] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:56 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1325 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:56.677018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5e50c01e-8b71-4064-a5fa-73b5e27cc47d tempest-AbsoluteLimitsTestJSON-1375754319 tempest-AbsoluteLimitsTestJSON-1375754319-project] Calling method '.version_select at 0x7fd31b6d4160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:56.688748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e50c01e-8b71-4064-a5fa-73b5e27cc47d tempest-AbsoluteLimitsTestJSON-1375754319 tempest-AbsoluteLimitsTestJSON-1375754319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:56.689235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e50c01e-8b71-4064-a5fa-73b5e27cc47d tempest-AbsoluteLimitsTestJSON-1375754319 tempest-AbsoluteLimitsTestJSON-1375754319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:56.690045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e50c01e-8b71-4064-a5fa-73b5e27cc47d tempest-AbsoluteLimitsTestJSON-1375754319 tempest-AbsoluteLimitsTestJSON-1375754319-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:56.690477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e50c01e-8b71-4064-a5fa-73b5e27cc47d tempest-AbsoluteLimitsTestJSON-1375754319 tempest-AbsoluteLimitsTestJSON-1375754319-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:56.734391 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5e50c01e-8b71-4064-a5fa-73b5e27cc47d tempest-AbsoluteLimitsTestJSON-1375754319 tempest-AbsoluteLimitsTestJSON-1375754319-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.146034 May 19 04:40:56.746383 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1165/2399] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 19 04:40:56 2022] GET /compute/v2.1/limits => generated 511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:56.752628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:56.753853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:56.761707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:56.763924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:56.763924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:56.763924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.305101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:40:57.305705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:40:57.306482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:40:57.307056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:40:57.307616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:40:57.324107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:57.339771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:57.343213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.343666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.344476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.344916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.351458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:57.352683 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c962629-845d-4aa6-b4bc-fbef15e8e844 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.605109 May 19 04:40:57.359043 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1166/2400] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:56 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:57.370034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:57.375436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:57.392944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.393442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.394237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.394683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.408748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:40:57.419680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for user 55c593b7f2a04b0e820a505e8e8eb521 and project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:40:57.463844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.464358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.465141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lazy-loading 'fault' on Instance uuid a7b1ec1b-3115-4cd6-ab4b-e430266a6147 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:40:57.472055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:40:57.478183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:40:57.562402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1beed6ea3284f8ba5449b9e1c4fc37c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277beeca952b478ebfc6d0bb55d89de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:57.578131 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3957bf7-d1ca-447b-94f4-68fa9d81afec tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147" status: 200 len: 1313 microversion: 2.1 time: 0.217531 May 19 04:40:57.578608 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1167/2401] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:57 2022] GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:57.591643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f8f8493e-d6c1-4fa9-9a7a-d79e71377eb1 req-ef5a2469-588e-44ac-972d-c43efd57fd98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76be18c3-93a7-4cf3-81ff-05956bb3bce2", "tag": "f5734274-cd30-436c-836d-82643814bc02"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:57.593631 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-efa4e627-fb64-477a-a3ff-1bc5bfc975d4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689746 May 19 04:40:57.595707 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1235/2402] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:40:57.600833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f8f8493e-d6c1-4fa9-9a7a-d79e71377eb1 req-ef5a2469-588e-44ac-972d-c43efd57fd98 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.601962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f8f8493e-d6c1-4fa9-9a7a-d79e71377eb1 req-ef5a2469-588e-44ac-972d-c43efd57fd98 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.624115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d4bc101-5884-4b1d-9423-588c03b3ffb7 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:57.626752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7d4bc101-5884-4b1d-9423-588c03b3ffb7 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:57.630946 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f8f8493e-d6c1-4fa9-9a7a-d79e71377eb1 req-ef5a2469-588e-44ac-972d-c43efd57fd98 service nova] Creating event network-changed:f5734274-cd30-436c-836d-82643814bc02 for instance 76be18c3-93a7-4cf3-81ff-05956bb3bce2 on n-h1-766726-30 May 19 04:40:57.637468 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f8f8493e-d6c1-4fa9-9a7a-d79e71377eb1 req-ef5a2469-588e-44ac-972d-c43efd57fd98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051591 May 19 04:40:57.638536 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1168/2403] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:57.643526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d4bc101-5884-4b1d-9423-588c03b3ffb7 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.644210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b968aacf-55e0-42db-acf9-d7db3af715e1 req-18c9f864-f6cd-49f3-9f98-ab2497847734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b1ec1b-3115-4cd6-ab4b-e430266a6147", "name": "network-vif-deleted", "tag": "ca85c40e-7474-4a04-a51f-acd3567f6990"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:57.644941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d4bc101-5884-4b1d-9423-588c03b3ffb7 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.646621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d4bc101-5884-4b1d-9423-588c03b3ffb7 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.647662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d4bc101-5884-4b1d-9423-588c03b3ffb7 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.658149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b968aacf-55e0-42db-acf9-d7db3af715e1 req-18c9f864-f6cd-49f3-9f98-ab2497847734 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.658604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b968aacf-55e0-42db-acf9-d7db3af715e1 req-18c9f864-f6cd-49f3-9f98-ab2497847734 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.684087 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b968aacf-55e0-42db-acf9-d7db3af715e1 req-18c9f864-f6cd-49f3-9f98-ab2497847734 service nova] Creating event network-vif-deleted:ca85c40e-7474-4a04-a51f-acd3567f6990 for instance a7b1ec1b-3115-4cd6-ab4b-e430266a6147 on n-h1-766726-30 May 19 04:40:57.698187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b968aacf-55e0-42db-acf9-d7db3af715e1 req-18c9f864-f6cd-49f3-9f98-ab2497847734 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058105 May 19 04:40:57.706999 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1169/2404] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:57.715286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7bd78179-c6f1-4957-9835-e8aa6eb2adc3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:57.716367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7bd78179-c6f1-4957-9835-e8aa6eb2adc3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:57.735439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:57.740200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7bd78179-c6f1-4957-9835-e8aa6eb2adc3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.741185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7bd78179-c6f1-4957-9835-e8aa6eb2adc3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.743731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7bd78179-c6f1-4957-9835-e8aa6eb2adc3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:57.745407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7bd78179-c6f1-4957-9835-e8aa6eb2adc3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:57.767823 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d4bc101-5884-4b1d-9423-588c03b3ffb7 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169284 May 19 04:40:57.769734 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1236/2405] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:40:57 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:57.778970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-281d1670-f47e-4d15-a9e4-bd97403bb034 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:57.781520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-281d1670-f47e-4d15-a9e4-bd97403bb034 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:57.888795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-281d1670-f47e-4d15-a9e4-bd97403bb034 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:57.905724 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-281d1670-f47e-4d15-a9e4-bd97403bb034 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1213 microversion: 2.1 time: 0.133625 May 19 04:40:57.909149 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1237/2406] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:57 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:58.125486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7bd78179-c6f1-4957-9835-e8aa6eb2adc3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:58.142977 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7bd78179-c6f1-4957-9835-e8aa6eb2adc3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1325 microversion: 2.1 time: 0.434934 May 19 04:40:58.151603 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1170/2407] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:57 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:58.372584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:58.373490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:58.382823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.383663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:58.384806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.385492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:58.595097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:58.595656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: a7b1ec1b-3115-4cd6-ab4b-e430266a6147] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:58.603092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.603538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:58.604268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:58.604727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.604727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:58.617351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:58.619133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:58.620964 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c8edea4e-2f13-4630-ad52-09cdcfa767f2 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.252584 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] HTTP exception thrown: Instance a7b1ec1b-3115-4cd6-ab4b-e430266a6147 could not be found. May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Request method failure captured: May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147 HTTP/1.1 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcowZhSpGkm09H8WUakL-y4Eh1Jv2At570KS53GeKkVGnDvnbwGc3I94tn3hsnD1w8DtHxBKyKWxdjBZ7TuFgZ17rG4i716jOykkdGGPsghNdGzCVE4Uqjcya7MwwH6MhRgTmW4SHjSfFy52oDU8hrJPH_g8aOly4KSRYuOeAxjWxNw May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f1beed6ea3284f8ba5449b9e1c4fc37c May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance a7b1ec1b-3115-4cd6-ab4b-e430266a6147 could not be found. May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'a7b1ec1b-3115-4cd6-ab4b-e430266a6147'} May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b1ec1b-3115-4cd6-ab4b-e430266a6147 could not be found. May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:58.633103 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b1ec1b-3115-4cd6-ab4b-e430266a6147 could not be found. May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b1ec1b-3115-4cd6-ab4b-e430266a6147 could not be found. May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Returning 404 to user: Instance a7b1ec1b-3115-4cd6-ab4b-e430266a6147 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64d481af-95c2-4612-ae3a-67dd5427b65c tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147" status: 404 len: 111 microversion: 2.1 time: 0.036462 May 19 04:40:58.638615 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1171/2408] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:58 2022] GET /compute/v2.1/servers/a7b1ec1b-3115-4cd6-ab4b-e430266a6147 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:40:58.640599 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1238/2409] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:58 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:40:58.643179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:58.643929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] [instance: b28e3b5b-0420-466c-b3ee-98ed2ab1e101] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:58.654429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.655147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:58.656080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.656612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:58.671243 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] HTTP exception thrown: Instance b28e3b5b-0420-466c-b3ee-98ed2ab1e101 could not be found. May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Request method failure captured: May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 HTTP/1.1 May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcowZhSpGkm09H8WUakL-y4Eh1Jv2At570KS53GeKkVGnDvnbwGc3I94tn3hsnD1w8DtHxBKyKWxdjBZ7TuFgZ17rG4i716jOykkdGGPsghNdGzCVE4Uqjcya7MwwH6MhRgTmW4SHjSfFy52oDU8hrJPH_g8aOly4KSRYuOeAxjWxNw May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277beeca952b478ebfc6d0bb55d89de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 277beeca952b478ebfc6d0bb55d89de2 May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-788139765 May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f1beed6ea3284f8ba5449b9e1c4fc37c May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListServersNegativeTestJSON-788139765-project May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance b28e3b5b-0420-466c-b3ee-98ed2ab1e101 could not be found. May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b28e3b5b-0420-466c-b3ee-98ed2ab1e101'} May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b28e3b5b-0420-466c-b3ee-98ed2ab1e101 could not be found. May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b28e3b5b-0420-466c-b3ee-98ed2ab1e101 could not be found. May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:40:58.672801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b28e3b5b-0420-466c-b3ee-98ed2ab1e101 could not be found. May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] Returning 404 to user: Instance b28e3b5b-0420-466c-b3ee-98ed2ab1e101 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3125303d-8f10-4424-98f6-776df9d19736 tempest-ListServersNegativeTestJSON-788139765 tempest-ListServersNegativeTestJSON-788139765-project] 10.222.0.58 "GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101" status: 404 len: 111 microversion: 2.1 time: 0.041727 May 19 04:40:58.676600 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1172/2410] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:58 2022] GET /compute/v2.1/servers/b28e3b5b-0420-466c-b3ee-98ed2ab1e101 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:40:58.781221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ad02ea4-9436-48d6-bed1-155e98a26c5f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:58.783118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8ad02ea4-9436-48d6-bed1-155e98a26c5f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:58.795022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ad02ea4-9436-48d6-bed1-155e98a26c5f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.797069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ad02ea4-9436-48d6-bed1-155e98a26c5f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:58.798189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ad02ea4-9436-48d6-bed1-155e98a26c5f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.798637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ad02ea4-9436-48d6-bed1-155e98a26c5f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:58.847764 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ad02ea4-9436-48d6-bed1-155e98a26c5f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071215 May 19 04:40:58.852700 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1239/2411] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:40:58 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:40:58.924049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-58a46ce1-2303-4799-b520-fd91978f5b78 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:58.924224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-58a46ce1-2303-4799-b520-fd91978f5b78 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:58.935448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58a46ce1-2303-4799-b520-fd91978f5b78 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.936031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58a46ce1-2303-4799-b520-fd91978f5b78 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:58.938057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58a46ce1-2303-4799-b520-fd91978f5b78 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:58.941128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58a46ce1-2303-4799-b520-fd91978f5b78 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:59.167209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b216fea-45c7-4b26-93be-f3e642e187ef tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:59.167884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4b216fea-45c7-4b26-93be-f3e642e187ef tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:59.183922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b216fea-45c7-4b26-93be-f3e642e187ef tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:59.184553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b216fea-45c7-4b26-93be-f3e642e187ef tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:59.185643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b216fea-45c7-4b26-93be-f3e642e187ef tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:59.186318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b216fea-45c7-4b26-93be-f3e642e187ef tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:59.302273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58a46ce1-2303-4799-b520-fd91978f5b78 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:59.312184 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-58a46ce1-2303-4799-b520-fd91978f5b78 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1217 microversion: 2.1 time: 0.392586 May 19 04:40:59.322978 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1173/2412] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:58 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1217 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:40:59.542564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4b216fea-45c7-4b26-93be-f3e642e187ef tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:40:59.557787 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4b216fea-45c7-4b26-93be-f3e642e187ef tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1325 microversion: 2.1 time: 0.394197 May 19 04:40:59.567833 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1240/2413] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:40:59 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1325 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:40:59.650993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:59.652240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:59.657213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-95f4e571-42c5-4fbd-b3c9-05d38661ce25 req-d91aa634-f4fe-4ba9-aed9-4d392076115a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-plugged", "status": "completed", "tag": "11827578-b39a-4078-b09c-f790673f88b0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:59.677679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-95f4e571-42c5-4fbd-b3c9-05d38661ce25 req-d91aa634-f4fe-4ba9-aed9-4d392076115a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:59.678388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:59.679071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:59.682174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:59.682455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-95f4e571-42c5-4fbd-b3c9-05d38661ce25 req-d91aa634-f4fe-4ba9-aed9-4d392076115a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:59.685356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:59.688033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:40:59.725732 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-95f4e571-42c5-4fbd-b3c9-05d38661ce25 req-d91aa634-f4fe-4ba9-aed9-4d392076115a service nova] Creating event network-vif-plugged:11827578-b39a-4078-b09c-f790673f88b0 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:40:59.741022 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-95f4e571-42c5-4fbd-b3c9-05d38661ce25 req-d91aa634-f4fe-4ba9-aed9-4d392076115a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098364 May 19 04:40:59.742364 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1241/2414] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:40:59.781115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-83a699cc-9e3d-4c6f-9e20-30cbead2f97a req-a58c5dc1-8034-4505-b406-366213fed210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28e3b5b-0420-466c-b3ee-98ed2ab1e101", "name": "network-vif-deleted", "tag": "0709d4db-9bd2-49ff-a5ad-cfcd318873d3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:40:59.797796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-83a699cc-9e3d-4c6f-9e20-30cbead2f97a req-a58c5dc1-8034-4505-b406-366213fed210 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:59.798699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-83a699cc-9e3d-4c6f-9e20-30cbead2f97a req-a58c5dc1-8034-4505-b406-366213fed210 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:59.825726 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-83a699cc-9e3d-4c6f-9e20-30cbead2f97a req-a58c5dc1-8034-4505-b406-366213fed210 service nova] Creating event network-vif-deleted:0709d4db-9bd2-49ff-a5ad-cfcd318873d3 for instance b28e3b5b-0420-466c-b3ee-98ed2ab1e101 on n-h2-766726-30 May 19 04:40:59.835400 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-83a699cc-9e3d-4c6f-9e20-30cbead2f97a req-a58c5dc1-8034-4505-b406-366213fed210 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063832 May 19 04:40:59.838358 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1242/2415] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:40:59.867043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60ed8f0b-cc1c-499d-832e-7ec4e22d331f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:40:59.869141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60ed8f0b-cc1c-499d-832e-7ec4e22d331f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:40:59.892197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60ed8f0b-cc1c-499d-832e-7ec4e22d331f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:59.893528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60ed8f0b-cc1c-499d-832e-7ec4e22d331f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:59.894414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60ed8f0b-cc1c-499d-832e-7ec4e22d331f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:40:59.894987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60ed8f0b-cc1c-499d-832e-7ec4e22d331f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:40:59.935595 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60ed8f0b-cc1c-499d-832e-7ec4e22d331f tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078144 May 19 04:40:59.936496 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1243/2416] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:40:59 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:00.349342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-506f3297-e9bc-486a-a12a-318c9487b942 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:00.350372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-506f3297-e9bc-486a-a12a-318c9487b942 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:00.355085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:00.365287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-506f3297-e9bc-486a-a12a-318c9487b942 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:00.365910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-506f3297-e9bc-486a-a12a-318c9487b942 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:00.368443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-506f3297-e9bc-486a-a12a-318c9487b942 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:00.368923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-506f3297-e9bc-486a-a12a-318c9487b942 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:00.374010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:00.381746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:00.384342 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b3936cd-f963-4553-bd8a-a5330cf60a27 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.742927 May 19 04:41:00.385059 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1174/2417] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:40:59 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:41:00.577033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9f7fcc34-5a69-48ac-94f4-710626eb2ca4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:00.578164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9f7fcc34-5a69-48ac-94f4-710626eb2ca4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:00.588551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f7fcc34-5a69-48ac-94f4-710626eb2ca4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:00.590595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f7fcc34-5a69-48ac-94f4-710626eb2ca4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:00.594299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f7fcc34-5a69-48ac-94f4-710626eb2ca4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:00.596465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f7fcc34-5a69-48ac-94f4-710626eb2ca4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:00.747986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-506f3297-e9bc-486a-a12a-318c9487b942 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:00.756516 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-506f3297-e9bc-486a-a12a-318c9487b942 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1271 microversion: 2.1 time: 0.418369 May 19 04:41:00.769928 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1244/2418] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:00 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1271 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:00.947600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-815ddb1d-d30f-4dbf-98f1-762f8ad08472 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:00.948466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-815ddb1d-d30f-4dbf-98f1-762f8ad08472 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:00.961931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-815ddb1d-d30f-4dbf-98f1-762f8ad08472 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:00.962391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-815ddb1d-d30f-4dbf-98f1-762f8ad08472 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:00.963189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-815ddb1d-d30f-4dbf-98f1-762f8ad08472 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:00.963630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-815ddb1d-d30f-4dbf-98f1-762f8ad08472 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:01.036446 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-815ddb1d-d30f-4dbf-98f1-762f8ad08472 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092822 May 19 04:41:01.037403 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1245/2419] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:00 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:01.055906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9f7fcc34-5a69-48ac-94f4-710626eb2ca4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:01.066977 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9f7fcc34-5a69-48ac-94f4-710626eb2ca4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1325 microversion: 2.1 time: 0.494794 May 19 04:41:01.071746 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1175/2420] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:00 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1325 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:01.405989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:01.407124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:01.418940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:01.420693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:01.423112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:01.424727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:01.948175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e9810d46-2319-4803-92d8-5fb1f704da8d tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Action: 'create', calling method: .version_select at 0x7fd315e87a60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:01.973825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e9810d46-2319-4803-92d8-5fb1f704da8d tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Getting quotas for project 77458aed156445d0beeb4fa6a930b2a2. Resources: {'server_groups'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:01.985021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e9810d46-2319-4803-92d8-5fb1f704da8d tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Getting quotas for user aba6c3d2ce6141e6ad4441835fd2aea6 and project 77458aed156445d0beeb4fa6a930b2a2. Resources: {'server_groups'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:01.990331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:02.005028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:02.025772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:02.030994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:02.036747 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d502f136-a0a5-4bd1-9b05-9398de28dc41 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.632736 May 19 04:41:02.037924 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1176/2421] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:01 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:41:02.060301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-842965c9-72f0-49b2-9fc6-01e001dc3357 req-a6d3580c-2fe6-4ce9-bc05-e318b03810c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-plugged", "status": "completed", "tag": "081b7f90-40d2-45cb-88dd-efe0b2900ed6"}, {"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-plugged", "status": "completed", "tag": "b5c9ee41-8f79-451c-8e52-3f34832d4eb8"}, {"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-plugged", "status": "completed", "tag": "712746b0-d242-41be-a8d0-753db84e4e8f"}, {"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-plugged", "status": "completed", "tag": "251915bf-6825-4c34-bd81-cf630c80845a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:02.068209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e9810d46-2319-4803-92d8-5fb1f704da8d tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Getting quotas for project 77458aed156445d0beeb4fa6a930b2a2. Resources: {'server_groups'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:02.075776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e9810d46-2319-4803-92d8-5fb1f704da8d tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Getting quotas for user aba6c3d2ce6141e6ad4441835fd2aea6 and project 77458aed156445d0beeb4fa6a930b2a2. Resources: {'server_groups'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:02.089426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-842965c9-72f0-49b2-9fc6-01e001dc3357 req-a6d3580c-2fe6-4ce9-bc05-e318b03810c7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:02.090153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-842965c9-72f0-49b2-9fc6-01e001dc3357 req-a6d3580c-2fe6-4ce9-bc05-e318b03810c7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:02.095364 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e9810d46-2319-4803-92d8-5fb1f704da8d tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.713104 May 19 04:41:02.096388 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1246/2422] 10.222.0.58 () {62 vars in 1213 bytes} [Thu May 19 04:41:01 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:41:02.104339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac7ffbc5-75ab-44e1-990c-5e92b640df29 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:02.104980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac7ffbc5-75ab-44e1-990c-5e92b640df29 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:02.111927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac7ffbc5-75ab-44e1-990c-5e92b640df29 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:02.112393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac7ffbc5-75ab-44e1-990c-5e92b640df29 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:02.113405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac7ffbc5-75ab-44e1-990c-5e92b640df29 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:02.113856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac7ffbc5-75ab-44e1-990c-5e92b640df29 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:02.114026 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-842965c9-72f0-49b2-9fc6-01e001dc3357 req-a6d3580c-2fe6-4ce9-bc05-e318b03810c7 service nova] Creating event network-vif-plugged:081b7f90-40d2-45cb-88dd-efe0b2900ed6 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:41:02.114747 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-842965c9-72f0-49b2-9fc6-01e001dc3357 req-a6d3580c-2fe6-4ce9-bc05-e318b03810c7 service nova] Creating event network-vif-plugged:b5c9ee41-8f79-451c-8e52-3f34832d4eb8 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:41:02.115441 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-842965c9-72f0-49b2-9fc6-01e001dc3357 req-a6d3580c-2fe6-4ce9-bc05-e318b03810c7 service nova] Creating event network-vif-plugged:712746b0-d242-41be-a8d0-753db84e4e8f for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:41:02.116824 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-842965c9-72f0-49b2-9fc6-01e001dc3357 req-a6d3580c-2fe6-4ce9-bc05-e318b03810c7 service nova] Creating event network-vif-plugged:251915bf-6825-4c34-bd81-cf630c80845a for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:41:02.124699 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-842965c9-72f0-49b2-9fc6-01e001dc3357 req-a6d3580c-2fe6-4ce9-bc05-e318b03810c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.083549 May 19 04:41:02.125549 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1177/2423] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:02.132756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c8afcb7-feda-4278-83f8-06ad46f83e35 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:02.134146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c8afcb7-feda-4278-83f8-06ad46f83e35 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:02.141955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c8afcb7-feda-4278-83f8-06ad46f83e35 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:02.142761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c8afcb7-feda-4278-83f8-06ad46f83e35 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:02.143750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c8afcb7-feda-4278-83f8-06ad46f83e35 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:02.144389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c8afcb7-feda-4278-83f8-06ad46f83e35 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:02.188833 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c8afcb7-feda-4278-83f8-06ad46f83e35 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054976 May 19 04:41:02.191174 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1178/2424] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:02 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:02.202063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-89c2472e-ed0a-4c90-8671-a4c1bfb8838f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:02.204418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-89c2472e-ed0a-4c90-8671-a4c1bfb8838f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:02.218166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c2472e-ed0a-4c90-8671-a4c1bfb8838f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:02.221575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c2472e-ed0a-4c90-8671-a4c1bfb8838f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:02.229375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c2472e-ed0a-4c90-8671-a4c1bfb8838f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:02.230291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c2472e-ed0a-4c90-8671-a4c1bfb8838f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:02.520774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac7ffbc5-75ab-44e1-990c-5e92b640df29 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:02.528799 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac7ffbc5-75ab-44e1-990c-5e92b640df29 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1313 microversion: 2.1 time: 0.431023 May 19 04:41:02.529475 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1247/2425] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:02 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:02.534662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7776a5de-c3f7-4c1b-960b-8bfb72b044a8 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:02.548945 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7776a5de-c3f7-4c1b-960b-8bfb72b044a8 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.018380 May 19 04:41:02.549753 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1248/2426] 10.222.0.58 () {60 vars in 1192 bytes} [Thu May 19 04:41:02 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:41:02.592622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-89c2472e-ed0a-4c90-8671-a4c1bfb8838f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:02.621489 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-89c2472e-ed0a-4c90-8671-a4c1bfb8838f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1325 microversion: 2.1 time: 0.428701 May 19 04:41:02.633691 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1179/2427] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:02 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1325 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:02.640768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2cf308bc-6e6f-4a79-8b87-b3f9cfec6079 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:02.654093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2cf308bc-6e6f-4a79-8b87-b3f9cfec6079 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/9f18b016-d791-477b-a91c-d04f5a7ac8bc" status: 200 len: 235 microversion: 2.64 time: 0.018898 May 19 04:41:02.655344 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1180/2428] 10.222.0.58 () {60 vars in 1303 bytes} [Thu May 19 04:41:02 2022] GET /compute/v2.1/os-server-groups/9f18b016-d791-477b-a91c-d04f5a7ac8bc => generated 235 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:41:02.667233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dd2a3f98-2837-4b9b-aad2-72561c0e5f67 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:02.716695 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dd2a3f98-2837-4b9b-aad2-72561c0e5f67 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/9f18b016-d791-477b-a91c-d04f5a7ac8bc" status: 204 len: 0 microversion: 2.64 time: 0.055647 May 19 04:41:02.719425 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1181/2429] 10.222.0.58 () {60 vars in 1306 bytes} [Thu May 19 04:41:02 2022] DELETE /compute/v2.1/os-server-groups/9f18b016-d791-477b-a91c-d04f5a7ac8bc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:41:02.729773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93090ca5-d43e-4228-8e27-064d0196a114 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:02.736482 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-93090ca5-d43e-4228-8e27-064d0196a114 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] HTTP exception thrown: Instance group 9f18b016-d791-477b-a91c-d04f5a7ac8bc could not be found. May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93090ca5-d43e-4228-8e27-064d0196a114 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Request method failure captured: May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-server-groups/9f18b016-d791-477b-a91c-d04f5a7ac8bc HTTP/1.1 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpdBjplcBOH5JYdGoi2eV-67FbAdCRhHG9N5AR7pBXlpWAoK4xhfEaWKLKALR-a-3KsQtKnjU2DNb0SysdXDkm1BfAhmqMIhvGdpUxRbVo6q62UThM39ABxtzOOX4WvQEwBi2tGSvLTup0o3QpHx-QO7TrDBwSF0b0twIvUyDyD8Dg May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.64 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 77458aed156445d0beeb4fa6a930b2a2 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerGroup264TestJSON-1698730190 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77458aed156445d0beeb4fa6a930b2a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77458aed156445d0beeb4fa6a930b2a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77458aed156445d0beeb4fa6a930b2a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77458aed156445d0beeb4fa6a930b2a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerGroup264TestJSON-1698730190 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 77458aed156445d0beeb4fa6a930b2a2 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1698730190 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerGroup264TestJSON-1698730190-project May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: aba6c3d2ce6141e6ad4441835fd2aea6 May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerGroup264TestJSON-1698730190-project May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance group 9f18b016-d791-477b-a91c-d04f5a7ac8bc could not be found. May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '9f18b016-d791-477b-a91c-d04f5a7ac8bc'} May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9f18b016-d791-477b-a91c-d04f5a7ac8bc could not be found. May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9f18b016-d791-477b-a91c-d04f5a7ac8bc could not be found. May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.738823 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.742992 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:02.742992 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:02.742992 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:02.742992 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:02.742992 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9f18b016-d791-477b-a91c-d04f5a7ac8bc could not be found. May 19 04:41:02.742992 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.744824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93090ca5-d43e-4228-8e27-064d0196a114 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] Returning 404 to user: Instance group 9f18b016-d791-477b-a91c-d04f5a7ac8bc could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:02.746079 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-93090ca5-d43e-4228-8e27-064d0196a114 tempest-ServerGroup264TestJSON-1698730190 tempest-ServerGroup264TestJSON-1698730190-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/9f18b016-d791-477b-a91c-d04f5a7ac8bc" status: 404 len: 117 microversion: 2.64 time: 0.021148 May 19 04:41:02.747478 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1182/2430] 10.222.0.58 () {60 vars in 1306 bytes} [Thu May 19 04:41:02 2022] DELETE /compute/v2.1/os-server-groups/9f18b016-d791-477b-a91c-d04f5a7ac8bc => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:41:02.780609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c6b03c65-2c24-49be-8030-54ada32dbc0f tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2085056675", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:02.783189 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c6b03c65-2c24-49be-8030-54ada32dbc0f tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] HTTP exception thrown: min_count must be <= max_count May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c6b03c65-2c24-49be-8030-54ada32dbc0f tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Request method failure captured: May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 184 May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpexttMohg4Y6_3UFWvyNT0qDS2WYUcDiD9g3CoQbeFh0CKzNrJhLedtIEsJnvnQl2gBmnjRp6uvv4TfayGxWrDXYJGeZqPcbbPR0FnGojoz6wHTbWruFmJ3eOv74wpNDA-AX3wBB8H4mJ2CdlmYZ3xSQ_YoWArR-RYZqRmCN9prMI May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7af7b7c9996044f89da29f78f2ce9d40 May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2085056675", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 3, "max_count": 2}} May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: exception: min_count must be <= max_count May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2085056675', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 728, in create May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count May 19 04:41:02.785714 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.793209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c6b03c65-2c24-49be-8030-54ada32dbc0f tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Returning 400 to user: min_count must be <= max_count {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:02.794450 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c6b03c65-2c24-49be-8030-54ada32dbc0f tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.239322 May 19 04:41:02.805118 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1249/2431] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:02 2022] POST /compute/v2.1/servers => generated 74 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 04:41:02.861300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9368eaa-3718-4315-9e37-a22a570afecd tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-67545646", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "max_count": 0}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9368eaa-3718-4315-9e37-a22a570afecd tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Request method failure captured: May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 166 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpexttMohg4Y6_3UFWvyNT0qDS2WYUcDiD9g3CoQbeFh0CKzNrJhLedtIEsJnvnQl2gBmnjRp6uvv4TfayGxWrDXYJGeZqPcbbPR0FnGojoz6wHTbWruFmJ3eOv74wpNDA-AX3wBB8H4mJ2CdlmYZ3xSQ_YoWArR-RYZqRmCN9prMI May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7af7b7c9996044f89da29f78f2ce9d40 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-67545646", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "max_count": 0}} May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-67545646', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'max_count': 0}}} May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 0 May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:41:02.864521 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 19 04:41:02.868392 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:02.870040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9368eaa-3718-4315-9e37-a22a570afecd tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:02.871071 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9368eaa-3718-4315-9e37-a22a570afecd tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013994 May 19 04:41:02.872208 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1183/2432] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:02 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:41:02.928115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cdbfb10e-a6b7-44af-a3cd-f5efb15b3242 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-358029214", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "max_count": 2.5}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cdbfb10e-a6b7-44af-a3cd-f5efb15b3242 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Request method failure captured: May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 169 May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpexttMohg4Y6_3UFWvyNT0qDS2WYUcDiD9g3CoQbeFh0CKzNrJhLedtIEsJnvnQl2gBmnjRp6uvv4TfayGxWrDXYJGeZqPcbbPR0FnGojoz6wHTbWruFmJ3eOv74wpNDA-AX3wBB8H4mJ2CdlmYZ3xSQ_YoWArR-RYZqRmCN9prMI May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7af7b7c9996044f89da29f78f2ce9d40 May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-358029214", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "max_count": 2.5}} May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-358029214', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'max_count': 2.5}}} May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 2.5 May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:41:02.931817 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 04:41:02.935130 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:02.939552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cdbfb10e-a6b7-44af-a3cd-f5efb15b3242 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:02.940650 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cdbfb10e-a6b7-44af-a3cd-f5efb15b3242 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017613 May 19 04:41:02.950814 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1250/2433] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:41:03.001233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-888cfef5-b541-4d8d-91d4-e13be4277ab5 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-894125826", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 0}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-888cfef5-b541-4d8d-91d4-e13be4277ab5 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Request method failure captured: May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 167 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpexttMohg4Y6_3UFWvyNT0qDS2WYUcDiD9g3CoQbeFh0CKzNrJhLedtIEsJnvnQl2gBmnjRp6uvv4TfayGxWrDXYJGeZqPcbbPR0FnGojoz6wHTbWruFmJ3eOv74wpNDA-AX3wBB8H4mJ2CdlmYZ3xSQ_YoWArR-RYZqRmCN9prMI May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7af7b7c9996044f89da29f78f2ce9d40 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-894125826", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 0}} May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-894125826', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'min_count': 0}}} May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 0 May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:41:03.005984 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 19 04:41:03.009968 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.014663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-888cfef5-b541-4d8d-91d4-e13be4277ab5 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:03.016035 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-888cfef5-b541-4d8d-91d4-e13be4277ab5 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022008 May 19 04:41:03.027870 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1184/2434] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:02 2022] POST /compute/v2.1/servers => generated 130 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:41:03.060511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:03.061458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:03.071422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:03.072212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:03.073289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:03.074043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:03.099778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2a68de8-79a0-443f-b392-511584d45117 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-179683446", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 2.5}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2a68de8-79a0-443f-b392-511584d45117 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Request method failure captured: May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 169 May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpexttMohg4Y6_3UFWvyNT0qDS2WYUcDiD9g3CoQbeFh0CKzNrJhLedtIEsJnvnQl2gBmnjRp6uvv4TfayGxWrDXYJGeZqPcbbPR0FnGojoz6wHTbWruFmJ3eOv74wpNDA-AX3wBB8H4mJ2CdlmYZ3xSQ_YoWArR-RYZqRmCN9prMI May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_18f99b77f9e34a708b316df95c6e31ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 18f99b77f9e34a708b316df95c6e31ac May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1482885467 May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7af7b7c9996044f89da29f78f2ce9d40 May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1482885467-project May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-179683446", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 2.5}} May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-179683446', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'min_count': 2.5}}} May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 2.5 May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:41:03.102571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2a68de8-79a0-443f-b392-511584d45117 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:03.107775 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2a68de8-79a0-443f-b392-511584d45117 tempest-MultipleCreateNegativeTestJSON-1482885467 tempest-MultipleCreateNegativeTestJSON-1482885467-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008427 May 19 04:41:03.111556 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1185/2435] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:41:03.206413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b827bab-f5e5-4c96-bb56-93e9bf6fad66 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:03.208497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b827bab-f5e5-4c96-bb56-93e9bf6fad66 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:03.238255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b827bab-f5e5-4c96-bb56-93e9bf6fad66 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:03.238736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b827bab-f5e5-4c96-bb56-93e9bf6fad66 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:03.242667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b827bab-f5e5-4c96-bb56-93e9bf6fad66 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:03.243498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b827bab-f5e5-4c96-bb56-93e9bf6fad66 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:03.331433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b827bab-f5e5-4c96-bb56-93e9bf6fad66 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131582 May 19 04:41:03.333289 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1186/2436] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:03 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:03.547914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a2ea4856-913f-4765-a38e-e557a62c2296 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:03.549500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a2ea4856-913f-4765-a38e-e557a62c2296 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:03.558181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2ea4856-913f-4765-a38e-e557a62c2296 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:03.558922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2ea4856-913f-4765-a38e-e557a62c2296 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:03.560554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2ea4856-913f-4765-a38e-e557a62c2296 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:03.561378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2ea4856-913f-4765-a38e-e557a62c2296 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:03.588154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:03.607347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:03.624010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:03.641455 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1a671118-c79d-406a-b36f-80609c936232 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.574089 May 19 04:41:03.642543 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1251/2437] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:03 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:03.654046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f009dc02-fdec-4420-aa84-e0c927f0abc9 req-fdbdd058-f977-4cd3-a0bf-afb933dc604a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a73785c-f5e6-40ba-a07f-4a385e57a0dd", "tag": "ff46de4a-5688-469b-9504-e82ae8240d7d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:03.669048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f009dc02-fdec-4420-aa84-e0c927f0abc9 req-fdbdd058-f977-4cd3-a0bf-afb933dc604a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:03.669962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f009dc02-fdec-4420-aa84-e0c927f0abc9 req-fdbdd058-f977-4cd3-a0bf-afb933dc604a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:03.685156 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f009dc02-fdec-4420-aa84-e0c927f0abc9 req-fdbdd058-f977-4cd3-a0bf-afb933dc604a service nova] Creating event network-changed:ff46de4a-5688-469b-9504-e82ae8240d7d for instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd on n-h1-766726-30 May 19 04:41:03.690312 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f009dc02-fdec-4420-aa84-e0c927f0abc9 req-fdbdd058-f977-4cd3-a0bf-afb933dc604a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044042 May 19 04:41:03.690991 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1252/2438] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:03.696887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db1f200c-21a4-45b3-b74f-faac0865024f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:03.697873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-db1f200c-21a4-45b3-b74f-faac0865024f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:03.705636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db1f200c-21a4-45b3-b74f-faac0865024f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:03.706502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db1f200c-21a4-45b3-b74f-faac0865024f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:03.707493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db1f200c-21a4-45b3-b74f-faac0865024f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:03.708127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db1f200c-21a4-45b3-b74f-faac0865024f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:04.143042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a2ea4856-913f-4765-a38e-e557a62c2296 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:04.155115 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a2ea4856-913f-4765-a38e-e557a62c2296 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1313 microversion: 2.1 time: 0.613046 May 19 04:41:04.156424 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1187/2439] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:03 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:04.187294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-db1f200c-21a4-45b3-b74f-faac0865024f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:04.201716 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-db1f200c-21a4-45b3-b74f-faac0865024f tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1325 microversion: 2.1 time: 0.509196 May 19 04:41:04.203174 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1253/2440] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:03 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:04.255891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-fea365ca-782e-44ad-b53b-0905f89a911b req-3ad4c15b-2573-4825-b772-010719715dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-plugged", "status": "completed", "tag": "8dc19ac8-4427-4f73-aaa7-05481bc13e94"}, {"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-plugged", "status": "completed", "tag": "ae40130a-66c8-4231-8905-bf545db96c13"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:04.269252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fea365ca-782e-44ad-b53b-0905f89a911b req-3ad4c15b-2573-4825-b772-010719715dfa service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:04.270050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fea365ca-782e-44ad-b53b-0905f89a911b req-3ad4c15b-2573-4825-b772-010719715dfa service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:04.286093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-fea365ca-782e-44ad-b53b-0905f89a911b req-3ad4c15b-2573-4825-b772-010719715dfa service nova] Creating event network-vif-plugged:8dc19ac8-4427-4f73-aaa7-05481bc13e94 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:41:04.286887 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-fea365ca-782e-44ad-b53b-0905f89a911b req-3ad4c15b-2573-4825-b772-010719715dfa service nova] Creating event network-vif-plugged:ae40130a-66c8-4231-8905-bf545db96c13 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:41:04.293573 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-fea365ca-782e-44ad-b53b-0905f89a911b req-3ad4c15b-2573-4825-b772-010719715dfa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042718 May 19 04:41:04.294531 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1188/2441] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:04.343774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-10d1a296-17ef-4caa-b677-bd4611f70803 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:04.344718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-10d1a296-17ef-4caa-b677-bd4611f70803 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:04.351945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10d1a296-17ef-4caa-b677-bd4611f70803 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:04.352389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10d1a296-17ef-4caa-b677-bd4611f70803 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:04.353202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10d1a296-17ef-4caa-b677-bd4611f70803 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:04.353640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10d1a296-17ef-4caa-b677-bd4611f70803 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:04.393261 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-10d1a296-17ef-4caa-b677-bd4611f70803 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053604 May 19 04:41:04.395034 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1254/2442] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:04 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:04.664084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:04.664956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:04.682522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:04.682985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:04.688088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:04.688933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:04.699877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:04.950679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:04.966391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:04.968997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:04.971378 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4d9652b5-141c-4e5a-8540-ee36d85f00aa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1879 microversion: 2.42 time: 0.313442 May 19 04:41:04.973315 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1189/2443] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:04 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1879 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:41:05.173492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aaff0141-a084-4f06-9c5f-36a10879ff93 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:05.174233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aaff0141-a084-4f06-9c5f-36a10879ff93 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:05.182267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaff0141-a084-4f06-9c5f-36a10879ff93 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:05.182802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaff0141-a084-4f06-9c5f-36a10879ff93 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:05.183788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaff0141-a084-4f06-9c5f-36a10879ff93 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:05.184445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aaff0141-a084-4f06-9c5f-36a10879ff93 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:05.221202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-65d2832f-bcac-4e92-9634-df99294b2a9b tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:05.222052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-65d2832f-bcac-4e92-9634-df99294b2a9b tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:05.233383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65d2832f-bcac-4e92-9634-df99294b2a9b tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:05.235357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65d2832f-bcac-4e92-9634-df99294b2a9b tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:05.237313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65d2832f-bcac-4e92-9634-df99294b2a9b tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:05.240574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65d2832f-bcac-4e92-9634-df99294b2a9b tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:05.519650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aaff0141-a084-4f06-9c5f-36a10879ff93 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:05.528651 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aaff0141-a084-4f06-9c5f-36a10879ff93 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1313 microversion: 2.1 time: 0.359216 May 19 04:41:05.529265 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1255/2444] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:05 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:05.549459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da925674-64c3-4d88-a0b5-e38369e293bb tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:05.550462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da925674-64c3-4d88-a0b5-e38369e293bb tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:05.570444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da925674-64c3-4d88-a0b5-e38369e293bb tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:05.575588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da925674-64c3-4d88-a0b5-e38369e293bb tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:05.576721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da925674-64c3-4d88-a0b5-e38369e293bb tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:05.577197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da925674-64c3-4d88-a0b5-e38369e293bb tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:05.614228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-65d2832f-bcac-4e92-9634-df99294b2a9b tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:05.632430 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-65d2832f-bcac-4e92-9634-df99294b2a9b tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1325 microversion: 2.1 time: 0.416376 May 19 04:41:05.635403 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1190/2445] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:05 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1325 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:05.667104 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da925674-64c3-4d88-a0b5-e38369e293bb tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123291 May 19 04:41:05.667983 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1256/2446] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:05 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:05.876514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ff09225-9304-4efa-8710-1197e8987ba1 tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] Calling method '.version_select at 0x7fd315e92e50>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:05.936520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-197881614", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": "none"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:05.966777 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ff09225-9304-4efa-8710-1197e8987ba1 tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca/defaults" status: 200 len: 371 microversion: 2.1 time: 0.166804 May 19 04:41:05.968166 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1257/2447] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:41:05 2022] GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca/defaults => generated 371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:41:05.978556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88bec501-6a8c-4dfb-a046-9167e0f696e3 tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] Calling method '.version_select at 0x7fd315f49ee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:06.036426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:41:06.037141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:41:06.038073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:41:06.038708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:41:06.039411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:41:06.050605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:06.051427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:06.052677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:06.053519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:06.076019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Getting quotas for project 00560f861f494a5a854aa84c36ceac81. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:06.082963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Getting quotas for user 45761241325a4e1a865e0ba69d0bc451 and project 00560f861f494a5a854aa84c36ceac81. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:06.087317 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88bec501-6a8c-4dfb-a046-9167e0f696e3 tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca" status: 200 len: 371 microversion: 2.1 time: 0.112402 May 19 04:41:06.094168 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1258/2448] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 04:41:05 2022] GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:41:06.100951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:06.102669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:06.114262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:41:06.114699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:06.115157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:06.118251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:41:06.118461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:06.119545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:06.178264 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1426f840-47e6-4256-9ad4-7ce0b0a2d763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.541080 May 19 04:41:06.180532 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1191/2449] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:41:06.186923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2abd5d55-8e3b-4328-b7ac-bcf1ed46de10 tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] Calling method '.version_select at 0x7fd31b7b6c10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:06.261713 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2abd5d55-8e3b-4328-b7ac-bcf1ed46de10 tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca/defaults" status: 200 len: 371 microversion: 2.1 time: 0.079545 May 19 04:41:06.263396 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1192/2450] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:41:06 2022] GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca/defaults => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:06.269643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d530b0a8-e9fe-46f3-b6f5-82eddf5dfa67 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:06.270717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d530b0a8-e9fe-46f3-b6f5-82eddf5dfa67 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:06.435233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d530b0a8-e9fe-46f3-b6f5-82eddf5dfa67 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:06.446688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d530b0a8-e9fe-46f3-b6f5-82eddf5dfa67 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:06.448378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d530b0a8-e9fe-46f3-b6f5-82eddf5dfa67 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:06.449802 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d530b0a8-e9fe-46f3-b6f5-82eddf5dfa67 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1277 microversion: 2.57 time: 0.185241 May 19 04:41:06.451057 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1193/2451] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:06 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:06.468650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30a2bb1f-7db6-48c9-ad78-658d5d34268a tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] Calling method '.version_select at 0x7fd31b828af0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:06.562019 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-30a2bb1f-7db6-48c9-ad78-658d5d34268a tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca" status: 200 len: 371 microversion: 2.1 time: 0.097505 May 19 04:41:06.563069 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1194/2452] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 04:41:06 2022] GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:06.575706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-56424243-5051-435b-b816-d2493f290d8d req-6539aee6-a157-41c6-b9ef-d1e97c8469c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76be18c3-93a7-4cf3-81ff-05956bb3bce2", "name": "network-vif-plugged", "status": "completed", "tag": "f5734274-cd30-436c-836d-82643814bc02"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:06.585198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-56424243-5051-435b-b816-d2493f290d8d req-6539aee6-a157-41c6-b9ef-d1e97c8469c9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:06.585982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-56424243-5051-435b-b816-d2493f290d8d req-6539aee6-a157-41c6-b9ef-d1e97c8469c9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:06.599156 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-56424243-5051-435b-b816-d2493f290d8d req-6539aee6-a157-41c6-b9ef-d1e97c8469c9 service nova] Creating event network-vif-plugged:f5734274-cd30-436c-836d-82643814bc02 for instance 76be18c3-93a7-4cf3-81ff-05956bb3bce2 on n-h1-766726-30 May 19 04:41:06.609215 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-56424243-5051-435b-b816-d2493f290d8d req-6539aee6-a157-41c6-b9ef-d1e97c8469c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044802 May 19 04:41:06.610259 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1195/2453] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:06.627949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0aba9fdf-abd6-4f53-845c-007f5095f1ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:06.634639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0aba9fdf-abd6-4f53-845c-007f5095f1ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:06.643937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:06.655808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aba9fdf-abd6-4f53-845c-007f5095f1ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:06.656595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aba9fdf-abd6-4f53-845c-007f5095f1ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:06.657982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aba9fdf-abd6-4f53-845c-007f5095f1ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:06.658614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aba9fdf-abd6-4f53-845c-007f5095f1ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:06.673910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:06.675785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:06.677497 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-06b0134f-f8c2-4666-bd3a-7e70708521c1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2836 microversion: 2.42 time: 0.582154 May 19 04:41:06.683092 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1259/2454] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:06 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2836 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:06.693851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09e326c6-052e-4d3d-9c20-18a2a314a5e6 tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] Calling method '.version_select at 0x7fd315df2790>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:06.816827 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-09e326c6-052e-4d3d-9c20-18a2a314a5e6 tempest-QuotasTestJSON-2040606665 tempest-QuotasTestJSON-2040606665-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca?user_id=38330010a2bb42cfbbf5836ed68f4954" status: 200 len: 371 microversion: 2.1 time: 0.132386 May 19 04:41:06.817469 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1260/2455] 10.222.0.58 () {58 vars in 1322 bytes} [Thu May 19 04:41:06 2022] GET /compute/v2.1/os-quota-sets/189b6ff85a224a4aae8ab1df66556eca?user_id=38330010a2bb42cfbbf5836ed68f4954 => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:06.825971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-392feee0-7c34-4155-964e-afd96c434c0e tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:06.827020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-392feee0-7c34-4155-964e-afd96c434c0e tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:06.836210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-392feee0-7c34-4155-964e-afd96c434c0e tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:06.836580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-392feee0-7c34-4155-964e-afd96c434c0e tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:06.837839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-392feee0-7c34-4155-964e-afd96c434c0e tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:06.838572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-392feee0-7c34-4155-964e-afd96c434c0e tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:07.374814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:07.516696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0aba9fdf-abd6-4f53-845c-007f5095f1ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:07.531377 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0aba9fdf-abd6-4f53-845c-007f5095f1ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1313 microversion: 2.1 time: 0.915358 May 19 04:41:07.532032 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1196/2456] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:06 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:07.537353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-094dd8fb-9477-4e7d-a3ec-2462f8079381 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:07.542025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-094dd8fb-9477-4e7d-a3ec-2462f8079381 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:07.562408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-094dd8fb-9477-4e7d-a3ec-2462f8079381 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:07.563430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-094dd8fb-9477-4e7d-a3ec-2462f8079381 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:07.566435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-094dd8fb-9477-4e7d-a3ec-2462f8079381 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:07.567158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-094dd8fb-9477-4e7d-a3ec-2462f8079381 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:07.591758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-392feee0-7c34-4155-964e-afd96c434c0e tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:07.611023 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-392feee0-7c34-4155-964e-afd96c434c0e tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1325 microversion: 2.1 time: 0.785206 May 19 04:41:07.612715 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1261/2457] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:06 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1325 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:07.625035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8d4c7de1-4389-410f-96a8-2cba33ce4114 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:07.625571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8d4c7de1-4389-410f-96a8-2cba33ce4114 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:07.628436 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-094dd8fb-9477-4e7d-a3ec-2462f8079381 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095076 May 19 04:41:07.629115 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1197/2458] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:07 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:07.635082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:07.635945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:07.642027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d4c7de1-4389-410f-96a8-2cba33ce4114 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:07.642508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d4c7de1-4389-410f-96a8-2cba33ce4114 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:07.642949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:07.643305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d4c7de1-4389-410f-96a8-2cba33ce4114 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:07.643756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d4c7de1-4389-410f-96a8-2cba33ce4114 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:07.644058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:07.645033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:07.646262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:07.795087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:07.806881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:07.808951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:07.810578 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bc7c80e5-9ea5-4ff5-a17d-9f76ce981763 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1329 microversion: 2.57 time: 0.179844 May 19 04:41:07.811163 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1198/2459] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:07 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1329 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:07.846464 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8d4c7de1-4389-410f-96a8-2cba33ce4114 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.231063 May 19 04:41:07.848070 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1262/2460] 10.222.0.58 () {60 vars in 1315 bytes} [Thu May 19 04:41:07 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3/os-interface => generated 1831 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:08.550333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c32fb66-32c3-4707-ba06-a4e7d7829a48 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:08.553691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c32fb66-32c3-4707-ba06-a4e7d7829a48 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:08.561280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c32fb66-32c3-4707-ba06-a4e7d7829a48 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:08.561953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c32fb66-32c3-4707-ba06-a4e7d7829a48 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:08.563181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c32fb66-32c3-4707-ba06-a4e7d7829a48 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:08.563888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c32fb66-32c3-4707-ba06-a4e7d7829a48 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:08.634868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6f78fb03-0876-4556-8383-0bcdc438854d tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:08.636701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6f78fb03-0876-4556-8383-0bcdc438854d tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:08.647816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f78fb03-0876-4556-8383-0bcdc438854d tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:08.648539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f78fb03-0876-4556-8383-0bcdc438854d tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:08.651407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f78fb03-0876-4556-8383-0bcdc438854d tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:08.653666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f78fb03-0876-4556-8383-0bcdc438854d tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:08.881836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c32fb66-32c3-4707-ba06-a4e7d7829a48 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:08.892991 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c32fb66-32c3-4707-ba06-a4e7d7829a48 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1313 microversion: 2.1 time: 0.348794 May 19 04:41:08.894427 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1199/2461] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:08 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:08.908599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1785a47b-88d4-46bb-8ab6-4b3c9b7a5b88 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:08.909908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1785a47b-88d4-46bb-8ab6-4b3c9b7a5b88 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:08.921144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1785a47b-88d4-46bb-8ab6-4b3c9b7a5b88 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:08.922022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1785a47b-88d4-46bb-8ab6-4b3c9b7a5b88 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:08.923022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1785a47b-88d4-46bb-8ab6-4b3c9b7a5b88 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:08.923727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1785a47b-88d4-46bb-8ab6-4b3c9b7a5b88 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:08.962133 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1785a47b-88d4-46bb-8ab6-4b3c9b7a5b88 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063748 May 19 04:41:08.963115 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1200/2462] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:08 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:08.969666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:08.970663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:08.974049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6f78fb03-0876-4556-8383-0bcdc438854d tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:08.980912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:08.981680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:08.982516 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6f78fb03-0876-4556-8383-0bcdc438854d tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1522 microversion: 2.1 time: 0.357225 May 19 04:41:08.983417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:08.983766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:08.988447 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1263/2463] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:08 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:09.008653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:09.009546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:09.017473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.018642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.020725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.021835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.057450 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] HTTP exception thrown: Action 999 not found May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Request method failure captured: May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2/os-instance-actions/999 HTTP/1.1 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpSs0mKCuGQWTfy8vqN0eR6ppMSB5pzE8XA9ONYjsP1afNPq_Mt788AsjcOfHRBKgU56U-t_DzU1IdLm8bMUecpFlvubnOuGX1FHJo4Z17ipE_x9L2bC92IB_2KHKawQIgR3VNDXY85dSbRG8ciGHyFw1ZeiYeU9IWfMy1uAO7MR74 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 9326a3ab36f0429ab18ba9e6ab0fa687 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1752279945 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1752279945 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 9326a3ab36f0429ab18ba9e6ab0fa687 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1752279945 May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-InstanceActionsNegativeTestJSON-1752279945-project May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 536d76934fe64cdfa8817c11fd8367eb May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1752279945-project May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: exception: Action 999 not found May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'server_id': '76be18c3-93a7-4cf3-81ff-05956bb3bce2', 'id': '999'} May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found May 19 04:41:09.062300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:09.066489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Returning 404 to user: Action 999 not found {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:09.067762 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e9e6f21a-e8d8-4acf-84d1-7376ed6693f4 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.064072 May 19 04:41:09.073671 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1264/2464] 10.222.0.58 () {58 vars in 1307 bytes} [Thu May 19 04:41:09 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2/os-instance-actions/999 => generated 66 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:41:09.079076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3456af0f-e5f6-4606-b6b4-710cbbc1cc96 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '.version_select at 0x7fd315df79d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:09.079836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3456af0f-e5f6-4606-b6b4-710cbbc1cc96 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 88d67c97-ea16-4508-a6e0-797e1f5c7c04] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:09.086591 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-3456af0f-e5f6-4606-b6b4-710cbbc1cc96 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] HTTP exception thrown: Instance 88d67c97-ea16-4508-a6e0-797e1f5c7c04 could not be found. May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3456af0f-e5f6-4606-b6b4-710cbbc1cc96 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Request method failure captured: May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/88d67c97-ea16-4508-a6e0-797e1f5c7c04/os-instance-actions HTTP/1.1 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpSs0mKCuGQWTfy8vqN0eR6ppMSB5pzE8XA9ONYjsP1afNPq_Mt788AsjcOfHRBKgU56U-t_DzU1IdLm8bMUecpFlvubnOuGX1FHJo4Z17ipE_x9L2bC92IB_2KHKawQIgR3VNDXY85dSbRG8ciGHyFw1ZeiYeU9IWfMy1uAO7MR74 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 9326a3ab36f0429ab18ba9e6ab0fa687 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1752279945 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1752279945 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 9326a3ab36f0429ab18ba9e6ab0fa687 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1752279945 May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-InstanceActionsNegativeTestJSON-1752279945-project May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 536d76934fe64cdfa8817c11fd8367eb May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1752279945-project May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 88d67c97-ea16-4508-a6e0-797e1f5c7c04 could not be found. May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'server_id': '88d67c97-ea16-4508-a6e0-797e1f5c7c04'} May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d67c97-ea16-4508-a6e0-797e1f5c7c04 could not be found. May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:41:09.088379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d67c97-ea16-4508-a6e0-797e1f5c7c04 could not be found. May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d67c97-ea16-4508-a6e0-797e1f5c7c04 could not be found. May 19 04:41:09.091528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:09.093271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3456af0f-e5f6-4606-b6b4-710cbbc1cc96 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Returning 404 to user: Instance 88d67c97-ea16-4508-a6e0-797e1f5c7c04 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:09.094381 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3456af0f-e5f6-4606-b6b4-710cbbc1cc96 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/88d67c97-ea16-4508-a6e0-797e1f5c7c04/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.019493 May 19 04:41:09.095179 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1265/2465] 10.222.0.58 () {58 vars in 1295 bytes} [Thu May 19 04:41:09 2022] GET /compute/v2.1/servers/88d67c97-ea16-4508-a6e0-797e1f5c7c04/os-instance-actions => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:41:09.104420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82acc519-62a4-4de5-bb15-35fa927d9a23 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:09.105110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82acc519-62a4-4de5-bb15-35fa927d9a23 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:09.112426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82acc519-62a4-4de5-bb15-35fa927d9a23 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.113147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82acc519-62a4-4de5-bb15-35fa927d9a23 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.114060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82acc519-62a4-4de5-bb15-35fa927d9a23 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.114649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82acc519-62a4-4de5-bb15-35fa927d9a23 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.150318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82acc519-62a4-4de5-bb15-35fa927d9a23 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:41:09.174369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:09.187927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:09.191560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:09.198011 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-37ebf864-14ef-4e76-8147-579bd8a5c247 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1335 microversion: 2.57 time: 0.233531 May 19 04:41:09.199621 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1201/2466] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:08 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1335 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:09.221466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:09.281682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a0e9a010-b63b-4609-b06f-fb3cfd056466 req-b3242e3a-c504-446c-9a1d-f63e19884875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "tag": "11827578-b39a-4078-b09c-f790673f88b0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:09.290657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a0e9a010-b63b-4609-b06f-fb3cfd056466 req-b3242e3a-c504-446c-9a1d-f63e19884875 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.291237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a0e9a010-b63b-4609-b06f-fb3cfd056466 req-b3242e3a-c504-446c-9a1d-f63e19884875 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.292106 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82acc519-62a4-4de5-bb15-35fa927d9a23 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "DELETE /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 204 len: 0 microversion: 2.1 time: 0.191244 May 19 04:41:09.292891 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1266/2467] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:41:09 2022] DELETE /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:41:09.302739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ae6e420c-70aa-446f-bd15-0354ef9b9b94 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:09.303468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ae6e420c-70aa-446f-bd15-0354ef9b9b94 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:09.308232 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a0e9a010-b63b-4609-b06f-fb3cfd056466 req-b3242e3a-c504-446c-9a1d-f63e19884875 service nova] Creating event network-changed:11827578-b39a-4078-b09c-f790673f88b0 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:41:09.314923 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a0e9a010-b63b-4609-b06f-fb3cfd056466 req-b3242e3a-c504-446c-9a1d-f63e19884875 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037216 May 19 04:41:09.315610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae6e420c-70aa-446f-bd15-0354ef9b9b94 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.316069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae6e420c-70aa-446f-bd15-0354ef9b9b94 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.317558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae6e420c-70aa-446f-bd15-0354ef9b9b94 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.318066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae6e420c-70aa-446f-bd15-0354ef9b9b94 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.318604 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1202/2468] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:41:09.439356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:09.440395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:09.455387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.456126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.457179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.457806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.564354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ae6e420c-70aa-446f-bd15-0354ef9b9b94 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:09.575879 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ae6e420c-70aa-446f-bd15-0354ef9b9b94 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1528 microversion: 2.1 time: 0.278414 May 19 04:41:09.577229 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1267/2469] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:09 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1528 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:09.846791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:09.860252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:09.865137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:09.869473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c815ad49-95be-4b20-b617-5a732a3b28f1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2938 microversion: 2.32 time: 0.433557 May 19 04:41:09.870195 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1203/2470] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:09 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2938 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:09.895805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e5b4f22-838c-44e1-b4c5-3af5b25398ea tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:09.897512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3e5b4f22-838c-44e1-b4c5-3af5b25398ea tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:09.905961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e5b4f22-838c-44e1-b4c5-3af5b25398ea tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.913357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd9ea0fc-36fb-4b29-b868-132a19d0a1e9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:09.914789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bd9ea0fc-36fb-4b29-b868-132a19d0a1e9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:09.923704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e5b4f22-838c-44e1-b4c5-3af5b25398ea tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.925060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e5b4f22-838c-44e1-b4c5-3af5b25398ea tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.928035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e5b4f22-838c-44e1-b4c5-3af5b25398ea tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.932303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd9ea0fc-36fb-4b29-b868-132a19d0a1e9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.933006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd9ea0fc-36fb-4b29-b868-132a19d0a1e9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:09.934967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd9ea0fc-36fb-4b29-b868-132a19d0a1e9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:09.939148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd9ea0fc-36fb-4b29-b868-132a19d0a1e9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:10.273848 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3e5b4f22-838c-44e1-b4c5-3af5b25398ea tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c/os-interface" status: 200 len: 1827 microversion: 2.32 time: 0.382601 May 19 04:41:10.286932 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1268/2471] 10.222.0.58 () {60 vars in 1315 bytes} [Thu May 19 04:41:09 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c/os-interface => generated 1827 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:10.295150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3500e9ba-0263-4c0a-bb16-ce846361ee22 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:10.299353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3500e9ba-0263-4c0a-bb16-ce846361ee22 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:10.315351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3500e9ba-0263-4c0a-bb16-ce846361ee22 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:10.316520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3500e9ba-0263-4c0a-bb16-ce846361ee22 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:10.317486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3500e9ba-0263-4c0a-bb16-ce846361ee22 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:10.317931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3500e9ba-0263-4c0a-bb16-ce846361ee22 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:10.385620 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3500e9ba-0263-4c0a-bb16-ce846361ee22 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096807 May 19 04:41:10.389658 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1269/2472] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:10 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:10.395694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:10.396373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:10.412501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:10.412951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:10.414293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:10.414731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:10.587053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:10.600864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bd9ea0fc-36fb-4b29-b868-132a19d0a1e9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:10.603651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:10.605415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:10.606255 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-316293da-3c1f-4d41-8295-6462484b7e04 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1335 microversion: 2.57 time: 0.215590 May 19 04:41:10.607134 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1270/2473] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:10 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1335 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:10.611421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c265de22-3ede-4317-a5f6-09ab0242625c req-7250fbd3-51c1-4460-82e5-5b792dcc96bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a73785c-f5e6-40ba-a07f-4a385e57a0dd", "name": "network-vif-plugged", "status": "completed", "tag": "ff46de4a-5688-469b-9504-e82ae8240d7d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:10.612625 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd9ea0fc-36fb-4b29-b868-132a19d0a1e9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1313 microversion: 2.1 time: 0.703016 May 19 04:41:10.616429 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1204/2474] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:09 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:10.632920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c265de22-3ede-4317-a5f6-09ab0242625c req-7250fbd3-51c1-4460-82e5-5b792dcc96bb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:10.633391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c265de22-3ede-4317-a5f6-09ab0242625c req-7250fbd3-51c1-4460-82e5-5b792dcc96bb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:10.635798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d5780aa-49a2-45e6-9b40-c26e6f079d1a tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:10.640152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2d5780aa-49a2-45e6-9b40-c26e6f079d1a tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:10.653483 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c265de22-3ede-4317-a5f6-09ab0242625c req-7250fbd3-51c1-4460-82e5-5b792dcc96bb service nova] Creating event network-vif-plugged:ff46de4a-5688-469b-9504-e82ae8240d7d for instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd on n-h1-766726-30 May 19 04:41:10.655226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d5780aa-49a2-45e6-9b40-c26e6f079d1a tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:10.657238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d5780aa-49a2-45e6-9b40-c26e6f079d1a tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:10.660574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d5780aa-49a2-45e6-9b40-c26e6f079d1a tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:10.661255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d5780aa-49a2-45e6-9b40-c26e6f079d1a tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:10.677252 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c265de22-3ede-4317-a5f6-09ab0242625c req-7250fbd3-51c1-4460-82e5-5b792dcc96bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068791 May 19 04:41:10.678165 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1271/2475] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:10.930679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d5780aa-49a2-45e6-9b40-c26e6f079d1a tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:10.945626 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d5780aa-49a2-45e6-9b40-c26e6f079d1a tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1528 microversion: 2.1 time: 0.326023 May 19 04:41:10.979038 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1205/2476] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:10 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1528 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:11.402800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2047cb8b-ef83-468b-b55b-22acf4a377f8 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:11.404632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2047cb8b-ef83-468b-b55b-22acf4a377f8 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:11.421093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2047cb8b-ef83-468b-b55b-22acf4a377f8 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:11.421830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2047cb8b-ef83-468b-b55b-22acf4a377f8 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:11.422774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2047cb8b-ef83-468b-b55b-22acf4a377f8 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:11.423323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2047cb8b-ef83-468b-b55b-22acf4a377f8 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:11.494436 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2047cb8b-ef83-468b-b55b-22acf4a377f8 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099902 May 19 04:41:11.499959 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1272/2477] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:11 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:11.625738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:11.626624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:11.634987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:11.635255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0740e196-41b9-4101-a2b7-c3e858525bdd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:11.635799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0740e196-41b9-4101-a2b7-c3e858525bdd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:11.638692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:11.639664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:11.646346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:11.647048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0740e196-41b9-4101-a2b7-c3e858525bdd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:11.649177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0740e196-41b9-4101-a2b7-c3e858525bdd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:11.653434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0740e196-41b9-4101-a2b7-c3e858525bdd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:11.654013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0740e196-41b9-4101-a2b7-c3e858525bdd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:11.868741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:11.884372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:11.890061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:11.895424 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-39c0ca59-f552-4d39-98b6-1fef50b0b203 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1335 microversion: 2.57 time: 0.273912 May 19 04:41:11.896832 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1206/2478] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:11 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1335 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:11.963016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5974b6b9-2b0a-4da5-936d-3c3bcaa1d7c3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:11.964493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5974b6b9-2b0a-4da5-936d-3c3bcaa1d7c3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:11.974163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5974b6b9-2b0a-4da5-936d-3c3bcaa1d7c3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:11.977063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5974b6b9-2b0a-4da5-936d-3c3bcaa1d7c3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:11.984616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5974b6b9-2b0a-4da5-936d-3c3bcaa1d7c3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:11.987650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5974b6b9-2b0a-4da5-936d-3c3bcaa1d7c3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:12.171792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5974b6b9-2b0a-4da5-936d-3c3bcaa1d7c3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:12.184932 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5974b6b9-2b0a-4da5-936d-3c3bcaa1d7c3 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1486 microversion: 2.1 time: 0.226200 May 19 04:41:12.186944 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1207/2479] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:11 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1486 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:12.255654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0cbaf9c9-12ea-4f12-a874-f8575f87a920 req-8a46f1d8-8951-4877-bbea-35580cb2803d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76be18c3-93a7-4cf3-81ff-05956bb3bce2", "name": "network-vif-deleted", "tag": "f5734274-cd30-436c-836d-82643814bc02"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:12.271327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0cbaf9c9-12ea-4f12-a874-f8575f87a920 req-8a46f1d8-8951-4877-bbea-35580cb2803d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:12.272159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0cbaf9c9-12ea-4f12-a874-f8575f87a920 req-8a46f1d8-8951-4877-bbea-35580cb2803d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:12.312978 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0cbaf9c9-12ea-4f12-a874-f8575f87a920 req-8a46f1d8-8951-4877-bbea-35580cb2803d service nova] Creating event network-vif-deleted:f5734274-cd30-436c-836d-82643814bc02 for instance 76be18c3-93a7-4cf3-81ff-05956bb3bce2 on n-h1-766726-30 May 19 04:41:12.319223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0740e196-41b9-4101-a2b7-c3e858525bdd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:12.326547 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0cbaf9c9-12ea-4f12-a874-f8575f87a920 req-8a46f1d8-8951-4877-bbea-35580cb2803d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073699 May 19 04:41:12.331931 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1208/2480] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:12.340293 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0740e196-41b9-4101-a2b7-c3e858525bdd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1313 microversion: 2.1 time: 0.711482 May 19 04:41:12.341239 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1273/2481] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:11 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:12.508320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b55b77ce-685b-491b-9b87-a4d9a050944a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:12.509823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b55b77ce-685b-491b-9b87-a4d9a050944a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:12.518501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b55b77ce-685b-491b-9b87-a4d9a050944a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:12.519614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b55b77ce-685b-491b-9b87-a4d9a050944a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:12.520694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b55b77ce-685b-491b-9b87-a4d9a050944a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:12.521537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b55b77ce-685b-491b-9b87-a4d9a050944a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:12.645141 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b55b77ce-685b-491b-9b87-a4d9a050944a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141584 May 19 04:41:12.645808 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1209/2482] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:12 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:12.917811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:12.918620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:12.939105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:12.940628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:12.942496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:12.943469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.168502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:13.183479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:13.186508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:13.187741 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d920660f-8df4-495a-bf51-9486f098cf18 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1356 microversion: 2.57 time: 0.277158 May 19 04:41:13.206448 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1274/2483] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:12 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1356 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:13.211043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:13.211870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:13.217961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:13.220585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:13.223869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.225277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.228605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.229377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.230827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.231511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.232118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.232594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.301554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:13.307984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.308633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.310059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lazy-loading 'fault' on Instance uuid 76be18c3-93a7-4cf3-81ff-05956bb3bce2 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:41:13.407458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '536d76934fe64cdfa8817c11fd8367eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9326a3ab36f0429ab18ba9e6ab0fa687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:13.414330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:41:13.415125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:41:13.415780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:41:13.416348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:41:13.416917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:41:13.419009 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d13a57b7-d443-42a5-9ab1-81835c6e17ed tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 200 len: 1315 microversion: 2.1 time: 0.209908 May 19 04:41:13.428971 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1210/2484] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:13 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:13.434935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9111b884-9930-4cab-b2bb-d9449abb0f60 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:13.435774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9111b884-9930-4cab-b2bb-d9449abb0f60 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:13.442614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9111b884-9930-4cab-b2bb-d9449abb0f60 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.443305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9111b884-9930-4cab-b2bb-d9449abb0f60 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.444240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9111b884-9930-4cab-b2bb-d9449abb0f60 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.445402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9111b884-9930-4cab-b2bb-d9449abb0f60 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.492883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:13.554522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:13.563409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.563871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.570601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.571065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.640678 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-83e3f1fe-c2d7-4513-be40-44bd9765723c tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "POST /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f/action" status: 202 len: 1137 microversion: 2.57 time: 0.432825 May 19 04:41:13.645337 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1275/2485] 10.222.0.58 () {62 vars in 1319 bytes} [Thu May 19 04:41:13 2022] POST /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f/action => generated 1137 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 19 04:41:13.658039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b6b4c904-f6da-4dbd-b6a4-e156616483b1 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:13.659286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b6b4c904-f6da-4dbd-b6a4-e156616483b1 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:13.671460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6b4c904-f6da-4dbd-b6a4-e156616483b1 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.672252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6b4c904-f6da-4dbd-b6a4-e156616483b1 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.673290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6b4c904-f6da-4dbd-b6a4-e156616483b1 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.673996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6b4c904-f6da-4dbd-b6a4-e156616483b1 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.740331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b6b4c904-f6da-4dbd-b6a4-e156616483b1 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086373 May 19 04:41:13.742970 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1276/2486] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:13 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:41:13.752172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:13.752806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:13.769972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.770438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:13.771251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:13.771700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:14.070114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:14.087855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:14.094942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:14.097106 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8082040-8699-47af-bc5d-8447d541165b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.353105 May 19 04:41:14.100654 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1277/2487] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:13 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:14.257132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9111b884-9930-4cab-b2bb-d9449abb0f60 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:14.268106 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9111b884-9930-4cab-b2bb-d9449abb0f60 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1463 microversion: 2.1 time: 0.837101 May 19 04:41:14.268810 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1211/2488] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:13 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1463 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:14.436406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:14.437306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] [instance: 76be18c3-93a7-4cf3-81ff-05956bb3bce2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:14.443971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:14.453847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:14.454951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:14.455565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:14.498901 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] HTTP exception thrown: Instance 76be18c3-93a7-4cf3-81ff-05956bb3bce2 could not be found. May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Request method failure captured: May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 HTTP/1.1 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpSs0mKCuGQWTfy8vqN0eR6ppMSB5pzE8XA9ONYjsP1afNPq_Mt788AsjcOfHRBKgU56U-t_DzU1IdLm8bMUecpFlvubnOuGX1FHJo4Z17ipE_x9L2bC92IB_2KHKawQIgR3VNDXY85dSbRG8ciGHyFw1ZeiYeU9IWfMy1uAO7MR74 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 9326a3ab36f0429ab18ba9e6ab0fa687 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1752279945 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9326a3ab36f0429ab18ba9e6ab0fa687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1752279945 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 9326a3ab36f0429ab18ba9e6ab0fa687 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1752279945 May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-InstanceActionsNegativeTestJSON-1752279945-project May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 536d76934fe64cdfa8817c11fd8367eb May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1752279945-project May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 76be18c3-93a7-4cf3-81ff-05956bb3bce2 could not be found. May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '76be18c3-93a7-4cf3-81ff-05956bb3bce2'} May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76be18c3-93a7-4cf3-81ff-05956bb3bce2 could not be found. May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76be18c3-93a7-4cf3-81ff-05956bb3bce2 could not be found. May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:14.500973 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76be18c3-93a7-4cf3-81ff-05956bb3bce2 could not be found. May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] Returning 404 to user: Instance 76be18c3-93a7-4cf3-81ff-05956bb3bce2 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:14.508323 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6ac0d3ca-2946-44f7-aa80-b0321810c9b7 tempest-InstanceActionsNegativeTestJSON-1752279945 tempest-InstanceActionsNegativeTestJSON-1752279945-project] 10.222.0.58 "GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2" status: 404 len: 111 microversion: 2.1 time: 0.070015 May 19 04:41:14.509404 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1212/2489] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:14 2022] GET /compute/v2.1/servers/76be18c3-93a7-4cf3-81ff-05956bb3bce2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:41:14.783663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8aea544b-4680-4423-af84-760540acb9ad tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:14.784751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8aea544b-4680-4423-af84-760540acb9ad tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:14.794173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8aea544b-4680-4423-af84-760540acb9ad tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:14.794827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8aea544b-4680-4423-af84-760540acb9ad tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:14.796414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8aea544b-4680-4423-af84-760540acb9ad tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:14.797027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8aea544b-4680-4423-af84-760540acb9ad tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:15.118255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:15.119061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:15.129649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:15.137700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:15.140314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:15.140922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:15.402985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:15.412088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:15.415607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:15.421860 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b1fd768-d316-4697-95dd-169ef9473ae0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.308063 May 19 04:41:15.423099 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1213/2490] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:15 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:41:16.239040 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8aea544b-4680-4423-af84-760540acb9ad tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1616 microversion: 2.1 time: 1.952608 May 19 04:41:16.241126 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1278/2491] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:14 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1616 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:16.258976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:16.259741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:16.261823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=10 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:16.281751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:16.285128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:16.286891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:16.308660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:16.441964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:16.443034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:16.451611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:16.452216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:16.453491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:16.455313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:16.564965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=34 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:16.585003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:16.595053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '790c9a312d0a44afb52ec1208161e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a226680fd4709ba4faedada631836', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:16.595699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] flavor_id is None. Assuming migration. {{(pid=124819) resize /opt/stack/nova/nova/compute/api.py:4142}} May 19 04:41:16.596150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=124819) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 04:41:16.599579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:16.605246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:16.610995 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-75cbf62c-b07e-451b-a209-419404979f31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.174950 May 19 04:41:16.611915 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1279/2492] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:16 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:17.299325 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cbb0bb81-8bbb-401a-945a-1eb2373336bf tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd/action" status: 202 len: 0 microversion: 2.1 time: 1.044992 May 19 04:41:17.306325 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1214/2493] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:41:16 2022] POST /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd/action => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:41:17.308537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af873322-7e26-4b13-8c2a-998a895fa717 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:17.309680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af873322-7e26-4b13-8c2a-998a895fa717 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:17.311887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=34 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:17.331948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af873322-7e26-4b13-8c2a-998a895fa717 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:17.333615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af873322-7e26-4b13-8c2a-998a895fa717 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:17.342186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af873322-7e26-4b13-8c2a-998a895fa717 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:17.344563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af873322-7e26-4b13-8c2a-998a895fa717 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:17.620444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "88b74233-1da9-4136-b37c-c8a726dd9b13"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:17.624882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:17.639112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:17.640708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:17.643539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:17.648185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:17.770842 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] HTTP exception thrown: Volume bf977ad4-630b-4512-91eb-2767bb3ad293 could not be found. May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Request method failure captured: May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments/bf977ad4-630b-4512-91eb-2767bb3ad293 HTTP/1.1 May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 74 May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcodLP9q2r_HpKRb7ZapSoz2bvIF7hTpU_xeJWRdoIHky3oGvwFwr046UecAfKyZ4Mz--fY5C_TRikBL-hiuTOrJCdKAyJeKfKCFM6D7UHTUvNZTl_E3mW_yNTzdX3-6US8BvAd12lQd09ReWMCEzHBQAvxRwCfMKoZA_xFgK6FPFUM May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: dda442cfe23c474f93eb279f232da438 May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-VolumesAdminNegativeTest-185099497 May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dda442cfe23c474f93eb279f232da438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dda442cfe23c474f93eb279f232da438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dda442cfe23c474f93eb279f232da438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dda442cfe23c474f93eb279f232da438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-VolumesAdminNegativeTest-185099497 May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: dda442cfe23c474f93eb279f232da438 May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-185099497 May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-VolumesAdminNegativeTest-185099497-project-admin May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 9b4d2d54f3254e6fa0b134f9c3d63c3c May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-VolumesAdminNegativeTest-185099497-project-admin May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: {"volumeAttachment": {"volumeId": "88b74233-1da9-4136-b37c-c8a726dd9b13"}} May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: exception: Volume bf977ad4-630b-4512-91eb-2767bb3ad293 could not be found. May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'server_id': '3946eaf6-225d-46e4-b381-85acfabcb9d7', 'id': 'bf977ad4-630b-4512-91eb-2767bb3ad293', 'body': {'volumeAttachment': {'volumeId': '88b74233-1da9-4136-b37c-c8a726dd9b13'}}} May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf977ad4-630b-4512-91eb-2767bb3ad293 could not be found. (HTTP 404) (Request-ID: req-db490191-cf24-458a-a74b-bba55bccda94) May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:41:17.774020 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf977ad4-630b-4512-91eb-2767bb3ad293 could not be found. May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf977ad4-630b-4512-91eb-2767bb3ad293 could not be found. May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf977ad4-630b-4512-91eb-2767bb3ad293 could not be found. May 19 04:41:17.778506 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:17.786169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] Returning 404 to user: Volume bf977ad4-630b-4512-91eb-2767bb3ad293 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:17.787283 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-edf52107-e749-4e6b-85f1-91e8f5c94941 tempest-VolumesAdminNegativeTest-185099497 tempest-VolumesAdminNegativeTest-185099497-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments/bf977ad4-630b-4512-91eb-2767bb3ad293" status: 404 len: 109 microversion: 2.1 time: 0.188733 May 19 04:41:17.788086 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1215/2494] 10.222.0.58 () {60 vars in 1432 bytes} [Thu May 19 04:41:17 2022] PUT /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7/os-volume_attachments/bf977ad4-630b-4512-91eb-2767bb3ad293 => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:41:17.807833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:17.816617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:17.824384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:17.825168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:17.826332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:17.826998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:18.131708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:18.145637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:18.151230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:18.156525 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-15df1e89-c037-486a-96db-f9c5be5728e9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.366231 May 19 04:41:18.158160 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1216/2495] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:17 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:18.445597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-af873322-7e26-4b13-8c2a-998a895fa717 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:18.463801 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af873322-7e26-4b13-8c2a-998a895fa717 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1472 microversion: 2.1 time: 1.152149 May 19 04:41:18.464631 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1280/2496] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:17 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1472 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:19.171378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a802dab9-c7f1-4e57-abc4-940b5f2f7698 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: .version_select at 0x7fd31b804430>, body: {"keypair": {"name": "tempest-keypair-490828993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6eBGXRjK3gAhA32raMBa6ukLgmTG4MG3eRtvw91++vSwg17NaUHJwrNUBB5IORHbuGzETNKxSrfUrUHjG+ssLF1/bjsxaOkvGkTAlWQGBWE5kaF9aVp8xaav07yLbayQ=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:19.182119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:19.182823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:19.204761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:19.208652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:19.213068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:19.214021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:19.216711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:19.242306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a802dab9-c7f1-4e57-abc4-940b5f2f7698 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for project 0db6b7171e3b4a2db160855939246a40. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:19.279137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a802dab9-c7f1-4e57-abc4-940b5f2f7698 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for user a651109c72e84cab9e712ad5fbd002b6 and project 0db6b7171e3b4a2db160855939246a40. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:19.377554 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a802dab9-c7f1-4e57-abc4-940b5f2f7698 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.551300 May 19 04:41:19.384361 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1217/2497] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:41:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:19.494501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b68cec7-ed22-4a58-95c4-152b99f03ea1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:19.495655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5b68cec7-ed22-4a58-95c4-152b99f03ea1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:19.529271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b68cec7-ed22-4a58-95c4-152b99f03ea1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:19.530205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b68cec7-ed22-4a58-95c4-152b99f03ea1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:19.531398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b68cec7-ed22-4a58-95c4-152b99f03ea1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:19.534657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b68cec7-ed22-4a58-95c4-152b99f03ea1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:19.544494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:19.562380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:19.566428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:19.568676 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c6810571-cd21-461e-9552-c399425566f9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.391228 May 19 04:41:19.573351 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1281/2498] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:19 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:41:19.882919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5b68cec7-ed22-4a58-95c4-152b99f03ea1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:19.896101 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5b68cec7-ed22-4a58-95c4-152b99f03ea1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1472 microversion: 2.1 time: 0.417697 May 19 04:41:19.911075 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1218/2499] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:19 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1472 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:20.591058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:20.592515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:20.614525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:20.618492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:20.621680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:20.622303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:20.634121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:20.850231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:20.860281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:20.876476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:20.877885 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51e70c39-531f-415c-a2b9-3c45b98260a3 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.291715 May 19 04:41:20.894768 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1282/2500] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:20 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:20.927888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2aaf729-d4b6-439b-bd62-4b580fa29f3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:20.929875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f2aaf729-d4b6-439b-bd62-4b580fa29f3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:20.936714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1410072059", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "eeb4f4bc-6453-40b4-bc6b-2d70da95bfad"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:20.952723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2aaf729-d4b6-439b-bd62-4b580fa29f3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:20.956681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2aaf729-d4b6-439b-bd62-4b580fa29f3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:20.957812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2aaf729-d4b6-439b-bd62-4b580fa29f3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:20.958276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2aaf729-d4b6-439b-bd62-4b580fa29f3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:21.059508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] validate_networks() for [('eeb4f4bc-6453-40b4-bc6b-2d70da95bfad', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:41:22.236085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f2aaf729-d4b6-439b-bd62-4b580fa29f3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:22.251898 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2aaf729-d4b6-439b-bd62-4b580fa29f3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1472 microversion: 2.1 time: 1.335735 May 19 04:41:22.252710 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1283/2501] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:20 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1472 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:22.267164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:22.268507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:22.280661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:22.285710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:22.289852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:22.293566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:22.488011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:22.505180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:22.509997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:22.512130 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9401f915-4748-4cf9-aa8c-c2313e7847ba tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.257599 May 19 04:41:22.514171 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1284/2502] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:22 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:23.011092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:41:23.012681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:41:23.013815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:41:23.016328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:41:23.016941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:41:23.037703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:23.037703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:23.039556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:23.040087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:23.067077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Getting quotas for project cb2e6bbf06674145976cbcf25142a5db. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:23.079017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Getting quotas for user 537b978be2864cbb83c53161a6932f9f and project cb2e6bbf06674145976cbcf25142a5db. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:23.124796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:41:23.128461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:41:23.269896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac2a6694-405e-469c-a427-215ee5f2e75b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:23.271124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac2a6694-405e-469c-a427-215ee5f2e75b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:23.274610 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e787116-faac-4d30-ba78-d70e292b42bd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.482878 May 19 04:41:23.279355 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1219/2503] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:41:23.280281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac2a6694-405e-469c-a427-215ee5f2e75b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:23.280891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac2a6694-405e-469c-a427-215ee5f2e75b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:23.281912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac2a6694-405e-469c-a427-215ee5f2e75b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:23.282642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac2a6694-405e-469c-a427-215ee5f2e75b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:23.445678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1920276997", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "eeb4f4bc-6453-40b4-bc6b-2d70da95bfad"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:23.568382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] validate_networks() for [('eeb4f4bc-6453-40b4-bc6b-2d70da95bfad', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:41:23.855707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac2a6694-405e-469c-a427-215ee5f2e75b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:23.870551 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac2a6694-405e-469c-a427-215ee5f2e75b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.604328 May 19 04:41:23.873730 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1285/2504] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:23 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:23.897111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:23.898337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:23.917321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:23.918081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:23.920493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:23.921517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:24.030897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:24.045661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:24.047556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:24.050485 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8fb92fe0-9dbe-4a3b-b0c5-f6b077a9ad91 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.175313 May 19 04:41:24.053848 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1286/2505] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:23 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:24.060598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1797776336", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6598bc70-0651-4830-84b7-60a72f799274"}], "security_groups": [{"name": "tempest-securitygroup--1029272468"}], "key_name": "tempest-keypair-490828993", "user_data": "}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:24.334258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] validate_networks() for [('6598bc70-0651-4830-84b7-60a72f799274', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:41:24.465022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:41:24.465557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:41:24.465934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:41:24.467083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:41:24.467510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:41:24.499098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:24.502489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:24.504367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:24.506897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:24.541295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Getting quotas for project cb2e6bbf06674145976cbcf25142a5db. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:24.547434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Getting quotas for user 537b978be2864cbb83c53161a6932f9f and project cb2e6bbf06674145976cbcf25142a5db. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:24.563360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:41:24.566366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 972aeb1f-6753-4233-a67f-6e8c61c15139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:41:24.618688 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8b87f283-34f4-4c24-bfce-de35302c24b1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.181314 May 19 04:41:24.629325 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1220/2506] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:41:24.727815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-273144425", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "451", "networks": [{"uuid": "eeb4f4bc-6453-40b4-bc6b-2d70da95bfad"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:24.872679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] validate_networks() for [('eeb4f4bc-6453-40b4-bc6b-2d70da95bfad', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:41:25.455219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:41:25.457905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:41:25.459006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:41:25.459910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:41:25.462395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:41:25.487373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:25.489838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:25.492048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:25.493655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:25.527055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for project 0db6b7171e3b4a2db160855939246a40. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:25.536232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for user a651109c72e84cab9e712ad5fbd002b6 and project 0db6b7171e3b4a2db160855939246a40. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:25.553910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:41:25.557414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:41:25.667108 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a0185c14-dc37-4abe-8a64-e38b568ff13d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.607064 May 19 04:41:25.670427 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1287/2507] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:41:25.687047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9fe2b614-ed27-4e4d-a4c3-28f9d077188f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:25.690210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9fe2b614-ed27-4e4d-a4c3-28f9d077188f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:25.707740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fe2b614-ed27-4e4d-a4c3-28f9d077188f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:25.709198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fe2b614-ed27-4e4d-a4c3-28f9d077188f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:25.713331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fe2b614-ed27-4e4d-a4c3-28f9d077188f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:25.714041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fe2b614-ed27-4e4d-a4c3-28f9d077188f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:26.087665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:41:26.088154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:41:26.088561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:41:26.089028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:41:26.089816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:41:26.113747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:26.114421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:26.115441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:26.125827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:26.177311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Getting quotas for project cb2e6bbf06674145976cbcf25142a5db. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:26.185591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Getting quotas for user 537b978be2864cbb83c53161a6932f9f and project cb2e6bbf06674145976cbcf25142a5db. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:26.199641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:41:26.202535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:41:26.256504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9fe2b614-ed27-4e4d-a4c3-28f9d077188f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:26.267328 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-de4cca99-7cb4-48e7-85e3-c912027526f5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545780 May 19 04:41:26.268267 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1221/2508] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:41:26.277408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:26.278372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:26.278614 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9fe2b614-ed27-4e4d-a4c3-28f9d077188f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.603365 May 19 04:41:26.280162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1288/2509] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:25 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:26.293410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-814d23f1-7e08-40f4-a733-efb053f13735 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:26.294802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-814d23f1-7e08-40f4-a733-efb053f13735 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:26.300836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:26.302058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:26.303069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:26.304798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:26.554722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-814d23f1-7e08-40f4-a733-efb053f13735 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:26.564850 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-814d23f1-7e08-40f4-a733-efb053f13735 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1241 microversion: 2.1 time: 0.282884 May 19 04:41:26.569459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:26.573299 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1289/2510] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:26 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1241 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:26.586042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:26.589909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8aac21b-6bbb-4897-913f-306447362b4d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:26.591752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:26.593560 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1305cae1-3e87-458b-a09a-3c6fce7893dc tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.324293 May 19 04:41:26.595361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8aac21b-6bbb-4897-913f-306447362b4d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:26.597516 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1222/2511] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:26 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:26.822357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8aac21b-6bbb-4897-913f-306447362b4d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:26.837490 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8aac21b-6bbb-4897-913f-306447362b4d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1220 microversion: 2.1 time: 0.260977 May 19 04:41:26.838407 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1290/2512] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:26 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1220 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:27.243934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2f819bae-949d-4cd9-bbee-97ae3290663e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:27.258481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2f819bae-949d-4cd9-bbee-97ae3290663e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:27.280153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f819bae-949d-4cd9-bbee-97ae3290663e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.280962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f819bae-949d-4cd9-bbee-97ae3290663e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:27.282009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f819bae-949d-4cd9-bbee-97ae3290663e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.282666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f819bae-949d-4cd9-bbee-97ae3290663e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:27.297193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c0f1cd5-0246-4a6a-b723-db1951aa4567 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:27.298223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9c0f1cd5-0246-4a6a-b723-db1951aa4567 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:27.315535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c0f1cd5-0246-4a6a-b723-db1951aa4567 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.316079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c0f1cd5-0246-4a6a-b723-db1951aa4567 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:27.317909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c0f1cd5-0246-4a6a-b723-db1951aa4567 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.319468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c0f1cd5-0246-4a6a-b723-db1951aa4567 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:27.391006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2f819bae-949d-4cd9-bbee-97ae3290663e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:41:27.602182 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2f819bae-949d-4cd9-bbee-97ae3290663e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 204 len: 0 microversion: 2.1 time: 0.382968 May 19 04:41:27.603437 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1223/2513] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:41:27 2022] DELETE /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:41:27.621043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-28ae05a6-7bff-47b7-800b-e2c8b34005c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:27.633474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-28ae05a6-7bff-47b7-800b-e2c8b34005c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:27.645318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28ae05a6-7bff-47b7-800b-e2c8b34005c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.646007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28ae05a6-7bff-47b7-800b-e2c8b34005c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:27.646952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28ae05a6-7bff-47b7-800b-e2c8b34005c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.647559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28ae05a6-7bff-47b7-800b-e2c8b34005c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:27.765898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-28ae05a6-7bff-47b7-800b-e2c8b34005c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:27.774664 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-28ae05a6-7bff-47b7-800b-e2c8b34005c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1299 microversion: 2.1 time: 0.169760 May 19 04:41:27.789339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c0f1cd5-0246-4a6a-b723-db1951aa4567 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:27.797179 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1224/2514] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:27 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:27.800246 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c0f1cd5-0246-4a6a-b723-db1951aa4567 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.508602 May 19 04:41:27.824000 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1291/2515] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:27 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:27.828665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f36fd848-962e-4ae9-a33d-521ab9e06679 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:27.830771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f36fd848-962e-4ae9-a33d-521ab9e06679 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:27.837329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:27.838864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:27.843108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36fd848-962e-4ae9-a33d-521ab9e06679 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.843576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36fd848-962e-4ae9-a33d-521ab9e06679 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:27.846485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36fd848-962e-4ae9-a33d-521ab9e06679 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.846946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36fd848-962e-4ae9-a33d-521ab9e06679 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:27.858377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.859510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:27.865845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:27.868433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:28.511025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:28.523957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:28.532573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:28.534796 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d95d59e3-846b-43f1-bde9-9bef7acd556d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.709029 May 19 04:41:28.536269 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1292/2516] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:27 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:28.542349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89849177-3e50-4306-9aa6-e95dbf986179 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:28.544733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-89849177-3e50-4306-9aa6-e95dbf986179 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:28.562094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89849177-3e50-4306-9aa6-e95dbf986179 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:28.562675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89849177-3e50-4306-9aa6-e95dbf986179 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:28.567000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89849177-3e50-4306-9aa6-e95dbf986179 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:28.567601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89849177-3e50-4306-9aa6-e95dbf986179 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:28.888737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-89849177-3e50-4306-9aa6-e95dbf986179 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:28.913335 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-89849177-3e50-4306-9aa6-e95dbf986179 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1216 microversion: 2.1 time: 0.375412 May 19 04:41:28.916112 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1293/2517] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:28 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1216 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:28.939325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-40785328-3631-4b92-a7b0-fd46352da210 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:28.941374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-40785328-3631-4b92-a7b0-fd46352da210 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:28.966251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40785328-3631-4b92-a7b0-fd46352da210 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:28.966777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40785328-3631-4b92-a7b0-fd46352da210 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:28.968143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40785328-3631-4b92-a7b0-fd46352da210 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:28.968781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40785328-3631-4b92-a7b0-fd46352da210 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:29.017167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f36fd848-962e-4ae9-a33d-521ab9e06679 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:29.036998 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f36fd848-962e-4ae9-a33d-521ab9e06679 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1553 microversion: 2.1 time: 1.238346 May 19 04:41:29.040954 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1225/2518] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:27 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1553 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:29.048461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-07d930d4-2dd5-43d6-9d9b-078130558b3a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:29.057363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-07d930d4-2dd5-43d6-9d9b-078130558b3a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:29.066372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07d930d4-2dd5-43d6-9d9b-078130558b3a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:29.071083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07d930d4-2dd5-43d6-9d9b-078130558b3a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:29.071943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07d930d4-2dd5-43d6-9d9b-078130558b3a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:29.072391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07d930d4-2dd5-43d6-9d9b-078130558b3a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:30.470283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-40785328-3631-4b92-a7b0-fd46352da210 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:30.481323 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-40785328-3631-4b92-a7b0-fd46352da210 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1367 microversion: 2.1 time: 1.561473 May 19 04:41:30.491042 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1294/2519] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:28 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1367 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:30.497873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:30.498501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:30.516214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-07d930d4-2dd5-43d6-9d9b-078130558b3a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:30.519782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:30.520241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:30.521069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:30.522759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:30.527888 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-07d930d4-2dd5-43d6-9d9b-078130558b3a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 1.482877 May 19 04:41:30.528527 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1226/2520] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:29 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:30.542381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0685bf76-fc26-453a-8e77-3746465649bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:30.545529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0685bf76-fc26-453a-8e77-3746465649bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:30.568427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0685bf76-fc26-453a-8e77-3746465649bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:30.568973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0685bf76-fc26-453a-8e77-3746465649bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:30.569870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0685bf76-fc26-453a-8e77-3746465649bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:30.570318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0685bf76-fc26-453a-8e77-3746465649bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:30.874161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0685bf76-fc26-453a-8e77-3746465649bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:30.905187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0685bf76-fc26-453a-8e77-3746465649bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1278 microversion: 2.1 time: 0.369962 May 19 04:41:30.908907 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1227/2521] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:30 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1278 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:30.927938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aeaf4135-6bbe-4feb-9a08-7847921f7fd8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:30.933961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:30.935038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aeaf4135-6bbe-4feb-9a08-7847921f7fd8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:30.951283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aeaf4135-6bbe-4feb-9a08-7847921f7fd8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:30.953164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aeaf4135-6bbe-4feb-9a08-7847921f7fd8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:30.955999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aeaf4135-6bbe-4feb-9a08-7847921f7fd8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:30.957942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aeaf4135-6bbe-4feb-9a08-7847921f7fd8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:30.960612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:30.962723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:30.963965 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47023eba-b56a-470e-91a9-272326d185f4 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.477200 May 19 04:41:30.975079 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1295/2522] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:30 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:30.975079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-15b17f10-1b8d-46d9-bf2d-05be36901390 req-38e3ff75-1d93-4c19-92b4-cc692af9ce2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e865dff-7659-43e8-8069-81e6760080d7", "tag": "af735cc6-7354-4151-a169-9174e6e19bc9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:30.986935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-15b17f10-1b8d-46d9-bf2d-05be36901390 req-38e3ff75-1d93-4c19-92b4-cc692af9ce2a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:30.987389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-15b17f10-1b8d-46d9-bf2d-05be36901390 req-38e3ff75-1d93-4c19-92b4-cc692af9ce2a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:30.990723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:31.028703 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-15b17f10-1b8d-46d9-bf2d-05be36901390 req-38e3ff75-1d93-4c19-92b4-cc692af9ce2a service nova] Creating event network-changed:af735cc6-7354-4151-a169-9174e6e19bc9 for instance 7e865dff-7659-43e8-8069-81e6760080d7 on n-h1-766726-30 May 19 04:41:31.042883 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-15b17f10-1b8d-46d9-bf2d-05be36901390 req-38e3ff75-1d93-4c19-92b4-cc692af9ce2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075539 May 19 04:41:31.045184 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1296/2523] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:31.487230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aeaf4135-6bbe-4feb-9a08-7847921f7fd8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:31.501566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7271e396-4b64-4f35-a7a3-7e1c0da2739f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:31.502486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7271e396-4b64-4f35-a7a3-7e1c0da2739f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:31.506689 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aeaf4135-6bbe-4feb-9a08-7847921f7fd8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1553 microversion: 2.1 time: 0.595193 May 19 04:41:31.509464 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1228/2524] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:30 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1553 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:31.516185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7271e396-4b64-4f35-a7a3-7e1c0da2739f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:31.516639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7271e396-4b64-4f35-a7a3-7e1c0da2739f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:31.517448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7271e396-4b64-4f35-a7a3-7e1c0da2739f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:31.517883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7271e396-4b64-4f35-a7a3-7e1c0da2739f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:31.548068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f46402d9-46a4-4755-884e-0a84f60bf259 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:31.550196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f46402d9-46a4-4755-884e-0a84f60bf259 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:31.571734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f46402d9-46a4-4755-884e-0a84f60bf259 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:31.572440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f46402d9-46a4-4755-884e-0a84f60bf259 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:31.573712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f46402d9-46a4-4755-884e-0a84f60bf259 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:31.575219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f46402d9-46a4-4755-884e-0a84f60bf259 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:32.157427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7271e396-4b64-4f35-a7a3-7e1c0da2739f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:32.171442 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7271e396-4b64-4f35-a7a3-7e1c0da2739f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1367 microversion: 2.1 time: 0.675175 May 19 04:41:32.173411 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1297/2525] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:31 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1367 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:32.178243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-59132de3-1c53-428b-94ab-1cdc2864a7b9 req-0be7f867-ff1b-46ed-a4ae-a295775d9e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a81ce7-232a-4300-b267-c7859631cad7", "tag": "b08aeaa2-48fd-4db7-8875-c5c727177e45"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:32.195898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-59132de3-1c53-428b-94ab-1cdc2864a7b9 req-0be7f867-ff1b-46ed-a4ae-a295775d9e9f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:32.196722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-59132de3-1c53-428b-94ab-1cdc2864a7b9 req-0be7f867-ff1b-46ed-a4ae-a295775d9e9f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:32.229691 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-59132de3-1c53-428b-94ab-1cdc2864a7b9 req-0be7f867-ff1b-46ed-a4ae-a295775d9e9f service nova] Creating event network-changed:b08aeaa2-48fd-4db7-8875-c5c727177e45 for instance b0a81ce7-232a-4300-b267-c7859631cad7 on n-h2-766726-30 May 19 04:41:32.237511 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-59132de3-1c53-428b-94ab-1cdc2864a7b9 req-0be7f867-ff1b-46ed-a4ae-a295775d9e9f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062368 May 19 04:41:32.240482 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1298/2526] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:32.261468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-acabaf76-3d1b-4022-bc6a-e55932cd3625 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:32.262183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-acabaf76-3d1b-4022-bc6a-e55932cd3625 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:32.272464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-acabaf76-3d1b-4022-bc6a-e55932cd3625 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:32.273325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-acabaf76-3d1b-4022-bc6a-e55932cd3625 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:32.277381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-acabaf76-3d1b-4022-bc6a-e55932cd3625 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:32.278158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-acabaf76-3d1b-4022-bc6a-e55932cd3625 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:32.797054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f46402d9-46a4-4755-884e-0a84f60bf259 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:32.809261 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f46402d9-46a4-4755-884e-0a84f60bf259 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 1.266451 May 19 04:41:32.810897 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1229/2527] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:31 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:32.835459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:32.837335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:32.841782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:32.847351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:32.848091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:32.849961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:32.850693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:32.891779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-acabaf76-3d1b-4022-bc6a-e55932cd3625 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:32.910553 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-acabaf76-3d1b-4022-bc6a-e55932cd3625 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.665452 May 19 04:41:32.913836 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1299/2528] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:32 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:32.924831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e13263f1-b849-4aae-a99a-df5306119c9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:32.931126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e13263f1-b849-4aae-a99a-df5306119c9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:32.950011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e13263f1-b849-4aae-a99a-df5306119c9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:32.952833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e13263f1-b849-4aae-a99a-df5306119c9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:32.954393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e13263f1-b849-4aae-a99a-df5306119c9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:32.956305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e13263f1-b849-4aae-a99a-df5306119c9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:33.059423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:33.088032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:33.099265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:33.102539 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6dbd19f3-3e62-4256-9e1a-0fef44803ce1 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.288289 May 19 04:41:33.107047 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1230/2529] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:32 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:33.121028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-21ed8101-191a-4c35-b2f1-28adc16d1d7e req-8ef80c07-595e-4ac7-89ab-6d3e7288e898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec90454-5ef7-4127-a380-6ce701d46f73", "tag": "05c90412-be15-45e5-996b-c61c55c8ecda"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:33.155807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-21ed8101-191a-4c35-b2f1-28adc16d1d7e req-8ef80c07-595e-4ac7-89ab-6d3e7288e898 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:33.156654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-21ed8101-191a-4c35-b2f1-28adc16d1d7e req-8ef80c07-595e-4ac7-89ab-6d3e7288e898 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:33.194126 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-21ed8101-191a-4c35-b2f1-28adc16d1d7e req-8ef80c07-595e-4ac7-89ab-6d3e7288e898 service nova] Creating event network-changed:05c90412-be15-45e5-996b-c61c55c8ecda for instance 9ec90454-5ef7-4127-a380-6ce701d46f73 on n-h2-766726-30 May 19 04:41:33.223836 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-21ed8101-191a-4c35-b2f1-28adc16d1d7e req-8ef80c07-595e-4ac7-89ab-6d3e7288e898 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114923 May 19 04:41:33.224896 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1231/2530] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:33.230931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a394852-9062-4970-b944-1d24b4c2fa5c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:33.231967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0a394852-9062-4970-b944-1d24b4c2fa5c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:33.233804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e13263f1-b849-4aae-a99a-df5306119c9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:33.248971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a394852-9062-4970-b944-1d24b4c2fa5c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:33.253888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a394852-9062-4970-b944-1d24b4c2fa5c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:33.254168 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e13263f1-b849-4aae-a99a-df5306119c9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1346 microversion: 2.1 time: 0.335977 May 19 04:41:33.255132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a394852-9062-4970-b944-1d24b4c2fa5c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:33.256872 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1300/2531] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:32 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1346 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:33.259803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a394852-9062-4970-b944-1d24b4c2fa5c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:33.830886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b905c97-f898-4d6f-8c5d-ba093213ccc2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:33.831517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b905c97-f898-4d6f-8c5d-ba093213ccc2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:33.842459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b905c97-f898-4d6f-8c5d-ba093213ccc2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:33.842911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b905c97-f898-4d6f-8c5d-ba093213ccc2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:33.852099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b905c97-f898-4d6f-8c5d-ba093213ccc2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:33.852554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b905c97-f898-4d6f-8c5d-ba093213ccc2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:34.137840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0a394852-9062-4970-b944-1d24b4c2fa5c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:34.161486 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0a394852-9062-4970-b944-1d24b4c2fa5c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1367 microversion: 2.1 time: 0.934334 May 19 04:41:34.162957 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1232/2532] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:33 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1367 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:34.181109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a444ff4e-b249-4ce7-a286-78bf11b38412 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:34.182075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a444ff4e-b249-4ce7-a286-78bf11b38412 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:34.193196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a444ff4e-b249-4ce7-a286-78bf11b38412 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:34.193800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a444ff4e-b249-4ce7-a286-78bf11b38412 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:34.194905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a444ff4e-b249-4ce7-a286-78bf11b38412 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:34.195825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a444ff4e-b249-4ce7-a286-78bf11b38412 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:34.242848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0b905c97-f898-4d6f-8c5d-ba093213ccc2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:34.251562 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b905c97-f898-4d6f-8c5d-ba093213ccc2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.424767 May 19 04:41:34.252150 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1301/2533] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:33 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:34.259888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:34.267029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:34.279750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:34.280755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:34.282215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:34.282853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:34.401699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a444ff4e-b249-4ce7-a286-78bf11b38412 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:34.411120 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a444ff4e-b249-4ce7-a286-78bf11b38412 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.246098 May 19 04:41:34.415190 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1233/2534] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:34 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:34.433741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c9276cb3-ba54-48f9-9b24-6ed5efdd691a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:34.434817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c9276cb3-ba54-48f9-9b24-6ed5efdd691a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:34.436319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:34.439118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:34.454693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c9276cb3-ba54-48f9-9b24-6ed5efdd691a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:34.459357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c9276cb3-ba54-48f9-9b24-6ed5efdd691a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:34.460880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c9276cb3-ba54-48f9-9b24-6ed5efdd691a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:34.461879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:34.462485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c9276cb3-ba54-48f9-9b24-6ed5efdd691a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:34.465518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:34.468539 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2a9d20df-20ac-42e8-8fc6-5c6e298ffde9 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.212746 May 19 04:41:34.471577 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1302/2535] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:34 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:34.485401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1b5ef15b-2955-43d6-b576-aea5e0d970f8 req-e2f45e7b-e6de-409c-90a7-237206c7d6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb877d5d-0195-476d-b98e-214237ab958e", "name": "network-vif-deleted", "tag": "15705a77-261b-4a61-915d-6329807f2d66"}, {"name": "network-changed", "server_uuid": "972aeb1f-6753-4233-a67f-6e8c61c15139", "tag": "6f95438e-fe6a-4aad-97a4-8a8b85227eed"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:34.506306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1b5ef15b-2955-43d6-b576-aea5e0d970f8 req-e2f45e7b-e6de-409c-90a7-237206c7d6f6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:34.513217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1b5ef15b-2955-43d6-b576-aea5e0d970f8 req-e2f45e7b-e6de-409c-90a7-237206c7d6f6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:34.543296 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1b5ef15b-2955-43d6-b576-aea5e0d970f8 req-e2f45e7b-e6de-409c-90a7-237206c7d6f6 service nova] Creating event network-vif-deleted:15705a77-261b-4a61-915d-6329807f2d66 for instance cb877d5d-0195-476d-b98e-214237ab958e on n-h2-766726-30 May 19 04:41:34.543824 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1b5ef15b-2955-43d6-b576-aea5e0d970f8 req-e2f45e7b-e6de-409c-90a7-237206c7d6f6 service nova] Creating event network-changed:6f95438e-fe6a-4aad-97a4-8a8b85227eed for instance 972aeb1f-6753-4233-a67f-6e8c61c15139 on n-h1-766726-30 May 19 04:41:34.566720 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1b5ef15b-2955-43d6-b576-aea5e0d970f8 req-e2f45e7b-e6de-409c-90a7-237206c7d6f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.085777 May 19 04:41:34.569050 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1303/2536] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:34.583746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c9276cb3-ba54-48f9-9b24-6ed5efdd691a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:34.594881 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c9276cb3-ba54-48f9-9b24-6ed5efdd691a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1346 microversion: 2.1 time: 0.178463 May 19 04:41:34.606490 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1234/2537] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:34 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:35.182176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9328b712-33c9-4988-9840-4fab2a938725 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:35.183187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9328b712-33c9-4988-9840-4fab2a938725 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:35.193664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9328b712-33c9-4988-9840-4fab2a938725 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.194111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9328b712-33c9-4988-9840-4fab2a938725 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.195239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9328b712-33c9-4988-9840-4fab2a938725 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.195680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9328b712-33c9-4988-9840-4fab2a938725 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.267982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f80129c3-56a2-4e41-a780-21fd57d0d588 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:35.268832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f80129c3-56a2-4e41-a780-21fd57d0d588 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:35.279102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f80129c3-56a2-4e41-a780-21fd57d0d588 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.281040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f80129c3-56a2-4e41-a780-21fd57d0d588 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.282086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f80129c3-56a2-4e41-a780-21fd57d0d588 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.283081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f80129c3-56a2-4e41-a780-21fd57d0d588 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.426237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9328b712-33c9-4988-9840-4fab2a938725 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:35.446296 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9328b712-33c9-4988-9840-4fab2a938725 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1367 microversion: 2.1 time: 0.270403 May 19 04:41:35.446970 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1304/2538] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:35 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:35.460924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4600cf32-6878-4fc0-95de-41249f2280b3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:35.461604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4600cf32-6878-4fc0-95de-41249f2280b3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:35.468150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4600cf32-6878-4fc0-95de-41249f2280b3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.468617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4600cf32-6878-4fc0-95de-41249f2280b3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.469483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4600cf32-6878-4fc0-95de-41249f2280b3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.469924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4600cf32-6878-4fc0-95de-41249f2280b3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.493393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f80129c3-56a2-4e41-a780-21fd57d0d588 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:35.506433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f80129c3-56a2-4e41-a780-21fd57d0d588 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.242380 May 19 04:41:35.512475 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1235/2539] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:35 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:35.517101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:35.532521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:35.535965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:35.556835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.558276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.559157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.561987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.653997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4600cf32-6878-4fc0-95de-41249f2280b3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:35.671842 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4600cf32-6878-4fc0-95de-41249f2280b3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.212525 May 19 04:41:35.672578 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1305/2540] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:35 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:35.701428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c14d3bf9-3609-4e6d-8f2f-38dcbad15f66 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:35.701836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:35.702398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c14d3bf9-3609-4e6d-8f2f-38dcbad15f66 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:35.715001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:35.717267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:35.718872 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b68bcbb-0410-448f-bd83-116439f78844 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.204517 May 19 04:41:35.719100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c14d3bf9-3609-4e6d-8f2f-38dcbad15f66 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.732277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c14d3bf9-3609-4e6d-8f2f-38dcbad15f66 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.732277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c14d3bf9-3609-4e6d-8f2f-38dcbad15f66 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.732571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c14d3bf9-3609-4e6d-8f2f-38dcbad15f66 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.733224 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1236/2541] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:35 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:35.738692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3d00a85c-1e8d-4056-963a-d7ae54f72541 req-427cb0b5-8739-44d3-9003-709a6eb068c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e865dff-7659-43e8-8069-81e6760080d7", "name": "network-vif-plugged", "status": "completed", "tag": "af735cc6-7354-4151-a169-9174e6e19bc9"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:35.754281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3d00a85c-1e8d-4056-963a-d7ae54f72541 req-427cb0b5-8739-44d3-9003-709a6eb068c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:35.754800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3d00a85c-1e8d-4056-963a-d7ae54f72541 req-427cb0b5-8739-44d3-9003-709a6eb068c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:35.770851 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3d00a85c-1e8d-4056-963a-d7ae54f72541 req-427cb0b5-8739-44d3-9003-709a6eb068c1 service nova] Creating event network-vif-plugged:af735cc6-7354-4151-a169-9174e6e19bc9 for instance 7e865dff-7659-43e8-8069-81e6760080d7 on n-h1-766726-30 May 19 04:41:35.777750 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3d00a85c-1e8d-4056-963a-d7ae54f72541 req-427cb0b5-8739-44d3-9003-709a6eb068c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042594 May 19 04:41:35.778772 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1237/2542] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:35.863718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c14d3bf9-3609-4e6d-8f2f-38dcbad15f66 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:35.877957 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c14d3bf9-3609-4e6d-8f2f-38dcbad15f66 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1346 microversion: 2.1 time: 0.192050 May 19 04:41:35.888143 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1306/2543] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:35 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1346 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:36.009065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f6272f9f-500d-41a7-a41e-f4b6cd9db5d5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:36.010384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f6272f9f-500d-41a7-a41e-f4b6cd9db5d5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:36.018301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f6272f9f-500d-41a7-a41e-f4b6cd9db5d5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.019061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f6272f9f-500d-41a7-a41e-f4b6cd9db5d5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.020558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f6272f9f-500d-41a7-a41e-f4b6cd9db5d5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.021553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f6272f9f-500d-41a7-a41e-f4b6cd9db5d5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.077064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f6272f9f-500d-41a7-a41e-f4b6cd9db5d5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:41:36.144856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:36.209228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=22 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:36.229040 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f6272f9f-500d-41a7-a41e-f4b6cd9db5d5 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 204 len: 0 microversion: 2.1 time: 0.224898 May 19 04:41:36.229846 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1238/2544] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:41:36 2022] DELETE /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:41:36.238439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b9751869-9f4e-42d3-a1d5-0dd576444d1a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:36.239227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b9751869-9f4e-42d3-a1d5-0dd576444d1a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:36.252208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9751869-9f4e-42d3-a1d5-0dd576444d1a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.253997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9751869-9f4e-42d3-a1d5-0dd576444d1a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.254889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9751869-9f4e-42d3-a1d5-0dd576444d1a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.255358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9751869-9f4e-42d3-a1d5-0dd576444d1a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.463162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00f1396c-3eb4-4138-b35c-45c88f63ba77 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:36.464027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00f1396c-3eb4-4138-b35c-45c88f63ba77 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:36.481721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00f1396c-3eb4-4138-b35c-45c88f63ba77 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.482173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00f1396c-3eb4-4138-b35c-45c88f63ba77 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.483135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00f1396c-3eb4-4138-b35c-45c88f63ba77 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.483588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00f1396c-3eb4-4138-b35c-45c88f63ba77 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.500502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b9751869-9f4e-42d3-a1d5-0dd576444d1a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:36.515377 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b9751869-9f4e-42d3-a1d5-0dd576444d1a tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1513 microversion: 2.1 time: 0.280930 May 19 04:41:36.517767 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1307/2545] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:36 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:36.534132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1838970c-81ce-41ad-9b29-15a221c7c89f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:36.534804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1838970c-81ce-41ad-9b29-15a221c7c89f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:36.544303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1838970c-81ce-41ad-9b29-15a221c7c89f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.545135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1838970c-81ce-41ad-9b29-15a221c7c89f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.546164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1838970c-81ce-41ad-9b29-15a221c7c89f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.546826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1838970c-81ce-41ad-9b29-15a221c7c89f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.730361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-00f1396c-3eb4-4138-b35c-45c88f63ba77 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:36.742954 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00f1396c-3eb4-4138-b35c-45c88f63ba77 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1367 microversion: 2.1 time: 0.283841 May 19 04:41:36.743867 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1239/2546] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:36 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:36.750812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff9dc213-0c37-48a6-97e4-7aaa313e1d2b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:36.751582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff9dc213-0c37-48a6-97e4-7aaa313e1d2b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:36.761040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1838970c-81ce-41ad-9b29-15a221c7c89f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:36.766417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff9dc213-0c37-48a6-97e4-7aaa313e1d2b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.766902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff9dc213-0c37-48a6-97e4-7aaa313e1d2b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.767689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff9dc213-0c37-48a6-97e4-7aaa313e1d2b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.768157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff9dc213-0c37-48a6-97e4-7aaa313e1d2b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.770974 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1838970c-81ce-41ad-9b29-15a221c7c89f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.242024 May 19 04:41:36.772271 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1308/2547] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:36 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:36.778525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:36.779344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:36.786823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.787235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.788757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.789310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.828586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=10 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:36.869194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:36.881775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:36.888255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:36.890633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e43cb306-3319-4dda-8318-41aef395f589 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.116187 May 19 04:41:36.892486 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1309/2548] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:36 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:36.900482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fb3505a4-097a-4bd9-b373-149c6c7e23ce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:36.901480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fb3505a4-097a-4bd9-b373-149c6c7e23ce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:36.936032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb3505a4-097a-4bd9-b373-149c6c7e23ce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.937348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb3505a4-097a-4bd9-b373-149c6c7e23ce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:36.938156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb3505a4-097a-4bd9-b373-149c6c7e23ce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:36.938715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb3505a4-097a-4bd9-b373-149c6c7e23ce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:37.037431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff9dc213-0c37-48a6-97e4-7aaa313e1d2b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:37.049971 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff9dc213-0c37-48a6-97e4-7aaa313e1d2b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.304990 May 19 04:41:37.050831 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1240/2549] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:36 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:37.050942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fb3505a4-097a-4bd9-b373-149c6c7e23ce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:37.059343 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fb3505a4-097a-4bd9-b373-149c6c7e23ce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1346 microversion: 2.1 time: 0.164122 May 19 04:41:37.060175 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1310/2550] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:36 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:37.537347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-02cdd962-8912-4ac3-aa93-d33528b787af tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:37.538078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-02cdd962-8912-4ac3-aa93-d33528b787af tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:37.545119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02cdd962-8912-4ac3-aa93-d33528b787af tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:37.557894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02cdd962-8912-4ac3-aa93-d33528b787af tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:37.558756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02cdd962-8912-4ac3-aa93-d33528b787af tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:37.559208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02cdd962-8912-4ac3-aa93-d33528b787af tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:37.768066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-edc9e90c-5fd6-4bde-991a-b3c2cd6d6cba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:37.768716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-edc9e90c-5fd6-4bde-991a-b3c2cd6d6cba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:37.785816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-edc9e90c-5fd6-4bde-991a-b3c2cd6d6cba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:37.786269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-edc9e90c-5fd6-4bde-991a-b3c2cd6d6cba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:37.787386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-edc9e90c-5fd6-4bde-991a-b3c2cd6d6cba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:37.792138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-edc9e90c-5fd6-4bde-991a-b3c2cd6d6cba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:37.826878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02cdd962-8912-4ac3-aa93-d33528b787af tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:37.843201 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-02cdd962-8912-4ac3-aa93-d33528b787af tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1513 microversion: 2.1 time: 0.309716 May 19 04:41:37.844317 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1241/2551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:37 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:37.855053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4f4d7a8d-744b-43d1-8d1f-9d6c56b8723f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:37.862355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4f4d7a8d-744b-43d1-8d1f-9d6c56b8723f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:37.884931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f4d7a8d-744b-43d1-8d1f-9d6c56b8723f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:37.885772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f4d7a8d-744b-43d1-8d1f-9d6c56b8723f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:37.888338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f4d7a8d-744b-43d1-8d1f-9d6c56b8723f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:37.889042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f4d7a8d-744b-43d1-8d1f-9d6c56b8723f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:38.301121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-edc9e90c-5fd6-4bde-991a-b3c2cd6d6cba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:38.315546 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-edc9e90c-5fd6-4bde-991a-b3c2cd6d6cba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1556 microversion: 2.1 time: 0.552628 May 19 04:41:38.316894 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1311/2552] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:37 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1556 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:38.325517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:38.327710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:38.337657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4f4d7a8d-744b-43d1-8d1f-9d6c56b8723f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:38.363572 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4f4d7a8d-744b-43d1-8d1f-9d6c56b8723f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.517600 May 19 04:41:38.369679 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1242/2553] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:37 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:38.376530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:38.377350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:38.379363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:38.380025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:38.383863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-53117cc8-f6b0-4cff-9c9d-122f322dcc0d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:38.386254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-53117cc8-f6b0-4cff-9c9d-122f322dcc0d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:38.400681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53117cc8-f6b0-4cff-9c9d-122f322dcc0d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:38.401528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53117cc8-f6b0-4cff-9c9d-122f322dcc0d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:38.403324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53117cc8-f6b0-4cff-9c9d-122f322dcc0d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:38.403991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53117cc8-f6b0-4cff-9c9d-122f322dcc0d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:38.838342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:38.846641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:38.848287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:38.850716 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-36fcb526-c513-43ab-bdb1-b75705e1310f tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.531693 May 19 04:41:38.852581 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1312/2554] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:38 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:38.858957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8ff8b97-f810-4a0e-bb0d-e8b5a9d4cf37 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:38.860465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8ff8b97-f810-4a0e-bb0d-e8b5a9d4cf37 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:38.867022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ff8b97-f810-4a0e-bb0d-e8b5a9d4cf37 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:38.867586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ff8b97-f810-4a0e-bb0d-e8b5a9d4cf37 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:38.868598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ff8b97-f810-4a0e-bb0d-e8b5a9d4cf37 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:38.869155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ff8b97-f810-4a0e-bb0d-e8b5a9d4cf37 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:38.990138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8ff8b97-f810-4a0e-bb0d-e8b5a9d4cf37 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:39.002478 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8ff8b97-f810-4a0e-bb0d-e8b5a9d4cf37 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1346 microversion: 2.1 time: 0.150273 May 19 04:41:39.003374 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1313/2555] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:38 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1346 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:39.009273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-114b73f0-fd1c-42ea-9d9f-a60a786b427e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:39.009842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-114b73f0-fd1c-42ea-9d9f-a60a786b427e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:39.016378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-114b73f0-fd1c-42ea-9d9f-a60a786b427e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:39.016838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-114b73f0-fd1c-42ea-9d9f-a60a786b427e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:39.017656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-114b73f0-fd1c-42ea-9d9f-a60a786b427e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:39.018100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-114b73f0-fd1c-42ea-9d9f-a60a786b427e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:39.025024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-53117cc8-f6b0-4cff-9c9d-122f322dcc0d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:39.034311 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-53117cc8-f6b0-4cff-9c9d-122f322dcc0d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.663391 May 19 04:41:39.036976 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1243/2556] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:38 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:39.044260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6dcca7da-ea6d-4200-8700-97e14d6d6f4c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:39.046180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6dcca7da-ea6d-4200-8700-97e14d6d6f4c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:39.056355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dcca7da-ea6d-4200-8700-97e14d6d6f4c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:39.057257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dcca7da-ea6d-4200-8700-97e14d6d6f4c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:39.058281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dcca7da-ea6d-4200-8700-97e14d6d6f4c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:39.058977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dcca7da-ea6d-4200-8700-97e14d6d6f4c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:39.132595 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-114b73f0-fd1c-42ea-9d9f-a60a786b427e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127706 May 19 04:41:39.133907 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1314/2557] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:41:39 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:39.141106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f221ba88-0724-43c7-a365-a0345b438f5c req-0143d854-9d16-45c5-99e4-8f055ab537c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3946eaf6-225d-46e4-b381-85acfabcb9d7", "name": "network-vif-deleted", "tag": "7c061226-abfd-4367-b257-a2b57b8dfb01"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:39.151092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6dcca7da-ea6d-4200-8700-97e14d6d6f4c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b053bf022854871a6d4754a546f8582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8d32b8d5449b859441346fb0b234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:39.158979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:39.162864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f221ba88-0724-43c7-a365-a0345b438f5c req-0143d854-9d16-45c5-99e4-8f055ab537c6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:39.164083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f221ba88-0724-43c7-a365-a0345b438f5c req-0143d854-9d16-45c5-99e4-8f055ab537c6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:39.167863 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6dcca7da-ea6d-4200-8700-97e14d6d6f4c tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 200 len: 1471 microversion: 2.1 time: 0.125891 May 19 04:41:39.168620 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1244/2558] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:39 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 1471 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:39.182295 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f221ba88-0724-43c7-a365-a0345b438f5c req-0143d854-9d16-45c5-99e4-8f055ab537c6 service nova] Creating event network-vif-deleted:7c061226-abfd-4367-b257-a2b57b8dfb01 for instance 3946eaf6-225d-46e4-b381-85acfabcb9d7 on n-h2-766726-30 May 19 04:41:39.189528 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f221ba88-0724-43c7-a365-a0345b438f5c req-0143d854-9d16-45c5-99e4-8f055ab537c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053643 May 19 04:41:39.194682 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1315/2559] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:39.384679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ade9d35f-5ec6-4d38-b9e4-851d1e3af6c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:39.385256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ade9d35f-5ec6-4d38-b9e4-851d1e3af6c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:39.395495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ade9d35f-5ec6-4d38-b9e4-851d1e3af6c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:39.395961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ade9d35f-5ec6-4d38-b9e4-851d1e3af6c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:39.396843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ade9d35f-5ec6-4d38-b9e4-851d1e3af6c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:39.397586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ade9d35f-5ec6-4d38-b9e4-851d1e3af6c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:39.611812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ade9d35f-5ec6-4d38-b9e4-851d1e3af6c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:39.635822 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ade9d35f-5ec6-4d38-b9e4-851d1e3af6c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.257270 May 19 04:41:39.645107 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1245/2560] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:39 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:39.871216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:39.872763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:39.879443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:39.879900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:39.881243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:39.881716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:39.955622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:39.965621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:39.967221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:39.968797 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-21ddb7b8-6ecf-4415-a126-54c3967fad97 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.103195 May 19 04:41:39.969866 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1316/2561] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:39 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:39.994556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-955ca90d-689e-4399-96a4-ffe06ba1404e req-f726ae8c-4d9c-4910-b33a-9edcfa81132c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a81ce7-232a-4300-b267-c7859631cad7", "name": "network-vif-plugged", "status": "completed", "tag": "b08aeaa2-48fd-4db7-8875-c5c727177e45"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:40.005089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-955ca90d-689e-4399-96a4-ffe06ba1404e req-f726ae8c-4d9c-4910-b33a-9edcfa81132c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.005697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-955ca90d-689e-4399-96a4-ffe06ba1404e req-f726ae8c-4d9c-4910-b33a-9edcfa81132c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.023911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-258875a4-9395-42b0-bf06-e8dee29cd663 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:40.024097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-258875a4-9395-42b0-bf06-e8dee29cd663 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:40.036701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-258875a4-9395-42b0-bf06-e8dee29cd663 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.037367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-258875a4-9395-42b0-bf06-e8dee29cd663 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.039813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-258875a4-9395-42b0-bf06-e8dee29cd663 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.040469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-258875a4-9395-42b0-bf06-e8dee29cd663 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.045516 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-955ca90d-689e-4399-96a4-ffe06ba1404e req-f726ae8c-4d9c-4910-b33a-9edcfa81132c service nova] Creating event network-vif-plugged:b08aeaa2-48fd-4db7-8875-c5c727177e45 for instance b0a81ce7-232a-4300-b267-c7859631cad7 on n-h2-766726-30 May 19 04:41:40.059953 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-955ca90d-689e-4399-96a4-ffe06ba1404e req-f726ae8c-4d9c-4910-b33a-9edcfa81132c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068779 May 19 04:41:40.061892 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1246/2562] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:40.069603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5a8f019-424f-419a-a72d-b7fe593d2dce tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:40.071063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b5a8f019-424f-419a-a72d-b7fe593d2dce tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:40.078896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5a8f019-424f-419a-a72d-b7fe593d2dce tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.079360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5a8f019-424f-419a-a72d-b7fe593d2dce tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.080165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5a8f019-424f-419a-a72d-b7fe593d2dce tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.080682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5a8f019-424f-419a-a72d-b7fe593d2dce tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.204035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-258875a4-9395-42b0-bf06-e8dee29cd663 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:40.215732 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-258875a4-9395-42b0-bf06-e8dee29cd663 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1346 microversion: 2.1 time: 0.198727 May 19 04:41:40.227945 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1317/2563] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:40 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1346 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:40.234182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:40.235849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] [instance: 3946eaf6-225d-46e4-b381-85acfabcb9d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:40.243136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.244272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.245541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.246186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.263339 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] HTTP exception thrown: Instance 3946eaf6-225d-46e4-b381-85acfabcb9d7 could not be found. May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Request method failure captured: May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 HTTP/1.1 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcoahMV2otOxGSFFxOxZ1JU8_nDJg6RKllsQeofH244s4U4rClOQZaTXBB_za0gb0eTxGkeZZdQVxAJ-RvjsFdyZRVy_HlKObcKFejuXxy7O0ef4UnuAQQiahtefA5AmVdELDxwmifwI4-vH4O2fyzg0489WqeMbl-ZGjJgWDbrk04I May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 961c8d32b8d5449b859441346fb0b234 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesAdminNegativeTest-1896639576 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/961c8d32b8d5449b859441346fb0b234"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/961c8d32b8d5449b859441346fb0b234"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/961c8d32b8d5449b859441346fb0b234"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_961c8d32b8d5449b859441346fb0b234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesAdminNegativeTest-1896639576 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 961c8d32b8d5449b859441346fb0b234 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1896639576 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesAdminNegativeTest-1896639576-project May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 8b053bf022854871a6d4754a546f8582 May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesAdminNegativeTest-1896639576-project May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 3946eaf6-225d-46e4-b381-85acfabcb9d7 could not be found. May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '3946eaf6-225d-46e4-b381-85acfabcb9d7'} May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3946eaf6-225d-46e4-b381-85acfabcb9d7 could not be found. May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3946eaf6-225d-46e4-b381-85acfabcb9d7 could not be found. May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:40.265439 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:40.269038 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:40.269038 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:40.269038 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:40.269038 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:40.269038 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:40.269038 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3946eaf6-225d-46e4-b381-85acfabcb9d7 could not be found. May 19 04:41:40.269038 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:40.273517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] Returning 404 to user: Instance 3946eaf6-225d-46e4-b381-85acfabcb9d7 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:40.275519 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2c1dff7-d407-4314-87bc-334d73ac4c79 tempest-VolumesAdminNegativeTest-1896639576 tempest-VolumesAdminNegativeTest-1896639576-project] 10.222.0.58 "GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7" status: 404 len: 111 microversion: 2.1 time: 0.045848 May 19 04:41:40.276673 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1318/2564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:40 2022] GET /compute/v2.1/servers/3946eaf6-225d-46e4-b381-85acfabcb9d7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:41:40.388783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b5a8f019-424f-419a-a72d-b7fe593d2dce tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:40.417689 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5a8f019-424f-419a-a72d-b7fe593d2dce tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.353060 May 19 04:41:40.419260 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1247/2565] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:40 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:40.487899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9438c39d-7b4b-452e-8c30-5148ea6940e7 req-1f337e72-547d-4991-a96a-e640288bbf38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e865dff-7659-43e8-8069-81e6760080d7", "tag": "af735cc6-7354-4151-a169-9174e6e19bc9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:40.495962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9438c39d-7b4b-452e-8c30-5148ea6940e7 req-1f337e72-547d-4991-a96a-e640288bbf38 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.496564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9438c39d-7b4b-452e-8c30-5148ea6940e7 req-1f337e72-547d-4991-a96a-e640288bbf38 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.510187 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9438c39d-7b4b-452e-8c30-5148ea6940e7 req-1f337e72-547d-4991-a96a-e640288bbf38 service nova] Creating event network-changed:af735cc6-7354-4151-a169-9174e6e19bc9 for instance 7e865dff-7659-43e8-8069-81e6760080d7 on n-h1-766726-30 May 19 04:41:40.515807 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9438c39d-7b4b-452e-8c30-5148ea6940e7 req-1f337e72-547d-4991-a96a-e640288bbf38 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032103 May 19 04:41:40.516787 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1319/2566] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:40.654873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd4ef2e4-63b3-407d-9d71-de7978fc793e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:40.654873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fd4ef2e4-63b3-407d-9d71-de7978fc793e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:40.664616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd4ef2e4-63b3-407d-9d71-de7978fc793e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.665087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd4ef2e4-63b3-407d-9d71-de7978fc793e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.680261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd4ef2e4-63b3-407d-9d71-de7978fc793e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:40.683700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd4ef2e4-63b3-407d-9d71-de7978fc793e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:40.989465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:40.990285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:41.009358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:41.009920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:41.010811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:41.011345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:41.049665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd4ef2e4-63b3-407d-9d71-de7978fc793e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:41.060025 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd4ef2e4-63b3-407d-9d71-de7978fc793e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.410728 May 19 04:41:41.060911 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1248/2567] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:40 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:41.233264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cd9ddee1-5d0f-4ece-8241-051cede51dc4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:41.234139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cd9ddee1-5d0f-4ece-8241-051cede51dc4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:41.240865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd9ddee1-5d0f-4ece-8241-051cede51dc4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:41.241643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd9ddee1-5d0f-4ece-8241-051cede51dc4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:41.242591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd9ddee1-5d0f-4ece-8241-051cede51dc4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:41.243187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd9ddee1-5d0f-4ece-8241-051cede51dc4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:41.247367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:41.264392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:41.266120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:41.281815 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4e3ddddf-62a7-4e65-b3e1-0b63cb03c62d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.296204 May 19 04:41:41.282588 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1320/2568] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:40 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:41.352178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cd9ddee1-5d0f-4ece-8241-051cede51dc4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:41.361430 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cd9ddee1-5d0f-4ece-8241-051cede51dc4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1346 microversion: 2.1 time: 0.132107 May 19 04:41:41.362651 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1249/2569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:41 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:41.436574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b9c6f5f-4631-479f-a0e1-2ce94e538dff tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:41.437736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b9c6f5f-4631-479f-a0e1-2ce94e538dff tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:41.445138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:41.447953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b9c6f5f-4631-479f-a0e1-2ce94e538dff tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:41.448631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b9c6f5f-4631-479f-a0e1-2ce94e538dff tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:41.451174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b9c6f5f-4631-479f-a0e1-2ce94e538dff tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:41.451882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b9c6f5f-4631-479f-a0e1-2ce94e538dff tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:41.614307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b9c6f5f-4631-479f-a0e1-2ce94e538dff tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:41.623974 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b9c6f5f-4631-479f-a0e1-2ce94e538dff tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.191960 May 19 04:41:41.635081 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1321/2570] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:41 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:42.085047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8ea3b431-c27c-4f40-a95a-ed3d95301967 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:42.086492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8ea3b431-c27c-4f40-a95a-ed3d95301967 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:42.105061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1e2c4f75-a9ea-4923-9d8a-4f383313b7b2 req-6d257c0a-e1d8-4190-b6d5-a8414a58f9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972aeb1f-6753-4233-a67f-6e8c61c15139", "name": "network-vif-plugged", "status": "completed", "tag": "6f95438e-fe6a-4aad-97a4-8a8b85227eed"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:42.105654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ea3b431-c27c-4f40-a95a-ed3d95301967 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:42.106751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ea3b431-c27c-4f40-a95a-ed3d95301967 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:42.107625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ea3b431-c27c-4f40-a95a-ed3d95301967 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:42.111612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ea3b431-c27c-4f40-a95a-ed3d95301967 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:42.127791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1e2c4f75-a9ea-4923-9d8a-4f383313b7b2 req-6d257c0a-e1d8-4190-b6d5-a8414a58f9c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:42.128668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1e2c4f75-a9ea-4923-9d8a-4f383313b7b2 req-6d257c0a-e1d8-4190-b6d5-a8414a58f9c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:42.159353 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1e2c4f75-a9ea-4923-9d8a-4f383313b7b2 req-6d257c0a-e1d8-4190-b6d5-a8414a58f9c1 service nova] Creating event network-vif-plugged:6f95438e-fe6a-4aad-97a4-8a8b85227eed for instance 972aeb1f-6753-4233-a67f-6e8c61c15139 on n-h1-766726-30 May 19 04:41:42.170901 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1e2c4f75-a9ea-4923-9d8a-4f383313b7b2 req-6d257c0a-e1d8-4190-b6d5-a8414a58f9c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070349 May 19 04:41:42.172061 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1322/2571] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:42.301940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:42.302863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:42.321192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:42.321891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:42.324751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:42.326984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:42.354591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:42.391806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8ea3b431-c27c-4f40-a95a-ed3d95301967 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:42.400594 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8ea3b431-c27c-4f40-a95a-ed3d95301967 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.321877 May 19 04:41:42.404787 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1250/2572] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:42 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:42.418038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-284bf01d-78b4-4eff-a70d-401b4a6c5562 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:42.418761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-284bf01d-78b4-4eff-a70d-401b4a6c5562 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:42.432031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-284bf01d-78b4-4eff-a70d-401b4a6c5562 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:42.434987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-284bf01d-78b4-4eff-a70d-401b4a6c5562 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:42.436036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-284bf01d-78b4-4eff-a70d-401b4a6c5562 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:42.436497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-284bf01d-78b4-4eff-a70d-401b4a6c5562 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:42.497948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:42.508362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:42.510631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:42.513035 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4fab55ca-5e51-4e9e-8a22-49317d794a31 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.216615 May 19 04:41:42.514296 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1323/2573] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:42 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:41:42.517257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-284bf01d-78b4-4eff-a70d-401b4a6c5562 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:42.531511 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-284bf01d-78b4-4eff-a70d-401b4a6c5562 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1346 microversion: 2.1 time: 0.125448 May 19 04:41:42.532115 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1251/2574] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:42 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:42.642441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a870e3b-b445-40a9-8946-510ee6e4842f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:42.643060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a870e3b-b445-40a9-8946-510ee6e4842f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:42.650120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a870e3b-b445-40a9-8946-510ee6e4842f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:42.650570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a870e3b-b445-40a9-8946-510ee6e4842f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:42.651344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a870e3b-b445-40a9-8946-510ee6e4842f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:42.651800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a870e3b-b445-40a9-8946-510ee6e4842f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:42.808771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a870e3b-b445-40a9-8946-510ee6e4842f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:42.816778 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a870e3b-b445-40a9-8946-510ee6e4842f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.178623 May 19 04:41:42.825878 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1324/2575] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:42 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:43.422023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df95a033-c7a5-4705-b693-583cd88d814e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:43.423016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-df95a033-c7a5-4705-b693-583cd88d814e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:43.430377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df95a033-c7a5-4705-b693-583cd88d814e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:43.431227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df95a033-c7a5-4705-b693-583cd88d814e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:43.432084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df95a033-c7a5-4705-b693-583cd88d814e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:43.432659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df95a033-c7a5-4705-b693-583cd88d814e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:43.532188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:43.533680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:43.547558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:43.548293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:43.549301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:43.549954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:43.587086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df95a033-c7a5-4705-b693-583cd88d814e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:43.597677 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-df95a033-c7a5-4705-b693-583cd88d814e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.179301 May 19 04:41:43.608866 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1252/2576] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:43 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:43.621495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-119f4b3c-3579-4c4c-ae56-c49560009c93 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:43.625124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:43.625530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-119f4b3c-3579-4c4c-ae56-c49560009c93 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:43.634442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:43.636037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:43.637453 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cefef036-a9c7-4aae-8c47-4aeb7a0341e7 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.109313 May 19 04:41:43.638182 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1325/2577] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:43 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:41:43.640590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-119f4b3c-3579-4c4c-ae56-c49560009c93 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:43.641040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-119f4b3c-3579-4c4c-ae56-c49560009c93 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:43.642149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-119f4b3c-3579-4c4c-ae56-c49560009c93 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:43.642605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-119f4b3c-3579-4c4c-ae56-c49560009c93 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:43.719607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-119f4b3c-3579-4c4c-ae56-c49560009c93 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:43.732085 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-119f4b3c-3579-4c4c-ae56-c49560009c93 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1346 microversion: 2.1 time: 0.120545 May 19 04:41:43.732998 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1253/2578] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:43 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:43.834179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-acc00fc1-6975-4b56-a63a-5b2d8219bade tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:43.835872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-acc00fc1-6975-4b56-a63a-5b2d8219bade tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:43.842231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-acc00fc1-6975-4b56-a63a-5b2d8219bade tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:43.842927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-acc00fc1-6975-4b56-a63a-5b2d8219bade tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:43.844809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-acc00fc1-6975-4b56-a63a-5b2d8219bade tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:43.845792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-acc00fc1-6975-4b56-a63a-5b2d8219bade tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:43.996072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-acc00fc1-6975-4b56-a63a-5b2d8219bade tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:44.004168 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-acc00fc1-6975-4b56-a63a-5b2d8219bade tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.174517 May 19 04:41:44.012406 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1326/2579] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:43 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:44.188202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3b9f4faf-2196-4e62-b867-9356d8a31dd8 req-f180bbbe-e364-411a-9035-592de01db6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec90454-5ef7-4127-a380-6ce701d46f73", "name": "network-vif-plugged", "status": "completed", "tag": "05c90412-be15-45e5-996b-c61c55c8ecda"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:44.197261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3b9f4faf-2196-4e62-b867-9356d8a31dd8 req-f180bbbe-e364-411a-9035-592de01db6f9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:44.197789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3b9f4faf-2196-4e62-b867-9356d8a31dd8 req-f180bbbe-e364-411a-9035-592de01db6f9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:44.209518 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3b9f4faf-2196-4e62-b867-9356d8a31dd8 req-f180bbbe-e364-411a-9035-592de01db6f9 service nova] Creating event network-vif-plugged:05c90412-be15-45e5-996b-c61c55c8ecda for instance 9ec90454-5ef7-4127-a380-6ce701d46f73 on n-h2-766726-30 May 19 04:41:44.216234 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3b9f4faf-2196-4e62-b867-9356d8a31dd8 req-f180bbbe-e364-411a-9035-592de01db6f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031658 May 19 04:41:44.216897 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1327/2580] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:41:44.251489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d331ae76-ad06-46ff-8391-da3a2de52988 tempest-ListImagesTestJSON-1166102343 tempest-ListImagesTestJSON-1166102343-project] Calling method '.version_select at 0x7fd316280dc0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:44.300146 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d331ae76-ad06-46ff-8391-da3a2de52988 tempest-ListImagesTestJSON-1166102343 tempest-ListImagesTestJSON-1166102343-project] 10.222.0.58 "GET /compute/v2.1/images/a784e77f-4241-416d-b5b0-40834f7e24eb" status: 200 len: 784 microversion: 2.1 time: 0.168446 May 19 04:41:44.305690 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1254/2581] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 19 04:41:44 2022] GET /compute/v2.1/images/a784e77f-4241-416d-b5b0-40834f7e24eb => generated 784 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:44.313468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2bdb170-15db-467c-aaa0-83e5364fce74 tempest-ListImagesTestJSON-1166102343 tempest-ListImagesTestJSON-1166102343-project] Calling method '.version_select at 0x7fd315e665e0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:44.371362 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2bdb170-15db-467c-aaa0-83e5364fce74 tempest-ListImagesTestJSON-1166102343 tempest-ListImagesTestJSON-1166102343-project] 10.222.0.58 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.062011 May 19 04:41:44.372188 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1328/2582] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 19 04:41:44 2022] GET /compute/v2.1/images => generated 445 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:44.383943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-113052e1-4e09-48b2-96a6-65ee6b333d96 tempest-ListImagesTestJSON-1166102343 tempest-ListImagesTestJSON-1166102343-project] Calling method '.version_select at 0x7fd315fe9f70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:44.429982 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-113052e1-4e09-48b2-96a6-65ee6b333d96 tempest-ListImagesTestJSON-1166102343 tempest-ListImagesTestJSON-1166102343-project] 10.222.0.58 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.050448 May 19 04:41:44.430824 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1255/2583] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:41:44 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:44.615863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1b34aa4-8be5-4dd5-9624-4ffa4d5b03c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:44.617158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1b34aa4-8be5-4dd5-9624-4ffa4d5b03c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:44.624149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1b34aa4-8be5-4dd5-9624-4ffa4d5b03c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:44.624858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1b34aa4-8be5-4dd5-9624-4ffa4d5b03c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:44.625650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1b34aa4-8be5-4dd5-9624-4ffa4d5b03c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:44.626252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1b34aa4-8be5-4dd5-9624-4ffa4d5b03c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:44.657109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:44.657724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:44.664452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:44.664895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:44.665691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:44.666602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:44.794182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:44.806015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:44.807746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:44.808933 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6ec97f7-7631-4c37-a80f-8986939d4c22 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1365 microversion: 2.57 time: 0.156925 May 19 04:41:44.809528 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1256/2584] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:44 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:41:44.820135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:44.820135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:44.820288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1b34aa4-8be5-4dd5-9624-4ffa4d5b03c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:44.821423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:44.821871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:44.822686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:44.823071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:44.825727 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1b34aa4-8be5-4dd5-9624-4ffa4d5b03c7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1477 microversion: 2.1 time: 0.214485 May 19 04:41:44.826523 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1329/2585] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:44 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:44.856055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:44.856447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:44.856895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lazy-loading 'fault' on Instance uuid cb877d5d-0195-476d-b98e-214237ab958e {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:41:44.898457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:44.906413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5582d524-8762-4492-8aa8-8fe7943df051 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 200 len: 1351 microversion: 2.1 time: 0.095674 May 19 04:41:44.907056 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1257/2586] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:44 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:45.020639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-356c0c2d-0761-4c13-9b2a-a18ef6f1000a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:45.021290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-356c0c2d-0761-4c13-9b2a-a18ef6f1000a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:45.027452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-356c0c2d-0761-4c13-9b2a-a18ef6f1000a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:45.027909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-356c0c2d-0761-4c13-9b2a-a18ef6f1000a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:45.028711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-356c0c2d-0761-4c13-9b2a-a18ef6f1000a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:45.029185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-356c0c2d-0761-4c13-9b2a-a18ef6f1000a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:45.198980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-356c0c2d-0761-4c13-9b2a-a18ef6f1000a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:45.207633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-356c0c2d-0761-4c13-9b2a-a18ef6f1000a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1320 microversion: 2.1 time: 0.190782 May 19 04:41:45.210033 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1330/2587] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:45 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1320 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:45.828044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:45.829369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:45.840009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:45.840735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:45.841717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:45.842317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:45.849557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60d0df2d-f166-40eb-a50d-b5e77fe8e7a3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:45.850209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60d0df2d-f166-40eb-a50d-b5e77fe8e7a3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:45.859396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60d0df2d-f166-40eb-a50d-b5e77fe8e7a3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:45.859917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60d0df2d-f166-40eb-a50d-b5e77fe8e7a3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:45.860735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60d0df2d-f166-40eb-a50d-b5e77fe8e7a3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:45.862030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60d0df2d-f166-40eb-a50d-b5e77fe8e7a3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:45.944753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:45.953818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:45.955425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:45.956626 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a2d8159e-2634-48ba-b1ae-dd542d404cbe tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1371 microversion: 2.57 time: 0.132544 May 19 04:41:45.957592 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1258/2588] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:45 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:41:45.965507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:45.966192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:45.980150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:45.980620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:45.981556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:45.982235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:46.000828 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e HTTP/1.1 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'cb877d5d-0195-476d-b98e-214237ab958e'} May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:46.002654 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2da3f87f-c4d3-4653-be5a-303972327e2b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 404 len: 111 microversion: 2.1 time: 0.045299 May 19 04:41:46.006640 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1259/2589] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:45 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:41:46.140138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:46.141698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:46.149598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:46.150224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:46.151281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:46.151936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:46.154739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60d0df2d-f166-40eb-a50d-b5e77fe8e7a3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:46.167584 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e/os-volume_attachments HTTP/1.1 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'server_id': 'cb877d5d-0195-476d-b98e-214237ab958e'} May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:41:46.169804 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:41:46.174014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:46.174667 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60d0df2d-f166-40eb-a50d-b5e77fe8e7a3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1476 microversion: 2.1 time: 0.329697 May 19 04:41:46.175853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:46.176950 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d302566c-b03c-4b7d-8de0-d69ea1bd7394 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041978 May 19 04:41:46.178115 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1260/2590] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:41:46 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:41:46.181926 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1331/2591] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:45 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:46.227501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9c8fd7cd-6e3d-451b-92fa-5450d659f7c1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:46.228356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9c8fd7cd-6e3d-451b-92fa-5450d659f7c1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:46.235599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c8fd7cd-6e3d-451b-92fa-5450d659f7c1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:46.237225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c8fd7cd-6e3d-451b-92fa-5450d659f7c1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:46.239125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c8fd7cd-6e3d-451b-92fa-5450d659f7c1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:46.239767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c8fd7cd-6e3d-451b-92fa-5450d659f7c1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:46.395639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-352964722", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "56a7f773-0e0a-4675-b687-c0077a456785"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:46.467135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] validate_networks() for [('56a7f773-0e0a-4675-b687-c0077a456785', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:41:46.485655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9c8fd7cd-6e3d-451b-92fa-5450d659f7c1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:46.495099 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9c8fd7cd-6e3d-451b-92fa-5450d659f7c1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1510 microversion: 2.1 time: 0.274499 May 19 04:41:46.496066 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1261/2592] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:46 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:46.513267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70624be7-c2de-43d5-b480-89a4bc1d874f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:46.514158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-70624be7-c2de-43d5-b480-89a4bc1d874f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:46.521699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70624be7-c2de-43d5-b480-89a4bc1d874f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:46.522981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70624be7-c2de-43d5-b480-89a4bc1d874f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:46.523997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70624be7-c2de-43d5-b480-89a4bc1d874f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:46.524592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70624be7-c2de-43d5-b480-89a4bc1d874f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:46.941684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-70624be7-c2de-43d5-b480-89a4bc1d874f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:46.952048 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-70624be7-c2de-43d5-b480-89a4bc1d874f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1511 microversion: 2.1 time: 0.442685 May 19 04:41:46.955659 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1262/2593] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:46 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:47.150731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-4c23ae2c-6a5e-464b-98c5-9f742231d5df req-6e09f2fa-8bc5-4dad-bc06-b238fd0ddd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a73785c-f5e6-40ba-a07f-4a385e57a0dd", "name": "network-vif-unplugged", "status": "completed", "tag": "ff46de4a-5688-469b-9504-e82ae8240d7d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:47.159551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4c23ae2c-6a5e-464b-98c5-9f742231d5df req-6e09f2fa-8bc5-4dad-bc06-b238fd0ddd52 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:47.159978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4c23ae2c-6a5e-464b-98c5-9f742231d5df req-6e09f2fa-8bc5-4dad-bc06-b238fd0ddd52 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:47.173639 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-4c23ae2c-6a5e-464b-98c5-9f742231d5df req-6e09f2fa-8bc5-4dad-bc06-b238fd0ddd52 service nova] Creating event network-vif-unplugged:ff46de4a-5688-469b-9504-e82ae8240d7d for instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd on n-h2-766726-30 May 19 04:41:47.182684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-4c23ae2c-6a5e-464b-98c5-9f742231d5df req-6e09f2fa-8bc5-4dad-bc06-b238fd0ddd52 service nova] Instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:41:47.198541 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-4c23ae2c-6a5e-464b-98c5-9f742231d5df req-6e09f2fa-8bc5-4dad-bc06-b238fd0ddd52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.242138 May 19 04:41:47.200542 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1263/2594] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:47.208442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e0389e59-63a3-4795-82c3-fab57ec7e8a5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:47.209409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e0389e59-63a3-4795-82c3-fab57ec7e8a5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 972aeb1f-6753-4233-a67f-6e8c61c15139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:47.216001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0389e59-63a3-4795-82c3-fab57ec7e8a5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:47.216451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0389e59-63a3-4795-82c3-fab57ec7e8a5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:47.217332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0389e59-63a3-4795-82c3-fab57ec7e8a5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:47.217778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0389e59-63a3-4795-82c3-fab57ec7e8a5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:47.365089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:41:47.366718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:41:47.367326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:41:47.367773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:41:47.368155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:41:47.377864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:47.378319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:47.379166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:47.380260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:47.397804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:47.403151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for user 1e14ea8dad314974bf5f4e8e51b88349 and project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:47.416970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:41:47.419349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:41:47.472305 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cb9038a0-f01f-4970-bb49-e62527adf6ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.080939 May 19 04:41:47.478755 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1332/2595] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:41:47.484125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:47.484967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:47.491825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:47.492547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:47.493561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:47.494000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:47.530425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e0389e59-63a3-4795-82c3-fab57ec7e8a5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:47.548882 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e0389e59-63a3-4795-82c3-fab57ec7e8a5 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139" status: 200 len: 1511 microversion: 2.1 time: 0.346503 May 19 04:41:47.563269 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1264/2596] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:47 2022] GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139 => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:47.621522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1b53482-d4ae-4469-a7a9-ec4449ce87eb tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd3160d5700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1072752257", "description": "tempest-description-1019221603"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:47.642473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:47.657772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:47.659914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:47.661513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-65c7a1c2-0ea9-4979-a05c-a25fd704022d tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1371 microversion: 2.57 time: 0.181360 May 19 04:41:47.663384 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1333/2597] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:47 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:47.670117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be45c4f8-4fa9-4255-bda7-80b5e49e6c7d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:47.671140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be45c4f8-4fa9-4255-bda7-80b5e49e6c7d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:47.688517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be45c4f8-4fa9-4255-bda7-80b5e49e6c7d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:47.689202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be45c4f8-4fa9-4255-bda7-80b5e49e6c7d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:47.690130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be45c4f8-4fa9-4255-bda7-80b5e49e6c7d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:47.690853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be45c4f8-4fa9-4255-bda7-80b5e49e6c7d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.011400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be45c4f8-4fa9-4255-bda7-80b5e49e6c7d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:48.020712 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be45c4f8-4fa9-4255-bda7-80b5e49e6c7d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1476 microversion: 2.1 time: 0.355227 May 19 04:41:48.021567 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1334/2598] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:47 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1476 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:48.032089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-59661a06-11b8-4797-ae07-73ce732bf7e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:48.033990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-59661a06-11b8-4797-ae07-73ce732bf7e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:48.103012 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e1b53482-d4ae-4469-a7a9-ec4449ce87eb tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.538186 May 19 04:41:48.103963 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1265/2599] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:41:47 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:48.109108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:48.113505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:48.114621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:48.132781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.133287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-59661a06-11b8-4797-ae07-73ce732bf7e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:48.134013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.135463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.136210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.143319 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-59661a06-11b8-4797-ae07-73ce732bf7e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1214 microversion: 2.1 time: 0.117148 May 19 04:41:48.144006 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1335/2600] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:48 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:48.162781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5dbcaad9-ad9d-421f-9c91-cdb29940d61e tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd315655dc0>, body: {"security_group_rule": {"parent_group_id": "5d8d5293-4489-483f-ad8d-e04bc157869b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:48.254379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:41:48.259537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:48.362475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:48.374080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.374951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.624834 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5dbcaad9-ad9d-421f-9c91-cdb29940d61e tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.478885 May 19 04:41:48.625648 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1336/2601] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:41:48 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:48.629168 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49fcb236-9fb2-4af9-b79a-9fc9c6219ecc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.523774 May 19 04:41:48.629785 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1266/2602] 10.222.0.58 () {58 vars in 1166 bytes} [Thu May 19 04:41:48 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:48.635242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27c061b7-70c1-405f-93a2-f5496b316b0c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:48.635794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27c061b7-70c1-405f-93a2-f5496b316b0c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:48.636646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f9e6837-e337-4f84-8e17-e3f0cadd0441 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd3161fa4c0>, body: {"security_group_rule": {"parent_group_id": "5d8d5293-4489-483f-ad8d-e04bc157869b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:48.645534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27c061b7-70c1-405f-93a2-f5496b316b0c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.646442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27c061b7-70c1-405f-93a2-f5496b316b0c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.647993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27c061b7-70c1-405f-93a2-f5496b316b0c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.648434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27c061b7-70c1-405f-93a2-f5496b316b0c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.684403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27c061b7-70c1-405f-93a2-f5496b316b0c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:41:48.702093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-3f9e6837-e337-4f84-8e17-e3f0cadd0441 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] HTTP exception thrown: This rule already exists in group 5d8d5293-4489-483f-ad8d-e04bc157869b May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f9e6837-e337-4f84-8e17-e3f0cadd0441 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Request method failure captured: May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 138 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcqKEwT-VxMCnHaoz2YqSoSrNcVaxqy9RQaeRI0V8dkaL1G-dw5p-1KXSkiDxh7EoVBDfNaXsASyx8MeMU0YXf4s0slTDLIEAdv5FQjOqeQD3-IPg4ahBH1KxGz0iW_-nHoseJqzP2uucruK9WAVPUQCNe4So8HweleoVHXY7EwBc3g May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cd78606e85d74891abde9013e22d6341 May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: {"security_group_rule": {"parent_group_id": "5d8d5293-4489-483f-ad8d-e04bc157869b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: exception: This rule already exists in group 5d8d5293-4489-483f-ad8d-e04bc157869b May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5d8d5293-4489-483f-ad8d-e04bc157869b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 5d8d5293-4489-483f-ad8d-e04bc157869b May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 5d8d5293-4489-483f-ad8d-e04bc157869b May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:48.707969 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:48.718195 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:48.718195 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:48.718195 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 5d8d5293-4489-483f-ad8d-e04bc157869b May 19 04:41:48.718195 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:48.718195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f9e6837-e337-4f84-8e17-e3f0cadd0441 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Returning 400 to user: This rule already exists in group 5d8d5293-4489-483f-ad8d-e04bc157869b {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:48.718195 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3f9e6837-e337-4f84-8e17-e3f0cadd0441 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.076809 May 19 04:41:48.718195 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1267/2603] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:41:48 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 04:41:48.723297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:48.728050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:48.728846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1410072059', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:48.735469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.736311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.736730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.737376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.803370 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27c061b7-70c1-405f-93a2-f5496b316b0c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 204 len: 0 microversion: 2.1 time: 0.176310 May 19 04:41:48.807254 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1337/2604] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:41:48 2022] DELETE /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:41:48.813435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:48.814690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:48.822141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.822653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.823439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.824261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:48.844569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:41:48.912604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:48.922863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:48.924609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:48.926294 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72437708-fa0b-4982-b472-163260d7ade2 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1356 microversion: 2.57 time: 0.117676 May 19 04:41:48.939267 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1338/2605] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:48 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1356 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:48.950402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5025f003-06c8-4e69-a5da-43a41d3e998a tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Calling method '.version_select at 0x7fd315c03b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:48.953766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:48.960523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:48.961897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.135864 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b1b6a86-bb90-4120-a519-9207fb2a712d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1410072059" status: 200 len: 1514 microversion: 2.1 time: 0.422457 May 19 04:41:49.136816 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1268/2606] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:41:48 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1410072059 => generated 1514 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:49.141546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f0b4c584-99fb-4465-96e9-987c0d122714 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:49.142151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f0b4c584-99fb-4465-96e9-987c0d122714 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:49.148775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b4c584-99fb-4465-96e9-987c0d122714 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.149257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b4c584-99fb-4465-96e9-987c0d122714 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.150696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b4c584-99fb-4465-96e9-987c0d122714 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.151180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b4c584-99fb-4465-96e9-987c0d122714 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.189419 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5025f003-06c8-4e69-a5da-43a41d3e998a tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/d7832d4c-50b2-436f-a476-663ba2554754" status: 202 len: 0 microversion: 2.1 time: 0.248820 May 19 04:41:49.194775 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1339/2607] 10.222.0.58 () {58 vars in 1286 bytes} [Thu May 19 04:41:48 2022] DELETE /compute/v2.1/os-security-group-rules/d7832d4c-50b2-436f-a476-663ba2554754 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:41:49.196394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a2de9325-082d-46d7-ae08-f1e777aca1f0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:49.197309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a2de9325-082d-46d7-ae08-f1e777aca1f0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:49.208135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2de9325-082d-46d7-ae08-f1e777aca1f0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.208862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2de9325-082d-46d7-ae08-f1e777aca1f0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.212351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2de9325-082d-46d7-ae08-f1e777aca1f0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.213334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a2de9325-082d-46d7-ae08-f1e777aca1f0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.234645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f0b4c584-99fb-4465-96e9-987c0d122714 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:49.243807 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f0b4c584-99fb-4465-96e9-987c0d122714 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1284 microversion: 2.1 time: 0.105832 May 19 04:41:49.244365 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1269/2608] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:49 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:49.246920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a2de9325-082d-46d7-ae08-f1e777aca1f0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:41:49.249535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1610a5be-cb4e-4428-b98e-1da982e04349 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:49.250247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1610a5be-cb4e-4428-b98e-1da982e04349 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:49.257766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1610a5be-cb4e-4428-b98e-1da982e04349 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.258266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1610a5be-cb4e-4428-b98e-1da982e04349 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.259120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1610a5be-cb4e-4428-b98e-1da982e04349 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.259590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1610a5be-cb4e-4428-b98e-1da982e04349 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.340091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a2de9325-082d-46d7-ae08-f1e777aca1f0 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 204 len: 0 microversion: 2.57 time: 0.148124 May 19 04:41:49.341381 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1340/2609] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:41:49 2022] DELETE /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:41:49.348586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:49.354386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:49.355574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:49.361771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.362248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.363046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.363511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.415921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1610a5be-cb4e-4428-b98e-1da982e04349 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:49.425384 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1610a5be-cb4e-4428-b98e-1da982e04349 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1474 microversion: 2.1 time: 0.179832 May 19 04:41:49.426287 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1270/2610] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:49 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1474 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:49.432038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-38bd865a-d799-4e7b-8046-ac7e36179742 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd315fc3670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1632467668", "description": "tempest-description-1113557041"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:49.461817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:41:49.466611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:49.536437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:49.545173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.545624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.610347 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-38bd865a-d799-4e7b-8046-ac7e36179742 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.182970 May 19 04:41:49.610952 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1271/2611] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:41:49 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:49.615965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-98491da2-5f9e-4bba-a275-843e465e64cc req-a210829b-34fa-479f-9dfa-3fc178ca2397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a73785c-f5e6-40ba-a07f-4a385e57a0dd", "tag": "ff46de4a-5688-469b-9504-e82ae8240d7d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:49.625945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-98491da2-5f9e-4bba-a275-843e465e64cc req-a210829b-34fa-479f-9dfa-3fc178ca2397 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.626483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-98491da2-5f9e-4bba-a275-843e465e64cc req-a210829b-34fa-479f-9dfa-3fc178ca2397 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.638694 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-98491da2-5f9e-4bba-a275-843e465e64cc req-a210829b-34fa-479f-9dfa-3fc178ca2397 service nova] Creating event network-changed:ff46de4a-5688-469b-9504-e82ae8240d7d for instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd on n-h2-766726-30 May 19 04:41:49.644146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-98491da2-5f9e-4bba-a275-843e465e64cc req-a210829b-34fa-479f-9dfa-3fc178ca2397 service nova] Instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:41:49.654628 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-98491da2-5f9e-4bba-a275-843e465e64cc req-a210829b-34fa-479f-9dfa-3fc178ca2397 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042265 May 19 04:41:49.655233 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1272/2612] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:49.660169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:49.660863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:49.667658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.668108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.668880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.669349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.702264 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a41877f7-e785-40a0-9bc9-d89115028f8b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.359408 May 19 04:41:49.702884 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1341/2613] 10.222.0.58 () {58 vars in 1172 bytes} [Thu May 19 04:41:49 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:49.707902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2470a6a0-112a-43d9-bc63-4f818f29e93d tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd315c030d0>, body: {"security_group_rule": {"parent_group_id": "ecdac08c-4d90-4d63-ae89-d41cc8fa7b8c", "ip_protocol": "tcp", "from_port": 1285537660, "to_port": 22}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:49.745387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:49.753983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:49.755573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:49.756793 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0aeefdf8-9894-40df-8e3d-720f7fdf2c19 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1362 microversion: 2.57 time: 0.100478 May 19 04:41:49.757467 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1273/2614] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:49 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1362 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:49.762046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:49.765429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:49.765855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.compute.servers [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Removing options 'limit' from query {{(pid=124819) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} May 19 04:41:49.766698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:49.770612 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-2470a6a0-112a-43d9-bc63-4f818f29e93d tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] HTTP exception thrown: Invalid port range 1285537660:22. Former value cannot be greater than the later May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2470a6a0-112a-43d9-bc63-4f818f29e93d tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Request method failure captured: May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 146 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcqKEwT-VxMCnHaoz2YqSoSrNcVaxqy9RQaeRI0V8dkaL1G-dw5p-1KXSkiDxh7EoVBDfNaXsASyx8MeMU0YXf4s0slTDLIEAdv5FQjOqeQD3-IPg4ahBH1KxGz0iW_-nHoseJqzP2uucruK9WAVPUQCNe4So8HweleoVHXY7EwBc3g May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: cd78606e85d74891abde9013e22d6341 May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: {"security_group_rule": {"parent_group_id": "ecdac08c-4d90-4d63-ae89-d41cc8fa7b8c", "ip_protocol": "tcp", "from_port": 1285537660, "to_port": 22}} May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid port range 1285537660:22. Former value cannot be greater than the later May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ecdac08c-4d90-4d63-ae89-d41cc8fa7b8c', 'ip_protocol': 'tcp', 'from_port': 1285537660, 'to_port': 22}}} May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1285537660:22. Former value cannot be greater than the later May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1285537660:22. Former value cannot be greater than the later May 19 04:41:49.772913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.776676 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:49.776676 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.776676 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:49.776676 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:49.776676 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:49.776676 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:49.776676 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:49.776676 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1285537660:22. Former value cannot be greater than the later May 19 04:41:49.776676 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.777187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.777187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.777331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2470a6a0-112a-43d9-bc63-4f818f29e93d tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Returning 400 to user: Invalid port range 1285537660:22. Former value cannot be greater than the later {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:49.777403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.777472 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2470a6a0-112a-43d9-bc63-4f818f29e93d tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.070752 May 19 04:41:49.777546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.777624 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1342/2615] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:41:49 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:41:49.783957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d91d2b1d-f432-4480-a0ad-d6819dc77e0f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd315533790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1024745809", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:49.785709 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-d91d2b1d-f432-4480-a0ad-d6819dc77e0f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] HTTP exception thrown: Security group id should be uuid May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d91d2b1d-f432-4480-a0ad-d6819dc77e0f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Request method failure captured: May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 131 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcqKEwT-VxMCnHaoz2YqSoSrNcVaxqy9RQaeRI0V8dkaL1G-dw5p-1KXSkiDxh7EoVBDfNaXsASyx8MeMU0YXf4s0slTDLIEAdv5FQjOqeQD3-IPg4ahBH1KxGz0iW_-nHoseJqzP2uucruK9WAVPUQCNe4So8HweleoVHXY7EwBc3g May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: cd78606e85d74891abde9013e22d6341 May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1024745809", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: exception: Security group id should be uuid May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1024745809', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:49.787114 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:49.791218 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid May 19 04:41:49.791218 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:49.791218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d91d2b1d-f432-4480-a0ad-d6819dc77e0f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Returning 400 to user: Security group id should be uuid {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:49.791218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d91d2b1d-f432-4480-a0ad-d6819dc77e0f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.008825 May 19 04:41:49.791218 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1343/2616] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:41:49 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 19 04:41:49.798633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe38f2fe-cff0-4d43-8962-cd6e2c2fdeff tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd315e3f310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-381664579", "description": "tempest-description-1766353217"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:49.881047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:49.887749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:49.888200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:49.986632 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fe38f2fe-cff0-4d43-8962-cd6e2c2fdeff tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.191940 May 19 04:41:49.987943 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1344/2617] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:41:49 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:50.000151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-57fa8554-0a1f-4963-818a-45e56b37a853 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd3155339d0>, body: {"security_group_rule": {"parent_group_id": "69394191-db5d-4db5-b76d-f2d890589313", "ip_protocol": "tempest-999-286091268", "from_port": 22, "to_port": 22}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:50.072249 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-38a94a24-dd46-4389-9065-763b2692789c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.313394 May 19 04:41:50.072897 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1274/2618] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 04:41:49 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:50.075495 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-57fa8554-0a1f-4963-818a-45e56b37a853 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] HTTP exception thrown: Invalid IP protocol tempest-999-286091268. May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-57fa8554-0a1f-4963-818a-45e56b37a853 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Request method failure captured: May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 156 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcqKEwT-VxMCnHaoz2YqSoSrNcVaxqy9RQaeRI0V8dkaL1G-dw5p-1KXSkiDxh7EoVBDfNaXsASyx8MeMU0YXf4s0slTDLIEAdv5FQjOqeQD3-IPg4ahBH1KxGz0iW_-nHoseJqzP2uucruK9WAVPUQCNe4So8HweleoVHXY7EwBc3g May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: cd78606e85d74891abde9013e22d6341 May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: {"security_group_rule": {"parent_group_id": "69394191-db5d-4db5-b76d-f2d890589313", "ip_protocol": "tempest-999-286091268", "from_port": 22, "to_port": 22}} May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid IP protocol tempest-999-286091268. May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'security_group_rule': {'parent_group_id': '69394191-db5d-4db5-b76d-f2d890589313', 'ip_protocol': 'tempest-999-286091268', 'from_port': 22, 'to_port': 22}}} May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-286091268. May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-286091268. May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:50.077111 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-286091268. May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-57fa8554-0a1f-4963-818a-45e56b37a853 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Returning 400 to user: Invalid IP protocol tempest-999-286091268. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-57fa8554-0a1f-4963-818a-45e56b37a853 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.083074 May 19 04:41:50.080544 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1345/2619] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:41:49 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 19 04:41:50.089162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-385cdd0a-eeef-4fab-916b-27b7349e472f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd315fc3e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1040031385", "description": "tempest-description-1107401901"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:50.091645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-81c6f502-9a50-45e3-8c92-a19bc2ae9d89 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:50.096115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-81c6f502-9a50-45e3-8c92-a19bc2ae9d89 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:50.097057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-81c6f502-9a50-45e3-8c92-a19bc2ae9d89 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:50.105819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81c6f502-9a50-45e3-8c92-a19bc2ae9d89 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:50.107103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81c6f502-9a50-45e3-8c92-a19bc2ae9d89 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:50.108076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81c6f502-9a50-45e3-8c92-a19bc2ae9d89 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:50.109038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81c6f502-9a50-45e3-8c92-a19bc2ae9d89 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:50.244161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-81c6f502-9a50-45e3-8c92-a19bc2ae9d89 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:41:50.309810 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-81c6f502-9a50-45e3-8c92-a19bc2ae9d89 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.222637 May 19 04:41:50.310982 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1346/2620] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:41:50 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:50.315648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-37f534a3-d443-426a-9886-950b8b0ca22a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:50.316507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-37f534a3-d443-426a-9886-950b8b0ca22a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:50.326948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37f534a3-d443-426a-9886-950b8b0ca22a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:50.326948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37f534a3-d443-426a-9886-950b8b0ca22a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:50.326948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37f534a3-d443-426a-9886-950b8b0ca22a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:50.326948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37f534a3-d443-426a-9886-950b8b0ca22a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:50.456254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-37f534a3-d443-426a-9886-950b8b0ca22a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:50.466860 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-385cdd0a-eeef-4fab-916b-27b7349e472f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.380909 May 19 04:41:50.470017 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-37f534a3-d443-426a-9886-950b8b0ca22a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1272 microversion: 2.1 time: 0.157154 May 19 04:41:50.470667 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1275/2621] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:41:50 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:50.480648 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1347/2622] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:50 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:50.482062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:50.485741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:50.486186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.compute.servers [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Removing options 'limit' from query {{(pid=124819) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} May 19 04:41:50.486847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:50.487432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac9b317b-b8a5-4a3e-88ce-2ef33fd6aa0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:50.488067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac9b317b-b8a5-4a3e-88ce-2ef33fd6aa0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:50.497455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac9b317b-b8a5-4a3e-88ce-2ef33fd6aa0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:50.497964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac9b317b-b8a5-4a3e-88ce-2ef33fd6aa0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:50.498874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac9b317b-b8a5-4a3e-88ce-2ef33fd6aa0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:50.499573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac9b317b-b8a5-4a3e-88ce-2ef33fd6aa0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:50.515463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:50.516116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:50.517606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:50.518131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:50.557556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:41:50.590289 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-61aef6a8-332e-4c3a-8659-4f0fac0801e0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.118454 May 19 04:41:50.591258 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1276/2623] 10.222.0.58 () {58 vars in 1149 bytes} [Thu May 19 04:41:50 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:50.596384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f18754df-22cf-48d6-867b-c4365534bc4f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd3161248b0>, body: {"security_group_rule": {"parent_group_id": "3e8955ef-14e4-4ccb-b75e-727ce52c7c48", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:51.150040 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-f18754df-22cf-48d6-867b-c4365534bc4f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f18754df-22cf-48d6-867b-c4365534bc4f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Request method failure captured: May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 138 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcqKEwT-VxMCnHaoz2YqSoSrNcVaxqy9RQaeRI0V8dkaL1G-dw5p-1KXSkiDxh7EoVBDfNaXsASyx8MeMU0YXf4s0slTDLIEAdv5FQjOqeQD3-IPg4ahBH1KxGz0iW_-nHoseJqzP2uucruK9WAVPUQCNe4So8HweleoVHXY7EwBc3g May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cd78606e85d74891abde9013e22d6341 May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: {"security_group_rule": {"parent_group_id": "3e8955ef-14e4-4ccb-b75e-727ce52c7c48", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid port range 22:21. Former value cannot be greater than the later May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3e8955ef-14e4-4ccb-b75e-727ce52c7c48', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later May 19 04:41:51.152106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.157801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:51.157801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.157801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.157801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:51.157801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:51.157801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:51.157801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:51.157801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later May 19 04:41:51.157801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.160864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f18754df-22cf-48d6-867b-c4365534bc4f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:51.161930 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f18754df-22cf-48d6-867b-c4365534bc4f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.569514 May 19 04:41:51.167801 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1277/2624] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:41:50 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 576 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:41:51.175347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f3200970-b28e-4a0b-b865-e3f7593f3638 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:51.182462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f3200970-b28e-4a0b-b865-e3f7593f3638 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:51.184150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f3200970-b28e-4a0b-b865-e3f7593f3638 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:51.190006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac9b317b-b8a5-4a3e-88ce-2ef33fd6aa0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:51.190925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3200970-b28e-4a0b-b865-e3f7593f3638 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.191844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3200970-b28e-4a0b-b865-e3f7593f3638 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.192886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3200970-b28e-4a0b-b865-e3f7593f3638 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.200574 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac9b317b-b8a5-4a3e-88ce-2ef33fd6aa0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1474 microversion: 2.1 time: 0.720284 May 19 04:41:51.201196 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1348/2625] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:50 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1474 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:51.213110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3200970-b28e-4a0b-b865-e3f7593f3638 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.214972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:51.215599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:51.235727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.237299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.239958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.240417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.267327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-f3200970-b28e-4a0b-b865-e3f7593f3638 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:41:51.280400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.280856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.281352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lazy-loading 'fault' on Instance uuid 9aed42f8-83a9-4948-bd0c-8fe9584bf26f {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:41:51.300248 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f3200970-b28e-4a0b-b865-e3f7593f3638 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.131210 May 19 04:41:51.300973 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1278/2626] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:41:51 2022] GET /compute/v2.1/servers => generated 1011 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:51.310643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4c79001d-f0c8-4c6d-bc83-c081b3e92d38 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd3160d5940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1633796199", "description": "tempest-description-272099647"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:51.396234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:51.405989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:51.407501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45761241325a4e1a865e0ba69d0bc451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00560f861f494a5a854aa84c36ceac81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:51.408700 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1856df82-7caf-4d7f-adf1-7158af070085 tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 200 len: 1367 microversion: 2.57 time: 0.206530 May 19 04:41:51.409768 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1349/2627] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:51 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:41:51.415180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-61b2fb4a-6471-4112-bc7a-17f8642f9251 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:51.419575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-61b2fb4a-6471-4112-bc7a-17f8642f9251 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:51.420469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-61b2fb4a-6471-4112-bc7a-17f8642f9251 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:51.432529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61b2fb4a-6471-4112-bc7a-17f8642f9251 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.432974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61b2fb4a-6471-4112-bc7a-17f8642f9251 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.433813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61b2fb4a-6471-4112-bc7a-17f8642f9251 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.434249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61b2fb4a-6471-4112-bc7a-17f8642f9251 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.530370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-61b2fb4a-6471-4112-bc7a-17f8642f9251 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:41:51.596942 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-61b2fb4a-6471-4112-bc7a-17f8642f9251 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.185793 May 19 04:41:51.603624 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1350/2628] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:41:51 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:51.603624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-118a4b51-898c-449e-a386-677f06712ea2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:51.603624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-118a4b51-898c-449e-a386-677f06712ea2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:51.611765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-118a4b51-898c-449e-a386-677f06712ea2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.612255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-118a4b51-898c-449e-a386-677f06712ea2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.613243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-118a4b51-898c-449e-a386-677f06712ea2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.613663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-118a4b51-898c-449e-a386-677f06712ea2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.733855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-118a4b51-898c-449e-a386-677f06712ea2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:51.743477 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-118a4b51-898c-449e-a386-677f06712ea2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1272 microversion: 2.1 time: 0.144650 May 19 04:41:51.745762 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1351/2629] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:51 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:51.751424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b8622e2-d91e-4153-9d05-6b2412c83c6c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:51.755440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2b8622e2-d91e-4153-9d05-6b2412c83c6c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:51.755898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.compute.servers [None req-2b8622e2-d91e-4153-9d05-6b2412c83c6c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Removing options 'limit' from query {{(pid=124818) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} May 19 04:41:51.757466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b8622e2-d91e-4153-9d05-6b2412c83c6c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:51.764011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b8622e2-d91e-4153-9d05-6b2412c83c6c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.764516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b8622e2-d91e-4153-9d05-6b2412c83c6c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.765396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b8622e2-d91e-4153-9d05-6b2412c83c6c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.766065 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4c79001d-f0c8-4c6d-bc83-c081b3e92d38 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.462880 May 19 04:41:51.766524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b8622e2-d91e-4153-9d05-6b2412c83c6c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.772384 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1279/2630] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:41:51 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:51.781385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1674f45-d8bd-48c8-8dc5-adf6487df79e tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd316495a60>, body: {"security_group_rule": {"parent_group_id": "cd7c6785-2905-4582-8766-dd1d4bed68e1", "ip_protocol": "tcp", "from_port": 22, "to_port": 816753470}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:51.798492 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b8622e2-d91e-4153-9d05-6b2412c83c6c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.053199 May 19 04:41:51.799260 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1352/2631] 10.222.0.58 () {58 vars in 1139 bytes} [Thu May 19 04:41:51 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:51.811222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-28a6f86b-ac5d-4a8d-b14f-1cffe79ce2c0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:51.815122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-28a6f86b-ac5d-4a8d-b14f-1cffe79ce2c0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:51.815824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-28a6f86b-ac5d-4a8d-b14f-1cffe79ce2c0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1410072059', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:41:51.821367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28a6f86b-ac5d-4a8d-b14f-1cffe79ce2c0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.821948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28a6f86b-ac5d-4a8d-b14f-1cffe79ce2c0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.822775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28a6f86b-ac5d-4a8d-b14f-1cffe79ce2c0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.823209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28a6f86b-ac5d-4a8d-b14f-1cffe79ce2c0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:51.910016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-28a6f86b-ac5d-4a8d-b14f-1cffe79ce2c0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:41:51.911320 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d1674f45-d8bd-48c8-8dc5-adf6487df79e tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] HTTP exception thrown: Invalid port range 22:816753470. Valid TCP ports should be between 1-65535 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1674f45-d8bd-48c8-8dc5-adf6487df79e tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Request method failure captured: May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 145 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcqKEwT-VxMCnHaoz2YqSoSrNcVaxqy9RQaeRI0V8dkaL1G-dw5p-1KXSkiDxh7EoVBDfNaXsASyx8MeMU0YXf4s0slTDLIEAdv5FQjOqeQD3-IPg4ahBH1KxGz0iW_-nHoseJqzP2uucruK9WAVPUQCNe4So8HweleoVHXY7EwBc3g May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cd78606e85d74891abde9013e22d6341 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: {"security_group_rule": {"parent_group_id": "cd7c6785-2905-4582-8766-dd1d4bed68e1", "ip_protocol": "tcp", "from_port": 22, "to_port": 816753470}} May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid port range 22:816753470. Valid TCP ports should be between 1-65535 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cd7c6785-2905-4582-8766-dd1d4bed68e1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 816753470}}} May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:816753470. Valid TCP ports should be between 1-65535 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:816753470. Valid TCP ports should be between 1-65535 May 19 04:41:51.913571 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:816753470. Valid TCP ports should be between 1-65535 May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1674f45-d8bd-48c8-8dc5-adf6487df79e tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Returning 400 to user: Invalid port range 22:816753470. Valid TCP ports should be between 1-65535 {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d1674f45-d8bd-48c8-8dc5-adf6487df79e tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.138800 May 19 04:41:51.916851 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1280/2632] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:41:51 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:41:51.925794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-57df495c-49f4-46c7-9d68-95ec6fb9efc1 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Action: 'create', calling method: .version_select at 0x7fd3164a8550>, body: {"security_group_rule": {"parent_group_id": "f93adc6f-3c99-449d-a160-9077854abaff", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:51.958382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-57df495c-49f4-46c7-9d68-95ec6fb9efc1 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f93adc6f-3c99-449d-a160-9077854abaff does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:41:51.959024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-57df495c-49f4-46c7-9d68-95ec6fb9efc1 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Neutron security group f93adc6f-3c99-449d-a160-9077854abaff not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:41:51.960224 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-57df495c-49f4-46c7-9d68-95ec6fb9efc1 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] HTTP exception thrown: Security group f93adc6f-3c99-449d-a160-9077854abaff does not exist May 19 04:41:51.960224 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-c05b6c65-a0d0-4080-9ac3-d70d7cdb0b1f'] May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-57df495c-49f4-46c7-9d68-95ec6fb9efc1 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Request method failure captured: May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 138 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcqKEwT-VxMCnHaoz2YqSoSrNcVaxqy9RQaeRI0V8dkaL1G-dw5p-1KXSkiDxh7EoVBDfNaXsASyx8MeMU0YXf4s0slTDLIEAdv5FQjOqeQD3-IPg4ahBH1KxGz0iW_-nHoseJqzP2uucruK9WAVPUQCNe4So8HweleoVHXY7EwBc3g May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cd78606e85d74891abde9013e22d6341 May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: {"security_group_rule": {"parent_group_id": "f93adc6f-3c99-449d-a160-9077854abaff", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group f93adc6f-3c99-449d-a160-9077854abaff does not exist May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-c05b6c65-a0d0-4080-9ac3-d70d7cdb0b1f'] May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f93adc6f-3c99-449d-a160-9077854abaff', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:41:51.962591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f93adc6f-3c99-449d-a160-9077854abaff does not exist May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c05b6c65-a0d0-4080-9ac3-d70d7cdb0b1f'] May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f93adc6f-3c99-449d-a160-9077854abaff does not exist May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c05b6c65-a0d0-4080-9ac3-d70d7cdb0b1f'] May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f93adc6f-3c99-449d-a160-9077854abaff does not exist May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c05b6c65-a0d0-4080-9ac3-d70d7cdb0b1f'] May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f93adc6f-3c99-449d-a160-9077854abaff does not exist May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c05b6c65-a0d0-4080-9ac3-d70d7cdb0b1f'] May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-57df495c-49f4-46c7-9d68-95ec6fb9efc1 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Returning 404 to user: Security group f93adc6f-3c99-449d-a160-9077854abaff does not exist May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-c05b6c65-a0d0-4080-9ac3-d70d7cdb0b1f'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:51.966021 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-57df495c-49f4-46c7-9d68-95ec6fb9efc1 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.042311 May 19 04:41:51.969239 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1281/2633] 10.222.0.58 () {60 vars in 1194 bytes} [Thu May 19 04:41:51 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:41:51.973877 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-28a6f86b-ac5d-4a8d-b14f-1cffe79ce2c0 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1410072059" status: 200 len: 346 microversion: 2.1 time: 0.165979 May 19 04:41:51.974671 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1353/2634] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 04:41:51 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1410072059 => generated 346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:41:51.986098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8d276813-934a-40cc-b74d-11b4ec0591dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:51.990218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da14d66b-0093-4a88-8c63-605c26ff3f02 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Calling method '.version_select at 0x7fd315a6dd30>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:51.992212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d276813-934a-40cc-b74d-11b4ec0591dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:51.992665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d276813-934a-40cc-b74d-11b4ec0591dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:52.025031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-da14d66b-0093-4a88-8c63-605c26ff3f02 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule fd2dec24-06e7-4b43-ab72-ff123e514bff does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:41:52.026475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-da14d66b-0093-4a88-8c63-605c26ff3f02 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Neutron security group rule fd2dec24-06e7-4b43-ab72-ff123e514bff not found {{(pid=124819) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} May 19 04:41:52.027202 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-da14d66b-0093-4a88-8c63-605c26ff3f02 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] HTTP exception thrown: Security group rule fd2dec24-06e7-4b43-ab72-ff123e514bff does not exist May 19 04:41:52.027202 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-a4a9453b-4b64-40bb-a0e8-91a16382221a'] May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da14d66b-0093-4a88-8c63-605c26ff3f02 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Request method failure captured: May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-security-group-rules/fd2dec24-06e7-4b43-ab72-ff123e514bff HTTP/1.1 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcqKEwT-VxMCnHaoz2YqSoSrNcVaxqy9RQaeRI0V8dkaL1G-dw5p-1KXSkiDxh7EoVBDfNaXsASyx8MeMU0YXf4s0slTDLIEAdv5FQjOqeQD3-IPg4ahBH1KxGz0iW_-nHoseJqzP2uucruK9WAVPUQCNe4So8HweleoVHXY7EwBc3g May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efbdd4e19f67452f98a0574dbde1a387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: efbdd4e19f67452f98a0574dbde1a387 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cd78606e85d74891abde9013e22d6341 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-350818888-project May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group rule fd2dec24-06e7-4b43-ab72-ff123e514bff does not exist May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-a4a9453b-4b64-40bb-a0e8-91a16382221a'] May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'fd2dec24-06e7-4b43-ab72-ff123e514bff'} May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:41:52.031946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule fd2dec24-06e7-4b43-ab72-ff123e514bff does not exist May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4a9453b-4b64-40bb-a0e8-91a16382221a'] May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule fd2dec24-06e7-4b43-ab72-ff123e514bff does not exist May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4a9453b-4b64-40bb-a0e8-91a16382221a'] May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule fd2dec24-06e7-4b43-ab72-ff123e514bff does not exist May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4a9453b-4b64-40bb-a0e8-91a16382221a'] May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule fd2dec24-06e7-4b43-ab72-ff123e514bff does not exist May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4a9453b-4b64-40bb-a0e8-91a16382221a'] May 19 04:41:52.040375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.048570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da14d66b-0093-4a88-8c63-605c26ff3f02 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Returning 404 to user: Security group rule fd2dec24-06e7-4b43-ab72-ff123e514bff does not exist May 19 04:41:52.048570 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-a4a9453b-4b64-40bb-a0e8-91a16382221a'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:52.054591 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da14d66b-0093-4a88-8c63-605c26ff3f02 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/fd2dec24-06e7-4b43-ab72-ff123e514bff" status: 404 len: 199 microversion: 2.1 time: 0.084278 May 19 04:41:52.055755 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1282/2635] 10.222.0.58 () {58 vars in 1286 bytes} [Thu May 19 04:41:51 2022] DELETE /compute/v2.1/os-security-group-rules/fd2dec24-06e7-4b43-ab72-ff123e514bff => generated 199 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:41:52.066159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8d276813-934a-40cc-b74d-11b4ec0591dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Going to try to stop instance {{(pid=124818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 04:41:52.068770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a5b04a35-a8b9-44b8-b58e-222578613ab1 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Calling method '.version_select at 0x7fd3160d5940>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:52.119556 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8d276813-934a-40cc-b74d-11b4ec0591dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "POST /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7/action" status: 202 len: 0 microversion: 2.1 time: 0.136983 May 19 04:41:52.120344 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1354/2636] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:41:51 2022] POST /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:41:52.129556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ff3ed6e4-ab89-42a3-bdb5-0adc825862dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:52.130481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ff3ed6e4-ab89-42a3-bdb5-0adc825862dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:52.137717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff3ed6e4-ab89-42a3-bdb5-0adc825862dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:52.138485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff3ed6e4-ab89-42a3-bdb5-0adc825862dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:52.140085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff3ed6e4-ab89-42a3-bdb5-0adc825862dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:52.140382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff3ed6e4-ab89-42a3-bdb5-0adc825862dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:52.485880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ff3ed6e4-ab89-42a3-bdb5-0adc825862dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:52.493425 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ff3ed6e4-ab89-42a3-bdb5-0adc825862dc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.368175 May 19 04:41:52.494169 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1355/2637] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:52 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:52.499948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0acc73e0-605f-42d9-89b5-9b66280f8acb req-49840c1b-48c0-40ff-b0a3-fdb4068d3e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a73785c-f5e6-40ba-a07f-4a385e57a0dd", "name": "network-vif-plugged", "status": "completed", "tag": "ff46de4a-5688-469b-9504-e82ae8240d7d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:52.508776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0acc73e0-605f-42d9-89b5-9b66280f8acb req-49840c1b-48c0-40ff-b0a3-fdb4068d3e8d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:52.509249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0acc73e0-605f-42d9-89b5-9b66280f8acb req-49840c1b-48c0-40ff-b0a3-fdb4068d3e8d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:52.520773 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0acc73e0-605f-42d9-89b5-9b66280f8acb req-49840c1b-48c0-40ff-b0a3-fdb4068d3e8d service nova] Creating event network-vif-plugged:ff46de4a-5688-469b-9504-e82ae8240d7d for instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd on n-h2-766726-30 May 19 04:41:52.528919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-0acc73e0-605f-42d9-89b5-9b66280f8acb req-49840c1b-48c0-40ff-b0a3-fdb4068d3e8d service nova] Instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:41:52.541424 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0acc73e0-605f-42d9-89b5-9b66280f8acb req-49840c1b-48c0-40ff-b0a3-fdb4068d3e8d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045327 May 19 04:41:52.542045 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1356/2638] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:52.548896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41c6a402-bc77-45a4-acaa-6b79742b8c8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:52.549628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-41c6a402-bc77-45a4-acaa-6b79742b8c8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:52.556944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41c6a402-bc77-45a4-acaa-6b79742b8c8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:52.557428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41c6a402-bc77-45a4-acaa-6b79742b8c8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:52.558317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41c6a402-bc77-45a4-acaa-6b79742b8c8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:52.558877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41c6a402-bc77-45a4-acaa-6b79742b8c8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:52.578131 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a5b04a35-a8b9-44b8-b58e-222578613ab1 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/cd7c6785-2905-4582-8766-dd1d4bed68e1" status: 202 len: 0 microversion: 2.1 time: 0.517348 May 19 04:41:52.578966 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1283/2639] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:41:52 2022] DELETE /compute/v2.1/os-security-groups/cd7c6785-2905-4582-8766-dd1d4bed68e1 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:41:52.587365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:52.588117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] [instance: 9aed42f8-83a9-4948-bd0c-8fe9584bf26f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:52.591530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:52.596718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:52.597462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:52.598541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:52.599111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:52.616734 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] HTTP exception thrown: Instance 9aed42f8-83a9-4948-bd0c-8fe9584bf26f could not be found. May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Request method failure captured: May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f HTTP/1.1 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcphalNmMJuApeJ6uutLKfKkM13gdB4e74Z6Rboc0F5p54SqG-_MKmQpUq_PsSjvUslw1Dtsm-HWHFp1c1ZZJ8YmNgRNb9g50kAPqTQ_PcXaeGmjGU0GHLZjRPsjZifZUvuNfgmIl22LA1I53f6Zlq1Vjkg91hitm5XUu0xaKKwYm3U May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.57 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 00560f861f494a5a854aa84c36ceac81 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerShowV257Test-1788722600 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/00560f861f494a5a854aa84c36ceac81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/00560f861f494a5a854aa84c36ceac81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/00560f861f494a5a854aa84c36ceac81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_00560f861f494a5a854aa84c36ceac81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerShowV257Test-1788722600 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 00560f861f494a5a854aa84c36ceac81 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerShowV257Test-1788722600 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerShowV257Test-1788722600-project May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 45761241325a4e1a865e0ba69d0bc451 May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerShowV257Test-1788722600-project May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 9aed42f8-83a9-4948-bd0c-8fe9584bf26f could not be found. May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '9aed42f8-83a9-4948-bd0c-8fe9584bf26f'} May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aed42f8-83a9-4948-bd0c-8fe9584bf26f could not be found. May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aed42f8-83a9-4948-bd0c-8fe9584bf26f could not be found. May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:41:52.619096 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aed42f8-83a9-4948-bd0c-8fe9584bf26f could not be found. May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] Returning 404 to user: Instance 9aed42f8-83a9-4948-bd0c-8fe9584bf26f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ea13aac-72d4-4ca0-8e27-016d290f554b tempest-ServerShowV257Test-1788722600 tempest-ServerShowV257Test-1788722600-project] 10.222.0.58 "GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f" status: 404 len: 111 microversion: 2.57 time: 0.037536 May 19 04:41:52.623755 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1284/2640] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:41:52 2022] GET /compute/v2.1/servers/9aed42f8-83a9-4948-bd0c-8fe9584bf26f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:41:52.627317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd593178-eaa5-429d-8c4f-7ae4542a0a53 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Calling method '.version_select at 0x7fd3160d5c10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:52.875059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-41c6a402-bc77-45a4-acaa-6b79742b8c8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:52.885335 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-41c6a402-bc77-45a4-acaa-6b79742b8c8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1471 microversion: 2.1 time: 0.341894 May 19 04:41:52.886316 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1357/2641] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:52 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1471 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:52.890505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-679a966e-9e70-4368-a520-815600231c1a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:52.891162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-679a966e-9e70-4368-a520-815600231c1a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:52.898750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-679a966e-9e70-4368-a520-815600231c1a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:52.899197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-679a966e-9e70-4368-a520-815600231c1a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:52.899996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-679a966e-9e70-4368-a520-815600231c1a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:52.900430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-679a966e-9e70-4368-a520-815600231c1a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:53.119103 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd593178-eaa5-429d-8c4f-7ae4542a0a53 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/3e8955ef-14e4-4ccb-b75e-727ce52c7c48" status: 202 len: 0 microversion: 2.1 time: 0.496968 May 19 04:41:53.119749 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1285/2642] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:41:52 2022] DELETE /compute/v2.1/os-security-groups/3e8955ef-14e4-4ccb-b75e-727ce52c7c48 => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:41:53.125675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cfaf62d7-8ce9-4946-adf8-c75dfda6223f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:53.126208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cfaf62d7-8ce9-4946-adf8-c75dfda6223f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:53.133910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cfaf62d7-8ce9-4946-adf8-c75dfda6223f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:53.134358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cfaf62d7-8ce9-4946-adf8-c75dfda6223f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:53.135132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cfaf62d7-8ce9-4946-adf8-c75dfda6223f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:53.135570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cfaf62d7-8ce9-4946-adf8-c75dfda6223f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:53.190057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-679a966e-9e70-4368-a520-815600231c1a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:53.200358 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-679a966e-9e70-4368-a520-815600231c1a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1314 microversion: 2.1 time: 0.313375 May 19 04:41:53.201772 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1358/2643] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:52 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:53.207628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eeb5615b-7c90-40b3-bdb4-158711c6668f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Calling method '.version_select at 0x7fd31511b1f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:53.212146 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cfaf62d7-8ce9-4946-adf8-c75dfda6223f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd/action" status: 204 len: 0 microversion: 2.1 time: 0.090962 May 19 04:41:53.216281 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1286/2644] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:41:53 2022] POST /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:41:53.222619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-18cf4515-6915-4bae-995f-6d6dbc949efa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:53.223954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-18cf4515-6915-4bae-995f-6d6dbc949efa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:53.230583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18cf4515-6915-4bae-995f-6d6dbc949efa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:53.231059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18cf4515-6915-4bae-995f-6d6dbc949efa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:53.232002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18cf4515-6915-4bae-995f-6d6dbc949efa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:53.232663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18cf4515-6915-4bae-995f-6d6dbc949efa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:53.615617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-18cf4515-6915-4bae-995f-6d6dbc949efa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:53.624734 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-18cf4515-6915-4bae-995f-6d6dbc949efa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1471 microversion: 2.1 time: 0.406614 May 19 04:41:53.625362 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1287/2645] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:53 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1471 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:53.630144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a591a87e-8058-4631-9ae9-258091627159 req-97a87b6b-4eda-493f-a433-0a36c00bd5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d5472b0-f730-4891-985f-cc16e617c486", "tag": "e8432c29-a5b3-4353-9a48-d9709801691a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:53.640544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a591a87e-8058-4631-9ae9-258091627159 req-97a87b6b-4eda-493f-a433-0a36c00bd5ff service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:53.641340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a591a87e-8058-4631-9ae9-258091627159 req-97a87b6b-4eda-493f-a433-0a36c00bd5ff service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:53.654599 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a591a87e-8058-4631-9ae9-258091627159 req-97a87b6b-4eda-493f-a433-0a36c00bd5ff service nova] Creating event network-changed:e8432c29-a5b3-4353-9a48-d9709801691a for instance 2d5472b0-f730-4891-985f-cc16e617c486 on n-h2-766726-30 May 19 04:41:53.660569 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a591a87e-8058-4631-9ae9-258091627159 req-97a87b6b-4eda-493f-a433-0a36c00bd5ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033793 May 19 04:41:53.663031 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1288/2646] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:53.669769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e3128025-05c1-46e7-b552-71e375f86ad7 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:53.670868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e3128025-05c1-46e7-b552-71e375f86ad7 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:53.678761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3128025-05c1-46e7-b552-71e375f86ad7 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:53.679849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3128025-05c1-46e7-b552-71e375f86ad7 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:53.682369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3128025-05c1-46e7-b552-71e375f86ad7 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:53.683446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3128025-05c1-46e7-b552-71e375f86ad7 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:53.871233 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eeb5615b-7c90-40b3-bdb4-158711c6668f tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/69394191-db5d-4db5-b76d-f2d890589313" status: 202 len: 0 microversion: 2.1 time: 0.666937 May 19 04:41:53.871869 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1359/2647] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:41:53 2022] DELETE /compute/v2.1/os-security-groups/69394191-db5d-4db5-b76d-f2d890589313 => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:41:53.882005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-42580412-dd32-4374-8713-f85c551e5e58 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Calling method '.version_select at 0x7fd315d80ca0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:54.051761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e3128025-05c1-46e7-b552-71e375f86ad7 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:54.064198 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e3128025-05c1-46e7-b552-71e375f86ad7 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.399676 May 19 04:41:54.065279 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1289/2648] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:53 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:54.223964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af02614a-80c1-473f-8707-f18024a08c07 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:54.224826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af02614a-80c1-473f-8707-f18024a08c07 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:54.240557 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-42580412-dd32-4374-8713-f85c551e5e58 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ecdac08c-4d90-4d63-ae89-d41cc8fa7b8c" status: 202 len: 0 microversion: 2.1 time: 0.363636 May 19 04:41:54.244499 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1360/2649] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:41:53 2022] DELETE /compute/v2.1/os-security-groups/ecdac08c-4d90-4d63-ae89-d41cc8fa7b8c => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:41:54.247919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af02614a-80c1-473f-8707-f18024a08c07 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:54.248377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af02614a-80c1-473f-8707-f18024a08c07 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:54.250618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e09bd9f3-b542-4d9f-a67f-fa51f07fdc16 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] Calling method '.version_select at 0x7fd315090820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:54.251532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af02614a-80c1-473f-8707-f18024a08c07 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:54.254732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af02614a-80c1-473f-8707-f18024a08c07 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:54.468726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-af02614a-80c1-473f-8707-f18024a08c07 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:54.480033 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af02614a-80c1-473f-8707-f18024a08c07 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1314 microversion: 2.1 time: 0.263240 May 19 04:41:54.480952 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1290/2650] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:54 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:54.534726 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e09bd9f3-b542-4d9f-a67f-fa51f07fdc16 tempest-SecurityGroupRulesNegativeTestJSON-350818888 tempest-SecurityGroupRulesNegativeTestJSON-350818888-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5d8d5293-4489-483f-ad8d-e04bc157869b" status: 202 len: 0 microversion: 2.1 time: 0.288636 May 19 04:41:54.535312 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1361/2651] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:41:54 2022] DELETE /compute/v2.1/os-security-groups/5d8d5293-4489-483f-ad8d-e04bc157869b => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:41:54.647825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1de9d4fd-8c15-4f8c-8a50-2556e15c8bf4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:54.648523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1de9d4fd-8c15-4f8c-8a50-2556e15c8bf4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:54.656142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1de9d4fd-8c15-4f8c-8a50-2556e15c8bf4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:54.656590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1de9d4fd-8c15-4f8c-8a50-2556e15c8bf4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:54.657407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1de9d4fd-8c15-4f8c-8a50-2556e15c8bf4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:54.657845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1de9d4fd-8c15-4f8c-8a50-2556e15c8bf4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:54.810206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1de9d4fd-8c15-4f8c-8a50-2556e15c8bf4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:54.814668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:54.822158 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1de9d4fd-8c15-4f8c-8a50-2556e15c8bf4 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1471 microversion: 2.1 time: 0.181938 May 19 04:41:54.822756 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1291/2652] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:54 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:55.084322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64b6b152-2ffa-4f29-9202-ab5afde8b484 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:55.085864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64b6b152-2ffa-4f29-9202-ab5afde8b484 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:55.095985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64b6b152-2ffa-4f29-9202-ab5afde8b484 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:55.096504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64b6b152-2ffa-4f29-9202-ab5afde8b484 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:55.097398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64b6b152-2ffa-4f29-9202-ab5afde8b484 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:55.098049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64b6b152-2ffa-4f29-9202-ab5afde8b484 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:55.478352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-64b6b152-2ffa-4f29-9202-ab5afde8b484 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:55.496876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b49c3b7a-1e2c-4054-8673-6dddbe496656 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:55.497509 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64b6b152-2ffa-4f29-9202-ab5afde8b484 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.419092 May 19 04:41:55.497605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b49c3b7a-1e2c-4054-8673-6dddbe496656 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:55.508784 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1362/2653] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:55 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:55.512521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b49c3b7a-1e2c-4054-8673-6dddbe496656 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:55.512963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b49c3b7a-1e2c-4054-8673-6dddbe496656 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:55.514210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b49c3b7a-1e2c-4054-8673-6dddbe496656 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:55.515206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b49c3b7a-1e2c-4054-8673-6dddbe496656 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:55.821186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b49c3b7a-1e2c-4054-8673-6dddbe496656 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:55.832167 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b49c3b7a-1e2c-4054-8673-6dddbe496656 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1314 microversion: 2.1 time: 0.339016 May 19 04:41:55.832986 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1292/2654] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:55 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:55.843625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a9100e3-74cb-48cc-876c-e4ab294ed777 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:55.845199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a9100e3-74cb-48cc-876c-e4ab294ed777 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:55.853711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a9100e3-74cb-48cc-876c-e4ab294ed777 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:55.854652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a9100e3-74cb-48cc-876c-e4ab294ed777 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:55.855623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a9100e3-74cb-48cc-876c-e4ab294ed777 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:55.856108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a9100e3-74cb-48cc-876c-e4ab294ed777 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:55.860635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:56.093263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a9100e3-74cb-48cc-876c-e4ab294ed777 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:56.100867 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a9100e3-74cb-48cc-876c-e4ab294ed777 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1463 microversion: 2.1 time: 0.262365 May 19 04:41:56.105235 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1363/2655] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:55 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1463 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:56.116557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64ce0f61-96b8-4122-bac2-adbbf862c776 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:56.117098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64ce0f61-96b8-4122-bac2-adbbf862c776 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:56.128605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64ce0f61-96b8-4122-bac2-adbbf862c776 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:56.129070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64ce0f61-96b8-4122-bac2-adbbf862c776 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:56.129895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64ce0f61-96b8-4122-bac2-adbbf862c776 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:56.130350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64ce0f61-96b8-4122-bac2-adbbf862c776 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:56.280435 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64ce0f61-96b8-4122-bac2-adbbf862c776 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1616 microversion: 2.1 time: 0.167561 May 19 04:41:56.281345 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1293/2656] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:56 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1616 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:56.301871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-29b3e287-5c04-48e0-84c0-16f962483983 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '.version_select at 0x7fd315eac280>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:56.304371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29b3e287-5c04-48e0-84c0-16f962483983 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:56.305890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29b3e287-5c04-48e0-84c0-16f962483983 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:56.313470 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-29b3e287-5c04-48e0-84c0-16f962483983 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.015414 May 19 04:41:56.314018 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1364/2657] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:41:56 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:41:56.434478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-574906200", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:56.490125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:41:56.514785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-42a3e915-faef-4c45-95c4-9ab46239e6cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:56.515429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-42a3e915-faef-4c45-95c4-9ab46239e6cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:56.518602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:41:56.523638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42a3e915-faef-4c45-95c4-9ab46239e6cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:56.524071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42a3e915-faef-4c45-95c4-9ab46239e6cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:56.524838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42a3e915-faef-4c45-95c4-9ab46239e6cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:56.525452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42a3e915-faef-4c45-95c4-9ab46239e6cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:56.780297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-42a3e915-faef-4c45-95c4-9ab46239e6cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:56.795781 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-42a3e915-faef-4c45-95c4-9ab46239e6cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.284749 May 19 04:41:56.796723 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1365/2658] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:56 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:56.799745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:41:56.800788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:41:56.801303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:41:56.801955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:41:56.802645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:41:56.814505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:56.814960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:56.816982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:56.817649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:56.837053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:56.842720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for user 55c593b7f2a04b0e820a505e8e8eb521 and project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:56.850847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f17df88-44b8-48ee-8787-729e47b33615 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:56.852025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5f17df88-44b8-48ee-8787-729e47b33615 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:56.857212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:41:56.859533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:41:56.859930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f17df88-44b8-48ee-8787-729e47b33615 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:56.860534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f17df88-44b8-48ee-8787-729e47b33615 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:56.861548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f17df88-44b8-48ee-8787-729e47b33615 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:56.862139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f17df88-44b8-48ee-8787-729e47b33615 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:56.910627 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-797c3849-760c-42f0-9ad2-8e6bc3757d47 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480536 May 19 04:41:56.911404 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1294/2659] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:41:56.922099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8cd656e-2db7-4227-bf76-33adbb160f5b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:56.922809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8cd656e-2db7-4227-bf76-33adbb160f5b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:57.035493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8cd656e-2db7-4227-bf76-33adbb160f5b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:57.048990 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8cd656e-2db7-4227-bf76-33adbb160f5b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1212 microversion: 2.1 time: 0.130869 May 19 04:41:57.059710 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1295/2660] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:56 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1212 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:57.073642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5f17df88-44b8-48ee-8787-729e47b33615 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:57.090693 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5f17df88-44b8-48ee-8787-729e47b33615 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1314 microversion: 2.1 time: 0.243654 May 19 04:41:57.091899 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1366/2661] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:56 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:57.814957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-63323ef4-0339-4b5a-b278-2b332cf830a2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:57.815581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-63323ef4-0339-4b5a-b278-2b332cf830a2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:57.823617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63323ef4-0339-4b5a-b278-2b332cf830a2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:57.824424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63323ef4-0339-4b5a-b278-2b332cf830a2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:57.825517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63323ef4-0339-4b5a-b278-2b332cf830a2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:57.826173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63323ef4-0339-4b5a-b278-2b332cf830a2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:58.067503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b0f81d7-9ea1-410a-bf7a-6b0ac20983a0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:58.068635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4b0f81d7-9ea1-410a-bf7a-6b0ac20983a0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:58.077501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b0f81d7-9ea1-410a-bf7a-6b0ac20983a0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:58.082995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b0f81d7-9ea1-410a-bf7a-6b0ac20983a0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:58.084065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b0f81d7-9ea1-410a-bf7a-6b0ac20983a0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:58.084682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b0f81d7-9ea1-410a-bf7a-6b0ac20983a0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:58.143204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-63323ef4-0339-4b5a-b278-2b332cf830a2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:58.157589 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-63323ef4-0339-4b5a-b278-2b332cf830a2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.346979 May 19 04:41:58.158610 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1296/2662] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:57 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:58.163467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b3d5328-ff82-45cd-96a4-f4855f48d4f0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:58.164077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b3d5328-ff82-45cd-96a4-f4855f48d4f0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:58.172355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b3d5328-ff82-45cd-96a4-f4855f48d4f0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:58.173214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b3d5328-ff82-45cd-96a4-f4855f48d4f0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:58.174310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b3d5328-ff82-45cd-96a4-f4855f48d4f0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:58.174903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b3d5328-ff82-45cd-96a4-f4855f48d4f0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:58.254916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4b0f81d7-9ea1-410a-bf7a-6b0ac20983a0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:58.289591 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4b0f81d7-9ea1-410a-bf7a-6b0ac20983a0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1264 microversion: 2.1 time: 0.225948 May 19 04:41:58.290971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1367/2663] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:58 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:41:58.488625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b3d5328-ff82-45cd-96a4-f4855f48d4f0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:58.505600 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b3d5328-ff82-45cd-96a4-f4855f48d4f0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1314 microversion: 2.1 time: 0.343349 May 19 04:41:58.506238 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1297/2664] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:58 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:58.653454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1613579267", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "fcd83891-4b75-4809-8f6d-739d7d2ed6e1"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:41:58.734948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] validate_networks() for [('fcd83891-4b75-4809-8f6d-739d7d2ed6e1', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:41:59.175947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-de21fe13-d386-4a04-9fd1-dd5f9e9bd91e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:59.177380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-de21fe13-d386-4a04-9fd1-dd5f9e9bd91e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:59.200380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de21fe13-d386-4a04-9fd1-dd5f9e9bd91e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:59.201307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de21fe13-d386-4a04-9fd1-dd5f9e9bd91e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:59.202639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de21fe13-d386-4a04-9fd1-dd5f9e9bd91e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:59.203680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de21fe13-d386-4a04-9fd1-dd5f9e9bd91e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:59.424679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:41:59.425907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:41:59.426415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:41:59.426835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:41:59.427258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:41:59.451365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:59.455439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:59.456478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:59.456988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:59.498513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Getting quotas for project d4f2dc7d2dc343dca0ca5823506171d2. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:41:59.507433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Getting quotas for user f1eaab665eaa424092568f3b20fa013a and project d4f2dc7d2dc343dca0ca5823506171d2. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:41:59.545800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:41:59.558970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:41:59.636967 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d5abbb6-9220-493e-acf0-d80293169a65 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.344878 May 19 04:41:59.645345 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1368/2665] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:41:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:41:59.650669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3644245b-9f5c-4998-9a61-fb224265d999 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:59.651652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3644245b-9f5c-4998-9a61-fb224265d999 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:59.659810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3644245b-9f5c-4998-9a61-fb224265d999 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:59.660502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3644245b-9f5c-4998-9a61-fb224265d999 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:59.661475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3644245b-9f5c-4998-9a61-fb224265d999 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:59.662153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3644245b-9f5c-4998-9a61-fb224265d999 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:59.750241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-de21fe13-d386-4a04-9fd1-dd5f9e9bd91e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:41:59.764248 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-de21fe13-d386-4a04-9fd1-dd5f9e9bd91e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.592568 May 19 04:41:59.767363 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1298/2666] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:59 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:41:59.772502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-08199a6f-1cf5-4851-b130-dfebb2e0af40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:41:59.780717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-08199a6f-1cf5-4851-b130-dfebb2e0af40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:41:59.800201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-08199a6f-1cf5-4851-b130-dfebb2e0af40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:59.800665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-08199a6f-1cf5-4851-b130-dfebb2e0af40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:41:59.801489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-08199a6f-1cf5-4851-b130-dfebb2e0af40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:41:59.802003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-08199a6f-1cf5-4851-b130-dfebb2e0af40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:00.059865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3644245b-9f5c-4998-9a61-fb224265d999 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:00.069309 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3644245b-9f5c-4998-9a61-fb224265d999 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1312 microversion: 2.1 time: 0.422462 May 19 04:42:00.071612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-08199a6f-1cf5-4851-b130-dfebb2e0af40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:00.084212 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1369/2667] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:59 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1312 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:00.090446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94ae060a-8398-48c4-a005-976e173e3cb3 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:00.091517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-94ae060a-8398-48c4-a005-976e173e3cb3 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:00.093883 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-08199a6f-1cf5-4851-b130-dfebb2e0af40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1314 microversion: 2.1 time: 0.325349 May 19 04:42:00.094509 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1299/2668] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:41:59 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:00.205944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94ae060a-8398-48c4-a005-976e173e3cb3 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:00.223682 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94ae060a-8398-48c4-a005-976e173e3cb3 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1228 microversion: 2.1 time: 0.137754 May 19 04:42:00.224936 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1370/2669] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:00 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1228 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:00.626835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-40db091a-966f-4892-85ea-dd9734c872fe req-bc5b2167-3182-4a58-9594-5aec028a8596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "386556b3-9bff-473a-94c3-61225505b4ff", "tag": "b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:00.662907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-40db091a-966f-4892-85ea-dd9734c872fe req-bc5b2167-3182-4a58-9594-5aec028a8596 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:00.663675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-40db091a-966f-4892-85ea-dd9734c872fe req-bc5b2167-3182-4a58-9594-5aec028a8596 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:00.686898 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-40db091a-966f-4892-85ea-dd9734c872fe req-bc5b2167-3182-4a58-9594-5aec028a8596 service nova] Creating event network-changed:b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5 for instance 386556b3-9bff-473a-94c3-61225505b4ff on n-h1-766726-30 May 19 04:42:00.701611 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-40db091a-966f-4892-85ea-dd9734c872fe req-bc5b2167-3182-4a58-9594-5aec028a8596 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087317 May 19 04:42:00.702687 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1300/2670] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:00.786190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-91155bec-6d82-437e-a40d-2c5611caef5a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:00.788331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-91155bec-6d82-437e-a40d-2c5611caef5a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:00.798349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91155bec-6d82-437e-a40d-2c5611caef5a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:00.799574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91155bec-6d82-437e-a40d-2c5611caef5a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:00.800794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91155bec-6d82-437e-a40d-2c5611caef5a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:00.801449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91155bec-6d82-437e-a40d-2c5611caef5a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:01.093257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-03a4c2cd-1b9a-4c49-aa2c-65df2234fc80 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:01.094596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-03a4c2cd-1b9a-4c49-aa2c-65df2234fc80 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:01.111830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03a4c2cd-1b9a-4c49-aa2c-65df2234fc80 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:01.112290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03a4c2cd-1b9a-4c49-aa2c-65df2234fc80 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:01.115259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03a4c2cd-1b9a-4c49-aa2c-65df2234fc80 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:01.115973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03a4c2cd-1b9a-4c49-aa2c-65df2234fc80 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:01.196683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-91155bec-6d82-437e-a40d-2c5611caef5a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:01.212008 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-91155bec-6d82-437e-a40d-2c5611caef5a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.432360 May 19 04:42:01.225861 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1371/2671] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:00 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:01.249970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f49fa323-9de9-459f-92c6-8f544b42cf7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:01.250943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f49fa323-9de9-459f-92c6-8f544b42cf7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:01.290365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f49fa323-9de9-459f-92c6-8f544b42cf7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:01.290823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f49fa323-9de9-459f-92c6-8f544b42cf7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:01.291842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f49fa323-9de9-459f-92c6-8f544b42cf7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:01.292433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f49fa323-9de9-459f-92c6-8f544b42cf7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:01.562481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-03a4c2cd-1b9a-4c49-aa2c-65df2234fc80 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:01.581719 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-03a4c2cd-1b9a-4c49-aa2c-65df2234fc80 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1312 microversion: 2.1 time: 0.491327 May 19 04:42:01.583972 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1301/2672] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:01 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1312 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:01.590993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4343f631-ac4f-49ab-97c0-544edd5786e6 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:01.591649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4343f631-ac4f-49ab-97c0-544edd5786e6 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:01.598973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4343f631-ac4f-49ab-97c0-544edd5786e6 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:01.599670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4343f631-ac4f-49ab-97c0-544edd5786e6 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:01.600652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4343f631-ac4f-49ab-97c0-544edd5786e6 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:01.601297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4343f631-ac4f-49ab-97c0-544edd5786e6 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:01.721928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4343f631-ac4f-49ab-97c0-544edd5786e6 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:01.731101 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4343f631-ac4f-49ab-97c0-544edd5786e6 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1286 microversion: 2.1 time: 0.144022 May 19 04:42:01.732343 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1302/2673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:01 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:01.766871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f49fa323-9de9-459f-92c6-8f544b42cf7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:01.787964 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f49fa323-9de9-459f-92c6-8f544b42cf7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1314 microversion: 2.1 time: 0.556692 May 19 04:42:01.790549 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1372/2674] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:01 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:01.825261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d3c05f84-57ed-41e8-a635-53ebb64b8ef5 req-b094abb2-6a2f-4bb6-9686-e3f446144a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5472b0-f730-4891-985f-cc16e617c486", "name": "network-vif-plugged", "status": "completed", "tag": "e8432c29-a5b3-4353-9a48-d9709801691a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:01.835920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d3c05f84-57ed-41e8-a635-53ebb64b8ef5 req-b094abb2-6a2f-4bb6-9686-e3f446144a6e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:01.836686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d3c05f84-57ed-41e8-a635-53ebb64b8ef5 req-b094abb2-6a2f-4bb6-9686-e3f446144a6e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:01.852088 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d3c05f84-57ed-41e8-a635-53ebb64b8ef5 req-b094abb2-6a2f-4bb6-9686-e3f446144a6e service nova] Creating event network-vif-plugged:e8432c29-a5b3-4353-9a48-d9709801691a for instance 2d5472b0-f730-4891-985f-cc16e617c486 on n-h2-766726-30 May 19 04:42:01.858754 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d3c05f84-57ed-41e8-a635-53ebb64b8ef5 req-b094abb2-6a2f-4bb6-9686-e3f446144a6e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124886 May 19 04:42:01.859778 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1303/2675] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:02.234779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-839b3fdb-c3e3-49ae-8d77-500bf839db4f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:02.243614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-839b3fdb-c3e3-49ae-8d77-500bf839db4f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:02.273536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-839b3fdb-c3e3-49ae-8d77-500bf839db4f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:02.274302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-839b3fdb-c3e3-49ae-8d77-500bf839db4f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:02.275676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-839b3fdb-c3e3-49ae-8d77-500bf839db4f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:02.276490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-839b3fdb-c3e3-49ae-8d77-500bf839db4f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:02.458212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:02.460130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:02.474648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:02.475781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:02.476962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:02.477703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:02.674642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-839b3fdb-c3e3-49ae-8d77-500bf839db4f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:02.683493 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-839b3fdb-c3e3-49ae-8d77-500bf839db4f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.456157 May 19 04:42:02.685056 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1373/2676] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:02 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:02.691080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-79f6a54d-96f9-47bf-9c35-fe87ed6d025f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:02.692357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-79f6a54d-96f9-47bf-9c35-fe87ed6d025f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:02.710454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79f6a54d-96f9-47bf-9c35-fe87ed6d025f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:02.711639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79f6a54d-96f9-47bf-9c35-fe87ed6d025f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:02.712686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79f6a54d-96f9-47bf-9c35-fe87ed6d025f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:02.713369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79f6a54d-96f9-47bf-9c35-fe87ed6d025f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:02.900033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:02.919745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:02.921690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:02.930149 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ea308c6-dd08-43d9-91ae-7a23ff60b52c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2955 microversion: 2.42 time: 0.473927 May 19 04:42:02.931262 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1304/2677] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:42:02 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2955 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:42:02.953879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c51e399-e66c-43a0-a5e6-f98cbb1a8c3e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:02.955046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c51e399-e66c-43a0-a5e6-f98cbb1a8c3e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:02.971992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c51e399-e66c-43a0-a5e6-f98cbb1a8c3e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:02.973319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c51e399-e66c-43a0-a5e6-f98cbb1a8c3e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:02.974440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c51e399-e66c-43a0-a5e6-f98cbb1a8c3e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:02.975835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c51e399-e66c-43a0-a5e6-f98cbb1a8c3e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:03.043188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-79f6a54d-96f9-47bf-9c35-fe87ed6d025f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:03.053855 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-79f6a54d-96f9-47bf-9c35-fe87ed6d025f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1312 microversion: 2.1 time: 0.365617 May 19 04:42:03.056111 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1374/2678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:02 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:03.069594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-74abdd25-04ea-4e87-a58e-6881ca072d18 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:03.070448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-74abdd25-04ea-4e87-a58e-6881ca072d18 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:03.083991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74abdd25-04ea-4e87-a58e-6881ca072d18 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:03.084891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74abdd25-04ea-4e87-a58e-6881ca072d18 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:03.085783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74abdd25-04ea-4e87-a58e-6881ca072d18 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:03.086227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74abdd25-04ea-4e87-a58e-6881ca072d18 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:03.238903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c51e399-e66c-43a0-a5e6-f98cbb1a8c3e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:03.251862 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c51e399-e66c-43a0-a5e6-f98cbb1a8c3e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1328 microversion: 2.1 time: 0.319340 May 19 04:42:03.253346 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1305/2679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:02 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1328 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:03.258435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fbc2f472-51c0-4622-b8d2-88a1d0c8cf82 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:03.259304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fbc2f472-51c0-4622-b8d2-88a1d0c8cf82 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:03.266857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbc2f472-51c0-4622-b8d2-88a1d0c8cf82 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:03.267596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbc2f472-51c0-4622-b8d2-88a1d0c8cf82 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:03.268583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbc2f472-51c0-4622-b8d2-88a1d0c8cf82 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:03.269363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbc2f472-51c0-4622-b8d2-88a1d0c8cf82 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:03.297318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-74abdd25-04ea-4e87-a58e-6881ca072d18 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:03.306451 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-74abdd25-04ea-4e87-a58e-6881ca072d18 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1314 microversion: 2.1 time: 0.247591 May 19 04:42:03.307370 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1375/2680] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:03 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:03.446825 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fbc2f472-51c0-4622-b8d2-88a1d0c8cf82 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.192160 May 19 04:42:03.447436 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1306/2681] 10.222.0.58 () {60 vars in 1315 bytes} [Thu May 19 04:42:03 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3/os-interface => generated 1831 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:42:03.702242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3ae00a8e-e6a9-4c0e-9854-ab73e786115b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:03.703019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3ae00a8e-e6a9-4c0e-9854-ab73e786115b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:03.711717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ae00a8e-e6a9-4c0e-9854-ab73e786115b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:03.712837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ae00a8e-e6a9-4c0e-9854-ab73e786115b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:03.713969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ae00a8e-e6a9-4c0e-9854-ab73e786115b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:03.714629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ae00a8e-e6a9-4c0e-9854-ab73e786115b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:03.951346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3ae00a8e-e6a9-4c0e-9854-ab73e786115b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:03.962338 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3ae00a8e-e6a9-4c0e-9854-ab73e786115b tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.263680 May 19 04:42:03.963592 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1376/2682] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:03 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:04.074171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-591e1a53-dfde-4b4e-ae5c-bb607559fe12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:04.075071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-591e1a53-dfde-4b4e-ae5c-bb607559fe12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:04.106204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-591e1a53-dfde-4b4e-ae5c-bb607559fe12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:04.110300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-591e1a53-dfde-4b4e-ae5c-bb607559fe12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:04.111875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-591e1a53-dfde-4b4e-ae5c-bb607559fe12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:04.112327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-591e1a53-dfde-4b4e-ae5c-bb607559fe12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:04.271078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-506e57ab-61fa-4b3b-8246-f50f9861df5b tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:04.272952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-506e57ab-61fa-4b3b-8246-f50f9861df5b tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:04.282663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-506e57ab-61fa-4b3b-8246-f50f9861df5b tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:04.283375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-506e57ab-61fa-4b3b-8246-f50f9861df5b tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:04.285771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-506e57ab-61fa-4b3b-8246-f50f9861df5b tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:04.286416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-506e57ab-61fa-4b3b-8246-f50f9861df5b tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:04.581575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-591e1a53-dfde-4b4e-ae5c-bb607559fe12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:04.589968 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-591e1a53-dfde-4b4e-ae5c-bb607559fe12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1312 microversion: 2.1 time: 0.521791 May 19 04:42:04.590543 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1307/2683] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:04 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1312 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:04.600916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b661f16c-bfd0-4427-ad86-d64d6084b91a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:04.601547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b661f16c-bfd0-4427-ad86-d64d6084b91a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:04.607749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b661f16c-bfd0-4427-ad86-d64d6084b91a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:04.608288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b661f16c-bfd0-4427-ad86-d64d6084b91a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:04.609159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b661f16c-bfd0-4427-ad86-d64d6084b91a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:04.609721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b661f16c-bfd0-4427-ad86-d64d6084b91a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:04.642987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-506e57ab-61fa-4b3b-8246-f50f9861df5b tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:04.653390 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-506e57ab-61fa-4b3b-8246-f50f9861df5b tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1328 microversion: 2.1 time: 0.386647 May 19 04:42:04.655023 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1377/2684] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:04 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1328 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:04.719858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a3a08afb-704f-4d64-bf76-4b615dd77c7a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Action: 'create', calling method: .version_select at 0x7fd31504ba60>, body: {"keypair": {"name": "tempest-keypair-309633492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA+X8I9T9pB8Zst4sdUxyIAySBnbngu/u0t3l3TCvNJwg3cLzlVr3uBlb+8MrXYHjvYtSBBu83D3FCvvon0oqiZ9TNyFDcgpzpXwOnvbTQMzGId45JRFxQ600hvGgcCfQ=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:04.735538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a3a08afb-704f-4d64-bf76-4b615dd77c7a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Getting quotas for project d3d0917d2e4b4886991ec5c714103799. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:04.743005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a3a08afb-704f-4d64-bf76-4b615dd77c7a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Getting quotas for user e1709e9b58fe4a16a3156b3141b4a297 and project d3d0917d2e4b4886991ec5c714103799. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:04.808765 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a3a08afb-704f-4d64-bf76-4b615dd77c7a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152385 May 19 04:42:04.809993 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1378/2685] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:42:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:04.961371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b661f16c-bfd0-4427-ad86-d64d6084b91a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:04.976087 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b661f16c-bfd0-4427-ad86-d64d6084b91a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1500 microversion: 2.1 time: 0.384417 May 19 04:42:04.976978 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1308/2686] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:04 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1500 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:04.986386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6bf912c3-d5aa-4735-99f8-7cd9c5dd2863 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:04.987982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6bf912c3-d5aa-4735-99f8-7cd9c5dd2863 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:05.005008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bf912c3-d5aa-4735-99f8-7cd9c5dd2863 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:05.005501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bf912c3-d5aa-4735-99f8-7cd9c5dd2863 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:05.008500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bf912c3-d5aa-4735-99f8-7cd9c5dd2863 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:05.012958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bf912c3-d5aa-4735-99f8-7cd9c5dd2863 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:05.050918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0a589f80-ddd5-43c2-aef5-918c600c0da8 req-fbf5e077-4f9c-46cd-902a-587d2e7ee28b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8a3fcd-56ca-424e-942f-9b20f93565c4", "tag": "330a2171-c3c3-401c-a445-b2277bab1da7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:05.070557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0a589f80-ddd5-43c2-aef5-918c600c0da8 req-fbf5e077-4f9c-46cd-902a-587d2e7ee28b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:05.071260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0a589f80-ddd5-43c2-aef5-918c600c0da8 req-fbf5e077-4f9c-46cd-902a-587d2e7ee28b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:05.095050 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0a589f80-ddd5-43c2-aef5-918c600c0da8 req-fbf5e077-4f9c-46cd-902a-587d2e7ee28b service nova] Creating event network-changed:330a2171-c3c3-401c-a445-b2277bab1da7 for instance be8a3fcd-56ca-424e-942f-9b20f93565c4 on n-h2-766726-30 May 19 04:42:05.112236 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0a589f80-ddd5-43c2-aef5-918c600c0da8 req-fbf5e077-4f9c-46cd-902a-587d2e7ee28b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064840 May 19 04:42:05.112855 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1309/2687] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:05.431342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6bf912c3-d5aa-4735-99f8-7cd9c5dd2863 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:05.447643 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6bf912c3-d5aa-4735-99f8-7cd9c5dd2863 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.471745 May 19 04:42:05.454183 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1379/2688] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:04 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:05.607790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a396c4b6-d39b-401a-ab4c-8fff69602781 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:05.608500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a396c4b6-d39b-401a-ab4c-8fff69602781 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:05.615076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a396c4b6-d39b-401a-ab4c-8fff69602781 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:05.615794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a396c4b6-d39b-401a-ab4c-8fff69602781 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:05.616756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a396c4b6-d39b-401a-ab4c-8fff69602781 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:05.617379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a396c4b6-d39b-401a-ab4c-8fff69602781 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:05.673949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5475517-c9dc-4f4d-96ee-ceff18c6b917 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:05.675678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5475517-c9dc-4f4d-96ee-ceff18c6b917 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:05.685756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5475517-c9dc-4f4d-96ee-ceff18c6b917 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:05.690253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5475517-c9dc-4f4d-96ee-ceff18c6b917 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:05.691246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5475517-c9dc-4f4d-96ee-ceff18c6b917 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:05.691852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5475517-c9dc-4f4d-96ee-ceff18c6b917 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:05.947487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a396c4b6-d39b-401a-ab4c-8fff69602781 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:05.956570 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a396c4b6-d39b-401a-ab4c-8fff69602781 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1312 microversion: 2.1 time: 0.352967 May 19 04:42:05.967370 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1310/2689] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:05 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1312 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:05.978390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5475517-c9dc-4f4d-96ee-ceff18c6b917 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:05.987537 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5475517-c9dc-4f4d-96ee-ceff18c6b917 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1328 microversion: 2.1 time: 0.320219 May 19 04:42:05.988737 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1380/2690] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:05 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1328 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:05.994233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-34acc092-8e9f-4522-b4de-cf34975513eb tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:05.995213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-34acc092-8e9f-4522-b4de-cf34975513eb tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:06.002844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34acc092-8e9f-4522-b4de-cf34975513eb tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:06.003304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34acc092-8e9f-4522-b4de-cf34975513eb tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:06.004393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34acc092-8e9f-4522-b4de-cf34975513eb tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:06.004992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34acc092-8e9f-4522-b4de-cf34975513eb tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:06.161501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-34acc092-8e9f-4522-b4de-cf34975513eb tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:06.173363 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-34acc092-8e9f-4522-b4de-cf34975513eb tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1500 microversion: 2.1 time: 0.183399 May 19 04:42:06.174443 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1311/2691] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:05 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1500 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:06.470434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3aed69c6-f850-4bba-b4e7-085edbbbe46a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:06.471052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3aed69c6-f850-4bba-b4e7-085edbbbe46a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:06.488189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3aed69c6-f850-4bba-b4e7-085edbbbe46a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:06.488635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3aed69c6-f850-4bba-b4e7-085edbbbe46a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:06.489509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3aed69c6-f850-4bba-b4e7-085edbbbe46a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:06.489921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3aed69c6-f850-4bba-b4e7-085edbbbe46a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:06.715895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3aed69c6-f850-4bba-b4e7-085edbbbe46a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:06.724525 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3aed69c6-f850-4bba-b4e7-085edbbbe46a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.257847 May 19 04:42:06.725633 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1381/2692] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:06 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:06.971112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=12 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:06.975774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf75a940-4c65-4ca1-b064-4660462dc274 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:06.976694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf75a940-4c65-4ca1-b064-4660462dc274 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:06.987360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf75a940-4c65-4ca1-b064-4660462dc274 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:06.987791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf75a940-4c65-4ca1-b064-4660462dc274 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:06.988576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf75a940-4c65-4ca1-b064-4660462dc274 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:06.989015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf75a940-4c65-4ca1-b064-4660462dc274 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:07.005157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6b609dd0-81b9-4c1c-9b21-870b2f65116e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:07.005854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6b609dd0-81b9-4c1c-9b21-870b2f65116e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:07.016715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b609dd0-81b9-4c1c-9b21-870b2f65116e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:07.019625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b609dd0-81b9-4c1c-9b21-870b2f65116e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:07.020439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b609dd0-81b9-4c1c-9b21-870b2f65116e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:07.024980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b609dd0-81b9-4c1c-9b21-870b2f65116e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:07.034179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:07.043650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=14 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:07.335285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6b609dd0-81b9-4c1c-9b21-870b2f65116e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:07.351217 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6b609dd0-81b9-4c1c-9b21-870b2f65116e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1328 microversion: 2.1 time: 0.350784 May 19 04:42:07.352117 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1382/2693] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:06 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1328 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:07.357439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a6280ac-6ab4-4bdf-87a6-a5a6f116f575 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:07.358315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a6280ac-6ab4-4bdf-87a6-a5a6f116f575 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:07.365157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a6280ac-6ab4-4bdf-87a6-a5a6f116f575 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:07.366150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a6280ac-6ab4-4bdf-87a6-a5a6f116f575 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:07.366946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a6280ac-6ab4-4bdf-87a6-a5a6f116f575 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:07.367392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a6280ac-6ab4-4bdf-87a6-a5a6f116f575 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:07.371822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:07.373310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cf75a940-4c65-4ca1-b064-4660462dc274 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:07.387432 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf75a940-4c65-4ca1-b064-4660462dc274 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1312 microversion: 2.1 time: 0.415552 May 19 04:42:07.388687 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1312/2694] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:06 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1312 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:07.546533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a6280ac-6ab4-4bdf-87a6-a5a6f116f575 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:07.560851 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a6280ac-6ab4-4bdf-87a6-a5a6f116f575 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1500 microversion: 2.1 time: 0.207197 May 19 04:42:07.562059 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1383/2695] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:07 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1500 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:07.741443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5f2fdb91-64d0-46a4-8612-1f2196ea19f2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:07.742452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5f2fdb91-64d0-46a4-8612-1f2196ea19f2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:07.750248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f2fdb91-64d0-46a4-8612-1f2196ea19f2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:07.751050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f2fdb91-64d0-46a4-8612-1f2196ea19f2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:07.751984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f2fdb91-64d0-46a4-8612-1f2196ea19f2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:07.753255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f2fdb91-64d0-46a4-8612-1f2196ea19f2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:07.857027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a3b5ae95-3064-437a-a6d0-5940a2272c86 req-1f610712-f244-44f8-8fd1-ef7db979d352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386556b3-9bff-473a-94c3-61225505b4ff", "name": "network-vif-plugged", "status": "completed", "tag": "b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:07.875004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a3b5ae95-3064-437a-a6d0-5940a2272c86 req-1f610712-f244-44f8-8fd1-ef7db979d352 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:07.875931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a3b5ae95-3064-437a-a6d0-5940a2272c86 req-1f610712-f244-44f8-8fd1-ef7db979d352 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:07.901391 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a3b5ae95-3064-437a-a6d0-5940a2272c86 req-1f610712-f244-44f8-8fd1-ef7db979d352 service nova] Creating event network-vif-plugged:b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5 for instance 386556b3-9bff-473a-94c3-61225505b4ff on n-h1-766726-30 May 19 04:42:07.907452 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a3b5ae95-3064-437a-a6d0-5940a2272c86 req-1f610712-f244-44f8-8fd1-ef7db979d352 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057970 May 19 04:42:07.908903 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1384/2696] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:42:07.964406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5f2fdb91-64d0-46a4-8612-1f2196ea19f2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:07.973884 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5f2fdb91-64d0-46a4-8612-1f2196ea19f2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.236715 May 19 04:42:07.974673 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1313/2697] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:07 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:08.371236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df891545-f0a8-4d9e-84c3-34f90b46d187 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:08.372075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df891545-f0a8-4d9e-84c3-34f90b46d187 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:08.386351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df891545-f0a8-4d9e-84c3-34f90b46d187 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:08.387089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df891545-f0a8-4d9e-84c3-34f90b46d187 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:08.388090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df891545-f0a8-4d9e-84c3-34f90b46d187 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:08.388911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df891545-f0a8-4d9e-84c3-34f90b46d187 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:08.404467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86b7096c-6d88-437c-b1b0-45e3845fe4d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:08.406016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-86b7096c-6d88-437c-b1b0-45e3845fe4d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:08.419752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86b7096c-6d88-437c-b1b0-45e3845fe4d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:08.420702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86b7096c-6d88-437c-b1b0-45e3845fe4d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:08.421655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86b7096c-6d88-437c-b1b0-45e3845fe4d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:08.427103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86b7096c-6d88-437c-b1b0-45e3845fe4d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:08.815529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-df891545-f0a8-4d9e-84c3-34f90b46d187 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:08.826000 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df891545-f0a8-4d9e-84c3-34f90b46d187 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1328 microversion: 2.1 time: 0.461350 May 19 04:42:08.827331 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1385/2698] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:08 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1328 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:08.835269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d925a06a-4245-48f6-aeb6-14eb81915001 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:08.836394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d925a06a-4245-48f6-aeb6-14eb81915001 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:08.842939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d925a06a-4245-48f6-aeb6-14eb81915001 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:08.843395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d925a06a-4245-48f6-aeb6-14eb81915001 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:08.844170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d925a06a-4245-48f6-aeb6-14eb81915001 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:08.844893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d925a06a-4245-48f6-aeb6-14eb81915001 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:08.863117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-86b7096c-6d88-437c-b1b0-45e3845fe4d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:08.876647 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-86b7096c-6d88-437c-b1b0-45e3845fe4d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1312 microversion: 2.1 time: 0.475985 May 19 04:42:08.878042 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1314/2699] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:08 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1312 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:09.002171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2bf2084a-56e4-429d-aaa9-891b6d788b72 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:09.003815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2bf2084a-56e4-429d-aaa9-891b6d788b72 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:09.017847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bf2084a-56e4-429d-aaa9-891b6d788b72 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:09.018996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bf2084a-56e4-429d-aaa9-891b6d788b72 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:09.020604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bf2084a-56e4-429d-aaa9-891b6d788b72 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:09.021235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bf2084a-56e4-429d-aaa9-891b6d788b72 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:09.264963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d925a06a-4245-48f6-aeb6-14eb81915001 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:09.274756 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d925a06a-4245-48f6-aeb6-14eb81915001 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 200 len: 1500 microversion: 2.1 time: 0.444987 May 19 04:42:09.278036 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1386/2700] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:08 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 1500 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:09.496905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2bf2084a-56e4-429d-aaa9-891b6d788b72 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:09.507987 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2bf2084a-56e4-429d-aaa9-891b6d788b72 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.517592 May 19 04:42:09.517485 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1315/2701] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:08 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:09.731557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2e149aca-7c5c-4132-a8a6-ae00434c220d req-e9c26174-0daf-4af0-949a-f944687795f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5472b0-f730-4891-985f-cc16e617c486", "name": "network-vif-deleted", "tag": "e8432c29-a5b3-4353-9a48-d9709801691a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:09.735351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=14 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:09.744332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2e149aca-7c5c-4132-a8a6-ae00434c220d req-e9c26174-0daf-4af0-949a-f944687795f0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:09.744778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2e149aca-7c5c-4132-a8a6-ae00434c220d req-e9c26174-0daf-4af0-949a-f944687795f0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:09.760096 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2e149aca-7c5c-4132-a8a6-ae00434c220d req-e9c26174-0daf-4af0-949a-f944687795f0 service nova] Creating event network-vif-deleted:e8432c29-a5b3-4353-9a48-d9709801691a for instance 2d5472b0-f730-4891-985f-cc16e617c486 on n-h2-766726-30 May 19 04:42:09.765138 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2e149aca-7c5c-4132-a8a6-ae00434c220d req-e9c26174-0daf-4af0-949a-f944687795f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037469 May 19 04:42:09.765784 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1387/2702] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:09.845828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-092f1b08-5cdb-4867-8c01-0b9ef9e31d0a tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:09.846679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-092f1b08-5cdb-4867-8c01-0b9ef9e31d0a tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:09.854466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-092f1b08-5cdb-4867-8c01-0b9ef9e31d0a tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:09.855516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-092f1b08-5cdb-4867-8c01-0b9ef9e31d0a tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:09.856556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-092f1b08-5cdb-4867-8c01-0b9ef9e31d0a tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:09.857354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-092f1b08-5cdb-4867-8c01-0b9ef9e31d0a tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:09.896841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad7534b3-0fa1-4ff9-ba25-515d2a09984a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:09.898535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ad7534b3-0fa1-4ff9-ba25-515d2a09984a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:09.908826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad7534b3-0fa1-4ff9-ba25-515d2a09984a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:09.909344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad7534b3-0fa1-4ff9-ba25-515d2a09984a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:09.910152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad7534b3-0fa1-4ff9-ba25-515d2a09984a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:09.910777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad7534b3-0fa1-4ff9-ba25-515d2a09984a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:10.066650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-092f1b08-5cdb-4867-8c01-0b9ef9e31d0a tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:10.075322 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-092f1b08-5cdb-4867-8c01-0b9ef9e31d0a tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1328 microversion: 2.1 time: 0.235100 May 19 04:42:10.085858 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1316/2703] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:09 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1328 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:10.096992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ad7534b3-0fa1-4ff9-ba25-515d2a09984a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:10.107574 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad7534b3-0fa1-4ff9-ba25-515d2a09984a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1461 microversion: 2.1 time: 0.216489 May 19 04:42:10.108248 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1388/2704] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:09 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1461 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:10.126996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:10.128059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:10.134308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:10.134762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:10.135536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:10.135977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:10.230462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:10.237328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Old instance type m1.heat2, new instance type m1.heat {{(pid=124819) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 04:42:10.244472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:42:10.244904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:42:10.245473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:42:10.246057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:42:10.246340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:42:10.298500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:10.299131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:10.306048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:10.306511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:10.307272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:10.311031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:10.329267 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 HTTP/1.1 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2d5472b0-f730-4891-985f-cc16e617c486'} May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:10.331973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:10.338216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:10.338216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:10.338216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:10.338216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:42:10.338216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:42:10.338216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:42:10.338216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:10.338216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:42:10.339156 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df0d1756-7d31-4508-89e5-fcbe53b23d58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 404 len: 111 microversion: 2.1 time: 0.043631 May 19 04:42:10.340160 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1389/2705] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:10 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:42:10.380998 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c938108-48d6-4391-8278-acbd26952da1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff/action" status: 202 len: 0 microversion: 2.1 time: 0.258550 May 19 04:42:10.389770 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1317/2706] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:42:10 2022] POST /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:42:10.395041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-67e06ab6-d5dc-4902-b550-57946b58626a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:10.395793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-67e06ab6-d5dc-4902-b550-57946b58626a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:10.412706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67e06ab6-d5dc-4902-b550-57946b58626a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:10.413322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67e06ab6-d5dc-4902-b550-57946b58626a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:10.414231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67e06ab6-d5dc-4902-b550-57946b58626a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:10.414635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67e06ab6-d5dc-4902-b550-57946b58626a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:10.526174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-37a573e5-9575-43dd-8cc0-3d1879e1413e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:10.527053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-37a573e5-9575-43dd-8cc0-3d1879e1413e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:10.537811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37a573e5-9575-43dd-8cc0-3d1879e1413e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:10.538266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37a573e5-9575-43dd-8cc0-3d1879e1413e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:10.539063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37a573e5-9575-43dd-8cc0-3d1879e1413e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:10.539508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37a573e5-9575-43dd-8cc0-3d1879e1413e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:10.784150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-37a573e5-9575-43dd-8cc0-3d1879e1413e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:10.793648 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-37a573e5-9575-43dd-8cc0-3d1879e1413e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.272287 May 19 04:42:10.795221 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1318/2707] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:10 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:10.799898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1189360846", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "56a7f773-0e0a-4675-b687-c0077a456785"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:10.864887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] validate_networks() for [('56a7f773-0e0a-4675-b687-c0077a456785', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:42:10.960809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-67e06ab6-d5dc-4902-b550-57946b58626a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:10.972817 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-67e06ab6-d5dc-4902-b550-57946b58626a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1470 microversion: 2.1 time: 0.582106 May 19 04:42:10.973442 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1390/2708] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:10 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1470 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:10.978860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-224eb065-e83d-4eb1-8a25-c2ecff0be0c1 req-423c1bb7-cd92-488b-a7b8-01d4de59be95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8a3fcd-56ca-424e-942f-9b20f93565c4", "name": "network-vif-plugged", "status": "completed", "tag": "330a2171-c3c3-401c-a445-b2277bab1da7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:10.990305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-224eb065-e83d-4eb1-8a25-c2ecff0be0c1 req-423c1bb7-cd92-488b-a7b8-01d4de59be95 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:10.991141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-224eb065-e83d-4eb1-8a25-c2ecff0be0c1 req-423c1bb7-cd92-488b-a7b8-01d4de59be95 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:11.003728 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-224eb065-e83d-4eb1-8a25-c2ecff0be0c1 req-423c1bb7-cd92-488b-a7b8-01d4de59be95 service nova] Creating event network-vif-plugged:330a2171-c3c3-401c-a445-b2277bab1da7 for instance be8a3fcd-56ca-424e-942f-9b20f93565c4 on n-h2-766726-30 May 19 04:42:11.010174 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-224eb065-e83d-4eb1-8a25-c2ecff0be0c1 req-423c1bb7-cd92-488b-a7b8-01d4de59be95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 May 19 04:42:11.010878 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1391/2709] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:11.094960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cc616a9e-3d1d-4cb9-a048-08df70a8ca84 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:11.095924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cc616a9e-3d1d-4cb9-a048-08df70a8ca84 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:11.105476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc616a9e-3d1d-4cb9-a048-08df70a8ca84 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:11.106448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc616a9e-3d1d-4cb9-a048-08df70a8ca84 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:11.107529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc616a9e-3d1d-4cb9-a048-08df70a8ca84 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:11.108341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc616a9e-3d1d-4cb9-a048-08df70a8ca84 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:11.772754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cc616a9e-3d1d-4cb9-a048-08df70a8ca84 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:11.781930 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cc616a9e-3d1d-4cb9-a048-08df70a8ca84 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1328 microversion: 2.1 time: 0.692439 May 19 04:42:11.793013 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1392/2710] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:11 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1328 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:11.813340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5fdb91f-9a4e-4e28-852b-2942fcce07cb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:11.814561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5fdb91f-9a4e-4e28-852b-2942fcce07cb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:11.822486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5fdb91f-9a4e-4e28-852b-2942fcce07cb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:11.822951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5fdb91f-9a4e-4e28-852b-2942fcce07cb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:11.823774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5fdb91f-9a4e-4e28-852b-2942fcce07cb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:11.824265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5fdb91f-9a4e-4e28-852b-2942fcce07cb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:11.825845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:42:11.827085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:42:11.827776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:42:11.828357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:42:11.828866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:42:11.843022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:11.843914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:11.844881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:11.845608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:11.867293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:11.873888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for user 1e14ea8dad314974bf5f4e8e51b88349 and project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:11.890644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:42:11.893044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:42:11.906871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:11.956844 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cdb51662-4f90-4a49-8b29-951bc962cc9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160360 May 19 04:42:11.958170 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1319/2711] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:42:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:42:11.991932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1df3422b-c3e3-4555-b9b4-696acb95d8f4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:11.992614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1df3422b-c3e3-4555-b9b4-696acb95d8f4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:12.011501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5fdb91f-9a4e-4e28-852b-2942fcce07cb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:12.019708 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5fdb91f-9a4e-4e28-852b-2942fcce07cb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.213115 May 19 04:42:12.020296 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1393/2712] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:11 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:12.029383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-315d31cc-d395-4804-acef-b9fc5abbd2a1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:12.030324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-315d31cc-d395-4804-acef-b9fc5abbd2a1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:12.039923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-315d31cc-d395-4804-acef-b9fc5abbd2a1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:12.040522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-315d31cc-d395-4804-acef-b9fc5abbd2a1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:12.041690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-315d31cc-d395-4804-acef-b9fc5abbd2a1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:12.042460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-315d31cc-d395-4804-acef-b9fc5abbd2a1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:12.062912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1df3422b-c3e3-4555-b9b4-696acb95d8f4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:12.071711 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1df3422b-c3e3-4555-b9b4-696acb95d8f4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1215 microversion: 2.1 time: 0.098387 May 19 04:42:12.072934 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1320/2713] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:11 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:12.204561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-315d31cc-d395-4804-acef-b9fc5abbd2a1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:12.213715 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-315d31cc-d395-4804-acef-b9fc5abbd2a1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1470 microversion: 2.1 time: 0.191952 May 19 04:42:12.214280 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1394/2714] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:12 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:12.802313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0044767c-76d0-4910-a72f-e74e9899393e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:12.803272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0044767c-76d0-4910-a72f-e74e9899393e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:12.810492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0044767c-76d0-4910-a72f-e74e9899393e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:12.810938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0044767c-76d0-4910-a72f-e74e9899393e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:12.812056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0044767c-76d0-4910-a72f-e74e9899393e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:12.812675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0044767c-76d0-4910-a72f-e74e9899393e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:12.973315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0044767c-76d0-4910-a72f-e74e9899393e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:12.982782 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0044767c-76d0-4910-a72f-e74e9899393e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1328 microversion: 2.1 time: 0.186707 May 19 04:42:12.983366 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1321/2715] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:12 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1328 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:13.037599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-85687310-1523-49ac-93a7-be16d5c56747 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:13.038210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-85687310-1523-49ac-93a7-be16d5c56747 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:13.045176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85687310-1523-49ac-93a7-be16d5c56747 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:13.045629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85687310-1523-49ac-93a7-be16d5c56747 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:13.046411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85687310-1523-49ac-93a7-be16d5c56747 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:13.046847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85687310-1523-49ac-93a7-be16d5c56747 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:13.089477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2e87f43d-0b87-4796-a5c6-9c7e3c27dea8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:13.090093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2e87f43d-0b87-4796-a5c6-9c7e3c27dea8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:13.101593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e87f43d-0b87-4796-a5c6-9c7e3c27dea8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:13.102117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e87f43d-0b87-4796-a5c6-9c7e3c27dea8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:13.103401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e87f43d-0b87-4796-a5c6-9c7e3c27dea8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:13.103854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e87f43d-0b87-4796-a5c6-9c7e3c27dea8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:13.210331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2e87f43d-0b87-4796-a5c6-9c7e3c27dea8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:13.218648 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2e87f43d-0b87-4796-a5c6-9c7e3c27dea8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1211 microversion: 2.1 time: 0.133582 May 19 04:42:13.224926 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1322/2716] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:13 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1211 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:13.237934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5331d35f-4b89-44b2-b650-adb4b5a0b47a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:13.241584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5331d35f-4b89-44b2-b650-adb4b5a0b47a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:13.244897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-85687310-1523-49ac-93a7-be16d5c56747 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:13.257516 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-85687310-1523-49ac-93a7-be16d5c56747 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.222138 May 19 04:42:13.260019 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1395/2717] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:13 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:13.265664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5331d35f-4b89-44b2-b650-adb4b5a0b47a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:13.266388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5331d35f-4b89-44b2-b650-adb4b5a0b47a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:13.267349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5331d35f-4b89-44b2-b650-adb4b5a0b47a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:13.267786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5331d35f-4b89-44b2-b650-adb4b5a0b47a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:13.424292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5331d35f-4b89-44b2-b650-adb4b5a0b47a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:13.434627 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5331d35f-4b89-44b2-b650-adb4b5a0b47a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1470 microversion: 2.1 time: 0.207401 May 19 04:42:13.435264 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1323/2718] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:13 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1470 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:14.002878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e659ecc0-7a5b-4956-9441-371077ad2080 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:14.003683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e659ecc0-7a5b-4956-9441-371077ad2080 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:14.017737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e659ecc0-7a5b-4956-9441-371077ad2080 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.018473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e659ecc0-7a5b-4956-9441-371077ad2080 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.019414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e659ecc0-7a5b-4956-9441-371077ad2080 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.020165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e659ecc0-7a5b-4956-9441-371077ad2080 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.209774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e659ecc0-7a5b-4956-9441-371077ad2080 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:14.219253 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e659ecc0-7a5b-4956-9441-371077ad2080 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1528 microversion: 2.1 time: 0.223204 May 19 04:42:14.230207 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1396/2719] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:13 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1528 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:14.237765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f85706bc-5102-4b6d-ba66-b92d6098d95e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:14.238406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f85706bc-5102-4b6d-ba66-b92d6098d95e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:14.239391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a663df2a-1297-4527-8d5c-7290177a9c29 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:14.240252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a663df2a-1297-4527-8d5c-7290177a9c29 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:14.247523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a663df2a-1297-4527-8d5c-7290177a9c29 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.248706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a663df2a-1297-4527-8d5c-7290177a9c29 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.250142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a663df2a-1297-4527-8d5c-7290177a9c29 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.250923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a663df2a-1297-4527-8d5c-7290177a9c29 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.257622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f85706bc-5102-4b6d-ba66-b92d6098d95e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.258322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f85706bc-5102-4b6d-ba66-b92d6098d95e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.260307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f85706bc-5102-4b6d-ba66-b92d6098d95e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.260613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f85706bc-5102-4b6d-ba66-b92d6098d95e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.387979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f85706bc-5102-4b6d-ba66-b92d6098d95e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:14.395696 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f85706bc-5102-4b6d-ba66-b92d6098d95e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1273 microversion: 2.1 time: 0.163541 May 19 04:42:14.405793 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1324/2720] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:14 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:14.405793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-922c190f-dbfe-45b6-ba18-9edc7c3fec0e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:14.405793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-922c190f-dbfe-45b6-ba18-9edc7c3fec0e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:14.408468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-922c190f-dbfe-45b6-ba18-9edc7c3fec0e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.408940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-922c190f-dbfe-45b6-ba18-9edc7c3fec0e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.409763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-922c190f-dbfe-45b6-ba18-9edc7c3fec0e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.410261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-922c190f-dbfe-45b6-ba18-9edc7c3fec0e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.560409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a663df2a-1297-4527-8d5c-7290177a9c29 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:14.572239 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a663df2a-1297-4527-8d5c-7290177a9c29 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1528 microversion: 2.1 time: 0.337520 May 19 04:42:14.575562 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1397/2721] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:14 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1528 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:14.584677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9187ded-3399-436c-93c3-2a52c030783c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:14.586914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a9187ded-3399-436c-93c3-2a52c030783c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:14.600176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9187ded-3399-436c-93c3-2a52c030783c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.602421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9187ded-3399-436c-93c3-2a52c030783c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.603328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9187ded-3399-436c-93c3-2a52c030783c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.604472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9187ded-3399-436c-93c3-2a52c030783c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.684933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-922c190f-dbfe-45b6-ba18-9edc7c3fec0e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:14.695165 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-922c190f-dbfe-45b6-ba18-9edc7c3fec0e tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.297202 May 19 04:42:14.700791 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1325/2722] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:14 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:14.761802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=22 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:14.789327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:14.789833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:14.805862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.806265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.807327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.807767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.835305 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] HTTP exception thrown: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Request method failure captured: May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 HTTP/1.1 May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcqVDLWfvUEgfSDdzCed446fMoRiD-e85ouB1iqGinx64T-iFLXT-gmheuoupeSha9OtIyojHUovdj6BXW5WYjCHHfwfk32U7rVZxSc8ZZ57Zq8CtThxJhTHUuqZ4qcCU2bXeDrJRHoJHD3Ha0QuMoTh2Rs4eQCTr9pn5lRMtOfMDzk May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: f6c2613296f2435f84513bfc953af75d May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2099900130 May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6c2613296f2435f84513bfc953af75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6c2613296f2435f84513bfc953af75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6c2613296f2435f84513bfc953af75d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6c2613296f2435f84513bfc953af75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2099900130 May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: f6c2613296f2435f84513bfc953af75d May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2099900130 May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2099900130-project May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: ef6a61ceaa664a48b867a71142bc2680 May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2099900130-project May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'be8a3fcd-56ca-424e-942f-9b20f93565c4'} May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:42:14.838433 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:14.842174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Returning 404 to user: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:42:14.845964 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b9b98fe7-f0b2-4477-81cf-292a40a8faa0 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] 10.222.0.58 "DELETE /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 404 len: 111 microversion: 2.1 time: 0.141160 May 19 04:42:14.850765 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1326/2723] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:42:14 2022] DELETE /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:42:14.857130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0b42abd-ca58-472c-8d65-1864ebedd4eb tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:14.857908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d0b42abd-ca58-472c-8d65-1864ebedd4eb tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:14.867902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0b42abd-ca58-472c-8d65-1864ebedd4eb tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.868342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0b42abd-ca58-472c-8d65-1864ebedd4eb tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.869159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0b42abd-ca58-472c-8d65-1864ebedd4eb tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:14.873685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0b42abd-ca58-472c-8d65-1864ebedd4eb tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:14.884975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a9187ded-3399-436c-93c3-2a52c030783c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:14.895650 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a9187ded-3399-436c-93c3-2a52c030783c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1470 microversion: 2.1 time: 0.318053 May 19 04:42:14.896177 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1398/2724] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:14 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:15.092315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d0b42abd-ca58-472c-8d65-1864ebedd4eb tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:15.103136 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d0b42abd-ca58-472c-8d65-1864ebedd4eb tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1528 microversion: 2.1 time: 0.250895 May 19 04:42:15.104196 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1327/2725] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:14 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1528 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:15.119688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Action: 'update', calling method: >, body: {"server": {"name": "be8a3fcd-56ca-424e-942f-9b20f93565c4_new"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:15.121007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:15.128990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.129469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.130241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.130675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.145233 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] HTTP exception thrown: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Request method failure captured: May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: request: PUT /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 HTTP/1.1 May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 64 May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcqVDLWfvUEgfSDdzCed446fMoRiD-e85ouB1iqGinx64T-iFLXT-gmheuoupeSha9OtIyojHUovdj6BXW5WYjCHHfwfk32U7rVZxSc8ZZ57Zq8CtThxJhTHUuqZ4qcCU2bXeDrJRHoJHD3Ha0QuMoTh2Rs4eQCTr9pn5lRMtOfMDzk May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: f6c2613296f2435f84513bfc953af75d May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2099900130 May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6c2613296f2435f84513bfc953af75d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6c2613296f2435f84513bfc953af75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6c2613296f2435f84513bfc953af75d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6c2613296f2435f84513bfc953af75d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2099900130 May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: f6c2613296f2435f84513bfc953af75d May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2099900130 May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2099900130-project May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: ef6a61ceaa664a48b867a71142bc2680 May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2099900130-project May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "be8a3fcd-56ca-424e-942f-9b20f93565c4_new"}} May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'be8a3fcd-56ca-424e-942f-9b20f93565c4', 'body': {'server': {'name': 'be8a3fcd-56ca-424e-942f-9b20f93565c4_new'}}} May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 04:42:15.147592 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 917, in update May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:15.151364 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:15.153504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] Returning 404 to user: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:42:15.154546 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-abbfb33c-a630-459f-a01f-ff62ec246e67 tempest-ServersNegativeTestMultiTenantJSON-2099900130 tempest-ServersNegativeTestMultiTenantJSON-2099900130-project] 10.222.0.58 "PUT /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 404 len: 111 microversion: 2.1 time: 0.039069 May 19 04:42:15.155460 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1399/2726] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 04:42:15 2022] PUT /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:42:15.164615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-05b9722a-6116-49ec-9487-6c5b15ed95fe tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:15.165184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-05b9722a-6116-49ec-9487-6c5b15ed95fe tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:15.171342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05b9722a-6116-49ec-9487-6c5b15ed95fe tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.171799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05b9722a-6116-49ec-9487-6c5b15ed95fe tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.172576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05b9722a-6116-49ec-9487-6c5b15ed95fe tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.173021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05b9722a-6116-49ec-9487-6c5b15ed95fe tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.202064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-05b9722a-6116-49ec-9487-6c5b15ed95fe tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:42:15.254004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:15.293444 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-05b9722a-6116-49ec-9487-6c5b15ed95fe tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "DELETE /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 204 len: 0 microversion: 2.1 time: 0.132706 May 19 04:42:15.294720 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1328/2727] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:42:15 2022] DELETE /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:42:15.302560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4aa0e10f-5066-42d9-888f-7605579a134d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:15.304428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4aa0e10f-5066-42d9-888f-7605579a134d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:15.316345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aa0e10f-5066-42d9-888f-7605579a134d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.316796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aa0e10f-5066-42d9-888f-7605579a134d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.317644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aa0e10f-5066-42d9-888f-7605579a134d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.318083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aa0e10f-5066-42d9-888f-7605579a134d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.414233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-19cf44b2-56ed-4e55-99b4-b964749e0bd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:15.415083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-19cf44b2-56ed-4e55-99b4-b964749e0bd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:15.421584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19cf44b2-56ed-4e55-99b4-b964749e0bd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.422030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19cf44b2-56ed-4e55-99b4-b964749e0bd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.422797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19cf44b2-56ed-4e55-99b4-b964749e0bd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.423232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19cf44b2-56ed-4e55-99b4-b964749e0bd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.643321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4aa0e10f-5066-42d9-888f-7605579a134d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:15.655342 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4aa0e10f-5066-42d9-888f-7605579a134d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1534 microversion: 2.1 time: 0.356528 May 19 04:42:15.656467 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1400/2728] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:15 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1534 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:15.686525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-19cf44b2-56ed-4e55-99b4-b964749e0bd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:15.695278 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-19cf44b2-56ed-4e55-99b4-b964749e0bd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1315 microversion: 2.1 time: 0.285848 May 19 04:42:15.695846 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1329/2729] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:15 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:15.714049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-25dafbce-dff5-4314-b4e3-6a8abbd69379 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:15.714728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-25dafbce-dff5-4314-b4e3-6a8abbd69379 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:15.721004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25dafbce-dff5-4314-b4e3-6a8abbd69379 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.721479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25dafbce-dff5-4314-b4e3-6a8abbd69379 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.722410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25dafbce-dff5-4314-b4e3-6a8abbd69379 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.723117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25dafbce-dff5-4314-b4e3-6a8abbd69379 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.913385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2e63b270-8c70-43df-9f63-2fef5150999e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:15.914403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2e63b270-8c70-43df-9f63-2fef5150999e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:15.922005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e63b270-8c70-43df-9f63-2fef5150999e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.922506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e63b270-8c70-43df-9f63-2fef5150999e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.923952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e63b270-8c70-43df-9f63-2fef5150999e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:15.924601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e63b270-8c70-43df-9f63-2fef5150999e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:15.966157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-25dafbce-dff5-4314-b4e3-6a8abbd69379 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:15.973728 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-25dafbce-dff5-4314-b4e3-6a8abbd69379 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.264257 May 19 04:42:15.974674 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1401/2730] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:15 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:16.135614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2e63b270-8c70-43df-9f63-2fef5150999e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:16.154110 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2e63b270-8c70-43df-9f63-2fef5150999e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.243177 May 19 04:42:16.155866 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1330/2731] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:15 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:16.216384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-48d03573-082d-456f-814f-7d44cbf96012 req-ade3902d-25cf-488d-a107-0a19730e264b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b5cdae-ce14-4498-b192-9fc681612c20", "tag": "8d3eb248-a6e2-4c0b-9b5c-8f11b6e6f1da"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:16.224271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:16.227535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-48d03573-082d-456f-814f-7d44cbf96012 req-ade3902d-25cf-488d-a107-0a19730e264b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:16.228326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-48d03573-082d-456f-814f-7d44cbf96012 req-ade3902d-25cf-488d-a107-0a19730e264b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:16.250106 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-48d03573-082d-456f-814f-7d44cbf96012 req-ade3902d-25cf-488d-a107-0a19730e264b service nova] Creating event network-changed:8d3eb248-a6e2-4c0b-9b5c-8f11b6e6f1da for instance 96b5cdae-ce14-4498-b192-9fc681612c20 on n-h2-766726-30 May 19 04:42:16.254911 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-48d03573-082d-456f-814f-7d44cbf96012 req-ade3902d-25cf-488d-a107-0a19730e264b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043001 May 19 04:42:16.255522 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1402/2732] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:16.671988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e25dcca-9edd-4bd6-96f9-ba2c864eef2e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:16.672629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7e25dcca-9edd-4bd6-96f9-ba2c864eef2e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:16.680944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e25dcca-9edd-4bd6-96f9-ba2c864eef2e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:16.681555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e25dcca-9edd-4bd6-96f9-ba2c864eef2e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:16.682365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e25dcca-9edd-4bd6-96f9-ba2c864eef2e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:16.682894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e25dcca-9edd-4bd6-96f9-ba2c864eef2e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:16.717498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3afca14a-db0c-4d4c-9cb2-7704a308eded tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:16.719099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3afca14a-db0c-4d4c-9cb2-7704a308eded tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:16.730699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3afca14a-db0c-4d4c-9cb2-7704a308eded tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:16.731639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3afca14a-db0c-4d4c-9cb2-7704a308eded tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:16.733886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3afca14a-db0c-4d4c-9cb2-7704a308eded tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:16.734880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3afca14a-db0c-4d4c-9cb2-7704a308eded tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:17.069469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3afca14a-db0c-4d4c-9cb2-7704a308eded tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:17.078739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e25dcca-9edd-4bd6-96f9-ba2c864eef2e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:17.085981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:17.095154 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e25dcca-9edd-4bd6-96f9-ba2c864eef2e tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1534 microversion: 2.1 time: 0.427163 May 19 04:42:17.096719 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1331/2733] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:16 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1534 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:17.101798 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3afca14a-db0c-4d4c-9cb2-7704a308eded tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1315 microversion: 2.1 time: 0.389748 May 19 04:42:17.104685 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1403/2734] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:16 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:17.113179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-27e8f3fb-e497-4327-a16a-04cd45a9a112 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:17.113880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-27e8f3fb-e497-4327-a16a-04cd45a9a112 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:17.127045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2efbaad-0485-457d-9573-5f37638ac87c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:17.127764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d2efbaad-0485-457d-9573-5f37638ac87c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:17.128543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27e8f3fb-e497-4327-a16a-04cd45a9a112 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:17.129100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27e8f3fb-e497-4327-a16a-04cd45a9a112 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:17.129942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27e8f3fb-e497-4327-a16a-04cd45a9a112 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:17.130691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27e8f3fb-e497-4327-a16a-04cd45a9a112 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:17.141239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2efbaad-0485-457d-9573-5f37638ac87c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:17.141711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2efbaad-0485-457d-9573-5f37638ac87c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:17.145584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2efbaad-0485-457d-9573-5f37638ac87c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:17.146131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2efbaad-0485-457d-9573-5f37638ac87c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:17.203850 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2efbaad-0485-457d-9573-5f37638ac87c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/ips" status: 200 len: 149 microversion: 2.1 time: 0.086335 May 19 04:42:17.209369 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1404/2735] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:42:17 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/ips => generated 149 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:42:17.229406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f7d99c0-d18e-4e46-ac3b-5915161cbfee tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:17.229966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f7d99c0-d18e-4e46-ac3b-5915161cbfee tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:17.255193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f7d99c0-d18e-4e46-ac3b-5915161cbfee tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:17.286366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f7d99c0-d18e-4e46-ac3b-5915161cbfee tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:17.290884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f7d99c0-d18e-4e46-ac3b-5915161cbfee tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:17.291719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f7d99c0-d18e-4e46-ac3b-5915161cbfee tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:17.543108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-27e8f3fb-e497-4327-a16a-04cd45a9a112 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:17.553927 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-27e8f3fb-e497-4327-a16a-04cd45a9a112 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1521 microversion: 2.1 time: 0.452384 May 19 04:42:17.555774 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1332/2736] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:17 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:17.713120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f7d99c0-d18e-4e46-ac3b-5915161cbfee tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:17.737231 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f7d99c0-d18e-4e46-ac3b-5915161cbfee tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.527948 May 19 04:42:17.744454 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1405/2737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:17 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:18.114722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bac0ef0c-31ec-41b3-b901-0e18ec0aea5d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:18.116587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bac0ef0c-31ec-41b3-b901-0e18ec0aea5d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:18.119441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60cec620-902a-44d4-aedd-ad97192fa6e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:18.120542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60cec620-902a-44d4-aedd-ad97192fa6e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:18.126911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bac0ef0c-31ec-41b3-b901-0e18ec0aea5d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.127798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bac0ef0c-31ec-41b3-b901-0e18ec0aea5d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.128903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bac0ef0c-31ec-41b3-b901-0e18ec0aea5d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.129574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bac0ef0c-31ec-41b3-b901-0e18ec0aea5d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.132018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60cec620-902a-44d4-aedd-ad97192fa6e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.132722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60cec620-902a-44d4-aedd-ad97192fa6e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.134409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60cec620-902a-44d4-aedd-ad97192fa6e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.136745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60cec620-902a-44d4-aedd-ad97192fa6e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.266540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bac0ef0c-31ec-41b3-b901-0e18ec0aea5d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:18.285912 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bac0ef0c-31ec-41b3-b901-0e18ec0aea5d tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1492 microversion: 2.1 time: 0.176561 May 19 04:42:18.288786 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1333/2738] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:18 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1492 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:18.296017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f6ca1a39-477a-4f46-b4d1-59495367bf5d req-53a06d85-8241-496a-a222-d29ae672f076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8a3fcd-56ca-424e-942f-9b20f93565c4", "name": "network-vif-deleted", "tag": "330a2171-c3c3-401c-a445-b2277bab1da7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:18.310090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f6ca1a39-477a-4f46-b4d1-59495367bf5d req-53a06d85-8241-496a-a222-d29ae672f076 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.312357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f6ca1a39-477a-4f46-b4d1-59495367bf5d req-53a06d85-8241-496a-a222-d29ae672f076 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.332602 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f6ca1a39-477a-4f46-b4d1-59495367bf5d req-53a06d85-8241-496a-a222-d29ae672f076 service nova] Creating event network-vif-deleted:330a2171-c3c3-401c-a445-b2277bab1da7 for instance be8a3fcd-56ca-424e-942f-9b20f93565c4 on n-h2-766726-30 May 19 04:42:18.340450 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f6ca1a39-477a-4f46-b4d1-59495367bf5d req-53a06d85-8241-496a-a222-d29ae672f076 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049941 May 19 04:42:18.343069 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1334/2739] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:18.360695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60cec620-902a-44d4-aedd-ad97192fa6e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:18.369406 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60cec620-902a-44d4-aedd-ad97192fa6e9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1315 microversion: 2.1 time: 0.254447 May 19 04:42:18.370397 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1406/2740] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:18 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:18.576004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cbbfe24d-6c30-4279-bc69-b67633b6591c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:18.576613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cbbfe24d-6c30-4279-bc69-b67633b6591c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:18.583351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbbfe24d-6c30-4279-bc69-b67633b6591c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.584879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbbfe24d-6c30-4279-bc69-b67633b6591c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.585909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbbfe24d-6c30-4279-bc69-b67633b6591c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.586556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cbbfe24d-6c30-4279-bc69-b67633b6591c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.731243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cbbfe24d-6c30-4279-bc69-b67633b6591c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:18.742512 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cbbfe24d-6c30-4279-bc69-b67633b6591c tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1498 microversion: 2.1 time: 0.170416 May 19 04:42:18.743737 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1335/2741] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:18 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:18.758109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-05164124-39d3-43d2-ba12-950652c3b9d0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:18.758745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-05164124-39d3-43d2-ba12-950652c3b9d0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:18.765503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05164124-39d3-43d2-ba12-950652c3b9d0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.766223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05164124-39d3-43d2-ba12-950652c3b9d0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.766690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-80d05afc-ea05-4466-ab1c-80e6c554221d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:18.767005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05164124-39d3-43d2-ba12-950652c3b9d0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.767662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05164124-39d3-43d2-ba12-950652c3b9d0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.778806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-80d05afc-ea05-4466-ab1c-80e6c554221d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:18.779651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-80d05afc-ea05-4466-ab1c-80e6c554221d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:18.791592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80d05afc-ea05-4466-ab1c-80e6c554221d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.793183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80d05afc-ea05-4466-ab1c-80e6c554221d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.794025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80d05afc-ea05-4466-ab1c-80e6c554221d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:18.794477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80d05afc-ea05-4466-ab1c-80e6c554221d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:18.912903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-80d05afc-ea05-4466-ab1c-80e6c554221d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:42:19.010391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-05164124-39d3-43d2-ba12-950652c3b9d0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:19.019377 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-05164124-39d3-43d2-ba12-950652c3b9d0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.267200 May 19 04:42:19.020783 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1407/2742] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:18 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:19.039324 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-80d05afc-ea05-4466-ab1c-80e6c554221d tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.281533 May 19 04:42:19.040591 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1336/2743] 10.222.0.58 () {58 vars in 1153 bytes} [Thu May 19 04:42:18 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:19.057219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a973f30e-e016-45f0-b5b3-706edf98cdaf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:19.067169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a973f30e-e016-45f0-b5b3-706edf98cdaf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.070964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a973f30e-e016-45f0-b5b3-706edf98cdaf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:19.114361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a973f30e-e016-45f0-b5b3-706edf98cdaf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Going to try to start instance {{(pid=124818) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 04:42:19.199552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a973f30e-e016-45f0-b5b3-706edf98cdaf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "POST /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7/action" status: 202 len: 0 microversion: 2.1 time: 0.152330 May 19 04:42:19.204055 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1408/2744] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:42:19 2022] POST /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:42:19.208860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4a9e12c-71c0-4c4f-a8c7-2a2dc9382b09 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:19.209714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4a9e12c-71c0-4c4f-a8c7-2a2dc9382b09 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:19.243851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a9e12c-71c0-4c4f-a8c7-2a2dc9382b09 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.244733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a9e12c-71c0-4c4f-a8c7-2a2dc9382b09 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:19.245585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a9e12c-71c0-4c4f-a8c7-2a2dc9382b09 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.246027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a9e12c-71c0-4c4f-a8c7-2a2dc9382b09 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:19.310825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:19.314667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:19.341383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.344955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:19.346304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.350341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:19.469453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.476751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:19.479631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lazy-loading 'fault' on Instance uuid be8a3fcd-56ca-424e-942f-9b20f93565c4 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:42:19.489290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a4a9e12c-71c0-4c4f-a8c7-2a2dc9382b09 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:19.500302 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4a9e12c-71c0-4c4f-a8c7-2a2dc9382b09 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1507 microversion: 2.1 time: 0.293936 May 19 04:42:19.501846 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1337/2745] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:19 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:19.507737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e1b11b7-683b-4995-9f4a-252b8649ef5a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:19.508803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e1b11b7-683b-4995-9f4a-252b8649ef5a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:19.515424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e1b11b7-683b-4995-9f4a-252b8649ef5a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.516227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e1b11b7-683b-4995-9f4a-252b8649ef5a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:19.517261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e1b11b7-683b-4995-9f4a-252b8649ef5a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.529133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e1b11b7-683b-4995-9f4a-252b8649ef5a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:19.610354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eaab665eaa424092568f3b20fa013a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f2dc7d2dc343dca0ca5823506171d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:19.618856 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6f52281e-5d8c-4f8a-b121-af83b72716c2 tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 200 len: 1318 microversion: 2.1 time: 0.318022 May 19 04:42:19.620049 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1409/2746] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:19 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:19.843952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e1b11b7-683b-4995-9f4a-252b8649ef5a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:19.852328 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e1b11b7-683b-4995-9f4a-252b8649ef5a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1315 microversion: 2.1 time: 0.349024 May 19 04:42:19.852905 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1338/2747] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:19 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:19.950584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3840de6a-4813-4e3b-88d7-22d45d0f255a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f068977-283f-4d29-9a22-e9f699264655"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:19.951713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3840de6a-4813-4e3b-88d7-22d45d0f255a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:19.958468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3840de6a-4813-4e3b-88d7-22d45d0f255a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.959256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3840de6a-4813-4e3b-88d7-22d45d0f255a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:19.960269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3840de6a-4813-4e3b-88d7-22d45d0f255a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:19.960903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3840de6a-4813-4e3b-88d7-22d45d0f255a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:20.036675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-88c7dba9-41d2-4252-8dc8-8dd3d074354a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:20.038336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-88c7dba9-41d2-4252-8dc8-8dd3d074354a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:20.046203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88c7dba9-41d2-4252-8dc8-8dd3d074354a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:20.046663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88c7dba9-41d2-4252-8dc8-8dd3d074354a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:20.056673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88c7dba9-41d2-4252-8dc8-8dd3d074354a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:20.056673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88c7dba9-41d2-4252-8dc8-8dd3d074354a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:20.263524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-88c7dba9-41d2-4252-8dc8-8dd3d074354a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:20.272969 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-88c7dba9-41d2-4252-8dc8-8dd3d074354a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.239993 May 19 04:42:20.274241 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1339/2748] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:20 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:20.390385 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3840de6a-4813-4e3b-88d7-22d45d0f255a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443402 May 19 04:42:20.391026 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1410/2749] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:42:19 2022] POST /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:20.518765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4fba3c74-f87c-4d7c-8740-b7916f885126 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:20.520128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4fba3c74-f87c-4d7c-8740-b7916f885126 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:20.529184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fba3c74-f87c-4d7c-8740-b7916f885126 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:20.530337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fba3c74-f87c-4d7c-8740-b7916f885126 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:20.531656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fba3c74-f87c-4d7c-8740-b7916f885126 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:20.532363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fba3c74-f87c-4d7c-8740-b7916f885126 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:20.637482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:20.638634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] [instance: be8a3fcd-56ca-424e-942f-9b20f93565c4] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:20.652126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:20.657856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:20.658682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:20.659131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:20.690524 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] HTTP exception thrown: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:20.693652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4fba3c74-f87c-4d7c-8740-b7916f885126 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Request method failure captured: May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 HTTP/1.1 May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcqT6K9sqivqY4FkLZYkWzZeQeDiljvtEAXH59_EOHrpefMJEv6jRxEhn1pU6WbvFe7zyKInFEImNb5VgyGgIzQB5SIh7nTYL7bumc14Ghi4rhBSCucyEVhLi4KcmchQ3zw-IU42MP91RZN_XDhAG0dvhxfB_hhHJOaHf12qpKOBG3o May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: d4f2dc7d2dc343dca0ca5823506171d2 May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2055439312 May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d4f2dc7d2dc343dca0ca5823506171d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4f2dc7d2dc343dca0ca5823506171d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d4f2dc7d2dc343dca0ca5823506171d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d4f2dc7d2dc343dca0ca5823506171d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2055439312 May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: d4f2dc7d2dc343dca0ca5823506171d2 May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2055439312 May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2055439312-project May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: f1eaab665eaa424092568f3b20fa013a May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2055439312-project May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'be8a3fcd-56ca-424e-942f-9b20f93565c4'} May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:20.699785 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] Returning 404 to user: Instance be8a3fcd-56ca-424e-942f-9b20f93565c4 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:42:20.705413 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a4f1a8cc-080c-41c5-832b-96999d4c2cab tempest-ServersNegativeTestMultiTenantJSON-2055439312 tempest-ServersNegativeTestMultiTenantJSON-2055439312-project] 10.222.0.58 "GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4" status: 404 len: 111 microversion: 2.1 time: 0.069596 May 19 04:42:20.706492 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4fba3c74-f87c-4d7c-8740-b7916f885126 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1507 microversion: 2.1 time: 0.189266 May 19 04:42:20.706577 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1411/2750] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:20 2022] GET /compute/v2.1/servers/be8a3fcd-56ca-424e-942f-9b20f93565c4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:42:20.713622 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1340/2751] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:20 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:20.869810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6febfb9-8ab0-43ca-9289-f31f7f1b8f14 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:20.871170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6febfb9-8ab0-43ca-9289-f31f7f1b8f14 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:20.883002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6febfb9-8ab0-43ca-9289-f31f7f1b8f14 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:20.883948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6febfb9-8ab0-43ca-9289-f31f7f1b8f14 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:20.885273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6febfb9-8ab0-43ca-9289-f31f7f1b8f14 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:20.885904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6febfb9-8ab0-43ca-9289-f31f7f1b8f14 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:21.188481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e6febfb9-8ab0-43ca-9289-f31f7f1b8f14 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:21.216624 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6febfb9-8ab0-43ca-9289-f31f7f1b8f14 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1315 microversion: 2.1 time: 0.351144 May 19 04:42:21.219559 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1412/2752] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:20 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:21.311224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-503c3d6f-782d-4c50-a3a4-ebf9b6d0a1da tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:21.312554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-503c3d6f-782d-4c50-a3a4-ebf9b6d0a1da tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:21.319962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-503c3d6f-782d-4c50-a3a4-ebf9b6d0a1da tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:21.320720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-503c3d6f-782d-4c50-a3a4-ebf9b6d0a1da tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:21.321747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-503c3d6f-782d-4c50-a3a4-ebf9b6d0a1da tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:21.322404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-503c3d6f-782d-4c50-a3a4-ebf9b6d0a1da tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:21.720095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b44c929e-0c07-46c5-bce8-a7452d934fd8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:21.720750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b44c929e-0c07-46c5-bce8-a7452d934fd8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:21.728901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b44c929e-0c07-46c5-bce8-a7452d934fd8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:21.729378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b44c929e-0c07-46c5-bce8-a7452d934fd8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:21.730202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b44c929e-0c07-46c5-bce8-a7452d934fd8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:21.730694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b44c929e-0c07-46c5-bce8-a7452d934fd8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:21.924040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-503c3d6f-782d-4c50-a3a4-ebf9b6d0a1da tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:21.938405 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-503c3d6f-782d-4c50-a3a4-ebf9b6d0a1da tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.632112 May 19 04:42:21.941920 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1341/2753] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:21 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:21.980250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b44c929e-0c07-46c5-bce8-a7452d934fd8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:21.988534 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b44c929e-0c07-46c5-bce8-a7452d934fd8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1511 microversion: 2.1 time: 0.272616 May 19 04:42:21.989138 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1413/2754] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:21 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:22.010606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a73607d-ced7-4fdc-a87f-ecb3baa4102f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:22.014520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2a73607d-ced7-4fdc-a87f-ecb3baa4102f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:22.014976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.compute.servers [None req-2a73607d-ced7-4fdc-a87f-ecb3baa4102f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Removing options 'limit' from query {{(pid=124819) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} May 19 04:42:22.015655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2a73607d-ced7-4fdc-a87f-ecb3baa4102f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:22.016724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a73607d-ced7-4fdc-a87f-ecb3baa4102f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.017199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a73607d-ced7-4fdc-a87f-ecb3baa4102f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.018006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a73607d-ced7-4fdc-a87f-ecb3baa4102f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.018448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a73607d-ced7-4fdc-a87f-ecb3baa4102f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.019850 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a73607d-ced7-4fdc-a87f-ecb3baa4102f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.013457 May 19 04:42:22.026526 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1342/2755] 10.222.0.58 () {58 vars in 1139 bytes} [Thu May 19 04:42:22 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:42:22.032901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b70c13c-88dd-4be3-aa80-25b3c3f0dd02 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:22.033636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b70c13c-88dd-4be3-aa80-25b3c3f0dd02 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:22.044228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b70c13c-88dd-4be3-aa80-25b3c3f0dd02 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.045384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b70c13c-88dd-4be3-aa80-25b3c3f0dd02 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.046370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b70c13c-88dd-4be3-aa80-25b3c3f0dd02 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.047020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b70c13c-88dd-4be3-aa80-25b3c3f0dd02 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.239100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7436e1af-73ce-4c50-a538-db1f595ede58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:22.240080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7436e1af-73ce-4c50-a538-db1f595ede58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:22.248961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:22.253984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7436e1af-73ce-4c50-a538-db1f595ede58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.255888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7436e1af-73ce-4c50-a538-db1f595ede58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.257720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7436e1af-73ce-4c50-a538-db1f595ede58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.258493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7436e1af-73ce-4c50-a538-db1f595ede58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.310123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b70c13c-88dd-4be3-aa80-25b3c3f0dd02 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:22.318672 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b70c13c-88dd-4be3-aa80-25b3c3f0dd02 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1511 microversion: 2.1 time: 0.290161 May 19 04:42:22.321979 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1414/2756] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:22 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:22.335657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2e31a3c-7266-48a7-a4ff-e95c3dc740df tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:22.347317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2e31a3c-7266-48a7-a4ff-e95c3dc740df tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 972aeb1f-6753-4233-a67f-6e8c61c15139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:22.354301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2e31a3c-7266-48a7-a4ff-e95c3dc740df tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.354962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2e31a3c-7266-48a7-a4ff-e95c3dc740df tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.355901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2e31a3c-7266-48a7-a4ff-e95c3dc740df tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.356487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2e31a3c-7266-48a7-a4ff-e95c3dc740df tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.704462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7436e1af-73ce-4c50-a538-db1f595ede58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:22.718738 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7436e1af-73ce-4c50-a538-db1f595ede58 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1315 microversion: 2.1 time: 0.484737 May 19 04:42:22.721632 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1343/2757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:22 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:22.738293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-067099ef-3f56-4def-971f-451330dd78f7 req-9051d286-b5e8-4cd8-8046-80ff1da47be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b5cdae-ce14-4498-b192-9fc681612c20", "name": "network-vif-plugged", "status": "completed", "tag": "8d3eb248-a6e2-4c0b-9b5c-8f11b6e6f1da"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:22.747205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e2e31a3c-7266-48a7-a4ff-e95c3dc740df tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:22.754356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-067099ef-3f56-4def-971f-451330dd78f7 req-9051d286-b5e8-4cd8-8046-80ff1da47be8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.754712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-067099ef-3f56-4def-971f-451330dd78f7 req-9051d286-b5e8-4cd8-8046-80ff1da47be8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.761302 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2e31a3c-7266-48a7-a4ff-e95c3dc740df tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139" status: 200 len: 1511 microversion: 2.1 time: 0.429286 May 19 04:42:22.773565 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1415/2758] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:22 2022] GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:22.777467 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-067099ef-3f56-4def-971f-451330dd78f7 req-9051d286-b5e8-4cd8-8046-80ff1da47be8 service nova] Creating event network-vif-plugged:8d3eb248-a6e2-4c0b-9b5c-8f11b6e6f1da for instance 96b5cdae-ce14-4498-b192-9fc681612c20 on n-h2-766726-30 May 19 04:42:22.784233 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-067099ef-3f56-4def-971f-451330dd78f7 req-9051d286-b5e8-4cd8-8046-80ff1da47be8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060876 May 19 04:42:22.784853 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1344/2759] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:22.786314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-060dee26-b2ed-4bf0-b34e-7ca7e6002490 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:22.788770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-060dee26-b2ed-4bf0-b34e-7ca7e6002490 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:22.806400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-060dee26-b2ed-4bf0-b34e-7ca7e6002490 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.806857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-060dee26-b2ed-4bf0-b34e-7ca7e6002490 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.807758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-060dee26-b2ed-4bf0-b34e-7ca7e6002490 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.808190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-060dee26-b2ed-4bf0-b34e-7ca7e6002490 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.959962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ab0ef40-3700-49de-9560-d95372ea2768 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:22.960929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9ab0ef40-3700-49de-9560-d95372ea2768 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:22.973485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ab0ef40-3700-49de-9560-d95372ea2768 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.974061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ab0ef40-3700-49de-9560-d95372ea2768 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:22.976075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ab0ef40-3700-49de-9560-d95372ea2768 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:22.977939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ab0ef40-3700-49de-9560-d95372ea2768 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:23.187706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-060dee26-b2ed-4bf0-b34e-7ca7e6002490 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:23.203339 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-060dee26-b2ed-4bf0-b34e-7ca7e6002490 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1510 microversion: 2.1 time: 0.428191 May 19 04:42:23.205971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1416/2760] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:22 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1510 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:23.230767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9ab0ef40-3700-49de-9560-d95372ea2768 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:23.231573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-413f6b8e-118a-4ced-8ee2-552ff02c8070 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:23.240653 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ab0ef40-3700-49de-9560-d95372ea2768 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.285569 May 19 04:42:23.241651 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1345/2761] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:22 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:23.258945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-413f6b8e-118a-4ced-8ee2-552ff02c8070 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:23.261518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-413f6b8e-118a-4ced-8ee2-552ff02c8070 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:23.413358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-413f6b8e-118a-4ced-8ee2-552ff02c8070 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:23.413921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-413f6b8e-118a-4ced-8ee2-552ff02c8070 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:23.415745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-413f6b8e-118a-4ced-8ee2-552ff02c8070 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:23.416477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-413f6b8e-118a-4ced-8ee2-552ff02c8070 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:23.527775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-413f6b8e-118a-4ced-8ee2-552ff02c8070 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:42:23.602548 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-413f6b8e-118a-4ced-8ee2-552ff02c8070 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 345 microversion: 2.1 time: 0.379546 May 19 04:42:23.603699 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1417/2762] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:42:23 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 345 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:23.616482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eafdc283-038b-482e-a4c9-00adf7c021dd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:23.617410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eafdc283-038b-482e-a4c9-00adf7c021dd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:23.625653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eafdc283-038b-482e-a4c9-00adf7c021dd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:23.626387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eafdc283-038b-482e-a4c9-00adf7c021dd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:23.627328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eafdc283-038b-482e-a4c9-00adf7c021dd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:23.628038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eafdc283-038b-482e-a4c9-00adf7c021dd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:23.742146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea180f4b-8404-4035-be9e-4039a54c72ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:23.742896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ea180f4b-8404-4035-be9e-4039a54c72ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:23.755578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea180f4b-8404-4035-be9e-4039a54c72ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:23.756718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea180f4b-8404-4035-be9e-4039a54c72ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:23.758932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea180f4b-8404-4035-be9e-4039a54c72ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:23.759448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea180f4b-8404-4035-be9e-4039a54c72ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:23.819246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:23.830718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eafdc283-038b-482e-a4c9-00adf7c021dd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:23.839383 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eafdc283-038b-482e-a4c9-00adf7c021dd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1511 microversion: 2.1 time: 0.227511 May 19 04:42:23.840522 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1346/2763] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:23 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:23.858490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a5820d11-1e7f-4565-a3eb-97b6ac255cb8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:23.859339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a5820d11-1e7f-4565-a3eb-97b6ac255cb8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 972aeb1f-6753-4233-a67f-6e8c61c15139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:23.867080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5820d11-1e7f-4565-a3eb-97b6ac255cb8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:23.867908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5820d11-1e7f-4565-a3eb-97b6ac255cb8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:23.869572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5820d11-1e7f-4565-a3eb-97b6ac255cb8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:23.870270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5820d11-1e7f-4565-a3eb-97b6ac255cb8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:23.877248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:24.073028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ea180f4b-8404-4035-be9e-4039a54c72ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:24.087708 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ea180f4b-8404-4035-be9e-4039a54c72ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1315 microversion: 2.1 time: 0.352510 May 19 04:42:24.089694 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1418/2764] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:23 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:24.130105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a5820d11-1e7f-4565-a3eb-97b6ac255cb8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:24.138003 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a5820d11-1e7f-4565-a3eb-97b6ac255cb8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139" status: 200 len: 1511 microversion: 2.1 time: 0.283400 May 19 04:42:24.141713 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1347/2765] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:23 2022] GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:24.159576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c7372a59-5287-4eda-b6cb-1eeffa760cb4 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:24.160354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c7372a59-5287-4eda-b6cb-1eeffa760cb4 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:24.168094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7372a59-5287-4eda-b6cb-1eeffa760cb4 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:24.168561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7372a59-5287-4eda-b6cb-1eeffa760cb4 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:24.171564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7372a59-5287-4eda-b6cb-1eeffa760cb4 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:24.172119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7372a59-5287-4eda-b6cb-1eeffa760cb4 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:24.258904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7367a8a-c038-4de9-8a5b-61ecee5b09f5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:24.259798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e7367a8a-c038-4de9-8a5b-61ecee5b09f5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:24.273778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7367a8a-c038-4de9-8a5b-61ecee5b09f5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:24.274433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7367a8a-c038-4de9-8a5b-61ecee5b09f5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:24.280296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7367a8a-c038-4de9-8a5b-61ecee5b09f5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:24.282280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7367a8a-c038-4de9-8a5b-61ecee5b09f5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:24.552832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7367a8a-c038-4de9-8a5b-61ecee5b09f5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:24.563516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c7372a59-5287-4eda-b6cb-1eeffa760cb4 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:24.565354 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7367a8a-c038-4de9-8a5b-61ecee5b09f5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.310665 May 19 04:42:24.572049 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c7372a59-5287-4eda-b6cb-1eeffa760cb4 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1510 microversion: 2.1 time: 0.417840 May 19 04:42:24.576482 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1419/2766] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:24 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:24.587731 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1348/2767] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:24 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:24.595482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:24.601846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:24.602612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:24.613475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:24.614543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:24.616417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:24.617413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:24.656723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:42:24.695633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:24.704324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:24.704784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:24.914251 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3293e165-8324-47d3-bdb6-2842970eb971 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.322533 May 19 04:42:24.914998 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1420/2768] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:42:24 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:24.935322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7c6d603e-417f-4635-a82b-b2730f49c6de tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:24.940781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7c6d603e-417f-4635-a82b-b2730f49c6de tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:24.941771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7c6d603e-417f-4635-a82b-b2730f49c6de tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:25.035332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c6d603e-417f-4635-a82b-b2730f49c6de tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.036105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c6d603e-417f-4635-a82b-b2730f49c6de tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.038559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c6d603e-417f-4635-a82b-b2730f49c6de tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.039062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c6d603e-417f-4635-a82b-b2730f49c6de tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.105802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6a5f357d-7f3d-4418-98cd-7d59221f3162 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:25.107084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6a5f357d-7f3d-4418-98cd-7d59221f3162 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:25.115703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a5f357d-7f3d-4418-98cd-7d59221f3162 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.116358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a5f357d-7f3d-4418-98cd-7d59221f3162 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.117452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a5f357d-7f3d-4418-98cd-7d59221f3162 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.118095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a5f357d-7f3d-4418-98cd-7d59221f3162 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.176552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-7c6d603e-417f-4635-a82b-b2730f49c6de tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:42:25.249772 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7c6d603e-417f-4635-a82b-b2730f49c6de tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.318605 May 19 04:42:25.251015 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1349/2769] 10.222.0.58 () {58 vars in 1149 bytes} [Thu May 19 04:42:24 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:25.264622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c95047a-7b57-4aee-b94a-4764de6dd2bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:25.271093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c95047a-7b57-4aee-b94a-4764de6dd2bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:25.272393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c95047a-7b57-4aee-b94a-4764de6dd2bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:25.278481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c95047a-7b57-4aee-b94a-4764de6dd2bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.279270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c95047a-7b57-4aee-b94a-4764de6dd2bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.280911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c95047a-7b57-4aee-b94a-4764de6dd2bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.281895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c95047a-7b57-4aee-b94a-4764de6dd2bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.399743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6a5f357d-7f3d-4418-98cd-7d59221f3162 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:25.410796 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6a5f357d-7f3d-4418-98cd-7d59221f3162 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1501 microversion: 2.1 time: 0.309773 May 19 04:42:25.411778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-6c95047a-7b57-4aee-b94a-4764de6dd2bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:42:25.413822 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1421/2770] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:25 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1501 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:25.433463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-05924f7c-7a8a-41a9-b310-08f1569c1e49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:25.436596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-05924f7c-7a8a-41a9-b310-08f1569c1e49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:25.448114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05924f7c-7a8a-41a9-b310-08f1569c1e49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.450159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05924f7c-7a8a-41a9-b310-08f1569c1e49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.451395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05924f7c-7a8a-41a9-b310-08f1569c1e49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.455852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05924f7c-7a8a-41a9-b310-08f1569c1e49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.480887 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c95047a-7b57-4aee-b94a-4764de6dd2bc tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.220973 May 19 04:42:25.481835 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1350/2771] 10.222.0.58 () {58 vars in 1211 bytes} [Thu May 19 04:42:25 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:25.493539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c76d7cf-fb86-475c-865d-c92d86190a65 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:25.497347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1c76d7cf-fb86-475c-865d-c92d86190a65 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:25.498148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c76d7cf-fb86-475c-865d-c92d86190a65 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:25.505467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c76d7cf-fb86-475c-865d-c92d86190a65 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.506463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c76d7cf-fb86-475c-865d-c92d86190a65 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.507256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c76d7cf-fb86-475c-865d-c92d86190a65 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.507687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c76d7cf-fb86-475c-865d-c92d86190a65 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.590814 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-05924f7c-7a8a-41a9-b310-08f1569c1e49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20/action" status: 202 len: 0 microversion: 2.1 time: 0.164312 May 19 04:42:25.593778 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1422/2772] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:42:25 2022] POST /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:42:25.601461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b92267a-6b91-4092-ad1d-cd8d4e8e2219 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:25.602531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b92267a-6b91-4092-ad1d-cd8d4e8e2219 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:25.619800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b92267a-6b91-4092-ad1d-cd8d4e8e2219 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.620950 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b92267a-6b91-4092-ad1d-cd8d4e8e2219 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.622093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b92267a-6b91-4092-ad1d-cd8d4e8e2219 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.622798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b92267a-6b91-4092-ad1d-cd8d4e8e2219 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.679856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-1c76d7cf-fb86-475c-865d-c92d86190a65 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:42:25.933211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0b92267a-6b91-4092-ad1d-cd8d4e8e2219 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:25.954561 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b92267a-6b91-4092-ad1d-cd8d4e8e2219 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.358151 May 19 04:42:25.968312 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1423/2773] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:25 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:25.979322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9f7c67e0-3511-4cfd-aca3-57228af09d59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:25.979996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9f7c67e0-3511-4cfd-aca3-57228af09d59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:25.993418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f7c67e0-3511-4cfd-aca3-57228af09d59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.998139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f7c67e0-3511-4cfd-aca3-57228af09d59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:25.998998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f7c67e0-3511-4cfd-aca3-57228af09d59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:25.999715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f7c67e0-3511-4cfd-aca3-57228af09d59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.233536 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c76d7cf-fb86-475c-865d-c92d86190a65 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.744025 May 19 04:42:26.242621 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1351/2774] 10.222.0.58 () {58 vars in 1195 bytes} [Thu May 19 04:42:25 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:26.248689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dbcf859e-275e-4ac0-b12e-b2a66dafec87 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:26.250864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9f7c67e0-3511-4cfd-aca3-57228af09d59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:26.254481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dbcf859e-275e-4ac0-b12e-b2a66dafec87 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:26.254926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dbcf859e-275e-4ac0-b12e-b2a66dafec87 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'name': '1410072059', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:26.258633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9f7c67e0-3511-4cfd-aca3-57228af09d59 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1486 microversion: 2.1 time: 0.289165 May 19 04:42:26.259408 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1424/2775] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:25 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1486 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:26.261450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbcf859e-275e-4ac0-b12e-b2a66dafec87 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.262086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbcf859e-275e-4ac0-b12e-b2a66dafec87 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.263138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbcf859e-275e-4ac0-b12e-b2a66dafec87 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.263719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbcf859e-275e-4ac0-b12e-b2a66dafec87 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.278399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a48c0b4e-8efe-4d5e-bebf-f5b9c671a5c4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:26.278904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a48c0b4e-8efe-4d5e-bebf-f5b9c671a5c4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:26.296597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a48c0b4e-8efe-4d5e-bebf-f5b9c671a5c4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.297057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a48c0b4e-8efe-4d5e-bebf-f5b9c671a5c4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.297869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a48c0b4e-8efe-4d5e-bebf-f5b9c671a5c4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.298313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a48c0b4e-8efe-4d5e-bebf-f5b9c671a5c4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.338441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a48c0b4e-8efe-4d5e-bebf-f5b9c671a5c4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:42:26.355360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-dbcf859e-275e-4ac0-b12e-b2a66dafec87 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:42:26.420132 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dbcf859e-275e-4ac0-b12e-b2a66dafec87 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?name=1410072059" status: 200 len: 346 microversion: 2.1 time: 0.176052 May 19 04:42:26.421177 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1352/2776] 10.222.0.58 () {58 vars in 1155 bytes} [Thu May 19 04:42:26 2022] GET /compute/v2.1/servers?name=1410072059 => generated 346 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:26.434735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bf46ef7c-6fbe-4ebb-a219-a7cd32f75a9a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:26.439845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bf46ef7c-6fbe-4ebb-a219-a7cd32f75a9a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:26.440974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bf46ef7c-6fbe-4ebb-a219-a7cd32f75a9a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:26.448805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf46ef7c-6fbe-4ebb-a219-a7cd32f75a9a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.449657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf46ef7c-6fbe-4ebb-a219-a7cd32f75a9a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.450809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf46ef7c-6fbe-4ebb-a219-a7cd32f75a9a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.451480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf46ef7c-6fbe-4ebb-a219-a7cd32f75a9a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.516864 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a48c0b4e-8efe-4d5e-bebf-f5b9c671a5c4 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 204 len: 0 microversion: 2.1 time: 0.241915 May 19 04:42:26.517655 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1425/2777] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:42:26 2022] DELETE /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:42:26.526619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27529288-79bf-474a-81d3-48ab2e0948f5 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:26.527334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27529288-79bf-474a-81d3-48ab2e0948f5 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:26.544170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27529288-79bf-474a-81d3-48ab2e0948f5 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.544622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27529288-79bf-474a-81d3-48ab2e0948f5 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.545431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27529288-79bf-474a-81d3-48ab2e0948f5 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.545870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27529288-79bf-474a-81d3-48ab2e0948f5 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.616472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-bf46ef7c-6fbe-4ebb-a219-a7cd32f75a9a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:42:26.718214 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bf46ef7c-6fbe-4ebb-a219-a7cd32f75a9a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.288814 May 19 04:42:26.727375 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1353/2778] 10.222.0.58 () {58 vars in 1153 bytes} [Thu May 19 04:42:26 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:26.733475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3122f4d2-b579-45df-9b23-9509be8642cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:26.740412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3122f4d2-b579-45df-9b23-9509be8642cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:26.741103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3122f4d2-b579-45df-9b23-9509be8642cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-141007205', 'deleted': False, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:42:26.748832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3122f4d2-b579-45df-9b23-9509be8642cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.749647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3122f4d2-b579-45df-9b23-9509be8642cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.750495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3122f4d2-b579-45df-9b23-9509be8642cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.750937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3122f4d2-b579-45df-9b23-9509be8642cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.807876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27529288-79bf-474a-81d3-48ab2e0948f5 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:26.816609 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27529288-79bf-474a-81d3-48ab2e0948f5 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1492 microversion: 2.1 time: 0.294088 May 19 04:42:26.822125 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1426/2779] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:26 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1492 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:26.864489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-3122f4d2-b579-45df-9b23-9509be8642cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:42:26.932538 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3122f4d2-b579-45df-9b23-9509be8642cf tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-141007205" status: 200 len: 346 microversion: 2.1 time: 0.203288 May 19 04:42:26.933779 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1354/2780] 10.222.0.58 () {58 vars in 1227 bytes} [Thu May 19 04:42:26 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-141007205 => generated 346 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:26.945049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d47b1d9c-9af8-401c-9cd7-baefd767946a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:26.945878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d47b1d9c-9af8-401c-9cd7-baefd767946a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:26.952324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d47b1d9c-9af8-401c-9cd7-baefd767946a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.953051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d47b1d9c-9af8-401c-9cd7-baefd767946a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.954086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d47b1d9c-9af8-401c-9cd7-baefd767946a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.954745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d47b1d9c-9af8-401c-9cd7-baefd767946a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.971844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1661e85-dafd-4bc1-86c1-5c8908606163 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:26.972372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d1661e85-dafd-4bc1-86c1-5c8908606163 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:26.983683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d47b1d9c-9af8-401c-9cd7-baefd767946a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:42:26.984946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1661e85-dafd-4bc1-86c1-5c8908606163 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.985828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1661e85-dafd-4bc1-86c1-5c8908606163 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:26.986707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1661e85-dafd-4bc1-86c1-5c8908606163 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:26.987145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1661e85-dafd-4bc1-86c1-5c8908606163 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:27.117267 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d47b1d9c-9af8-401c-9cd7-baefd767946a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 204 len: 0 microversion: 2.1 time: 0.176502 May 19 04:42:27.117657 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1427/2781] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:42:26 2022] DELETE /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:42:27.127615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d78c631f-f28b-4ba3-9c37-e4d794f9307f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:27.128553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d78c631f-f28b-4ba3-9c37-e4d794f9307f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:27.145326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d78c631f-f28b-4ba3-9c37-e4d794f9307f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:27.146087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d78c631f-f28b-4ba3-9c37-e4d794f9307f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:27.147058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d78c631f-f28b-4ba3-9c37-e4d794f9307f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:27.147792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d78c631f-f28b-4ba3-9c37-e4d794f9307f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:27.242735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1661e85-dafd-4bc1-86c1-5c8908606163 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:27.257433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d1661e85-dafd-4bc1-86c1-5c8908606163 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.289412 May 19 04:42:27.258350 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1355/2782] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:26 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:27.386659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d78c631f-f28b-4ba3-9c37-e4d794f9307f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:27.395776 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d78c631f-f28b-4ba3-9c37-e4d794f9307f tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1516 microversion: 2.1 time: 0.273490 May 19 04:42:27.406725 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1428/2783] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:27 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:27.839172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d78d6378-4749-444c-9bb2-1fcf33f5807b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:27.839793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d78d6378-4749-444c-9bb2-1fcf33f5807b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:27.846275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d78d6378-4749-444c-9bb2-1fcf33f5807b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:27.846745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d78d6378-4749-444c-9bb2-1fcf33f5807b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:27.847499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d78d6378-4749-444c-9bb2-1fcf33f5807b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:27.847948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d78d6378-4749-444c-9bb2-1fcf33f5807b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:27.992011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d78d6378-4749-444c-9bb2-1fcf33f5807b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:28.000661 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d78d6378-4749-444c-9bb2-1fcf33f5807b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1492 microversion: 2.1 time: 0.165242 May 19 04:42:28.001387 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1356/2784] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:27 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1492 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:28.276710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-68cc9001-7d84-4f06-8082-6796df2a4e22 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd31507a700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:28.277622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1dc2e252-f4ef-455b-aa17-8700fc0a0526 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:28.278354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1dc2e252-f4ef-455b-aa17-8700fc0a0526 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:28.285252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dc2e252-f4ef-455b-aa17-8700fc0a0526 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:28.285788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dc2e252-f4ef-455b-aa17-8700fc0a0526 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:28.286641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dc2e252-f4ef-455b-aa17-8700fc0a0526 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:28.287694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dc2e252-f4ef-455b-aa17-8700fc0a0526 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:28.351607 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-68cc9001-7d84-4f06-8082-6796df2a4e22 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/bc07d290-7eb7-4fd6-ae03-15e5e569dd9e" status: 200 len: 350 microversion: 2.1 time: 0.078647 May 19 04:42:28.352183 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1429/2785] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:42:28 2022] GET /compute/v2.1/os-volumes/bc07d290-7eb7-4fd6-ae03-15e5e569dd9e => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:28.416683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf969f67-4c74-4de8-a332-84f79ae47d29 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:28.418067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cf969f67-4c74-4de8-a332-84f79ae47d29 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:28.427313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf969f67-4c74-4de8-a332-84f79ae47d29 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:28.428567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf969f67-4c74-4de8-a332-84f79ae47d29 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:28.429801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf969f67-4c74-4de8-a332-84f79ae47d29 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:28.430389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf969f67-4c74-4de8-a332-84f79ae47d29 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:28.451727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1dc2e252-f4ef-455b-aa17-8700fc0a0526 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:28.471784 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1dc2e252-f4ef-455b-aa17-8700fc0a0526 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.198760 May 19 04:42:28.472565 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1357/2786] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:28 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:28.614423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cf969f67-4c74-4de8-a332-84f79ae47d29 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:28.626110 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cf969f67-4c74-4de8-a332-84f79ae47d29 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1516 microversion: 2.1 time: 0.215868 May 19 04:42:28.627015 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1430/2787] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:28 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1516 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:29.018303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e64030bb-8ec5-4c3a-80b1-be22965eaabe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:29.019184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e64030bb-8ec5-4c3a-80b1-be22965eaabe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:29.026668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e64030bb-8ec5-4c3a-80b1-be22965eaabe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:29.027349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e64030bb-8ec5-4c3a-80b1-be22965eaabe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:29.028195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e64030bb-8ec5-4c3a-80b1-be22965eaabe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:29.028720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e64030bb-8ec5-4c3a-80b1-be22965eaabe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:29.199772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e64030bb-8ec5-4c3a-80b1-be22965eaabe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:29.211677 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e64030bb-8ec5-4c3a-80b1-be22965eaabe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1492 microversion: 2.1 time: 0.197384 May 19 04:42:29.214334 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1358/2788] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:29 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1492 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:29.497715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2cce0a33-cf02-4c1b-b4a5-f0a510979ae5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:29.498847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2cce0a33-cf02-4c1b-b4a5-f0a510979ae5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:29.513363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cce0a33-cf02-4c1b-b4a5-f0a510979ae5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:29.515994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cce0a33-cf02-4c1b-b4a5-f0a510979ae5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:29.516954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cce0a33-cf02-4c1b-b4a5-f0a510979ae5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:29.520253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cce0a33-cf02-4c1b-b4a5-f0a510979ae5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:29.572438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:29.644324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-50b9fdf0-945d-4506-93e1-b7d67db298d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:29.645170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-50b9fdf0-945d-4506-93e1-b7d67db298d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:29.664739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50b9fdf0-945d-4506-93e1-b7d67db298d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:29.665665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50b9fdf0-945d-4506-93e1-b7d67db298d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:29.666775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50b9fdf0-945d-4506-93e1-b7d67db298d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:29.667475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50b9fdf0-945d-4506-93e1-b7d67db298d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:30.175777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2cce0a33-cf02-4c1b-b4a5-f0a510979ae5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:30.215154 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2cce0a33-cf02-4c1b-b4a5-f0a510979ae5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.720265 May 19 04:42:30.216515 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1431/2789] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:29 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:30.238399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7fffef41-5c3b-40f8-95a4-f14f7663f380 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:30.247094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7fffef41-5c3b-40f8-95a4-f14f7663f380 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:30.261525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fffef41-5c3b-40f8-95a4-f14f7663f380 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:30.262140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fffef41-5c3b-40f8-95a4-f14f7663f380 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:30.263131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fffef41-5c3b-40f8-95a4-f14f7663f380 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:30.263679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7fffef41-5c3b-40f8-95a4-f14f7663f380 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:30.293320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-50b9fdf0-945d-4506-93e1-b7d67db298d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:30.311605 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-50b9fdf0-945d-4506-93e1-b7d67db298d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1516 microversion: 2.1 time: 0.671114 May 19 04:42:30.324476 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1359/2790] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:29 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1516 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:30.656841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7fffef41-5c3b-40f8-95a4-f14f7663f380 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:30.673948 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7fffef41-5c3b-40f8-95a4-f14f7663f380 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 200 len: 1492 microversion: 2.1 time: 0.446104 May 19 04:42:30.677119 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1432/2791] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:30 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 1492 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:30.820026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e10563fe-fa17-41ff-9cf4-a4cdbbedd75a req-e9bc70d8-2f5e-42b7-a720-df27aa07f424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b5cdae-ce14-4498-b192-9fc681612c20", "name": "network-vif-deleted", "tag": "8d3eb248-a6e2-4c0b-9b5c-8f11b6e6f1da"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:30.859799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e10563fe-fa17-41ff-9cf4-a4cdbbedd75a req-e9bc70d8-2f5e-42b7-a720-df27aa07f424 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:30.860359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e10563fe-fa17-41ff-9cf4-a4cdbbedd75a req-e9bc70d8-2f5e-42b7-a720-df27aa07f424 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:30.894705 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e10563fe-fa17-41ff-9cf4-a4cdbbedd75a req-e9bc70d8-2f5e-42b7-a720-df27aa07f424 service nova] Creating event network-vif-deleted:8d3eb248-a6e2-4c0b-9b5c-8f11b6e6f1da for instance 96b5cdae-ce14-4498-b192-9fc681612c20 on n-h2-766726-30 May 19 04:42:30.909023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98370931-50eb-4eda-b361-a2432bc91bea tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd315df2310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:30.914453 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e10563fe-fa17-41ff-9cf4-a4cdbbedd75a req-e9bc70d8-2f5e-42b7-a720-df27aa07f424 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104407 May 19 04:42:30.918977 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1360/2792] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:31.006743 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-98370931-50eb-4eda-b361-a2432bc91bea tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/559a9c8b-a165-4ff4-acc7-ce56789eebc6" status: 200 len: 350 microversion: 2.1 time: 0.102123 May 19 04:42:31.007580 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1433/2793] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:42:30 2022] GET /compute/v2.1/os-volumes/559a9c8b-a165-4ff4-acc7-ce56789eebc6 => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:31.234893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b7ddc7c0-cd8b-41f9-8941-1a588713284b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:31.236767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b7ddc7c0-cd8b-41f9-8941-1a588713284b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:31.255053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7ddc7c0-cd8b-41f9-8941-1a588713284b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:31.259531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7ddc7c0-cd8b-41f9-8941-1a588713284b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:31.260499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7ddc7c0-cd8b-41f9-8941-1a588713284b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:31.261149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7ddc7c0-cd8b-41f9-8941-1a588713284b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:31.328901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df644433-ee70-41c5-9298-00f045edaec1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:31.329440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df644433-ee70-41c5-9298-00f045edaec1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:31.344308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df644433-ee70-41c5-9298-00f045edaec1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:31.344764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df644433-ee70-41c5-9298-00f045edaec1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:31.370859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df644433-ee70-41c5-9298-00f045edaec1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:31.373351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df644433-ee70-41c5-9298-00f045edaec1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:31.546928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-df644433-ee70-41c5-9298-00f045edaec1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:31.560620 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df644433-ee70-41c5-9298-00f045edaec1 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 200 len: 1305 microversion: 2.1 time: 0.232726 May 19 04:42:31.563669 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1434/2794] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:31 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 1305 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:31.692722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:31.693957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:31.702650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b7ddc7c0-cd8b-41f9-8941-1a588713284b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:31.709541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:31.709998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:31.710783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:31.711236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:31.717369 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b7ddc7c0-cd8b-41f9-8941-1a588713284b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.488196 May 19 04:42:31.717970 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1361/2795] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:31 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:31.732125 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 HTTP/1.1 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '96b5cdae-ce14-4498-b192-9fc681612c20'} May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:31.733934 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:31.738445 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:31.738445 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:31.738445 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:31.738445 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:42:31.738445 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:42:31.738445 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:42:31.738445 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:31.738445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:42:31.738445 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd1b7fb7-4241-4923-a3be-43cea90d136c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 404 len: 111 microversion: 2.1 time: 0.046749 May 19 04:42:31.747007 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1435/2796] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:31 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:42:31.877266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1184118461", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "56a7f773-0e0a-4675-b687-c0077a456785"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:31.949416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] validate_networks() for [('56a7f773-0e0a-4675-b687-c0077a456785', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:42:32.580128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:32.581360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 9ec90454-5ef7-4127-a380-6ce701d46f73] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:32.589064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:42:32.597017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:42:32.597801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:42:32.598413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:42:32.599024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:42:32.624836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:32.625637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:32.627483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:32.631337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:32.632021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:32.632733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:32.635471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:32.642936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:32.674621 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] HTTP exception thrown: Instance 9ec90454-5ef7-4127-a380-6ce701d46f73 could not be found. May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Request method failure captured: May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 HTTP/1.1 May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpwHDONflsTOuNpmaWrb5ddoVaARW89682HIDa7nW-gmRFkgmv6KOoqiuIYfAuf_GJiUzo8cYBZHUH95NgaQpJRlc1Fpegss5XF6TXw7-0adlZkBHqYTxsLZJANIylNAQcUUZeXM7Givw5uFIxvN49VVl3peAklgQ0NdRrpxbYwDkk May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: cb2e6bbf06674145976cbcf25142a5db May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ListServerFiltersTestJSON-401251476 May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ListServerFiltersTestJSON-401251476 May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: cb2e6bbf06674145976cbcf25142a5db May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-401251476 May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ListServerFiltersTestJSON-401251476-project May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 537b978be2864cbb83c53161a6932f9f May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ListServerFiltersTestJSON-401251476-project May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 9ec90454-5ef7-4127-a380-6ce701d46f73 could not be found. May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '9ec90454-5ef7-4127-a380-6ce701d46f73'} May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec90454-5ef7-4127-a380-6ce701d46f73 could not be found. May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec90454-5ef7-4127-a380-6ce701d46f73 could not be found. May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:32.677389 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:32.681822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:32.681822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:32.681822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:32.681822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:42:32.681822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:42:32.681822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec90454-5ef7-4127-a380-6ce701d46f73 could not be found. May 19 04:42:32.681822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:42:32.684872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Returning 404 to user: Instance 9ec90454-5ef7-4127-a380-6ce701d46f73 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:42:32.686139 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7357b8cb-73b6-4a4a-8fba-8ede3140dc7a tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73" status: 404 len: 111 microversion: 2.1 time: 0.111785 May 19 04:42:32.693336 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1436/2797] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:32 2022] GET /compute/v2.1/servers/9ec90454-5ef7-4127-a380-6ce701d46f73 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:42:32.698365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:32.703521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e4e19e15-6fe6-4643-bfee-65ae6d4c3bfb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:32.706068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e4e19e15-6fe6-4643-bfee-65ae6d4c3bfb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 972aeb1f-6753-4233-a67f-6e8c61c15139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:32.713230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for user 1e14ea8dad314974bf5f4e8e51b88349 and project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:32.722612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:32.726137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4e19e15-6fe6-4643-bfee-65ae6d4c3bfb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:32.727145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4e19e15-6fe6-4643-bfee-65ae6d4c3bfb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:32.728317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4e19e15-6fe6-4643-bfee-65ae6d4c3bfb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:32.729041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4e19e15-6fe6-4643-bfee-65ae6d4c3bfb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:32.750021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:42:32.758964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:42:32.769418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e4e19e15-6fe6-4643-bfee-65ae6d4c3bfb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 972aeb1f-6753-4233-a67f-6e8c61c15139] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:42:32.858645 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97df42e8-d7d9-44b8-b0db-30caaf537f9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989034 May 19 04:42:32.864587 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1362/2798] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:42:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:42:32.872121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5bb42692-7df1-4cbe-a8f4-83a0f30bb37b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:32.873576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5bb42692-7df1-4cbe-a8f4-83a0f30bb37b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:32.884227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bb42692-7df1-4cbe-a8f4-83a0f30bb37b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:32.885292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bb42692-7df1-4cbe-a8f4-83a0f30bb37b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:32.886235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bb42692-7df1-4cbe-a8f4-83a0f30bb37b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:32.886831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bb42692-7df1-4cbe-a8f4-83a0f30bb37b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:32.915193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:32.919829 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e4e19e15-6fe6-4643-bfee-65ae6d4c3bfb tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "DELETE /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139" status: 204 len: 0 microversion: 2.1 time: 0.222601 May 19 04:42:32.921487 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1437/2799] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:42:32 2022] DELETE /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:42:32.929313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43b63891-8ecd-47e0-b8fb-a9b3fb20cc56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:32.930563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43b63891-8ecd-47e0-b8fb-a9b3fb20cc56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:33.012225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-43b63891-8ecd-47e0-b8fb-a9b3fb20cc56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:33.019695 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43b63891-8ecd-47e0-b8fb-a9b3fb20cc56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1215 microversion: 2.1 time: 0.096207 May 19 04:42:33.029819 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1438/2800] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:32 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:33.034470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa6452f1-48ba-4208-9fdd-f7540e4ffe12 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:33.034957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aa6452f1-48ba-4208-9fdd-f7540e4ffe12 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 972aeb1f-6753-4233-a67f-6e8c61c15139] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:33.052443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa6452f1-48ba-4208-9fdd-f7540e4ffe12 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:33.053640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa6452f1-48ba-4208-9fdd-f7540e4ffe12 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:33.054529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa6452f1-48ba-4208-9fdd-f7540e4ffe12 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:33.054907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa6452f1-48ba-4208-9fdd-f7540e4ffe12 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:33.108541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5bb42692-7df1-4cbe-a8f4-83a0f30bb37b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:33.122668 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5bb42692-7df1-4cbe-a8f4-83a0f30bb37b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.256444 May 19 04:42:33.133000 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1363/2801] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:32 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:33.133000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-7747c9c3-7dd4-4794-b172-1ba125b0fdaf req-2c86cd59-73ea-45e0-b417-8e53a365cc0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec90454-5ef7-4127-a380-6ce701d46f73", "name": "network-vif-deleted", "tag": "05c90412-be15-45e5-996b-c61c55c8ecda"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:33.140181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7747c9c3-7dd4-4794-b172-1ba125b0fdaf req-2c86cd59-73ea-45e0-b417-8e53a365cc0a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:33.140771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7747c9c3-7dd4-4794-b172-1ba125b0fdaf req-2c86cd59-73ea-45e0-b417-8e53a365cc0a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:33.156296 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-7747c9c3-7dd4-4794-b172-1ba125b0fdaf req-2c86cd59-73ea-45e0-b417-8e53a365cc0a service nova] Creating event network-vif-deleted:05c90412-be15-45e5-996b-c61c55c8ecda for instance 9ec90454-5ef7-4127-a380-6ce701d46f73 on n-h2-766726-30 May 19 04:42:33.161642 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-7747c9c3-7dd4-4794-b172-1ba125b0fdaf req-2c86cd59-73ea-45e0-b417-8e53a365cc0a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036250 May 19 04:42:33.162581 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1364/2802] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:33.251419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aa6452f1-48ba-4208-9fdd-f7540e4ffe12 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:33.262777 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa6452f1-48ba-4208-9fdd-f7540e4ffe12 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139" status: 200 len: 1517 microversion: 2.1 time: 0.240286 May 19 04:42:33.263639 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1439/2803] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:33 2022] GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139 => generated 1517 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:33.529533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-96892d43-ae98-4596-a8dc-b872d64e3adb tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd31629be50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:33.594613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-296851246", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b8bdb1ad-bcfa-4645-a3d4-61340ff9620e"}], "security_groups": [{"name": "tempest-securitygroup--2116311088"}], "key_name": "tempest-keypair-309633492", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c64dcfa7-286b-49c5-986d-c8a4054a41f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:33.628461 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-96892d43-ae98-4596-a8dc-b872d64e3adb tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/660597b0-45c5-4b36-a1bb-6a768951e82f" status: 200 len: 351 microversion: 2.1 time: 0.103826 May 19 04:42:33.634598 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1365/2804] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:42:33 2022] GET /compute/v2.1/os-volumes/660597b0-45c5-4b36-a1bb-6a768951e82f => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:33.640573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b01292ce-d81c-4145-b22c-2e8c697ebe6e tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd3161a6ca0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:33.729376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] validate_networks() for [('b8bdb1ad-bcfa-4645-a3d4-61340ff9620e', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:42:33.758055 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b01292ce-d81c-4145-b22c-2e8c697ebe6e tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.121192 May 19 04:42:33.758902 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1366/2805] 10.222.0.58 () {58 vars in 1133 bytes} [Thu May 19 04:42:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:33.772331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0d88973-344e-464e-ac0f-19c104735e31 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd315fe9040>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:33.883676 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d0d88973-344e-464e-ac0f-19c104735e31 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.116756 May 19 04:42:33.884748 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1367/2806] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:42:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:33.896144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed08d394-39f7-4b58-bfc4-dc6cd195029c tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd316138c10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:33.994488 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed08d394-39f7-4b58-bfc4-dc6cd195029c tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.102417 May 19 04:42:33.995071 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1368/2807] 10.222.0.58 () {58 vars in 1133 bytes} [Thu May 19 04:42:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:34.007445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af7adedd-1b68-4e87-8147-296a2c3a4aa5 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd316755d30>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:34.100649 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af7adedd-1b68-4e87-8147-296a2c3a4aa5 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096573 May 19 04:42:34.101552 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1369/2808] 10.222.0.58 () {58 vars in 1166 bytes} [Thu May 19 04:42:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:34.108753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c25fac41-a27b-4908-9803-d25da7fd9cbd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:34.109626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c25fac41-a27b-4908-9803-d25da7fd9cbd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:34.122011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c25fac41-a27b-4908-9803-d25da7fd9cbd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:34.122651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c25fac41-a27b-4908-9803-d25da7fd9cbd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:34.124799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c25fac41-a27b-4908-9803-d25da7fd9cbd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:34.125465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c25fac41-a27b-4908-9803-d25da7fd9cbd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:34.218219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c25fac41-a27b-4908-9803-d25da7fd9cbd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:34.227186 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c25fac41-a27b-4908-9803-d25da7fd9cbd tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1275 microversion: 2.1 time: 0.124080 May 19 04:42:34.228288 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1370/2809] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:34 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:34.234361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eeec6140-21b8-4874-a24a-b7a7793ce112 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd3161fa550>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:34.317775 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eeec6140-21b8-4874-a24a-b7a7793ce112 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088217 May 19 04:42:34.318918 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1371/2810] 10.222.0.58 () {58 vars in 1169 bytes} [Thu May 19 04:42:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:34.329735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8483889d-1bc0-4d34-970a-91d207c2bd4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:34.330550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8483889d-1bc0-4d34-970a-91d207c2bd4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:34.338088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8483889d-1bc0-4d34-970a-91d207c2bd4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:34.339015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8483889d-1bc0-4d34-970a-91d207c2bd4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:34.339805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8483889d-1bc0-4d34-970a-91d207c2bd4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:34.340256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8483889d-1bc0-4d34-970a-91d207c2bd4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:34.632764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:34.808573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Getting quotas for project d3d0917d2e4b4886991ec5c714103799. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:34.811167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:34.815458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Getting quotas for user e1709e9b58fe4a16a3156b3141b4a297 and project d3d0917d2e4b4886991ec5c714103799. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:34.835383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:42:34.836218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:42:34.847838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:42:34.848455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:42:34.849251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:42:34.861608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:34.862310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:34.863317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:34.865677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:34.886523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8483889d-1bc0-4d34-970a-91d207c2bd4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:34.901836 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8483889d-1bc0-4d34-970a-91d207c2bd4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.581013 May 19 04:42:34.904970 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1372/2811] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:34 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:34.911483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Getting quotas for project d3d0917d2e4b4886991ec5c714103799. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:34.926433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2ee3664-ed3b-41df-ba2b-5387be6d32a9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:34.928705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b2ee3664-ed3b-41df-ba2b-5387be6d32a9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 972aeb1f-6753-4233-a67f-6e8c61c15139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:34.931840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Getting quotas for user e1709e9b58fe4a16a3156b3141b4a297 and project d3d0917d2e4b4886991ec5c714103799. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:34.944675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ee3664-ed3b-41df-ba2b-5387be6d32a9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:34.945575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ee3664-ed3b-41df-ba2b-5387be6d32a9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:34.947598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ee3664-ed3b-41df-ba2b-5387be6d32a9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:34.949205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ee3664-ed3b-41df-ba2b-5387be6d32a9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:35.053501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:42:35.055908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c64dcfa7-286b-49c5-986d-c8a4054a41f7',volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:42:35.068495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b2ee3664-ed3b-41df-ba2b-5387be6d32a9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:35.083642 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b2ee3664-ed3b-41df-ba2b-5387be6d32a9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139" status: 200 len: 1306 microversion: 2.1 time: 0.174962 May 19 04:42:35.084015 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1373/2812] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:34 2022] GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139 => generated 1306 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:35.090055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d1162f7-d630-41a0-9090-a44cf1876dc9 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd3161bd5e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:35.208862 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d1162f7-d630-41a0-9090-a44cf1876dc9 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.122865 May 19 04:42:35.209817 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1374/2813] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:42:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:35.276633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a6d6bc03-8fa0-4a01-b57f-40bc24ceb173 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.686026 May 19 04:42:35.281691 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1440/2814] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:42:33 2022] POST /compute/v2.1/servers => generated 407 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:42:35.292753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-847d4400-75ad-48fd-92e4-86a35834b866 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd3150b09d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:35.402898 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-847d4400-75ad-48fd-92e4-86a35834b866 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.116698 May 19 04:42:35.403481 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1441/2815] 10.222.0.58 () {58 vars in 1187 bytes} [Thu May 19 04:42:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:35.409595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e889b80-ad87-40db-bc36-1e0d5973160b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:35.410336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7e889b80-ad87-40db-bc36-1e0d5973160b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:35.425632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e889b80-ad87-40db-bc36-1e0d5973160b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:35.426246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e889b80-ad87-40db-bc36-1e0d5973160b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:35.427147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e889b80-ad87-40db-bc36-1e0d5973160b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:35.428197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e889b80-ad87-40db-bc36-1e0d5973160b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:35.488555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2ddda12f-00ad-4935-a0ce-10c3dbf11c02 req-d9a717d0-2f3e-4cd8-bcef-1d45dc6e19b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972aeb1f-6753-4233-a67f-6e8c61c15139", "name": "network-vif-deleted", "tag": "6f95438e-fe6a-4aad-97a4-8a8b85227eed"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:35.508449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2ddda12f-00ad-4935-a0ce-10c3dbf11c02 req-d9a717d0-2f3e-4cd8-bcef-1d45dc6e19b1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:35.509168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2ddda12f-00ad-4935-a0ce-10c3dbf11c02 req-d9a717d0-2f3e-4cd8-bcef-1d45dc6e19b1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:35.530202 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2ddda12f-00ad-4935-a0ce-10c3dbf11c02 req-d9a717d0-2f3e-4cd8-bcef-1d45dc6e19b1 service nova] Creating event network-vif-deleted:6f95438e-fe6a-4aad-97a4-8a8b85227eed for instance 972aeb1f-6753-4233-a67f-6e8c61c15139 on n-h1-766726-30 May 19 04:42:35.544642 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2ddda12f-00ad-4935-a0ce-10c3dbf11c02 req-d9a717d0-2f3e-4cd8-bcef-1d45dc6e19b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.332496 May 19 04:42:35.545866 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1375/2816] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:35.560266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aefe46b6-1d28-40b9-b614-a97d68211306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:35.564127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aefe46b6-1d28-40b9-b614-a97d68211306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:35.666902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aefe46b6-1d28-40b9-b614-a97d68211306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:35.674975 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aefe46b6-1d28-40b9-b614-a97d68211306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1120 microversion: 2.1 time: 0.125702 May 19 04:42:35.675754 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1376/2817] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:35 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1120 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:35.681890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ad529ef3-7280-425a-92a3-ed6432fdb4c1 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] Calling method '.version_select at 0x7fd315fba160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:35.722738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7e889b80-ad87-40db-bc36-1e0d5973160b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:35.733782 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e889b80-ad87-40db-bc36-1e0d5973160b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1315 microversion: 2.1 time: 0.328879 May 19 04:42:35.734873 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1442/2818] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:35 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:35.779282 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ad529ef3-7280-425a-92a3-ed6432fdb4c1 tempest-VolumesTestJSON-1652197020 tempest-VolumesTestJSON-1652197020-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.100803 May 19 04:42:35.779282 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1377/2819] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 04:42:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:35.922217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d867488-6911-4d2b-9ced-d80901cc0af1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:35.923574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d867488-6911-4d2b-9ced-d80901cc0af1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:35.930142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d867488-6911-4d2b-9ced-d80901cc0af1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:35.930910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d867488-6911-4d2b-9ced-d80901cc0af1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:35.932110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d867488-6911-4d2b-9ced-d80901cc0af1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:35.932729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d867488-6911-4d2b-9ced-d80901cc0af1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.101178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:36.102457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: 972aeb1f-6753-4233-a67f-6e8c61c15139] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:36.113202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.113577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.114616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.115330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.129720 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] HTTP exception thrown: Instance 972aeb1f-6753-4233-a67f-6e8c61c15139 could not be found. May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Request method failure captured: May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139 HTTP/1.1 May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpwHDONflsTOuNpmaWrb5ddoVaARW89682HIDa7nW-gmRFkgmv6KOoqiuIYfAuf_GJiUzo8cYBZHUH95NgaQpJRlc1Fpegss5XF6TXw7-0adlZkBHqYTxsLZJANIylNAQcUUZeXM7Givw5uFIxvN49VVl3peAklgQ0NdRrpxbYwDkk May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: cb2e6bbf06674145976cbcf25142a5db May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListServerFiltersTestJSON-401251476 May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListServerFiltersTestJSON-401251476 May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: cb2e6bbf06674145976cbcf25142a5db May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-401251476 May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListServerFiltersTestJSON-401251476-project May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 537b978be2864cbb83c53161a6932f9f May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListServerFiltersTestJSON-401251476-project May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 972aeb1f-6753-4233-a67f-6e8c61c15139 could not be found. May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '972aeb1f-6753-4233-a67f-6e8c61c15139'} May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972aeb1f-6753-4233-a67f-6e8c61c15139 could not be found. May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972aeb1f-6753-4233-a67f-6e8c61c15139 could not be found. May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:36.132047 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:36.135889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:36.135889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:36.135889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:36.135889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:42:36.135889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:42:36.135889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972aeb1f-6753-4233-a67f-6e8c61c15139 could not be found. May 19 04:42:36.135889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:36.135889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Returning 404 to user: Instance 972aeb1f-6753-4233-a67f-6e8c61c15139 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:42:36.135889 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0cb84d12-2cf6-403f-97de-7219db4388ea tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139" status: 404 len: 111 microversion: 2.1 time: 0.037390 May 19 04:42:36.137579 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1378/2820] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:36 2022] GET /compute/v2.1/servers/972aeb1f-6753-4233-a67f-6e8c61c15139 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:42:36.142937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-410c0f3e-0f86-47f2-b8e0-712bed4d78e9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:36.143661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-410c0f3e-0f86-47f2-b8e0-712bed4d78e9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:36.144630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d867488-6911-4d2b-9ced-d80901cc0af1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:36.151865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-410c0f3e-0f86-47f2-b8e0-712bed4d78e9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.152897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-410c0f3e-0f86-47f2-b8e0-712bed4d78e9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.153966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-410c0f3e-0f86-47f2-b8e0-712bed4d78e9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.154612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-410c0f3e-0f86-47f2-b8e0-712bed4d78e9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.157672 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d867488-6911-4d2b-9ced-d80901cc0af1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.240362 May 19 04:42:36.163114 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1443/2821] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:35 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:36.185271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-410c0f3e-0f86-47f2-b8e0-712bed4d78e9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:42:36.287358 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-410c0f3e-0f86-47f2-b8e0-712bed4d78e9 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 204 len: 0 microversion: 2.1 time: 0.148107 May 19 04:42:36.288160 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1379/2822] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:42:36 2022] DELETE /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:42:36.296423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-356d5fe7-0b82-47c7-838f-e4c22e89e3d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:36.296886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-356d5fe7-0b82-47c7-838f-e4c22e89e3d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:36.303907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-356d5fe7-0b82-47c7-838f-e4c22e89e3d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.304611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-356d5fe7-0b82-47c7-838f-e4c22e89e3d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.305631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-356d5fe7-0b82-47c7-838f-e4c22e89e3d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.306228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-356d5fe7-0b82-47c7-838f-e4c22e89e3d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.514732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-356d5fe7-0b82-47c7-838f-e4c22e89e3d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:36.530916 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-356d5fe7-0b82-47c7-838f-e4c22e89e3d2 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1517 microversion: 2.1 time: 0.238626 May 19 04:42:36.541480 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1444/2823] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:36 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:36.595944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-637f0194-9514-4777-9b6c-38562735ec83 req-89bf7e29-1617-464e-bebe-807a678c0684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8", "tag": "f9523cc7-bde6-44b3-8939-9aed1c4a8353"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:36.612325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-637f0194-9514-4777-9b6c-38562735ec83 req-89bf7e29-1617-464e-bebe-807a678c0684 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.613230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-637f0194-9514-4777-9b6c-38562735ec83 req-89bf7e29-1617-464e-bebe-807a678c0684 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.630609 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-637f0194-9514-4777-9b6c-38562735ec83 req-89bf7e29-1617-464e-bebe-807a678c0684 service nova] Creating event network-changed:f9523cc7-bde6-44b3-8939-9aed1c4a8353 for instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 on n-h2-766726-30 May 19 04:42:36.636875 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-637f0194-9514-4777-9b6c-38562735ec83 req-89bf7e29-1617-464e-bebe-807a678c0684 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047422 May 19 04:42:36.638112 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1380/2824] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:36.694982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5afeb422-949e-4689-8bb7-7f89397232a8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:36.696100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5afeb422-949e-4689-8bb7-7f89397232a8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:36.705469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5afeb422-949e-4689-8bb7-7f89397232a8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.706200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5afeb422-949e-4689-8bb7-7f89397232a8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.707230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5afeb422-949e-4689-8bb7-7f89397232a8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.707826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5afeb422-949e-4689-8bb7-7f89397232a8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.753540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ba7719a-635b-4fa1-93a7-985d3cab40ba tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:36.754710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3ba7719a-635b-4fa1-93a7-985d3cab40ba tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:36.769712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ba7719a-635b-4fa1-93a7-985d3cab40ba tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.770168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ba7719a-635b-4fa1-93a7-985d3cab40ba tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.771133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ba7719a-635b-4fa1-93a7-985d3cab40ba tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:36.772119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ba7719a-635b-4fa1-93a7-985d3cab40ba tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:36.814879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5afeb422-949e-4689-8bb7-7f89397232a8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:36.836278 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5afeb422-949e-4689-8bb7-7f89397232a8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1236 microversion: 2.1 time: 0.147984 May 19 04:42:36.853221 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1445/2825] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:36 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1236 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:36.953523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3ba7719a-635b-4fa1-93a7-985d3cab40ba tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:36.963013 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ba7719a-635b-4fa1-93a7-985d3cab40ba tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1315 microversion: 2.1 time: 0.214702 May 19 04:42:36.964052 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1381/2826] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:36 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:37.176826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-23f12126-6003-45b6-8080-5e3339a045c0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:37.177705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-23f12126-6003-45b6-8080-5e3339a045c0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:37.188002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23f12126-6003-45b6-8080-5e3339a045c0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:37.188588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23f12126-6003-45b6-8080-5e3339a045c0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:37.191810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23f12126-6003-45b6-8080-5e3339a045c0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:37.193216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23f12126-6003-45b6-8080-5e3339a045c0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:37.383754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23f12126-6003-45b6-8080-5e3339a045c0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:37.394965 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-23f12126-6003-45b6-8080-5e3339a045c0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.221948 May 19 04:42:37.406012 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1446/2827] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:37 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:37.548403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8dff867-343c-4a19-a59b-e338e4f908d3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:37.549034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e8dff867-343c-4a19-a59b-e338e4f908d3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:37.555399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8dff867-343c-4a19-a59b-e338e4f908d3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:37.556050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8dff867-343c-4a19-a59b-e338e4f908d3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:37.557126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8dff867-343c-4a19-a59b-e338e4f908d3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:37.557742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8dff867-343c-4a19-a59b-e338e4f908d3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:37.850333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e8dff867-343c-4a19-a59b-e338e4f908d3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:37.858174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6b1f2b0f-b300-482d-a746-49ddb2474bc8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:37.858869 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e8dff867-343c-4a19-a59b-e338e4f908d3 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1517 microversion: 2.1 time: 0.314960 May 19 04:42:37.859558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6b1f2b0f-b300-482d-a746-49ddb2474bc8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:37.870374 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1382/2828] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:37 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1517 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:37.876641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b1f2b0f-b300-482d-a746-49ddb2474bc8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:37.878339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b1f2b0f-b300-482d-a746-49ddb2474bc8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:37.884162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b1f2b0f-b300-482d-a746-49ddb2474bc8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:37.884877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b1f2b0f-b300-482d-a746-49ddb2474bc8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:37.980044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c63f833c-6b14-4836-b0a7-2cb56f812098 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:37.980937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c63f833c-6b14-4836-b0a7-2cb56f812098 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:37.991186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c63f833c-6b14-4836-b0a7-2cb56f812098 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:37.993329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c63f833c-6b14-4836-b0a7-2cb56f812098 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:37.995764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c63f833c-6b14-4836-b0a7-2cb56f812098 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:37.996381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c63f833c-6b14-4836-b0a7-2cb56f812098 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:38.601491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6b1f2b0f-b300-482d-a746-49ddb2474bc8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:38.623760 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6b1f2b0f-b300-482d-a746-49ddb2474bc8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1304 microversion: 2.1 time: 0.770605 May 19 04:42:38.632859 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1447/2829] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:37 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1304 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:38.652194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-76e636a2-905f-46be-8fb3-d564484d5b81 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:38.652837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-76e636a2-905f-46be-8fb3-d564484d5b81 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:38.667981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76e636a2-905f-46be-8fb3-d564484d5b81 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:38.671983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c63f833c-6b14-4836-b0a7-2cb56f812098 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:38.672834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76e636a2-905f-46be-8fb3-d564484d5b81 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:38.673748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76e636a2-905f-46be-8fb3-d564484d5b81 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:38.677931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76e636a2-905f-46be-8fb3-d564484d5b81 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:38.681005 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c63f833c-6b14-4836-b0a7-2cb56f812098 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1315 microversion: 2.1 time: 0.705019 May 19 04:42:38.697196 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1383/2830] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:37 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:38.858730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2cb8b12d-5303-48a6-ae48-939c72597f60 req-0347af66-340f-4a42-872d-b897b1212215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a0a37d-a68e-428a-8b9a-901167a2c06a", "tag": "4f334c46-7b49-4649-8354-c19a2c21fc75"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:38.881648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2cb8b12d-5303-48a6-ae48-939c72597f60 req-0347af66-340f-4a42-872d-b897b1212215 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:38.882111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2cb8b12d-5303-48a6-ae48-939c72597f60 req-0347af66-340f-4a42-872d-b897b1212215 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:38.913374 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2cb8b12d-5303-48a6-ae48-939c72597f60 req-0347af66-340f-4a42-872d-b897b1212215 service nova] Creating event network-changed:4f334c46-7b49-4649-8354-c19a2c21fc75 for instance d7a0a37d-a68e-428a-8b9a-901167a2c06a on n-h1-766726-30 May 19 04:42:38.928953 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2cb8b12d-5303-48a6-ae48-939c72597f60 req-0347af66-340f-4a42-872d-b897b1212215 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075567 May 19 04:42:38.931525 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1384/2831] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:42:38.945567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32098179-4789-4fbc-bac9-d5b85f8866d8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:38.946305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-32098179-4789-4fbc-bac9-d5b85f8866d8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:38.965701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32098179-4789-4fbc-bac9-d5b85f8866d8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:38.967817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32098179-4789-4fbc-bac9-d5b85f8866d8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:38.968673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32098179-4789-4fbc-bac9-d5b85f8866d8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:38.970551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32098179-4789-4fbc-bac9-d5b85f8866d8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:39.452538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-76e636a2-905f-46be-8fb3-d564484d5b81 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:39.465412 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-76e636a2-905f-46be-8fb3-d564484d5b81 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.830961 May 19 04:42:39.470526 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1448/2832] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:38 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:39.595154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-32098179-4789-4fbc-bac9-d5b85f8866d8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:39.611433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-32098179-4789-4fbc-bac9-d5b85f8866d8 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1517 microversion: 2.1 time: 0.678631 May 19 04:42:39.620947 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1385/2833] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:38 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1517 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:39.656710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be80bd45-6c02-4277-aae7-c23ad8a60306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:39.657388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be80bd45-6c02-4277-aae7-c23ad8a60306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:39.674520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be80bd45-6c02-4277-aae7-c23ad8a60306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:39.676464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be80bd45-6c02-4277-aae7-c23ad8a60306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:39.677333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be80bd45-6c02-4277-aae7-c23ad8a60306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:39.677790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be80bd45-6c02-4277-aae7-c23ad8a60306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:39.700030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4aed7630-feb1-4f4d-8c4b-9767c06ad73e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:39.701259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4aed7630-feb1-4f4d-8c4b-9767c06ad73e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:39.715312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4aed7630-feb1-4f4d-8c4b-9767c06ad73e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:39.715906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4aed7630-feb1-4f4d-8c4b-9767c06ad73e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:39.720811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4aed7630-feb1-4f4d-8c4b-9767c06ad73e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:39.721669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4aed7630-feb1-4f4d-8c4b-9767c06ad73e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:39.898519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be80bd45-6c02-4277-aae7-c23ad8a60306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:39.906448 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be80bd45-6c02-4277-aae7-c23ad8a60306 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1304 microversion: 2.1 time: 0.262274 May 19 04:42:39.916301 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1449/2834] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:39 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1304 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:39.916301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0e58f433-80d2-4bd7-9013-942b719e092e req-cd089808-add3-4db2-8275-ce0bee1fc7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a81ce7-232a-4300-b267-c7859631cad7", "name": "network-vif-deleted", "tag": "b08aeaa2-48fd-4db7-8875-c5c727177e45"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:39.936611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0e58f433-80d2-4bd7-9013-942b719e092e req-cd089808-add3-4db2-8275-ce0bee1fc7f3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:39.937090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0e58f433-80d2-4bd7-9013-942b719e092e req-cd089808-add3-4db2-8275-ce0bee1fc7f3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:39.961374 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0e58f433-80d2-4bd7-9013-942b719e092e req-cd089808-add3-4db2-8275-ce0bee1fc7f3 service nova] Creating event network-vif-deleted:b08aeaa2-48fd-4db7-8875-c5c727177e45 for instance b0a81ce7-232a-4300-b267-c7859631cad7 on n-h2-766726-30 May 19 04:42:39.972358 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0e58f433-80d2-4bd7-9013-942b719e092e req-cd089808-add3-4db2-8275-ce0bee1fc7f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061220 May 19 04:42:39.975222 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1450/2835] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:39.985776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4aed7630-feb1-4f4d-8c4b-9767c06ad73e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:39.999551 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4aed7630-feb1-4f4d-8c4b-9767c06ad73e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1315 microversion: 2.1 time: 0.302054 May 19 04:42:40.001032 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1386/2836] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:39 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:40.486214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1607f8e1-c8b0-4ac5-b2af-de70dfd7ba8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:40.487211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1607f8e1-c8b0-4ac5-b2af-de70dfd7ba8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:40.502339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1607f8e1-c8b0-4ac5-b2af-de70dfd7ba8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:40.503054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1607f8e1-c8b0-4ac5-b2af-de70dfd7ba8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:40.504751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1607f8e1-c8b0-4ac5-b2af-de70dfd7ba8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:40.506019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1607f8e1-c8b0-4ac5-b2af-de70dfd7ba8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:40.561388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6bb3427d-0501-432a-9670-1a45b93fc9c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: .version_select at 0x7fd3159c2430>, body: {"keypair": {"name": "tempest-keypair-385478761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGdbLYsCw4p+pjmeMNvFfVAfEO0u4gAKUb2Iel7t+4366v0OUivTF+7cdfXRKAS0RPRuDTAQMwBBrc97TKcHPw611GZ6OVMgjMbi9pH93ubDBQRsLUIS22ek8Sje44mlg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:40.578015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6bb3427d-0501-432a-9670-1a45b93fc9c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for project 0db6b7171e3b4a2db160855939246a40. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:40.601368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6bb3427d-0501-432a-9670-1a45b93fc9c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for user a651109c72e84cab9e712ad5fbd002b6 and project 0db6b7171e3b4a2db160855939246a40. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:40.664743 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6bb3427d-0501-432a-9670-1a45b93fc9c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107094 May 19 04:42:40.666501 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1387/2837] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:42:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:40.671447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:40.677953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:40.688852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:40.697988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:40.699143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:40.699826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:40.713840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1607f8e1-c8b0-4ac5-b2af-de70dfd7ba8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:40.718609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:40.725667 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1607f8e1-c8b0-4ac5-b2af-de70dfd7ba8d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.245204 May 19 04:42:40.726619 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1451/2838] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:40 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:40.765229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:40.765818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:40.766432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lazy-loading 'fault' on Instance uuid b0a81ce7-232a-4300-b267-c7859631cad7 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:42:40.836680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b978be2864cbb83c53161a6932f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2e6bbf06674145976cbcf25142a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:40.845323 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3adbf75b-46c2-433a-8813-fd540781d2fd tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 200 len: 1311 microversion: 2.1 time: 0.177473 May 19 04:42:40.845917 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1388/2839] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:40 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:40.928231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c0e7332-d029-4c1a-af9f-9795389912c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:40.929359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4c0e7332-d029-4c1a-af9f-9795389912c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:40.950969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c0e7332-d029-4c1a-af9f-9795389912c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:40.952288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c0e7332-d029-4c1a-af9f-9795389912c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:40.954949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c0e7332-d029-4c1a-af9f-9795389912c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:40.956707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c0e7332-d029-4c1a-af9f-9795389912c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:41.029235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c630694-adff-4bce-88b0-99be494e9fdc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:41.029872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3c630694-adff-4bce-88b0-99be494e9fdc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:41.039007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c630694-adff-4bce-88b0-99be494e9fdc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:41.039468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c630694-adff-4bce-88b0-99be494e9fdc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:41.040260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c630694-adff-4bce-88b0-99be494e9fdc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:41.040708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c630694-adff-4bce-88b0-99be494e9fdc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:41.309909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c0e7332-d029-4c1a-af9f-9795389912c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:41.321280 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c0e7332-d029-4c1a-af9f-9795389912c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1304 microversion: 2.1 time: 0.401290 May 19 04:42:41.323117 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1452/2840] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:40 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1304 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:41.468632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c630694-adff-4bce-88b0-99be494e9fdc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:41.482371 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3c630694-adff-4bce-88b0-99be494e9fdc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1315 microversion: 2.1 time: 0.464275 May 19 04:42:41.493362 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1389/2841] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:41 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:41.747373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4837b680-5577-47ee-8155-e7a028ac3338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:41.748016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4837b680-5577-47ee-8155-e7a028ac3338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:41.765933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4837b680-5577-47ee-8155-e7a028ac3338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:41.766692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4837b680-5577-47ee-8155-e7a028ac3338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:41.770096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4837b680-5577-47ee-8155-e7a028ac3338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:41.773294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4837b680-5577-47ee-8155-e7a028ac3338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:41.862408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:41.864273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] [instance: b0a81ce7-232a-4300-b267-c7859631cad7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:41.872700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:41.873516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:41.874989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:41.875867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:41.908545 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] HTTP exception thrown: Instance b0a81ce7-232a-4300-b267-c7859631cad7 could not be found. May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Request method failure captured: May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 HTTP/1.1 May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpwHDONflsTOuNpmaWrb5ddoVaARW89682HIDa7nW-gmRFkgmv6KOoqiuIYfAuf_GJiUzo8cYBZHUH95NgaQpJRlc1Fpegss5XF6TXw7-0adlZkBHqYTxsLZJANIylNAQcUUZeXM7Givw5uFIxvN49VVl3peAklgQ0NdRrpxbYwDkk May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: cb2e6bbf06674145976cbcf25142a5db May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ListServerFiltersTestJSON-401251476 May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb2e6bbf06674145976cbcf25142a5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ListServerFiltersTestJSON-401251476 May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: cb2e6bbf06674145976cbcf25142a5db May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-401251476 May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ListServerFiltersTestJSON-401251476-project May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 537b978be2864cbb83c53161a6932f9f May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ListServerFiltersTestJSON-401251476-project May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance b0a81ce7-232a-4300-b267-c7859631cad7 could not be found. May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b0a81ce7-232a-4300-b267-c7859631cad7'} May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a81ce7-232a-4300-b267-c7859631cad7 could not be found. May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a81ce7-232a-4300-b267-c7859631cad7 could not be found. May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:42:41.910634 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:41.914711 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:42:41.914711 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:42:41.914711 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:42:41.914711 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:42:41.914711 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:42:41.914711 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a81ce7-232a-4300-b267-c7859631cad7 could not be found. May 19 04:42:41.914711 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:42:41.918520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] Returning 404 to user: Instance b0a81ce7-232a-4300-b267-c7859631cad7 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:42:41.921066 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-24799557-093f-4764-998f-d3c79bd34383 tempest-ListServerFiltersTestJSON-401251476 tempest-ListServerFiltersTestJSON-401251476-project] 10.222.0.58 "GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7" status: 404 len: 111 microversion: 2.1 time: 0.062602 May 19 04:42:41.923858 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1390/2842] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:41 2022] GET /compute/v2.1/servers/b0a81ce7-232a-4300-b267-c7859631cad7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:42:42.160361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4837b680-5577-47ee-8155-e7a028ac3338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:42.169932 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4837b680-5577-47ee-8155-e7a028ac3338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1475 microversion: 2.1 time: 0.430728 May 19 04:42:42.170548 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1453/2843] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:41 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1475 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:42.338947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-903cca52-0716-4bed-970b-fd7d6a55b143 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:42.339803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-903cca52-0716-4bed-970b-fd7d6a55b143 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:42.355078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903cca52-0716-4bed-970b-fd7d6a55b143 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:42.355802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903cca52-0716-4bed-970b-fd7d6a55b143 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:42.356752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903cca52-0716-4bed-970b-fd7d6a55b143 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:42.357375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-903cca52-0716-4bed-970b-fd7d6a55b143 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:42.507120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1958431c-0430-415b-bb61-5ce07f6e0fc7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:42.511526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1958431c-0430-415b-bb61-5ce07f6e0fc7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:42.531200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1958431c-0430-415b-bb61-5ce07f6e0fc7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:42.537982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1958431c-0430-415b-bb61-5ce07f6e0fc7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:42.539813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1958431c-0430-415b-bb61-5ce07f6e0fc7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:42.544408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1958431c-0430-415b-bb61-5ce07f6e0fc7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:42.666278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=18 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:42.861272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-903cca52-0716-4bed-970b-fd7d6a55b143 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:42.868469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:42.877198 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-903cca52-0716-4bed-970b-fd7d6a55b143 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1304 microversion: 2.1 time: 0.541048 May 19 04:42:42.877988 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1391/2844] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:42 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1304 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:42.900913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6b55c225-08a3-4068-b882-4588fc69abd7 req-b09592d7-34e6-4a7f-9fef-f0f9d5d0541e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8", "name": "network-vif-plugged", "status": "completed", "tag": "f9523cc7-bde6-44b3-8939-9aed1c4a8353"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:42.931575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6b55c225-08a3-4068-b882-4588fc69abd7 req-b09592d7-34e6-4a7f-9fef-f0f9d5d0541e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:42.932932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6b55c225-08a3-4068-b882-4588fc69abd7 req-b09592d7-34e6-4a7f-9fef-f0f9d5d0541e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:42.972308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1958431c-0430-415b-bb61-5ce07f6e0fc7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:42.993203 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6b55c225-08a3-4068-b882-4588fc69abd7 req-b09592d7-34e6-4a7f-9fef-f0f9d5d0541e service nova] Creating event network-vif-plugged:f9523cc7-bde6-44b3-8939-9aed1c4a8353 for instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 on n-h2-766726-30 May 19 04:42:42.995795 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1958431c-0430-415b-bb61-5ce07f6e0fc7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1315 microversion: 2.1 time: 0.488954 May 19 04:42:42.998463 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1454/2845] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:42 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:43.013908 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6b55c225-08a3-4068-b882-4588fc69abd7 req-b09592d7-34e6-4a7f-9fef-f0f9d5d0541e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117219 May 19 04:42:43.016020 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1392/2846] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:43.189052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-84ee9fc2-6b79-4c46-a4d5-2ffc2bcc7a1e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:43.189792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-84ee9fc2-6b79-4c46-a4d5-2ffc2bcc7a1e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:43.203070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84ee9fc2-6b79-4c46-a4d5-2ffc2bcc7a1e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:43.203537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84ee9fc2-6b79-4c46-a4d5-2ffc2bcc7a1e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:43.207464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84ee9fc2-6b79-4c46-a4d5-2ffc2bcc7a1e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:43.207936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84ee9fc2-6b79-4c46-a4d5-2ffc2bcc7a1e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:43.535513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-717ac978-ca7d-4124-bd31-00bba93c03aa req-ae9e52b3-2f6c-4940-94eb-a81bdd398c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386556b3-9bff-473a-94c3-61225505b4ff", "name": "network-vif-unplugged", "status": "completed", "tag": "b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:43.551952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-717ac978-ca7d-4124-bd31-00bba93c03aa req-ae9e52b3-2f6c-4940-94eb-a81bdd398c1a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:43.552448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-717ac978-ca7d-4124-bd31-00bba93c03aa req-ae9e52b3-2f6c-4940-94eb-a81bdd398c1a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:43.582622 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-717ac978-ca7d-4124-bd31-00bba93c03aa req-ae9e52b3-2f6c-4940-94eb-a81bdd398c1a service nova] Creating event network-vif-unplugged:b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5 for instance 386556b3-9bff-473a-94c3-61225505b4ff on n-h2-766726-30 May 19 04:42:43.595547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-717ac978-ca7d-4124-bd31-00bba93c03aa req-ae9e52b3-2f6c-4940-94eb-a81bdd398c1a service nova] Instance 386556b3-9bff-473a-94c3-61225505b4ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:42:43.622563 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-717ac978-ca7d-4124-bd31-00bba93c03aa req-ae9e52b3-2f6c-4940-94eb-a81bdd398c1a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091035 May 19 04:42:43.625210 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1393/2847] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:42:43.895293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b893f8f-7565-46cb-b5f4-a52a942be106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:43.896144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b893f8f-7565-46cb-b5f4-a52a942be106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:43.912800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b893f8f-7565-46cb-b5f4-a52a942be106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:43.914418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b893f8f-7565-46cb-b5f4-a52a942be106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:43.915244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b893f8f-7565-46cb-b5f4-a52a942be106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:43.915697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b893f8f-7565-46cb-b5f4-a52a942be106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:44.239488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-84ee9fc2-6b79-4c46-a4d5-2ffc2bcc7a1e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:44.249861 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-84ee9fc2-6b79-4c46-a4d5-2ffc2bcc7a1e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1474 microversion: 2.1 time: 1.066128 May 19 04:42:44.263427 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1455/2848] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:43 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1474 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:44.268630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5490be0d-a3c0-4323-af84-a5323b80f8d3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:44.269434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5490be0d-a3c0-4323-af84-a5323b80f8d3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:44.276978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5490be0d-a3c0-4323-af84-a5323b80f8d3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:44.291074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5490be0d-a3c0-4323-af84-a5323b80f8d3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:44.292099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5490be0d-a3c0-4323-af84-a5323b80f8d3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:44.293870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5490be0d-a3c0-4323-af84-a5323b80f8d3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:44.690135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5490be0d-a3c0-4323-af84-a5323b80f8d3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:44.699964 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5490be0d-a3c0-4323-af84-a5323b80f8d3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1315 microversion: 2.1 time: 0.435155 May 19 04:42:44.721554 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1456/2849] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:44 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:44.753120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b893f8f-7565-46cb-b5f4-a52a942be106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:44.766470 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b893f8f-7565-46cb-b5f4-a52a942be106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1304 microversion: 2.1 time: 0.875488 May 19 04:42:44.770214 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1394/2850] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:43 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1304 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:45.040943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-57077264", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6598bc70-0651-4830-84b7-60a72f799274"}], "security_groups": [{"name": "tempest-securitygroup--62586226"}], "key_name": "tempest-keypair-385478761", "user_data": "}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:45.057564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:45.059578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=14 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:45.230321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] validate_networks() for [('6598bc70-0651-4830-84b7-60a72f799274', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:42:45.280787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a09468e-1d53-4282-902f-525f813c46c6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:45.281531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2a09468e-1d53-4282-902f-525f813c46c6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:45.290525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a09468e-1d53-4282-902f-525f813c46c6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:45.291210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a09468e-1d53-4282-902f-525f813c46c6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:45.292274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a09468e-1d53-4282-902f-525f813c46c6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:45.292874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a09468e-1d53-4282-902f-525f813c46c6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:45.768642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2a09468e-1d53-4282-902f-525f813c46c6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:45.780717 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a09468e-1d53-4282-902f-525f813c46c6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1474 microversion: 2.1 time: 0.504837 May 19 04:42:45.783100 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1395/2851] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:45 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1474 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:45.798564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-99986409-be5e-4166-bfb7-3d11a8e42755 req-a0b29f4e-d906-4e57-97b2-41362aaaecf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "386556b3-9bff-473a-94c3-61225505b4ff", "tag": "b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:45.845466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-99986409-be5e-4166-bfb7-3d11a8e42755 req-a0b29f4e-d906-4e57-97b2-41362aaaecf4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:45.845922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-99986409-be5e-4166-bfb7-3d11a8e42755 req-a0b29f4e-d906-4e57-97b2-41362aaaecf4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:45.873423 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-99986409-be5e-4166-bfb7-3d11a8e42755 req-a0b29f4e-d906-4e57-97b2-41362aaaecf4 service nova] Creating event network-changed:b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5 for instance 386556b3-9bff-473a-94c3-61225505b4ff on n-h2-766726-30 May 19 04:42:45.897538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-99986409-be5e-4166-bfb7-3d11a8e42755 req-a0b29f4e-d906-4e57-97b2-41362aaaecf4 service nova] Instance 386556b3-9bff-473a-94c3-61225505b4ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:42:45.929095 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-99986409-be5e-4166-bfb7-3d11a8e42755 req-a0b29f4e-d906-4e57-97b2-41362aaaecf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135521 May 19 04:42:45.934225 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1396/2852] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:45.942686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a34a059c-8689-442b-b7de-fe95c2a58e9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:45.943947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a34a059c-8689-442b-b7de-fe95c2a58e9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:45.952883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a34a059c-8689-442b-b7de-fe95c2a58e9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:45.955271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a34a059c-8689-442b-b7de-fe95c2a58e9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:45.956389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a34a059c-8689-442b-b7de-fe95c2a58e9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:45.957694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a34a059c-8689-442b-b7de-fe95c2a58e9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:46.623347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a34a059c-8689-442b-b7de-fe95c2a58e9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:46.648145 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a34a059c-8689-442b-b7de-fe95c2a58e9c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1502 microversion: 2.1 time: 0.704872 May 19 04:42:46.650781 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1397/2853] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:45 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1502 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:46.668892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0fc0edce-d73a-4e4e-997c-a018846aa15a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:46.674299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0fc0edce-d73a-4e4e-997c-a018846aa15a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:46.694094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc0edce-d73a-4e4e-997c-a018846aa15a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:46.694470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc0edce-d73a-4e4e-997c-a018846aa15a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:46.695254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc0edce-d73a-4e4e-997c-a018846aa15a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:46.695691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc0edce-d73a-4e4e-997c-a018846aa15a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:46.964861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:42:46.965729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:42:46.966323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:42:46.966803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:42:46.967292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:42:46.980081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:46.980887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:46.981936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:46.982583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:47.008926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for project 0db6b7171e3b4a2db160855939246a40. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:47.014583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for user a651109c72e84cab9e712ad5fbd002b6 and project 0db6b7171e3b4a2db160855939246a40. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:47.046721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:42:47.050807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:42:47.071752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0fc0edce-d73a-4e4e-997c-a018846aa15a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:47.082616 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0fc0edce-d73a-4e4e-997c-a018846aa15a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1304 microversion: 2.1 time: 0.418623 May 19 04:42:47.084887 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1398/2854] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:46 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1304 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:47.098445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-95666312-8b08-479d-ae9a-e37c93917288 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:47.099833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-95666312-8b08-479d-ae9a-e37c93917288 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:47.116442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95666312-8b08-479d-ae9a-e37c93917288 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:47.117106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95666312-8b08-479d-ae9a-e37c93917288 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:47.118011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95666312-8b08-479d-ae9a-e37c93917288 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:47.119663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95666312-8b08-479d-ae9a-e37c93917288 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:47.136582 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64a1d3ae-eb2c-458d-9345-c5b901d33cf0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.100504 May 19 04:42:47.137836 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1457/2855] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:42:45 2022] POST /compute/v2.1/servers => generated 400 bytes in 2102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:42:47.143179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6a4ffad-41b6-4ca4-8a3a-c29209df7a0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:47.143981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6a4ffad-41b6-4ca4-8a3a-c29209df7a0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:47.154373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6a4ffad-41b6-4ca4-8a3a-c29209df7a0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:47.155062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6a4ffad-41b6-4ca4-8a3a-c29209df7a0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:47.156187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6a4ffad-41b6-4ca4-8a3a-c29209df7a0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:47.157346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6a4ffad-41b6-4ca4-8a3a-c29209df7a0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:47.167178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-95666312-8b08-479d-ae9a-e37c93917288 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lazy-loading 'flavor' on Instance uuid 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:42:47.558284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e6a4ffad-41b6-4ca4-8a3a-c29209df7a0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:47.565352 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-95666312-8b08-479d-ae9a-e37c93917288 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8/action" status: 202 len: 0 microversion: 2.1 time: 0.478966 May 19 04:42:47.571301 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6a4ffad-41b6-4ca4-8a3a-c29209df7a0e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1472 microversion: 2.1 time: 0.428773 May 19 04:42:47.571419 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1399/2856] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:42:47 2022] POST /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:42:47.572259 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1458/2857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:47 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:47.576932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cb947fe1-f2d5-4f4d-85d6-0147768f05fd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:47.577893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cb947fe1-f2d5-4f4d-85d6-0147768f05fd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:47.583675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f3e734b-ee50-4697-bd37-2f585620dbd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:47.584734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f3e734b-ee50-4697-bd37-2f585620dbd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:47.599508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f3e734b-ee50-4697-bd37-2f585620dbd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:47.601350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f3e734b-ee50-4697-bd37-2f585620dbd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:47.602525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f3e734b-ee50-4697-bd37-2f585620dbd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:47.605790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f3e734b-ee50-4697-bd37-2f585620dbd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:47.676466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cb947fe1-f2d5-4f4d-85d6-0147768f05fd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:47.686050 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cb947fe1-f2d5-4f4d-85d6-0147768f05fd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1239 microversion: 2.1 time: 0.113628 May 19 04:42:47.687338 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1400/2858] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:47 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1239 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:47.862776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f3e734b-ee50-4697-bd37-2f585620dbd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:47.872465 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f3e734b-ee50-4697-bd37-2f585620dbd3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.298559 May 19 04:42:47.873354 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1459/2859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:47 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:48.101745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c818e4e1-ae6e-443f-852e-8fe901580be7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:48.102432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c818e4e1-ae6e-443f-852e-8fe901580be7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:48.113375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c818e4e1-ae6e-443f-852e-8fe901580be7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:48.113827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c818e4e1-ae6e-443f-852e-8fe901580be7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:48.114634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c818e4e1-ae6e-443f-852e-8fe901580be7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:48.118112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c818e4e1-ae6e-443f-852e-8fe901580be7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:48.588695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5440680f-e78e-42fc-981c-b2bea034d705 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:48.589914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5440680f-e78e-42fc-981c-b2bea034d705 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:48.607384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5440680f-e78e-42fc-981c-b2bea034d705 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:48.610275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5440680f-e78e-42fc-981c-b2bea034d705 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:48.611272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5440680f-e78e-42fc-981c-b2bea034d705 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:48.611939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5440680f-e78e-42fc-981c-b2bea034d705 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:48.866390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c818e4e1-ae6e-443f-852e-8fe901580be7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:48.875711 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c818e4e1-ae6e-443f-852e-8fe901580be7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1304 microversion: 2.1 time: 0.779969 May 19 04:42:48.876316 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1401/2860] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:48 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1304 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:49.072901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f6764e2c-e16f-4e4d-8341-6b5937a7e22d tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Action: 'create', calling method: .version_select at 0x7fd31606f5e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-589719006", "policies": ["affinity"]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:49.134789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f6764e2c-e16f-4e4d-8341-6b5937a7e22d tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:49.141733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f6764e2c-e16f-4e4d-8341-6b5937a7e22d tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:49.152410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:49.215425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5440680f-e78e-42fc-981c-b2bea034d705 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:49.224829 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5440680f-e78e-42fc-981c-b2bea034d705 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1469 microversion: 2.1 time: 0.639661 May 19 04:42:49.238247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f6764e2c-e16f-4e4d-8341-6b5937a7e22d tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:49.248651 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1460/2861] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:48 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1469 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:49.249933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f6764e2c-e16f-4e4d-8341-6b5937a7e22d tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:49.254506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bad45dff-b7f3-48de-82d8-870592c9a2c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:49.255372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bad45dff-b7f3-48de-82d8-870592c9a2c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:49.265715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad45dff-b7f3-48de-82d8-870592c9a2c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:49.277642 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f6764e2c-e16f-4e4d-8341-6b5937a7e22d tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.399940 May 19 04:42:49.278021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad45dff-b7f3-48de-82d8-870592c9a2c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:49.279023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad45dff-b7f3-48de-82d8-870592c9a2c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:49.279620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bad45dff-b7f3-48de-82d8-870592c9a2c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:49.283135 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1402/2862] 10.222.0.58 () {60 vars in 1173 bytes} [Thu May 19 04:42:48 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:49.288581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-010bb5a2-97cc-47b0-810e-db3ddd2fc130 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:49.289241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-010bb5a2-97cc-47b0-810e-db3ddd2fc130 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:49.313674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-010bb5a2-97cc-47b0-810e-db3ddd2fc130 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:49.314129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-010bb5a2-97cc-47b0-810e-db3ddd2fc130 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:49.314927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-010bb5a2-97cc-47b0-810e-db3ddd2fc130 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:49.315371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-010bb5a2-97cc-47b0-810e-db3ddd2fc130 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:49.409756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bad45dff-b7f3-48de-82d8-870592c9a2c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:49.418696 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bad45dff-b7f3-48de-82d8-870592c9a2c9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1309 microversion: 2.1 time: 0.168377 May 19 04:42:49.422824 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1461/2863] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:49 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:49.429631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c3eca0b9-58d5-4630-98e8-3c4d4d224a17 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:49.436231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c3eca0b9-58d5-4630-98e8-3c4d4d224a17 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:49.455691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3eca0b9-58d5-4630-98e8-3c4d4d224a17 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:49.456600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3eca0b9-58d5-4630-98e8-3c4d4d224a17 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:49.457652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3eca0b9-58d5-4630-98e8-3c4d4d224a17 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:49.458249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3eca0b9-58d5-4630-98e8-3c4d4d224a17 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:49.613039 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c3eca0b9-58d5-4630-98e8-3c4d4d224a17 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff/action" status: 204 len: 0 microversion: 2.1 time: 0.188745 May 19 04:42:49.614597 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1462/2864] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:42:49 2022] POST /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff/action => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:42:49.627654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-25822ef7-60f3-4a98-8603-c20e7b7d30c7 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Action: 'create', calling method: .version_select at 0x7fd315f97dc0>, body: {"server_group": {"name": "tempest-server-group-248084703", "policies": ["affinity"]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:49.667720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-25822ef7-60f3-4a98-8603-c20e7b7d30c7 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:49.677643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-25822ef7-60f3-4a98-8603-c20e7b7d30c7 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:49.787473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-25822ef7-60f3-4a98-8603-c20e7b7d30c7 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:49.790073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:49.793543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-25822ef7-60f3-4a98-8603-c20e7b7d30c7 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:49.829196 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-25822ef7-60f3-4a98-8603-c20e7b7d30c7 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.211075 May 19 04:42:49.834457 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1463/2865] 10.222.0.58 () {60 vars in 1172 bytes} [Thu May 19 04:42:49 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:49.839455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e615fe0d-f134-45e7-baf1-6e837fb5af67 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:49.840385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e615fe0d-f134-45e7-baf1-6e837fb5af67 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:49.860302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e615fe0d-f134-45e7-baf1-6e837fb5af67 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:49.861041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e615fe0d-f134-45e7-baf1-6e837fb5af67 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:49.862056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e615fe0d-f134-45e7-baf1-6e837fb5af67 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:49.862659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e615fe0d-f134-45e7-baf1-6e837fb5af67 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:49.914945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-010bb5a2-97cc-47b0-810e-db3ddd2fc130 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:49.926595 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-010bb5a2-97cc-47b0-810e-db3ddd2fc130 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.642251 May 19 04:42:49.933597 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1403/2866] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:49 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:49.941904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9bd4d130-594f-4b18-baad-a3241660db2b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Action: 'create', calling method: .version_select at 0x7fd31606f1f0>, body: {"server_group": {"name": "tempest-server-group-248084703", "policies": ["affinity"]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:49.985899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9bd4d130-594f-4b18-baad-a3241660db2b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:49.994534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9bd4d130-594f-4b18-baad-a3241660db2b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:50.090290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9bd4d130-594f-4b18-baad-a3241660db2b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:50.107638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9bd4d130-594f-4b18-baad-a3241660db2b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:50.134307 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9bd4d130-594f-4b18-baad-a3241660db2b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.199522 May 19 04:42:50.134920 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1404/2867] 10.222.0.58 () {60 vars in 1172 bytes} [Thu May 19 04:42:49 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:50.139434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-96231cf8-e55e-435e-a018-706498076069 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:50.140060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-96231cf8-e55e-435e-a018-706498076069 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:50.147106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96231cf8-e55e-435e-a018-706498076069 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:50.147561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96231cf8-e55e-435e-a018-706498076069 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:50.148338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96231cf8-e55e-435e-a018-706498076069 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:50.148778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96231cf8-e55e-435e-a018-706498076069 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:50.353214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e615fe0d-f134-45e7-baf1-6e837fb5af67 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:50.362410 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e615fe0d-f134-45e7-baf1-6e837fb5af67 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1469 microversion: 2.1 time: 0.526612 May 19 04:42:50.375696 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1464/2868] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:49 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1469 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:50.379334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e03cf15-55bd-48ad-b573-fb2155cd133b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:50.422754 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e03cf15-55bd-48ad-b573-fb2155cd133b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/0bf12883-f856-48fb-969d-0f72198d74a6" status: 204 len: 0 microversion: 2.1 time: 0.047474 May 19 04:42:50.425618 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1465/2869] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:42:50 2022] DELETE /compute/v2.1/os-server-groups/0bf12883-f856-48fb-969d-0f72198d74a6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:42:50.435821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b28e3ba8-c1e4-4caf-8bf2-097e63cb0a8e tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:50.448891 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b28e3ba8-c1e4-4caf-8bf2-097e63cb0a8e tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.018451 May 19 04:42:50.451104 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1466/2870] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:42:50 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:50.457518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-589f09d8-15d8-4fd8-a7e7-2547f8afd3a9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:50.461566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-589f09d8-15d8-4fd8-a7e7-2547f8afd3a9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:50.468645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-589f09d8-15d8-4fd8-a7e7-2547f8afd3a9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:50.469122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-589f09d8-15d8-4fd8-a7e7-2547f8afd3a9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:50.470189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-589f09d8-15d8-4fd8-a7e7-2547f8afd3a9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:50.470632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-589f09d8-15d8-4fd8-a7e7-2547f8afd3a9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:50.532528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-96231cf8-e55e-435e-a018-706498076069 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:50.544694 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-96231cf8-e55e-435e-a018-706498076069 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1304 microversion: 2.1 time: 0.408664 May 19 04:42:50.550526 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1405/2871] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:50 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1304 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:50.567801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c49a782a-a89e-4d6d-86e8-16b4b77ec387 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:50.656321 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c49a782a-a89e-4d6d-86e8-16b4b77ec387 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/ea1d8e32-ad44-4410-9aa5-1d80021dbcdf" status: 204 len: 0 microversion: 2.1 time: 0.099957 May 19 04:42:50.657912 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1406/2872] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:42:50 2022] DELETE /compute/v2.1/os-server-groups/ea1d8e32-ad44-4410-9aa5-1d80021dbcdf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:42:50.667515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bc820820-1c93-441c-ab7d-352011ed892f tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:50.702672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bc820820-1c93-441c-ab7d-352011ed892f tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.039142 May 19 04:42:50.703753 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1407/2873] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:42:50 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:50.704508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-589f09d8-15d8-4fd8-a7e7-2547f8afd3a9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:50.713552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-589f09d8-15d8-4fd8-a7e7-2547f8afd3a9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1297 microversion: 2.1 time: 0.260945 May 19 04:42:50.717825 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1467/2874] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:50 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1297 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:50.719820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-12b6b638-cea3-4e80-80a8-2029e95f66b4 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Action: 'create', calling method: .version_select at 0x7fd315b889d0>, body: {"server_group": {"name": "tempest-server-group-1193891390", "policies": ["affinity"]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:50.761229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-12b6b638-cea3-4e80-80a8-2029e95f66b4 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:50.775613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-12b6b638-cea3-4e80-80a8-2029e95f66b4 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:50.875706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-12b6b638-cea3-4e80-80a8-2029e95f66b4 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:50.885116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-12b6b638-cea3-4e80-80a8-2029e95f66b4 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:50.944257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bf70c7b5-8f6a-4ae0-b027-6f222be939df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:50.945070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bf70c7b5-8f6a-4ae0-b027-6f222be939df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:50.953699 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-12b6b638-cea3-4e80-80a8-2029e95f66b4 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.236037 May 19 04:42:50.954334 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1408/2875] 10.222.0.58 () {60 vars in 1172 bytes} [Thu May 19 04:42:50 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:42:50.956511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf70c7b5-8f6a-4ae0-b027-6f222be939df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:50.956970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf70c7b5-8f6a-4ae0-b027-6f222be939df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:50.957784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf70c7b5-8f6a-4ae0-b027-6f222be939df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:50.958226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf70c7b5-8f6a-4ae0-b027-6f222be939df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:50.972223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e547710-3c77-4cdc-9af2-2c08d3104ee4 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:51.037515 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e547710-3c77-4cdc-9af2-2c08d3104ee4 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/09d4a3c7-f6d1-4d44-87c5-0f443c1437df" status: 204 len: 0 microversion: 2.1 time: 0.076440 May 19 04:42:51.039609 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1409/2876] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:42:50 2022] DELETE /compute/v2.1/os-server-groups/09d4a3c7-f6d1-4d44-87c5-0f443c1437df => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:42:51.051681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1a746ad0-f261-4b20-bedc-a6a1253a36fb tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:51.080793 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1a746ad0-f261-4b20-bedc-a6a1253a36fb tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029967 May 19 04:42:51.081482 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1410/2877] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:42:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:51.095630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e38a4d42-de93-4c28-a589-48e20819e6a2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Action: 'create', calling method: .version_select at 0x7fd316054670>, body: {"server_group": {"name": "tempest-server-group-380963800", "policies": ["anti-affinity"]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:51.115297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:51.127438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e38a4d42-de93-4c28-a589-48e20819e6a2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:51.134360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e38a4d42-de93-4c28-a589-48e20819e6a2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:51.212346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e38a4d42-de93-4c28-a589-48e20819e6a2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:51.220019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e38a4d42-de93-4c28-a589-48e20819e6a2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_groups'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:51.248836 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e38a4d42-de93-4c28-a589-48e20819e6a2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.157003 May 19 04:42:51.250699 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1411/2878] 10.222.0.58 () {60 vars in 1172 bytes} [Thu May 19 04:42:51 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:51.263449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f798b0a5-6da7-4818-bcd4-933e46796dcc tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:51.283719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bf70c7b5-8f6a-4ae0-b027-6f222be939df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:51.296243 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bf70c7b5-8f6a-4ae0-b027-6f222be939df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.355176 May 19 04:42:51.308484 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1468/2879] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:50 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:51.321701 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f798b0a5-6da7-4818-bcd4-933e46796dcc tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/1a0dcaf4-e940-4809-a5c0-8dd0454eacc0" status: 204 len: 0 microversion: 2.1 time: 0.064419 May 19 04:42:51.322749 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1412/2880] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:42:51 2022] DELETE /compute/v2.1/os-server-groups/1a0dcaf4-e940-4809-a5c0-8dd0454eacc0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:42:51.347257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7493bdd1-beac-4c2f-a681-95ba4eda5648 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:51.356041 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7493bdd1-beac-4c2f-a681-95ba4eda5648 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.012679 May 19 04:42:51.369772 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1469/2881] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:42:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:51.381222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d93877b6-46ee-4956-a993-844d815d76eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:51.381854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d93877b6-46ee-4956-a993-844d815d76eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:51.390678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d93877b6-46ee-4956-a993-844d815d76eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:51.395668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d93877b6-46ee-4956-a993-844d815d76eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:51.396782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d93877b6-46ee-4956-a993-844d815d76eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:51.397159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d93877b6-46ee-4956-a993-844d815d76eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:51.425499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1377067790", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "e53e21cb-b3d3-4107-ba36-5733dc83c47a"}]}, "os:scheduler_hints": {"group": "898cd8a0-7730-4af1-9d20-75c1d8471153"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:51.526190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] validate_networks() for [('e53e21cb-b3d3-4107-ba36-5733dc83c47a', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:42:52.029385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d93877b6-46ee-4956-a993-844d815d76eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:52.043071 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d93877b6-46ee-4956-a993-844d815d76eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1469 microversion: 2.1 time: 0.666618 May 19 04:42:52.044166 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1413/2882] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:51 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1469 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:52.058123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d960f72c-7b61-4c4f-8f98-7bfb6c35c998 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:52.059671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d960f72c-7b61-4c4f-8f98-7bfb6c35c998 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:52.068680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d960f72c-7b61-4c4f-8f98-7bfb6c35c998 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:52.069461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d960f72c-7b61-4c4f-8f98-7bfb6c35c998 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:52.070283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d960f72c-7b61-4c4f-8f98-7bfb6c35c998 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:52.070732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d960f72c-7b61-4c4f-8f98-7bfb6c35c998 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:52.420069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:42:52.420971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:42:52.421483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:42:52.421899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:42:52.422681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:42:52.435810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d960f72c-7b61-4c4f-8f98-7bfb6c35c998 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:52.445833 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d960f72c-7b61-4c4f-8f98-7bfb6c35c998 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1304 microversion: 2.1 time: 0.400405 May 19 04:42:52.447638 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1414/2883] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:52 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1304 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:52.451696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:52.452155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:52.452955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:52.453439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:52.459105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d7b804e6-b9b5-4d59-90a4-174383ee0c51 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:52.459922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d7b804e6-b9b5-4d59-90a4-174383ee0c51 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:52.473844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7b804e6-b9b5-4d59-90a4-174383ee0c51 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:52.474544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7b804e6-b9b5-4d59-90a4-174383ee0c51 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:52.475487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7b804e6-b9b5-4d59-90a4-174383ee0c51 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:52.476090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d7b804e6-b9b5-4d59-90a4-174383ee0c51 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:52.492142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:52.503141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:52.520579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:42:52.523973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:42:52.586970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:52.594400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:52.650952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:52.658306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Getting quotas for user c7b76e5ebca942739771a4f3da7b6036 and project ec4f8d09d25f4727b51a2a8188edd195. Resources: {'server_group_members'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:52.690349 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e4955481-bff0-4268-a70a-7c995424c0da tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.268845 May 19 04:42:52.696342 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1470/2884] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:42:52.698266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51894c63-af42-4b50-95d1-eebc80c49924 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:52.699067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-51894c63-af42-4b50-95d1-eebc80c49924 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:52.716060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51894c63-af42-4b50-95d1-eebc80c49924 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:52.716646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51894c63-af42-4b50-95d1-eebc80c49924 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:52.717606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51894c63-af42-4b50-95d1-eebc80c49924 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:52.718144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51894c63-af42-4b50-95d1-eebc80c49924 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:52.800767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d7b804e6-b9b5-4d59-90a4-174383ee0c51 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:52.826441 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d7b804e6-b9b5-4d59-90a4-174383ee0c51 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1363 microversion: 2.1 time: 0.377028 May 19 04:42:52.836882 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1415/2885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:52 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:52.841940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f29c4ffa-44e7-40c5-ba9f-60c061aa48a9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:52.842570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f29c4ffa-44e7-40c5-ba9f-60c061aa48a9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:52.968095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f29c4ffa-44e7-40c5-ba9f-60c061aa48a9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:52.980972 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f29c4ffa-44e7-40c5-ba9f-60c061aa48a9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1213 microversion: 2.1 time: 0.142843 May 19 04:42:52.982258 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1416/2886] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:52 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:52.987324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-00c60abe-7b35-4385-8870-6a6d3b08f125 req-5bea41fe-8cda-4dde-a058-82e9c65c2cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386556b3-9bff-473a-94c3-61225505b4ff", "name": "network-vif-plugged", "status": "completed", "tag": "b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:52.996714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-00c60abe-7b35-4385-8870-6a6d3b08f125 req-5bea41fe-8cda-4dde-a058-82e9c65c2cb5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:52.997186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-00c60abe-7b35-4385-8870-6a6d3b08f125 req-5bea41fe-8cda-4dde-a058-82e9c65c2cb5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.009995 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-00c60abe-7b35-4385-8870-6a6d3b08f125 req-5bea41fe-8cda-4dde-a058-82e9c65c2cb5 service nova] Creating event network-vif-plugged:b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5 for instance 386556b3-9bff-473a-94c3-61225505b4ff on n-h2-766726-30 May 19 04:42:53.015734 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-00c60abe-7b35-4385-8870-6a6d3b08f125 req-5bea41fe-8cda-4dde-a058-82e9c65c2cb5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032395 May 19 04:42:53.016731 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1417/2887] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:53.060688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b94f587a-f474-4dbb-953e-9ec13746703a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:53.061428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b94f587a-f474-4dbb-953e-9ec13746703a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:53.069317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94f587a-f474-4dbb-953e-9ec13746703a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.070014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94f587a-f474-4dbb-953e-9ec13746703a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.071598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94f587a-f474-4dbb-953e-9ec13746703a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.072121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94f587a-f474-4dbb-953e-9ec13746703a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.096686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-51894c63-af42-4b50-95d1-eebc80c49924 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:53.105745 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51894c63-af42-4b50-95d1-eebc80c49924 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.413424 May 19 04:42:53.106998 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1471/2888] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:52 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:53.274259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-7c05de43-b332-415e-ab60-a20d3efca970 req-98feeedf-0edd-4cf0-b12d-5a2980d66a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c25126-57dc-4b2f-b1d8-93980536a256", "tag": "f1dfd523-b4d9-4a9b-ac07-5b77b712f25c"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:53.301550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7c05de43-b332-415e-ab60-a20d3efca970 req-98feeedf-0edd-4cf0-b12d-5a2980d66a6a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.302018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7c05de43-b332-415e-ab60-a20d3efca970 req-98feeedf-0edd-4cf0-b12d-5a2980d66a6a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.321214 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7c05de43-b332-415e-ab60-a20d3efca970 req-98feeedf-0edd-4cf0-b12d-5a2980d66a6a service nova] Creating event network-changed:f1dfd523-b4d9-4a9b-ac07-5b77b712f25c for instance 71c25126-57dc-4b2f-b1d8-93980536a256 on n-h2-766726-30 May 19 04:42:53.335828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b94f587a-f474-4dbb-953e-9ec13746703a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:53.347640 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-7c05de43-b332-415e-ab60-a20d3efca970 req-98feeedf-0edd-4cf0-b12d-5a2980d66a6a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077595 May 19 04:42:53.348732 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1472/2889] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:53.355038 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b94f587a-f474-4dbb-953e-9ec13746703a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1461 microversion: 2.1 time: 0.298970 May 19 04:42:53.385694 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1418/2890] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:53 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1461 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:53.388108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a3b1e441-7bb4-4c52-97d5-931ab246a742 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:53.389488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a3b1e441-7bb4-4c52-97d5-931ab246a742 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:53.398528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3b1e441-7bb4-4c52-97d5-931ab246a742 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.399553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3b1e441-7bb4-4c52-97d5-931ab246a742 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.405750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3b1e441-7bb4-4c52-97d5-931ab246a742 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.406495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3b1e441-7bb4-4c52-97d5-931ab246a742 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.430940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:53.464448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a5e65bb-8854-41b8-9bc0-4a13515951c6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:53.467892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0a5e65bb-8854-41b8-9bc0-4a13515951c6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:53.483013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a5e65bb-8854-41b8-9bc0-4a13515951c6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.483554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a5e65bb-8854-41b8-9bc0-4a13515951c6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.484385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a5e65bb-8854-41b8-9bc0-4a13515951c6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.484838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a5e65bb-8854-41b8-9bc0-4a13515951c6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.511351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:53.740902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a3b1e441-7bb4-4c52-97d5-931ab246a742 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:53.749837 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a3b1e441-7bb4-4c52-97d5-931ab246a742 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1461 microversion: 2.1 time: 0.368192 May 19 04:42:53.750759 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1473/2891] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:53 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1461 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:53.767039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-363b842f-f9be-4a0a-8ab5-02a5944832f9 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '.version_select at 0x7fd315e71f70>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:53.769881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-363b842f-f9be-4a0a-8ab5-02a5944832f9 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.769881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-363b842f-f9be-4a0a-8ab5-02a5944832f9 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.779472 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-363b842f-f9be-4a0a-8ab5-02a5944832f9 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.014554 May 19 04:42:53.779472 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1474/2892] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 04:42:53 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:42:53.801048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-19736963-55ce-4387-bc17-c24cecae142f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:53.809530 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-19736963-55ce-4387-bc17-c24cecae142f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012742 May 19 04:42:53.810875 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1475/2893] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:42:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:42:53.821738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4af8d887-37ba-4cb2-966a-a91d9c3a59ed tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2080067618", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:53.823297 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:42:53.823297 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:42:53.840472 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4af8d887-37ba-4cb2-966a-a91d9c3a59ed tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.022612 May 19 04:42:53.841068 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1476/2894] 10.222.0.58 () {60 vars in 1145 bytes} [Thu May 19 04:42:53 2022] POST /compute/v2.1/flavors => generated 499 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:42:53.845528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55210876-ec48-464d-ac08-b1320a96e716 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:53.846128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-55210876-ec48-464d-ac08-b1320a96e716 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:53.857703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0a5e65bb-8854-41b8-9bc0-4a13515951c6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:53.868867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55210876-ec48-464d-ac08-b1320a96e716 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.869686 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0a5e65bb-8854-41b8-9bc0-4a13515951c6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.410805 May 19 04:42:53.870716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55210876-ec48-464d-ac08-b1320a96e716 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.871173 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1419/2895] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:53 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:53.873108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55210876-ec48-464d-ac08-b1320a96e716 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:53.873623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55210876-ec48-464d-ac08-b1320a96e716 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:53.883888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-14969267-7c4d-4142-a306-50639658a6fd tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:53.896819 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-14969267-7c4d-4142-a306-50639658a6fd tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024531 May 19 04:42:53.900745 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1420/2896] 10.222.0.58 () {58 vars in 1181 bytes} [Thu May 19 04:42:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:42:54.001287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-58f8291c-58cd-4051-a5c6-12c4907b0564 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:54.002477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-58f8291c-58cd-4051-a5c6-12c4907b0564 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:54.015148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58f8291c-58cd-4051-a5c6-12c4907b0564 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:54.015676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58f8291c-58cd-4051-a5c6-12c4907b0564 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:54.027127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58f8291c-58cd-4051-a5c6-12c4907b0564 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:54.028178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58f8291c-58cd-4051-a5c6-12c4907b0564 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:54.125305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55210876-ec48-464d-ac08-b1320a96e716 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:54.134887 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-55210876-ec48-464d-ac08-b1320a96e716 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1363 microversion: 2.1 time: 0.292744 May 19 04:42:54.135913 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1477/2897] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:53 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:54.140696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-699873097", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "61056ff7-5c00-40da-ae97-09efc2ebed8d"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:54.197510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:42:54.222959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58f8291c-58cd-4051-a5c6-12c4907b0564 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:54.236019 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-58f8291c-58cd-4051-a5c6-12c4907b0564 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1265 microversion: 2.1 time: 0.241480 May 19 04:42:54.237235 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1421/2898] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:53 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:54.246146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-840341a2-3c08-43c7-bda3-e4e90701fcf3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:54.248853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-840341a2-3c08-43c7-bda3-e4e90701fcf3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:54.261978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840341a2-3c08-43c7-bda3-e4e90701fcf3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:54.266568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840341a2-3c08-43c7-bda3-e4e90701fcf3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:54.270108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840341a2-3c08-43c7-bda3-e4e90701fcf3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:54.272579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840341a2-3c08-43c7-bda3-e4e90701fcf3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:54.587804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-840341a2-3c08-43c7-bda3-e4e90701fcf3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:54.610555 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-840341a2-3c08-43c7-bda3-e4e90701fcf3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.371645 May 19 04:42:54.618681 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1422/2899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:54 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:54.667584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:42:54.670629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:42:54.673063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:42:54.673834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:42:54.674575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:42:54.694516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:54.695346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:54.697372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:54.698083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:54.727859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:42:54.735887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for user 55c593b7f2a04b0e820a505e8e8eb521 and project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:42:54.778531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:42:54.781477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:42:54.856250 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b9307d3-3a75-4550-b577-e8073ca060ec tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718846 May 19 04:42:54.859846 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1478/2900] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:42:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:42:54.869775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf38eebd-2816-4813-baa8-c0a1ad787905 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:54.870833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf38eebd-2816-4813-baa8-c0a1ad787905 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:54.889751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1616fe12-50dd-4bfc-b59a-374df3f7b110 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:54.890831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1616fe12-50dd-4bfc-b59a-374df3f7b110 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:54.906517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1616fe12-50dd-4bfc-b59a-374df3f7b110 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:54.909990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1616fe12-50dd-4bfc-b59a-374df3f7b110 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:54.910972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1616fe12-50dd-4bfc-b59a-374df3f7b110 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:54.912118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1616fe12-50dd-4bfc-b59a-374df3f7b110 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:55.009439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cf38eebd-2816-4813-baa8-c0a1ad787905 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:55.017059 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf38eebd-2816-4813-baa8-c0a1ad787905 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1278 microversion: 2.1 time: 0.153374 May 19 04:42:55.029877 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1423/2901] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:54 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:55.152920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-94b8693b-c38f-4542-9cff-77b7610af8cd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:55.153564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-94b8693b-c38f-4542-9cff-77b7610af8cd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:55.163123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94b8693b-c38f-4542-9cff-77b7610af8cd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:55.163585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94b8693b-c38f-4542-9cff-77b7610af8cd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:55.164372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94b8693b-c38f-4542-9cff-77b7610af8cd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:55.164813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94b8693b-c38f-4542-9cff-77b7610af8cd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:55.246741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1616fe12-50dd-4bfc-b59a-374df3f7b110 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:55.261099 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1616fe12-50dd-4bfc-b59a-374df3f7b110 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.375988 May 19 04:42:55.271732 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1479/2902] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:54 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:55.281943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-511bfd2b-885c-45f1-9bb2-70f5efc4f01b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:55.283143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-511bfd2b-885c-45f1-9bb2-70f5efc4f01b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:55.306318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-511bfd2b-885c-45f1-9bb2-70f5efc4f01b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:55.307839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-511bfd2b-885c-45f1-9bb2-70f5efc4f01b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:55.310572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-511bfd2b-885c-45f1-9bb2-70f5efc4f01b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:55.313826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-511bfd2b-885c-45f1-9bb2-70f5efc4f01b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:55.781728 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-94b8693b-c38f-4542-9cff-77b7610af8cd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:55.793130 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-94b8693b-c38f-4542-9cff-77b7610af8cd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1363 microversion: 2.1 time: 0.643101 May 19 04:42:55.795604 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1424/2903] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:55 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1363 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:55.813868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-02f2fb58-8486-4b22-995d-52f881f15042 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:55.815036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-02f2fb58-8486-4b22-995d-52f881f15042 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:55.816119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-511bfd2b-885c-45f1-9bb2-70f5efc4f01b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:55.828873 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-511bfd2b-885c-45f1-9bb2-70f5efc4f01b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1313 microversion: 2.1 time: 0.551091 May 19 04:42:55.831587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02f2fb58-8486-4b22-995d-52f881f15042 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:55.832061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02f2fb58-8486-4b22-995d-52f881f15042 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:55.833010 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1480/2904] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:55 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:55.842958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02f2fb58-8486-4b22-995d-52f881f15042 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:55.844767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02f2fb58-8486-4b22-995d-52f881f15042 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:56.042625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3f454378-b290-43a1-821e-17c12bcdfeaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:56.043426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3f454378-b290-43a1-821e-17c12bcdfeaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:56.051791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:42:56.073631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f454378-b290-43a1-821e-17c12bcdfeaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:56.074414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f454378-b290-43a1-821e-17c12bcdfeaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:56.078427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f454378-b290-43a1-821e-17c12bcdfeaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:56.081916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f454378-b290-43a1-821e-17c12bcdfeaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:56.497313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3f454378-b290-43a1-821e-17c12bcdfeaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:56.511126 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3f454378-b290-43a1-821e-17c12bcdfeaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1330 microversion: 2.1 time: 0.474635 May 19 04:42:56.511740 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1481/2905] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:56 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1330 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:56.529528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-38e13605-cefa-4dec-a625-e1aabc1fb91c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:56.530130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-38e13605-cefa-4dec-a625-e1aabc1fb91c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:56.547567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38e13605-cefa-4dec-a625-e1aabc1fb91c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:56.548063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38e13605-cefa-4dec-a625-e1aabc1fb91c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:56.548847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38e13605-cefa-4dec-a625-e1aabc1fb91c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:56.549333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38e13605-cefa-4dec-a625-e1aabc1fb91c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:56.662866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02f2fb58-8486-4b22-995d-52f881f15042 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:56.671739 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-02f2fb58-8486-4b22-995d-52f881f15042 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.874663 May 19 04:42:56.672339 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1425/2906] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:55 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:56.702346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f51273c5-38cc-4e65-8b69-3a9f392395e7 req-999ffc55-8a01-4cfd-b0a8-668feaca2cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a696adb-6dd1-4fae-9ef2-06b964a0fd8a", "tag": "15651615-54b8-477a-a850-5680373e2116"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:56.741308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f51273c5-38cc-4e65-8b69-3a9f392395e7 req-999ffc55-8a01-4cfd-b0a8-668feaca2cba service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:56.741761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f51273c5-38cc-4e65-8b69-3a9f392395e7 req-999ffc55-8a01-4cfd-b0a8-668feaca2cba service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:56.762877 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f51273c5-38cc-4e65-8b69-3a9f392395e7 req-999ffc55-8a01-4cfd-b0a8-668feaca2cba service nova] Creating event network-changed:15651615-54b8-477a-a850-5680373e2116 for instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a on n-h1-766726-30 May 19 04:42:56.775463 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f51273c5-38cc-4e65-8b69-3a9f392395e7 req-999ffc55-8a01-4cfd-b0a8-668feaca2cba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086200 May 19 04:42:56.776353 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1426/2907] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:42:56.818293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-077d8ab6-3bed-457d-b2cb-0e80108b3cd4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:56.819915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-077d8ab6-3bed-457d-b2cb-0e80108b3cd4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:56.829374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-077d8ab6-3bed-457d-b2cb-0e80108b3cd4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:56.830080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-077d8ab6-3bed-457d-b2cb-0e80108b3cd4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:56.831055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-077d8ab6-3bed-457d-b2cb-0e80108b3cd4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:56.832004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-077d8ab6-3bed-457d-b2cb-0e80108b3cd4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:57.009307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-38e13605-cefa-4dec-a625-e1aabc1fb91c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:57.021764 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-38e13605-cefa-4dec-a625-e1aabc1fb91c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.505166 May 19 04:42:57.023469 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1482/2908] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:56 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:57.028442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bca2cf63-2412-4ed2-86fc-b45fd58a3d18 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:57.029363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bca2cf63-2412-4ed2-86fc-b45fd58a3d18 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:57.036575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bca2cf63-2412-4ed2-86fc-b45fd58a3d18 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:57.037148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bca2cf63-2412-4ed2-86fc-b45fd58a3d18 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:57.038016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bca2cf63-2412-4ed2-86fc-b45fd58a3d18 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:57.038552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bca2cf63-2412-4ed2-86fc-b45fd58a3d18 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:57.167091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-077d8ab6-3bed-457d-b2cb-0e80108b3cd4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:57.188132 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-077d8ab6-3bed-457d-b2cb-0e80108b3cd4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1363 microversion: 2.1 time: 0.376015 May 19 04:42:57.190339 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1427/2909] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:56 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:57.278995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bca2cf63-2412-4ed2-86fc-b45fd58a3d18 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:57.287296 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bca2cf63-2412-4ed2-86fc-b45fd58a3d18 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1313 microversion: 2.1 time: 0.262109 May 19 04:42:57.287896 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1483/2910] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:57 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:57.528455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d10c07d5-f639-4802-ad01-d6dcf386f523 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:57.529353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d10c07d5-f639-4802-ad01-d6dcf386f523 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:57.536099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d10c07d5-f639-4802-ad01-d6dcf386f523 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:57.537153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d10c07d5-f639-4802-ad01-d6dcf386f523 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:57.537997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d10c07d5-f639-4802-ad01-d6dcf386f523 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:57.538382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d10c07d5-f639-4802-ad01-d6dcf386f523 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:57.611768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d10c07d5-f639-4802-ad01-d6dcf386f523 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:57.619318 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d10c07d5-f639-4802-ad01-d6dcf386f523 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1336 microversion: 2.1 time: 0.094755 May 19 04:42:57.619905 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1428/2911] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:57 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:57.693949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-50fc0318-526d-4326-8afc-06b0f998397b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:57.695363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-50fc0318-526d-4326-8afc-06b0f998397b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:57.721995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50fc0318-526d-4326-8afc-06b0f998397b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:57.722741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50fc0318-526d-4326-8afc-06b0f998397b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:57.723721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50fc0318-526d-4326-8afc-06b0f998397b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:57.724623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50fc0318-526d-4326-8afc-06b0f998397b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:57.972397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-50fc0318-526d-4326-8afc-06b0f998397b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:57.981905 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-50fc0318-526d-4326-8afc-06b0f998397b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.295767 May 19 04:42:57.983866 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1484/2912] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:57 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:58.038494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ddab7d5-964b-4153-9710-daab6f06afc6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:58.040137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3ddab7d5-964b-4153-9710-daab6f06afc6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:58.048072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ddab7d5-964b-4153-9710-daab6f06afc6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:58.049023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ddab7d5-964b-4153-9710-daab6f06afc6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:58.049973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ddab7d5-964b-4153-9710-daab6f06afc6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:58.050563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ddab7d5-964b-4153-9710-daab6f06afc6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:58.206921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-04d95d6f-6a2b-4fb2-bc6b-92a5eee35a76 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:58.208160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-04d95d6f-6a2b-4fb2-bc6b-92a5eee35a76 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:58.217245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04d95d6f-6a2b-4fb2-bc6b-92a5eee35a76 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:58.218563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04d95d6f-6a2b-4fb2-bc6b-92a5eee35a76 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:58.219571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04d95d6f-6a2b-4fb2-bc6b-92a5eee35a76 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:58.220201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04d95d6f-6a2b-4fb2-bc6b-92a5eee35a76 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:58.343410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3ddab7d5-964b-4153-9710-daab6f06afc6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:58.352915 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ddab7d5-964b-4153-9710-daab6f06afc6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.318229 May 19 04:42:58.354012 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1429/2913] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:58 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:58.359356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-967516de-e704-4725-938e-05e1c971add9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:58.360634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-967516de-e704-4725-938e-05e1c971add9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:58.369385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-967516de-e704-4725-938e-05e1c971add9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:58.370054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-967516de-e704-4725-938e-05e1c971add9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:58.370978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-967516de-e704-4725-938e-05e1c971add9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:58.371568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-967516de-e704-4725-938e-05e1c971add9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:58.557648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-04d95d6f-6a2b-4fb2-bc6b-92a5eee35a76 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:58.588758 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-04d95d6f-6a2b-4fb2-bc6b-92a5eee35a76 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1363 microversion: 2.1 time: 0.383593 May 19 04:42:58.591168 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1485/2914] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:58 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:58.636830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f12b9e5-7650-4e54-9966-3caa78585dab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:58.637674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f12b9e5-7650-4e54-9966-3caa78585dab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:58.643616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f12b9e5-7650-4e54-9966-3caa78585dab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:58.644068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f12b9e5-7650-4e54-9966-3caa78585dab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:58.644835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f12b9e5-7650-4e54-9966-3caa78585dab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:58.646652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f12b9e5-7650-4e54-9966-3caa78585dab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:58.662206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-967516de-e704-4725-938e-05e1c971add9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:58.673967 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-967516de-e704-4725-938e-05e1c971add9 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1313 microversion: 2.1 time: 0.318658 May 19 04:42:58.675030 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1430/2915] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:58 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:58.947297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0f12b9e5-7650-4e54-9966-3caa78585dab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:58.959045 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f12b9e5-7650-4e54-9966-3caa78585dab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1378 microversion: 2.1 time: 0.324008 May 19 04:42:58.961330 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1486/2916] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:58 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1378 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:59.002356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-42b8b958-2edc-4064-8f89-a82e480408b3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:59.003442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-42b8b958-2edc-4064-8f89-a82e480408b3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:59.029045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42b8b958-2edc-4064-8f89-a82e480408b3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.029562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42b8b958-2edc-4064-8f89-a82e480408b3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.030369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42b8b958-2edc-4064-8f89-a82e480408b3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.039090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42b8b958-2edc-4064-8f89-a82e480408b3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.061508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ed2bca43-f16c-42c6-ba8b-e41ba1a911b3 req-503e15c8-043c-492e-bbf3-a6e3b0b55803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bd7e64-3246-40ea-844d-5e88603a9e20", "tag": "60433ce3-7f6a-48fa-9b49-9f65b436fd14"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:42:59.084509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ed2bca43-f16c-42c6-ba8b-e41ba1a911b3 req-503e15c8-043c-492e-bbf3-a6e3b0b55803 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.084970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ed2bca43-f16c-42c6-ba8b-e41ba1a911b3 req-503e15c8-043c-492e-bbf3-a6e3b0b55803 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.114387 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ed2bca43-f16c-42c6-ba8b-e41ba1a911b3 req-503e15c8-043c-492e-bbf3-a6e3b0b55803 service nova] Creating event network-changed:60433ce3-7f6a-48fa-9b49-9f65b436fd14 for instance 98bd7e64-3246-40ea-844d-5e88603a9e20 on n-h2-766726-30 May 19 04:42:59.126096 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ed2bca43-f16c-42c6-ba8b-e41ba1a911b3 req-503e15c8-043c-492e-bbf3-a6e3b0b55803 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068780 May 19 04:42:59.127964 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1487/2917] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:42:59.364281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-42b8b958-2edc-4064-8f89-a82e480408b3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:59.371526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b72cb688-7559-41e5-92b9-c51fae8d4762 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:59.372568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b72cb688-7559-41e5-92b9-c51fae8d4762 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:59.375478 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-42b8b958-2edc-4064-8f89-a82e480408b3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.379535 May 19 04:42:59.376644 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1431/2918] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:58 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:59.383251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b72cb688-7559-41e5-92b9-c51fae8d4762 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.383706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b72cb688-7559-41e5-92b9-c51fae8d4762 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.384483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b72cb688-7559-41e5-92b9-c51fae8d4762 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.385691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b72cb688-7559-41e5-92b9-c51fae8d4762 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.608580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae521196-e299-4af6-a321-2534cb544e24 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:59.609645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ae521196-e299-4af6-a321-2534cb544e24 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:59.619178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae521196-e299-4af6-a321-2534cb544e24 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.619737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae521196-e299-4af6-a321-2534cb544e24 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.620731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae521196-e299-4af6-a321-2534cb544e24 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.621385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae521196-e299-4af6-a321-2534cb544e24 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.694418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b72cb688-7559-41e5-92b9-c51fae8d4762 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:59.701979 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b72cb688-7559-41e5-92b9-c51fae8d4762 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.335262 May 19 04:42:59.702563 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1488/2919] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:59 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:59.707556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6786897f-be60-46e0-bac3-7882fe3c07a1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:59.708272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6786897f-be60-46e0-bac3-7882fe3c07a1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:59.714929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6786897f-be60-46e0-bac3-7882fe3c07a1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.715460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6786897f-be60-46e0-bac3-7882fe3c07a1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.716232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6786897f-be60-46e0-bac3-7882fe3c07a1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.716666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6786897f-be60-46e0-bac3-7882fe3c07a1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.923308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae521196-e299-4af6-a321-2534cb544e24 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:59.931561 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae521196-e299-4af6-a321-2534cb544e24 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1363 microversion: 2.1 time: 0.329352 May 19 04:42:59.932239 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1432/2920] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:59 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:42:59.965857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6786897f-be60-46e0-bac3-7882fe3c07a1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:42:59.977519 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6786897f-be60-46e0-bac3-7882fe3c07a1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1313 microversion: 2.1 time: 0.273703 May 19 04:42:59.978526 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1489/2921] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:59 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:42:59.979418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-faea7eba-a029-4211-bd59-614accd6f96a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:42:59.980152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-faea7eba-a029-4211-bd59-614accd6f96a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:42:59.987461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-faea7eba-a029-4211-bd59-614accd6f96a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.988354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-faea7eba-a029-4211-bd59-614accd6f96a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:42:59.989405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-faea7eba-a029-4211-bd59-614accd6f96a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:42:59.990542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-faea7eba-a029-4211-bd59-614accd6f96a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:00.141881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-faea7eba-a029-4211-bd59-614accd6f96a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:00.150870 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-faea7eba-a029-4211-bd59-614accd6f96a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1378 microversion: 2.1 time: 0.178790 May 19 04:43:00.151686 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1433/2922] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:42:59 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1378 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:00.392971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-50646616-86dc-40d5-8d77-8309609d2eaf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:00.393567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-50646616-86dc-40d5-8d77-8309609d2eaf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:00.400484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50646616-86dc-40d5-8d77-8309609d2eaf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:00.400964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50646616-86dc-40d5-8d77-8309609d2eaf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:00.402135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50646616-86dc-40d5-8d77-8309609d2eaf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:00.402588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50646616-86dc-40d5-8d77-8309609d2eaf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:00.543010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-50646616-86dc-40d5-8d77-8309609d2eaf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:00.550735 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-50646616-86dc-40d5-8d77-8309609d2eaf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.161629 May 19 04:43:00.560294 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1490/2923] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:00 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:00.709889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a918c377-faf8-4583-8d0a-e4d59502cf8d req-5aa076f3-17a1-45f4-be57-1b394a0ffee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c25126-57dc-4b2f-b1d8-93980536a256", "name": "network-vif-plugged", "status": "completed", "tag": "f1dfd523-b4d9-4a9b-ac07-5b77b712f25c"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:00.720210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be0d30fc-bdcf-4eb8-ba5e-b5a5cf1402a1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:00.720410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a918c377-faf8-4583-8d0a-e4d59502cf8d req-5aa076f3-17a1-45f4-be57-1b394a0ffee8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:00.721122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a918c377-faf8-4583-8d0a-e4d59502cf8d req-5aa076f3-17a1-45f4-be57-1b394a0ffee8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:00.721233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be0d30fc-bdcf-4eb8-ba5e-b5a5cf1402a1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:00.728367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0d30fc-bdcf-4eb8-ba5e-b5a5cf1402a1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:00.729595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0d30fc-bdcf-4eb8-ba5e-b5a5cf1402a1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:00.730641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0d30fc-bdcf-4eb8-ba5e-b5a5cf1402a1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:00.731149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0d30fc-bdcf-4eb8-ba5e-b5a5cf1402a1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:00.734446 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a918c377-faf8-4583-8d0a-e4d59502cf8d req-5aa076f3-17a1-45f4-be57-1b394a0ffee8 service nova] Creating event network-vif-plugged:f1dfd523-b4d9-4a9b-ac07-5b77b712f25c for instance 71c25126-57dc-4b2f-b1d8-93980536a256 on n-h2-766726-30 May 19 04:43:00.740054 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a918c377-faf8-4583-8d0a-e4d59502cf8d req-5aa076f3-17a1-45f4-be57-1b394a0ffee8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034476 May 19 04:43:00.741220 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1434/2924] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:00.900094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be0d30fc-bdcf-4eb8-ba5e-b5a5cf1402a1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:00.908476 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be0d30fc-bdcf-4eb8-ba5e-b5a5cf1402a1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.193634 May 19 04:43:00.913156 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1491/2925] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:00 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:00.950676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-42e72b1d-5c16-4ec2-b078-febd1b3a1384 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:00.951539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-42e72b1d-5c16-4ec2-b078-febd1b3a1384 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:00.960799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42e72b1d-5c16-4ec2-b078-febd1b3a1384 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:00.961616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42e72b1d-5c16-4ec2-b078-febd1b3a1384 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:00.962615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42e72b1d-5c16-4ec2-b078-febd1b3a1384 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:00.963252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42e72b1d-5c16-4ec2-b078-febd1b3a1384 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:00.995155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da35ec36-c7b6-4321-9b2a-52e4829c1148 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:00.996183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da35ec36-c7b6-4321-9b2a-52e4829c1148 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:01.011575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da35ec36-c7b6-4321-9b2a-52e4829c1148 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:01.014118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da35ec36-c7b6-4321-9b2a-52e4829c1148 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:01.016107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da35ec36-c7b6-4321-9b2a-52e4829c1148 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:01.016839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da35ec36-c7b6-4321-9b2a-52e4829c1148 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:01.387431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-42e72b1d-5c16-4ec2-b078-febd1b3a1384 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:01.391773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-da35ec36-c7b6-4321-9b2a-52e4829c1148 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:01.396471 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-42e72b1d-5c16-4ec2-b078-febd1b3a1384 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1363 microversion: 2.1 time: 0.450804 May 19 04:43:01.400797 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da35ec36-c7b6-4321-9b2a-52e4829c1148 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1313 microversion: 2.1 time: 0.409566 May 19 04:43:01.401506 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1492/2926] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:00 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:01.406042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-56331909-c98e-4112-9425-4b4e5a053b45 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:01.406330 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1435/2927] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:00 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1363 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:01.407046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-56331909-c98e-4112-9425-4b4e5a053b45 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:01.413519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56331909-c98e-4112-9425-4b4e5a053b45 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:01.414055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56331909-c98e-4112-9425-4b4e5a053b45 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:01.414884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56331909-c98e-4112-9425-4b4e5a053b45 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:01.415384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56331909-c98e-4112-9425-4b4e5a053b45 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:01.554366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-56331909-c98e-4112-9425-4b4e5a053b45 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:01.561934 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-56331909-c98e-4112-9425-4b4e5a053b45 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1378 microversion: 2.1 time: 0.159320 May 19 04:43:01.562998 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1493/2928] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:01 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1378 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:01.569286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7fc18e6-b2b8-4e07-bcca-6779f7d161fe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:01.570113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7fc18e6-b2b8-4e07-bcca-6779f7d161fe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:01.577492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7fc18e6-b2b8-4e07-bcca-6779f7d161fe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:01.578227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7fc18e6-b2b8-4e07-bcca-6779f7d161fe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:01.579454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7fc18e6-b2b8-4e07-bcca-6779f7d161fe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:01.580104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7fc18e6-b2b8-4e07-bcca-6779f7d161fe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:01.792360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7fc18e6-b2b8-4e07-bcca-6779f7d161fe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:01.800263 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7fc18e6-b2b8-4e07-bcca-6779f7d161fe tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.236243 May 19 04:43:01.801383 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1436/2929] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:01 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:01.925040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5efad22d-0193-4d99-bb44-7f5a8a2b2daa tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:01.925694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5efad22d-0193-4d99-bb44-7f5a8a2b2daa tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:01.932676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5efad22d-0193-4d99-bb44-7f5a8a2b2daa tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:01.933175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5efad22d-0193-4d99-bb44-7f5a8a2b2daa tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:01.933930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5efad22d-0193-4d99-bb44-7f5a8a2b2daa tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:01.934365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5efad22d-0193-4d99-bb44-7f5a8a2b2daa tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:01.938436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:02.069881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5efad22d-0193-4d99-bb44-7f5a8a2b2daa tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:02.077909 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5efad22d-0193-4d99-bb44-7f5a8a2b2daa tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.156760 May 19 04:43:02.078502 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1494/2930] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:01 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:02.413840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-77126cd5-88f5-4d4e-976e-e3460b8578b8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:02.415056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-77126cd5-88f5-4d4e-976e-e3460b8578b8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:02.418504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31bced97-63ab-4f83-a885-0ed5412517d8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:02.420239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-31bced97-63ab-4f83-a885-0ed5412517d8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:02.422044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77126cd5-88f5-4d4e-976e-e3460b8578b8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:02.422509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77126cd5-88f5-4d4e-976e-e3460b8578b8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:02.423287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77126cd5-88f5-4d4e-976e-e3460b8578b8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:02.423723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77126cd5-88f5-4d4e-976e-e3460b8578b8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:02.427570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31bced97-63ab-4f83-a885-0ed5412517d8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:02.428021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31bced97-63ab-4f83-a885-0ed5412517d8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:02.428786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31bced97-63ab-4f83-a885-0ed5412517d8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:02.429247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31bced97-63ab-4f83-a885-0ed5412517d8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:02.635828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31bced97-63ab-4f83-a885-0ed5412517d8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:02.636279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-77126cd5-88f5-4d4e-976e-e3460b8578b8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:02.644996 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-31bced97-63ab-4f83-a885-0ed5412517d8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1313 microversion: 2.1 time: 0.231282 May 19 04:43:02.646440 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1495/2931] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:02 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:02.647529 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-77126cd5-88f5-4d4e-976e-e3460b8578b8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1363 microversion: 2.1 time: 0.237748 May 19 04:43:02.649116 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1437/2932] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:02 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:02.652881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ebcbcd75-df21-4b14-bae2-6dbf27ce77e2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:02.653528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ebcbcd75-df21-4b14-bae2-6dbf27ce77e2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:02.659708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebcbcd75-df21-4b14-bae2-6dbf27ce77e2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:02.660105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebcbcd75-df21-4b14-bae2-6dbf27ce77e2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:02.660884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebcbcd75-df21-4b14-bae2-6dbf27ce77e2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:02.661873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebcbcd75-df21-4b14-bae2-6dbf27ce77e2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:02.803745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ebcbcd75-df21-4b14-bae2-6dbf27ce77e2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:02.811692 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ebcbcd75-df21-4b14-bae2-6dbf27ce77e2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1378 microversion: 2.1 time: 0.163789 May 19 04:43:02.812478 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1496/2933] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:02 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1378 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:02.819741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d31ba66-fd4c-496b-8197-14c38b532f52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:02.820610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5d31ba66-fd4c-496b-8197-14c38b532f52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:02.827742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d31ba66-fd4c-496b-8197-14c38b532f52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:02.828199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d31ba66-fd4c-496b-8197-14c38b532f52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:02.829000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d31ba66-fd4c-496b-8197-14c38b532f52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:02.829458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d31ba66-fd4c-496b-8197-14c38b532f52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:02.901041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-23682488-69b9-41f2-9614-2b422666e882 req-7d34df74-b271-4fc4-a631-4c29ea1da955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a696adb-6dd1-4fae-9ef2-06b964a0fd8a", "name": "network-vif-plugged", "status": "completed", "tag": "15651615-54b8-477a-a850-5680373e2116"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:02.913226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-23682488-69b9-41f2-9614-2b422666e882 req-7d34df74-b271-4fc4-a631-4c29ea1da955 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:02.914720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-23682488-69b9-41f2-9614-2b422666e882 req-7d34df74-b271-4fc4-a631-4c29ea1da955 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:02.938834 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-23682488-69b9-41f2-9614-2b422666e882 req-7d34df74-b271-4fc4-a631-4c29ea1da955 service nova] Creating event network-vif-plugged:15651615-54b8-477a-a850-5680373e2116 for instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a on n-h1-766726-30 May 19 04:43:02.944610 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-23682488-69b9-41f2-9614-2b422666e882 req-7d34df74-b271-4fc4-a631-4c29ea1da955 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047838 May 19 04:43:02.945763 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1497/2934] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:02.987788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5d31ba66-fd4c-496b-8197-14c38b532f52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:02.997382 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5d31ba66-fd4c-496b-8197-14c38b532f52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.182193 May 19 04:43:02.998434 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1438/2935] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:02 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:03.095694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5ca8c23f-514a-48b1-91eb-0b1d041f13b9 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:03.096576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5ca8c23f-514a-48b1-91eb-0b1d041f13b9 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:03.107323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ca8c23f-514a-48b1-91eb-0b1d041f13b9 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.108014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ca8c23f-514a-48b1-91eb-0b1d041f13b9 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:03.109647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ca8c23f-514a-48b1-91eb-0b1d041f13b9 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.110657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ca8c23f-514a-48b1-91eb-0b1d041f13b9 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:03.264064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5ca8c23f-514a-48b1-91eb-0b1d041f13b9 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:03.272122 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5ca8c23f-514a-48b1-91eb-0b1d041f13b9 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.180809 May 19 04:43:03.272706 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1498/2936] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:03 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:03.662509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97d02a8c-ce72-4f83-94c6-1b752e0223b3 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:03.663679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97d02a8c-ce72-4f83-94c6-1b752e0223b3 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:03.665742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-63ae5b2f-8308-443d-ad75-c9aa6d6b4488 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:03.666380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-63ae5b2f-8308-443d-ad75-c9aa6d6b4488 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:03.670850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97d02a8c-ce72-4f83-94c6-1b752e0223b3 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.671313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97d02a8c-ce72-4f83-94c6-1b752e0223b3 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:03.672261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97d02a8c-ce72-4f83-94c6-1b752e0223b3 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.672705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97d02a8c-ce72-4f83-94c6-1b752e0223b3 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:03.673536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63ae5b2f-8308-443d-ad75-c9aa6d6b4488 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.674093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63ae5b2f-8308-443d-ad75-c9aa6d6b4488 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:03.674952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63ae5b2f-8308-443d-ad75-c9aa6d6b4488 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.675775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63ae5b2f-8308-443d-ad75-c9aa6d6b4488 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:03.691366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:03.875528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-97d02a8c-ce72-4f83-94c6-1b752e0223b3 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:03.879563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-63ae5b2f-8308-443d-ad75-c9aa6d6b4488 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:03.884463 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97d02a8c-ce72-4f83-94c6-1b752e0223b3 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1313 microversion: 2.1 time: 0.225738 May 19 04:43:03.885141 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1439/2937] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:03 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:03.890135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-67090d96-1c6b-4019-a2db-e5eb98369d1a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:03.890779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-67090d96-1c6b-4019-a2db-e5eb98369d1a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:03.896817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67090d96-1c6b-4019-a2db-e5eb98369d1a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.897263 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-63ae5b2f-8308-443d-ad75-c9aa6d6b4488 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1552 microversion: 2.1 time: 0.237063 May 19 04:43:03.897419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67090d96-1c6b-4019-a2db-e5eb98369d1a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:03.897873 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1499/2938] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:03 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1552 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:03.898082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67090d96-1c6b-4019-a2db-e5eb98369d1a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.898694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67090d96-1c6b-4019-a2db-e5eb98369d1a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:03.914127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd1ce04e-b31a-41d9-8490-b7ecb4837dab tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:03.915881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bd1ce04e-b31a-41d9-8490-b7ecb4837dab tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:03.922268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd1ce04e-b31a-41d9-8490-b7ecb4837dab tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.922721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd1ce04e-b31a-41d9-8490-b7ecb4837dab tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:03.923498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd1ce04e-b31a-41d9-8490-b7ecb4837dab tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:03.923932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd1ce04e-b31a-41d9-8490-b7ecb4837dab tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:04.051604 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bd1ce04e-b31a-41d9-8490-b7ecb4837dab tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142107 May 19 04:43:04.052203 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1500/2939] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:43:03 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:04.057104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9779dbd5-fb2f-4e3f-8f7a-63e0791658c2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:04.057957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9779dbd5-fb2f-4e3f-8f7a-63e0791658c2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:04.071646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9779dbd5-fb2f-4e3f-8f7a-63e0791658c2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:04.072193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9779dbd5-fb2f-4e3f-8f7a-63e0791658c2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:04.074004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9779dbd5-fb2f-4e3f-8f7a-63e0791658c2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:04.074529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9779dbd5-fb2f-4e3f-8f7a-63e0791658c2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:04.087771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-67090d96-1c6b-4019-a2db-e5eb98369d1a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:04.096869 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-67090d96-1c6b-4019-a2db-e5eb98369d1a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1378 microversion: 2.1 time: 0.210160 May 19 04:43:04.107857 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1440/2940] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:03 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1378 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:04.234862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9779dbd5-fb2f-4e3f-8f7a-63e0791658c2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:04.258600 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9779dbd5-fb2f-4e3f-8f7a-63e0791658c2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.205155 May 19 04:43:04.259389 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1501/2941] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:04 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:04.289362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fdeb40a2-a73d-4c26-90ed-65850e4c9501 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:04.289984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fdeb40a2-a73d-4c26-90ed-65850e4c9501 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:04.296188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fdeb40a2-a73d-4c26-90ed-65850e4c9501 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:04.296797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fdeb40a2-a73d-4c26-90ed-65850e4c9501 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:04.297776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fdeb40a2-a73d-4c26-90ed-65850e4c9501 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:04.298214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fdeb40a2-a73d-4c26-90ed-65850e4c9501 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:04.473434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fdeb40a2-a73d-4c26-90ed-65850e4c9501 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:04.481581 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fdeb40a2-a73d-4c26-90ed-65850e4c9501 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.196526 May 19 04:43:04.482430 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1441/2942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:04 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:04.902653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9265270c-145a-4801-9cba-1cd4f008af45 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:04.903774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9265270c-145a-4801-9cba-1cd4f008af45 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:04.905590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:04.906514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=34 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:04.913878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9265270c-145a-4801-9cba-1cd4f008af45 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:04.914330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9265270c-145a-4801-9cba-1cd4f008af45 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:04.915114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9265270c-145a-4801-9cba-1cd4f008af45 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:04.915552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9265270c-145a-4801-9cba-1cd4f008af45 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:04.982692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f2b0fcfe-ddcb-432e-841c-9d1c963c18fc req-bb45e02d-52c9-449c-9a9b-4cb304cc490a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a0a37d-a68e-428a-8b9a-901167a2c06a", "name": "network-vif-plugged", "status": "completed", "tag": "4f334c46-7b49-4649-8354-c19a2c21fc75"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:04.999135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f2b0fcfe-ddcb-432e-841c-9d1c963c18fc req-bb45e02d-52c9-449c-9a9b-4cb304cc490a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.001622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f2b0fcfe-ddcb-432e-841c-9d1c963c18fc req-bb45e02d-52c9-449c-9a9b-4cb304cc490a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.019731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=50 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:05.030497 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f2b0fcfe-ddcb-432e-841c-9d1c963c18fc req-bb45e02d-52c9-449c-9a9b-4cb304cc490a service nova] Creating event network-vif-plugged:4f334c46-7b49-4649-8354-c19a2c21fc75 for instance d7a0a37d-a68e-428a-8b9a-901167a2c06a on n-h1-766726-30 May 19 04:43:05.038281 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f2b0fcfe-ddcb-432e-841c-9d1c963c18fc req-bb45e02d-52c9-449c-9a9b-4cb304cc490a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059361 May 19 04:43:05.045555 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1442/2943] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:05.114561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6387504-4328-426e-a9bc-eee05d05c263 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:05.115534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b6387504-4328-426e-a9bc-eee05d05c263 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:05.128796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6387504-4328-426e-a9bc-eee05d05c263 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.129287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6387504-4328-426e-a9bc-eee05d05c263 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.130619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6387504-4328-426e-a9bc-eee05d05c263 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.131064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6387504-4328-426e-a9bc-eee05d05c263 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.134223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9265270c-145a-4801-9cba-1cd4f008af45 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:05.149872 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9265270c-145a-4801-9cba-1cd4f008af45 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1498 microversion: 2.1 time: 0.250459 May 19 04:43:05.150841 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1502/2944] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:04 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:05.178092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1ade2fc4-3fdb-4f79-8b57-78c6d3d5e71b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:05.214036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.compute.server_groups [None req-1ade2fc4-3fdb-4f79-8b57-78c6d3d5e71b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Querying cell c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) for 1 instances {{(pid=124818) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 19 04:43:05.217236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ade2fc4-3fdb-4f79-8b57-78c6d3d5e71b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.217727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ade2fc4-3fdb-4f79-8b57-78c6d3d5e71b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.254573 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1ade2fc4-3fdb-4f79-8b57-78c6d3d5e71b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/898cd8a0-7730-4af1-9d20-75c1d8471153" status: 200 len: 221 microversion: 2.1 time: 0.090557 May 19 04:43:05.261437 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1503/2945] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:43:05 2022] GET /compute/v2.1/os-server-groups/898cd8a0-7730-4af1-9d20-75c1d8471153 => generated 221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:05.267338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-dab33f69-86f9-43bf-b21d-7b11715abfcd req-0e0f9e58-cede-4488-afe7-055c27d68444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c25126-57dc-4b2f-b1d8-93980536a256", "tag": "f1dfd523-b4d9-4a9b-ac07-5b77b712f25c"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:05.276847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dab33f69-86f9-43bf-b21d-7b11715abfcd req-0e0f9e58-cede-4488-afe7-055c27d68444 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.277217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dab33f69-86f9-43bf-b21d-7b11715abfcd req-0e0f9e58-cede-4488-afe7-055c27d68444 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.289136 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-dab33f69-86f9-43bf-b21d-7b11715abfcd req-0e0f9e58-cede-4488-afe7-055c27d68444 service nova] Creating event network-changed:f1dfd523-b4d9-4a9b-ac07-5b77b712f25c for instance 71c25126-57dc-4b2f-b1d8-93980536a256 on n-h2-766726-30 May 19 04:43:05.296596 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-dab33f69-86f9-43bf-b21d-7b11715abfcd req-0e0f9e58-cede-4488-afe7-055c27d68444 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032855 May 19 04:43:05.297695 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1504/2946] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:05.306775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8e5203e7-a442-4cbb-a5df-9319a52da7df tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:05.307246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e5203e7-a442-4cbb-a5df-9319a52da7df tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:05.314235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e5203e7-a442-4cbb-a5df-9319a52da7df tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.314681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e5203e7-a442-4cbb-a5df-9319a52da7df tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.315496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e5203e7-a442-4cbb-a5df-9319a52da7df tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.315962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e5203e7-a442-4cbb-a5df-9319a52da7df tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.361621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e5203e7-a442-4cbb-a5df-9319a52da7df tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:43:05.447128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b6387504-4328-426e-a9bc-eee05d05c263 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:05.465821 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6387504-4328-426e-a9bc-eee05d05c263 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1378 microversion: 2.1 time: 0.355483 May 19 04:43:05.466626 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1443/2947] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:05 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1378 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:05.472379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8e2c1db-3a30-46b7-ae7e-e25cdd549180 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:05.473192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f8e2c1db-3a30-46b7-ae7e-e25cdd549180 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:05.491395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8e2c1db-3a30-46b7-ae7e-e25cdd549180 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.494075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8e2c1db-3a30-46b7-ae7e-e25cdd549180 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.494383 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8e5203e7-a442-4cbb-a5df-9319a52da7df tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 204 len: 0 microversion: 2.1 time: 0.194831 May 19 04:43:05.495698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8e2c1db-3a30-46b7-ae7e-e25cdd549180 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.496357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8e2c1db-3a30-46b7-ae7e-e25cdd549180 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.500916 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1505/2948] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:43:05 2022] DELETE /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:43:05.510915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66553c09-71a0-4aa0-a727-63e182af510c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:05.511666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66553c09-71a0-4aa0-a727-63e182af510c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:05.518943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66553c09-71a0-4aa0-a727-63e182af510c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.519402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66553c09-71a0-4aa0-a727-63e182af510c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.520238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66553c09-71a0-4aa0-a727-63e182af510c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.520905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66553c09-71a0-4aa0-a727-63e182af510c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.851886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f8e2c1db-3a30-46b7-ae7e-e25cdd549180 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:05.858472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-66553c09-71a0-4aa0-a727-63e182af510c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:05.861377 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f8e2c1db-3a30-46b7-ae7e-e25cdd549180 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.393006 May 19 04:43:05.862448 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1444/2949] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:05 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:05.872145 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66553c09-71a0-4aa0-a727-63e182af510c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.364477 May 19 04:43:05.872145 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1506/2950] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:05 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:05.883676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b56fc133-d5c5-401e-b5f9-33772f058f77 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:05.884313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b56fc133-d5c5-401e-b5f9-33772f058f77 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:05.895833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b56fc133-d5c5-401e-b5f9-33772f058f77 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.896280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b56fc133-d5c5-401e-b5f9-33772f058f77 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:05.897055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b56fc133-d5c5-401e-b5f9-33772f058f77 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:05.898460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b56fc133-d5c5-401e-b5f9-33772f058f77 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:06.135943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b56fc133-d5c5-401e-b5f9-33772f058f77 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:06.147556 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b56fc133-d5c5-401e-b5f9-33772f058f77 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1504 microversion: 2.1 time: 0.276416 May 19 04:43:06.148170 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1507/2951] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:05 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:06.484648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3aa2a120-380b-42e2-a043-fce3e3cd768d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:06.485310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3aa2a120-380b-42e2-a043-fce3e3cd768d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:06.491986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:06.494375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3aa2a120-380b-42e2-a043-fce3e3cd768d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:06.494813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3aa2a120-380b-42e2-a043-fce3e3cd768d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:06.495776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3aa2a120-380b-42e2-a043-fce3e3cd768d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:06.496217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3aa2a120-380b-42e2-a043-fce3e3cd768d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:06.658498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3aa2a120-380b-42e2-a043-fce3e3cd768d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:06.670101 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3aa2a120-380b-42e2-a043-fce3e3cd768d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1378 microversion: 2.1 time: 0.189462 May 19 04:43:06.672194 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1445/2952] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:06 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1378 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:06.880719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-483109b8-a6bc-4761-92f1-13fd34250b4a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:06.881587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-483109b8-a6bc-4761-92f1-13fd34250b4a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:06.887142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff8cbcb4-69ef-43b4-9a21-2d863c25f8f8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:06.888277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff8cbcb4-69ef-43b4-9a21-2d863c25f8f8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:06.889586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-483109b8-a6bc-4761-92f1-13fd34250b4a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:06.890047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-483109b8-a6bc-4761-92f1-13fd34250b4a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:06.890822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-483109b8-a6bc-4761-92f1-13fd34250b4a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:06.891265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-483109b8-a6bc-4761-92f1-13fd34250b4a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:06.894540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff8cbcb4-69ef-43b4-9a21-2d863c25f8f8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:06.894999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff8cbcb4-69ef-43b4-9a21-2d863c25f8f8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:06.896506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff8cbcb4-69ef-43b4-9a21-2d863c25f8f8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:06.896951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff8cbcb4-69ef-43b4-9a21-2d863c25f8f8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:07.125521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-483109b8-a6bc-4761-92f1-13fd34250b4a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:07.130780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff8cbcb4-69ef-43b4-9a21-2d863c25f8f8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:07.134725 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-483109b8-a6bc-4761-92f1-13fd34250b4a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.258797 May 19 04:43:07.144586 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1508/2953] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:06 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:07.144586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0459b7e6-5a4b-4541-8604-1f2b7bcc3d5e req-1369e4f6-d691-45e0-947d-2d41ca6e1b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd7e64-3246-40ea-844d-5e88603a9e20", "name": "network-vif-plugged", "status": "completed", "tag": "60433ce3-7f6a-48fa-9b49-9f65b436fd14"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:07.148907 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff8cbcb4-69ef-43b4-9a21-2d863c25f8f8 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1292 microversion: 2.1 time: 0.265286 May 19 04:43:07.156202 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1446/2954] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:06 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1292 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:07.156363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0459b7e6-5a4b-4541-8604-1f2b7bcc3d5e req-1369e4f6-d691-45e0-947d-2d41ca6e1b03 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:07.156363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0459b7e6-5a4b-4541-8604-1f2b7bcc3d5e req-1369e4f6-d691-45e0-947d-2d41ca6e1b03 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:07.164179 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0459b7e6-5a4b-4541-8604-1f2b7bcc3d5e req-1369e4f6-d691-45e0-947d-2d41ca6e1b03 service nova] Creating event network-vif-plugged:60433ce3-7f6a-48fa-9b49-9f65b436fd14 for instance 98bd7e64-3246-40ea-844d-5e88603a9e20 on n-h2-766726-30 May 19 04:43:07.167366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21e6b216-319c-49dc-ad9c-f2e20dac3ea2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:07.168072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-21e6b216-319c-49dc-ad9c-f2e20dac3ea2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:07.169848 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0459b7e6-5a4b-4541-8604-1f2b7bcc3d5e req-1369e4f6-d691-45e0-947d-2d41ca6e1b03 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032733 May 19 04:43:07.171022 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1509/2955] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:07.181522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21e6b216-319c-49dc-ad9c-f2e20dac3ea2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:07.183540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21e6b216-319c-49dc-ad9c-f2e20dac3ea2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:07.185704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21e6b216-319c-49dc-ad9c-f2e20dac3ea2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:07.186270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21e6b216-319c-49dc-ad9c-f2e20dac3ea2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:07.496313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-21e6b216-319c-49dc-ad9c-f2e20dac3ea2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b76e5ebca942739771a4f3da7b6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4f8d09d25f4727b51a2a8188edd195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:07.511838 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21e6b216-319c-49dc-ad9c-f2e20dac3ea2 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 200 len: 1504 microversion: 2.1 time: 0.348791 May 19 04:43:07.512835 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1447/2956] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:07 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:07.690162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-95f4800b-f0da-4f62-99c3-0c2b8cab0f0c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:07.691277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-95f4800b-f0da-4f62-99c3-0c2b8cab0f0c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:07.700169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95f4800b-f0da-4f62-99c3-0c2b8cab0f0c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:07.700714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95f4800b-f0da-4f62-99c3-0c2b8cab0f0c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:07.702106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95f4800b-f0da-4f62-99c3-0c2b8cab0f0c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:07.702613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95f4800b-f0da-4f62-99c3-0c2b8cab0f0c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:07.891961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ca09fa39-f263-4792-8f4b-f514cb4c59bb req-f411e019-be96-4e05-afa1-23fac1d8a30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a696adb-6dd1-4fae-9ef2-06b964a0fd8a", "name": "network-vif-deleted", "tag": "15651615-54b8-477a-a850-5680373e2116"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:07.902262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ca09fa39-f263-4792-8f4b-f514cb4c59bb req-f411e019-be96-4e05-afa1-23fac1d8a30c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:07.902802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ca09fa39-f263-4792-8f4b-f514cb4c59bb req-f411e019-be96-4e05-afa1-23fac1d8a30c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:07.915955 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ca09fa39-f263-4792-8f4b-f514cb4c59bb req-f411e019-be96-4e05-afa1-23fac1d8a30c service nova] Creating event network-vif-deleted:15651615-54b8-477a-a850-5680373e2116 for instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a on n-h1-766726-30 May 19 04:43:07.922252 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ca09fa39-f263-4792-8f4b-f514cb4c59bb req-f411e019-be96-4e05-afa1-23fac1d8a30c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036836 May 19 04:43:07.923239 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1448/2957] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:07.967000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-95f4800b-f0da-4f62-99c3-0c2b8cab0f0c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:07.974777 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-95f4800b-f0da-4f62-99c3-0c2b8cab0f0c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1378 microversion: 2.1 time: 0.289364 May 19 04:43:07.975591 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1510/2958] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:07 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1378 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:08.152536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-037345d5-d3ff-4fee-8bb5-1df154c4194a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:08.153255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-037345d5-d3ff-4fee-8bb5-1df154c4194a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:08.159461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-037345d5-d3ff-4fee-8bb5-1df154c4194a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.159909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-037345d5-d3ff-4fee-8bb5-1df154c4194a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.161516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-037345d5-d3ff-4fee-8bb5-1df154c4194a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.161967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-037345d5-d3ff-4fee-8bb5-1df154c4194a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.166758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5107075-cd16-458b-a043-5a4c16a1aa36 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:08.167397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5107075-cd16-458b-a043-5a4c16a1aa36 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:08.174622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5107075-cd16-458b-a043-5a4c16a1aa36 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.175259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5107075-cd16-458b-a043-5a4c16a1aa36 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.176305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5107075-cd16-458b-a043-5a4c16a1aa36 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.176783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5107075-cd16-458b-a043-5a4c16a1aa36 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.741740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-037345d5-d3ff-4fee-8bb5-1df154c4194a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:08.744556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5107075-cd16-458b-a043-5a4c16a1aa36 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:08.746993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:08.752133 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-037345d5-d3ff-4fee-8bb5-1df154c4194a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.604115 May 19 04:43:08.764014 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5107075-cd16-458b-a043-5a4c16a1aa36 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1484 microversion: 2.1 time: 0.594017 May 19 04:43:08.764014 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1511/2959] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:08 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1484 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:08.764014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:08.764014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:08.764996 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1449/2960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:08 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:08.770123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.771112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.771888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.772332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.773699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21b291cc-66a3-4b5e-b38d-96e79f7c8106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:08.774197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-21b291cc-66a3-4b5e-b38d-96e79f7c8106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:08.780459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21b291cc-66a3-4b5e-b38d-96e79f7c8106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.780907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21b291cc-66a3-4b5e-b38d-96e79f7c8106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.781710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21b291cc-66a3-4b5e-b38d-96e79f7c8106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.782175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21b291cc-66a3-4b5e-b38d-96e79f7c8106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.787683 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] HTTP exception thrown: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Request method failure captured: May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a HTTP/1.1 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcrIyWv9a_LBN8SGSrBy_fla_d4JNKNEkc8G7JE8lQp5NAD3rCvdO1-NhkvRVvb2qRwNFbJva9pVAIjiNs9xIh3A51RDKH7VRLiw0RlvmiQjG12MyCAmzGhJXKne-kTKfQjgn2yDF-ETFN7vuSuz83tF19PjTCWx2RGninRMnZv-j9M May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: c7b76e5ebca942739771a4f3da7b6036 May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2a696adb-6dd1-4fae-9ef2-06b964a0fd8a'} May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:08.789374 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Returning 404 to user: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c86a6bef-cb58-4c3c-bd01-a630e6924ab1 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 404 len: 111 microversion: 2.1 time: 0.032919 May 19 04:43:08.793405 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1512/2961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:08 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:43:08.803577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7551292d-728e-4894-bbed-7bbe2caa4d29 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:08.816894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.compute.server_groups [None req-7551292d-728e-4894-bbed-7bbe2caa4d29 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Querying cell c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) for 1 instances {{(pid=124818) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 19 04:43:08.818364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7551292d-728e-4894-bbed-7bbe2caa4d29 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.818767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7551292d-728e-4894-bbed-7bbe2caa4d29 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.829824 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7551292d-728e-4894-bbed-7bbe2caa4d29 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029837 May 19 04:43:08.830405 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1513/2962] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 04:43:08 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:43:08.842237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-feee4800-7870-4227-ba51-0949aed55b57 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:08.867844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.compute.server_groups [None req-feee4800-7870-4227-ba51-0949aed55b57 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Querying cell c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) for 1 instances {{(pid=124818) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 19 04:43:08.869049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-feee4800-7870-4227-ba51-0949aed55b57 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.869995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-feee4800-7870-4227-ba51-0949aed55b57 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.886746 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-feee4800-7870-4227-ba51-0949aed55b57 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/898cd8a0-7730-4af1-9d20-75c1d8471153" status: 200 len: 183 microversion: 2.1 time: 0.048011 May 19 04:43:08.888581 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1514/2963] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:43:08 2022] GET /compute/v2.1/os-server-groups/898cd8a0-7730-4af1-9d20-75c1d8471153 => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:08.903417 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21b291cc-66a3-4b5e-b38d-96e79f7c8106 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135008 May 19 04:43:08.905143 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1450/2964] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:43:08 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:43:08.909127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:08.909284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:08.919935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.920328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.921293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.921866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.937342 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] HTTP exception thrown: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Request method failure captured: May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a HTTP/1.1 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcrIyWv9a_LBN8SGSrBy_fla_d4JNKNEkc8G7JE8lQp5NAD3rCvdO1-NhkvRVvb2qRwNFbJva9pVAIjiNs9xIh3A51RDKH7VRLiw0RlvmiQjG12MyCAmzGhJXKne-kTKfQjgn2yDF-ETFN7vuSuz83tF19PjTCWx2RGninRMnZv-j9M May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: c7b76e5ebca942739771a4f3da7b6036 May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2a696adb-6dd1-4fae-9ef2-06b964a0fd8a'} May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:43:08.940213 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.945813 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:08.948960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Returning 404 to user: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:08.950139 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-55f98e57-b454-451b-b4c1-6b8101c482cd tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 404 len: 111 microversion: 2.1 time: 0.050607 May 19 04:43:08.954918 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1515/2965] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:43:08 2022] DELETE /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:43:08.961007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:08.961429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] [instance: 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:08.968106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.968836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.969949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:08.970487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:08.987034 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] HTTP exception thrown: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Request method failure captured: May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a HTTP/1.1 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcrIyWv9a_LBN8SGSrBy_fla_d4JNKNEkc8G7JE8lQp5NAD3rCvdO1-NhkvRVvb2qRwNFbJva9pVAIjiNs9xIh3A51RDKH7VRLiw0RlvmiQjG12MyCAmzGhJXKne-kTKfQjgn2yDF-ETFN7vuSuz83tF19PjTCWx2RGninRMnZv-j9M May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c7b76e5ebca942739771a4f3da7b6036 May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2a696adb-6dd1-4fae-9ef2-06b964a0fd8a'} May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:08.988815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:08.993241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:08.993241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:08.993241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:08.993241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:08.993241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:08.993241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. May 19 04:43:08.993241 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:08.993742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-574c1521-9ebd-41cb-b33e-909c8998cd79 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:08.993742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-574c1521-9ebd-41cb-b33e-909c8998cd79 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:08.993906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Returning 404 to user: Instance 2a696adb-6dd1-4fae-9ef2-06b964a0fd8a could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:08.994846 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e5cadabb-d4b8-4f35-834c-1f53ff81e3c8 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a" status: 404 len: 111 microversion: 2.1 time: 0.038718 May 19 04:43:08.995842 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1451/2966] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:08 2022] GET /compute/v2.1/servers/2a696adb-6dd1-4fae-9ef2-06b964a0fd8a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:43:09.001806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-574c1521-9ebd-41cb-b33e-909c8998cd79 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:09.002258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-574c1521-9ebd-41cb-b33e-909c8998cd79 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:09.003029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-574c1521-9ebd-41cb-b33e-909c8998cd79 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:09.003492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-574c1521-9ebd-41cb-b33e-909c8998cd79 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:09.019683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0236a50-6fc6-4c29-aab1-7c2d9409348a tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:09.030648 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d0236a50-6fc6-4c29-aab1-7c2d9409348a tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] HTTP exception thrown: Instance group 1a0dcaf4-e940-4809-a5c0-8dd0454eacc0 could not be found. May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0236a50-6fc6-4c29-aab1-7c2d9409348a tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Request method failure captured: May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-server-groups/1a0dcaf4-e940-4809-a5c0-8dd0454eacc0 HTTP/1.1 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcrIyWv9a_LBN8SGSrBy_fla_d4JNKNEkc8G7JE8lQp5NAD3rCvdO1-NhkvRVvb2qRwNFbJva9pVAIjiNs9xIh3A51RDKH7VRLiw0RlvmiQjG12MyCAmzGhJXKne-kTKfQjgn2yDF-ETFN7vuSuz83tF19PjTCWx2RGninRMnZv-j9M May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c7b76e5ebca942739771a4f3da7b6036 May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance group 1a0dcaf4-e940-4809-a5c0-8dd0454eacc0 could not be found. May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '1a0dcaf4-e940-4809-a5c0-8dd0454eacc0'} May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1a0dcaf4-e940-4809-a5c0-8dd0454eacc0 could not be found. May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1a0dcaf4-e940-4809-a5c0-8dd0454eacc0 could not be found. May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.032692 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.036939 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:09.036939 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:09.036939 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:09.036939 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:09.036939 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1a0dcaf4-e940-4809-a5c0-8dd0454eacc0 could not be found. May 19 04:43:09.036939 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.039509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0236a50-6fc6-4c29-aab1-7c2d9409348a tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Returning 404 to user: Instance group 1a0dcaf4-e940-4809-a5c0-8dd0454eacc0 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:09.040394 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d0236a50-6fc6-4c29-aab1-7c2d9409348a tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/1a0dcaf4-e940-4809-a5c0-8dd0454eacc0" status: 404 len: 117 microversion: 2.1 time: 0.032836 May 19 04:43:09.044069 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1452/2967] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:43:09 2022] DELETE /compute/v2.1/os-server-groups/1a0dcaf4-e940-4809-a5c0-8dd0454eacc0 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:43:09.060015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-984669a3-254c-4c5f-83e0-4676eee9d5e6 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:09.073196 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-984669a3-254c-4c5f-83e0-4676eee9d5e6 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] HTTP exception thrown: Instance group 09d4a3c7-f6d1-4d44-87c5-0f443c1437df could not be found. May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-984669a3-254c-4c5f-83e0-4676eee9d5e6 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Request method failure captured: May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-server-groups/09d4a3c7-f6d1-4d44-87c5-0f443c1437df HTTP/1.1 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcrIyWv9a_LBN8SGSrBy_fla_d4JNKNEkc8G7JE8lQp5NAD3rCvdO1-NhkvRVvb2qRwNFbJva9pVAIjiNs9xIh3A51RDKH7VRLiw0RlvmiQjG12MyCAmzGhJXKne-kTKfQjgn2yDF-ETFN7vuSuz83tF19PjTCWx2RGninRMnZv-j9M May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c7b76e5ebca942739771a4f3da7b6036 May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance group 09d4a3c7-f6d1-4d44-87c5-0f443c1437df could not be found. May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '09d4a3c7-f6d1-4d44-87c5-0f443c1437df'} May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 09d4a3c7-f6d1-4d44-87c5-0f443c1437df could not be found. May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 09d4a3c7-f6d1-4d44-87c5-0f443c1437df could not be found. May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.074725 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.078901 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:09.078901 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:09.078901 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:09.078901 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:09.078901 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 09d4a3c7-f6d1-4d44-87c5-0f443c1437df could not be found. May 19 04:43:09.078901 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.084597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-984669a3-254c-4c5f-83e0-4676eee9d5e6 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Returning 404 to user: Instance group 09d4a3c7-f6d1-4d44-87c5-0f443c1437df could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:09.085512 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-984669a3-254c-4c5f-83e0-4676eee9d5e6 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/09d4a3c7-f6d1-4d44-87c5-0f443c1437df" status: 404 len: 117 microversion: 2.1 time: 0.034100 May 19 04:43:09.086417 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1453/2968] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:43:09 2022] DELETE /compute/v2.1/os-server-groups/09d4a3c7-f6d1-4d44-87c5-0f443c1437df => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:43:09.094451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-545aa975-58c8-4755-8e9b-b373cb9b55a0 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:09.101730 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-545aa975-58c8-4755-8e9b-b373cb9b55a0 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] HTTP exception thrown: Instance group ea1d8e32-ad44-4410-9aa5-1d80021dbcdf could not be found. May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-545aa975-58c8-4755-8e9b-b373cb9b55a0 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Request method failure captured: May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-server-groups/ea1d8e32-ad44-4410-9aa5-1d80021dbcdf HTTP/1.1 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcrIyWv9a_LBN8SGSrBy_fla_d4JNKNEkc8G7JE8lQp5NAD3rCvdO1-NhkvRVvb2qRwNFbJva9pVAIjiNs9xIh3A51RDKH7VRLiw0RlvmiQjG12MyCAmzGhJXKne-kTKfQjgn2yDF-ETFN7vuSuz83tF19PjTCWx2RGninRMnZv-j9M May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c7b76e5ebca942739771a4f3da7b6036 May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance group ea1d8e32-ad44-4410-9aa5-1d80021dbcdf could not be found. May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'ea1d8e32-ad44-4410-9aa5-1d80021dbcdf'} May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ea1d8e32-ad44-4410-9aa5-1d80021dbcdf could not be found. May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ea1d8e32-ad44-4410-9aa5-1d80021dbcdf could not be found. May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.103702 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.108128 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:09.108128 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:09.108128 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:09.108128 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:09.108128 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ea1d8e32-ad44-4410-9aa5-1d80021dbcdf could not be found. May 19 04:43:09.108128 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.108128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-545aa975-58c8-4755-8e9b-b373cb9b55a0 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Returning 404 to user: Instance group ea1d8e32-ad44-4410-9aa5-1d80021dbcdf could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:09.108128 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-545aa975-58c8-4755-8e9b-b373cb9b55a0 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/ea1d8e32-ad44-4410-9aa5-1d80021dbcdf" status: 404 len: 117 microversion: 2.1 time: 0.014847 May 19 04:43:09.108790 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1454/2969] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:43:09 2022] DELETE /compute/v2.1/os-server-groups/ea1d8e32-ad44-4410-9aa5-1d80021dbcdf => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:43:09.114060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1a7e4f7-5039-42f2-969e-a54cffa8df6b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:09.123369 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-f1a7e4f7-5039-42f2-969e-a54cffa8df6b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] HTTP exception thrown: Instance group 0bf12883-f856-48fb-969d-0f72198d74a6 could not be found. May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1a7e4f7-5039-42f2-969e-a54cffa8df6b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Request method failure captured: May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-server-groups/0bf12883-f856-48fb-969d-0f72198d74a6 HTTP/1.1 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcrIyWv9a_LBN8SGSrBy_fla_d4JNKNEkc8G7JE8lQp5NAD3rCvdO1-NhkvRVvb2qRwNFbJva9pVAIjiNs9xIh3A51RDKH7VRLiw0RlvmiQjG12MyCAmzGhJXKne-kTKfQjgn2yDF-ETFN7vuSuz83tF19PjTCWx2RGninRMnZv-j9M May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec4f8d09d25f4727b51a2a8188edd195"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ec4f8d09d25f4727b51a2a8188edd195 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerGroupTestJSON-1404668718 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c7b76e5ebca942739771a4f3da7b6036 May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerGroupTestJSON-1404668718-project May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance group 0bf12883-f856-48fb-969d-0f72198d74a6 could not be found. May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '0bf12883-f856-48fb-969d-0f72198d74a6'} May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0bf12883-f856-48fb-969d-0f72198d74a6 could not be found. May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0bf12883-f856-48fb-969d-0f72198d74a6 could not be found. May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.125461 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:09.129500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:09.129500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:09.129500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:09.129500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:09.129500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0bf12883-f856-48fb-969d-0f72198d74a6 could not be found. May 19 04:43:09.129500 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:43:09.130635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1a7e4f7-5039-42f2-969e-a54cffa8df6b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Returning 404 to user: Instance group 0bf12883-f856-48fb-969d-0f72198d74a6 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:09.131701 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f1a7e4f7-5039-42f2-969e-a54cffa8df6b tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/0bf12883-f856-48fb-969d-0f72198d74a6" status: 404 len: 117 microversion: 2.1 time: 0.021759 May 19 04:43:09.135623 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1455/2970] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:43:09 2022] DELETE /compute/v2.1/os-server-groups/0bf12883-f856-48fb-969d-0f72198d74a6 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:43:09.140502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f712cca5-7616-46ea-9dfc-90d58d953704 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:09.167637 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f712cca5-7616-46ea-9dfc-90d58d953704 tempest-ServerGroupTestJSON-1404668718 tempest-ServerGroupTestJSON-1404668718-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/898cd8a0-7730-4af1-9d20-75c1d8471153" status: 204 len: 0 microversion: 2.1 time: 0.030550 May 19 04:43:09.168409 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1456/2971] 10.222.0.58 () {58 vars in 1265 bytes} [Thu May 19 04:43:09 2022] DELETE /compute/v2.1/os-server-groups/898cd8a0-7730-4af1-9d20-75c1d8471153 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:43:09.344372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-574c1521-9ebd-41cb-b33e-909c8998cd79 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:09.357102 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-574c1521-9ebd-41cb-b33e-909c8998cd79 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1528 microversion: 2.1 time: 0.369156 May 19 04:43:09.359034 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1516/2972] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:08 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1528 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:09.376057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-598e64e5-7962-4c5e-90d1-b9b8232dfb4f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:09.376678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-598e64e5-7962-4c5e-90d1-b9b8232dfb4f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:09.383798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-598e64e5-7962-4c5e-90d1-b9b8232dfb4f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:09.384451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-598e64e5-7962-4c5e-90d1-b9b8232dfb4f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:09.385446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-598e64e5-7962-4c5e-90d1-b9b8232dfb4f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:09.386032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-598e64e5-7962-4c5e-90d1-b9b8232dfb4f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:09.668658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-598e64e5-7962-4c5e-90d1-b9b8232dfb4f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:09.686665 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-598e64e5-7962-4c5e-90d1-b9b8232dfb4f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1528 microversion: 2.1 time: 0.315442 May 19 04:43:09.688380 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1457/2973] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:09 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1528 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:09.716059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0792f097-8f4d-4307-835e-397bf81401b0 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:09.718889 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:43:09.718889 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:43:09.746337 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0792f097-8f4d-4307-835e-397bf81401b0 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/61056ff7-5c00-40da-ae97-09efc2ebed8d" status: 202 len: 0 microversion: 2.1 time: 0.036183 May 19 04:43:09.751695 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1517/2974] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:43:09 2022] DELETE /compute/v2.1/flavors/61056ff7-5c00-40da-ae97-09efc2ebed8d => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:43:09.761198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fe157821-fec3-4b6a-afd3-7a3974f22706 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:09.772375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86284730-1b05-4e99-8e4a-2b17801c228c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:09.773201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86284730-1b05-4e99-8e4a-2b17801c228c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:09.780579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86284730-1b05-4e99-8e4a-2b17801c228c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:09.781362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86284730-1b05-4e99-8e4a-2b17801c228c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:09.782597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86284730-1b05-4e99-8e4a-2b17801c228c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:09.783186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86284730-1b05-4e99-8e4a-2b17801c228c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:09.799561 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fe157821-fec3-4b6a-afd3-7a3974f22706 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043198 May 19 04:43:09.812804 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1458/2975] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:43:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:09.818601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:09.819941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:09.830390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:09.833861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:09.834826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:09.836175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:09.870309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:09.877883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Old instance type tempest-test_resize_flavor_-2080067618, new instance type m1.heat {{(pid=124819) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 04:43:09.887206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:43:09.887937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:43:09.888622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:43:09.889336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:43:09.889898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:43:10.006121 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2b4c7a9-3b77-4ef1-afc1-e9b21b7086f0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20/action" status: 202 len: 0 microversion: 2.1 time: 0.190603 May 19 04:43:10.006766 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1459/2976] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:43:09 2022] POST /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:43:10.024732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1ed6fce2-54f0-470a-842c-b845c0cdf92b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:10.027911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1ed6fce2-54f0-470a-842c-b845c0cdf92b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:10.044052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ed6fce2-54f0-470a-842c-b845c0cdf92b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:10.046195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ed6fce2-54f0-470a-842c-b845c0cdf92b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:10.046195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ed6fce2-54f0-470a-842c-b845c0cdf92b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:10.046666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ed6fce2-54f0-470a-842c-b845c0cdf92b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:10.252791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86284730-1b05-4e99-8e4a-2b17801c228c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:10.260676 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86284730-1b05-4e99-8e4a-2b17801c228c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.493488 May 19 04:43:10.265835 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1518/2977] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:09 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:10.403000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0af09a4d-3296-4fa1-9ebb-bc724b95c28d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:10.404562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0af09a4d-3296-4fa1-9ebb-bc724b95c28d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:10.412132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af09a4d-3296-4fa1-9ebb-bc724b95c28d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:10.412883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af09a4d-3296-4fa1-9ebb-bc724b95c28d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:10.420355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af09a4d-3296-4fa1-9ebb-bc724b95c28d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:10.421792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af09a4d-3296-4fa1-9ebb-bc724b95c28d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:10.577674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1ed6fce2-54f0-470a-842c-b845c0cdf92b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:10.597329 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1ed6fce2-54f0-470a-842c-b845c0cdf92b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1537 microversion: 2.1 time: 0.585695 May 19 04:43:10.598600 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1460/2978] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:10 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1537 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:10.603887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-12a8f0c3-bf77-4988-9a55-4173a61f0694 req-256f945d-0436-48bb-b2f7-613ee2173c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a0a37d-a68e-428a-8b9a-901167a2c06a", "tag": "4f334c46-7b49-4649-8354-c19a2c21fc75"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:10.612899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-12a8f0c3-bf77-4988-9a55-4173a61f0694 req-256f945d-0436-48bb-b2f7-613ee2173c68 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:10.613463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-12a8f0c3-bf77-4988-9a55-4173a61f0694 req-256f945d-0436-48bb-b2f7-613ee2173c68 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:10.627541 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-12a8f0c3-bf77-4988-9a55-4173a61f0694 req-256f945d-0436-48bb-b2f7-613ee2173c68 service nova] Creating event network-changed:4f334c46-7b49-4649-8354-c19a2c21fc75 for instance d7a0a37d-a68e-428a-8b9a-901167a2c06a on n-h1-766726-30 May 19 04:43:10.635497 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-12a8f0c3-bf77-4988-9a55-4173a61f0694 req-256f945d-0436-48bb-b2f7-613ee2173c68 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035431 May 19 04:43:10.637013 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1461/2979] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:10.907987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0af09a4d-3296-4fa1-9ebb-bc724b95c28d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:10.923789 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0af09a4d-3296-4fa1-9ebb-bc724b95c28d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1484 microversion: 2.1 time: 0.525021 May 19 04:43:10.938081 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1519/2980] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:10 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1484 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:11.289991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32b9d4b5-29f2-4d56-9e81-642ee51554df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:11.290847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-32b9d4b5-29f2-4d56-9e81-642ee51554df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:11.300167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32b9d4b5-29f2-4d56-9e81-642ee51554df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:11.300735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32b9d4b5-29f2-4d56-9e81-642ee51554df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:11.302324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32b9d4b5-29f2-4d56-9e81-642ee51554df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:11.303160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32b9d4b5-29f2-4d56-9e81-642ee51554df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:11.621450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5bc93d1e-9eea-4cce-a5e6-3581b17f5d00 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:11.624958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5bc93d1e-9eea-4cce-a5e6-3581b17f5d00 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:11.631076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-32b9d4b5-29f2-4d56-9e81-642ee51554df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:11.648207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc93d1e-9eea-4cce-a5e6-3581b17f5d00 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:11.648660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc93d1e-9eea-4cce-a5e6-3581b17f5d00 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:11.649503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc93d1e-9eea-4cce-a5e6-3581b17f5d00 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:11.650021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc93d1e-9eea-4cce-a5e6-3581b17f5d00 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:11.652547 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-32b9d4b5-29f2-4d56-9e81-642ee51554df tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.369336 May 19 04:43:11.653725 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1462/2981] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:11 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:12.087151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5bc93d1e-9eea-4cce-a5e6-3581b17f5d00 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:12.100716 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5bc93d1e-9eea-4cce-a5e6-3581b17f5d00 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1537 microversion: 2.1 time: 0.487689 May 19 04:43:12.103588 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1520/2982] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:11 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1537 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:12.673351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-71bf4d77-e0f8-46a7-b9dc-c144974c92cc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:12.673971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-71bf4d77-e0f8-46a7-b9dc-c144974c92cc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:12.685974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71bf4d77-e0f8-46a7-b9dc-c144974c92cc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:12.686426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71bf4d77-e0f8-46a7-b9dc-c144974c92cc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:12.688824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71bf4d77-e0f8-46a7-b9dc-c144974c92cc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:12.690580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71bf4d77-e0f8-46a7-b9dc-c144974c92cc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:13.013708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-71bf4d77-e0f8-46a7-b9dc-c144974c92cc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:13.023427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:13.031895 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-71bf4d77-e0f8-46a7-b9dc-c144974c92cc tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.362266 May 19 04:43:13.035006 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1463/2983] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:12 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:13.120229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bdf8407-cceb-491a-9c98-f3dadb841ba0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:13.121973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4bdf8407-cceb-491a-9c98-f3dadb841ba0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:13.130713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdf8407-cceb-491a-9c98-f3dadb841ba0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:13.131441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdf8407-cceb-491a-9c98-f3dadb841ba0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:13.132605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdf8407-cceb-491a-9c98-f3dadb841ba0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:13.133424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdf8407-cceb-491a-9c98-f3dadb841ba0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:13.420176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4bdf8407-cceb-491a-9c98-f3dadb841ba0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:13.431244 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4bdf8407-cceb-491a-9c98-f3dadb841ba0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1537 microversion: 2.1 time: 0.315333 May 19 04:43:13.432946 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1521/2984] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:13 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1537 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:14.054132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c61550c5-688a-4a47-9949-4658eb5e5c8c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:14.055738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c61550c5-688a-4a47-9949-4658eb5e5c8c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:14.064434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c61550c5-688a-4a47-9949-4658eb5e5c8c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:14.065424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c61550c5-688a-4a47-9949-4658eb5e5c8c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:14.066267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c61550c5-688a-4a47-9949-4658eb5e5c8c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:14.068070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c61550c5-688a-4a47-9949-4658eb5e5c8c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:14.403229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c61550c5-688a-4a47-9949-4658eb5e5c8c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:14.412574 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c61550c5-688a-4a47-9949-4658eb5e5c8c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.362868 May 19 04:43:14.413469 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1464/2985] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:14 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:14.450561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-38c8700c-a33e-4915-a505-f775ea77be61 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:14.452042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-38c8700c-a33e-4915-a505-f775ea77be61 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:14.460466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38c8700c-a33e-4915-a505-f775ea77be61 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:14.501552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38c8700c-a33e-4915-a505-f775ea77be61 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:14.504342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38c8700c-a33e-4915-a505-f775ea77be61 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:14.505633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38c8700c-a33e-4915-a505-f775ea77be61 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:14.742170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-38c8700c-a33e-4915-a505-f775ea77be61 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:14.761686 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-38c8700c-a33e-4915-a505-f775ea77be61 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.313971 May 19 04:43:14.763243 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1522/2986] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:14 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:15.076269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-44ef4545-25b0-4542-8383-6aafe4681129 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:15.076888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-44ef4545-25b0-4542-8383-6aafe4681129 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:15.089109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ef4545-25b0-4542-8383-6aafe4681129 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:15.089594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ef4545-25b0-4542-8383-6aafe4681129 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:15.090383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ef4545-25b0-4542-8383-6aafe4681129 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:15.090828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-44ef4545-25b0-4542-8383-6aafe4681129 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:15.118552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-44ef4545-25b0-4542-8383-6aafe4681129 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:43:15.213700 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-44ef4545-25b0-4542-8383-6aafe4681129 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "DELETE /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 204 len: 0 microversion: 2.32 time: 0.461857 May 19 04:43:15.215251 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1465/2987] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:43:14 2022] DELETE /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 04:43:15.224723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:15.225609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:15.231284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:15.232913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:15.233600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:15.234387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:15.235068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:15.428335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:15.438031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:15.439819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:15.441341 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d1a71f97-8b92-407e-9b85-2d6aeeb88c72 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2944 microversion: 2.32 time: 0.221763 May 19 04:43:15.441625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8d5f08a-a7c4-49c6-9180-8b14824c7c48 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:15.442524 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1523/2988] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:15 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2944 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:15.453920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e8d5f08a-a7c4-49c6-9180-8b14824c7c48 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:15.464227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8d5f08a-a7c4-49c6-9180-8b14824c7c48 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:15.464985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8d5f08a-a7c4-49c6-9180-8b14824c7c48 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:15.466463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8d5f08a-a7c4-49c6-9180-8b14824c7c48 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:15.467282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8d5f08a-a7c4-49c6-9180-8b14824c7c48 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:15.618993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e8d5f08a-a7c4-49c6-9180-8b14824c7c48 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:15.628028 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e8d5f08a-a7c4-49c6-9180-8b14824c7c48 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.194503 May 19 04:43:15.629427 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1466/2989] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:15 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:15.779763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8a948b93-24a2-4d12-8789-2b9264bf5b4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:15.780412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8a948b93-24a2-4d12-8789-2b9264bf5b4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:15.788735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a948b93-24a2-4d12-8789-2b9264bf5b4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:15.790080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a948b93-24a2-4d12-8789-2b9264bf5b4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:15.790923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a948b93-24a2-4d12-8789-2b9264bf5b4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:15.791428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a948b93-24a2-4d12-8789-2b9264bf5b4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:15.933112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8a948b93-24a2-4d12-8789-2b9264bf5b4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:15.942002 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8a948b93-24a2-4d12-8789-2b9264bf5b4d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.166400 May 19 04:43:15.943284 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1524/2990] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:15 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:16.460985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:16.461631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:16.471152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:16.472305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:16.473836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:16.475621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:16.652155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71b68daf-ec2c-48cc-ad8b-05ef2099b205 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:16.653157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-71b68daf-ec2c-48cc-ad8b-05ef2099b205 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:16.662266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71b68daf-ec2c-48cc-ad8b-05ef2099b205 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:16.663107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71b68daf-ec2c-48cc-ad8b-05ef2099b205 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:16.664057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71b68daf-ec2c-48cc-ad8b-05ef2099b205 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:16.664498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71b68daf-ec2c-48cc-ad8b-05ef2099b205 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:16.842944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:16.855952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:16.858149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-71b68daf-ec2c-48cc-ad8b-05ef2099b205 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:16.859658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:16.860977 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-56505174-208e-4098-8f50-e1f8b9e17d56 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2944 microversion: 2.32 time: 0.403888 May 19 04:43:16.868745 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-71b68daf-ec2c-48cc-ad8b-05ef2099b205 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.223466 May 19 04:43:16.879001 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1525/2991] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:16 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:16.879205 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1467/2992] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:16 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2944 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:16.972669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e800281-e666-4be9-86e8-9fa3e638db3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:16.974893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6e800281-e666-4be9-86e8-9fa3e638db3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:16.987389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e800281-e666-4be9-86e8-9fa3e638db3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:16.987860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e800281-e666-4be9-86e8-9fa3e638db3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:16.988644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e800281-e666-4be9-86e8-9fa3e638db3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:16.989159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e800281-e666-4be9-86e8-9fa3e638db3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:17.217738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6e800281-e666-4be9-86e8-9fa3e638db3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:17.226718 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e800281-e666-4be9-86e8-9fa3e638db3e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.269057 May 19 04:43:17.229599 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1526/2993] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:16 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:17.886815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e932e0d-7c9a-41c8-bf95-13a49f2daf9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:17.888379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:17.889278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5e932e0d-7c9a-41c8-bf95-13a49f2daf9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:17.889796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:17.905306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e932e0d-7c9a-41c8-bf95-13a49f2daf9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:17.909338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:17.912866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:17.913734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e932e0d-7c9a-41c8-bf95-13a49f2daf9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:17.914773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:17.915790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e932e0d-7c9a-41c8-bf95-13a49f2daf9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:17.916466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:17.917990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e932e0d-7c9a-41c8-bf95-13a49f2daf9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:18.264873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e932e0d-7c9a-41c8-bf95-13a49f2daf9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:18.273592 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e932e0d-7c9a-41c8-bf95-13a49f2daf9f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1508 microversion: 2.1 time: 0.391443 May 19 04:43:18.277586 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1527/2994] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:17 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:18.288804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3c280119-c141-4083-b88b-89f13f777b12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:18.290108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3c280119-c141-4083-b88b-89f13f777b12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:18.303937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c280119-c141-4083-b88b-89f13f777b12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:18.307159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c280119-c141-4083-b88b-89f13f777b12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:18.308433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c280119-c141-4083-b88b-89f13f777b12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:18.310109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c280119-c141-4083-b88b-89f13f777b12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:18.625052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:18.656078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:18.658433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:18.660535 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-52ca566c-cab7-4ccf-bc5d-2e7478a6243d tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2944 microversion: 2.32 time: 0.782226 May 19 04:43:18.670241 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1468/2995] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:17 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2944 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:18.683275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3c280119-c141-4083-b88b-89f13f777b12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:18.694446 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3c280119-c141-4083-b88b-89f13f777b12 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.415536 May 19 04:43:18.695965 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1528/2996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:18 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:19.293125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8a19bf3-4c77-4672-aa32-4190cf49817f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:19.294477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8a19bf3-4c77-4672-aa32-4190cf49817f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:19.310058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8a19bf3-4c77-4672-aa32-4190cf49817f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:19.312757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8a19bf3-4c77-4672-aa32-4190cf49817f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:19.319667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8a19bf3-4c77-4672-aa32-4190cf49817f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:19.320486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8a19bf3-4c77-4672-aa32-4190cf49817f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:19.639702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1073660250", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:19.734959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] validate_networks() for [('260656eb-d041-4e9d-9cb0-3930a24c3f23', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:43:19.778838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8a19bf3-4c77-4672-aa32-4190cf49817f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:19.787111 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8a19bf3-4c77-4672-aa32-4190cf49817f tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1529 microversion: 2.1 time: 0.498062 May 19 04:43:19.797885 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1529/2997] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:19 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1529 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:19.803873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:19.804545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:19.811547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:19.812394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:19.813453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:19.814079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:20.208882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:20.222161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:20.225701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:20.227185 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cc852fb3-8dcb-4f95-8f88-b647c1551c05 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2944 microversion: 2.32 time: 0.427985 May 19 04:43:20.228006 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1530/2998] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:19 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2944 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:20.234752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9051f2fa-e6cf-43aa-9750-5c339be5e272 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:20.236386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9051f2fa-e6cf-43aa-9750-5c339be5e272 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:20.265640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9051f2fa-e6cf-43aa-9750-5c339be5e272 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:20.267795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9051f2fa-e6cf-43aa-9750-5c339be5e272 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:20.269177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9051f2fa-e6cf-43aa-9750-5c339be5e272 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:20.269917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9051f2fa-e6cf-43aa-9750-5c339be5e272 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:20.709336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9051f2fa-e6cf-43aa-9750-5c339be5e272 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:20.727059 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9051f2fa-e6cf-43aa-9750-5c339be5e272 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.488897 May 19 04:43:20.727792 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1531/2999] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:20 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:20.806509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-820f6aab-d0c7-4543-bc0f-4bd5afb45d56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:20.807631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-820f6aab-d0c7-4543-bc0f-4bd5afb45d56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:20.816000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-820f6aab-d0c7-4543-bc0f-4bd5afb45d56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:20.816649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-820f6aab-d0c7-4543-bc0f-4bd5afb45d56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:20.821434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-820f6aab-d0c7-4543-bc0f-4bd5afb45d56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:20.822071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-820f6aab-d0c7-4543-bc0f-4bd5afb45d56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:20.827258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:20.857360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:43:20.857909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:43:20.858251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:43:20.858666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:43:20.859078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:43:20.871858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:20.872297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:20.873136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:20.873577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:20.924052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Getting quotas for project cd18dc85a9074ccebec5de473b90fb27. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:43:20.935892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Getting quotas for user b645d221b97b4d9fb5c3ae3bc0fec0ed and project cd18dc85a9074ccebec5de473b90fb27. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:43:20.950565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:43:20.952887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:43:21.034490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b8312bc2-8647-406d-bfda-6a96c6473b25 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.929654 May 19 04:43:21.037429 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1469/3000] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:43:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 04:43:21.058374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f96249b6-0278-4cdb-b6ef-7825e313c7db tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:21.061556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f96249b6-0278-4cdb-b6ef-7825e313c7db tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:21.183599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-820f6aab-d0c7-4543-bc0f-4bd5afb45d56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:21.196982 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-820f6aab-d0c7-4543-bc0f-4bd5afb45d56 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1529 microversion: 2.1 time: 0.396123 May 19 04:43:21.199965 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1532/3001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:20 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1529 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:21.252489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:21.253793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:21.267035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:21.267490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:21.268272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:21.268712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:21.278728 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f96249b6-0278-4cdb-b6ef-7825e313c7db tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:21.288655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f96249b6-0278-4cdb-b6ef-7825e313c7db tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1214 microversion: 2.1 time: 0.242202 May 19 04:43:21.289304 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1470/3002] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:21 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:21.745566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2f3eb909-70da-4d23-9a38-96e27d1af4ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:21.746737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2f3eb909-70da-4d23-9a38-96e27d1af4ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:21.763114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f3eb909-70da-4d23-9a38-96e27d1af4ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:21.765556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f3eb909-70da-4d23-9a38-96e27d1af4ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:21.772751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f3eb909-70da-4d23-9a38-96e27d1af4ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:21.774567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f3eb909-70da-4d23-9a38-96e27d1af4ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:21.830508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:21.851135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:21.857499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:21.865760 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-692cfc53-872d-4f71-b8ac-2ade4f0319ca tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2923 microversion: 2.32 time: 0.617348 May 19 04:43:21.874921 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1533/3003] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:21 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2923 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:22.156204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c7efa60f-4bef-469a-bd89-d2f0be83e877 req-9298440c-240f-495c-b62c-1c29cdea9e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-unplugged", "status": "completed", "tag": "c98bb199-4633-4d92-8f73-35d11894ef17"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:22.187766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c7efa60f-4bef-469a-bd89-d2f0be83e877 req-9298440c-240f-495c-b62c-1c29cdea9e62 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:22.189212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c7efa60f-4bef-469a-bd89-d2f0be83e877 req-9298440c-240f-495c-b62c-1c29cdea9e62 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:22.228344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2f3eb909-70da-4d23-9a38-96e27d1af4ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:22.237953 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2f3eb909-70da-4d23-9a38-96e27d1af4ab tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.497626 May 19 04:43:22.245847 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1471/3004] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:21 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:22.255449 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c7efa60f-4bef-469a-bd89-d2f0be83e877 req-9298440c-240f-495c-b62c-1c29cdea9e62 service nova] Creating event network-vif-unplugged:c98bb199-4633-4d92-8f73-35d11894ef17 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:22.266758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c114460f-2b5a-48c9-ae5e-4d2ff6cc6d3d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:22.273329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c114460f-2b5a-48c9-ae5e-4d2ff6cc6d3d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:22.288554 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c7efa60f-4bef-469a-bd89-d2f0be83e877 req-9298440c-240f-495c-b62c-1c29cdea9e62 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137715 May 19 04:43:22.289199 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1534/3005] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:22.290087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c114460f-2b5a-48c9-ae5e-4d2ff6cc6d3d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:22.290851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c114460f-2b5a-48c9-ae5e-4d2ff6cc6d3d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:22.291881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c114460f-2b5a-48c9-ae5e-4d2ff6cc6d3d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:22.293715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c114460f-2b5a-48c9-ae5e-4d2ff6cc6d3d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:22.307737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e555b2df-17e7-4522-a4b6-7106220642fa tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:22.336715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e555b2df-17e7-4522-a4b6-7106220642fa tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:22.351808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e555b2df-17e7-4522-a4b6-7106220642fa tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:22.353261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e555b2df-17e7-4522-a4b6-7106220642fa tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:22.354259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e555b2df-17e7-4522-a4b6-7106220642fa tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:22.356791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e555b2df-17e7-4522-a4b6-7106220642fa tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:22.579858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e555b2df-17e7-4522-a4b6-7106220642fa tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:22.593562 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e555b2df-17e7-4522-a4b6-7106220642fa tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1210 microversion: 2.1 time: 0.290333 May 19 04:43:22.594331 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1535/3006] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:22 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1210 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:22.890545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:22.901275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:22.912936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:22.913626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:22.916765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:22.917385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:22.950882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c114460f-2b5a-48c9-ae5e-4d2ff6cc6d3d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:22.961683 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c114460f-2b5a-48c9-ae5e-4d2ff6cc6d3d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.714552 May 19 04:43:22.971237 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1472/3007] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:22 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:23.267244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b1dcf6af-7a5b-4117-93c0-069aa8ff3ce6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:23.268679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b1dcf6af-7a5b-4117-93c0-069aa8ff3ce6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:23.282657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1dcf6af-7a5b-4117-93c0-069aa8ff3ce6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:23.287523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1dcf6af-7a5b-4117-93c0-069aa8ff3ce6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:23.289392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1dcf6af-7a5b-4117-93c0-069aa8ff3ce6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:23.292948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1dcf6af-7a5b-4117-93c0-069aa8ff3ce6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:23.955326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:23.979337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:23.981635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:23.983177 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fbd352ea-cd62-4147-a4ae-1326e2407cc5 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2902 microversion: 2.32 time: 1.096977 May 19 04:43:23.985621 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1536/3008] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:22 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2902 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:23.997938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea2372cb-47ff-4d41-acd9-d74fd3ba650c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:24.007196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ea2372cb-47ff-4d41-acd9-d74fd3ba650c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:24.039562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea2372cb-47ff-4d41-acd9-d74fd3ba650c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:24.041610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea2372cb-47ff-4d41-acd9-d74fd3ba650c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:24.042421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea2372cb-47ff-4d41-acd9-d74fd3ba650c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:24.046022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea2372cb-47ff-4d41-acd9-d74fd3ba650c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:24.221538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b1dcf6af-7a5b-4117-93c0-069aa8ff3ce6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:24.234099 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b1dcf6af-7a5b-4117-93c0-069aa8ff3ce6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.971191 May 19 04:43:24.239791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ea2372cb-47ff-4d41-acd9-d74fd3ba650c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:24.257657 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1473/3009] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:23 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:24.262121 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ea2372cb-47ff-4d41-acd9-d74fd3ba650c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1272 microversion: 2.1 time: 0.274267 May 19 04:43:24.268981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc72358b-16ef-4a07-8aa8-304c7cb0ee5e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:24.272493 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1537/3010] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:23 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:24.276037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fc72358b-16ef-4a07-8aa8-304c7cb0ee5e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:24.293144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc72358b-16ef-4a07-8aa8-304c7cb0ee5e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:24.293877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc72358b-16ef-4a07-8aa8-304c7cb0ee5e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:24.294897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc72358b-16ef-4a07-8aa8-304c7cb0ee5e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:24.297603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc72358b-16ef-4a07-8aa8-304c7cb0ee5e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:24.497638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-7560d5ab-93d0-4053-93b1-69f6e81ab695 req-f58fcf35-b3f8-420e-97f1-c0c563094ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-unplugged", "status": "completed", "tag": "1b45fa40-6dea-450d-9ca3-5940db1c12bf"}, {"server_uuid": "3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8", "name": "network-vif-plugged", "status": "completed", "tag": "f9523cc7-bde6-44b3-8939-9aed1c4a8353"}, {"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-unplugged", "status": "completed", "tag": "4ade1fa2-1f84-447f-bdda-2b80cce5bf66"}, {"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-unplugged", "status": "completed", "tag": "0d520ead-ade4-471e-93f7-b40ec3e08c30"}, {"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-unplugged", "status": "completed", "tag": "0fb435e5-06bc-4971-8e0d-ca6e92a30329"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:24.516117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7560d5ab-93d0-4053-93b1-69f6e81ab695 req-f58fcf35-b3f8-420e-97f1-c0c563094ed9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:24.517489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7560d5ab-93d0-4053-93b1-69f6e81ab695 req-f58fcf35-b3f8-420e-97f1-c0c563094ed9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:24.572113 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7560d5ab-93d0-4053-93b1-69f6e81ab695 req-f58fcf35-b3f8-420e-97f1-c0c563094ed9 service nova] Creating event network-vif-unplugged:1b45fa40-6dea-450d-9ca3-5940db1c12bf for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:24.573005 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7560d5ab-93d0-4053-93b1-69f6e81ab695 req-f58fcf35-b3f8-420e-97f1-c0c563094ed9 service nova] Creating event network-vif-plugged:f9523cc7-bde6-44b3-8939-9aed1c4a8353 for instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 on n-h2-766726-30 May 19 04:43:24.573689 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7560d5ab-93d0-4053-93b1-69f6e81ab695 req-f58fcf35-b3f8-420e-97f1-c0c563094ed9 service nova] Creating event network-vif-unplugged:4ade1fa2-1f84-447f-bdda-2b80cce5bf66 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:24.574364 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7560d5ab-93d0-4053-93b1-69f6e81ab695 req-f58fcf35-b3f8-420e-97f1-c0c563094ed9 service nova] Creating event network-vif-unplugged:0d520ead-ade4-471e-93f7-b40ec3e08c30 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:24.576903 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7560d5ab-93d0-4053-93b1-69f6e81ab695 req-f58fcf35-b3f8-420e-97f1-c0c563094ed9 service nova] Creating event network-vif-unplugged:0fb435e5-06bc-4971-8e0d-ca6e92a30329 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:24.609064 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-7560d5ab-93d0-4053-93b1-69f6e81ab695 req-f58fcf35-b3f8-420e-97f1-c0c563094ed9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 875 microversion: 2.1 time: 0.115069 May 19 04:43:24.628701 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1538/3011] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 875 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:24.771756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fc72358b-16ef-4a07-8aa8-304c7cb0ee5e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:24.779648 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc72358b-16ef-4a07-8aa8-304c7cb0ee5e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.516723 May 19 04:43:24.780263 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1474/3012] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:24 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:25.012243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:25.012955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:25.022394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:25.022852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:25.030340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:25.030850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:25.158872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e6eb4b9d-e925-4e82-8d7f-697592b78c55 req-7269595a-f626-42ab-9314-e7fb7f62b6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-deleted", "tag": "1b45fa40-6dea-450d-9ca3-5940db1c12bf"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:25.190165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e6eb4b9d-e925-4e82-8d7f-697592b78c55 req-7269595a-f626-42ab-9314-e7fb7f62b6b4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:25.197493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e6eb4b9d-e925-4e82-8d7f-697592b78c55 req-7269595a-f626-42ab-9314-e7fb7f62b6b4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:25.215454 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e6eb4b9d-e925-4e82-8d7f-697592b78c55 req-7269595a-f626-42ab-9314-e7fb7f62b6b4 service nova] Creating event network-vif-deleted:1b45fa40-6dea-450d-9ca3-5940db1c12bf for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:25.235363 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e6eb4b9d-e925-4e82-8d7f-697592b78c55 req-7269595a-f626-42ab-9314-e7fb7f62b6b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086522 May 19 04:43:25.240940 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1475/3013] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:43:25.274999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-36496dce-8c74-4661-86ad-1070b7631441 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:25.276412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-36496dce-8c74-4661-86ad-1070b7631441 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:25.289913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36496dce-8c74-4661-86ad-1070b7631441 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:25.290929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36496dce-8c74-4661-86ad-1070b7631441 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:25.291999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36496dce-8c74-4661-86ad-1070b7631441 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:25.292631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36496dce-8c74-4661-86ad-1070b7631441 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:26.152178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:26.186757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-36496dce-8c74-4661-86ad-1070b7631441 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:26.194893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:26.203256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:26.204688 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-36496dce-8c74-4661-86ad-1070b7631441 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.946486 May 19 04:43:26.214727 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8e5559ff-27d8-4359-a891-5921e17358bf tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2856 microversion: 2.32 time: 1.201424 May 19 04:43:26.215351 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1476/3015] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:25 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:26.215482 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1539/3015] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:25 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2856 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:26.231861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-558ac102-5c64-4f2c-acb4-e246b922bbf1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:26.234133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-50d702c0-3e87-4edf-bc60-0cb8f9e478b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:26.234936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-50d702c0-3e87-4edf-bc60-0cb8f9e478b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:26.235086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-558ac102-5c64-4f2c-acb4-e246b922bbf1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:26.252878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50d702c0-3e87-4edf-bc60-0cb8f9e478b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:26.253953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50d702c0-3e87-4edf-bc60-0cb8f9e478b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:26.257748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50d702c0-3e87-4edf-bc60-0cb8f9e478b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:26.258398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-558ac102-5c64-4f2c-acb4-e246b922bbf1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:26.258581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50d702c0-3e87-4edf-bc60-0cb8f9e478b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:26.261568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-558ac102-5c64-4f2c-acb4-e246b922bbf1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:26.264020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-558ac102-5c64-4f2c-acb4-e246b922bbf1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:26.264869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-558ac102-5c64-4f2c-acb4-e246b922bbf1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:27.062080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-558ac102-5c64-4f2c-acb4-e246b922bbf1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:27.066098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-50d702c0-3e87-4edf-bc60-0cb8f9e478b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:27.089600 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-558ac102-5c64-4f2c-acb4-e246b922bbf1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1314 microversion: 2.1 time: 0.869842 May 19 04:43:27.093102 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1540/3016] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:26 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1314 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:27.098081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e1e3b3b6-e3ad-4ade-9465-e6e900edef11 req-e048a7a4-3767-47f9-bbae-dfe09907e366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab142e5-ae78-480f-96d6-bbe61f8574f7", "tag": "33c8ede5-22d9-431c-9bd0-555f0928a3a9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:27.110282 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-50d702c0-3e87-4edf-bc60-0cb8f9e478b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.861414 May 19 04:43:27.114540 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1477/3017] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:26 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:27.127760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e1e3b3b6-e3ad-4ade-9465-e6e900edef11 req-e048a7a4-3767-47f9-bbae-dfe09907e366 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:27.128447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e1e3b3b6-e3ad-4ade-9465-e6e900edef11 req-e048a7a4-3767-47f9-bbae-dfe09907e366 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:27.158764 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e1e3b3b6-e3ad-4ade-9465-e6e900edef11 req-e048a7a4-3767-47f9-bbae-dfe09907e366 service nova] Creating event network-changed:33c8ede5-22d9-431c-9bd0-555f0928a3a9 for instance 0ab142e5-ae78-480f-96d6-bbe61f8574f7 on n-h1-766726-30 May 19 04:43:27.166249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e1e3b3b6-e3ad-4ade-9465-e6e900edef11 req-e048a7a4-3767-47f9-bbae-dfe09907e366 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071724 May 19 04:43:27.170322 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1541/3018] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:27.222469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cfa584f1-9948-4b6d-8109-b1a07b9d195a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:27.222830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cfa584f1-9948-4b6d-8109-b1a07b9d195a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:27.236570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:27.237577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:27.247230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cfa584f1-9948-4b6d-8109-b1a07b9d195a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:27.247775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cfa584f1-9948-4b6d-8109-b1a07b9d195a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:27.248622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cfa584f1-9948-4b6d-8109-b1a07b9d195a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:27.256579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:27.257436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:27.258457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:27.259127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:27.259382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cfa584f1-9948-4b6d-8109-b1a07b9d195a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:27.671382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cfa584f1-9948-4b6d-8109-b1a07b9d195a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:27.701206 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cfa584f1-9948-4b6d-8109-b1a07b9d195a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.482121 May 19 04:43:27.702404 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1478/3019] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:27 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:27.708134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:27.727499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:27.729300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:27.731562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-19fd11ae-7018-4afd-8266-b76fd62cdd5f req-cb9d0e18-4148-4f3d-bcf7-89f905b4bccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-deleted", "tag": "0fb435e5-06bc-4971-8e0d-ca6e92a30329"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:27.734826 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e55a084-5496-4e79-9182-90a6b10ea78c tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2525 microversion: 2.32 time: 0.502714 May 19 04:43:27.737750 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1542/3020] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:27 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2525 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:27.744934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:27.748023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-19fd11ae-7018-4afd-8266-b76fd62cdd5f req-cb9d0e18-4148-4f3d-bcf7-89f905b4bccd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:27.748623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-19fd11ae-7018-4afd-8266-b76fd62cdd5f req-cb9d0e18-4148-4f3d-bcf7-89f905b4bccd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:27.769458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-19fd11ae-7018-4afd-8266-b76fd62cdd5f req-cb9d0e18-4148-4f3d-bcf7-89f905b4bccd service nova] Creating event network-vif-deleted:0fb435e5-06bc-4971-8e0d-ca6e92a30329 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:27.777892 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-19fd11ae-7018-4afd-8266-b76fd62cdd5f req-cb9d0e18-4148-4f3d-bcf7-89f905b4bccd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059598 May 19 04:43:27.778915 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1479/3021] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:28.106433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39892d19-75f1-40e8-bad0-da2374c6d184 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:28.107062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39892d19-75f1-40e8-bad0-da2374c6d184 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:28.124208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39892d19-75f1-40e8-bad0-da2374c6d184 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:28.124656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39892d19-75f1-40e8-bad0-da2374c6d184 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:28.132987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee09f27e-2abe-4c9c-8419-71666382ad0d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:28.134562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee09f27e-2abe-4c9c-8419-71666382ad0d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:28.138744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39892d19-75f1-40e8-bad0-da2374c6d184 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:28.141145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39892d19-75f1-40e8-bad0-da2374c6d184 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:28.160098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee09f27e-2abe-4c9c-8419-71666382ad0d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:28.164051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee09f27e-2abe-4c9c-8419-71666382ad0d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:28.165152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee09f27e-2abe-4c9c-8419-71666382ad0d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:28.168735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee09f27e-2abe-4c9c-8419-71666382ad0d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:28.711856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ee09f27e-2abe-4c9c-8419-71666382ad0d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:28.716155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39892d19-75f1-40e8-bad0-da2374c6d184 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:28.724046 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee09f27e-2abe-4c9c-8419-71666382ad0d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.595814 May 19 04:43:28.737495 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1480/3022] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:28 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:28.740991 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39892d19-75f1-40e8-bad0-da2374c6d184 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1314 microversion: 2.1 time: 0.638041 May 19 04:43:28.743259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fba7d988-efbc-49ac-9c35-f7f5ee6393b7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:28.744119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fba7d988-efbc-49ac-9c35-f7f5ee6393b7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:28.744955 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1543/3023] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:28 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:28.763463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:28.764763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:28.764915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fba7d988-efbc-49ac-9c35-f7f5ee6393b7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:28.765269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fba7d988-efbc-49ac-9c35-f7f5ee6393b7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:28.767315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fba7d988-efbc-49ac-9c35-f7f5ee6393b7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:28.769525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fba7d988-efbc-49ac-9c35-f7f5ee6393b7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:28.789289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:28.790171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:28.794378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:28.795935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:29.148776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fba7d988-efbc-49ac-9c35-f7f5ee6393b7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:29.152868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:29.169723 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fba7d988-efbc-49ac-9c35-f7f5ee6393b7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.426678 May 19 04:43:29.170402 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1481/3024] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:28 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:29.227758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:29.237121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:29.238688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:29.240001 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4fcb4ea6-e256-4968-af1b-732add0edab4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 2365 microversion: 2.32 time: 0.482918 May 19 04:43:29.240898 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1544/3025] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:28 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 2365 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:29.741936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90145921-ada8-4b1f-bb16-6a55bd98952d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:29.742547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-90145921-ada8-4b1f-bb16-6a55bd98952d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:29.757866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90145921-ada8-4b1f-bb16-6a55bd98952d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:29.758326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90145921-ada8-4b1f-bb16-6a55bd98952d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:29.759125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90145921-ada8-4b1f-bb16-6a55bd98952d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:29.760024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90145921-ada8-4b1f-bb16-6a55bd98952d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:29.764013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1716223f-147a-4cb2-9b8d-23882a76dab4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:29.764630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1716223f-147a-4cb2-9b8d-23882a76dab4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:29.785368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1716223f-147a-4cb2-9b8d-23882a76dab4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:29.786582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1716223f-147a-4cb2-9b8d-23882a76dab4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:29.787406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1716223f-147a-4cb2-9b8d-23882a76dab4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:29.787971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1716223f-147a-4cb2-9b8d-23882a76dab4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:30.038469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-90145921-ada8-4b1f-bb16-6a55bd98952d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:30.052673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1716223f-147a-4cb2-9b8d-23882a76dab4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:30.057191 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-90145921-ada8-4b1f-bb16-6a55bd98952d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.319399 May 19 04:43:30.064270 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1716223f-147a-4cb2-9b8d-23882a76dab4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1314 microversion: 2.1 time: 0.305454 May 19 04:43:30.072077 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1482/3026] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:29 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:30.076017 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1545/3027] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:29 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:30.087451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-688e30ef-2456-4cb1-b85a-6b64aa2510d1 req-00dc632d-243e-4a3f-b8c5-ae2f464c518d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-deleted", "tag": "0d520ead-ade4-471e-93f7-b40ec3e08c30"}, {"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-deleted", "tag": "4ade1fa2-1f84-447f-bdda-2b80cce5bf66"}, {"server_uuid": "19184d52-45a9-457d-9cc8-7635125ecc4c", "name": "network-vif-deleted", "tag": "c98bb199-4633-4d92-8f73-35d11894ef17"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:30.111319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-688e30ef-2456-4cb1-b85a-6b64aa2510d1 req-00dc632d-243e-4a3f-b8c5-ae2f464c518d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:30.111843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-688e30ef-2456-4cb1-b85a-6b64aa2510d1 req-00dc632d-243e-4a3f-b8c5-ae2f464c518d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:30.152101 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-688e30ef-2456-4cb1-b85a-6b64aa2510d1 req-00dc632d-243e-4a3f-b8c5-ae2f464c518d service nova] Creating event network-vif-deleted:0d520ead-ade4-471e-93f7-b40ec3e08c30 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:30.152753 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-688e30ef-2456-4cb1-b85a-6b64aa2510d1 req-00dc632d-243e-4a3f-b8c5-ae2f464c518d service nova] Creating event network-vif-deleted:4ade1fa2-1f84-447f-bdda-2b80cce5bf66 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:30.162351 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-688e30ef-2456-4cb1-b85a-6b64aa2510d1 req-00dc632d-243e-4a3f-b8c5-ae2f464c518d service nova] Creating event network-vif-deleted:c98bb199-4633-4d92-8f73-35d11894ef17 for instance 19184d52-45a9-457d-9cc8-7635125ecc4c on n-h1-766726-30 May 19 04:43:30.169008 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-688e30ef-2456-4cb1-b85a-6b64aa2510d1 req-00dc632d-243e-4a3f-b8c5-ae2f464c518d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.095063 May 19 04:43:30.172611 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1483/3028] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:30.188059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6272325e-abcb-45a3-b6b4-fa7ae686532e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:30.189018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6272325e-abcb-45a3-b6b4-fa7ae686532e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:30.199846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6272325e-abcb-45a3-b6b4-fa7ae686532e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:30.201651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6272325e-abcb-45a3-b6b4-fa7ae686532e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:30.202686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6272325e-abcb-45a3-b6b4-fa7ae686532e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:30.203502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6272325e-abcb-45a3-b6b4-fa7ae686532e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:30.261947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:30.262652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:30.275887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:30.276755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:30.278685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:30.279335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:30.472096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:30.490849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:30.492377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:30.493629 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b04c402-f353-494e-bd7d-40888e0ba351 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.236931 May 19 04:43:30.494201 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1484/3029] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:30 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:43:30.543683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6272325e-abcb-45a3-b6b4-fa7ae686532e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:30.554345 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6272325e-abcb-45a3-b6b4-fa7ae686532e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.371727 May 19 04:43:30.555446 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1546/3030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:30 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:31.083680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8610d913-88d8-435f-a4a8-71c1b017407e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:31.085163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8610d913-88d8-435f-a4a8-71c1b017407e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:31.087799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8d7ecdc4-3f43-431f-ab8f-5d2f09596d0a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:31.090975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8d7ecdc4-3f43-431f-ab8f-5d2f09596d0a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:31.105649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8610d913-88d8-435f-a4a8-71c1b017407e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:31.110867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:31.111716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8610d913-88d8-435f-a4a8-71c1b017407e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:31.112723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8610d913-88d8-435f-a4a8-71c1b017407e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:31.113341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8610d913-88d8-435f-a4a8-71c1b017407e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:31.121415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d7ecdc4-3f43-431f-ab8f-5d2f09596d0a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:31.122184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d7ecdc4-3f43-431f-ab8f-5d2f09596d0a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:31.124315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d7ecdc4-3f43-431f-ab8f-5d2f09596d0a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:31.125615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d7ecdc4-3f43-431f-ab8f-5d2f09596d0a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:31.283206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:31.402039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8610d913-88d8-435f-a4a8-71c1b017407e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:31.420321 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8610d913-88d8-435f-a4a8-71c1b017407e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1314 microversion: 2.1 time: 0.338927 May 19 04:43:31.431786 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1547/3031] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:31 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:31.447793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8d7ecdc4-3f43-431f-ab8f-5d2f09596d0a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:31.457449 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8d7ecdc4-3f43-431f-ab8f-5d2f09596d0a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.383898 May 19 04:43:31.470011 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1485/3032] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:31 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:31.516349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:31.517096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:31.534330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:31.535258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:31.536340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:31.537882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:31.578318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f97154b9-c4ae-4b3e-8b4c-244c071d3a03 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:31.579378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f97154b9-c4ae-4b3e-8b4c-244c071d3a03 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:31.595115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97154b9-c4ae-4b3e-8b4c-244c071d3a03 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:31.600406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97154b9-c4ae-4b3e-8b4c-244c071d3a03 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:31.601563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97154b9-c4ae-4b3e-8b4c-244c071d3a03 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:31.602212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97154b9-c4ae-4b3e-8b4c-244c071d3a03 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:31.671935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:31.697297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:31.703144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:31.706126 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-00043b5e-0fbb-4465-afc9-008f2517a84f tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.194938 May 19 04:43:31.707341 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1548/3033] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:31 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:31.850413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f97154b9-c4ae-4b3e-8b4c-244c071d3a03 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:31.864848 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f97154b9-c4ae-4b3e-8b4c-244c071d3a03 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.290248 May 19 04:43:31.889689 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1486/3034] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:31 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:32.268499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-10e80f58-66a5-4dca-bef6-ca425003cdd5 req-f47dbbf5-6ced-487e-98c3-9c64bee757f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab142e5-ae78-480f-96d6-bbe61f8574f7", "name": "network-vif-plugged", "status": "completed", "tag": "33c8ede5-22d9-431c-9bd0-555f0928a3a9"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:32.288976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-10e80f58-66a5-4dca-bef6-ca425003cdd5 req-f47dbbf5-6ced-487e-98c3-9c64bee757f9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:32.291125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-10e80f58-66a5-4dca-bef6-ca425003cdd5 req-f47dbbf5-6ced-487e-98c3-9c64bee757f9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:32.311553 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-10e80f58-66a5-4dca-bef6-ca425003cdd5 req-f47dbbf5-6ced-487e-98c3-9c64bee757f9 service nova] Creating event network-vif-plugged:33c8ede5-22d9-431c-9bd0-555f0928a3a9 for instance 0ab142e5-ae78-480f-96d6-bbe61f8574f7 on n-h1-766726-30 May 19 04:43:32.324773 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-10e80f58-66a5-4dca-bef6-ca425003cdd5 req-f47dbbf5-6ced-487e-98c3-9c64bee757f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059911 May 19 04:43:32.333680 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1549/3035] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:32.437379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bc99c309-1ce2-4d2f-954d-f703631ba633 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:32.439037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bc99c309-1ce2-4d2f-954d-f703631ba633 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:32.465283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc99c309-1ce2-4d2f-954d-f703631ba633 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:32.466232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc99c309-1ce2-4d2f-954d-f703631ba633 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:32.467260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc99c309-1ce2-4d2f-954d-f703631ba633 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:32.467932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc99c309-1ce2-4d2f-954d-f703631ba633 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:32.477738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f86a8aa-0c62-480e-8f17-76662f7b32a1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:32.478454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f86a8aa-0c62-480e-8f17-76662f7b32a1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:32.489614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f86a8aa-0c62-480e-8f17-76662f7b32a1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:32.490030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f86a8aa-0c62-480e-8f17-76662f7b32a1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:32.494218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f86a8aa-0c62-480e-8f17-76662f7b32a1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:32.494926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f86a8aa-0c62-480e-8f17-76662f7b32a1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:32.829828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bc99c309-1ce2-4d2f-954d-f703631ba633 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:32.844028 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bc99c309-1ce2-4d2f-954d-f703631ba633 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1314 microversion: 2.1 time: 0.410419 May 19 04:43:32.853575 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1487/3036] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:32 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:32.853747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f86a8aa-0c62-480e-8f17-76662f7b32a1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:32.855327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:32.855947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:32.867990 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f86a8aa-0c62-480e-8f17-76662f7b32a1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.393166 May 19 04:43:32.868843 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1550/3037] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:32 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:32.884717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:32.885203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:32.885896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:32.886346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:32.894036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da8024cf-7339-40ea-86fe-66c1d90f410c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:32.895995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da8024cf-7339-40ea-86fe-66c1d90f410c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:32.906357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da8024cf-7339-40ea-86fe-66c1d90f410c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:32.908134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da8024cf-7339-40ea-86fe-66c1d90f410c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:32.909879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da8024cf-7339-40ea-86fe-66c1d90f410c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:32.910751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da8024cf-7339-40ea-86fe-66c1d90f410c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:32.963715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:33.038654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:33.050068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:33.063535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:33.066491 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-66b8110b-23e5-4d54-b3fb-662c0358ec74 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.213354 May 19 04:43:33.067125 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1488/3038] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:32 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:33.197685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-da8024cf-7339-40ea-86fe-66c1d90f410c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:33.215741 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da8024cf-7339-40ea-86fe-66c1d90f410c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.335112 May 19 04:43:33.217028 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1551/3039] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:32 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:33.897935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8011ff6-f57a-4d06-aec0-d309603ae2ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:33.899230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8011ff6-f57a-4d06-aec0-d309603ae2ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:33.900511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f406ffa-d85e-4344-86e7-058d07b69712 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:33.901293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f406ffa-d85e-4344-86e7-058d07b69712 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:33.906765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8011ff6-f57a-4d06-aec0-d309603ae2ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:33.907455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8011ff6-f57a-4d06-aec0-d309603ae2ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:33.908423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8011ff6-f57a-4d06-aec0-d309603ae2ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:33.911744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f406ffa-d85e-4344-86e7-058d07b69712 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:33.912207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f406ffa-d85e-4344-86e7-058d07b69712 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:33.912448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8011ff6-f57a-4d06-aec0-d309603ae2ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:33.917176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f406ffa-d85e-4344-86e7-058d07b69712 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:33.917798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f406ffa-d85e-4344-86e7-058d07b69712 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:34.280418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8011ff6-f57a-4d06-aec0-d309603ae2ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:34.290843 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8011ff6-f57a-4d06-aec0-d309603ae2ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1499 microversion: 2.1 time: 0.433165 May 19 04:43:34.292628 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1489/3040] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:33 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1499 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:34.305476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:34.307760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:34.325159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:34.325889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:34.329837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:34.335388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:34.372540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f406ffa-d85e-4344-86e7-058d07b69712 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:34.393560 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f406ffa-d85e-4344-86e7-058d07b69712 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.511167 May 19 04:43:34.402846 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1552/3041] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:33 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:34.402846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89bb6744-6f4f-4ba9-94a7-dd1af829cff0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:34.402846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-89bb6744-6f4f-4ba9-94a7-dd1af829cff0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:34.409584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89bb6744-6f4f-4ba9-94a7-dd1af829cff0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:34.410177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89bb6744-6f4f-4ba9-94a7-dd1af829cff0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:34.411640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89bb6744-6f4f-4ba9-94a7-dd1af829cff0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:34.412088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89bb6744-6f4f-4ba9-94a7-dd1af829cff0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:34.515433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:34.531920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:34.533975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:34.536309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf277b95-73be-439a-9c02-d79dbc81f2da tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.242376 May 19 04:43:34.537515 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1490/3042] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:34 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:34.546684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d83bc940-81c5-4f50-891f-9338df51156e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:34.548941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d83bc940-81c5-4f50-891f-9338df51156e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:34.556933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d83bc940-81c5-4f50-891f-9338df51156e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:34.557962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d83bc940-81c5-4f50-891f-9338df51156e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:34.559650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d83bc940-81c5-4f50-891f-9338df51156e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:34.561188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d83bc940-81c5-4f50-891f-9338df51156e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:34.598139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-d83bc940-81c5-4f50-891f-9338df51156e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lazy-loading 'flavor' on Instance uuid 0ab142e5-ae78-480f-96d6-bbe61f8574f7 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:43:34.716598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-89bb6744-6f4f-4ba9-94a7-dd1af829cff0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:34.727875 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-89bb6744-6f4f-4ba9-94a7-dd1af829cff0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.331882 May 19 04:43:34.728636 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1553/3043] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:34 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:34.753743 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d83bc940-81c5-4f50-891f-9338df51156e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "POST /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7/action" status: 200 len: 32 microversion: 2.1 time: 0.213807 May 19 04:43:34.754493 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1491/3044] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:43:34 2022] POST /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:43:34.765244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99f15aec-75ac-4191-81be-db7a025a8427 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:34.766337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-99f15aec-75ac-4191-81be-db7a025a8427 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:34.778517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99f15aec-75ac-4191-81be-db7a025a8427 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:34.781134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99f15aec-75ac-4191-81be-db7a025a8427 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:34.784979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99f15aec-75ac-4191-81be-db7a025a8427 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:34.787043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99f15aec-75ac-4191-81be-db7a025a8427 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:35.106577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99f15aec-75ac-4191-81be-db7a025a8427 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:35.116431 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99f15aec-75ac-4191-81be-db7a025a8427 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.355949 May 19 04:43:35.120759 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1554/3045] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:34 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:35.415503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-626ff5ed-d467-4be4-8682-70a9f7e49918 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:35.416228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-626ff5ed-d467-4be4-8682-70a9f7e49918 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:35.433555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-626ff5ed-d467-4be4-8682-70a9f7e49918 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:35.434014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-626ff5ed-d467-4be4-8682-70a9f7e49918 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:35.438871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-626ff5ed-d467-4be4-8682-70a9f7e49918 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:35.440270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-626ff5ed-d467-4be4-8682-70a9f7e49918 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:35.559956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:35.561343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:35.570818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:35.571683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:35.572757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:35.576392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:35.711038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:35.722489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:35.724718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:35.730970 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a006c4f7-fdfc-4b44-961e-b2fbc3bdc295 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.177416 May 19 04:43:35.731906 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1555/3046] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:35 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:43:35.747646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ee07e36e-79a9-4b8f-ad15-2e573350f0d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:35.751422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ee07e36e-79a9-4b8f-ad15-2e573350f0d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:35.771110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-626ff5ed-d467-4be4-8682-70a9f7e49918 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:35.778471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee07e36e-79a9-4b8f-ad15-2e573350f0d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:35.779768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee07e36e-79a9-4b8f-ad15-2e573350f0d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:35.781336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee07e36e-79a9-4b8f-ad15-2e573350f0d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:35.782508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee07e36e-79a9-4b8f-ad15-2e573350f0d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:35.782847 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-626ff5ed-d467-4be4-8682-70a9f7e49918 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.373718 May 19 04:43:35.786275 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1492/3047] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:35 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:36.058456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ee07e36e-79a9-4b8f-ad15-2e573350f0d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:36.081134 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ee07e36e-79a9-4b8f-ad15-2e573350f0d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.333536 May 19 04:43:36.091073 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1556/3048] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:35 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:36.144247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f922aca0-153b-4d9f-a96e-5d14580e7927 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:36.144712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f922aca0-153b-4d9f-a96e-5d14580e7927 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:36.163970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f922aca0-153b-4d9f-a96e-5d14580e7927 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:36.164567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f922aca0-153b-4d9f-a96e-5d14580e7927 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:36.165863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f922aca0-153b-4d9f-a96e-5d14580e7927 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:36.166600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f922aca0-153b-4d9f-a96e-5d14580e7927 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:36.476814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f922aca0-153b-4d9f-a96e-5d14580e7927 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:36.494479 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f922aca0-153b-4d9f-a96e-5d14580e7927 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.361254 May 19 04:43:36.495567 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1493/3049] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:36 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:36.756089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:36.757898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:36.767620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:36.768889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:36.771239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:36.771951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:36.807104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40732c07-e1d1-414d-bf92-c28de8870ca7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:36.808370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-40732c07-e1d1-414d-bf92-c28de8870ca7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:36.826172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40732c07-e1d1-414d-bf92-c28de8870ca7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:36.828507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40732c07-e1d1-414d-bf92-c28de8870ca7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:36.830200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40732c07-e1d1-414d-bf92-c28de8870ca7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:36.831335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40732c07-e1d1-414d-bf92-c28de8870ca7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:36.951975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:36.965013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:36.975979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:36.977285 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e4828c23-fde4-4309-bf9f-c4cf4ff2e5aa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.228882 May 19 04:43:36.989110 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1557/3050] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:36 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:37.097957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-20217271-1f59-4647-bf7f-246814cc99ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:37.098913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-20217271-1f59-4647-bf7f-246814cc99ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:37.110356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20217271-1f59-4647-bf7f-246814cc99ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:37.111058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20217271-1f59-4647-bf7f-246814cc99ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:37.112028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20217271-1f59-4647-bf7f-246814cc99ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:37.115507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20217271-1f59-4647-bf7f-246814cc99ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:37.115677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-40732c07-e1d1-414d-bf92-c28de8870ca7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:37.127468 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-40732c07-e1d1-414d-bf92-c28de8870ca7 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.327813 May 19 04:43:37.128519 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1494/3051] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:36 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:37.356473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-20217271-1f59-4647-bf7f-246814cc99ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:37.365199 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-20217271-1f59-4647-bf7f-246814cc99ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.271074 May 19 04:43:37.366338 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1558/3052] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:37 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:37.516020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6116ed1b-74db-4c38-ba31-3e0686507e7d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:37.516824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6116ed1b-74db-4c38-ba31-3e0686507e7d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:37.531130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6116ed1b-74db-4c38-ba31-3e0686507e7d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:37.532220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6116ed1b-74db-4c38-ba31-3e0686507e7d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:37.533428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6116ed1b-74db-4c38-ba31-3e0686507e7d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:37.534107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6116ed1b-74db-4c38-ba31-3e0686507e7d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:37.760608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6116ed1b-74db-4c38-ba31-3e0686507e7d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:37.769837 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6116ed1b-74db-4c38-ba31-3e0686507e7d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.258500 May 19 04:43:37.785481 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1495/3053] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:37 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:38.001550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:38.002174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:38.020361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:38.021369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:38.022785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:38.024374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:38.134711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:38.148378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dbbdb8e9-6df0-401a-9ec5-9fb785a2676e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:38.149313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dbbdb8e9-6df0-401a-9ec5-9fb785a2676e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:38.151015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:38.154139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:38.156387 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-07e37ec7-04b2-4446-a2f3-615e506545b1 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.161401 May 19 04:43:38.156571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbbdb8e9-6df0-401a-9ec5-9fb785a2676e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:38.157612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbbdb8e9-6df0-401a-9ec5-9fb785a2676e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:38.158563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbbdb8e9-6df0-401a-9ec5-9fb785a2676e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:38.159427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbbdb8e9-6df0-401a-9ec5-9fb785a2676e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:38.165856 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1559/3054] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:37 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:38.383473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dbbdb8e9-6df0-401a-9ec5-9fb785a2676e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:38.386687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f900368d-1e63-422b-88d4-5bffbc3038ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:38.387775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f900368d-1e63-422b-88d4-5bffbc3038ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:38.398857 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dbbdb8e9-6df0-401a-9ec5-9fb785a2676e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.254623 May 19 04:43:38.403724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f900368d-1e63-422b-88d4-5bffbc3038ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:38.407707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f900368d-1e63-422b-88d4-5bffbc3038ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:38.411140 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1496/3055] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:38 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:38.416378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f900368d-1e63-422b-88d4-5bffbc3038ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:38.416978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f900368d-1e63-422b-88d4-5bffbc3038ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:38.645573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f900368d-1e63-422b-88d4-5bffbc3038ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:38.659869 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f900368d-1e63-422b-88d4-5bffbc3038ff tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.280574 May 19 04:43:38.685458 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1560/3056] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:38 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:38.793124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4f890465-c820-4f8a-9501-ee1791dcca6c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:38.794512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4f890465-c820-4f8a-9501-ee1791dcca6c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:38.802614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f890465-c820-4f8a-9501-ee1791dcca6c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:38.803587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f890465-c820-4f8a-9501-ee1791dcca6c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:38.804586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f890465-c820-4f8a-9501-ee1791dcca6c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:38.805250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f890465-c820-4f8a-9501-ee1791dcca6c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:38.812549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:38.996388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4f890465-c820-4f8a-9501-ee1791dcca6c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:39.013450 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4f890465-c820-4f8a-9501-ee1791dcca6c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.226741 May 19 04:43:39.014055 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1497/3057] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:38 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:39.181522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:39.182656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:39.195932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:39.197959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:39.202647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:39.203399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:39.339966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:39.363727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:39.365867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:39.367354 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1ed428b2-eff2-457f-8133-80bb6997eedd tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.191750 May 19 04:43:39.368605 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1561/3058] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:39 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:39.418302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6dc1a0b8-54e9-44bb-8be5-f51f3039743d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:39.419690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6dc1a0b8-54e9-44bb-8be5-f51f3039743d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:39.431940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dc1a0b8-54e9-44bb-8be5-f51f3039743d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:39.433680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dc1a0b8-54e9-44bb-8be5-f51f3039743d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:39.435908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dc1a0b8-54e9-44bb-8be5-f51f3039743d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:39.436366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dc1a0b8-54e9-44bb-8be5-f51f3039743d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:39.661747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6dc1a0b8-54e9-44bb-8be5-f51f3039743d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:39.670921 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6dc1a0b8-54e9-44bb-8be5-f51f3039743d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1524 microversion: 2.1 time: 0.257257 May 19 04:43:39.671974 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1498/3059] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:39 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1524 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:39.678543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51f98042-ce15-4bcc-97bd-ab60624c0920 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:39.679319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-51f98042-ce15-4bcc-97bd-ab60624c0920 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:39.686273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51f98042-ce15-4bcc-97bd-ab60624c0920 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:39.687123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51f98042-ce15-4bcc-97bd-ab60624c0920 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:39.688145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51f98042-ce15-4bcc-97bd-ab60624c0920 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:39.688739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51f98042-ce15-4bcc-97bd-ab60624c0920 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:39.891424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-51f98042-ce15-4bcc-97bd-ab60624c0920 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:39.900814 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51f98042-ce15-4bcc-97bd-ab60624c0920 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.226574 May 19 04:43:39.912857 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1562/3060] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:39 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:40.035773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c619ccc-4411-4801-a47a-5bb1ae209e9a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:40.036734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c619ccc-4411-4801-a47a-5bb1ae209e9a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:40.044024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c619ccc-4411-4801-a47a-5bb1ae209e9a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:40.044715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c619ccc-4411-4801-a47a-5bb1ae209e9a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:40.045847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c619ccc-4411-4801-a47a-5bb1ae209e9a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:40.046384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c619ccc-4411-4801-a47a-5bb1ae209e9a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:40.234398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c619ccc-4411-4801-a47a-5bb1ae209e9a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:40.253293 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c619ccc-4411-4801-a47a-5bb1ae209e9a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.223150 May 19 04:43:40.256722 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1499/3061] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:40 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:40.386895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:40.388945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:40.396332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:40.396794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:40.397601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:40.398048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:40.488542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:40.503848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:40.507051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:40.508487 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7086ed18-54b9-4cb6-9a95-6eb29aed468a tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.125946 May 19 04:43:40.509318 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1563/3062] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:40 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:40.693698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-73057489-6c21-4150-8691-11bf48e2a7ae tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:40.694326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-73057489-6c21-4150-8691-11bf48e2a7ae tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:40.701199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73057489-6c21-4150-8691-11bf48e2a7ae tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:40.701620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73057489-6c21-4150-8691-11bf48e2a7ae tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:40.702429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73057489-6c21-4150-8691-11bf48e2a7ae tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:40.702842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73057489-6c21-4150-8691-11bf48e2a7ae tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:40.919271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-419187ae-5036-4b24-8215-914c84cd9466 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:40.919906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-419187ae-5036-4b24-8215-914c84cd9466 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:40.931909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-419187ae-5036-4b24-8215-914c84cd9466 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:40.932522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-419187ae-5036-4b24-8215-914c84cd9466 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:40.933629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-419187ae-5036-4b24-8215-914c84cd9466 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:40.935191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-419187ae-5036-4b24-8215-914c84cd9466 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:41.042464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-73057489-6c21-4150-8691-11bf48e2a7ae tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:41.053943 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-73057489-6c21-4150-8691-11bf48e2a7ae tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1506 microversion: 2.1 time: 0.363673 May 19 04:43:41.054742 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1500/3063] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:40 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:41.186288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-419187ae-5036-4b24-8215-914c84cd9466 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:41.208075 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-419187ae-5036-4b24-8215-914c84cd9466 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.290928 May 19 04:43:41.213836 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1564/3064] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:40 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:41.274935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-341376e6-a539-4184-bfc6-ceba36bad44b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:41.275819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-341376e6-a539-4184-bfc6-ceba36bad44b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:41.282962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-341376e6-a539-4184-bfc6-ceba36bad44b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:41.283706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-341376e6-a539-4184-bfc6-ceba36bad44b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:41.284708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-341376e6-a539-4184-bfc6-ceba36bad44b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:41.285298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-341376e6-a539-4184-bfc6-ceba36bad44b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:41.466753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-341376e6-a539-4184-bfc6-ceba36bad44b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:41.477293 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-341376e6-a539-4184-bfc6-ceba36bad44b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.207061 May 19 04:43:41.478132 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1501/3065] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:41 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:41.529456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:41.530440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:41.538335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:41.539052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:41.540449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:41.541238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:41.626208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:41.643925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:41.651814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:41.654012 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14cd81a6-3f9d-424b-8629-f9dc38c4f277 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.129061 May 19 04:43:41.655342 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1565/3066] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:41 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:43:42.071769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d599625-af6e-4653-b07e-c3a28f6065c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:42.072460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d599625-af6e-4653-b07e-c3a28f6065c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:42.081451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d599625-af6e-4653-b07e-c3a28f6065c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:42.081915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d599625-af6e-4653-b07e-c3a28f6065c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:42.082801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d599625-af6e-4653-b07e-c3a28f6065c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:42.083275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d599625-af6e-4653-b07e-c3a28f6065c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:42.227696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72c29c0e-f887-4c81-894f-42fdb5115c3f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:42.228332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72c29c0e-f887-4c81-894f-42fdb5115c3f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:42.236660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72c29c0e-f887-4c81-894f-42fdb5115c3f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:42.236982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72c29c0e-f887-4c81-894f-42fdb5115c3f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:42.238232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72c29c0e-f887-4c81-894f-42fdb5115c3f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:42.239505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72c29c0e-f887-4c81-894f-42fdb5115c3f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:42.287471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6d599625-af6e-4653-b07e-c3a28f6065c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:42.297413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d599625-af6e-4653-b07e-c3a28f6065c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1506 microversion: 2.1 time: 0.229507 May 19 04:43:42.298140 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1502/3067] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:42 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:42.443873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-72c29c0e-f887-4c81-894f-42fdb5115c3f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:42.462325 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72c29c0e-f887-4c81-894f-42fdb5115c3f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.240112 May 19 04:43:42.473488 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1566/3068] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:42 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:42.495337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afb1d8cc-c999-475f-96fa-47c8fcd6b33b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:42.496146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-afb1d8cc-c999-475f-96fa-47c8fcd6b33b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:42.504824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afb1d8cc-c999-475f-96fa-47c8fcd6b33b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:42.505506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afb1d8cc-c999-475f-96fa-47c8fcd6b33b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:42.506656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afb1d8cc-c999-475f-96fa-47c8fcd6b33b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:42.507705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afb1d8cc-c999-475f-96fa-47c8fcd6b33b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:42.673523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:42.675232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:42.678466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afb1d8cc-c999-475f-96fa-47c8fcd6b33b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:42.683254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:42.683557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:42.686194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:42.686624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:42.688191 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afb1d8cc-c999-475f-96fa-47c8fcd6b33b tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.197625 May 19 04:43:42.689369 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1503/3069] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:42 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:42.761030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:42.771098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:42.772597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:42.773851 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3cc6ec4b-0205-4c97-aa85-cd3442349931 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.104761 May 19 04:43:42.775191 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1567/3070] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:42 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:43:43.315948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e40e247-2dbc-488f-898f-c6f63a5d969d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:43.317278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e40e247-2dbc-488f-898f-c6f63a5d969d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:43.340366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e40e247-2dbc-488f-898f-c6f63a5d969d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.341268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e40e247-2dbc-488f-898f-c6f63a5d969d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:43.342282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e40e247-2dbc-488f-898f-c6f63a5d969d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.342730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e40e247-2dbc-488f-898f-c6f63a5d969d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:43.482823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9fe075d6-32ca-45ab-a736-371900c5e215 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:43.483373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9fe075d6-32ca-45ab-a736-371900c5e215 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:43.491147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fe075d6-32ca-45ab-a736-371900c5e215 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.492169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fe075d6-32ca-45ab-a736-371900c5e215 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:43.493114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fe075d6-32ca-45ab-a736-371900c5e215 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.493785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fe075d6-32ca-45ab-a736-371900c5e215 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:43.498503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:43.503391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e40e247-2dbc-488f-898f-c6f63a5d969d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:43.512109 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e40e247-2dbc-488f-898f-c6f63a5d969d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 200 len: 1449 microversion: 2.1 time: 0.200056 May 19 04:43:43.513017 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1504/3071] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:43 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 1449 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:43.529588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:43.530403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:43.537589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.538550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:43.539680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.540367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:43.570304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:43:43.579597 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.compute.api [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Working on deleting snapshot 7f330d82-e004-4d67-96a2-5897258f61d9 from shelved instance... May 19 04:43:43.671119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9fe075d6-32ca-45ab-a736-371900c5e215 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:43.680906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9fe075d6-32ca-45ab-a736-371900c5e215 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.202114 May 19 04:43:43.694503 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1568/3072] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:43 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:43.710562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b07b7e1-4a88-4b3f-befe-40662c36c7f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:43.711539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b07b7e1-4a88-4b3f-befe-40662c36c7f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:43.721344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b07b7e1-4a88-4b3f-befe-40662c36c7f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.722471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b07b7e1-4a88-4b3f-befe-40662c36c7f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:43.724093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b07b7e1-4a88-4b3f-befe-40662c36c7f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.725107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b07b7e1-4a88-4b3f-befe-40662c36c7f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:43.911115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0b07b7e1-4a88-4b3f-befe-40662c36c7f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:43.925788 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b07b7e1-4a88-4b3f-befe-40662c36c7f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.223040 May 19 04:43:43.927145 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1569/3073] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:43 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:43.932294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:43.933045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:43.942675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.943736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:43.944931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:43.946167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:44.032135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:44.043942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:44.046115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:44.047458 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-31cdaced-ce02-402f-891b-aa982eafc9ed tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.118880 May 19 04:43:44.048023 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1570/3074] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:43 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:44.439258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Doing local delete in cell c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) {{(pid=124819) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 19 04:43:44.440291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:44.440871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:44.441492 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.compute.api [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 19 04:43:44.446315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] deallocate_for_instance() {{(pid=124819) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 19 04:43:44.699300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f7c7887-8148-4e86-85cd-7b9e9b179662 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:44.700574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5f7c7887-8148-4e86-85cd-7b9e9b179662 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:44.710236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f7c7887-8148-4e86-85cd-7b9e9b179662 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:44.710948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f7c7887-8148-4e86-85cd-7b9e9b179662 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:44.711877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f7c7887-8148-4e86-85cd-7b9e9b179662 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:44.712618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f7c7887-8148-4e86-85cd-7b9e9b179662 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:45.249839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5f7c7887-8148-4e86-85cd-7b9e9b179662 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:45.263646 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5f7c7887-8148-4e86-85cd-7b9e9b179662 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1542 microversion: 2.1 time: 0.567416 May 19 04:43:45.264975 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1571/3075] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:44 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1542 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:45.271523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-d89b91b1-b0c7-486e-b769-f019dab01575 req-ec96949b-9e7d-42b0-a776-0218ef907e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8", "name": "network-vif-unplugged", "status": "completed", "tag": "f9523cc7-bde6-44b3-8939-9aed1c4a8353"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:45.276503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=98 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:45.286940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d89b91b1-b0c7-486e-b769-f019dab01575 req-ec96949b-9e7d-42b0-a776-0218ef907e20 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:45.287928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d89b91b1-b0c7-486e-b769-f019dab01575 req-ec96949b-9e7d-42b0-a776-0218ef907e20 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:45.319061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.compute.server_external_events [req-d89b91b1-b0c7-486e-b769-f019dab01575 req-ec96949b-9e7d-42b0-a776-0218ef907e20 service nova] Unable to find a host for instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8. Dropping event network-vif-unplugged {{(pid=124818) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 04:43:45.326388 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-d89b91b1-b0c7-486e-b769-f019dab01575 req-ec96949b-9e7d-42b0-a776-0218ef907e20 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060039 May 19 04:43:45.329031 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1572/3076] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 04:43:45.336680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a9ae131-7fcc-4607-90e8-079017293dc3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:45.339009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a9ae131-7fcc-4607-90e8-079017293dc3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:45.346805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a9ae131-7fcc-4607-90e8-079017293dc3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:45.347530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a9ae131-7fcc-4607-90e8-079017293dc3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:45.349515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a9ae131-7fcc-4607-90e8-079017293dc3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:45.350112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a9ae131-7fcc-4607-90e8-079017293dc3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:45.402408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Updating instance_info_cache with network_info: [] {{(pid=124819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:43:45.586046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a9ae131-7fcc-4607-90e8-079017293dc3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:45.596054 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a9ae131-7fcc-4607-90e8-079017293dc3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.263987 May 19 04:43:45.598113 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1573/3077] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:45 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:45.606430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:45.607242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:45.614344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:45.615174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:45.616480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:45.617370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:45.696710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:45.707497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:45.710181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:45.711681 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-282f1fcf-1deb-4a4f-9e04-78098b2ba7fa tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.111362 May 19 04:43:45.712738 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1574/3078] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:45 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:45.717919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-31d996e9-3886-4e06-ac44-48874976c69d req-de280aaf-d531-4925-8d9c-07e81103f3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8", "name": "network-vif-deleted", "tag": "f9523cc7-bde6-44b3-8939-9aed1c4a8353"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:45.728742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-31d996e9-3886-4e06-ac44-48874976c69d req-de280aaf-d531-4925-8d9c-07e81103f3f4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:45.729357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-31d996e9-3886-4e06-ac44-48874976c69d req-de280aaf-d531-4925-8d9c-07e81103f3f4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:45.742758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.compute.server_external_events [req-31d996e9-3886-4e06-ac44-48874976c69d req-de280aaf-d531-4925-8d9c-07e81103f3f4 service nova] Unable to find a host for instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8. Dropping event network-vif-deleted {{(pid=124818) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 04:43:45.744029 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-31d996e9-3886-4e06-ac44-48874976c69d req-de280aaf-d531-4925-8d9c-07e81103f3f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029843 May 19 04:43:45.745498 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1575/3079] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 04:43:45.933570 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-89c217cf-ce22-472c-89bc-39f618d2f0b6 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 204 len: 0 microversion: 2.1 time: 2.407726 May 19 04:43:45.937857 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1505/3080] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:43:43 2022] DELETE /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 0 bytes in 2410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:43:45.944024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:45.945408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:45.953025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:45.953748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:45.954989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:45.955767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:45.984618 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 HTTP/1.1 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8'} May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:45.987740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:45.992580 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:45.992580 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:45.992580 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:45.992580 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:45.992580 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:45.992580 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:43:45.992580 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:45.994417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:45.996383 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-54c74303-99f8-4fcf-8f35-3b06e78b70e2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 404 len: 111 microversion: 2.1 time: 0.056415 May 19 04:43:45.997470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1576/3081] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:45 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:43:46.180243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1268888229", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "56a7f773-0e0a-4675-b687-c0077a456785"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:46.267216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] validate_networks() for [('56a7f773-0e0a-4675-b687-c0077a456785', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:43:46.283153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8338ff7-3c38-4f3b-8924-345b66499559 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:46.284254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8338ff7-3c38-4f3b-8924-345b66499559 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:46.292482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8338ff7-3c38-4f3b-8924-345b66499559 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:46.293224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8338ff7-3c38-4f3b-8924-345b66499559 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:46.294145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8338ff7-3c38-4f3b-8924-345b66499559 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:46.294732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8338ff7-3c38-4f3b-8924-345b66499559 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:46.605382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8338ff7-3c38-4f3b-8924-345b66499559 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:46.626220 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8338ff7-3c38-4f3b-8924-345b66499559 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1541 microversion: 2.1 time: 0.348219 May 19 04:43:46.627505 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1577/3082] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:46 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1541 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:46.634412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f42fbbbb-2a1b-4fe1-bd73-0c6dc210ab7e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:46.635372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f42fbbbb-2a1b-4fe1-bd73-0c6dc210ab7e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:46.644045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f42fbbbb-2a1b-4fe1-bd73-0c6dc210ab7e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:46.645632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f42fbbbb-2a1b-4fe1-bd73-0c6dc210ab7e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:46.646902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f42fbbbb-2a1b-4fe1-bd73-0c6dc210ab7e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:46.647806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f42fbbbb-2a1b-4fe1-bd73-0c6dc210ab7e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:47.014679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f42fbbbb-2a1b-4fe1-bd73-0c6dc210ab7e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:47.025611 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f42fbbbb-2a1b-4fe1-bd73-0c6dc210ab7e tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.394559 May 19 04:43:47.026463 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1578/3083] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:46 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:47.041028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:47.041770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:47.049590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:47.050286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:47.052307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:47.053088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:47.169521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:47.187951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:47.190235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:47.192830 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-757f7bfb-b229-4598-baa1-fdfdd5a195c8 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.160482 May 19 04:43:47.195764 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1579/3084] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:47 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:47.248952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:43:47.249995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:43:47.251219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:43:47.251813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:43:47.252709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:43:47.272089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:47.273345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:47.274327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:47.274963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:47.298281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:43:47.319329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for user 1e14ea8dad314974bf5f4e8e51b88349 and project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:43:47.361971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:43:47.364668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:43:47.471403 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e1cbaa47-0b4b-49e9-be6f-b1c370eeef0e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297162 May 19 04:43:47.477629 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1506/3085] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:43:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:43:47.483590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-797f47ab-bbbc-4fe8-987c-53753ba3a2ec tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:47.485359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-797f47ab-bbbc-4fe8-987c-53753ba3a2ec tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:47.579907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-797f47ab-bbbc-4fe8-987c-53753ba3a2ec tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:47.588372 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-797f47ab-bbbc-4fe8-987c-53753ba3a2ec tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1215 microversion: 2.1 time: 0.109811 May 19 04:43:47.592309 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1580/3086] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:47 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:47.644780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74d994ab-886d-46f0-a333-05ad97f59a3c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:47.646178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74d994ab-886d-46f0-a333-05ad97f59a3c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:47.654673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74d994ab-886d-46f0-a333-05ad97f59a3c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:47.655634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74d994ab-886d-46f0-a333-05ad97f59a3c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:47.657602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74d994ab-886d-46f0-a333-05ad97f59a3c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:47.659285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74d994ab-886d-46f0-a333-05ad97f59a3c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:47.780628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c7db9688-1948-4cef-9e76-ce00d92b544c req-407e1989-c4b6-4aed-9b24-7d2dd3a0c4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd7e64-3246-40ea-844d-5e88603a9e20", "name": "network-vif-unplugged", "status": "completed", "tag": "60433ce3-7f6a-48fa-9b49-9f65b436fd14"}, {"name": "network-changed", "server_uuid": "98bd7e64-3246-40ea-844d-5e88603a9e20", "tag": "60433ce3-7f6a-48fa-9b49-9f65b436fd14"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:47.795906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c7db9688-1948-4cef-9e76-ce00d92b544c req-407e1989-c4b6-4aed-9b24-7d2dd3a0c4bd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:47.797367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c7db9688-1948-4cef-9e76-ce00d92b544c req-407e1989-c4b6-4aed-9b24-7d2dd3a0c4bd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:47.811807 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c7db9688-1948-4cef-9e76-ce00d92b544c req-407e1989-c4b6-4aed-9b24-7d2dd3a0c4bd service nova] Creating event network-vif-unplugged:60433ce3-7f6a-48fa-9b49-9f65b436fd14 for instance 98bd7e64-3246-40ea-844d-5e88603a9e20 on n-h1-766726-30 May 19 04:43:47.812604 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c7db9688-1948-4cef-9e76-ce00d92b544c req-407e1989-c4b6-4aed-9b24-7d2dd3a0c4bd service nova] Creating event network-changed:60433ce3-7f6a-48fa-9b49-9f65b436fd14 for instance 98bd7e64-3246-40ea-844d-5e88603a9e20 on n-h1-766726-30 May 19 04:43:47.820001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-c7db9688-1948-4cef-9e76-ce00d92b544c req-407e1989-c4b6-4aed-9b24-7d2dd3a0c4bd service nova] Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:43:47.834366 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c7db9688-1948-4cef-9e76-ce00d92b544c req-407e1989-c4b6-4aed-9b24-7d2dd3a0c4bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.057055 May 19 04:43:47.835862 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1581/3087] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:43:47.895696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74d994ab-886d-46f0-a333-05ad97f59a3c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:47.905985 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74d994ab-886d-46f0-a333-05ad97f59a3c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1541 microversion: 2.1 time: 0.265338 May 19 04:43:47.917615 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1507/3088] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:47 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1541 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:48.053357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4e39515-99d6-4bba-920b-bbf98d228006 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:48.056642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c4e39515-99d6-4bba-920b-bbf98d228006 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:48.070977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4e39515-99d6-4bba-920b-bbf98d228006 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:48.072833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4e39515-99d6-4bba-920b-bbf98d228006 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:48.074069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4e39515-99d6-4bba-920b-bbf98d228006 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:48.074741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4e39515-99d6-4bba-920b-bbf98d228006 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:48.213733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:48.214513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:48.233093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:48.233688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:48.234578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:48.235123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:48.239981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:48.476826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:48.492854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:48.495536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:48.498143 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd92985a-5a85-4e6a-9bd9-81200fa5f65b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.287967 May 19 04:43:48.499909 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1508/3089] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:48 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:48.602549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c4e39515-99d6-4bba-920b-bbf98d228006 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:48.607741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e84751e5-67c0-4b0e-ab47-16857652dfe8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:48.608473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e84751e5-67c0-4b0e-ab47-16857652dfe8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:48.613249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c4e39515-99d6-4bba-920b-bbf98d228006 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.572378 May 19 04:43:48.614356 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1582/3090] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:48 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:48.617809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e84751e5-67c0-4b0e-ab47-16857652dfe8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:48.625653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e84751e5-67c0-4b0e-ab47-16857652dfe8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:48.626960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e84751e5-67c0-4b0e-ab47-16857652dfe8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:48.627583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e84751e5-67c0-4b0e-ab47-16857652dfe8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:48.823568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e84751e5-67c0-4b0e-ab47-16857652dfe8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:48.832148 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e84751e5-67c0-4b0e-ab47-16857652dfe8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1267 microversion: 2.1 time: 0.228122 May 19 04:43:48.837445 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1509/3091] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:48 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:48.924989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b2aa6a6-6833-4203-bcb5-1114dbc9e194 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:48.926711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8b2aa6a6-6833-4203-bcb5-1114dbc9e194 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:48.936001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b2aa6a6-6833-4203-bcb5-1114dbc9e194 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:48.936814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b2aa6a6-6833-4203-bcb5-1114dbc9e194 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:48.940502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b2aa6a6-6833-4203-bcb5-1114dbc9e194 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:48.941063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b2aa6a6-6833-4203-bcb5-1114dbc9e194 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.099304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8b2aa6a6-6833-4203-bcb5-1114dbc9e194 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:49.107680 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b2aa6a6-6833-4203-bcb5-1114dbc9e194 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1473 microversion: 2.1 time: 0.187160 May 19 04:43:49.112594 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1583/3092] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:48 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1473 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:49.151330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35731db9-dda0-4746-a17c-9686ba8352b0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:49.152228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-35731db9-dda0-4746-a17c-9686ba8352b0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:49.158841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35731db9-dda0-4746-a17c-9686ba8352b0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.159297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35731db9-dda0-4746-a17c-9686ba8352b0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.160841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35731db9-dda0-4746-a17c-9686ba8352b0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.161324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35731db9-dda0-4746-a17c-9686ba8352b0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.185168 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-35731db9-dda0-4746-a17c-9686ba8352b0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256/ips" status: 200 len: 148 microversion: 2.1 time: 0.037710 May 19 04:43:49.185751 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1510/3093] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:43:49 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:49.196514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f068977-283f-4d29-9a22-e9f699264655"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:49.197735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:49.203958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.204416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.205221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.205669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.294177 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Invalid volume: volume 1f068977-283f-4d29-9a22-e9f699264655 is already attached to instances: 7e865dff-7659-43e8-8069-81e6760080d7 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256/os-volume_attachments HTTP/1.1 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 74 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: {"volumeAttachment": {"volumeId": "1f068977-283f-4d29-9a22-e9f699264655"}} May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid volume: volume 1f068977-283f-4d29-9a22-e9f699264655 is already attached to instances: 7e865dff-7659-43e8-8069-81e6760080d7 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'server_id': '71c25126-57dc-4b2f-b1d8-93980536a256', 'body': {'volumeAttachment': {'volumeId': '1f068977-283f-4d29-9a22-e9f699264655'}}} May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1f068977-283f-4d29-9a22-e9f699264655 is already attached to instances: 7e865dff-7659-43e8-8069-81e6760080d7 May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:43:49.297062 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1f068977-283f-4d29-9a22-e9f699264655 is already attached to instances: 7e865dff-7659-43e8-8069-81e6760080d7 May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1f068977-283f-4d29-9a22-e9f699264655 is already attached to instances: 7e865dff-7659-43e8-8069-81e6760080d7 May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 400 to user: Invalid volume: volume 1f068977-283f-4d29-9a22-e9f699264655 is already attached to instances: 7e865dff-7659-43e8-8069-81e6760080d7 {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:49.300928 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b4331dc3-8f35-49ad-99e1-2d81fd7a3acb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106135 May 19 04:43:49.303620 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1584/3094] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:43:49 2022] POST /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:43:49.308863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa0b5c43-acff-4c9d-acd7-0b551ca9dafe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:49.309445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa0b5c43-acff-4c9d-acd7-0b551ca9dafe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:49.316788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa0b5c43-acff-4c9d-acd7-0b551ca9dafe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.317539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa0b5c43-acff-4c9d-acd7-0b551ca9dafe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.318489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa0b5c43-acff-4c9d-acd7-0b551ca9dafe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.319082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa0b5c43-acff-4c9d-acd7-0b551ca9dafe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.352221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa0b5c43-acff-4c9d-acd7-0b551ca9dafe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:43:49.446254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fa0b5c43-acff-4c9d-acd7-0b551ca9dafe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 204 len: 0 microversion: 2.1 time: 0.140000 May 19 04:43:49.447337 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1511/3095] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:43:49 2022] DELETE /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:43:49.459038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bde89d3-ff8e-4315-b8fd-4957b9681391 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:49.459909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4bde89d3-ff8e-4315-b8fd-4957b9681391 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:49.468271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bde89d3-ff8e-4315-b8fd-4957b9681391 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.468958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bde89d3-ff8e-4315-b8fd-4957b9681391 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.469943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bde89d3-ff8e-4315-b8fd-4957b9681391 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.470581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bde89d3-ff8e-4315-b8fd-4957b9681391 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.520438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:49.521958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:49.531196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.531676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.534412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.534855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.651729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:49.668177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:49.669746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:49.673519 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a6789c4a-6375-4f1e-8409-2df4fc60a62b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.158858 May 19 04:43:49.674278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4bde89d3-ff8e-4315-b8fd-4957b9681391 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:49.684070 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4bde89d3-ff8e-4315-b8fd-4957b9681391 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1676 microversion: 2.1 time: 0.231438 May 19 04:43:49.695290 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1512/3096] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:49 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:49.695495 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1585/3097] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:49 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:49.696788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fff00ac4-25c8-42a4-9084-8b68d0881745 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:49.696788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fff00ac4-25c8-42a4-9084-8b68d0881745 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:49.701401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fff00ac4-25c8-42a4-9084-8b68d0881745 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.702063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fff00ac4-25c8-42a4-9084-8b68d0881745 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.703092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fff00ac4-25c8-42a4-9084-8b68d0881745 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.704745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fff00ac4-25c8-42a4-9084-8b68d0881745 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.856455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6491132a-1cb7-460c-be4a-e6233236ae95 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:49.857202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6491132a-1cb7-460c-be4a-e6233236ae95 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:49.863820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fff00ac4-25c8-42a4-9084-8b68d0881745 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:49.867146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6491132a-1cb7-460c-be4a-e6233236ae95 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.867608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6491132a-1cb7-460c-be4a-e6233236ae95 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.868403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6491132a-1cb7-460c-be4a-e6233236ae95 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:49.868845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6491132a-1cb7-460c-be4a-e6233236ae95 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:49.872819 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fff00ac4-25c8-42a4-9084-8b68d0881745 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.186845 May 19 04:43:49.877489 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1513/3098] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:49 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:49.954157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6491132a-1cb7-460c-be4a-e6233236ae95 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:49.962528 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6491132a-1cb7-460c-be4a-e6233236ae95 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1285 microversion: 2.1 time: 0.111133 May 19 04:43:49.963479 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1586/3099] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:49 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:50.125992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-65934a2f-f2d2-441c-8a1d-44453cb24b2a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:50.126632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-65934a2f-f2d2-441c-8a1d-44453cb24b2a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:50.133260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65934a2f-f2d2-441c-8a1d-44453cb24b2a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:50.134018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65934a2f-f2d2-441c-8a1d-44453cb24b2a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:50.134978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65934a2f-f2d2-441c-8a1d-44453cb24b2a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:50.135725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65934a2f-f2d2-441c-8a1d-44453cb24b2a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:50.342301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-65934a2f-f2d2-441c-8a1d-44453cb24b2a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:50.355542 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-65934a2f-f2d2-441c-8a1d-44453cb24b2a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1473 microversion: 2.1 time: 0.234365 May 19 04:43:50.356179 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1514/3100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:50 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1473 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:50.702909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:50.704588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:50.716635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a9fa0cd-0c28-4cc6-9f59-0ef9c5d108df tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:50.717301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0a9fa0cd-0c28-4cc6-9f59-0ef9c5d108df tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:50.719362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:50.720325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:50.720979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:50.722045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:50.723748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:50.729454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a9fa0cd-0c28-4cc6-9f59-0ef9c5d108df tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:50.729891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a9fa0cd-0c28-4cc6-9f59-0ef9c5d108df tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:50.747844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a9fa0cd-0c28-4cc6-9f59-0ef9c5d108df tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:50.748308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a9fa0cd-0c28-4cc6-9f59-0ef9c5d108df tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:50.960243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:50.974793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:50.977857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:50.979426 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a6b08833-0bec-4b82-a2c7-51f8af6f386b tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.280709 May 19 04:43:50.980432 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1587/3101] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:50 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:51.000463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8f2848c-2aa4-40b4-b05c-3c838e010943 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:51.001506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8f2848c-2aa4-40b4-b05c-3c838e010943 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:51.010903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8f2848c-2aa4-40b4-b05c-3c838e010943 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:51.018456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8f2848c-2aa4-40b4-b05c-3c838e010943 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:51.019729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8f2848c-2aa4-40b4-b05c-3c838e010943 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:51.020490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8f2848c-2aa4-40b4-b05c-3c838e010943 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:51.023998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:51.530600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0a9fa0cd-0c28-4cc6-9f59-0ef9c5d108df tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:51.549010 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0a9fa0cd-0c28-4cc6-9f59-0ef9c5d108df tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1676 microversion: 2.1 time: 0.836672 May 19 04:43:51.554024 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1515/3102] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:50 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1676 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:51.566112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3261d52-5876-4221-a9b9-b6b2608aa2f3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:51.567054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3261d52-5876-4221-a9b9-b6b2608aa2f3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:51.578401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3261d52-5876-4221-a9b9-b6b2608aa2f3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:51.578856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3261d52-5876-4221-a9b9-b6b2608aa2f3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:51.593724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3261d52-5876-4221-a9b9-b6b2608aa2f3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:51.594216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3261d52-5876-4221-a9b9-b6b2608aa2f3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:51.653140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8f2848c-2aa4-40b4-b05c-3c838e010943 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:51.662876 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8f2848c-2aa4-40b4-b05c-3c838e010943 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.680966 May 19 04:43:51.663471 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1588/3103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:50 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:51.668782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5ceb733e-1315-47ff-95f5-b8cb75a3da50 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:51.669702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5ceb733e-1315-47ff-95f5-b8cb75a3da50 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:51.685879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ceb733e-1315-47ff-95f5-b8cb75a3da50 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:51.686816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ceb733e-1315-47ff-95f5-b8cb75a3da50 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:51.688426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ceb733e-1315-47ff-95f5-b8cb75a3da50 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:51.689637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ceb733e-1315-47ff-95f5-b8cb75a3da50 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.523447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5ceb733e-1315-47ff-95f5-b8cb75a3da50 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:52.532157 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5ceb733e-1315-47ff-95f5-b8cb75a3da50 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1470 microversion: 2.1 time: 0.867404 May 19 04:43:52.545015 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1589/3104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:51 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1470 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:52.550482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:52.551958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:52.559144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.559828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.560911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.561533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.589665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3261d52-5876-4221-a9b9-b6b2608aa2f3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:52.601983 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3261d52-5876-4221-a9b9-b6b2608aa2f3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1315 microversion: 2.1 time: 1.045631 May 19 04:43:52.602763 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1516/3105] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:51 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1315 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:52.611897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b6c22f51-4711-4bfe-9515-18cf14d708b5 req-d9cdd04c-2287-4bd9-a874-c332a4a13964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be2c79-a225-4e66-94af-e8c52a84d705", "tag": "953640be-a2f4-4290-bbd9-98d1b6d88589"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:52.622709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b6c22f51-4711-4bfe-9515-18cf14d708b5 req-d9cdd04c-2287-4bd9-a874-c332a4a13964 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.623852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b6c22f51-4711-4bfe-9515-18cf14d708b5 req-d9cdd04c-2287-4bd9-a874-c332a4a13964 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.639300 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b6c22f51-4711-4bfe-9515-18cf14d708b5 req-d9cdd04c-2287-4bd9-a874-c332a4a13964 service nova] Creating event network-changed:953640be-a2f4-4290-bbd9-98d1b6d88589 for instance 59be2c79-a225-4e66-94af-e8c52a84d705 on n-h1-766726-30 May 19 04:43:52.646310 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b6c22f51-4711-4bfe-9515-18cf14d708b5 req-d9cdd04c-2287-4bd9-a874-c332a4a13964 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042077 May 19 04:43:52.647679 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1517/3106] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:52.656066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-62a10e49-dfe7-4063-af71-4bd6cb690e29 req-82e56cea-a50a-4586-a2d1-b3f997d5e0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd7e64-3246-40ea-844d-5e88603a9e20", "name": "network-vif-plugged", "status": "completed", "tag": "60433ce3-7f6a-48fa-9b49-9f65b436fd14"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:52.675379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-62a10e49-dfe7-4063-af71-4bd6cb690e29 req-82e56cea-a50a-4586-a2d1-b3f997d5e0cd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.676753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-62a10e49-dfe7-4063-af71-4bd6cb690e29 req-82e56cea-a50a-4586-a2d1-b3f997d5e0cd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.691336 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-62a10e49-dfe7-4063-af71-4bd6cb690e29 req-82e56cea-a50a-4586-a2d1-b3f997d5e0cd service nova] Creating event network-vif-plugged:60433ce3-7f6a-48fa-9b49-9f65b436fd14 for instance 98bd7e64-3246-40ea-844d-5e88603a9e20 on n-h1-766726-30 May 19 04:43:52.700141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:52.708715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-62a10e49-dfe7-4063-af71-4bd6cb690e29 req-82e56cea-a50a-4586-a2d1-b3f997d5e0cd service nova] Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:43:52.715288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:52.718109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:52.720528 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b3fc9740-8ed3-444d-ae42-2a07e3f8ae52 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.173901 May 19 04:43:52.721914 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1590/3107] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:52 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:52.731590 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-62a10e49-dfe7-4063-af71-4bd6cb690e29 req-82e56cea-a50a-4586-a2d1-b3f997d5e0cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081699 May 19 04:43:52.732431 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1518/3108] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:52.742468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:52.743621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-19ba22fc-ec80-499c-b452-5273d6064db4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:52.743943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:52.746981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-19ba22fc-ec80-499c-b452-5273d6064db4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:52.754517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.755408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.757207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.757984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.762094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19ba22fc-ec80-499c-b452-5273d6064db4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.762600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19ba22fc-ec80-499c-b452-5273d6064db4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.763401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19ba22fc-ec80-499c-b452-5273d6064db4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.763850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19ba22fc-ec80-499c-b452-5273d6064db4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.821606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.822594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.824436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:52.825031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:52.861788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:43:52.871815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for user 55c593b7f2a04b0e820a505e8e8eb521 and project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:43:53.031431 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96dfc899-1baa-45e1-8c62-f65c1cd8e016 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20/action" status: 202 len: 0 microversion: 2.1 time: 0.307187 May 19 04:43:53.032494 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1591/3109] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:43:52 2022] POST /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:43:53.038429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e0da4726-28cc-466f-b676-3a657e6364e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:53.039335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e0da4726-28cc-466f-b676-3a657e6364e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:53.047993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0da4726-28cc-466f-b676-3a657e6364e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:53.048646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0da4726-28cc-466f-b676-3a657e6364e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:53.050344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0da4726-28cc-466f-b676-3a657e6364e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:53.051986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0da4726-28cc-466f-b676-3a657e6364e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:53.384940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-19ba22fc-ec80-499c-b452-5273d6064db4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:53.418233 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-19ba22fc-ec80-499c-b452-5273d6064db4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1676 microversion: 2.1 time: 0.684414 May 19 04:43:53.420711 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1519/3110] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:52 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1676 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:53.447090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c37edb3-18c0-49d0-a86b-3750318be470 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:53.447883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c37edb3-18c0-49d0-a86b-3750318be470 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:53.465526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c37edb3-18c0-49d0-a86b-3750318be470 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:53.466371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c37edb3-18c0-49d0-a86b-3750318be470 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:53.467407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c37edb3-18c0-49d0-a86b-3750318be470 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:53.468060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c37edb3-18c0-49d0-a86b-3750318be470 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:53.486138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e0da4726-28cc-466f-b676-3a657e6364e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:53.498982 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e0da4726-28cc-466f-b676-3a657e6364e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.464015 May 19 04:43:53.500635 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1592/3111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:53 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:53.626322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d41a4dea-eb58-4c19-993f-e5c5ae8a095b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:53.626996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d41a4dea-eb58-4c19-993f-e5c5ae8a095b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:53.648483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d41a4dea-eb58-4c19-993f-e5c5ae8a095b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:53.649709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d41a4dea-eb58-4c19-993f-e5c5ae8a095b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:53.655222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d41a4dea-eb58-4c19-993f-e5c5ae8a095b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:53.655898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d41a4dea-eb58-4c19-993f-e5c5ae8a095b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:53.841022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0c37edb3-18c0-49d0-a86b-3750318be470 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:53.851578 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c37edb3-18c0-49d0-a86b-3750318be470 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1469 microversion: 2.1 time: 0.416228 May 19 04:43:53.861564 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1520/3112] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:53 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1469 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:53.861564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:53.861564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:53.870264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:53.870717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:53.871502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:53.871942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:54.007516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:54.018816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:54.020529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:54.022141 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1786594-5b98-42e5-a3fd-37f29817a8af tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.168628 May 19 04:43:54.048981 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1521/3113] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:53 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:54.075989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d41a4dea-eb58-4c19-993f-e5c5ae8a095b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:54.087355 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d41a4dea-eb58-4c19-993f-e5c5ae8a095b tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1315 microversion: 2.1 time: 0.470775 May 19 04:43:54.088707 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1593/3114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:53 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:54.323717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-531eec76-0c36-4224-a14c-f648e79c88bd req-4f8eb070-b1f0-4679-b60d-db11a68b0206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c25126-57dc-4b2f-b1d8-93980536a256", "name": "network-vif-deleted", "tag": "f1dfd523-b4d9-4a9b-ac07-5b77b712f25c"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:54.338355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-531eec76-0c36-4224-a14c-f648e79c88bd req-4f8eb070-b1f0-4679-b60d-db11a68b0206 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:54.343618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-531eec76-0c36-4224-a14c-f648e79c88bd req-4f8eb070-b1f0-4679-b60d-db11a68b0206 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:54.366915 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-531eec76-0c36-4224-a14c-f648e79c88bd req-4f8eb070-b1f0-4679-b60d-db11a68b0206 service nova] Creating event network-vif-deleted:f1dfd523-b4d9-4a9b-ac07-5b77b712f25c for instance 71c25126-57dc-4b2f-b1d8-93980536a256 on n-h2-766726-30 May 19 04:43:54.386152 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-531eec76-0c36-4224-a14c-f648e79c88bd req-4f8eb070-b1f0-4679-b60d-db11a68b0206 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066065 May 19 04:43:54.389195 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1522/3115] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:54.439974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:54.440601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:54.452114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:54.453482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:54.456149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:54.456575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:54.521347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3faa174c-5476-4fd6-889f-6c46d62dba26 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:54.522391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3faa174c-5476-4fd6-889f-6c46d62dba26 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:54.544733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:54.546303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:54.547285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lazy-loading 'fault' on Instance uuid 71c25126-57dc-4b2f-b1d8-93980536a256 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:43:54.549450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3faa174c-5476-4fd6-889f-6c46d62dba26 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:54.551900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3faa174c-5476-4fd6-889f-6c46d62dba26 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:54.557398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3faa174c-5476-4fd6-889f-6c46d62dba26 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:54.559375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3faa174c-5476-4fd6-889f-6c46d62dba26 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:54.788477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:54.797091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-46915bdf-3e6a-4ad1-851e-1e4227b2ab95 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 200 len: 1329 microversion: 2.1 time: 0.361793 May 19 04:43:54.811119 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1594/3116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:54 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 1329 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:54.868498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5af707e-6eb5-40d1-a96e-d5c7644646d7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:54.869161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5af707e-6eb5-40d1-a96e-d5c7644646d7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:54.881621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5af707e-6eb5-40d1-a96e-d5c7644646d7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:54.882077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5af707e-6eb5-40d1-a96e-d5c7644646d7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:54.882913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5af707e-6eb5-40d1-a96e-d5c7644646d7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:54.883286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5af707e-6eb5-40d1-a96e-d5c7644646d7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.012628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3faa174c-5476-4fd6-889f-6c46d62dba26 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:55.021913 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3faa174c-5476-4fd6-889f-6c46d62dba26 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.507205 May 19 04:43:55.044833 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1523/3117] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:54 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:55.051338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:55.052378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:55.059959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.062095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.063204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.063869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.181256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:55.198039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:55.206255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:55.208074 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aa4153e4-d055-4680-8d80-7e3b930305ee tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.161556 May 19 04:43:55.208874 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1524/3118] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:55 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:55.224165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-361ac66a-c2d4-47a6-a0a2-7c9b7fd9aea0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:55.225178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-361ac66a-c2d4-47a6-a0a2-7c9b7fd9aea0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:55.239244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-361ac66a-c2d4-47a6-a0a2-7c9b7fd9aea0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.239721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-361ac66a-c2d4-47a6-a0a2-7c9b7fd9aea0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.240570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-361ac66a-c2d4-47a6-a0a2-7c9b7fd9aea0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.241007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-361ac66a-c2d4-47a6-a0a2-7c9b7fd9aea0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.266089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:55.712094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5af707e-6eb5-40d1-a96e-d5c7644646d7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:55.724146 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5af707e-6eb5-40d1-a96e-d5c7644646d7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1469 microversion: 2.1 time: 0.859407 May 19 04:43:55.725588 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1595/3119] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:54 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1469 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:55.734610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c88acc1c-2723-4eb3-837f-e10ca7bfbb7f tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:55.753832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c88acc1c-2723-4eb3-837f-e10ca7bfbb7f tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:55.754981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c88acc1c-2723-4eb3-837f-e10ca7bfbb7f tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Searching by: {'deleted': False, 'project_id': 'd3d0917d2e4b4886991ec5c714103799'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:43:55.760960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c88acc1c-2723-4eb3-837f-e10ca7bfbb7f tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.761554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c88acc1c-2723-4eb3-837f-e10ca7bfbb7f tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.764001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c88acc1c-2723-4eb3-837f-e10ca7bfbb7f tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.764524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c88acc1c-2723-4eb3-837f-e10ca7bfbb7f tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.802932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-c88acc1c-2723-4eb3-837f-e10ca7bfbb7f tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:43:55.843037 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c88acc1c-2723-4eb3-837f-e10ca7bfbb7f tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.115596 May 19 04:43:55.844662 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1596/3120] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:43:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:55.855268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-361ac66a-c2d4-47a6-a0a2-7c9b7fd9aea0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:55.856994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:55.857673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:55.864353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.865092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.865964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.866410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.866521 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-361ac66a-c2d4-47a6-a0a2-7c9b7fd9aea0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1315 microversion: 2.1 time: 0.654079 May 19 04:43:55.867005 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1525/3121] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:55 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:55.880648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:55.882089 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 HTTP/1.1 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '71c25126-57dc-4b2f-b1d8-93980536a256'} May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:43:55.884073 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a9e896d9-bdae-480f-b363-fe8c39b81c18 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 404 len: 111 microversion: 2.1 time: 0.039264 May 19 04:43:55.888971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1597/3122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:55 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:43:55.890559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:55.891457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Searching by: {'deleted': False, 'project_id': 'd3d0917d2e4b4886991ec5c714103799'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:43:55.897369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b83b23da-31d5-4160-9865-8f6765c4c5bc tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '.version_select at 0x7fd315ff5310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:55.898020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.898477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.899283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:55.899728 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:55.926502 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b83b23da-31d5-4160-9865-8f6765c4c5bc tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385478761" status: 202 len: 0 microversion: 2.1 time: 0.034651 May 19 04:43:55.927015 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1598/3123] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:43:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385478761 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:43:55.935997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:43:56.038513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:56.046568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.047636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:56.053297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bb72015c-df6c-4085-a47e-cb7ead9812ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:56.053998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bb72015c-df6c-4085-a47e-cb7ead9812ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:56.067216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bb72015c-df6c-4085-a47e-cb7ead9812ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.067672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bb72015c-df6c-4085-a47e-cb7ead9812ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:56.068467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bb72015c-df6c-4085-a47e-cb7ead9812ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.068912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bb72015c-df6c-4085-a47e-cb7ead9812ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:56.448705 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e5186e0e-5845-4a9b-8284-8936b6c93fd7 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.571671 May 19 04:43:56.450006 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1526/3124] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:43:55 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:56.455188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:56.456438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:56.471991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.483381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:56.484482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.485038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:56.861116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bb72015c-df6c-4085-a47e-cb7ead9812ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:56.867910 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bb72015c-df6c-4085-a47e-cb7ead9812ae tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.819867 May 19 04:43:56.873357 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1599/3125] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:56 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:56.881062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad45d7ff-fd0d-4b23-957a-d7eb6b045910 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:56.890495 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad45d7ff-fd0d-4b23-957a-d7eb6b045910 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015033 May 19 04:43:56.891144 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1600/3126] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:43:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:56.893733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:56.899598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-51471045-6d17-4fce-87d1-9c909cd52c55 req-e300bafc-3645-4321-b7c3-3be0139d0da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59be2c79-a225-4e66-94af-e8c52a84d705", "name": "network-vif-plugged", "status": "completed", "tag": "953640be-a2f4-4290-bbd9-98d1b6d88589"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:43:56.908378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:56.910084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:56.911447 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-18c52757-ecc6-41cd-94f5-b1ec7fbffa75 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.460378 May 19 04:43:56.912058 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1527/3127] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:56 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:56.913505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-51471045-6d17-4fce-87d1-9c909cd52c55 req-e300bafc-3645-4321-b7c3-3be0139d0da8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.914193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-51471045-6d17-4fce-87d1-9c909cd52c55 req-e300bafc-3645-4321-b7c3-3be0139d0da8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:56.916516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0e649614-0f98-4fcc-9b0c-3a56ddd73510 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:56.920948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0e649614-0f98-4fcc-9b0c-3a56ddd73510 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:56.927442 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-51471045-6d17-4fce-87d1-9c909cd52c55 req-e300bafc-3645-4321-b7c3-3be0139d0da8 service nova] Creating event network-vif-plugged:953640be-a2f4-4290-bbd9-98d1b6d88589 for instance 59be2c79-a225-4e66-94af-e8c52a84d705 on n-h1-766726-30 May 19 04:43:56.933274 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-51471045-6d17-4fce-87d1-9c909cd52c55 req-e300bafc-3645-4321-b7c3-3be0139d0da8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040419 May 19 04:43:56.933568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e649614-0f98-4fcc-9b0c-3a56ddd73510 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.934029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e649614-0f98-4fcc-9b0c-3a56ddd73510 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:56.934926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e649614-0f98-4fcc-9b0c-3a56ddd73510 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.935531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0e649614-0f98-4fcc-9b0c-3a56ddd73510 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:56.937098 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1601/3128] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:56.942883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e26d3fc-d3a3-4064-ae3f-ab785d4c61c7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:56.943679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7e26d3fc-d3a3-4064-ae3f-ab785d4c61c7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:56.950746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e26d3fc-d3a3-4064-ae3f-ab785d4c61c7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.951401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e26d3fc-d3a3-4064-ae3f-ab785d4c61c7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:56.952341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e26d3fc-d3a3-4064-ae3f-ab785d4c61c7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:56.952945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e26d3fc-d3a3-4064-ae3f-ab785d4c61c7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.045559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-7e26d3fc-d3a3-4064-ae3f-ab785d4c61c7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lazy-loading 'services' on Instance uuid 7e865dff-7659-43e8-8069-81e6760080d7 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:43:57.126817 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e26d3fc-d3a3-4064-ae3f-ab785d4c61c7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments/1f068977-283f-4d29-9a22-e9f699264655" status: 202 len: 0 microversion: 2.1 time: 0.188136 May 19 04:43:57.127832 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1602/3129] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 04:43:56 2022] DELETE /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments/1f068977-283f-4d29-9a22-e9f699264655 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:43:57.134658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d4449bf-c5dc-4ece-87dd-8d318ffd5790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:57.136039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d4449bf-c5dc-4ece-87dd-8d318ffd5790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:57.143238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d4449bf-c5dc-4ece-87dd-8d318ffd5790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.144104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d4449bf-c5dc-4ece-87dd-8d318ffd5790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.146018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d4449bf-c5dc-4ece-87dd-8d318ffd5790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.146526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d4449bf-c5dc-4ece-87dd-8d318ffd5790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.167331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0e649614-0f98-4fcc-9b0c-3a56ddd73510 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:57.181656 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0e649614-0f98-4fcc-9b0c-3a56ddd73510 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1469 microversion: 2.1 time: 0.268341 May 19 04:43:57.182973 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1528/3130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:56 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:57.197429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00caba68-e5c2-473a-ad3d-bd4334e42f48 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:57.198498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00caba68-e5c2-473a-ad3d-bd4334e42f48 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:57.204810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00caba68-e5c2-473a-ad3d-bd4334e42f48 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.205395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00caba68-e5c2-473a-ad3d-bd4334e42f48 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.206244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00caba68-e5c2-473a-ad3d-bd4334e42f48 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.206901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00caba68-e5c2-473a-ad3d-bd4334e42f48 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.237392 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00caba68-e5c2-473a-ad3d-bd4334e42f48 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 May 19 04:43:57.238525 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1529/3131] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:43:57 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:57.276544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-58856139-420d-4805-8817-d3bb6de269c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:57.277088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-58856139-420d-4805-8817-d3bb6de269c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:57.283385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58856139-420d-4805-8817-d3bb6de269c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.284009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58856139-420d-4805-8817-d3bb6de269c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.284822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58856139-420d-4805-8817-d3bb6de269c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.285775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58856139-420d-4805-8817-d3bb6de269c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.328816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-58856139-420d-4805-8817-d3bb6de269c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:43:57.438356 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-58856139-420d-4805-8817-d3bb6de269c1 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 204 len: 0 microversion: 2.1 time: 0.164523 May 19 04:43:57.443344 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1530/3132] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:43:57 2022] DELETE /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:43:57.450321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ba2fa300-107f-4a78-bbba-44ab59b1f322 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:57.451298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba2fa300-107f-4a78-bbba-44ab59b1f322 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:57.459838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba2fa300-107f-4a78-bbba-44ab59b1f322 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.460299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba2fa300-107f-4a78-bbba-44ab59b1f322 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.461221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba2fa300-107f-4a78-bbba-44ab59b1f322 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.461657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba2fa300-107f-4a78-bbba-44ab59b1f322 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.467805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0d4449bf-c5dc-4ece-87dd-8d318ffd5790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:57.474866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:57.481593 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d4449bf-c5dc-4ece-87dd-8d318ffd5790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1315 microversion: 2.1 time: 0.348743 May 19 04:43:57.482748 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1603/3133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:57 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:57.751605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ba2fa300-107f-4a78-bbba-44ab59b1f322 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:57.759459 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ba2fa300-107f-4a78-bbba-44ab59b1f322 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1608 microversion: 2.1 time: 0.315252 May 19 04:43:57.760253 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1531/3134] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:57 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1608 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:57.888598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c8c1728-16e4-472b-8619-1a7d526b34a1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:57.889276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4c8c1728-16e4-472b-8619-1a7d526b34a1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:57.891422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:43:57.897619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c8c1728-16e4-472b-8619-1a7d526b34a1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.898202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c8c1728-16e4-472b-8619-1a7d526b34a1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.898987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c8c1728-16e4-472b-8619-1a7d526b34a1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.899433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c8c1728-16e4-472b-8619-1a7d526b34a1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.933180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:57.934168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:57.940560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.941256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:57.942125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:57.942637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:58.063164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:58.073458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:58.075139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:58.076413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7eb62530-7877-4b45-bc51-cfd9d370c7b2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.147134 May 19 04:43:58.077255 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1532/3135] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:57 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:58.133456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c8c1728-16e4-472b-8619-1a7d526b34a1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:58.141327 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c8c1728-16e4-472b-8619-1a7d526b34a1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.257402 May 19 04:43:58.151255 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1604/3136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:57 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:58.199864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17301688-b22b-42d9-ab55-b303e93bc3eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:58.200546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17301688-b22b-42d9-ab55-b303e93bc3eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:58.207274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17301688-b22b-42d9-ab55-b303e93bc3eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:58.208599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17301688-b22b-42d9-ab55-b303e93bc3eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:58.208599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17301688-b22b-42d9-ab55-b303e93bc3eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:58.208932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17301688-b22b-42d9-ab55-b303e93bc3eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:58.250073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ac6335b-caab-416f-a09e-9e1aa8a4cd7d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:58.251147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8ac6335b-caab-416f-a09e-9e1aa8a4cd7d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:58.258187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ac6335b-caab-416f-a09e-9e1aa8a4cd7d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:58.258828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ac6335b-caab-416f-a09e-9e1aa8a4cd7d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:58.259629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ac6335b-caab-416f-a09e-9e1aa8a4cd7d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:58.260077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ac6335b-caab-416f-a09e-9e1aa8a4cd7d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:58.299304 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ac6335b-caab-416f-a09e-9e1aa8a4cd7d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053070 May 19 04:43:58.303274 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1605/3137] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:43:58 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:43:58.408132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-17301688-b22b-42d9-ab55-b303e93bc3eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:58.417500 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17301688-b22b-42d9-ab55-b303e93bc3eb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1469 microversion: 2.1 time: 0.221401 May 19 04:43:58.428149 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1533/3138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:58 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:58.499245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-849e42c9-49b9-4d80-974a-8a0c807c6818 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:58.499973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-849e42c9-49b9-4d80-974a-8a0c807c6818 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:58.507128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849e42c9-49b9-4d80-974a-8a0c807c6818 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:58.507644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849e42c9-49b9-4d80-974a-8a0c807c6818 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:58.508492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849e42c9-49b9-4d80-974a-8a0c807c6818 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:58.508995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849e42c9-49b9-4d80-974a-8a0c807c6818 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:58.746965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-849e42c9-49b9-4d80-974a-8a0c807c6818 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:58.757534 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-849e42c9-49b9-4d80-974a-8a0c807c6818 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1315 microversion: 2.1 time: 0.261774 May 19 04:43:58.758320 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1606/3139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:58 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:58.776113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-292697e2-4900-4c6e-85e0-8e8e0ce2868d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:58.777012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-292697e2-4900-4c6e-85e0-8e8e0ce2868d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:58.783187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-292697e2-4900-4c6e-85e0-8e8e0ce2868d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:58.783731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-292697e2-4900-4c6e-85e0-8e8e0ce2868d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:58.784577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-292697e2-4900-4c6e-85e0-8e8e0ce2868d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:58.785134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-292697e2-4900-4c6e-85e0-8e8e0ce2868d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.096849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:59.098739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:59.108593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.109032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.110921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.111373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.226865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:59.237613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:59.240255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:59.243102 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dc6cb8de-b1a8-4a8a-9cfd-2f5267996a57 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.150695 May 19 04:43:59.244381 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1607/3140] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:43:59 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:43:59.250495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b6a62b89-d1d6-4a60-a50a-ddf9d25e1311 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:59.251198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b6a62b89-d1d6-4a60-a50a-ddf9d25e1311 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:59.258064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6a62b89-d1d6-4a60-a50a-ddf9d25e1311 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.258647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6a62b89-d1d6-4a60-a50a-ddf9d25e1311 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.259783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6a62b89-d1d6-4a60-a50a-ddf9d25e1311 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.260058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6a62b89-d1d6-4a60-a50a-ddf9d25e1311 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.275982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-292697e2-4900-4c6e-85e0-8e8e0ce2868d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:59.288220 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-292697e2-4900-4c6e-85e0-8e8e0ce2868d tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1608 microversion: 2.1 time: 0.515825 May 19 04:43:59.289596 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1534/3141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:58 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1608 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:59.310956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c108aced-a995-46d7-86d6-cb4bf9a638aa tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:59.312167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c108aced-a995-46d7-86d6-cb4bf9a638aa tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:59.318173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c108aced-a995-46d7-86d6-cb4bf9a638aa tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.318619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c108aced-a995-46d7-86d6-cb4bf9a638aa tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.319563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c108aced-a995-46d7-86d6-cb4bf9a638aa tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.320009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c108aced-a995-46d7-86d6-cb4bf9a638aa tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.363882 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c108aced-a995-46d7-86d6-cb4bf9a638aa tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056063 May 19 04:43:59.364471 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1535/3142] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:43:59 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:43:59.435556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d2171175-d710-40ba-9a2d-944881a2ffb7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:59.436180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d2171175-d710-40ba-9a2d-944881a2ffb7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:59.442909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2171175-d710-40ba-9a2d-944881a2ffb7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.443602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2171175-d710-40ba-9a2d-944881a2ffb7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.444382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2171175-d710-40ba-9a2d-944881a2ffb7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.444999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2171175-d710-40ba-9a2d-944881a2ffb7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.619153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b6a62b89-d1d6-4a60-a50a-ddf9d25e1311 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:59.627456 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b6a62b89-d1d6-4a60-a50a-ddf9d25e1311 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.381703 May 19 04:43:59.628489 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1608/3143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:59 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:43:59.679039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d2171175-d710-40ba-9a2d-944881a2ffb7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:43:59.686902 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d2171175-d710-40ba-9a2d-944881a2ffb7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1469 microversion: 2.1 time: 0.255149 May 19 04:43:59.687601 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1536/3144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:59 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1469 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:43:59.777265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dcee802c-a626-485d-8c3b-dbe879602d9d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:43:59.777265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dcee802c-a626-485d-8c3b-dbe879602d9d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:43:59.783758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcee802c-a626-485d-8c3b-dbe879602d9d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.784322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcee802c-a626-485d-8c3b-dbe879602d9d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:43:59.785812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcee802c-a626-485d-8c3b-dbe879602d9d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:43:59.786477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcee802c-a626-485d-8c3b-dbe879602d9d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.022643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dcee802c-a626-485d-8c3b-dbe879602d9d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:00.034182 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dcee802c-a626-485d-8c3b-dbe879602d9d tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1315 microversion: 2.1 time: 0.261887 May 19 04:44:00.034986 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1609/3145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:43:59 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:00.262460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:00.263394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:00.271258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.272077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.272937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.273424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.306389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b1a6aa2d-1820-4b91-a3de-a3db1d1673fb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:00.308198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b1a6aa2d-1820-4b91-a3de-a3db1d1673fb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:00.317571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1a6aa2d-1820-4b91-a3de-a3db1d1673fb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.318132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1a6aa2d-1820-4b91-a3de-a3db1d1673fb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.319229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1a6aa2d-1820-4b91-a3de-a3db1d1673fb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.319766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1a6aa2d-1820-4b91-a3de-a3db1d1673fb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.456082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:00.467140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:00.476108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:00.478491 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-88f75587-08ee-40ff-845e-81b283a3d9e7 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.219548 May 19 04:44:00.479595 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1537/3146] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:00 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:00.486921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c0f1c7c4-4fca-434f-882d-87df2d5bd84f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:00.488907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c0f1c7c4-4fca-434f-882d-87df2d5bd84f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:00.495853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0f1c7c4-4fca-434f-882d-87df2d5bd84f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.496342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0f1c7c4-4fca-434f-882d-87df2d5bd84f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.497156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0f1c7c4-4fca-434f-882d-87df2d5bd84f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.497735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0f1c7c4-4fca-434f-882d-87df2d5bd84f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.543472 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c0f1c7c4-4fca-434f-882d-87df2d5bd84f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062463 May 19 04:44:00.544355 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1538/3147] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:00 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:00.647773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c74a5508-4d2b-4f7a-b67e-93c1e2683e49 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:00.648769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c74a5508-4d2b-4f7a-b67e-93c1e2683e49 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:00.657054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c74a5508-4d2b-4f7a-b67e-93c1e2683e49 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.657845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c74a5508-4d2b-4f7a-b67e-93c1e2683e49 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.658832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c74a5508-4d2b-4f7a-b67e-93c1e2683e49 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.660452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c74a5508-4d2b-4f7a-b67e-93c1e2683e49 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.693070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:00.795298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b1a6aa2d-1820-4b91-a3de-a3db1d1673fb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:00.807825 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b1a6aa2d-1820-4b91-a3de-a3db1d1673fb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1608 microversion: 2.1 time: 0.505956 May 19 04:44:00.812250 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1610/3148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:00 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1608 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:00.830949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b6a57e5-421d-400e-98b5-13397b6e27f1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:00.832755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4b6a57e5-421d-400e-98b5-13397b6e27f1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:00.838730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:00.843331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b6a57e5-421d-400e-98b5-13397b6e27f1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.850681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b6a57e5-421d-400e-98b5-13397b6e27f1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:00.857994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b6a57e5-421d-400e-98b5-13397b6e27f1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:00.858899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b6a57e5-421d-400e-98b5-13397b6e27f1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:01.254740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c74a5508-4d2b-4f7a-b67e-93c1e2683e49 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:01.269859 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c74a5508-4d2b-4f7a-b67e-93c1e2683e49 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.628836 May 19 04:44:01.270674 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1539/3149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:00 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:01.277626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-635e3799-a69b-4b30-8b8b-9a0c21602da0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:01.278490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-635e3799-a69b-4b30-8b8b-9a0c21602da0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:01.288309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-635e3799-a69b-4b30-8b8b-9a0c21602da0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:01.288985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-635e3799-a69b-4b30-8b8b-9a0c21602da0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:01.290513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-635e3799-a69b-4b30-8b8b-9a0c21602da0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:01.291119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-635e3799-a69b-4b30-8b8b-9a0c21602da0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:01.350859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4b6a57e5-421d-400e-98b5-13397b6e27f1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:01.360316 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4b6a57e5-421d-400e-98b5-13397b6e27f1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1535 microversion: 2.1 time: 0.543853 May 19 04:44:01.361367 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1611/3150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:00 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1535 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:01.499233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:01.500298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:01.507267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:01.508024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:01.508965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:01.509600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:01.872708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:01.893830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:01.898097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:01.902810 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66e15dde-315a-405d-a42a-8d4ce96a2195 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.408639 May 19 04:44:01.905662 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1612/3151] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:01 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:44:01.914063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f25e8673-009c-46cd-a9c5-a707745d35d9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:01.915547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f25e8673-009c-46cd-a9c5-a707745d35d9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:01.922737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-635e3799-a69b-4b30-8b8b-9a0c21602da0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:01.923675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f25e8673-009c-46cd-a9c5-a707745d35d9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:01.924226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f25e8673-009c-46cd-a9c5-a707745d35d9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:01.925947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f25e8673-009c-46cd-a9c5-a707745d35d9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:01.926790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f25e8673-009c-46cd-a9c5-a707745d35d9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:01.932780 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-635e3799-a69b-4b30-8b8b-9a0c21602da0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1501 microversion: 2.1 time: 0.660762 May 19 04:44:01.935021 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1540/3152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:01 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1501 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:01.952128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bdac2da6-097b-4490-bc3e-89cf71d9ea2e tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:01.952954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bdac2da6-097b-4490-bc3e-89cf71d9ea2e tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:01.962858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdac2da6-097b-4490-bc3e-89cf71d9ea2e tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:01.963315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdac2da6-097b-4490-bc3e-89cf71d9ea2e tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:01.964108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdac2da6-097b-4490-bc3e-89cf71d9ea2e tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:01.964547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdac2da6-097b-4490-bc3e-89cf71d9ea2e tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:01.970451 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f25e8673-009c-46cd-a9c5-a707745d35d9 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063246 May 19 04:44:01.971333 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1613/3153] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:01 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:01.985327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b4ceeddd-ba33-4cf0-8f90-b6cb71acd2eb req-471f24ab-a35b-4116-aebc-b5cbd378f39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd7e64-3246-40ea-844d-5e88603a9e20", "name": "network-vif-unplugged", "status": "completed", "tag": "60433ce3-7f6a-48fa-9b49-9f65b436fd14"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:01.998350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b4ceeddd-ba33-4cf0-8f90-b6cb71acd2eb req-471f24ab-a35b-4116-aebc-b5cbd378f39a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:01.999159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b4ceeddd-ba33-4cf0-8f90-b6cb71acd2eb req-471f24ab-a35b-4116-aebc-b5cbd378f39a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:02.014697 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b4ceeddd-ba33-4cf0-8f90-b6cb71acd2eb req-471f24ab-a35b-4116-aebc-b5cbd378f39a service nova] Creating event network-vif-unplugged:60433ce3-7f6a-48fa-9b49-9f65b436fd14 for instance 98bd7e64-3246-40ea-844d-5e88603a9e20 on n-h2-766726-30 May 19 04:44:02.021355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-b4ceeddd-ba33-4cf0-8f90-b6cb71acd2eb req-471f24ab-a35b-4116-aebc-b5cbd378f39a service nova] Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:44:02.035433 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b4ceeddd-ba33-4cf0-8f90-b6cb71acd2eb req-471f24ab-a35b-4116-aebc-b5cbd378f39a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061961 May 19 04:44:02.036938 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1614/3154] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:02.043298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18b24075-a0e1-41f6-8e66-f3a19540b3da tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:02.051523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18b24075-a0e1-41f6-8e66-f3a19540b3da tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:02.052448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18b24075-a0e1-41f6-8e66-f3a19540b3da tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:02.078551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-18b24075-a0e1-41f6-8e66-f3a19540b3da tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Going to try to stop instance {{(pid=124818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 04:44:02.153054 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18b24075-a0e1-41f6-8e66-f3a19540b3da tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705/action" status: 202 len: 0 microversion: 2.1 time: 0.112858 May 19 04:44:02.154396 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1615/3155] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:44:02 2022] POST /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:44:02.179718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f233f74-c82a-4a49-a880-f9ff25d09945 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:02.181389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5f233f74-c82a-4a49-a880-f9ff25d09945 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:02.196135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f233f74-c82a-4a49-a880-f9ff25d09945 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:02.197019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f233f74-c82a-4a49-a880-f9ff25d09945 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:02.198099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f233f74-c82a-4a49-a880-f9ff25d09945 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:02.198834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f233f74-c82a-4a49-a880-f9ff25d09945 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:02.463473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bdac2da6-097b-4490-bc3e-89cf71d9ea2e tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:02.486133 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bdac2da6-097b-4490-bc3e-89cf71d9ea2e tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1608 microversion: 2.1 time: 0.538802 May 19 04:44:02.486912 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1541/3156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:01 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1608 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:02.496240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e577ea04-098d-4e27-b662-a6381052fa09 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:02.496240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e577ea04-098d-4e27-b662-a6381052fa09 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:02.501310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e577ea04-098d-4e27-b662-a6381052fa09 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:02.502495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e577ea04-098d-4e27-b662-a6381052fa09 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:02.504389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e577ea04-098d-4e27-b662-a6381052fa09 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:02.505004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e577ea04-098d-4e27-b662-a6381052fa09 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:02.700046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5f233f74-c82a-4a49-a880-f9ff25d09945 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:02.717724 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5f233f74-c82a-4a49-a880-f9ff25d09945 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.546707 May 19 04:44:02.718324 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1616/3157] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:02 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:02.723203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9fad6c62-1f10-46b3-9666-1de92bbd0b28 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:02.723816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9fad6c62-1f10-46b3-9666-1de92bbd0b28 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:02.741448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fad6c62-1f10-46b3-9666-1de92bbd0b28 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:02.741902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fad6c62-1f10-46b3-9666-1de92bbd0b28 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:02.742682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fad6c62-1f10-46b3-9666-1de92bbd0b28 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:02.743119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fad6c62-1f10-46b3-9666-1de92bbd0b28 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:02.977497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e577ea04-098d-4e27-b662-a6381052fa09 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:02.985634 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e577ea04-098d-4e27-b662-a6381052fa09 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.497567 May 19 04:44:02.986236 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1542/3158] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:02 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:03.001250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:03.001882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:03.023955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:03.024411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:03.025224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:03.025833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:03.163787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:03.177475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:03.183958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:03.190610 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4cb0b29f-4e8b-48cc-b9ea-c84c455c288e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.203334 May 19 04:44:03.191826 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1543/3159] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:02 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:03.196767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd497c15-b18f-42a8-8256-8cdfb9c4dc9a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:03.202307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bd497c15-b18f-42a8-8256-8cdfb9c4dc9a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:03.215817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd497c15-b18f-42a8-8256-8cdfb9c4dc9a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:03.216559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd497c15-b18f-42a8-8256-8cdfb9c4dc9a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:03.217933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd497c15-b18f-42a8-8256-8cdfb9c4dc9a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:03.225824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd497c15-b18f-42a8-8256-8cdfb9c4dc9a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:03.294006 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd497c15-b18f-42a8-8256-8cdfb9c4dc9a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100816 May 19 04:44:03.298280 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1544/3160] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:03 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:03.370817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9fad6c62-1f10-46b3-9666-1de92bbd0b28 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:03.382669 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9fad6c62-1f10-46b3-9666-1de92bbd0b28 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1535 microversion: 2.1 time: 0.663211 May 19 04:44:03.383180 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1617/3161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:02 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1535 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:03.504670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61da3838-4edb-4085-a0b5-55841f1d4c83 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:03.504934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-61da3838-4edb-4085-a0b5-55841f1d4c83 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:03.523037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61da3838-4edb-4085-a0b5-55841f1d4c83 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:03.523037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61da3838-4edb-4085-a0b5-55841f1d4c83 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:03.523950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61da3838-4edb-4085-a0b5-55841f1d4c83 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:03.524262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61da3838-4edb-4085-a0b5-55841f1d4c83 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:03.734547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c948dc9-00ce-4538-a42b-fe73303a3094 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:03.735535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4c948dc9-00ce-4538-a42b-fe73303a3094 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:03.750385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c948dc9-00ce-4538-a42b-fe73303a3094 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:03.750849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c948dc9-00ce-4538-a42b-fe73303a3094 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:03.751651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c948dc9-00ce-4538-a42b-fe73303a3094 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:03.752081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c948dc9-00ce-4538-a42b-fe73303a3094 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:03.839327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-61da3838-4edb-4085-a0b5-55841f1d4c83 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:03.848631 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-61da3838-4edb-4085-a0b5-55841f1d4c83 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1540 microversion: 2.1 time: 0.348300 May 19 04:44:03.856489 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1545/3162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:03 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1540 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:04.005189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6abafbf-4440-4f51-8b55-6ca8897fe1d5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:04.006542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b6abafbf-4440-4f51-8b55-6ca8897fe1d5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:04.023938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6abafbf-4440-4f51-8b55-6ca8897fe1d5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.024651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6abafbf-4440-4f51-8b55-6ca8897fe1d5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.025650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6abafbf-4440-4f51-8b55-6ca8897fe1d5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.026259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6abafbf-4440-4f51-8b55-6ca8897fe1d5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.291840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c948dc9-00ce-4538-a42b-fe73303a3094 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:04.302124 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c948dc9-00ce-4538-a42b-fe73303a3094 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.571344 May 19 04:44:04.313446 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1618/3163] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:03 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:04.318548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6c9a5a12-82cc-4278-aa84-2089e2246d84 req-209d26f1-1601-4246-9ba4-27df6327253e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bd7e64-3246-40ea-844d-5e88603a9e20", "tag": "60433ce3-7f6a-48fa-9b49-9f65b436fd14"}, {"server_uuid": "d7a0a37d-a68e-428a-8b9a-901167a2c06a", "name": "network-vif-deleted", "tag": "4f334c46-7b49-4649-8354-c19a2c21fc75"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:04.335215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6c9a5a12-82cc-4278-aa84-2089e2246d84 req-209d26f1-1601-4246-9ba4-27df6327253e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.335658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6c9a5a12-82cc-4278-aa84-2089e2246d84 req-209d26f1-1601-4246-9ba4-27df6327253e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.374443 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6c9a5a12-82cc-4278-aa84-2089e2246d84 req-209d26f1-1601-4246-9ba4-27df6327253e service nova] Creating event network-changed:60433ce3-7f6a-48fa-9b49-9f65b436fd14 for instance 98bd7e64-3246-40ea-844d-5e88603a9e20 on n-h2-766726-30 May 19 04:44:04.374443 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6c9a5a12-82cc-4278-aa84-2089e2246d84 req-209d26f1-1601-4246-9ba4-27df6327253e service nova] Creating event network-vif-deleted:4f334c46-7b49-4649-8354-c19a2c21fc75 for instance d7a0a37d-a68e-428a-8b9a-901167a2c06a on n-h1-766726-30 May 19 04:44:04.406215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-6c9a5a12-82cc-4278-aa84-2089e2246d84 req-209d26f1-1601-4246-9ba4-27df6327253e service nova] Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:44:04.432528 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6c9a5a12-82cc-4278-aa84-2089e2246d84 req-209d26f1-1601-4246-9ba4-27df6327253e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.117725 May 19 04:44:04.435106 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1619/3164] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:04.449916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:04.454861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:04.464910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.467640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.468616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.469637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.471582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b6abafbf-4440-4f51-8b55-6ca8897fe1d5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:04.480393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:04.484921 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6abafbf-4440-4f51-8b55-6ca8897fe1d5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.481173 May 19 04:44:04.497505 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1546/3165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:03 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:04.513365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-453413a1-30c0-4cd5-9741-96ea3bc48a5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:04.515604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-453413a1-30c0-4cd5-9741-96ea3bc48a5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:04.532680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-453413a1-30c0-4cd5-9741-96ea3bc48a5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.536669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-453413a1-30c0-4cd5-9741-96ea3bc48a5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.538772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-453413a1-30c0-4cd5-9741-96ea3bc48a5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.543720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-453413a1-30c0-4cd5-9741-96ea3bc48a5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.621816 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-453413a1-30c0-4cd5-9741-96ea3bc48a5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120189 May 19 04:44:04.627925 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1547/3166] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:04 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:04.637758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9705d9f0-1351-425e-830e-5cd24aa0c95d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:04.645579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9705d9f0-1351-425e-830e-5cd24aa0c95d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:04.651787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9705d9f0-1351-425e-830e-5cd24aa0c95d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.652240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9705d9f0-1351-425e-830e-5cd24aa0c95d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.653014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9705d9f0-1351-425e-830e-5cd24aa0c95d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.665693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9705d9f0-1351-425e-830e-5cd24aa0c95d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.684428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:04.700409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:04.705775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:04.712716 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bd30cb9e-605f-4cf6-97e0-7d48fbc5acb2 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1603 microversion: 2.32 time: 0.273417 May 19 04:44:04.713682 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1620/3167] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:04 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1603 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:04.869739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4ce47067-9d52-4a7f-a697-e99465aeabd4 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:04.871013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4ce47067-9d52-4a7f-a697-e99465aeabd4 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:04.884541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ce47067-9d52-4a7f-a697-e99465aeabd4 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.885612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ce47067-9d52-4a7f-a697-e99465aeabd4 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:04.888241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ce47067-9d52-4a7f-a697-e99465aeabd4 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:04.888794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ce47067-9d52-4a7f-a697-e99465aeabd4 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:05.060481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9705d9f0-1351-425e-830e-5cd24aa0c95d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:05.071832 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9705d9f0-1351-425e-830e-5cd24aa0c95d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1535 microversion: 2.1 time: 0.442360 May 19 04:44:05.074639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4ce47067-9d52-4a7f-a697-e99465aeabd4 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:05.075170 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1548/3168] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:04 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1535 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:05.086416 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4ce47067-9d52-4a7f-a697-e99465aeabd4 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.220556 May 19 04:44:05.087968 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1621/3169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:04 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:05.319601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a44b61d-39bb-4973-822b-ea1f4f051d52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:05.320274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4a44b61d-39bb-4973-822b-ea1f4f051d52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:05.328719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a44b61d-39bb-4973-822b-ea1f4f051d52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:05.329429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a44b61d-39bb-4973-822b-ea1f4f051d52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:05.331083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a44b61d-39bb-4973-822b-ea1f4f051d52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:05.331876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a44b61d-39bb-4973-822b-ea1f4f051d52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:05.505336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c93198d-0ca8-4965-a2ac-d83f07e382ec tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:05.505968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c93198d-0ca8-4965-a2ac-d83f07e382ec tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:05.515860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c93198d-0ca8-4965-a2ac-d83f07e382ec tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:05.546700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c93198d-0ca8-4965-a2ac-d83f07e382ec tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:05.547739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c93198d-0ca8-4965-a2ac-d83f07e382ec tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:05.550473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c93198d-0ca8-4965-a2ac-d83f07e382ec tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:05.785821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=5 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:05.906333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:06.036258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:06.080361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4a44b61d-39bb-4973-822b-ea1f4f051d52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:06.090627 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4a44b61d-39bb-4973-822b-ea1f4f051d52 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.775216 May 19 04:44:06.097635 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1549/3170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:05 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:06.103338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79482822-bbae-4f94-b45d-b3126d336207 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:06.107941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-79482822-bbae-4f94-b45d-b3126d336207 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:06.126122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79482822-bbae-4f94-b45d-b3126d336207 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:06.126894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79482822-bbae-4f94-b45d-b3126d336207 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:06.127934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79482822-bbae-4f94-b45d-b3126d336207 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:06.129172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79482822-bbae-4f94-b45d-b3126d336207 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:06.196290 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79482822-bbae-4f94-b45d-b3126d336207 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096602 May 19 04:44:06.198485 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1550/3171] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:06 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:06.210806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:06.214380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:06.229553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:06.230018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:06.233435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:06.233906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:06.285572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:06.286241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:06.286867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lazy-loading 'fault' on Instance uuid 19184d52-45a9-457d-9cc8-7635125ecc4c {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:44:06.294823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5c93198d-0ca8-4965-a2ac-d83f07e382ec tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:06.307656 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c93198d-0ca8-4965-a2ac-d83f07e382ec tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.807692 May 19 04:44:06.318010 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1622/3172] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:05 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:06.323784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-249a35c3-eb0c-44a3-9af5-eb41e546bb41 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:06.326367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-249a35c3-eb0c-44a3-9af5-eb41e546bb41 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:06.344519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-249a35c3-eb0c-44a3-9af5-eb41e546bb41 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:06.348323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-249a35c3-eb0c-44a3-9af5-eb41e546bb41 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:06.349516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-249a35c3-eb0c-44a3-9af5-eb41e546bb41 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:06.350179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-249a35c3-eb0c-44a3-9af5-eb41e546bb41 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:06.415313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:06.439417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:06.441830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cc04e71de084662ac6afa2806664050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345f541c3285497685c0e59daa6a4c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:06.447242 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d1c3dc97-e7ef-4717-bf7e-d4be2d033eb4 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 200 len: 1608 microversion: 2.32 time: 0.247267 May 19 04:44:06.450595 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1551/3173] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:06 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 1608 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:06.463820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d90aaf96-da98-4e4a-a224-28ed4f24127c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:06.464595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d90aaf96-da98-4e4a-a224-28ed4f24127c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:06.472578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d90aaf96-da98-4e4a-a224-28ed4f24127c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:06.473146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d90aaf96-da98-4e4a-a224-28ed4f24127c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:06.474244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d90aaf96-da98-4e4a-a224-28ed4f24127c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:06.474691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d90aaf96-da98-4e4a-a224-28ed4f24127c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:06.606752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d90aaf96-da98-4e4a-a224-28ed4f24127c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:06.620915 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d90aaf96-da98-4e4a-a224-28ed4f24127c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.169020 May 19 04:44:06.621927 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1552/3174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:06 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:06.629750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-249a35c3-eb0c-44a3-9af5-eb41e546bb41 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:06.637957 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-249a35c3-eb0c-44a3-9af5-eb41e546bb41 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1535 microversion: 2.1 time: 0.318614 May 19 04:44:06.638538 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1623/3175] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:06 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1535 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:07.114501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d84aac64-c523-4fdd-b388-b0e26fd98c7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:07.115121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d84aac64-c523-4fdd-b388-b0e26fd98c7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:07.125996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d84aac64-c523-4fdd-b388-b0e26fd98c7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.126329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d84aac64-c523-4fdd-b388-b0e26fd98c7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.127323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d84aac64-c523-4fdd-b388-b0e26fd98c7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.129720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d84aac64-c523-4fdd-b388-b0e26fd98c7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.210346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b4e49672-a100-4e4b-a90c-bd151420aeac tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:07.211346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4e49672-a100-4e4b-a90c-bd151420aeac tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:07.224113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e49672-a100-4e4b-a90c-bd151420aeac tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.225747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e49672-a100-4e4b-a90c-bd151420aeac tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.227633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e49672-a100-4e4b-a90c-bd151420aeac tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.230436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e49672-a100-4e4b-a90c-bd151420aeac tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.299955 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b4e49672-a100-4e4b-a90c-bd151420aeac tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094630 May 19 04:44:07.301640 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1624/3176] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:07 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:07.333543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e43e8ed2-4953-48e0-aa10-b928301bc365 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:07.334379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e43e8ed2-4953-48e0-aa10-b928301bc365 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:07.345466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e43e8ed2-4953-48e0-aa10-b928301bc365 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.347742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e43e8ed2-4953-48e0-aa10-b928301bc365 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.349518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e43e8ed2-4953-48e0-aa10-b928301bc365 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.352829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e43e8ed2-4953-48e0-aa10-b928301bc365 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.567980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d84aac64-c523-4fdd-b388-b0e26fd98c7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:07.578693 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d84aac64-c523-4fdd-b388-b0e26fd98c7e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.468066 May 19 04:44:07.579519 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1553/3177] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:07 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:07.599811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e43e8ed2-4953-48e0-aa10-b928301bc365 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:07.607679 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e43e8ed2-4953-48e0-aa10-b928301bc365 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1505 microversion: 2.1 time: 0.279735 May 19 04:44:07.608259 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1625/3178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:07 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:07.621797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:07.622599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:07.629471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.630112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.631032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.631623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.647310 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] HTTP exception thrown: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Request method failure captured: May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c HTTP/1.1 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckwL3CTGV1u5BZs0M9UR3dgEus-pd3bQDZNEs9kLS-QPTPCaCRCuxNEGImq-YqJQScwUmvspAwitUZoIeyQYgEfDiusX6UUxnmlrLAPjJ-GhIEeXeU7eiXpNtztsIhnLE3VjWqckzDesoOG_GWc6MPI9QdBBjfzdkq9m7aaPmC9xlk May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.32 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 345f541c3285497685c0e59daa6a4c28 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TaggedBootDevicesTest-992125731 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/345f541c3285497685c0e59daa6a4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/345f541c3285497685c0e59daa6a4c28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/345f541c3285497685c0e59daa6a4c28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_345f541c3285497685c0e59daa6a4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TaggedBootDevicesTest-992125731 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 345f541c3285497685c0e59daa6a4c28 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TaggedBootDevicesTest-992125731 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TaggedBootDevicesTest-992125731-project May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 0cc04e71de084662ac6afa2806664050 May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TaggedBootDevicesTest-992125731-project May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '19184d52-45a9-457d-9cc8-7635125ecc4c'} May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:07.649211 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:07.653827 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:07.653827 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:07.653827 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:07.653827 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:44:07.653827 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:44:07.653827 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:07.653827 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:07.653827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Returning 404 to user: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:44:07.654401 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e1e9d3c-6a00-4979-89c9-a72ddf959cbc tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 404 len: 111 microversion: 2.32 time: 0.036337 May 19 04:44:07.661328 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1626/3179] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:07 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:44:07.670325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6441519c-af34-4578-bec0-250f48ffe3ee tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:07.671574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6441519c-af34-4578-bec0-250f48ffe3ee tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:07.680683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6441519c-af34-4578-bec0-250f48ffe3ee tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.681186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6441519c-af34-4578-bec0-250f48ffe3ee tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.681977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6441519c-af34-4578-bec0-250f48ffe3ee tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.682445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6441519c-af34-4578-bec0-250f48ffe3ee tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.772514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6441519c-af34-4578-bec0-250f48ffe3ee tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:07.783263 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6441519c-af34-4578-bec0-250f48ffe3ee tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.121023 May 19 04:44:07.784111 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1627/3180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:07 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:07.789334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-25081e90-91bf-4aa1-897c-94002ace5364 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:07.790160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-25081e90-91bf-4aa1-897c-94002ace5364 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:07.797189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25081e90-91bf-4aa1-897c-94002ace5364 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.798221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25081e90-91bf-4aa1-897c-94002ace5364 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.799300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25081e90-91bf-4aa1-897c-94002ace5364 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.801113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25081e90-91bf-4aa1-897c-94002ace5364 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.843061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3d65cef-1f7b-4cf2-a8a6-f38ac5a24ed8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:07.853785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3d65cef-1f7b-4cf2-a8a6-f38ac5a24ed8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:07.862142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3d65cef-1f7b-4cf2-a8a6-f38ac5a24ed8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.865338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3d65cef-1f7b-4cf2-a8a6-f38ac5a24ed8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.866742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3d65cef-1f7b-4cf2-a8a6-f38ac5a24ed8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:07.866742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3d65cef-1f7b-4cf2-a8a6-f38ac5a24ed8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:07.909923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3d65cef-1f7b-4cf2-a8a6-f38ac5a24ed8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:44:07.949348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:08.016009 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d3d65cef-1f7b-4cf2-a8a6-f38ac5a24ed8 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 204 len: 0 microversion: 2.42 time: 0.434936 May 19 04:44:08.017591 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1554/3181] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:44:07 2022] DELETE /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:44:08.025909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8719d84-70f4-47d2-af81-fa2b889350c0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '.version_select at 0x7fd31b7ff160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:08.054870 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f8719d84-70f4-47d2-af81-fa2b889350c0 tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794907459" status: 204 len: 0 microversion: 2.32 time: 0.035057 May 19 04:44:08.055778 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1555/3182] 10.222.0.58 () {60 vars in 1258 bytes} [Thu May 19 04:44:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794907459 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:44:08.061033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:08.062071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:08.065915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-25081e90-91bf-4aa1-897c-94002ace5364 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:08.071574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:08.073459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:08.074109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:08.075103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:08.075567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:08.079444 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-25081e90-91bf-4aa1-897c-94002ace5364 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1528 microversion: 2.1 time: 0.293462 May 19 04:44:08.092205 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1628/3183] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:07 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1528 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:08.100555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f2aad2e-fa52-40c6-806a-b59427def4a5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:08.102429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f2aad2e-fa52-40c6-806a-b59427def4a5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:08.122345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f2aad2e-fa52-40c6-806a-b59427def4a5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:08.122884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f2aad2e-fa52-40c6-806a-b59427def4a5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:08.124083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f2aad2e-fa52-40c6-806a-b59427def4a5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:08.124626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f2aad2e-fa52-40c6-806a-b59427def4a5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:08.392950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:08.406461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:08.407146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f2aad2e-fa52-40c6-806a-b59427def4a5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:08.408012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:08.415871 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c4d9896a-ca9f-4052-9391-7afb95d6760b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2961 microversion: 2.42 time: 0.352401 May 19 04:44:08.416718 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1556/3184] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:08 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2961 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:08.420516 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f2aad2e-fa52-40c6-806a-b59427def4a5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1528 microversion: 2.1 time: 0.325870 May 19 04:44:08.421045 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1629/3185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:08 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1528 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:08.434393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb0eea5e-e3d5-45c6-9df0-af8762862422 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:08.435660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fb0eea5e-e3d5-45c6-9df0-af8762862422 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:08.436666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3bd5f492-8730-40f4-b472-5a34f14f957f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:08.437749 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:44:08.437749 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:44:08.442376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb0eea5e-e3d5-45c6-9df0-af8762862422 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:08.443093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb0eea5e-e3d5-45c6-9df0-af8762862422 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:08.444130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb0eea5e-e3d5-45c6-9df0-af8762862422 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:08.444724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb0eea5e-e3d5-45c6-9df0-af8762862422 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:08.446340 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-3bd5f492-8730-40f4-b472-5a34f14f957f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] HTTP exception thrown: Flavor 61056ff7-5c00-40da-ae97-09efc2ebed8d could not be found. May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3bd5f492-8730-40f4-b472-5a34f14f957f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Request method failure captured: May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/flavors/61056ff7-5c00-40da-ae97-09efc2ebed8d HTTP/1.1 May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpXSR-1ZaJkrv61wD3Zd0kYylhKKsynF3ri2_TuoTR2YBo125ejR3sBqo56BEZK6IPL9g7xvkFXH5UZ1w6yWflK7wSRHmO8awCYAoEWWetOrnVUwqOf37LtIiErWX-RDqkaIX6IxIWoz-BRodulofR2g3nIffa3r13CKKzEtQWf-oc May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: f43a226680fd4709ba4faedada631836 May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-MigrationsAdminTest-1160010530 May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f43a226680fd4709ba4faedada631836"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f43a226680fd4709ba4faedada631836"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f43a226680fd4709ba4faedada631836"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f43a226680fd4709ba4faedada631836"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-MigrationsAdminTest-1160010530 May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: f43a226680fd4709ba4faedada631836 May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-MigrationsAdminTest-1160010530 May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-MigrationsAdminTest-1160010530-project-admin May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 790c9a312d0a44afb52ec1208161e81d May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-MigrationsAdminTest-1160010530-project-admin May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: exception: Flavor 61056ff7-5c00-40da-ae97-09efc2ebed8d could not be found. May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '61056ff7-5c00-40da-ae97-09efc2ebed8d'} May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi flavor.destroy() May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 61056ff7-5c00-40da-ae97-09efc2ebed8d could not be found. May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 61056ff7-5c00-40da-ae97-09efc2ebed8d could not be found. May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:08.448595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:08.452601 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:08.452601 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:08.452601 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:08.452601 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:08.452601 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:44:08.452601 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:44:08.452601 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 61056ff7-5c00-40da-ae97-09efc2ebed8d could not be found. May 19 04:44:08.452601 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:08.453262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3bd5f492-8730-40f4-b472-5a34f14f957f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Returning 404 to user: Flavor 61056ff7-5c00-40da-ae97-09efc2ebed8d could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:44:08.457938 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3bd5f492-8730-40f4-b472-5a34f14f957f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/61056ff7-5c00-40da-ae97-09efc2ebed8d" status: 404 len: 109 microversion: 2.1 time: 0.024868 May 19 04:44:08.459737 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1630/3186] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:44:08 2022] DELETE /compute/v2.1/flavors/61056ff7-5c00-40da-ae97-09efc2ebed8d => generated 109 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:44:08.496453 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fb0eea5e-e3d5-45c6-9df0-af8762862422 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078252 May 19 04:44:08.498077 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1557/3187] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:08 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:08.598084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-677275529", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:08.598518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f68ffdee-a73f-4c2e-add9-13c04c996dce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:08.599762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f68ffdee-a73f-4c2e-add9-13c04c996dce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:08.612999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f68ffdee-a73f-4c2e-add9-13c04c996dce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:08.617294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f68ffdee-a73f-4c2e-add9-13c04c996dce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:08.618642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f68ffdee-a73f-4c2e-add9-13c04c996dce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:08.621473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f68ffdee-a73f-4c2e-add9-13c04c996dce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:08.703962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:44:08.985088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f68ffdee-a73f-4c2e-add9-13c04c996dce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:08.993135 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f68ffdee-a73f-4c2e-add9-13c04c996dce tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.400274 May 19 04:44:08.993729 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1558/3188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:08 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:09.008077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d88bea59-117b-4e84-a19e-aa70d72eaf62 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:09.010319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d88bea59-117b-4e84-a19e-aa70d72eaf62 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:09.031644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d88bea59-117b-4e84-a19e-aa70d72eaf62 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.032406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d88bea59-117b-4e84-a19e-aa70d72eaf62 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.033502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d88bea59-117b-4e84-a19e-aa70d72eaf62 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.034104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d88bea59-117b-4e84-a19e-aa70d72eaf62 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.305770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:44:09.306439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:44:09.307082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:44:09.307711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:44:09.308390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:44:09.338226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.338830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.339770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.340319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.363983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:44:09.371112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Getting quotas for user 55c593b7f2a04b0e820a505e8e8eb521 and project 081114d9b091417fa7bce66a77583d8c. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:44:09.387152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:44:09.390316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:44:09.400501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d88bea59-117b-4e84-a19e-aa70d72eaf62 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:09.409019 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d88bea59-117b-4e84-a19e-aa70d72eaf62 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1485 microversion: 2.1 time: 0.408288 May 19 04:44:09.413420 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1559/3189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:08 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1485 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:09.420241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c0275c6-48e4-4f1a-b62e-d9bda68ea7d3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:09.421118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c0275c6-48e4-4f1a-b62e-d9bda68ea7d3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:09.454295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c0275c6-48e4-4f1a-b62e-d9bda68ea7d3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.454776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c0275c6-48e4-4f1a-b62e-d9bda68ea7d3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.455577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c0275c6-48e4-4f1a-b62e-d9bda68ea7d3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.456022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c0275c6-48e4-4f1a-b62e-d9bda68ea7d3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.501622 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5afde93d-5a51-45ba-b825-cfaf50d26bf9 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913678 May 19 04:44:09.509200 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1631/3190] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:44:09.529211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:09.530996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:09.543102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.547405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.548428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.549063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.650142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c0275c6-48e4-4f1a-b62e-d9bda68ea7d3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:09.658916 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c0275c6-48e4-4f1a-b62e-d9bda68ea7d3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.244378 May 19 04:44:09.660064 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1560/3191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:09 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:09.670688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bb6ef462-93b9-451a-b157-fa1740229243 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:09.678556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bb6ef462-93b9-451a-b157-fa1740229243 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:09.690294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb6ef462-93b9-451a-b157-fa1740229243 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.697314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb6ef462-93b9-451a-b157-fa1740229243 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.698511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb6ef462-93b9-451a-b157-fa1740229243 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:09.699123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb6ef462-93b9-451a-b157-fa1740229243 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:09.763542 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bb6ef462-93b9-451a-b157-fa1740229243 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097371 May 19 04:44:09.764160 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1561/3192] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:09 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:09.770842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-26cf35ae-664f-400d-badb-51d13e89f707 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:09.771469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-26cf35ae-664f-400d-badb-51d13e89f707 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:09.894944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-26cf35ae-664f-400d-badb-51d13e89f707 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:09.904931 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-26cf35ae-664f-400d-badb-51d13e89f707 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1212 microversion: 2.1 time: 0.139561 May 19 04:44:09.905886 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1562/3193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:09 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1212 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:09.915548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-927572144", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:09.957510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:09.987118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:09.988850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:09.990174 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d4f3aa6b-d8a0-47e7-a75f-38b942813c75 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2961 microversion: 2.42 time: 0.486495 May 19 04:44:09.998013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] validate_networks() for [('260656eb-d041-4e9d-9cb0-3930a24c3f23', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:44:09.998139 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1632/3194] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:09 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2961 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:10.017999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64f8377e-ab9d-4c93-9d57-33e8a4bc938c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:10.018554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64f8377e-ab9d-4c93-9d57-33e8a4bc938c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:10.029530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64f8377e-ab9d-4c93-9d57-33e8a4bc938c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:10.029991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64f8377e-ab9d-4c93-9d57-33e8a4bc938c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:10.030802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64f8377e-ab9d-4c93-9d57-33e8a4bc938c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:10.031247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64f8377e-ab9d-4c93-9d57-33e8a4bc938c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:10.885020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-64f8377e-ab9d-4c93-9d57-33e8a4bc938c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:10.893030 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64f8377e-ab9d-4c93-9d57-33e8a4bc938c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.885472 May 19 04:44:10.913470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1633/3195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:10 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:10.918944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4eb30900-c210-45ec-b8a0-76e375e49b92 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:10.919774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4eb30900-c210-45ec-b8a0-76e375e49b92 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:10.929327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4eb30900-c210-45ec-b8a0-76e375e49b92 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:10.929787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4eb30900-c210-45ec-b8a0-76e375e49b92 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:10.930579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4eb30900-c210-45ec-b8a0-76e375e49b92 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:10.931019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4eb30900-c210-45ec-b8a0-76e375e49b92 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.090160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4eb30900-c210-45ec-b8a0-76e375e49b92 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:11.103710 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4eb30900-c210-45ec-b8a0-76e375e49b92 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.188752 May 19 04:44:11.104325 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1634/3196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:10 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:11.109224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4a8a15d0-94f2-4745-b64e-3d01c2e2e470 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:11.110238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4a8a15d0-94f2-4745-b64e-3d01c2e2e470 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:11.135832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a8a15d0-94f2-4745-b64e-3d01c2e2e470 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:11.136293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a8a15d0-94f2-4745-b64e-3d01c2e2e470 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.137390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a8a15d0-94f2-4745-b64e-3d01c2e2e470 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:11.138199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a8a15d0-94f2-4745-b64e-3d01c2e2e470 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.194771 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4a8a15d0-94f2-4745-b64e-3d01c2e2e470 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089372 May 19 04:44:11.200409 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1635/3197] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:11 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:11.211536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60d18ecd-43cc-4087-a5a8-40e24b180b22 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:11.213970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60d18ecd-43cc-4087-a5a8-40e24b180b22 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:11.230335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60d18ecd-43cc-4087-a5a8-40e24b180b22 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:11.231063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60d18ecd-43cc-4087-a5a8-40e24b180b22 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.231992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60d18ecd-43cc-4087-a5a8-40e24b180b22 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:11.233248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60d18ecd-43cc-4087-a5a8-40e24b180b22 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.479701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60d18ecd-43cc-4087-a5a8-40e24b180b22 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:11.494534 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60d18ecd-43cc-4087-a5a8-40e24b180b22 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1264 microversion: 2.1 time: 0.289285 May 19 04:44:11.495224 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1636/3198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:11 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1264 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:11.508169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:11.509324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:11.526736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:11.527527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.529066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:11.531821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.781812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:44:11.783121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:44:11.788675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:44:11.789265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:44:11.791378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:44:11.806217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:11.807164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.808119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:11.809280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.833529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Getting quotas for project cd18dc85a9074ccebec5de473b90fb27. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:44:11.850157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Getting quotas for user b645d221b97b4d9fb5c3ae3bc0fec0ed and project cd18dc85a9074ccebec5de473b90fb27. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:44:11.867060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:44:11.869432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:44:11.942001 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-66dbd6c5-a4aa-465d-ad81-f95ee34b054a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.034754 May 19 04:44:11.946599 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1563/3199] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:44:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:44:11.958905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-73bf0851-3115-44a9-8527-fa82d3e9e4be req-434ede4d-91db-49b3-8fd7-be8623cb61d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd7e64-3246-40ea-844d-5e88603a9e20", "name": "network-vif-plugged", "status": "completed", "tag": "60433ce3-7f6a-48fa-9b49-9f65b436fd14"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:11.975822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-73bf0851-3115-44a9-8527-fa82d3e9e4be req-434ede4d-91db-49b3-8fd7-be8623cb61d6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:11.976978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-73bf0851-3115-44a9-8527-fa82d3e9e4be req-434ede4d-91db-49b3-8fd7-be8623cb61d6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:11.992781 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-73bf0851-3115-44a9-8527-fa82d3e9e4be req-434ede4d-91db-49b3-8fd7-be8623cb61d6 service nova] Creating event network-vif-plugged:60433ce3-7f6a-48fa-9b49-9f65b436fd14 for instance 98bd7e64-3246-40ea-844d-5e88603a9e20 on n-h2-766726-30 May 19 04:44:11.999356 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-73bf0851-3115-44a9-8527-fa82d3e9e4be req-434ede4d-91db-49b3-8fd7-be8623cb61d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050412 May 19 04:44:12.000926 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1564/3200] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:12.008545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d085d118-1d61-4cf0-b4b4-5b6356b45d34 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:12.009665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d085d118-1d61-4cf0-b4b4-5b6356b45d34 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:12.018119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d085d118-1d61-4cf0-b4b4-5b6356b45d34 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:12.018945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d085d118-1d61-4cf0-b4b4-5b6356b45d34 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:12.020078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d085d118-1d61-4cf0-b4b4-5b6356b45d34 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:12.021494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d085d118-1d61-4cf0-b4b4-5b6356b45d34 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:12.153428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:12.163148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:12.164738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:12.174360 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b64cdff4-4f93-4744-931c-c00739b97dfb tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2961 microversion: 2.42 time: 0.677313 May 19 04:44:12.176008 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1637/3201] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:11 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2961 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:12.188487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f6803819-3a33-44bc-9951-3af270a259e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:12.189248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f6803819-3a33-44bc-9951-3af270a259e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:12.357986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f6803819-3a33-44bc-9951-3af270a259e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:12.366495 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f6803819-3a33-44bc-9951-3af270a259e5 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1213 microversion: 2.1 time: 0.189357 May 19 04:44:12.378190 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1638/3202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:12 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1213 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:12.383856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c6cf6af-7d85-4c8b-8828-83d0f5a799b2 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:12.384713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2c6cf6af-7d85-4c8b-8828-83d0f5a799b2 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:12.395057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c6cf6af-7d85-4c8b-8828-83d0f5a799b2 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:12.396530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c6cf6af-7d85-4c8b-8828-83d0f5a799b2 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:12.400011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c6cf6af-7d85-4c8b-8828-83d0f5a799b2 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:12.400536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c6cf6af-7d85-4c8b-8828-83d0f5a799b2 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:12.567260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2c6cf6af-7d85-4c8b-8828-83d0f5a799b2 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:12.576465 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c6cf6af-7d85-4c8b-8828-83d0f5a799b2 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.196161 May 19 04:44:12.577348 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1639/3203] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:12 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:12.582409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad6f7299-28b9-4ef0-a4ba-d6f93bf976dc tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:12.590978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ad6f7299-28b9-4ef0-a4ba-d6f93bf976dc tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:12.608872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad6f7299-28b9-4ef0-a4ba-d6f93bf976dc tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:12.609672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad6f7299-28b9-4ef0-a4ba-d6f93bf976dc tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:12.610655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad6f7299-28b9-4ef0-a4ba-d6f93bf976dc tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:12.611292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad6f7299-28b9-4ef0-a4ba-d6f93bf976dc tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:12.616213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:12.672737 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad6f7299-28b9-4ef0-a4ba-d6f93bf976dc tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094071 May 19 04:44:12.673492 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1640/3204] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:12 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:12.690949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2a458bb-1047-4777-ac78-07b624612593 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:12.691954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f2a458bb-1047-4777-ac78-07b624612593 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:12.699139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2a458bb-1047-4777-ac78-07b624612593 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:12.699951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2a458bb-1047-4777-ac78-07b624612593 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:12.700994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2a458bb-1047-4777-ac78-07b624612593 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:12.702596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2a458bb-1047-4777-ac78-07b624612593 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:12.855451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d085d118-1d61-4cf0-b4b4-5b6356b45d34 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:12.866973 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d085d118-1d61-4cf0-b4b4-5b6356b45d34 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.864193 May 19 04:44:12.870853 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1565/3205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:12 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:12.902556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f2a458bb-1047-4777-ac78-07b624612593 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:12.921034 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2a458bb-1047-4777-ac78-07b624612593 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1270 microversion: 2.1 time: 0.233904 May 19 04:44:12.927207 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1641/3206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:12 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1270 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:13.197178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:13.197896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:13.218467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:13.222310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:13.228258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:13.229865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:13.400001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d6b12df-9c7d-4d47-acd9-9351ef08bdca tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:13.401786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d6b12df-9c7d-4d47-acd9-9351ef08bdca tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:13.429344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6b12df-9c7d-4d47-acd9-9351ef08bdca tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:13.430256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6b12df-9c7d-4d47-acd9-9351ef08bdca tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:13.431251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6b12df-9c7d-4d47-acd9-9351ef08bdca tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:13.431902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6b12df-9c7d-4d47-acd9-9351ef08bdca tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:13.602979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d6b12df-9c7d-4d47-acd9-9351ef08bdca tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:13.631174 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d6b12df-9c7d-4d47-acd9-9351ef08bdca tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1265 microversion: 2.1 time: 0.240215 May 19 04:44:13.635447 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1642/3207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:13 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:13.657796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dcc1cf42-f81a-47ba-820e-8158d9f22211 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:13.658867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dcc1cf42-f81a-47ba-820e-8158d9f22211 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:13.670205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcc1cf42-f81a-47ba-820e-8158d9f22211 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:13.685829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcc1cf42-f81a-47ba-820e-8158d9f22211 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:13.689055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcc1cf42-f81a-47ba-820e-8158d9f22211 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:13.690452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dcc1cf42-f81a-47ba-820e-8158d9f22211 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:13.898531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:13.921349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:13.933266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:13.935247 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5d74196b-429c-42f5-9e0f-39893bbd5828 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2961 microversion: 2.42 time: 0.744561 May 19 04:44:13.936046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1566/3208] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:13 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2961 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:13.940874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e461881d-47d4-4648-be0a-b89f20d3e489 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:13.942089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e461881d-47d4-4648-be0a-b89f20d3e489 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:13.959596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e461881d-47d4-4648-be0a-b89f20d3e489 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:13.960305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e461881d-47d4-4648-be0a-b89f20d3e489 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:13.961288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e461881d-47d4-4648-be0a-b89f20d3e489 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:13.961888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e461881d-47d4-4648-be0a-b89f20d3e489 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:14.030766 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e461881d-47d4-4648-be0a-b89f20d3e489 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093452 May 19 04:44:14.031475 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1567/3209] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:13 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:14.049240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa20f731-4c49-4f31-baf8-0402c9e82b53 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:14.057359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aa20f731-4c49-4f31-baf8-0402c9e82b53 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:14.064052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa20f731-4c49-4f31-baf8-0402c9e82b53 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:14.065566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa20f731-4c49-4f31-baf8-0402c9e82b53 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:14.072140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa20f731-4c49-4f31-baf8-0402c9e82b53 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:14.074172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dcc1cf42-f81a-47ba-820e-8158d9f22211 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:14.085405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa20f731-4c49-4f31-baf8-0402c9e82b53 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:14.090683 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dcc1cf42-f81a-47ba-820e-8158d9f22211 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.450641 May 19 04:44:14.093359 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1643/3210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:13 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:14.098511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fd22ab84-b806-4f8a-b581-202119244652 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:14.101860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fd22ab84-b806-4f8a-b581-202119244652 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:14.112769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd22ab84-b806-4f8a-b581-202119244652 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:14.116482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd22ab84-b806-4f8a-b581-202119244652 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:14.117519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd22ab84-b806-4f8a-b581-202119244652 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:14.120374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd22ab84-b806-4f8a-b581-202119244652 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.118322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aa20f731-4c49-4f31-baf8-0402c9e82b53 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:15.128997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aa20f731-4c49-4f31-baf8-0402c9e82b53 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 1.091955 May 19 04:44:15.137621 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1568/3211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:14 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:15.147432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3a726b1-9e18-4238-9c25-e9b97dc74192 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:15.159200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3a726b1-9e18-4238-9c25-e9b97dc74192 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:15.166753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3a726b1-9e18-4238-9c25-e9b97dc74192 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:15.168116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3a726b1-9e18-4238-9c25-e9b97dc74192 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.169366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3a726b1-9e18-4238-9c25-e9b97dc74192 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:15.170035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3a726b1-9e18-4238-9c25-e9b97dc74192 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.244358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fd22ab84-b806-4f8a-b581-202119244652 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:15.267478 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fd22ab84-b806-4f8a-b581-202119244652 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1312 microversion: 2.1 time: 1.172453 May 19 04:44:15.268008 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1644/3212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:14 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1312 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:15.281991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:15.282611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:15.304928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:15.308415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.308748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:15.309265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.310414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3a726b1-9e18-4238-9c25-e9b97dc74192 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:15.319020 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3a726b1-9e18-4238-9c25-e9b97dc74192 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1271 microversion: 2.1 time: 0.180060 May 19 04:44:15.323725 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1569/3213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:15 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:15.341315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5445d07-c388-4c01-996b-5f6879fc92e3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:15.343840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e5445d07-c388-4c01-996b-5f6879fc92e3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:15.365187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5445d07-c388-4c01-996b-5f6879fc92e3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:15.366035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5445d07-c388-4c01-996b-5f6879fc92e3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.367052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5445d07-c388-4c01-996b-5f6879fc92e3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:15.367712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5445d07-c388-4c01-996b-5f6879fc92e3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.431993 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e5445d07-c388-4c01-996b-5f6879fc92e3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098058 May 19 04:44:15.436379 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1570/3214] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:15 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:15.442010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-db0c9840-3493-4747-a0c8-939b1d88b564 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:15.442632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-db0c9840-3493-4747-a0c8-939b1d88b564 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:15.467272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db0c9840-3493-4747-a0c8-939b1d88b564 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:15.467976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db0c9840-3493-4747-a0c8-939b1d88b564 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.468955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db0c9840-3493-4747-a0c8-939b1d88b564 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:15.469578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db0c9840-3493-4747-a0c8-939b1d88b564 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.615709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-db0c9840-3493-4747-a0c8-939b1d88b564 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:15.630504 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-db0c9840-3493-4747-a0c8-939b1d88b564 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.192573 May 19 04:44:15.631308 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1571/3215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:15 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:15.636260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2a13d6fa-626d-4792-a5ae-cbc1db17ac49 req-1eb59f88-f348-44bd-bde1-490293985b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-unplugged", "status": "completed", "tag": "11827578-b39a-4078-b09c-f790673f88b0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:15.645694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2a13d6fa-626d-4792-a5ae-cbc1db17ac49 req-1eb59f88-f348-44bd-bde1-490293985b6f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:15.646333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2a13d6fa-626d-4792-a5ae-cbc1db17ac49 req-1eb59f88-f348-44bd-bde1-490293985b6f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:15.660104 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2a13d6fa-626d-4792-a5ae-cbc1db17ac49 req-1eb59f88-f348-44bd-bde1-490293985b6f service nova] Creating event network-vif-unplugged:11827578-b39a-4078-b09c-f790673f88b0 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:15.667627 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2a13d6fa-626d-4792-a5ae-cbc1db17ac49 req-1eb59f88-f348-44bd-bde1-490293985b6f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034688 May 19 04:44:15.670485 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1572/3216] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:15.895130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:15.905245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:15.912459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:15.927478 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e9c545e1-f942-40ad-9e60-5fabe22c3879 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2940 microversion: 2.42 time: 0.649232 May 19 04:44:15.928687 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1645/3217] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:15 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2940 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:16.160170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-124f3197-260a-41e3-a38c-de4119c66278 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:16.161144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-124f3197-260a-41e3-a38c-de4119c66278 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:16.180470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-124f3197-260a-41e3-a38c-de4119c66278 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:16.195248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-124f3197-260a-41e3-a38c-de4119c66278 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:16.201099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-124f3197-260a-41e3-a38c-de4119c66278 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:16.202015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-124f3197-260a-41e3-a38c-de4119c66278 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:16.284976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c340044-6d11-4c22-8ccd-38e4485dc794 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:16.290867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2c340044-6d11-4c22-8ccd-38e4485dc794 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:16.300630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c340044-6d11-4c22-8ccd-38e4485dc794 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:16.318797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c340044-6d11-4c22-8ccd-38e4485dc794 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:16.321635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c340044-6d11-4c22-8ccd-38e4485dc794 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:16.341903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c340044-6d11-4c22-8ccd-38e4485dc794 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:17.442934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-124f3197-260a-41e3-a38c-de4119c66278 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:17.458506 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-124f3197-260a-41e3-a38c-de4119c66278 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 1.304506 May 19 04:44:17.469118 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1573/3218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:16 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:17.474944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-09c4139e-88c7-45a7-ae27-33a54931b442 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:17.485983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-09c4139e-88c7-45a7-ae27-33a54931b442 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:17.506299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09c4139e-88c7-45a7-ae27-33a54931b442 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:17.507486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09c4139e-88c7-45a7-ae27-33a54931b442 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:17.508494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09c4139e-88c7-45a7-ae27-33a54931b442 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:17.509181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09c4139e-88c7-45a7-ae27-33a54931b442 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:17.537512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2c340044-6d11-4c22-8ccd-38e4485dc794 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:17.548361 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c340044-6d11-4c22-8ccd-38e4485dc794 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1312 microversion: 2.1 time: 1.268054 May 19 04:44:17.548994 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1646/3219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:16 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1312 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:17.574511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-690d2e44-9b0c-4157-8cef-326038a95947 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:17.575580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-690d2e44-9b0c-4157-8cef-326038a95947 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:17.587312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-690d2e44-9b0c-4157-8cef-326038a95947 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:17.601887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-690d2e44-9b0c-4157-8cef-326038a95947 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:17.609231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-690d2e44-9b0c-4157-8cef-326038a95947 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:17.609730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-690d2e44-9b0c-4157-8cef-326038a95947 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:17.712757 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-690d2e44-9b0c-4157-8cef-326038a95947 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162607 May 19 04:44:17.719277 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1647/3220] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:17 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:17.729156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-656a0c49-a269-4710-bb25-d9a9a2762025 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:17.729796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-656a0c49-a269-4710-bb25-d9a9a2762025 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:17.742932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-656a0c49-a269-4710-bb25-d9a9a2762025 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:17.743389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-656a0c49-a269-4710-bb25-d9a9a2762025 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:17.749409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-656a0c49-a269-4710-bb25-d9a9a2762025 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:17.749906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-656a0c49-a269-4710-bb25-d9a9a2762025 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:17.917182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-09c4139e-88c7-45a7-ae27-33a54931b442 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:17.923707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:17.926408 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-09c4139e-88c7-45a7-ae27-33a54931b442 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1271 microversion: 2.1 time: 0.455923 May 19 04:44:17.929781 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1574/3221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:17 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1271 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:17.940199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-75c6bead-0ed0-4153-975b-c635df9de133 req-10d9ef9b-43be-4915-bd29-e6297ad11d4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f45fc0-830a-4e19-a6da-713dee4d1484", "tag": "1c0105bd-12fc-4a28-bacb-da55db20d3ca"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:17.961354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-75c6bead-0ed0-4153-975b-c635df9de133 req-10d9ef9b-43be-4915-bd29-e6297ad11d4c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:17.962059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-75c6bead-0ed0-4153-975b-c635df9de133 req-10d9ef9b-43be-4915-bd29-e6297ad11d4c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:17.991129 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-75c6bead-0ed0-4153-975b-c635df9de133 req-10d9ef9b-43be-4915-bd29-e6297ad11d4c service nova] Creating event network-changed:1c0105bd-12fc-4a28-bacb-da55db20d3ca for instance 35f45fc0-830a-4e19-a6da-713dee4d1484 on n-h2-766726-30 May 19 04:44:17.998173 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-75c6bead-0ed0-4153-975b-c635df9de133 req-10d9ef9b-43be-4915-bd29-e6297ad11d4c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061683 May 19 04:44:18.011853 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1575/3222] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:18.031077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:18.032170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:18.046687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:18.047495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:18.048499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:18.050318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:18.058484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-656a0c49-a269-4710-bb25-d9a9a2762025 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:18.073067 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-656a0c49-a269-4710-bb25-d9a9a2762025 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.352659 May 19 04:44:18.075077 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1648/3223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:17 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:18.089014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c6a7100e-fb12-470f-bee8-ca6bb17e0367 req-f5336cba-0ed8-4653-81a9-ce58e50d7b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-unplugged", "status": "completed", "tag": "081b7f90-40d2-45cb-88dd-efe0b2900ed6"}, {"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-unplugged", "status": "completed", "tag": "251915bf-6825-4c34-bd81-cf630c80845a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:18.113443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c6a7100e-fb12-470f-bee8-ca6bb17e0367 req-f5336cba-0ed8-4653-81a9-ce58e50d7b37 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:18.114163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c6a7100e-fb12-470f-bee8-ca6bb17e0367 req-f5336cba-0ed8-4653-81a9-ce58e50d7b37 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:18.145947 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c6a7100e-fb12-470f-bee8-ca6bb17e0367 req-f5336cba-0ed8-4653-81a9-ce58e50d7b37 service nova] Creating event network-vif-unplugged:081b7f90-40d2-45cb-88dd-efe0b2900ed6 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:18.146676 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c6a7100e-fb12-470f-bee8-ca6bb17e0367 req-f5336cba-0ed8-4653-81a9-ce58e50d7b37 service nova] Creating event network-vif-unplugged:251915bf-6825-4c34-bd81-cf630c80845a for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:18.162543 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c6a7100e-fb12-470f-bee8-ca6bb17e0367 req-f5336cba-0ed8-4653-81a9-ce58e50d7b37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.084764 May 19 04:44:18.167575 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1649/3224] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:18.476893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a309307-e9bb-4a35-b2c6-6ea4a5e0e243 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:18.477780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2a309307-e9bb-4a35-b2c6-6ea4a5e0e243 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:18.496728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a309307-e9bb-4a35-b2c6-6ea4a5e0e243 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:18.501762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a309307-e9bb-4a35-b2c6-6ea4a5e0e243 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:18.507481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a309307-e9bb-4a35-b2c6-6ea4a5e0e243 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:18.508377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a309307-e9bb-4a35-b2c6-6ea4a5e0e243 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:19.353733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:19.536364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2a309307-e9bb-4a35-b2c6-6ea4a5e0e243 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:19.555260 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2a309307-e9bb-4a35-b2c6-6ea4a5e0e243 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 1.077908 May 19 04:44:19.566127 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1650/3225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:18 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:19.571601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82afa39e-b970-4b9b-9d9c-db8acc2c43cd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:19.573050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82afa39e-b970-4b9b-9d9c-db8acc2c43cd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:19.582320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82afa39e-b970-4b9b-9d9c-db8acc2c43cd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:19.583094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82afa39e-b970-4b9b-9d9c-db8acc2c43cd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:19.584115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82afa39e-b970-4b9b-9d9c-db8acc2c43cd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:19.584769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82afa39e-b970-4b9b-9d9c-db8acc2c43cd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:19.638252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:19.649457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:19.651426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:19.652961 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ea8b3d06-c3a1-42af-a20f-b181b1c5cdaa tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2919 microversion: 2.42 time: 1.632309 May 19 04:44:19.654185 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1576/3226] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:18 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2919 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:19.660297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7a83ea44-4d8a-46b6-8598-a96cfb565e17 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:19.661555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7a83ea44-4d8a-46b6-8598-a96cfb565e17 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:19.669715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a83ea44-4d8a-46b6-8598-a96cfb565e17 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:19.670532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a83ea44-4d8a-46b6-8598-a96cfb565e17 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:19.671631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a83ea44-4d8a-46b6-8598-a96cfb565e17 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:19.672305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a83ea44-4d8a-46b6-8598-a96cfb565e17 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:19.714855 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7a83ea44-4d8a-46b6-8598-a96cfb565e17 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059359 May 19 04:44:19.716117 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1577/3227] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:44:19 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:44:19.736384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-38890595-879d-4b8c-a76b-506c47ab41a3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:19.743604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-38890595-879d-4b8c-a76b-506c47ab41a3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:19.761239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38890595-879d-4b8c-a76b-506c47ab41a3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:19.765405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38890595-879d-4b8c-a76b-506c47ab41a3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:19.767804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38890595-879d-4b8c-a76b-506c47ab41a3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:19.769132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-38890595-879d-4b8c-a76b-506c47ab41a3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.080019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82afa39e-b970-4b9b-9d9c-db8acc2c43cd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:20.088430 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82afa39e-b970-4b9b-9d9c-db8acc2c43cd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1312 microversion: 2.1 time: 0.520916 May 19 04:44:20.101354 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1651/3228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:19 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1312 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:20.115571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d693e94-a12e-42f1-8041-1cf12dd21ab3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:20.122917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d693e94-a12e-42f1-8041-1cf12dd21ab3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:20.133589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d693e94-a12e-42f1-8041-1cf12dd21ab3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.138498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d693e94-a12e-42f1-8041-1cf12dd21ab3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.139541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d693e94-a12e-42f1-8041-1cf12dd21ab3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.140233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d693e94-a12e-42f1-8041-1cf12dd21ab3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.350096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-38890595-879d-4b8c-a76b-506c47ab41a3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:20.362999 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-38890595-879d-4b8c-a76b-506c47ab41a3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1313 microversion: 2.1 time: 0.644930 May 19 04:44:20.363851 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1578/3229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:19 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:20.368793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b7785be-2ada-45f1-92cf-314c044a323d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:20.377833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b7785be-2ada-45f1-92cf-314c044a323d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:20.393879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b7785be-2ada-45f1-92cf-314c044a323d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.396963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b7785be-2ada-45f1-92cf-314c044a323d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.397299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0d693e94-a12e-42f1-8041-1cf12dd21ab3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:20.398753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b7785be-2ada-45f1-92cf-314c044a323d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.399420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b7785be-2ada-45f1-92cf-314c044a323d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.413439 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d693e94-a12e-42f1-8041-1cf12dd21ab3 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.310492 May 19 04:44:20.416725 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1652/3230] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:20 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:20.455688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fea943e0-737c-4b84-8403-6196290650cc req-6551c27a-269b-469f-b7cc-01f7a2e1c6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-unplugged", "status": "completed", "tag": "8dc19ac8-4427-4f73-aaa7-05481bc13e94"}, {"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-unplugged", "status": "completed", "tag": "ae40130a-66c8-4231-8905-bf545db96c13"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:20.457146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b7785be-2ada-45f1-92cf-314c044a323d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:44:20.494090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:20.520933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fea943e0-737c-4b84-8403-6196290650cc req-6551c27a-269b-469f-b7cc-01f7a2e1c6eb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.522340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fea943e0-737c-4b84-8403-6196290650cc req-6551c27a-269b-469f-b7cc-01f7a2e1c6eb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.558226 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fea943e0-737c-4b84-8403-6196290650cc req-6551c27a-269b-469f-b7cc-01f7a2e1c6eb service nova] Creating event network-vif-unplugged:8dc19ac8-4427-4f73-aaa7-05481bc13e94 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:20.559548 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fea943e0-737c-4b84-8403-6196290650cc req-6551c27a-269b-469f-b7cc-01f7a2e1c6eb service nova] Creating event network-vif-unplugged:ae40130a-66c8-4231-8905-bf545db96c13 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:20.586548 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b7785be-2ada-45f1-92cf-314c044a323d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 204 len: 0 microversion: 2.1 time: 0.221030 May 19 04:44:20.587522 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1579/3231] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:44:20 2022] DELETE /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:44:20.595810 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fea943e0-737c-4b84-8403-6196290650cc req-6551c27a-269b-469f-b7cc-01f7a2e1c6eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.161379 May 19 04:44:20.596018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3adea36-0163-4fcf-a6a9-6f578ad8fcf0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:20.597554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c3adea36-0163-4fcf-a6a9-6f578ad8fcf0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:20.604687 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1653/3232] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:20.609893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3adea36-0163-4fcf-a6a9-6f578ad8fcf0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.610553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3adea36-0163-4fcf-a6a9-6f578ad8fcf0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.611603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3adea36-0163-4fcf-a6a9-6f578ad8fcf0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.612148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3adea36-0163-4fcf-a6a9-6f578ad8fcf0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.620562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6f0234e4-0ca6-405f-a2e6-bb081a92134c req-c52950d0-0a90-40dc-88fa-cba30e916850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-deleted", "tag": "8dc19ac8-4427-4f73-aaa7-05481bc13e94"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:20.648695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6f0234e4-0ca6-405f-a2e6-bb081a92134c req-c52950d0-0a90-40dc-88fa-cba30e916850 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.651160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6f0234e4-0ca6-405f-a2e6-bb081a92134c req-c52950d0-0a90-40dc-88fa-cba30e916850 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.683111 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6f0234e4-0ca6-405f-a2e6-bb081a92134c req-c52950d0-0a90-40dc-88fa-cba30e916850 service nova] Creating event network-vif-deleted:8dc19ac8-4427-4f73-aaa7-05481bc13e94 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:20.701166 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6f0234e4-0ca6-405f-a2e6-bb081a92134c req-c52950d0-0a90-40dc-88fa-cba30e916850 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088346 May 19 04:44:20.702409 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1654/3233] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:20.715148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-abb952e8-3dcd-4080-a378-6a1870021440 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:20.721167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-abb952e8-3dcd-4080-a378-6a1870021440 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:20.744654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-abb952e8-3dcd-4080-a378-6a1870021440 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.746495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-abb952e8-3dcd-4080-a378-6a1870021440 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:20.747501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-abb952e8-3dcd-4080-a378-6a1870021440 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:20.750775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-abb952e8-3dcd-4080-a378-6a1870021440 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:21.478965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-abb952e8-3dcd-4080-a378-6a1870021440 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:21.487086 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-abb952e8-3dcd-4080-a378-6a1870021440 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1681 microversion: 2.1 time: 0.780847 May 19 04:44:21.487950 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1655/3234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:20 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1681 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:21.493388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:21.494228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:21.514984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:21.515834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:21.516877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:21.517532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:21.621401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c3adea36-0163-4fcf-a6a9-6f578ad8fcf0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:21.630504 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3adea36-0163-4fcf-a6a9-6f578ad8fcf0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 1.040921 May 19 04:44:21.631011 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1580/3235] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:20 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:21.635862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d09fbe9-0cb8-4e00-b9cf-893aa6d6ffbb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:21.636661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2d09fbe9-0cb8-4e00-b9cf-893aa6d6ffbb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:21.644572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d09fbe9-0cb8-4e00-b9cf-893aa6d6ffbb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:21.645026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d09fbe9-0cb8-4e00-b9cf-893aa6d6ffbb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:21.645820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d09fbe9-0cb8-4e00-b9cf-893aa6d6ffbb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:21.646253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d09fbe9-0cb8-4e00-b9cf-893aa6d6ffbb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:21.832908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:21.859673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:21.972071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:21.983248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:21.985517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:21.987225 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6aed40f2-f701-4b3d-9412-56ea64e1a386 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2758 microversion: 2.42 time: 0.498586 May 19 04:44:21.988740 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1656/3236] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:21 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2758 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:21.993777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:21.994555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:22.005795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.006820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.008130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.008926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.010020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d09fbe9-0cb8-4e00-b9cf-893aa6d6ffbb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:22.021320 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d09fbe9-0cb8-4e00-b9cf-893aa6d6ffbb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1312 microversion: 2.1 time: 0.388733 May 19 04:44:22.022652 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1581/3237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:21 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:22.028588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dca34d84-b284-4230-87e6-9a9a46455725 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:22.029451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dca34d84-b284-4230-87e6-9a9a46455725 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:22.037158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dca34d84-b284-4230-87e6-9a9a46455725 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.037351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] HTTP exception thrown: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.037947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dca34d84-b284-4230-87e6-9a9a46455725 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.039635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dca34d84-b284-4230-87e6-9a9a46455725 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.040233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dca34d84-b284-4230-87e6-9a9a46455725 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Request method failure captured: May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c HTTP/1.1 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckwL3CTGV1u5BZs0M9UR3dgEus-pd3bQDZNEs9kLS-QPTPCaCRCuxNEGImq-YqJQScwUmvspAwitUZoIeyQYgEfDiusX6UUxnmlrLAPjJ-GhIEeXeU7eiXpNtztsIhnLE3VjWqckzDesoOG_GWc6MPI9QdBBjfzdkq9m7aaPmC9xlk May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.32 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 345f541c3285497685c0e59daa6a4c28 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TaggedBootDevicesTest-992125731 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/345f541c3285497685c0e59daa6a4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/345f541c3285497685c0e59daa6a4c28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/345f541c3285497685c0e59daa6a4c28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_345f541c3285497685c0e59daa6a4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TaggedBootDevicesTest-992125731 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 345f541c3285497685c0e59daa6a4c28 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TaggedBootDevicesTest-992125731 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TaggedBootDevicesTest-992125731-project May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 0cc04e71de084662ac6afa2806664050 May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TaggedBootDevicesTest-992125731-project May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '19184d52-45a9-457d-9cc8-7635125ecc4c'} May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:44:22.043931 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.048822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Returning 404 to user: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:44:22.052252 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fe0baca3-6342-4afa-b9b1-6afa4598bcac tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "DELETE /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 404 len: 111 microversion: 2.32 time: 0.062131 May 19 04:44:22.058391 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1657/3238] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:44:21 2022] DELETE /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:44:22.064795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cad604b1-cb40-4c69-a06e-bbb7535b7f6b tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:22.069401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cad604b1-cb40-4c69-a06e-bbb7535b7f6b tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:22.084204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad604b1-cb40-4c69-a06e-bbb7535b7f6b tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.086151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad604b1-cb40-4c69-a06e-bbb7535b7f6b tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.087207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad604b1-cb40-4c69-a06e-bbb7535b7f6b tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.089555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad604b1-cb40-4c69-a06e-bbb7535b7f6b tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.230053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cad604b1-cb40-4c69-a06e-bbb7535b7f6b tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:22.241514 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cad604b1-cb40-4c69-a06e-bbb7535b7f6b tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.181468 May 19 04:44:22.251816 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1658/3239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:22 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:22.258517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:22.261431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] [instance: 19184d52-45a9-457d-9cc8-7635125ecc4c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:22.271495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.273815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.276924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.278048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.293224 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] HTTP exception thrown: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Request method failure captured: May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c HTTP/1.1 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihckwL3CTGV1u5BZs0M9UR3dgEus-pd3bQDZNEs9kLS-QPTPCaCRCuxNEGImq-YqJQScwUmvspAwitUZoIeyQYgEfDiusX6UUxnmlrLAPjJ-GhIEeXeU7eiXpNtztsIhnLE3VjWqckzDesoOG_GWc6MPI9QdBBjfzdkq9m7aaPmC9xlk May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.32 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 345f541c3285497685c0e59daa6a4c28 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TaggedBootDevicesTest-992125731 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/345f541c3285497685c0e59daa6a4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/345f541c3285497685c0e59daa6a4c28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/345f541c3285497685c0e59daa6a4c28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_345f541c3285497685c0e59daa6a4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TaggedBootDevicesTest-992125731 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 345f541c3285497685c0e59daa6a4c28 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TaggedBootDevicesTest-992125731 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TaggedBootDevicesTest-992125731-project May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 0cc04e71de084662ac6afa2806664050 May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TaggedBootDevicesTest-992125731-project May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '19184d52-45a9-457d-9cc8-7635125ecc4c'} May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:22.295108 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.298923 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:22.298923 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:22.298923 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:22.298923 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:44:22.298923 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:44:22.298923 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. May 19 04:44:22.298923 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:22.301717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] Returning 404 to user: Instance 19184d52-45a9-457d-9cc8-7635125ecc4c could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:44:22.302794 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef216b51-3807-4084-8181-be67c99f083e tempest-TaggedBootDevicesTest-992125731 tempest-TaggedBootDevicesTest-992125731-project] 10.222.0.58 "GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c" status: 404 len: 111 microversion: 2.32 time: 0.049596 May 19 04:44:22.303888 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1659/3240] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:22 2022] GET /compute/v2.1/servers/19184d52-45a9-457d-9cc8-7635125ecc4c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:44:22.482346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dca34d84-b284-4230-87e6-9a9a46455725 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:22.493413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dca34d84-b284-4230-87e6-9a9a46455725 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1313 microversion: 2.1 time: 0.469034 May 19 04:44:22.494349 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1582/3241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:22 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:22.517594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f71bff7-b554-42e1-b5c2-5ba5033c8154 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:22.521531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f71bff7-b554-42e1-b5c2-5ba5033c8154 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:22.530482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:22.534993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f71bff7-b554-42e1-b5c2-5ba5033c8154 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.536815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f71bff7-b554-42e1-b5c2-5ba5033c8154 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.537816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f71bff7-b554-42e1-b5c2-5ba5033c8154 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.538416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f71bff7-b554-42e1-b5c2-5ba5033c8154 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.544287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:22.647326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64a43d66-36b7-4739-b713-5d69dd21ceee tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:22.647964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64a43d66-36b7-4739-b713-5d69dd21ceee tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:22.660925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64a43d66-36b7-4739-b713-5d69dd21ceee tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.661581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64a43d66-36b7-4739-b713-5d69dd21ceee tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:22.662559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64a43d66-36b7-4739-b713-5d69dd21ceee tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:22.669193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64a43d66-36b7-4739-b713-5d69dd21ceee tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:23.550408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-64a43d66-36b7-4739-b713-5d69dd21ceee tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:23.565170 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64a43d66-36b7-4739-b713-5d69dd21ceee tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.921580 May 19 04:44:23.577766 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1583/3242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:22 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:23.585620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:23.586641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:23.601458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:23.602313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:23.603967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:23.604679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:23.615042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f71bff7-b554-42e1-b5c2-5ba5033c8154 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:23.626691 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f71bff7-b554-42e1-b5c2-5ba5033c8154 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1681 microversion: 2.1 time: 1.124666 May 19 04:44:23.627682 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1660/3243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:22 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1681 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:23.638345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51aa069a-508a-4cc2-bfe9-08f156c4138c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:23.639035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-51aa069a-508a-4cc2-bfe9-08f156c4138c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:23.655505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51aa069a-508a-4cc2-bfe9-08f156c4138c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:23.655979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51aa069a-508a-4cc2-bfe9-08f156c4138c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:23.656792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51aa069a-508a-4cc2-bfe9-08f156c4138c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:23.657261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51aa069a-508a-4cc2-bfe9-08f156c4138c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:23.934184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:23.955767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:23.961298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:23.962639 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed12bc87-6814-4e2d-9f10-2d14bb1774f4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2711 microversion: 2.42 time: 0.382426 May 19 04:44:23.963233 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1584/3244] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:23 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2711 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:23.971235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-cdb1678d-ca89-4723-8852-9bb17e1fd6f2 req-d6527111-0a2b-4bf9-a037-c86aaf13b343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29ff13b-411b-4e3a-8974-55cf7429a062", "tag": "483885c7-b80b-46a5-bf42-a6ef218263a7"}, {"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-deleted", "tag": "081b7f90-40d2-45cb-88dd-efe0b2900ed6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:23.985147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-51aa069a-508a-4cc2-bfe9-08f156c4138c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:23.991745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cdb1678d-ca89-4723-8852-9bb17e1fd6f2 req-d6527111-0a2b-4bf9-a037-c86aaf13b343 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:23.992200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cdb1678d-ca89-4723-8852-9bb17e1fd6f2 req-d6527111-0a2b-4bf9-a037-c86aaf13b343 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:23.996642 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51aa069a-508a-4cc2-bfe9-08f156c4138c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1312 microversion: 2.1 time: 0.367607 May 19 04:44:24.011748 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1661/3245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:23 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1312 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:24.013181 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cdb1678d-ca89-4723-8852-9bb17e1fd6f2 req-d6527111-0a2b-4bf9-a037-c86aaf13b343 service nova] Creating event network-changed:483885c7-b80b-46a5-bf42-a6ef218263a7 for instance f29ff13b-411b-4e3a-8974-55cf7429a062 on n-h1-766726-30 May 19 04:44:24.014019 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cdb1678d-ca89-4723-8852-9bb17e1fd6f2 req-d6527111-0a2b-4bf9-a037-c86aaf13b343 service nova] Creating event network-vif-deleted:081b7f90-40d2-45cb-88dd-efe0b2900ed6 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:24.025030 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-cdb1678d-ca89-4723-8852-9bb17e1fd6f2 req-d6527111-0a2b-4bf9-a037-c86aaf13b343 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.060589 May 19 04:44:24.026422 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1585/3246] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:24.027205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a5e1b8c8-f12e-4a84-bd6c-70fe20f5072c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:24.028043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a5e1b8c8-f12e-4a84-bd6c-70fe20f5072c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:24.038764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f84c5b67-cb65-4ad9-9ab4-603748643f1d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:24.039710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f84c5b67-cb65-4ad9-9ab4-603748643f1d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:24.050015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5e1b8c8-f12e-4a84-bd6c-70fe20f5072c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:24.052133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5e1b8c8-f12e-4a84-bd6c-70fe20f5072c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:24.054078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5e1b8c8-f12e-4a84-bd6c-70fe20f5072c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:24.054763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5e1b8c8-f12e-4a84-bd6c-70fe20f5072c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:24.055882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f84c5b67-cb65-4ad9-9ab4-603748643f1d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:24.057325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f84c5b67-cb65-4ad9-9ab4-603748643f1d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:24.057325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f84c5b67-cb65-4ad9-9ab4-603748643f1d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:24.057792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f84c5b67-cb65-4ad9-9ab4-603748643f1d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:24.259305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a5e1b8c8-f12e-4a84-bd6c-70fe20f5072c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:24.277002 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a5e1b8c8-f12e-4a84-bd6c-70fe20f5072c tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.254986 May 19 04:44:24.278954 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1662/3247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:24 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:24.429991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f84c5b67-cb65-4ad9-9ab4-603748643f1d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:24.441902 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f84c5b67-cb65-4ad9-9ab4-603748643f1d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1313 microversion: 2.1 time: 0.413442 May 19 04:44:24.444021 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1586/3248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:24 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:24.584735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-521afcf5-dade-4fbf-9033-fec8efc18568 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:24.585400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-521afcf5-dade-4fbf-9033-fec8efc18568 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:24.603534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-521afcf5-dade-4fbf-9033-fec8efc18568 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:24.603998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-521afcf5-dade-4fbf-9033-fec8efc18568 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:24.604791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-521afcf5-dade-4fbf-9033-fec8efc18568 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:24.605264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-521afcf5-dade-4fbf-9033-fec8efc18568 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:24.644161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-08474837-d2ad-41af-9951-580f5c7a8139 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:24.645173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-08474837-d2ad-41af-9951-580f5c7a8139 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:24.660057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-08474837-d2ad-41af-9951-580f5c7a8139 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:24.660803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-08474837-d2ad-41af-9951-580f5c7a8139 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:24.662074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-08474837-d2ad-41af-9951-580f5c7a8139 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:24.665041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-08474837-d2ad-41af-9951-580f5c7a8139 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:25.013547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-08474837-d2ad-41af-9951-580f5c7a8139 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:25.026844 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-08474837-d2ad-41af-9951-580f5c7a8139 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 200 len: 1613 microversion: 2.1 time: 0.383158 May 19 04:44:25.028146 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1587/3249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:24 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 1613 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:25.034478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a7d26a07-5528-424e-8fec-4477360fe537 req-39d696cd-cea1-4b69-a1b0-d5e3742f3814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e865dff-7659-43e8-8069-81e6760080d7", "name": "network-vif-deleted", "tag": "af735cc6-7354-4151-a169-9174e6e19bc9"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:25.057771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a7d26a07-5528-424e-8fec-4477360fe537 req-39d696cd-cea1-4b69-a1b0-d5e3742f3814 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:25.060886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a7d26a07-5528-424e-8fec-4477360fe537 req-39d696cd-cea1-4b69-a1b0-d5e3742f3814 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:25.085353 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a7d26a07-5528-424e-8fec-4477360fe537 req-39d696cd-cea1-4b69-a1b0-d5e3742f3814 service nova] Creating event network-vif-deleted:af735cc6-7354-4151-a169-9174e6e19bc9 for instance 7e865dff-7659-43e8-8069-81e6760080d7 on n-h1-766726-30 May 19 04:44:25.098333 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a7d26a07-5528-424e-8fec-4477360fe537 req-39d696cd-cea1-4b69-a1b0-d5e3742f3814 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068503 May 19 04:44:25.103054 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1588/3250] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:25.116863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:25.118000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:25.131050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:25.134696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:25.135802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:25.136464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:25.363238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-521afcf5-dade-4fbf-9033-fec8efc18568 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:25.376773 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-521afcf5-dade-4fbf-9033-fec8efc18568 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.794931 May 19 04:44:25.387821 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1663/3251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:24 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:25.403253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eeca21f4-3ff3-4d07-b328-5e73fa29d1ea tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:25.404158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eeca21f4-3ff3-4d07-b328-5e73fa29d1ea tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:25.421778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeca21f4-3ff3-4d07-b328-5e73fa29d1ea tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:25.422177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeca21f4-3ff3-4d07-b328-5e73fa29d1ea tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:25.422967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeca21f4-3ff3-4d07-b328-5e73fa29d1ea tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:25.427344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeca21f4-3ff3-4d07-b328-5e73fa29d1ea tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:25.702207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:25.712014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:25.718831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:25.721065 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3c432202-0168-40d3-a26a-074c1659e2c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2508 microversion: 2.42 time: 0.616587 May 19 04:44:25.750843 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1589/3252] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:25 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2508 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:25.761687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-800b211d-d6f4-4189-872b-a0a32886cbf6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:25.762501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-800b211d-d6f4-4189-872b-a0a32886cbf6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:25.782726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-800b211d-d6f4-4189-872b-a0a32886cbf6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:25.789744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-800b211d-d6f4-4189-872b-a0a32886cbf6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:25.790900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-800b211d-d6f4-4189-872b-a0a32886cbf6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:25.791512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-800b211d-d6f4-4189-872b-a0a32886cbf6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:25.932648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-800b211d-d6f4-4189-872b-a0a32886cbf6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:25.945737 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-800b211d-d6f4-4189-872b-a0a32886cbf6 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.193462 May 19 04:44:25.946351 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1590/3253] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:25 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:25.951085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-63a3360e-0464-4b0a-a989-72278cf5b23f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:25.959070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-63a3360e-0464-4b0a-a989-72278cf5b23f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:25.970056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63a3360e-0464-4b0a-a989-72278cf5b23f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:25.970724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63a3360e-0464-4b0a-a989-72278cf5b23f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:25.972448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63a3360e-0464-4b0a-a989-72278cf5b23f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:25.975735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63a3360e-0464-4b0a-a989-72278cf5b23f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:26.172138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eeca21f4-3ff3-4d07-b328-5e73fa29d1ea tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:26.186703 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eeca21f4-3ff3-4d07-b328-5e73fa29d1ea tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1312 microversion: 2.1 time: 0.797240 May 19 04:44:26.187234 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1664/3254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:25 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1312 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:26.198347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:26.198981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:26.218498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:26.219254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:26.220219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:26.220820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:26.242868 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 HTTP/1.1 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '7e865dff-7659-43e8-8069-81e6760080d7'} May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:26.244555 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8486ad7-7f30-47d3-820c-b89cd5fa3f50 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 404 len: 111 microversion: 2.1 time: 0.058047 May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1665/3255] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:26 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:44:26.253587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-40965640-2c88-407c-8798-c7e996f7389e req-204c223f-942e-4df6-b5a8-5058c3dddf3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-deleted", "tag": "11827578-b39a-4078-b09c-f790673f88b0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:26.262892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-40965640-2c88-407c-8798-c7e996f7389e req-204c223f-942e-4df6-b5a8-5058c3dddf3c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:26.263556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-40965640-2c88-407c-8798-c7e996f7389e req-204c223f-942e-4df6-b5a8-5058c3dddf3c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:26.278024 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-40965640-2c88-407c-8798-c7e996f7389e req-204c223f-942e-4df6-b5a8-5058c3dddf3c service nova] Creating event network-vif-deleted:11827578-b39a-4078-b09c-f790673f88b0 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:26.283536 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-40965640-2c88-407c-8798-c7e996f7389e req-204c223f-942e-4df6-b5a8-5058c3dddf3c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034129 May 19 04:44:26.284506 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1666/3256] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:26.296116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-774dc47a-1162-40d4-b7f1-d7491e7d509b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '.version_select at 0x7fd315ff5310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:26.359862 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-774dc47a-1162-40d4-b7f1-d7491e7d509b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-490828993" status: 202 len: 0 microversion: 2.1 time: 0.073576 May 19 04:44:26.361132 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1667/3257] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:44:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-490828993 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:44:26.394304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f78ee5b7-1096-409b-b1da-edab777f0ed3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:26.395083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f78ee5b7-1096-409b-b1da-edab777f0ed3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:26.410389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f78ee5b7-1096-409b-b1da-edab777f0ed3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:26.410847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f78ee5b7-1096-409b-b1da-edab777f0ed3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:26.411646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f78ee5b7-1096-409b-b1da-edab777f0ed3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:26.412088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f78ee5b7-1096-409b-b1da-edab777f0ed3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:26.501985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-63a3360e-0464-4b0a-a989-72278cf5b23f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:26.506239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:26.520631 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-63a3360e-0464-4b0a-a989-72278cf5b23f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1313 microversion: 2.1 time: 0.568057 May 19 04:44:26.526502 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1591/3258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:25 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:26.758936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:26.759560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:26.770686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:26.771076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:26.771875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:26.772323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:27.245061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f78ee5b7-1096-409b-b1da-edab777f0ed3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:27.258428 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f78ee5b7-1096-409b-b1da-edab777f0ed3 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.868863 May 19 04:44:27.259364 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1668/3259] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:26 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:27.267986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-043dd18e-4bc2-47e8-b335-673ed5557e9d req-ccb1cde4-a50e-4456-bf50-e37d65a0a49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f45fc0-830a-4e19-a6da-713dee4d1484", "name": "network-vif-plugged", "status": "completed", "tag": "1c0105bd-12fc-4a28-bacb-da55db20d3ca"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:27.291959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-043dd18e-4bc2-47e8-b335-673ed5557e9d req-ccb1cde4-a50e-4456-bf50-e37d65a0a49b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:27.292861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-043dd18e-4bc2-47e8-b335-673ed5557e9d req-ccb1cde4-a50e-4456-bf50-e37d65a0a49b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:27.319529 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-043dd18e-4bc2-47e8-b335-673ed5557e9d req-ccb1cde4-a50e-4456-bf50-e37d65a0a49b service nova] Creating event network-vif-plugged:1c0105bd-12fc-4a28-bacb-da55db20d3ca for instance 35f45fc0-830a-4e19-a6da-713dee4d1484 on n-h2-766726-30 May 19 04:44:27.345232 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-043dd18e-4bc2-47e8-b335-673ed5557e9d req-ccb1cde4-a50e-4456-bf50-e37d65a0a49b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075427 May 19 04:44:27.351476 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1669/3260] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:27.366284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8065b294-46ec-4bba-9c6c-65aabb489246 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:27.367007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8065b294-46ec-4bba-9c6c-65aabb489246 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:27.394581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8065b294-46ec-4bba-9c6c-65aabb489246 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:27.395284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8065b294-46ec-4bba-9c6c-65aabb489246 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:27.399012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8065b294-46ec-4bba-9c6c-65aabb489246 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:27.399473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8065b294-46ec-4bba-9c6c-65aabb489246 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:27.421798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:27.432050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:27.439752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:27.442097 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7045c482-d519-454c-9153-8d89c1406346 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 2215 microversion: 2.42 time: 0.687444 May 19 04:44:27.443191 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1592/3261] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:26 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 2215 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:27.456743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d9bf3cae-491c-4b1f-a9ea-da053374422c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:27.457398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d9bf3cae-491c-4b1f-a9ea-da053374422c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:27.477011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9bf3cae-491c-4b1f-a9ea-da053374422c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:27.477448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9bf3cae-491c-4b1f-a9ea-da053374422c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:27.478291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9bf3cae-491c-4b1f-a9ea-da053374422c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:27.478745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9bf3cae-491c-4b1f-a9ea-da053374422c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:27.610255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8065b294-46ec-4bba-9c6c-65aabb489246 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:27.631841 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8065b294-46ec-4bba-9c6c-65aabb489246 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.278756 May 19 04:44:27.632356 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1670/3262] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:27 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:27.654591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0578ad16-ce0f-4393-8f42-bcdfc6ff8d61 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:27.658244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0578ad16-ce0f-4393-8f42-bcdfc6ff8d61 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:27.686243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0578ad16-ce0f-4393-8f42-bcdfc6ff8d61 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:27.692983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0578ad16-ce0f-4393-8f42-bcdfc6ff8d61 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:27.694174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0578ad16-ce0f-4393-8f42-bcdfc6ff8d61 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:27.697896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0578ad16-ce0f-4393-8f42-bcdfc6ff8d61 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:27.888035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d9bf3cae-491c-4b1f-a9ea-da053374422c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:27.905136 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d9bf3cae-491c-4b1f-a9ea-da053374422c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1312 microversion: 2.1 time: 0.445127 May 19 04:44:27.907345 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1593/3263] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:27 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1312 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:27.991606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0578ad16-ce0f-4393-8f42-bcdfc6ff8d61 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:28.003596 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0578ad16-ce0f-4393-8f42-bcdfc6ff8d61 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1313 microversion: 2.1 time: 0.366372 May 19 04:44:28.004434 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1671/3264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:27 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:28.275671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31f7f7db-036c-43ca-96ff-8e6f3c1eb790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:28.276465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31f7f7db-036c-43ca-96ff-8e6f3c1eb790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:28.283248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31f7f7db-036c-43ca-96ff-8e6f3c1eb790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:28.283705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31f7f7db-036c-43ca-96ff-8e6f3c1eb790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:28.285063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31f7f7db-036c-43ca-96ff-8e6f3c1eb790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:28.290994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31f7f7db-036c-43ca-96ff-8e6f3c1eb790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:28.364084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5bc84a88-aa8e-4137-a544-b12b67d30069 req-4e2708fa-cea4-40fc-9e57-05bc4401b510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-deleted", "tag": "ae40130a-66c8-4231-8905-bf545db96c13"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:28.375755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5bc84a88-aa8e-4137-a544-b12b67d30069 req-4e2708fa-cea4-40fc-9e57-05bc4401b510 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:28.376485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5bc84a88-aa8e-4137-a544-b12b67d30069 req-4e2708fa-cea4-40fc-9e57-05bc4401b510 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:28.390650 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5bc84a88-aa8e-4137-a544-b12b67d30069 req-4e2708fa-cea4-40fc-9e57-05bc4401b510 service nova] Creating event network-vif-deleted:ae40130a-66c8-4231-8905-bf545db96c13 for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:28.406460 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5bc84a88-aa8e-4137-a544-b12b67d30069 req-4e2708fa-cea4-40fc-9e57-05bc4401b510 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046268 May 19 04:44:28.409956 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1672/3265] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:44:28.463322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:28.464615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:28.483434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:28.484269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:28.485563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:28.486215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:28.613826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:28.626181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:28.632342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:28.633898 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-786cf3e6-08d6-4ee6-b293-074e44b64972 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1986 microversion: 2.42 time: 0.174812 May 19 04:44:28.639817 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1673/3266] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:28 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1986 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:28.645421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6427163e-e485-4e49-8bae-73ef906b35ec tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: .version_select at 0x7fd315091310>, body: {"keypair": {"name": "tempest-keypair-588461752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeCy+TYMuWQpolZC0RLxOoYrrW/yCVQ1ljs4ahyx5rwQ0Nc9n+6/diZlJKgHDtmYL4Go87GzdO6KFYJb07QkC3K9/8sFmzIb9ZxouJUunmuoB+4K8inF6GAYwzD88zFYw=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:28.662878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-6427163e-e485-4e49-8bae-73ef906b35ec tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for project 0db6b7171e3b4a2db160855939246a40. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:44:28.675643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-6427163e-e485-4e49-8bae-73ef906b35ec tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for user a651109c72e84cab9e712ad5fbd002b6 and project 0db6b7171e3b4a2db160855939246a40. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:44:28.720264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31f7f7db-036c-43ca-96ff-8e6f3c1eb790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:28.731985 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31f7f7db-036c-43ca-96ff-8e6f3c1eb790 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.460069 May 19 04:44:28.743848 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6427163e-e485-4e49-8bae-73ef906b35ec tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102504 May 19 04:44:28.744442 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1594/3267] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:28 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:28.752812 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1674/3268] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:44:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:28.761052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-330e2156-a2db-416a-9d13-d5793b266334 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:28.763669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-330e2156-a2db-416a-9d13-d5793b266334 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:28.776448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:28.778149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-330e2156-a2db-416a-9d13-d5793b266334 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:28.779692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-330e2156-a2db-416a-9d13-d5793b266334 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:28.781056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-330e2156-a2db-416a-9d13-d5793b266334 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:28.781769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-330e2156-a2db-416a-9d13-d5793b266334 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:28.908014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-330e2156-a2db-416a-9d13-d5793b266334 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:28.922246 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-330e2156-a2db-416a-9d13-d5793b266334 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.171010 May 19 04:44:28.926419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-24a943d1-63d3-497c-8faf-e50613eefbdb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:28.927175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-24a943d1-63d3-497c-8faf-e50613eefbdb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:28.937641 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1595/3269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:28 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:28.940708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24a943d1-63d3-497c-8faf-e50613eefbdb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:28.941605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24a943d1-63d3-497c-8faf-e50613eefbdb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:28.943694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24a943d1-63d3-497c-8faf-e50613eefbdb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:28.945494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24a943d1-63d3-497c-8faf-e50613eefbdb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:29.022737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35641604-2d74-4eba-9988-fc15d5091439 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:29.023374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-35641604-2d74-4eba-9988-fc15d5091439 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:29.041706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35641604-2d74-4eba-9988-fc15d5091439 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:29.042445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35641604-2d74-4eba-9988-fc15d5091439 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:29.043868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35641604-2d74-4eba-9988-fc15d5091439 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:29.046257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35641604-2d74-4eba-9988-fc15d5091439 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:29.317332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-24a943d1-63d3-497c-8faf-e50613eefbdb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:29.336477 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-24a943d1-63d3-497c-8faf-e50613eefbdb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1312 microversion: 2.1 time: 0.415314 May 19 04:44:29.337780 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1675/3270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:28 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1312 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:29.387363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-35641604-2d74-4eba-9988-fc15d5091439 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:29.396750 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-35641604-2d74-4eba-9988-fc15d5091439 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1313 microversion: 2.1 time: 0.380808 May 19 04:44:29.398892 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1596/3271] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:29 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:29.503863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ded79777-ee23-49eb-b6a2-8153d69f40c0 req-79c57eea-7f1b-481d-ac5b-6b26c3ab35c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29ff13b-411b-4e3a-8974-55cf7429a062", "name": "network-vif-plugged", "status": "completed", "tag": "483885c7-b80b-46a5-bf42-a6ef218263a7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:29.517475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ded79777-ee23-49eb-b6a2-8153d69f40c0 req-79c57eea-7f1b-481d-ac5b-6b26c3ab35c7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:29.518059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ded79777-ee23-49eb-b6a2-8153d69f40c0 req-79c57eea-7f1b-481d-ac5b-6b26c3ab35c7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:29.537092 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ded79777-ee23-49eb-b6a2-8153d69f40c0 req-79c57eea-7f1b-481d-ac5b-6b26c3ab35c7 service nova] Creating event network-vif-plugged:483885c7-b80b-46a5-bf42-a6ef218263a7 for instance f29ff13b-411b-4e3a-8974-55cf7429a062 on n-h1-766726-30 May 19 04:44:29.544640 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ded79777-ee23-49eb-b6a2-8153d69f40c0 req-79c57eea-7f1b-481d-ac5b-6b26c3ab35c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045786 May 19 04:44:29.545738 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1676/3272] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:29.660362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:29.661230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:29.671506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:29.672268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:29.673393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:29.674036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:29.754866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df508059-2d88-420b-a5f4-2449533b2bf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:29.755849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df508059-2d88-420b-a5f4-2449533b2bf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:29.764526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df508059-2d88-420b-a5f4-2449533b2bf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:29.765205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df508059-2d88-420b-a5f4-2449533b2bf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:29.766180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df508059-2d88-420b-a5f4-2449533b2bf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:29.766774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df508059-2d88-420b-a5f4-2449533b2bf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:29.784600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:29.796558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:29.798777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:29.802459 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9d044532-3fed-4fa0-9c31-bce372b50254 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.146854 May 19 04:44:29.816541 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1597/3273] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:29 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:29.943723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c59d429c-8435-44c7-a895-3e57c1a8e53a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:29.944560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c59d429c-8435-44c7-a895-3e57c1a8e53a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:29.952127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c59d429c-8435-44c7-a895-3e57c1a8e53a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:29.952816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c59d429c-8435-44c7-a895-3e57c1a8e53a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:29.953809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c59d429c-8435-44c7-a895-3e57c1a8e53a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:29.954571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c59d429c-8435-44c7-a895-3e57c1a8e53a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.050786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c59d429c-8435-44c7-a895-3e57c1a8e53a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:30.063840 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c59d429c-8435-44c7-a895-3e57c1a8e53a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.122802 May 19 04:44:30.067427 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1598/3274] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:29 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:30.095046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-df508059-2d88-420b-a5f4-2449533b2bf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:30.107421 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df508059-2d88-420b-a5f4-2449533b2bf2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.360386 May 19 04:44:30.118494 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1677/3275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:29 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:30.357427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ecd6f1a-742b-4344-9afd-aca738a3c73d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:30.358279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ecd6f1a-742b-4344-9afd-aca738a3c73d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:30.365924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ecd6f1a-742b-4344-9afd-aca738a3c73d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:30.366553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ecd6f1a-742b-4344-9afd-aca738a3c73d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.367526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ecd6f1a-742b-4344-9afd-aca738a3c73d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:30.368121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ecd6f1a-742b-4344-9afd-aca738a3c73d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.415556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-62c5c6f2-e3f6-4817-8a79-00fa9fb9df38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:30.416851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-62c5c6f2-e3f6-4817-8a79-00fa9fb9df38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:30.425527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-62c5c6f2-e3f6-4817-8a79-00fa9fb9df38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:30.426435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-62c5c6f2-e3f6-4817-8a79-00fa9fb9df38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.427981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-62c5c6f2-e3f6-4817-8a79-00fa9fb9df38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:30.428672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-62c5c6f2-e3f6-4817-8a79-00fa9fb9df38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.663944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5ecd6f1a-742b-4344-9afd-aca738a3c73d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:30.672474 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ecd6f1a-742b-4344-9afd-aca738a3c73d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1461 microversion: 2.1 time: 0.318831 May 19 04:44:30.683886 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1599/3276] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:30 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1461 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:30.689580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0cdd208b-bd58-41fa-a89d-3f77cc0f1793 req-da82aee1-bf58-477a-9e1c-c3a92078aa4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f893d60d-f792-409a-99a4-ddfa34b26ab3", "name": "network-vif-deleted", "tag": "251915bf-6825-4c34-bd81-cf630c80845a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:30.698558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0cdd208b-bd58-41fa-a89d-3f77cc0f1793 req-da82aee1-bf58-477a-9e1c-c3a92078aa4e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:30.699262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0cdd208b-bd58-41fa-a89d-3f77cc0f1793 req-da82aee1-bf58-477a-9e1c-c3a92078aa4e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.710186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-62c5c6f2-e3f6-4817-8a79-00fa9fb9df38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:30.712254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0cdd208b-bd58-41fa-a89d-3f77cc0f1793 req-da82aee1-bf58-477a-9e1c-c3a92078aa4e service nova] Creating event network-vif-deleted:251915bf-6825-4c34-bd81-cf630c80845a for instance f893d60d-f792-409a-99a4-ddfa34b26ab3 on n-h2-766726-30 May 19 04:44:30.717659 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0cdd208b-bd58-41fa-a89d-3f77cc0f1793 req-da82aee1-bf58-477a-9e1c-c3a92078aa4e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 May 19 04:44:30.718738 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1600/3277] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:30.724034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d19e66b-6a49-4d1e-bd53-227c15d87c4f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:30.724733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d19e66b-6a49-4d1e-bd53-227c15d87c4f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:30.725222 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-62c5c6f2-e3f6-4817-8a79-00fa9fb9df38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1313 microversion: 2.1 time: 0.310519 May 19 04:44:30.736687 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1678/3278] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:30 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:30.743652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d19e66b-6a49-4d1e-bd53-227c15d87c4f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:30.744107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d19e66b-6a49-4d1e-bd53-227c15d87c4f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.744946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d19e66b-6a49-4d1e-bd53-227c15d87c4f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:30.745414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d19e66b-6a49-4d1e-bd53-227c15d87c4f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.830147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:30.833257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:30.841974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:30.842726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.844159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:30.844764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:30.969038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:30.985793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:30.987717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:30.989141 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d9c8f14d-0857-4766-aebe-61b83c5846e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.169006 May 19 04:44:30.990133 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1679/3279] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:30 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:31.085164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-970944a1-fb6b-4c62-a5da-935819ec6dfb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:31.086157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-970944a1-fb6b-4c62-a5da-935819ec6dfb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:31.099586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-970944a1-fb6b-4c62-a5da-935819ec6dfb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:31.100678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-970944a1-fb6b-4c62-a5da-935819ec6dfb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:31.114798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-970944a1-fb6b-4c62-a5da-935819ec6dfb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:31.115482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-970944a1-fb6b-4c62-a5da-935819ec6dfb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:31.165251 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d19e66b-6a49-4d1e-bd53-227c15d87c4f tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1614 microversion: 2.1 time: 0.444950 May 19 04:44:31.178196 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1601/3280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:30 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1614 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:31.183451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ead60e21-5da7-45d1-a745-8d3504ffcb8e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:31.184415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ead60e21-5da7-45d1-a745-8d3504ffcb8e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:31.192537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ead60e21-5da7-45d1-a745-8d3504ffcb8e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:31.192991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ead60e21-5da7-45d1-a745-8d3504ffcb8e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:31.193969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ead60e21-5da7-45d1-a745-8d3504ffcb8e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:31.194410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ead60e21-5da7-45d1-a745-8d3504ffcb8e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:31.267276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-970944a1-fb6b-4c62-a5da-935819ec6dfb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1709e9b58fe4a16a3156b3141b4a297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d0917d2e4b4886991ec5c714103799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:31.278175 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-970944a1-fb6b-4c62-a5da-935819ec6dfb tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 200 len: 1251 microversion: 2.1 time: 0.198431 May 19 04:44:31.279643 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1680/3281] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:31 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 1251 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:31.289002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:31.290038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:31.301839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:31.302457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:31.303683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:31.304404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:31.357142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '790c9a312d0a44afb52ec1208161e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43a226680fd4709ba4faedada631836', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:31.358863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] flavor_id is None. Assuming migration. {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4142}} May 19 04:44:31.359315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 04:44:31.488940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ead60e21-5da7-45d1-a745-8d3504ffcb8e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:31.501338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ead60e21-5da7-45d1-a745-8d3504ffcb8e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1511 microversion: 2.1 time: 0.319220 May 19 04:44:31.501338 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1602/3282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:31 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:31.576649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:31.661765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1453887455", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6598bc70-0651-4830-84b7-60a72f799274"}], "security_groups": [{"name": "tempest-securitygroup--1785278198"}], "key_name": "tempest-keypair-588461752", "user_data": "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:31.753553 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b4e5f866-f0ef-4c19-92fb-7df74e4330ef tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484/action" status: 202 len: 0 microversion: 2.1 time: 0.471252 May 19 04:44:31.756918 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1681/3283] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:44:31 2022] POST /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:44:31.769966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fb9e2a27-80c4-4e2c-ab3a-439c39bd86f9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:31.772929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fb9e2a27-80c4-4e2c-ab3a-439c39bd86f9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:31.789604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb9e2a27-80c4-4e2c-ab3a-439c39bd86f9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:31.792085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb9e2a27-80c4-4e2c-ab3a-439c39bd86f9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:31.792973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb9e2a27-80c4-4e2c-ab3a-439c39bd86f9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:31.793579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fb9e2a27-80c4-4e2c-ab3a-439c39bd86f9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:32.003283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] validate_networks() for [('6598bc70-0651-4830-84b7-60a72f799274', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:44:32.159883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fb9e2a27-80c4-4e2c-ab3a-439c39bd86f9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:32.172909 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fb9e2a27-80c4-4e2c-ab3a-439c39bd86f9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1499 microversion: 2.1 time: 0.410502 May 19 04:44:32.173518 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1682/3284] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:31 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1499 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:32.182925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-de509870-bb6d-4218-a57e-9ca27a70c338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:32.183778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-de509870-bb6d-4218-a57e-9ca27a70c338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:32.202209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de509870-bb6d-4218-a57e-9ca27a70c338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:32.202839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de509870-bb6d-4218-a57e-9ca27a70c338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:32.203762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de509870-bb6d-4218-a57e-9ca27a70c338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:32.204348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de509870-bb6d-4218-a57e-9ca27a70c338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:32.587339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-de509870-bb6d-4218-a57e-9ca27a70c338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:32.598733 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-de509870-bb6d-4218-a57e-9ca27a70c338 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1470 microversion: 2.1 time: 0.423984 May 19 04:44:32.602031 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1683/3285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:32 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:32.611281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:32.615509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:32.629949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:32.630561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:32.631440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:32.631975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:32.726745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:32.739195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:32.741339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:32.742946 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-528e27e9-04a2-4efb-bb86-4db74a35e274 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.135819 May 19 04:44:32.744093 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1684/3286] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:32 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:32.753381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39c5f3ca-66bf-42f6-b5c9-40838fea1636 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:32.754923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39c5f3ca-66bf-42f6-b5c9-40838fea1636 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:32.766590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c5f3ca-66bf-42f6-b5c9-40838fea1636 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:32.767260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c5f3ca-66bf-42f6-b5c9-40838fea1636 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:32.768291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c5f3ca-66bf-42f6-b5c9-40838fea1636 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:32.769556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c5f3ca-66bf-42f6-b5c9-40838fea1636 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:32.824545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-39c5f3ca-66bf-42f6-b5c9-40838fea1636 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lazy-loading 'flavor' on Instance uuid f29ff13b-411b-4e3a-8974-55cf7429a062 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:44:32.946668 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39c5f3ca-66bf-42f6-b5c9-40838fea1636 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "POST /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062/action" status: 200 len: 32 microversion: 2.1 time: 0.200161 May 19 04:44:32.948784 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1685/3287] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:44:32 2022] POST /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:44:32.957235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:32.958123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] [instance: d7a0a37d-a68e-428a-8b9a-901167a2c06a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:32.967575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:32.968374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:32.969482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:32.970015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:32.991538 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] HTTP exception thrown: Instance d7a0a37d-a68e-428a-8b9a-901167a2c06a could not be found. May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Request method failure captured: May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a HTTP/1.1 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcqcAzeiMnphc2Ggh8gnrbDu84G8vYpTeC2d8UbT9_v4C4auBhm8z3Qwbth3VOITQqh6-E_Xt1umOOovzPX9FXvf9JNOXZ4F8ZdAQGnh5P4dgm7RHau-XipLNoObfhPeWB4pnjSTt-SUFqJdK5_lNfFrY7vFRRYew8YTyxkTBlstnXA May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: d3d0917d2e4b4886991ec5c714103799 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestBootFromVolume-642566639 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d3d0917d2e4b4886991ec5c714103799"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d3d0917d2e4b4886991ec5c714103799"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d3d0917d2e4b4886991ec5c714103799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d3d0917d2e4b4886991ec5c714103799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestBootFromVolume-642566639 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: d3d0917d2e4b4886991ec5c714103799 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestBootFromVolume-642566639 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestBootFromVolume-642566639-project May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e1709e9b58fe4a16a3156b3141b4a297 May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestBootFromVolume-642566639-project May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance d7a0a37d-a68e-428a-8b9a-901167a2c06a could not be found. May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'd7a0a37d-a68e-428a-8b9a-901167a2c06a'} May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a0a37d-a68e-428a-8b9a-901167a2c06a could not be found. May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a0a37d-a68e-428a-8b9a-901167a2c06a could not be found. May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:32.993475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:32.998419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:32.998419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:32.998419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:32.998419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:44:32.998419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:44:32.998419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a0a37d-a68e-428a-8b9a-901167a2c06a could not be found. May 19 04:44:32.998419 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:32.998419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Returning 404 to user: Instance d7a0a37d-a68e-428a-8b9a-901167a2c06a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:44:32.998419 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5520f724-21d5-427c-9013-d9069d3d3e2a tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a" status: 404 len: 111 microversion: 2.1 time: 0.046277 May 19 04:44:32.999048 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1686/3288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:32 2022] GET /compute/v2.1/servers/d7a0a37d-a68e-428a-8b9a-901167a2c06a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:44:33.008589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b67709b-b257-4b08-a6a3-1d8aae1212c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:33.009361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9b67709b-b257-4b08-a6a3-1d8aae1212c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:33.016986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b67709b-b257-4b08-a6a3-1d8aae1212c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:33.017587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b67709b-b257-4b08-a6a3-1d8aae1212c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:33.018490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b67709b-b257-4b08-a6a3-1d8aae1212c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:33.018993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b67709b-b257-4b08-a6a3-1d8aae1212c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:33.382725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:44:33.388435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:44:33.389252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:44:33.389891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:44:33.390423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:44:33.412458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:33.412925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:33.414020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:33.414767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:33.435715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for project 0db6b7171e3b4a2db160855939246a40. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:44:33.442996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for user a651109c72e84cab9e712ad5fbd002b6 and project 0db6b7171e3b4a2db160855939246a40. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:44:33.446800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9b67709b-b257-4b08-a6a3-1d8aae1212c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:33.458750 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9b67709b-b257-4b08-a6a3-1d8aae1212c9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1488 microversion: 2.1 time: 0.451256 May 19 04:44:33.459438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:44:33.462720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:44:33.473907 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1687/3289] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:32 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1488 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:33.480810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4861d02e-648a-4491-972f-bb3b64eb30df tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:33.485951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4861d02e-648a-4491-972f-bb3b64eb30df tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:33.501454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4861d02e-648a-4491-972f-bb3b64eb30df tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:33.502059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4861d02e-648a-4491-972f-bb3b64eb30df tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:33.506126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4861d02e-648a-4491-972f-bb3b64eb30df tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:33.506703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4861d02e-648a-4491-972f-bb3b64eb30df tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:33.545559 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-62d7ae90-38df-4533-b5d3-f25c18e83607 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.887996 May 19 04:44:33.547036 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1603/3290] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:44:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:44:33.552229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ec6d7e9-af70-4a54-b9d3-807e3f140f04 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] Calling method '.version_select at 0x7fd3149188b0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:33.581409 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ec6d7e9-af70-4a54-b9d3-807e3f140f04 tempest-ServersTestBootFromVolume-642566639 tempest-ServersTestBootFromVolume-642566639-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-309633492" status: 202 len: 0 microversion: 2.1 time: 0.032453 May 19 04:44:33.583228 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1604/3291] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-309633492 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:44:33.595712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d7a85bf-0213-4344-b93f-8c2f8c8b0092 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:33.598064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9d7a85bf-0213-4344-b93f-8c2f8c8b0092 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:33.621816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d7a85bf-0213-4344-b93f-8c2f8c8b0092 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:33.622427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d7a85bf-0213-4344-b93f-8c2f8c8b0092 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:33.629124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d7a85bf-0213-4344-b93f-8c2f8c8b0092 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:33.629869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d7a85bf-0213-4344-b93f-8c2f8c8b0092 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:33.690028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9d7a85bf-0213-4344-b93f-8c2f8c8b0092 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:44:33.862792 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9d7a85bf-0213-4344-b93f-8c2f8c8b0092 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 204 len: 0 microversion: 2.1 time: 0.276980 May 19 04:44:33.866512 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1605/3292] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:44:33 2022] DELETE /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:44:33.868927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ddb8c19-14f8-4647-95ed-dfa023946f28 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:33.881152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2ddb8c19-14f8-4647-95ed-dfa023946f28 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:34.002435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ddb8c19-14f8-4647-95ed-dfa023946f28 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:34.014668 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ddb8c19-14f8-4647-95ed-dfa023946f28 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1241 microversion: 2.1 time: 0.147360 May 19 04:44:34.015827 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1606/3293] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:33 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:34.021398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-615d4f37-8bb0-4c39-9518-fab588946856 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:34.033446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-615d4f37-8bb0-4c39-9518-fab588946856 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:34.043097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-615d4f37-8bb0-4c39-9518-fab588946856 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:34.043305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-615d4f37-8bb0-4c39-9518-fab588946856 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:34.053976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-615d4f37-8bb0-4c39-9518-fab588946856 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:34.054777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-615d4f37-8bb0-4c39-9518-fab588946856 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:34.117300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4861d02e-648a-4491-972f-bb3b64eb30df tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:34.141669 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4861d02e-648a-4491-972f-bb3b64eb30df tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.664916 May 19 04:44:34.143786 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1688/3294] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:33 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:34.153280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:34.156074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:34.169461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:34.171315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:34.176264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:34.176670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:34.320727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:34.341503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-615d4f37-8bb0-4c39-9518-fab588946856 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:34.351458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-615d4f37-8bb0-4c39-9518-fab588946856 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1470 microversion: 2.1 time: 0.333795 May 19 04:44:34.359362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:34.363354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:34.363530 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1607/3295] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:34 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1470 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:34.364979 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f595b853-9282-4b5d-9d0f-a7d1787aa53c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.219505 May 19 04:44:34.368968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f9abb90e-be9c-4842-a8ca-c75d9fdd0605 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:34.369645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9abb90e-be9c-4842-a8ca-c75d9fdd0605 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:34.380268 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1689/3296] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:34 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:34.380941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9abb90e-be9c-4842-a8ca-c75d9fdd0605 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:34.381476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9abb90e-be9c-4842-a8ca-c75d9fdd0605 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:34.382320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9abb90e-be9c-4842-a8ca-c75d9fdd0605 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:34.382755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9abb90e-be9c-4842-a8ca-c75d9fdd0605 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:34.674269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f9abb90e-be9c-4842-a8ca-c75d9fdd0605 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:34.687395 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f9abb90e-be9c-4842-a8ca-c75d9fdd0605 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1494 microversion: 2.1 time: 0.322549 May 19 04:44:34.688524 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1608/3297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:34 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1494 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:35.032042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9134ff51-d72b-4efe-9363-c0bf0feaa7e5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:35.032722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9134ff51-d72b-4efe-9363-c0bf0feaa7e5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:35.040708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9134ff51-d72b-4efe-9363-c0bf0feaa7e5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.041765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9134ff51-d72b-4efe-9363-c0bf0feaa7e5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:35.043283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9134ff51-d72b-4efe-9363-c0bf0feaa7e5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.043886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9134ff51-d72b-4efe-9363-c0bf0feaa7e5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:35.160335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-11658eb4-ee32-436d-97de-60374cc079f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:35.160967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-11658eb4-ee32-436d-97de-60374cc079f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:35.181821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11658eb4-ee32-436d-97de-60374cc079f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.182733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11658eb4-ee32-436d-97de-60374cc079f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:35.184473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11658eb4-ee32-436d-97de-60374cc079f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.186197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11658eb4-ee32-436d-97de-60374cc079f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:35.200666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9134ff51-d72b-4efe-9363-c0bf0feaa7e5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:35.210841 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9134ff51-d72b-4efe-9363-c0bf0feaa7e5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1245 microversion: 2.1 time: 0.182921 May 19 04:44:35.211670 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1690/3298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:35 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1245 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:35.369433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7bd6220-1074-4aab-a526-480483a1c2d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:35.370062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7bd6220-1074-4aab-a526-480483a1c2d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:35.380920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7bd6220-1074-4aab-a526-480483a1c2d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.381415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7bd6220-1074-4aab-a526-480483a1c2d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:35.382209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7bd6220-1074-4aab-a526-480483a1c2d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.382658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7bd6220-1074-4aab-a526-480483a1c2d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:35.649347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-11658eb4-ee32-436d-97de-60374cc079f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:35.663017 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-11658eb4-ee32-436d-97de-60374cc079f1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.507047 May 19 04:44:35.664679 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1609/3299] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:35 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:35.670254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:35.671365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:35.678309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.679560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:35.680837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.682005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:35.687371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:35.747716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a7bd6220-1074-4aab-a526-480483a1c2d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:35.757598 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7bd6220-1074-4aab-a526-480483a1c2d8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1470 microversion: 2.1 time: 0.392122 May 19 04:44:35.758206 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1691/3300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:35 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:35.787640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af13a330-9d34-4772-905f-057ee28c951a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:35.788275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af13a330-9d34-4772-905f-057ee28c951a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:35.814142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af13a330-9d34-4772-905f-057ee28c951a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.814597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af13a330-9d34-4772-905f-057ee28c951a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:35.815418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af13a330-9d34-4772-905f-057ee28c951a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:35.815867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af13a330-9d34-4772-905f-057ee28c951a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:36.004236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:36.029647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:36.031626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:36.047055 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0533dd02-6a78-4102-82ae-7b9a4b3db571 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.380944 May 19 04:44:36.060028 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1610/3301] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:35 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:36.228736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-06deecf1-5091-4c7f-ae15-ea0e9c5e320d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:36.229398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-06deecf1-5091-4c7f-ae15-ea0e9c5e320d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:36.242021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06deecf1-5091-4c7f-ae15-ea0e9c5e320d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:36.242813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06deecf1-5091-4c7f-ae15-ea0e9c5e320d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:36.245028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06deecf1-5091-4c7f-ae15-ea0e9c5e320d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:36.245028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06deecf1-5091-4c7f-ae15-ea0e9c5e320d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:36.575444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-06deecf1-5091-4c7f-ae15-ea0e9c5e320d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:36.587151 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-06deecf1-5091-4c7f-ae15-ea0e9c5e320d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1301 microversion: 2.1 time: 0.362314 May 19 04:44:36.588970 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1611/3302] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:36 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1301 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:36.606957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-df279c63-71df-4f7f-bd83-29cda2e6447b req-0edb79e7-1f1e-4af5-8295-f5a906a4c961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59be2c79-a225-4e66-94af-e8c52a84d705", "name": "network-vif-deleted", "tag": "953640be-a2f4-4290-bbd9-98d1b6d88589"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:36.624832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-df279c63-71df-4f7f-bd83-29cda2e6447b req-0edb79e7-1f1e-4af5-8295-f5a906a4c961 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:36.626331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-df279c63-71df-4f7f-bd83-29cda2e6447b req-0edb79e7-1f1e-4af5-8295-f5a906a4c961 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:36.640872 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-df279c63-71df-4f7f-bd83-29cda2e6447b req-0edb79e7-1f1e-4af5-8295-f5a906a4c961 service nova] Creating event network-vif-deleted:953640be-a2f4-4290-bbd9-98d1b6d88589 for instance 59be2c79-a225-4e66-94af-e8c52a84d705 on n-h1-766726-30 May 19 04:44:36.644742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-af13a330-9d34-4772-905f-057ee28c951a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:36.647570 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-df279c63-71df-4f7f-bd83-29cda2e6447b req-0edb79e7-1f1e-4af5-8295-f5a906a4c961 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056592 May 19 04:44:36.649651 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1612/3303] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:36.656404 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af13a330-9d34-4772-905f-057ee28c951a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 200 len: 1494 microversion: 2.1 time: 0.897153 May 19 04:44:36.668283 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1692/3304] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:35 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 1494 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:36.682579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c9300bdc-ccf9-4643-a539-049d08c006b3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:36.684070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c9300bdc-ccf9-4643-a539-049d08c006b3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:36.692643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c9300bdc-ccf9-4643-a539-049d08c006b3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:36.693249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c9300bdc-ccf9-4643-a539-049d08c006b3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:36.694763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c9300bdc-ccf9-4643-a539-049d08c006b3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:36.695326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c9300bdc-ccf9-4643-a539-049d08c006b3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:36.776379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b922ccd-0f59-4ef9-a142-33e49039323a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:36.777293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7b922ccd-0f59-4ef9-a142-33e49039323a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:36.790797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b922ccd-0f59-4ef9-a142-33e49039323a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:36.791292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b922ccd-0f59-4ef9-a142-33e49039323a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:36.792121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b922ccd-0f59-4ef9-a142-33e49039323a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:36.792560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b922ccd-0f59-4ef9-a142-33e49039323a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:37.120338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c9300bdc-ccf9-4643-a539-049d08c006b3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:37.129138 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c9300bdc-ccf9-4643-a539-049d08c006b3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.451802 May 19 04:44:37.142771 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1613/3305] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:36 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:37.147835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:37.148458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:37.172121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:37.172580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:37.173477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:37.173922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:37.363070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:37.377902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:37.379576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:37.381141 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-261bfef9-3c71-40aa-82c4-2c8e4437f693 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.236994 May 19 04:44:37.382499 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1614/3306] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:37 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:37.492896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7b922ccd-0f59-4ef9-a142-33e49039323a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:37.505570 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7b922ccd-0f59-4ef9-a142-33e49039323a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1470 microversion: 2.1 time: 0.734056 May 19 04:44:37.507539 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1693/3307] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:36 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1470 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:37.605088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-daf4d371-46f2-4f49-ae1a-dd19d8367b06 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:37.605816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-daf4d371-46f2-4f49-ae1a-dd19d8367b06 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:37.614636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-daf4d371-46f2-4f49-ae1a-dd19d8367b06 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:37.615298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-daf4d371-46f2-4f49-ae1a-dd19d8367b06 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:37.616305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-daf4d371-46f2-4f49-ae1a-dd19d8367b06 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:37.616952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-daf4d371-46f2-4f49-ae1a-dd19d8367b06 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:37.674981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:37.675607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:37.682365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:37.682829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:37.683610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:37.684163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:37.698713 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 HTTP/1.1 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '59be2c79-a225-4e66-94af-e8c52a84d705'} May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:44:37.700261 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-938c0b70-41de-46de-b36e-4cd2cc0979ac tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 404 len: 111 microversion: 2.1 time: 0.032130 May 19 04:44:37.704318 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1694/3308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:37 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:44:37.802503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-daf4d371-46f2-4f49-ae1a-dd19d8367b06 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:37.811107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-961252503", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "56a7f773-0e0a-4675-b687-c0077a456785"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:37.812150 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-daf4d371-46f2-4f49-ae1a-dd19d8367b06 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1299 microversion: 2.1 time: 0.210911 May 19 04:44:37.822015 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1615/3309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:37 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1299 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:37.884601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] validate_networks() for [('56a7f773-0e0a-4675-b687-c0077a456785', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:44:38.148415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-033a5681-2013-4c6b-9f30-640e3ba875b9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:38.149902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-033a5681-2013-4c6b-9f30-640e3ba875b9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:38.156688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-033a5681-2013-4c6b-9f30-640e3ba875b9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:38.157155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-033a5681-2013-4c6b-9f30-640e3ba875b9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:38.158121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-033a5681-2013-4c6b-9f30-640e3ba875b9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:38.159367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-033a5681-2013-4c6b-9f30-640e3ba875b9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:38.690779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:38.830090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-033a5681-2013-4c6b-9f30-640e3ba875b9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:38.840919 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-033a5681-2013-4c6b-9f30-640e3ba875b9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.698352 May 19 04:44:38.854446 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1616/3310] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:38 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:38.863844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:38.863844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:38.870250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:38.870702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:38.871483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:38.871921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:38.992568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:39.003517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:39.005016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:39.006423 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c2c73fa2-76ba-477d-8b7e-17576466964d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.150697 May 19 04:44:39.007197 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1617/3311] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:38 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:39.011809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6dd0acf1-e384-4b42-922e-c3e71eb24f31 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:39.012578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6dd0acf1-e384-4b42-922e-c3e71eb24f31 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:39.019371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dd0acf1-e384-4b42-922e-c3e71eb24f31 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:39.020016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dd0acf1-e384-4b42-922e-c3e71eb24f31 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:39.020955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dd0acf1-e384-4b42-922e-c3e71eb24f31 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:39.021611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dd0acf1-e384-4b42-922e-c3e71eb24f31 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:39.533423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6dd0acf1-e384-4b42-922e-c3e71eb24f31 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:39.544589 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6dd0acf1-e384-4b42-922e-c3e71eb24f31 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1475 microversion: 2.1 time: 0.536180 May 19 04:44:39.545187 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1618/3312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:39 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1475 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:39.550074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3e8c833-6d1c-411f-9189-be9df0fcf435 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:39.550845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c3e8c833-6d1c-411f-9189-be9df0fcf435 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:39.556959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3e8c833-6d1c-411f-9189-be9df0fcf435 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:39.557696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3e8c833-6d1c-411f-9189-be9df0fcf435 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:39.558625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3e8c833-6d1c-411f-9189-be9df0fcf435 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:39.559215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3e8c833-6d1c-411f-9189-be9df0fcf435 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:39.610625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:44:39.611351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:44:39.611900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:44:39.612309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:44:39.612718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:44:39.616768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:39.628334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:39.628796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:39.629936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:39.630700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:39.655421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:44:39.661690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Getting quotas for user 1e14ea8dad314974bf5f4e8e51b88349 and project 90ef9ce51b2c4d59869b65ac106ed777. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:44:39.666313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c3e8c833-6d1c-411f-9189-be9df0fcf435 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:39.675751 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3e8c833-6d1c-411f-9189-be9df0fcf435 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1299 microversion: 2.1 time: 0.129260 May 19 04:44:39.679224 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1619/3313] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:39 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:39.696892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:44:39.701830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:44:39.763870 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fe9ae2d2-2fae-49bd-a95d-2c90543f945e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.956552 May 19 04:44:39.765171 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1695/3314] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:44:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 04:44:39.775510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-06c543e7-4d1a-424c-9c1d-5edbb34ba186 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:39.776392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-06c543e7-4d1a-424c-9c1d-5edbb34ba186 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:39.861111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f2e20d0-9af6-46cc-ae05-4af05483b343 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:39.861735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f2e20d0-9af6-46cc-ae05-4af05483b343 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:39.880763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f2e20d0-9af6-46cc-ae05-4af05483b343 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:39.881240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f2e20d0-9af6-46cc-ae05-4af05483b343 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:39.884706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f2e20d0-9af6-46cc-ae05-4af05483b343 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:39.886018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f2e20d0-9af6-46cc-ae05-4af05483b343 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:39.934703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-06c543e7-4d1a-424c-9c1d-5edbb34ba186 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:39.953520 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-06c543e7-4d1a-424c-9c1d-5edbb34ba186 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1214 microversion: 2.1 time: 0.176461 May 19 04:44:39.954711 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1620/3315] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:39 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:40.027033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:40.027933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:40.038465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:40.039202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:40.040579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:40.042136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:40.343301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:40.363022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:40.365181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:40.370288 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-371adb2d-8e6c-4d9b-b1dd-cbc3f38eed5d tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.344094 May 19 04:44:40.373506 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1621/3316] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:40 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:40.475940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f2e20d0-9af6-46cc-ae05-4af05483b343 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:40.492530 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f2e20d0-9af6-46cc-ae05-4af05483b343 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.637430 May 19 04:44:40.504230 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1696/3317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:39 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:40.561103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4eb6ffc1-1c27-442c-ba7b-505b2997935f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:40.561990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4eb6ffc1-1c27-442c-ba7b-505b2997935f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:40.571489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4eb6ffc1-1c27-442c-ba7b-505b2997935f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:40.573931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4eb6ffc1-1c27-442c-ba7b-505b2997935f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:40.575556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4eb6ffc1-1c27-442c-ba7b-505b2997935f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:40.576412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4eb6ffc1-1c27-442c-ba7b-505b2997935f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:40.695751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-29bf08e2-5fda-4e43-88ac-8be080c05a7e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:40.696447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-29bf08e2-5fda-4e43-88ac-8be080c05a7e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:40.714575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29bf08e2-5fda-4e43-88ac-8be080c05a7e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:40.715966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29bf08e2-5fda-4e43-88ac-8be080c05a7e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:40.719069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29bf08e2-5fda-4e43-88ac-8be080c05a7e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:40.719951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29bf08e2-5fda-4e43-88ac-8be080c05a7e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:40.725654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:41.097966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4eb6ffc1-1c27-442c-ba7b-505b2997935f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:41.107698 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4eb6ffc1-1c27-442c-ba7b-505b2997935f tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1475 microversion: 2.1 time: 0.550416 May 19 04:44:41.121486 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1622/3318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:40 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1475 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:41.127088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90f23940-6247-4783-b5ee-833d28bbbe49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:41.128509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-90f23940-6247-4783-b5ee-833d28bbbe49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:41.141479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90f23940-6247-4783-b5ee-833d28bbbe49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:41.142153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90f23940-6247-4783-b5ee-833d28bbbe49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:41.144734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90f23940-6247-4783-b5ee-833d28bbbe49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:41.145403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90f23940-6247-4783-b5ee-833d28bbbe49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:41.157887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-29bf08e2-5fda-4e43-88ac-8be080c05a7e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:41.171672 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-29bf08e2-5fda-4e43-88ac-8be080c05a7e tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1367 microversion: 2.1 time: 0.481350 May 19 04:44:41.173185 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1697/3319] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:40 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:41.366420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-90f23940-6247-4783-b5ee-833d28bbbe49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:41.383433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-90f23940-6247-4783-b5ee-833d28bbbe49 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1266 microversion: 2.1 time: 0.259147 May 19 04:44:41.385308 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1623/3320] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:41 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:41.394890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:41.394890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:41.409500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:41.409961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:41.410752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:41.411201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:41.511502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-abf82b36-b5d7-4aaf-a1fd-22ee0be2fc38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:41.512136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-abf82b36-b5d7-4aaf-a1fd-22ee0be2fc38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:41.524824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf82b36-b5d7-4aaf-a1fd-22ee0be2fc38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:41.529778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf82b36-b5d7-4aaf-a1fd-22ee0be2fc38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:41.532345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf82b36-b5d7-4aaf-a1fd-22ee0be2fc38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:41.532345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf82b36-b5d7-4aaf-a1fd-22ee0be2fc38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:41.744130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:41.761961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:41.763488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:41.764710 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3834aea0-e32f-41c1-bf36-8827edd4e22e tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.377976 May 19 04:44:41.765337 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1698/3321] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:41 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:44:42.045595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-abf82b36-b5d7-4aaf-a1fd-22ee0be2fc38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:42.059000 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-abf82b36-b5d7-4aaf-a1fd-22ee0be2fc38 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.551490 May 19 04:44:42.064304 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1624/3322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:41 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:42.125244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31ae8183-24f0-4ae5-8ff7-44bd9feecdd1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:42.125993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-31ae8183-24f0-4ae5-8ff7-44bd9feecdd1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:42.147681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31ae8183-24f0-4ae5-8ff7-44bd9feecdd1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:42.148414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31ae8183-24f0-4ae5-8ff7-44bd9feecdd1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:42.149104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31ae8183-24f0-4ae5-8ff7-44bd9feecdd1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:42.152180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31ae8183-24f0-4ae5-8ff7-44bd9feecdd1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:42.189675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d991383f-8c86-4b20-a911-a7d8d81782b4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:42.190438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d991383f-8c86-4b20-a911-a7d8d81782b4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:42.197707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d991383f-8c86-4b20-a911-a7d8d81782b4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:42.198720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d991383f-8c86-4b20-a911-a7d8d81782b4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:42.199908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d991383f-8c86-4b20-a911-a7d8d81782b4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:42.200563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d991383f-8c86-4b20-a911-a7d8d81782b4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:43.232290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d991383f-8c86-4b20-a911-a7d8d81782b4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:43.246493 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d991383f-8c86-4b20-a911-a7d8d81782b4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1367 microversion: 2.1 time: 1.059844 May 19 04:44:43.250464 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1625/3323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:42 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1367 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:43.261665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31ae8183-24f0-4ae5-8ff7-44bd9feecdd1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:43.263656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35e2030e-8a53-47fc-9bf2-5b8b07ef5455 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:43.265468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-35e2030e-8a53-47fc-9bf2-5b8b07ef5455 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:43.273553 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-31ae8183-24f0-4ae5-8ff7-44bd9feecdd1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1475 microversion: 2.1 time: 1.152781 May 19 04:44:43.279372 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1699/3324] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:42 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1475 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:43.287090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2887ccf2-124d-4676-8bd3-0249347e931d req-adc7aea1-4a8c-4fa1-850d-0d18e78df33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23673e55-0886-4f7e-bbf3-57c29b063597", "tag": "92204e48-6abb-409f-ab4f-82447be821fa"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:43.294767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35e2030e-8a53-47fc-9bf2-5b8b07ef5455 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:43.295381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35e2030e-8a53-47fc-9bf2-5b8b07ef5455 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:43.300053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35e2030e-8a53-47fc-9bf2-5b8b07ef5455 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:43.300599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35e2030e-8a53-47fc-9bf2-5b8b07ef5455 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:43.312850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2887ccf2-124d-4676-8bd3-0249347e931d req-adc7aea1-4a8c-4fa1-850d-0d18e78df33a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:43.313577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2887ccf2-124d-4676-8bd3-0249347e931d req-adc7aea1-4a8c-4fa1-850d-0d18e78df33a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:43.358055 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2887ccf2-124d-4676-8bd3-0249347e931d req-adc7aea1-4a8c-4fa1-850d-0d18e78df33a service nova] Creating event network-changed:92204e48-6abb-409f-ab4f-82447be821fa for instance 23673e55-0886-4f7e-bbf3-57c29b063597 on n-h1-766726-30 May 19 04:44:43.366913 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2887ccf2-124d-4676-8bd3-0249347e931d req-adc7aea1-4a8c-4fa1-850d-0d18e78df33a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085627 May 19 04:44:43.376898 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1700/3325] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:43.389610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:43.390347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:43.413050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:43.414905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:43.417053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:43.419853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:43.428076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:43.720804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-35e2030e-8a53-47fc-9bf2-5b8b07ef5455 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:43.740163 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-35e2030e-8a53-47fc-9bf2-5b8b07ef5455 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1272 microversion: 2.1 time: 0.488256 May 19 04:44:43.743876 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1626/3326] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:43 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1272 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:43.757828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8145c091-3ce1-4636-b251-4a5c151eb98a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:43.762710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8145c091-3ce1-4636-b251-4a5c151eb98a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:43.782528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:43.787165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8145c091-3ce1-4636-b251-4a5c151eb98a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:43.787725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8145c091-3ce1-4636-b251-4a5c151eb98a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:43.788562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8145c091-3ce1-4636-b251-4a5c151eb98a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:43.798451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:43.800243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8145c091-3ce1-4636-b251-4a5c151eb98a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:43.802747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:43.805598 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d04d7a9-3a6e-45a7-9205-36c4b38e3e01 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.426366 May 19 04:44:43.807112 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1701/3327] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:43 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:44.088305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8145c091-3ce1-4636-b251-4a5c151eb98a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:44.101307 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8145c091-3ce1-4636-b251-4a5c151eb98a tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.350630 May 19 04:44:44.102508 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1627/3328] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:43 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:44.265491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ff882361-6b71-426c-9413-b5e4bf87981d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:44.266693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ff882361-6b71-426c-9413-b5e4bf87981d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:44.289590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff882361-6b71-426c-9413-b5e4bf87981d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:44.291805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff882361-6b71-426c-9413-b5e4bf87981d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:44.293523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff882361-6b71-426c-9413-b5e4bf87981d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:44.294222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff882361-6b71-426c-9413-b5e4bf87981d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:44.296221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-858e46f0-2622-4d38-aeb5-4bc9682e5cb1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:44.296866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-858e46f0-2622-4d38-aeb5-4bc9682e5cb1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:44.311934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-858e46f0-2622-4d38-aeb5-4bc9682e5cb1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:44.312403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-858e46f0-2622-4d38-aeb5-4bc9682e5cb1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:44.313266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-858e46f0-2622-4d38-aeb5-4bc9682e5cb1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:44.313719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-858e46f0-2622-4d38-aeb5-4bc9682e5cb1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:44.368124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:44.673837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ff882361-6b71-426c-9413-b5e4bf87981d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:44.674891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-858e46f0-2622-4d38-aeb5-4bc9682e5cb1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:44.687273 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-858e46f0-2622-4d38-aeb5-4bc9682e5cb1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1475 microversion: 2.1 time: 0.399111 May 19 04:44:44.691222 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ff882361-6b71-426c-9413-b5e4bf87981d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1367 microversion: 2.1 time: 0.429456 May 19 04:44:44.691667 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1628/3329] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:44 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1475 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:44.704690 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1702/3330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:44 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:44.761022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac474523-d5b3-45cf-9358-7ad398fb470e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:44.761682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ac474523-d5b3-45cf-9358-7ad398fb470e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:44.772521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac474523-d5b3-45cf-9358-7ad398fb470e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:44.773021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac474523-d5b3-45cf-9358-7ad398fb470e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:44.778689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac474523-d5b3-45cf-9358-7ad398fb470e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:44.781437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac474523-d5b3-45cf-9358-7ad398fb470e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:44.829251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:44.830493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:44.842227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:44.844063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:44.845539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:44.847657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:45.029395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:45.052545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:45.056647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:45.058939 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fa3b5744-a842-4e45-8a83-fee38d46d236 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.234965 May 19 04:44:45.070960 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1703/3331] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:44 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:45.120087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9383e178-b84f-4eb6-838b-c13e6568b1ed tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:45.120752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9383e178-b84f-4eb6-838b-c13e6568b1ed tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:45.128159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9383e178-b84f-4eb6-838b-c13e6568b1ed tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:45.129421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9383e178-b84f-4eb6-838b-c13e6568b1ed tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:45.130631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9383e178-b84f-4eb6-838b-c13e6568b1ed tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:45.131400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9383e178-b84f-4eb6-838b-c13e6568b1ed tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:45.260959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ac474523-d5b3-45cf-9358-7ad398fb470e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:45.272930 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac474523-d5b3-45cf-9358-7ad398fb470e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1314 microversion: 2.1 time: 0.517018 May 19 04:44:45.275598 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1629/3332] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:44 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:45.634610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9383e178-b84f-4eb6-838b-c13e6568b1ed tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:45.644290 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9383e178-b84f-4eb6-838b-c13e6568b1ed tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.528227 May 19 04:44:45.645367 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1704/3333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:45 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:45.708244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee3c42df-07b3-498e-a77c-025096957af7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:45.708874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee3c42df-07b3-498e-a77c-025096957af7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:45.714261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-78868949-4693-4d19-bc78-9a7f14c515fe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:45.715376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-78868949-4693-4d19-bc78-9a7f14c515fe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:45.720629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee3c42df-07b3-498e-a77c-025096957af7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:45.722730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee3c42df-07b3-498e-a77c-025096957af7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:45.723550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee3c42df-07b3-498e-a77c-025096957af7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:45.723996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee3c42df-07b3-498e-a77c-025096957af7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:45.725439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78868949-4693-4d19-bc78-9a7f14c515fe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:45.726290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78868949-4693-4d19-bc78-9a7f14c515fe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:45.728200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78868949-4693-4d19-bc78-9a7f14c515fe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:45.728901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78868949-4693-4d19-bc78-9a7f14c515fe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:47.143647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ee3c42df-07b3-498e-a77c-025096957af7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:47.153631 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee3c42df-07b3-498e-a77c-025096957af7 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1475 microversion: 2.1 time: 1.450350 May 19 04:44:47.158029 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1630/3334] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:45 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1475 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:47.184462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:47.185312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:47.192593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:47.203015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:47.205880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:47.206873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:47.208371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:47.241805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-78868949-4693-4d19-bc78-9a7f14c515fe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:47.259706 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-78868949-4693-4d19-bc78-9a7f14c515fe tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1367 microversion: 2.1 time: 1.549129 May 19 04:44:47.271747 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1705/3335] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:45 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1367 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:47.288079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-749a189b-2b02-4b49-8a9f-e2c2d015f7a9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:47.288738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-749a189b-2b02-4b49-8a9f-e2c2d015f7a9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:47.318911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-749a189b-2b02-4b49-8a9f-e2c2d015f7a9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:47.319417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-749a189b-2b02-4b49-8a9f-e2c2d015f7a9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:47.324856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-749a189b-2b02-4b49-8a9f-e2c2d015f7a9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:47.327309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-749a189b-2b02-4b49-8a9f-e2c2d015f7a9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:47.528222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:47.542392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:47.547018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:47.557247 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-628ea68b-3674-4ae4-8bdf-0b2b9213409b tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.393236 May 19 04:44:47.558083 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1631/3336] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:47 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:47.563375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da9e4caa-45b4-4b2b-b257-46d8286968f0 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:47.567679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da9e4caa-45b4-4b2b-b257-46d8286968f0 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:47.583319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da9e4caa-45b4-4b2b-b257-46d8286968f0 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:47.584211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da9e4caa-45b4-4b2b-b257-46d8286968f0 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:47.588155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da9e4caa-45b4-4b2b-b257-46d8286968f0 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:47.589941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da9e4caa-45b4-4b2b-b257-46d8286968f0 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:47.916154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da9e4caa-45b4-4b2b-b257-46d8286968f0 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:47.934216 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da9e4caa-45b4-4b2b-b257-46d8286968f0 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.373128 May 19 04:44:47.937124 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1632/3337] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:47 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:47.950086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b6965cdc-fba5-4ba4-b8c3-f58126eeede5 req-91a8a483-dd18-4515-bdb3-0d736d4c06b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf0b48f-63c2-488d-978f-f46280338844", "tag": "a5f9b7a8-6b88-43e0-80bf-c4954e4870e3"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:47.964276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b6965cdc-fba5-4ba4-b8c3-f58126eeede5 req-91a8a483-dd18-4515-bdb3-0d736d4c06b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:47.971481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b6965cdc-fba5-4ba4-b8c3-f58126eeede5 req-91a8a483-dd18-4515-bdb3-0d736d4c06b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:47.992247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-749a189b-2b02-4b49-8a9f-e2c2d015f7a9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:48.000659 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-749a189b-2b02-4b49-8a9f-e2c2d015f7a9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1314 microversion: 2.1 time: 0.727752 May 19 04:44:48.003350 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b6965cdc-fba5-4ba4-b8c3-f58126eeede5 req-91a8a483-dd18-4515-bdb3-0d736d4c06b7 service nova] Creating event network-changed:a5f9b7a8-6b88-43e0-80bf-c4954e4870e3 for instance bcf0b48f-63c2-488d-978f-f46280338844 on n-h2-766726-30 May 19 04:44:48.012558 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1706/3338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:47 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:48.027703 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b6965cdc-fba5-4ba4-b8c3-f58126eeede5 req-91a8a483-dd18-4515-bdb3-0d736d4c06b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086720 May 19 04:44:48.029587 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1633/3339] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:48.177210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-859dd6f2-60a8-49b2-aaf4-fd0c4bd416cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:48.178027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-859dd6f2-60a8-49b2-aaf4-fd0c4bd416cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:48.194858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-859dd6f2-60a8-49b2-aaf4-fd0c4bd416cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:48.196406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-859dd6f2-60a8-49b2-aaf4-fd0c4bd416cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:48.197439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-859dd6f2-60a8-49b2-aaf4-fd0c4bd416cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:48.201612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-859dd6f2-60a8-49b2-aaf4-fd0c4bd416cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:48.277444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e3781ab3-d89c-471b-be62-ad8b51766b7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:48.278241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e3781ab3-d89c-471b-be62-ad8b51766b7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:48.299278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3781ab3-d89c-471b-be62-ad8b51766b7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:48.299788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3781ab3-d89c-471b-be62-ad8b51766b7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:48.300556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3781ab3-d89c-471b-be62-ad8b51766b7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:48.301358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3781ab3-d89c-471b-be62-ad8b51766b7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:48.465482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-859dd6f2-60a8-49b2-aaf4-fd0c4bd416cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:48.475687 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-859dd6f2-60a8-49b2-aaf4-fd0c4bd416cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1475 microversion: 2.1 time: 0.304543 May 19 04:44:48.496452 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1707/3340] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:48 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1475 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:48.578029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:48.581912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:48.602785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:48.604560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:48.605556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:48.609840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:48.720366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e3781ab3-d89c-471b-be62-ad8b51766b7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:48.733439 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e3781ab3-d89c-471b-be62-ad8b51766b7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1367 microversion: 2.1 time: 0.460543 May 19 04:44:48.763351 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1634/3341] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:48 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:48.787011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:48.808137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:48.811774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:48.817969 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac1cbd42-c421-47c2-9f06-bc1c56b3bd1f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.244151 May 19 04:44:48.818746 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1708/3342] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:48 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:48.957667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48c15b12-38e4-46d7-a70a-0f05d68c20c6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:48.964652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-48c15b12-38e4-46d7-a70a-0f05d68c20c6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:48.980349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48c15b12-38e4-46d7-a70a-0f05d68c20c6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:48.982552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48c15b12-38e4-46d7-a70a-0f05d68c20c6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:48.987962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48c15b12-38e4-46d7-a70a-0f05d68c20c6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:48.988739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48c15b12-38e4-46d7-a70a-0f05d68c20c6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:49.022205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-265ddce5-5de0-407e-90b7-bfa26f86b40a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:49.023509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-265ddce5-5de0-407e-90b7-bfa26f86b40a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:49.044013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-265ddce5-5de0-407e-90b7-bfa26f86b40a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:49.046153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-265ddce5-5de0-407e-90b7-bfa26f86b40a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:49.053296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-265ddce5-5de0-407e-90b7-bfa26f86b40a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:49.054155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-265ddce5-5de0-407e-90b7-bfa26f86b40a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:49.643361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:49.684775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:49.919403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-265ddce5-5de0-407e-90b7-bfa26f86b40a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:49.944200 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-265ddce5-5de0-407e-90b7-bfa26f86b40a tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1314 microversion: 2.1 time: 0.926778 May 19 04:44:49.947946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=10 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:49.958607 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1709/3343] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:49 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1314 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:49.972325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-59a95c6c-f709-4146-b076-40da1d31be5f req-9e7df445-9adb-430a-bc66-f4048e47690f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23673e55-0886-4f7e-bbf3-57c29b063597", "name": "network-vif-plugged", "status": "completed", "tag": "92204e48-6abb-409f-ab4f-82447be821fa"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:49.992565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-59a95c6c-f709-4146-b076-40da1d31be5f req-9e7df445-9adb-430a-bc66-f4048e47690f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:49.993369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-59a95c6c-f709-4146-b076-40da1d31be5f req-9e7df445-9adb-430a-bc66-f4048e47690f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:50.022826 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-59a95c6c-f709-4146-b076-40da1d31be5f req-9e7df445-9adb-430a-bc66-f4048e47690f service nova] Creating event network-vif-plugged:92204e48-6abb-409f-ab4f-82447be821fa for instance 23673e55-0886-4f7e-bbf3-57c29b063597 on n-h1-766726-30 May 19 04:44:50.044540 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-59a95c6c-f709-4146-b076-40da1d31be5f req-9e7df445-9adb-430a-bc66-f4048e47690f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081057 May 19 04:44:50.046087 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1710/3344] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:50.058564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-32fc6430-2c95-457f-b980-ce9124a4b756 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:50.061098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-32fc6430-2c95-457f-b980-ce9124a4b756 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:50.077754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32fc6430-2c95-457f-b980-ce9124a4b756 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:50.079879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32fc6430-2c95-457f-b980-ce9124a4b756 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:50.084619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32fc6430-2c95-457f-b980-ce9124a4b756 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:50.085460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32fc6430-2c95-457f-b980-ce9124a4b756 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:50.214652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-48c15b12-38e4-46d7-a70a-0f05d68c20c6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:50.227100 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-48c15b12-38e4-46d7-a70a-0f05d68c20c6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 1.279098 May 19 04:44:50.227721 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1635/3345] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:48 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:50.247160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4296d537-2a1b-4db8-8c8a-72504ce79f7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:50.253818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4296d537-2a1b-4db8-8c8a-72504ce79f7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:50.300641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4296d537-2a1b-4db8-8c8a-72504ce79f7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:50.302566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4296d537-2a1b-4db8-8c8a-72504ce79f7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:50.308538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4296d537-2a1b-4db8-8c8a-72504ce79f7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:50.309224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4296d537-2a1b-4db8-8c8a-72504ce79f7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:51.035841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32fc6430-2c95-457f-b980-ce9124a4b756 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:51.044124 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-32fc6430-2c95-457f-b980-ce9124a4b756 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1475 microversion: 2.1 time: 0.996305 May 19 04:44:51.044961 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1711/3346] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:50 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1475 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:51.076459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:51.077521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:51.102132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:51.102806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:51.106685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:51.108648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:51.346658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4296d537-2a1b-4db8-8c8a-72504ce79f7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:51.356864 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4296d537-2a1b-4db8-8c8a-72504ce79f7c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1367 microversion: 2.1 time: 1.128044 May 19 04:44:51.366771 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1636/3347] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:50 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1367 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:51.372587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:51.380235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-939e5663-adb7-4e1b-b38d-4d04b01c94a0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:51.383884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-939e5663-adb7-4e1b-b38d-4d04b01c94a0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:51.389962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:51.402003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:51.402242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-939e5663-adb7-4e1b-b38d-4d04b01c94a0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:51.402470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-939e5663-adb7-4e1b-b38d-4d04b01c94a0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:51.403271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-939e5663-adb7-4e1b-b38d-4d04b01c94a0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:51.403706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-939e5663-adb7-4e1b-b38d-4d04b01c94a0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:51.412800 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-08f68e72-2d15-4267-9f07-75424bf0fcaf tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.350008 May 19 04:44:51.420984 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1712/3348] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:51 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:51.432240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-931d49fc-dcf3-4e2d-8362-35e2f94ff833 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:51.434881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-931d49fc-dcf3-4e2d-8362-35e2f94ff833 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:51.442077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-931d49fc-dcf3-4e2d-8362-35e2f94ff833 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:51.444896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-931d49fc-dcf3-4e2d-8362-35e2f94ff833 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:51.446380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-931d49fc-dcf3-4e2d-8362-35e2f94ff833 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:51.452506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-931d49fc-dcf3-4e2d-8362-35e2f94ff833 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:51.947188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-931d49fc-dcf3-4e2d-8362-35e2f94ff833 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:51.960197 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-931d49fc-dcf3-4e2d-8362-35e2f94ff833 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.532997 May 19 04:44:51.960876 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1713/3349] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:51 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:52.053442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-939e5663-adb7-4e1b-b38d-4d04b01c94a0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:52.063401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-980845d1-ea57-4fa4-b086-7cb4be21c772 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:52.064649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-980845d1-ea57-4fa4-b086-7cb4be21c772 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:52.075650 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-939e5663-adb7-4e1b-b38d-4d04b01c94a0 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1314 microversion: 2.1 time: 0.707646 May 19 04:44:52.097115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-980845d1-ea57-4fa4-b086-7cb4be21c772 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:52.097578 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1637/3350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:51 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:52.101528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-980845d1-ea57-4fa4-b086-7cb4be21c772 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:52.102685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-980845d1-ea57-4fa4-b086-7cb4be21c772 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:52.112175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-980845d1-ea57-4fa4-b086-7cb4be21c772 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:52.374675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-26202321-f525-45b8-a9e6-1db62a8db9c4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:52.375382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-26202321-f525-45b8-a9e6-1db62a8db9c4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:52.390914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26202321-f525-45b8-a9e6-1db62a8db9c4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:52.391368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26202321-f525-45b8-a9e6-1db62a8db9c4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:52.400673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26202321-f525-45b8-a9e6-1db62a8db9c4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:52.401704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26202321-f525-45b8-a9e6-1db62a8db9c4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:52.731111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-980845d1-ea57-4fa4-b086-7cb4be21c772 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:52.747712 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-980845d1-ea57-4fa4-b086-7cb4be21c772 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1475 microversion: 2.1 time: 0.682889 May 19 04:44:52.748840 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1714/3351] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:52 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1475 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:52.771718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:52.772745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:52.795574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:52.796210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:52.799497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:52.800769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:52.807257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:44:52.966131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-26202321-f525-45b8-a9e6-1db62a8db9c4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:52.975766 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-26202321-f525-45b8-a9e6-1db62a8db9c4 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1556 microversion: 2.1 time: 0.605615 May 19 04:44:52.976362 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1638/3352] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:52 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1556 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:53.004236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:53.006635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f6049f7d-3b50-4a40-8fa7-6155d7aac3cb tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:53.007267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f6049f7d-3b50-4a40-8fa7-6155d7aac3cb tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:53.020293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:53.026453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:53.026691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f6049f7d-3b50-4a40-8fa7-6155d7aac3cb tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:53.027109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f6049f7d-3b50-4a40-8fa7-6155d7aac3cb tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:53.027921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f6049f7d-3b50-4a40-8fa7-6155d7aac3cb tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:53.028369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f6049f7d-3b50-4a40-8fa7-6155d7aac3cb tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:53.028673 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b24e8db5-abc9-4649-9948-5184f8349071 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.277549 May 19 04:44:53.034297 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1715/3353] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:52 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:53.040342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-38f4dbf2-34bc-4ad3-aaaf-fb639d296356 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:53.043110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-38f4dbf2-34bc-4ad3-aaaf-fb639d296356 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:53.058845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38f4dbf2-34bc-4ad3-aaaf-fb639d296356 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:53.060750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38f4dbf2-34bc-4ad3-aaaf-fb639d296356 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:53.062735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38f4dbf2-34bc-4ad3-aaaf-fb639d296356 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:53.063404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38f4dbf2-34bc-4ad3-aaaf-fb639d296356 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:53.359110 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-38f4dbf2-34bc-4ad3-aaaf-fb639d296356 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.323252 May 19 04:44:53.360402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1716/3354] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:44:53 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-interface => generated 284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:53.370845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64f77804-2e87-4187-a614-da3355d7f52e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:53.371950 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64f77804-2e87-4187-a614-da3355d7f52e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:53.408184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64f77804-2e87-4187-a614-da3355d7f52e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:53.409966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64f77804-2e87-4187-a614-da3355d7f52e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:53.412795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64f77804-2e87-4187-a614-da3355d7f52e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:53.413526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64f77804-2e87-4187-a614-da3355d7f52e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:55.269360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f6049f7d-3b50-4a40-8fa7-6155d7aac3cb tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:55.290262 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f6049f7d-3b50-4a40-8fa7-6155d7aac3cb tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 2.297280 May 19 04:44:55.292357 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1639/3355] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:52 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:55.306549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8f145fb4-ecbe-411a-b8ea-4932349e6b9b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:55.308825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8f145fb4-ecbe-411a-b8ea-4932349e6b9b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:55.323722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f145fb4-ecbe-411a-b8ea-4932349e6b9b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:55.325001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f145fb4-ecbe-411a-b8ea-4932349e6b9b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:55.327060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f145fb4-ecbe-411a-b8ea-4932349e6b9b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:55.333486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f145fb4-ecbe-411a-b8ea-4932349e6b9b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:55.783821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-64f77804-2e87-4187-a614-da3355d7f52e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:55.793381 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64f77804-2e87-4187-a614-da3355d7f52e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1314 microversion: 2.1 time: 2.426760 May 19 04:44:55.806187 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1717/3356] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:53 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1314 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:55.811695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:55.816486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:55.841178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:55.843296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:55.844404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:55.847306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:56.190549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:56.206524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:56.209120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:56.210641 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4bd9cb4f-72e2-4a13-9250-deaa9f10d0b0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.403078 May 19 04:44:56.233341 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1718/3357] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:55 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:56.247214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e2832ecc-1166-44ee-a9bb-15ed1c1b841b req-ff43732a-5cbe-48d6-b2a8-32aacfafde8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf0b48f-63c2-488d-978f-f46280338844", "name": "network-vif-plugged", "status": "completed", "tag": "a5f9b7a8-6b88-43e0-80bf-c4954e4870e3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:56.268863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e2832ecc-1166-44ee-a9bb-15ed1c1b841b req-ff43732a-5cbe-48d6-b2a8-32aacfafde8e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:56.280667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e2832ecc-1166-44ee-a9bb-15ed1c1b841b req-ff43732a-5cbe-48d6-b2a8-32aacfafde8e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:56.312272 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e2832ecc-1166-44ee-a9bb-15ed1c1b841b req-ff43732a-5cbe-48d6-b2a8-32aacfafde8e service nova] Creating event network-vif-plugged:a5f9b7a8-6b88-43e0-80bf-c4954e4870e3 for instance bcf0b48f-63c2-488d-978f-f46280338844 on n-h2-766726-30 May 19 04:44:56.319510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8f145fb4-ecbe-411a-b8ea-4932349e6b9b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:56.337909 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8f145fb4-ecbe-411a-b8ea-4932349e6b9b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1475 microversion: 2.1 time: 1.042678 May 19 04:44:56.338306 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e2832ecc-1166-44ee-a9bb-15ed1c1b841b req-ff43732a-5cbe-48d6-b2a8-32aacfafde8e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099619 May 19 04:44:56.341237 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1640/3358] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:55 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1475 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:56.344162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1719/3359] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:44:56.355733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-05541dc7-2380-48c4-9bb0-2f91e18021e9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:56.364258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-05541dc7-2380-48c4-9bb0-2f91e18021e9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:56.388312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05541dc7-2380-48c4-9bb0-2f91e18021e9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:56.390327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05541dc7-2380-48c4-9bb0-2f91e18021e9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:56.393450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05541dc7-2380-48c4-9bb0-2f91e18021e9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:56.394869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05541dc7-2380-48c4-9bb0-2f91e18021e9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:56.811139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-421916ee-b8fd-44e7-9e7e-ae9225f38885 req-298d7557-ca17-4946-bd46-f243ae269aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23673e55-0886-4f7e-bbf3-57c29b063597", "tag": "92204e48-6abb-409f-ab4f-82447be821fa"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:56.835688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-421916ee-b8fd-44e7-9e7e-ae9225f38885 req-298d7557-ca17-4946-bd46-f243ae269aa7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:56.840537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-421916ee-b8fd-44e7-9e7e-ae9225f38885 req-298d7557-ca17-4946-bd46-f243ae269aa7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:56.874567 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-421916ee-b8fd-44e7-9e7e-ae9225f38885 req-298d7557-ca17-4946-bd46-f243ae269aa7 service nova] Creating event network-changed:92204e48-6abb-409f-ab4f-82447be821fa for instance 23673e55-0886-4f7e-bbf3-57c29b063597 on n-h1-766726-30 May 19 04:44:56.893934 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-421916ee-b8fd-44e7-9e7e-ae9225f38885 req-298d7557-ca17-4946-bd46-f243ae269aa7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086483 May 19 04:44:56.895365 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1720/3360] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:44:56.930921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-10c0f065-f782-4627-bcb2-a05777176201 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:56.935192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-10c0f065-f782-4627-bcb2-a05777176201 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:56.965617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10c0f065-f782-4627-bcb2-a05777176201 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:56.967097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10c0f065-f782-4627-bcb2-a05777176201 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:56.967850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10c0f065-f782-4627-bcb2-a05777176201 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:56.968295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10c0f065-f782-4627-bcb2-a05777176201 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:57.219929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-05541dc7-2380-48c4-9bb0-2f91e18021e9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:57.229414 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-05541dc7-2380-48c4-9bb0-2f91e18021e9 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.884377 May 19 04:44:57.240033 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1641/3361] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:56 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:57.255851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:57.258045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:57.277214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:57.278168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:57.279207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:57.279877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:57.641694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:57.661302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:57.666073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:57.670913 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5c19b27d-c155-46e0-aa61-a439ab1d3537 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.429511 May 19 04:44:57.675817 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1642/3362] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:57 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:57.686982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-388e0f99-ef5d-42c9-989d-f263d98d1ba6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:57.690475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-388e0f99-ef5d-42c9-989d-f263d98d1ba6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:57.706665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388e0f99-ef5d-42c9-989d-f263d98d1ba6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:57.712324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388e0f99-ef5d-42c9-989d-f263d98d1ba6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:57.713187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388e0f99-ef5d-42c9-989d-f263d98d1ba6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:57.713638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388e0f99-ef5d-42c9-989d-f263d98d1ba6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:58.198796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-10c0f065-f782-4627-bcb2-a05777176201 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:58.210384 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-10c0f065-f782-4627-bcb2-a05777176201 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1314 microversion: 2.1 time: 1.311212 May 19 04:44:58.211703 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1721/3363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:56 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1314 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:58.260235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66c8427b-255b-49d0-9a44-fbb316d5416d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:58.263791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66c8427b-255b-49d0-9a44-fbb316d5416d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:58.281172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66c8427b-255b-49d0-9a44-fbb316d5416d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:58.281976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66c8427b-255b-49d0-9a44-fbb316d5416d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:58.286991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66c8427b-255b-49d0-9a44-fbb316d5416d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:58.287701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66c8427b-255b-49d0-9a44-fbb316d5416d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:58.318634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-388e0f99-ef5d-42c9-989d-f263d98d1ba6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:58.327005 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-388e0f99-ef5d-42c9-989d-f263d98d1ba6 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1474 microversion: 2.1 time: 0.648894 May 19 04:44:58.346865 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1643/3364] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:57 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1474 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:44:58.700533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:58.704790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:58.731915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:58.732724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:58.734150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:58.734773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:58.894491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-66c8427b-255b-49d0-9a44-fbb316d5416d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:58.941903 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66c8427b-255b-49d0-9a44-fbb316d5416d tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.671242 May 19 04:44:58.944961 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1722/3365] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:58 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:44:58.975868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9d8e8feb-f476-45ec-a9a3-441468e3c3a0 req-9364a920-ea04-4ef5-9aba-d176d2fab1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f45fc0-830a-4e19-a6da-713dee4d1484", "name": "network-vif-unplugged", "status": "completed", "tag": "1c0105bd-12fc-4a28-bacb-da55db20d3ca"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:44:59.021414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9d8e8feb-f476-45ec-a9a3-441468e3c3a0 req-9364a920-ea04-4ef5-9aba-d176d2fab1dd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:59.023766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9d8e8feb-f476-45ec-a9a3-441468e3c3a0 req-9364a920-ea04-4ef5-9aba-d176d2fab1dd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:59.047474 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9d8e8feb-f476-45ec-a9a3-441468e3c3a0 req-9364a920-ea04-4ef5-9aba-d176d2fab1dd service nova] Creating event network-vif-unplugged:1c0105bd-12fc-4a28-bacb-da55db20d3ca for instance 35f45fc0-830a-4e19-a6da-713dee4d1484 on n-h1-766726-30 May 19 04:44:59.064834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-9d8e8feb-f476-45ec-a9a3-441468e3c3a0 req-9364a920-ea04-4ef5-9aba-d176d2fab1dd service nova] Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:44:59.091514 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9d8e8feb-f476-45ec-a9a3-441468e3c3a0 req-9364a920-ea04-4ef5-9aba-d176d2fab1dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121290 May 19 04:44:59.093538 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1723/3366] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:44:59.229128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c6ef8772-7862-450b-a760-5812ca97f8ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:59.231558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c6ef8772-7862-450b-a760-5812ca97f8ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:59.244436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6ef8772-7862-450b-a760-5812ca97f8ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:59.246827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6ef8772-7862-450b-a760-5812ca97f8ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:59.249816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6ef8772-7862-450b-a760-5812ca97f8ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:59.250760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6ef8772-7862-450b-a760-5812ca97f8ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:59.297249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:59.347225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:59.351204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:44:59.358586 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e3b4f26-23bf-4322-a39b-b7c3caf44b95 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.664165 May 19 04:44:59.361366 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1644/3367] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:44:58 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:44:59.371352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c444cabf-00bd-4432-8494-ef88960f2c06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:44:59.371975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c444cabf-00bd-4432-8494-ef88960f2c06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:44:59.391652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c444cabf-00bd-4432-8494-ef88960f2c06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:59.392106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c444cabf-00bd-4432-8494-ef88960f2c06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:44:59.399143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c444cabf-00bd-4432-8494-ef88960f2c06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:44:59.399652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c444cabf-00bd-4432-8494-ef88960f2c06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:00.202243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c444cabf-00bd-4432-8494-ef88960f2c06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:00.224567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:00.231771 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c444cabf-00bd-4432-8494-ef88960f2c06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1474 microversion: 2.1 time: 0.869100 May 19 04:45:00.233492 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1645/3368] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:59 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1474 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:00.252408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c5a4ef1-4483-4c18-afb5-20aa42898970 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:00.255943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c5a4ef1-4483-4c18-afb5-20aa42898970 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:00.286708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a4ef1-4483-4c18-afb5-20aa42898970 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:00.302952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a4ef1-4483-4c18-afb5-20aa42898970 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:00.303848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a4ef1-4483-4c18-afb5-20aa42898970 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:00.304307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a4ef1-4483-4c18-afb5-20aa42898970 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:00.391085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c6ef8772-7862-450b-a760-5812ca97f8ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:00.412499 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c6ef8772-7862-450b-a760-5812ca97f8ca tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1501 microversion: 2.1 time: 1.188227 May 19 04:45:00.415250 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1724/3369] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:44:59 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1501 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:00.433382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:00.434387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:00.452981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:00.453731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:00.454678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:00.455947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:00.733030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:00.774354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:00.782477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:00.785249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d3c0b3a0-bd08-4e27-b4b0-6aeeab721d43 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.365266 May 19 04:45:00.787753 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1725/3370] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:00 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:00.806689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a177ac5c-c883-45af-a1bb-6dbc18239e20 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:00.815441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a177ac5c-c883-45af-a1bb-6dbc18239e20 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:00.831175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a177ac5c-c883-45af-a1bb-6dbc18239e20 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:00.838820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a177ac5c-c883-45af-a1bb-6dbc18239e20 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:00.844893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a177ac5c-c883-45af-a1bb-6dbc18239e20 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:00.848528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a177ac5c-c883-45af-a1bb-6dbc18239e20 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:00.919929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-a177ac5c-c883-45af-a1bb-6dbc18239e20 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lazy-loading 'flavor' on Instance uuid bcf0b48f-63c2-488d-978f-f46280338844 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:45:01.089158 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a177ac5c-c883-45af-a1bb-6dbc18239e20 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "POST /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844/action" status: 202 len: 0 microversion: 2.1 time: 0.298788 May 19 04:45:01.092845 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1726/3371] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:45:00 2022] POST /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:45:01.100458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b2625f33-fe48-4b09-94cc-66d070eb78ed tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:01.130186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b2625f33-fe48-4b09-94cc-66d070eb78ed tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:01.147607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2625f33-fe48-4b09-94cc-66d070eb78ed tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:01.163104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2625f33-fe48-4b09-94cc-66d070eb78ed tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:01.164679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2625f33-fe48-4b09-94cc-66d070eb78ed tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:01.165169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2625f33-fe48-4b09-94cc-66d070eb78ed tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:01.409700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c5a4ef1-4483-4c18-afb5-20aa42898970 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:01.428724 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c5a4ef1-4483-4c18-afb5-20aa42898970 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 1.192230 May 19 04:45:01.429564 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1646/3372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:00 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:01.441823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-647b39c0-a441-4c01-9472-c689a7a8b415 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:01.441823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-647b39c0-a441-4c01-9472-c689a7a8b415 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:01.451883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-647b39c0-a441-4c01-9472-c689a7a8b415 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:01.452624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-647b39c0-a441-4c01-9472-c689a7a8b415 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:01.453927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-647b39c0-a441-4c01-9472-c689a7a8b415 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:01.454571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-647b39c0-a441-4c01-9472-c689a7a8b415 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:01.851386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-647b39c0-a441-4c01-9472-c689a7a8b415 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:01.864417 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-647b39c0-a441-4c01-9472-c689a7a8b415 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1474 microversion: 2.1 time: 0.433754 May 19 04:45:01.865030 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1647/3373] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:01 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1474 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:01.895579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-463430018", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "32f12cab-b595-4d0e-851e-3acde15f2e8f"}, {"uuid": "382f179c-4b5b-4f3b-931c-82ddb6751f34"}, {"uuid": "32f12cab-b595-4d0e-851e-3acde15f2e8f"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:02.021661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] validate_networks() for [('32f12cab-b595-4d0e-851e-3acde15f2e8f', None, None, None, None, None), ('382f179c-4b5b-4f3b-931c-82ddb6751f34', None, None, None, None, None), ('32f12cab-b595-4d0e-851e-3acde15f2e8f', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:45:02.310318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b2625f33-fe48-4b09-94cc-66d070eb78ed tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:02.319911 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b2625f33-fe48-4b09-94cc-66d070eb78ed tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1509 microversion: 2.1 time: 1.224320 May 19 04:45:02.340971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1727/3374] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:01 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1509 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:02.350583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-d71b3abc-ca30-490e-b2bd-a1677b905a30 req-c0384f84-016a-4a1b-82e3-e14a5938f5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f45fc0-830a-4e19-a6da-713dee4d1484", "tag": "1c0105bd-12fc-4a28-bacb-da55db20d3ca"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:02.362063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d71b3abc-ca30-490e-b2bd-a1677b905a30 req-c0384f84-016a-4a1b-82e3-e14a5938f5d4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:02.362930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d71b3abc-ca30-490e-b2bd-a1677b905a30 req-c0384f84-016a-4a1b-82e3-e14a5938f5d4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:02.382850 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-d71b3abc-ca30-490e-b2bd-a1677b905a30 req-c0384f84-016a-4a1b-82e3-e14a5938f5d4 service nova] Creating event network-changed:1c0105bd-12fc-4a28-bacb-da55db20d3ca for instance 35f45fc0-830a-4e19-a6da-713dee4d1484 on n-h1-766726-30 May 19 04:45:02.390821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-d71b3abc-ca30-490e-b2bd-a1677b905a30 req-c0384f84-016a-4a1b-82e3-e14a5938f5d4 service nova] Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:45:02.413678 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-d71b3abc-ca30-490e-b2bd-a1677b905a30 req-c0384f84-016a-4a1b-82e3-e14a5938f5d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070412 May 19 04:45:02.415034 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1728/3375] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:02.476989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:02.490208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:02.499946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:02.500792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:02.504448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:02.505287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:02.717490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:02.737254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:02.741623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:02.744509 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cea5fb84-0d74-4675-944f-c9aafaf6b144 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.326429 May 19 04:45:02.747655 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1729/3376] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:02 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:02.756497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a5bf38d2-7023-43e9-b9ea-d563e91d0aa4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:02.758309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a5bf38d2-7023-43e9-b9ea-d563e91d0aa4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:02.774264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5bf38d2-7023-43e9-b9ea-d563e91d0aa4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:02.776943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5bf38d2-7023-43e9-b9ea-d563e91d0aa4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:02.780214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5bf38d2-7023-43e9-b9ea-d563e91d0aa4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:02.780968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5bf38d2-7023-43e9-b9ea-d563e91d0aa4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:03.729947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a5bf38d2-7023-43e9-b9ea-d563e91d0aa4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:03.743391 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a5bf38d2-7023-43e9-b9ea-d563e91d0aa4 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.992247 May 19 04:45:03.744746 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1730/3377] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:02 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:03.756954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60ddd0a0-4f27-4bcd-9ea9-79c00c5585e5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:03.759231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60ddd0a0-4f27-4bcd-9ea9-79c00c5585e5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:03.773907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60ddd0a0-4f27-4bcd-9ea9-79c00c5585e5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:03.774359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60ddd0a0-4f27-4bcd-9ea9-79c00c5585e5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:03.775143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60ddd0a0-4f27-4bcd-9ea9-79c00c5585e5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:03.775584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60ddd0a0-4f27-4bcd-9ea9-79c00c5585e5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:04.365261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60ddd0a0-4f27-4bcd-9ea9-79c00c5585e5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:04.373876 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60ddd0a0-4f27-4bcd-9ea9-79c00c5585e5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1472 microversion: 2.1 time: 0.625373 May 19 04:45:04.384309 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1731/3378] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:03 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1472 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:04.391850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9fb83c0b-116e-458f-9015-9e3db2224603 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:04.393248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9fb83c0b-116e-458f-9015-9e3db2224603 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:04.399833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fb83c0b-116e-458f-9015-9e3db2224603 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:04.400626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fb83c0b-116e-458f-9015-9e3db2224603 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:04.401631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fb83c0b-116e-458f-9015-9e3db2224603 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:04.402233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9fb83c0b-116e-458f-9015-9e3db2224603 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:04.427362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:04.836597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9fb83c0b-116e-458f-9015-9e3db2224603 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:04.846439 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9fb83c0b-116e-458f-9015-9e3db2224603 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1492 microversion: 2.1 time: 0.460085 May 19 04:45:04.847452 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1732/3379] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:04 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1492 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:04.852584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:04.854025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:04.864890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:04.865622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:04.866593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:04.867258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:04.968938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:04.980875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:04.982437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:04.983712 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94bf57c7-5289-46c4-9c44-9ab43a94a1e1 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.135144 May 19 04:45:04.984322 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1733/3380] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:04 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:04.990493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f18bafa-f405-44e6-81de-9e579099d518 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:04.991450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f18bafa-f405-44e6-81de-9e579099d518 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:05.000158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f18bafa-f405-44e6-81de-9e579099d518 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.003989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f18bafa-f405-44e6-81de-9e579099d518 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:05.004862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f18bafa-f405-44e6-81de-9e579099d518 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.005338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f18bafa-f405-44e6-81de-9e579099d518 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:05.455373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f18bafa-f405-44e6-81de-9e579099d518 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:05.469795 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f18bafa-f405-44e6-81de-9e579099d518 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1485 microversion: 2.1 time: 0.484174 May 19 04:45:05.480887 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1734/3381] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:04 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1485 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:05.480887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c68f0c25-1d38-46cf-b48b-0f60b5054590 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:05.480887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c68f0c25-1d38-46cf-b48b-0f60b5054590 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:05.513046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c68f0c25-1d38-46cf-b48b-0f60b5054590 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.513554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c68f0c25-1d38-46cf-b48b-0f60b5054590 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:05.514331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c68f0c25-1d38-46cf-b48b-0f60b5054590 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.514770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c68f0c25-1d38-46cf-b48b-0f60b5054590 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:05.587635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c68f0c25-1d38-46cf-b48b-0f60b5054590 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:45:05.742471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:45:05.743026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:45:05.743617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:45:05.744333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:45:05.744675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:45:05.772559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.772983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:05.775668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.778543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:05.779052 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c68f0c25-1d38-46cf-b48b-0f60b5054590 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 204 len: 0 microversion: 2.1 time: 0.306677 May 19 04:45:05.779928 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1735/3382] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:05 2022] DELETE /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:45:05.787994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-83460ce0-bd31-48c4-895e-f9d7c4601347 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:05.790282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-83460ce0-bd31-48c4-895e-f9d7c4601347 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:05.805785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:05.809602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83460ce0-bd31-48c4-895e-f9d7c4601347 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.810056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83460ce0-bd31-48c4-895e-f9d7c4601347 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:05.811198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83460ce0-bd31-48c4-895e-f9d7c4601347 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.811962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83460ce0-bd31-48c4-895e-f9d7c4601347 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:05.831211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Getting quotas for project b6633f964e254f10a5209671d95504f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:45:05.839197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Getting quotas for user 811f04490bc64b769f287f1f44577a3b and project b6633f964e254f10a5209671d95504f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:45:05.857533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:45:05.861455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:45:05.949994 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3fbdb061-4c83-4224-bedc-f274078a3280 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.074567 May 19 04:45:05.951789 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1648/3383] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:45:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:45:05.966056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-268a9a1d-7f9e-467f-98b9-ddca793f5670 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:05.967313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-268a9a1d-7f9e-467f-98b9-ddca793f5670 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:05.995705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-268a9a1d-7f9e-467f-98b9-ddca793f5670 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.997899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-268a9a1d-7f9e-467f-98b9-ddca793f5670 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:05.997899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-268a9a1d-7f9e-467f-98b9-ddca793f5670 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:05.998494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-268a9a1d-7f9e-467f-98b9-ddca793f5670 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:06.092819 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-268a9a1d-7f9e-467f-98b9-ddca793f5670 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "POST /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062/action" status: 202 len: 0 microversion: 2.1 time: 0.130577 May 19 04:45:06.094558 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1649/3384] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:45:05 2022] POST /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:45:06.128367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e510755-cfa5-4ee6-b43c-30f80685bfff tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:06.130930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e510755-cfa5-4ee6-b43c-30f80685bfff tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:06.151197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e510755-cfa5-4ee6-b43c-30f80685bfff tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:06.151869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e510755-cfa5-4ee6-b43c-30f80685bfff tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:06.152921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e510755-cfa5-4ee6-b43c-30f80685bfff tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:06.154091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e510755-cfa5-4ee6-b43c-30f80685bfff tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:06.977719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-83460ce0-bd31-48c4-895e-f9d7c4601347 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:06.993831 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-83460ce0-bd31-48c4-895e-f9d7c4601347 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1469 microversion: 2.1 time: 1.210358 May 19 04:45:06.995547 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1736/3385] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:05 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1469 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:07.025468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fba5c213-3019-4923-a027-7013d09dd31c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:07.026817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fba5c213-3019-4923-a027-7013d09dd31c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:07.035262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fba5c213-3019-4923-a027-7013d09dd31c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.036632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fba5c213-3019-4923-a027-7013d09dd31c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:07.037465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fba5c213-3019-4923-a027-7013d09dd31c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.037910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fba5c213-3019-4923-a027-7013d09dd31c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:07.237586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e510755-cfa5-4ee6-b43c-30f80685bfff tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:07.248593 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e510755-cfa5-4ee6-b43c-30f80685bfff tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1498 microversion: 2.1 time: 1.152284 May 19 04:45:07.255740 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1650/3386] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:06 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1498 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:07.260570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fba5c213-3019-4923-a027-7013d09dd31c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:07.264159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:07.264786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:07.273008 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fba5c213-3019-4923-a027-7013d09dd31c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1216 microversion: 2.1 time: 0.266250 May 19 04:45:07.288029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.288483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:07.288648 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1737/3387] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:06 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1216 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:07.289709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.290315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:07.302644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8910f5ab-8efd-4976-9c56-0e098e6c7772 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:07.312704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8910f5ab-8efd-4976-9c56-0e098e6c7772 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:07.325929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8910f5ab-8efd-4976-9c56-0e098e6c7772 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.329022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8910f5ab-8efd-4976-9c56-0e098e6c7772 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:07.330735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8910f5ab-8efd-4976-9c56-0e098e6c7772 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.337905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8910f5ab-8efd-4976-9c56-0e098e6c7772 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:07.516757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:07.530298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:07.540010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:07.541301 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4840de00-7a10-42a8-b536-41ca19814cc6 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.281724 May 19 04:45:07.544909 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1651/3388] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:07 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:07.549921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8a3763af-3861-446c-8dca-99759200bd88 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:07.556092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8a3763af-3861-446c-8dca-99759200bd88 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:07.574243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a3763af-3861-446c-8dca-99759200bd88 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.574899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a3763af-3861-446c-8dca-99759200bd88 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:07.576034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a3763af-3861-446c-8dca-99759200bd88 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.576629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a3763af-3861-446c-8dca-99759200bd88 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:07.749594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8910f5ab-8efd-4976-9c56-0e098e6c7772 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:07.761461 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8910f5ab-8efd-4976-9c56-0e098e6c7772 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1493 microversion: 2.1 time: 0.469090 May 19 04:45:07.762118 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1738/3389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:07 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1493 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:07.778453 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8a3763af-3861-446c-8dca-99759200bd88 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "POST /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484/action" status: 202 len: 0 microversion: 2.1 time: 0.232092 May 19 04:45:07.780159 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1652/3390] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:45:07 2022] POST /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:45:07.793000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e6fdc99-7271-4a3b-bd63-c900f8d409d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:07.794066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9e6fdc99-7271-4a3b-bd63-c900f8d409d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:07.804634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e6fdc99-7271-4a3b-bd63-c900f8d409d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.805298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e6fdc99-7271-4a3b-bd63-c900f8d409d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:07.806232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e6fdc99-7271-4a3b-bd63-c900f8d409d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:07.806669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e6fdc99-7271-4a3b-bd63-c900f8d409d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.010167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9e6fdc99-7271-4a3b-bd63-c900f8d409d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:08.018205 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e6fdc99-7271-4a3b-bd63-c900f8d409d1 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 0.233587 May 19 04:45:08.027903 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1739/3391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:07 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:08.205977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ee189bf1-20a6-4d3e-a9b9-747ce465ad14 req-4d0d04fb-9a34-4b75-8c64-056071ec4b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf0b48f-63c2-488d-978f-f46280338844", "name": "network-vif-deleted", "tag": "a5f9b7a8-6b88-43e0-80bf-c4954e4870e3"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:08.218193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ee189bf1-20a6-4d3e-a9b9-747ce465ad14 req-4d0d04fb-9a34-4b75-8c64-056071ec4b15 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.219074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ee189bf1-20a6-4d3e-a9b9-747ce465ad14 req-4d0d04fb-9a34-4b75-8c64-056071ec4b15 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.234826 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ee189bf1-20a6-4d3e-a9b9-747ce465ad14 req-4d0d04fb-9a34-4b75-8c64-056071ec4b15 service nova] Creating event network-vif-deleted:a5f9b7a8-6b88-43e0-80bf-c4954e4870e3 for instance bcf0b48f-63c2-488d-978f-f46280338844 on n-h2-766726-30 May 19 04:45:08.242347 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ee189bf1-20a6-4d3e-a9b9-747ce465ad14 req-4d0d04fb-9a34-4b75-8c64-056071ec4b15 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041173 May 19 04:45:08.244952 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1653/3392] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:08.274744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:08.275426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:08.292362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b503be25-965a-4863-beba-caa4aa30bd01 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:08.293126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b503be25-965a-4863-beba-caa4aa30bd01 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:08.305847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.307120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.309579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.310449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.311356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b503be25-965a-4863-beba-caa4aa30bd01 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.312403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b503be25-965a-4863-beba-caa4aa30bd01 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.313755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b503be25-965a-4863-beba-caa4aa30bd01 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.314254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b503be25-965a-4863-beba-caa4aa30bd01 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.390306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.391032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.391664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lazy-loading 'fault' on Instance uuid bcf0b48f-63c2-488d-978f-f46280338844 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:45:08.474397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b503be25-965a-4863-beba-caa4aa30bd01 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:08.475919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e14ea8dad314974bf5f4e8e51b88349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef9ce51b2c4d59869b65ac106ed777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:08.483182 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b503be25-965a-4863-beba-caa4aa30bd01 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1264 microversion: 2.1 time: 0.195479 May 19 04:45:08.484682 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1654/3393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:08 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:45:08.486538 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d016c30-d8ee-4be2-9b00-6628e862eff2 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 200 len: 1304 microversion: 2.1 time: 0.217864 May 19 04:45:08.487328 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1740/3394] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:08 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 1304 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:08.567237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:08.568472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:08.591335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.592483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.594351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.595071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.679019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:08.691363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:08.693223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:08.694604 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3dcc5221-24f5-4a34-9ef2-61e48bec28c0 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.134572 May 19 04:45:08.695375 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1655/3395] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:08 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:08.779727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d55dc669-ba54-4ad2-b2e2-8016d3b2fbbf tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:08.780833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d55dc669-ba54-4ad2-b2e2-8016d3b2fbbf tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:08.792495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d55dc669-ba54-4ad2-b2e2-8016d3b2fbbf tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.792846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d55dc669-ba54-4ad2-b2e2-8016d3b2fbbf tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.793668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d55dc669-ba54-4ad2-b2e2-8016d3b2fbbf tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:08.794117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d55dc669-ba54-4ad2-b2e2-8016d3b2fbbf tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:08.988751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d55dc669-ba54-4ad2-b2e2-8016d3b2fbbf tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:09.000674 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d55dc669-ba54-4ad2-b2e2-8016d3b2fbbf tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1493 microversion: 2.1 time: 0.224871 May 19 04:45:09.002401 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1741/3396] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:08 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1493 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:09.035739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a00a936e-8c2a-4ac0-a60b-1fd812696b02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:09.036620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a00a936e-8c2a-4ac0-a60b-1fd812696b02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:09.048863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a00a936e-8c2a-4ac0-a60b-1fd812696b02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.049783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a00a936e-8c2a-4ac0-a60b-1fd812696b02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.051935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a00a936e-8c2a-4ac0-a60b-1fd812696b02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.052558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a00a936e-8c2a-4ac0-a60b-1fd812696b02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.316089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1ccdaeb9-b40f-4b66-841c-dddae0f1b031 req-01ab27f6-b06f-421b-95bf-54679c66ae49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f45fc0-830a-4e19-a6da-713dee4d1484", "name": "network-vif-plugged", "status": "completed", "tag": "1c0105bd-12fc-4a28-bacb-da55db20d3ca"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:09.351908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1ccdaeb9-b40f-4b66-841c-dddae0f1b031 req-01ab27f6-b06f-421b-95bf-54679c66ae49 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.359189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1ccdaeb9-b40f-4b66-841c-dddae0f1b031 req-01ab27f6-b06f-421b-95bf-54679c66ae49 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.387210 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1ccdaeb9-b40f-4b66-841c-dddae0f1b031 req-01ab27f6-b06f-421b-95bf-54679c66ae49 service nova] Creating event network-vif-plugged:1c0105bd-12fc-4a28-bacb-da55db20d3ca for instance 35f45fc0-830a-4e19-a6da-713dee4d1484 on n-h1-766726-30 May 19 04:45:09.393592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-1ccdaeb9-b40f-4b66-841c-dddae0f1b031 req-01ab27f6-b06f-421b-95bf-54679c66ae49 service nova] Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:45:09.416369 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1ccdaeb9-b40f-4b66-841c-dddae0f1b031 req-01ab27f6-b06f-421b-95bf-54679c66ae49 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109803 May 19 04:45:09.417629 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1742/3397] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:09.503394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be53cc48-6a3a-4f72-bce2-68f845fbac69 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:09.504507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be53cc48-6a3a-4f72-bce2-68f845fbac69 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:09.516500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be53cc48-6a3a-4f72-bce2-68f845fbac69 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.519730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be53cc48-6a3a-4f72-bce2-68f845fbac69 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.520703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be53cc48-6a3a-4f72-bce2-68f845fbac69 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.525758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be53cc48-6a3a-4f72-bce2-68f845fbac69 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.591637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a00a936e-8c2a-4ac0-a60b-1fd812696b02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:09.603092 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a00a936e-8c2a-4ac0-a60b-1fd812696b02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 0.571854 May 19 04:45:09.603710 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1656/3398] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:09 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:09.613225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:09.629996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:09.636233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.636695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.637511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.637961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.670958 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 HTTP/1.1 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'bcf0b48f-63c2-488d-978f-f46280338844'} May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.672806 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-acdd8310-7451-4613-a1e7-1dc3cd51e2d8 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 404 len: 111 microversion: 2.1 time: 0.069918 May 19 04:45:09.678690 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1657/3399] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:09 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:09.687841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:09.688358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:09.695611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be53cc48-6a3a-4f72-bce2-68f845fbac69 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:09.695904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.696364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.697179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.697625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.703232 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be53cc48-6a3a-4f72-bce2-68f845fbac69 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1270 microversion: 2.1 time: 0.206879 May 19 04:45:09.703985 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1743/3400] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:09 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:45:09.712098 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 HTTP/1.1 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'bcf0b48f-63c2-488d-978f-f46280338844'} May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:09.715452 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.719189 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.721446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:09.723537 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29060442-8694-4188-a9e4-68242644a362 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 404 len: 111 microversion: 2.1 time: 0.039579 May 19 04:45:09.724813 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1658/3401] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:09 2022] DELETE /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:09.733755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:09.738707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:09.739331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: bcf0b48f-63c2-488d-978f-f46280338844] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:09.741739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:09.753517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.753924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.755883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.759134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.759599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.760399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.760864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.761372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.800635 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 HTTP/1.1 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'bcf0b48f-63c2-488d-978f-f46280338844'} May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.811820 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.816710 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.816710 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.816710 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.816710 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:09.816710 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:09.816710 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. May 19 04:45:09.816710 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.816710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance bcf0b48f-63c2-488d-978f-f46280338844 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:09.822506 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-45c84040-5421-4716-8824-6fd7f77d9063 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844" status: 404 len: 111 microversion: 2.1 time: 0.078411 May 19 04:45:09.823629 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1659/3402] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:09 2022] GET /compute/v2.1/servers/bcf0b48f-63c2-488d-978f-f46280338844 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:09.841898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:09.842518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:09.857479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.857940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.866230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.867000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.897161 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 HTTP/1.1 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '59be2c79-a225-4e66-94af-e8c52a84d705'} May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:09.903132 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:09.907070 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee172f5e-5a46-448e-9c01-1ebdf8c5b628 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 404 len: 111 microversion: 2.1 time: 0.078497 May 19 04:45:09.909850 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1660/3403] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:09 2022] DELETE /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:09.920454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:09.926072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 59be2c79-a225-4e66-94af-e8c52a84d705] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:09.936839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.937323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.938106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:09.938541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:09.943044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:09.953055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:09.960594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:09.961987 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be7fae09-34de-492e-be23-726c2ab6407c tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.232086 May 19 04:45:09.967857 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1744/3404] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:09 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:09.980252 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 HTTP/1.1 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '59be2c79-a225-4e66-94af-e8c52a84d705'} May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:09.984191 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.988591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:09.988591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:09.988591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:09.988591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:09.988591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:09.988591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. May 19 04:45:09.988591 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:09.988591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 59be2c79-a225-4e66-94af-e8c52a84d705 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:09.988591 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bc03ad4d-4c31-42f2-b80d-5272fe7bd833 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705" status: 404 len: 111 microversion: 2.1 time: 0.075599 May 19 04:45:09.989183 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1661/3405] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:09 2022] GET /compute/v2.1/servers/59be2c79-a225-4e66-94af-e8c52a84d705 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:09.996937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:09.998044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:10.012990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.013598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.014718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.015749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.019376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1f7d6f40-0789-40bf-897e-a92da9e5dd05 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:10.020384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1f7d6f40-0789-40bf-897e-a92da9e5dd05 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:10.030917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f7d6f40-0789-40bf-897e-a92da9e5dd05 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.031668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f7d6f40-0789-40bf-897e-a92da9e5dd05 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.032741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f7d6f40-0789-40bf-897e-a92da9e5dd05 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.033449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f7d6f40-0789-40bf-897e-a92da9e5dd05 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.045424 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 HTTP/1.1 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8'} May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:10.047279 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0329532f-348e-42b9-9cf0-3eb9caf02c3c tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 404 len: 111 microversion: 2.1 time: 0.056976 May 19 04:45:10.052181 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1745/3406] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:09 2022] DELETE /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:10.062205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:10.069566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:10.077899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.081881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.082823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.083357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.115586 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 HTTP/1.1 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8'} May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.119408 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.123508 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.123508 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.123508 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.123508 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:10.123508 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:10.123508 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. May 19 04:45:10.123508 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.123508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:10.125238 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2297bf5-7593-48a7-86dc-5edb73927951 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8" status: 404 len: 111 microversion: 2.1 time: 0.069546 May 19 04:45:10.126680 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1746/3407] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:10 2022] GET /compute/v2.1/servers/3bb65da6-ae3e-424c-ac8a-5e9a3ed008e8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:10.135738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:10.136261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:10.155216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.155694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.156515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.156960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.182950 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 HTTP/1.1 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '96b5cdae-ce14-4498-b192-9fc681612c20'} May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:10.186433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.191887 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.194839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:10.196106 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cf5ca40a-d7bb-4118-93b3-ef6660441294 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 404 len: 111 microversion: 2.1 time: 0.064404 May 19 04:45:10.199348 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1747/3408] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:10 2022] DELETE /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:45:10.204579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:10.209547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 96b5cdae-ce14-4498-b192-9fc681612c20] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:10.226816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.227591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.228606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.229250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.249420 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 HTTP/1.1 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '96b5cdae-ce14-4498-b192-9fc681612c20'} May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.252485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.256717 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.256717 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.256717 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.256717 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:10.256717 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:10.256717 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. May 19 04:45:10.256717 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.258946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 96b5cdae-ce14-4498-b192-9fc681612c20 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:10.259914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1bddd416-3022-426b-a008-0d7740b9deb9 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20" status: 404 len: 111 microversion: 2.1 time: 0.059250 May 19 04:45:10.260908 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1748/3409] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:10 2022] GET /compute/v2.1/servers/96b5cdae-ce14-4498-b192-9fc681612c20 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:45:10.269976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:10.273458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:10.282646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.284350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.286035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.286718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.307260 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 HTTP/1.1 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2d5472b0-f730-4891-985f-cc16e617c486'} May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:10.311140 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.314959 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.317709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:10.319222 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43f1cca9-60c1-429c-a91a-2001cabd0392 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 404 len: 111 microversion: 2.1 time: 0.054251 May 19 04:45:10.325021 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1749/3410] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:10 2022] DELETE /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:10.335498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:10.336776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 2d5472b0-f730-4891-985f-cc16e617c486] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:10.350678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.351482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.352962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.353819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.370759 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 HTTP/1.1 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2d5472b0-f730-4891-985f-cc16e617c486'} May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:10.372427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.376740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:10.376740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:10.376740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:10.376740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:10.376740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:10.376740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. May 19 04:45:10.376740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:10.379274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 2d5472b0-f730-4891-985f-cc16e617c486 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:10.380642 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72d61bc7-a5b4-4890-8c3d-4255a68755de tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486" status: 404 len: 111 microversion: 2.1 time: 0.053995 May 19 04:45:10.381812 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1750/3411] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:10 2022] GET /compute/v2.1/servers/2d5472b0-f730-4891-985f-cc16e617c486 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:10.621588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d416eb76-9169-41cf-9c40-a6d7e3547270 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:10.631243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d416eb76-9169-41cf-9c40-a6d7e3547270 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:10.648559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d416eb76-9169-41cf-9c40-a6d7e3547270 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.652577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d416eb76-9169-41cf-9c40-a6d7e3547270 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.656305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d416eb76-9169-41cf-9c40-a6d7e3547270 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.659588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d416eb76-9169-41cf-9c40-a6d7e3547270 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.726211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:10.856740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1f7d6f40-0789-40bf-897e-a92da9e5dd05 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:10.875162 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1f7d6f40-0789-40bf-897e-a92da9e5dd05 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1499 microversion: 2.1 time: 0.860429 May 19 04:45:10.895761 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1662/3412] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:10 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1499 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:10.902669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87471108-9252-43dd-9b0f-e237eb760782 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:10.903542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-87471108-9252-43dd-9b0f-e237eb760782 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:10.911098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87471108-9252-43dd-9b0f-e237eb760782 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.911752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87471108-9252-43dd-9b0f-e237eb760782 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:10.913225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87471108-9252-43dd-9b0f-e237eb760782 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:10.913843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87471108-9252-43dd-9b0f-e237eb760782 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:11.288676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-87471108-9252-43dd-9b0f-e237eb760782 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:11.305368 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87471108-9252-43dd-9b0f-e237eb760782 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1312 microversion: 2.1 time: 0.404507 May 19 04:45:11.306019 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1663/3413] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:10 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1312 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:11.343339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d7e7418-d6e5-471a-a337-504eeed0f953 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:11.344759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4d7e7418-d6e5-471a-a337-504eeed0f953 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:11.361170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d7e7418-d6e5-471a-a337-504eeed0f953 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:11.362790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d7e7418-d6e5-471a-a337-504eeed0f953 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:11.364713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d7e7418-d6e5-471a-a337-504eeed0f953 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:11.366094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d7e7418-d6e5-471a-a337-504eeed0f953 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:11.388076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d416eb76-9169-41cf-9c40-a6d7e3547270 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:11.405546 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d416eb76-9169-41cf-9c40-a6d7e3547270 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 0.788743 May 19 04:45:11.414917 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1751/3414] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:10 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:11.414917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:11.414917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:11.425234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:11.435438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:11.435907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:11.436735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:11.437248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:11.497401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4d7e7418-d6e5-471a-a337-504eeed0f953 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:45:11.710621 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4d7e7418-d6e5-471a-a337-504eeed0f953 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 204 len: 0 microversion: 2.1 time: 0.403174 May 19 04:45:11.711403 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1664/3415] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:11 2022] DELETE /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:45:11.721729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-22bd7ef0-6c37-4f1f-b878-929417dee956 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:11.724911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-22bd7ef0-6c37-4f1f-b878-929417dee956 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:11.738863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22bd7ef0-6c37-4f1f-b878-929417dee956 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:11.742477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22bd7ef0-6c37-4f1f-b878-929417dee956 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:11.743442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22bd7ef0-6c37-4f1f-b878-929417dee956 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:11.744150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22bd7ef0-6c37-4f1f-b878-929417dee956 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:11.785382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:11.798393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:11.801163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:11.806490 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b463430d-e388-422e-9064-c016e75fb2de tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.398939 May 19 04:45:11.823894 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1752/3416] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:11 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:12.104014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-22bd7ef0-6c37-4f1f-b878-929417dee956 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:12.118637 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-22bd7ef0-6c37-4f1f-b878-929417dee956 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.402113 May 19 04:45:12.119725 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1665/3417] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:11 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:12.324603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bf48790a-6924-46f8-81d1-ddf141adf9e2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:12.325447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bf48790a-6924-46f8-81d1-ddf141adf9e2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:12.341093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf48790a-6924-46f8-81d1-ddf141adf9e2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:12.341780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf48790a-6924-46f8-81d1-ddf141adf9e2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:12.342793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf48790a-6924-46f8-81d1-ddf141adf9e2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:12.343238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf48790a-6924-46f8-81d1-ddf141adf9e2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:12.422897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-efe094ec-3b13-4313-bdf2-ff687ba338f2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:12.423753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-efe094ec-3b13-4313-bdf2-ff687ba338f2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:12.441540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efe094ec-3b13-4313-bdf2-ff687ba338f2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:12.442515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efe094ec-3b13-4313-bdf2-ff687ba338f2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:12.444379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efe094ec-3b13-4313-bdf2-ff687ba338f2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:12.444990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efe094ec-3b13-4313-bdf2-ff687ba338f2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:12.733936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bf48790a-6924-46f8-81d1-ddf141adf9e2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:12.744031 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bf48790a-6924-46f8-81d1-ddf141adf9e2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.424606 May 19 04:45:12.765296 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1753/3418] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:12 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:12.795904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-efe094ec-3b13-4313-bdf2-ff687ba338f2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:12.804910 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-efe094ec-3b13-4313-bdf2-ff687ba338f2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 0.386155 May 19 04:45:12.815994 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1666/3419] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:12 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:12.829475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:12.830323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:12.845094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:12.846242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:12.847476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:12.847924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:12.972687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:12.984605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:12.986463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:12.987855 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-326b9708-09ed-4147-bba6-713e43a24b36 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.163814 May 19 04:45:13.000890 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1754/3420] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:12 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:13.138891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3ebd9a3-22f8-4db9-8749-cb165e1165f6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:13.139517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3ebd9a3-22f8-4db9-8749-cb165e1165f6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:13.168638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9a3-22f8-4db9-8749-cb165e1165f6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:13.169330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9a3-22f8-4db9-8749-cb165e1165f6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:13.170338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9a3-22f8-4db9-8749-cb165e1165f6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:13.171757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9a3-22f8-4db9-8749-cb165e1165f6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:13.441902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3ebd9a3-22f8-4db9-8749-cb165e1165f6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:13.451096 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3ebd9a3-22f8-4db9-8749-cb165e1165f6 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.317390 May 19 04:45:13.462713 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1667/3421] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:13 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:13.762407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-721c269a-3677-4f85-b2e4-1fd62a72ad90 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:13.764183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-721c269a-3677-4f85-b2e4-1fd62a72ad90 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:13.784298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-721c269a-3677-4f85-b2e4-1fd62a72ad90 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:13.785108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-721c269a-3677-4f85-b2e4-1fd62a72ad90 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:13.791527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-721c269a-3677-4f85-b2e4-1fd62a72ad90 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:13.792861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-721c269a-3677-4f85-b2e4-1fd62a72ad90 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:13.831083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-105aa299-e21f-4b30-b020-c9d7142c5cb8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:13.831552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-105aa299-e21f-4b30-b020-c9d7142c5cb8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:13.843234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-105aa299-e21f-4b30-b020-c9d7142c5cb8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:13.844842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-105aa299-e21f-4b30-b020-c9d7142c5cb8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:13.848874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-105aa299-e21f-4b30-b020-c9d7142c5cb8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:13.853116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-105aa299-e21f-4b30-b020-c9d7142c5cb8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:14.195972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-721c269a-3677-4f85-b2e4-1fd62a72ad90 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:14.213529 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-721c269a-3677-4f85-b2e4-1fd62a72ad90 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.456040 May 19 04:45:14.214357 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1755/3422] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:13 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:14.231811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:14.232742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:14.256024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:14.259148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:14.261359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:14.261826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:14.323977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-105aa299-e21f-4b30-b020-c9d7142c5cb8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:14.334344 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-105aa299-e21f-4b30-b020-c9d7142c5cb8 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 0.515825 May 19 04:45:14.343913 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1668/3423] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:13 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:14.350475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e579c943-46e3-4469-a546-03e8feae4d8e req-7a588bc7-bfb9-4cf9-b68e-6374f94ba6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "tag": "fe5abfb6-6a72-4662-bb44-c0ace3be9e2b"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:14.358081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:14.360428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e579c943-46e3-4469-a546-03e8feae4d8e req-7a588bc7-bfb9-4cf9-b68e-6374f94ba6db service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:14.361569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e579c943-46e3-4469-a546-03e8feae4d8e req-7a588bc7-bfb9-4cf9-b68e-6374f94ba6db service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:14.375775 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e579c943-46e3-4469-a546-03e8feae4d8e req-7a588bc7-bfb9-4cf9-b68e-6374f94ba6db service nova] Creating event network-changed:fe5abfb6-6a72-4662-bb44-c0ace3be9e2b for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:14.382154 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e579c943-46e3-4469-a546-03e8feae4d8e req-7a588bc7-bfb9-4cf9-b68e-6374f94ba6db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036936 May 19 04:45:14.383175 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1669/3424] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:14.395808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:14.407524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:14.409874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:14.414128 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a941d94-d9dd-475c-b7ba-17730c7405ef tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.193790 May 19 04:45:14.415352 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1756/3425] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:14 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:14.477564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-19c5923a-0576-49aa-b834-dbaf4ba7365c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:14.478721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-19c5923a-0576-49aa-b834-dbaf4ba7365c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:14.499122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19c5923a-0576-49aa-b834-dbaf4ba7365c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:14.499771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19c5923a-0576-49aa-b834-dbaf4ba7365c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:14.500573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19c5923a-0576-49aa-b834-dbaf4ba7365c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:14.501017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19c5923a-0576-49aa-b834-dbaf4ba7365c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:14.710758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-19c5923a-0576-49aa-b834-dbaf4ba7365c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:14.726540 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-19c5923a-0576-49aa-b834-dbaf4ba7365c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.256714 May 19 04:45:14.739570 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1670/3426] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:14 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:15.230230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8140c1e-4c01-41e7-8932-3dffb2ea8fab tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:15.230847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8140c1e-4c01-41e7-8932-3dffb2ea8fab tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:15.248033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8140c1e-4c01-41e7-8932-3dffb2ea8fab tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:15.248714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8140c1e-4c01-41e7-8932-3dffb2ea8fab tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:15.249681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8140c1e-4c01-41e7-8932-3dffb2ea8fab tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:15.250283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8140c1e-4c01-41e7-8932-3dffb2ea8fab tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:15.355595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-83dc88b1-a874-4998-b4cd-7db98e7afc02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:15.357460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-83dc88b1-a874-4998-b4cd-7db98e7afc02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:15.371123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83dc88b1-a874-4998-b4cd-7db98e7afc02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:15.373884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83dc88b1-a874-4998-b4cd-7db98e7afc02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:15.378508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83dc88b1-a874-4998-b4cd-7db98e7afc02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:15.380283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83dc88b1-a874-4998-b4cd-7db98e7afc02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:15.543235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8140c1e-4c01-41e7-8932-3dffb2ea8fab tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:15.559786 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8140c1e-4c01-41e7-8932-3dffb2ea8fab tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.333350 May 19 04:45:15.561113 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1757/3427] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:15 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:45:15.565993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:15.570147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:15.588024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:15.589109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:15.590896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:15.593331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:15.660570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-83dc88b1-a874-4998-b4cd-7db98e7afc02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:15.677343 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-83dc88b1-a874-4998-b4cd-7db98e7afc02 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 0.329118 May 19 04:45:15.677951 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1671/3428] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:15 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:15.738135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:15.744024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d5a9da3b-a67e-4f11-bd32-02a9d29b4e2c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:15.744919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d5a9da3b-a67e-4f11-bd32-02a9d29b4e2c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:15.749337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:15.750898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:15.752151 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e3f619de-e883-48d0-9435-7abde618df20 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.189779 May 19 04:45:15.763348 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1758/3429] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:15 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:15.766553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5a9da3b-a67e-4f11-bd32-02a9d29b4e2c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:15.766816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5a9da3b-a67e-4f11-bd32-02a9d29b4e2c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:15.767654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5a9da3b-a67e-4f11-bd32-02a9d29b4e2c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:15.768102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5a9da3b-a67e-4f11-bd32-02a9d29b4e2c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:15.813146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:15.850281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:16.161385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d5a9da3b-a67e-4f11-bd32-02a9d29b4e2c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:16.172398 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d5a9da3b-a67e-4f11-bd32-02a9d29b4e2c tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 0.432323 May 19 04:45:16.173004 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1672/3430] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:15 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:16.584863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-93d4eb6d-7189-429e-9950-2a9833f8cdb7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:16.585564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-93d4eb6d-7189-429e-9950-2a9833f8cdb7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:16.608638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93d4eb6d-7189-429e-9950-2a9833f8cdb7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:16.613357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93d4eb6d-7189-429e-9950-2a9833f8cdb7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:16.614920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93d4eb6d-7189-429e-9950-2a9833f8cdb7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:16.617360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93d4eb6d-7189-429e-9950-2a9833f8cdb7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:16.700390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ea1a2b75-9144-4489-87d0-d354d96db5dd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:16.701013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ea1a2b75-9144-4489-87d0-d354d96db5dd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:16.746081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea1a2b75-9144-4489-87d0-d354d96db5dd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:16.748320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea1a2b75-9144-4489-87d0-d354d96db5dd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:16.754036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea1a2b75-9144-4489-87d0-d354d96db5dd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:16.754533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea1a2b75-9144-4489-87d0-d354d96db5dd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:18.703326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-93d4eb6d-7189-429e-9950-2a9833f8cdb7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:18.713663 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-93d4eb6d-7189-429e-9950-2a9833f8cdb7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 2.140606 May 19 04:45:18.718598 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1759/3431] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:16 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:18.731476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:18.742335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:18.756148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:18.757005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:18.766633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:18.777803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:18.919231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ea1a2b75-9144-4489-87d0-d354d96db5dd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:18.933710 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ea1a2b75-9144-4489-87d0-d354d96db5dd tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 2.237720 May 19 04:45:18.934672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1673/3432] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:16 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:18.940372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-271fc6a8-f8fc-4034-ab33-6b67a7211415 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:18.954075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-271fc6a8-f8fc-4034-ab33-6b67a7211415 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:18.961229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-271fc6a8-f8fc-4034-ab33-6b67a7211415 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:18.962030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-271fc6a8-f8fc-4034-ab33-6b67a7211415 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:18.963092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-271fc6a8-f8fc-4034-ab33-6b67a7211415 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:18.963771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-271fc6a8-f8fc-4034-ab33-6b67a7211415 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:19.013372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:19.024031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:19.047578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:19.054517 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e02c32dc-0a1d-467c-b423-9d070812ee91 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.334591 May 19 04:45:19.060052 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1760/3433] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:18 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:19.078931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6b862d8e-51cb-40be-bba0-6ede8559f08a req-377a3b50-8e7b-4385-919b-a8189a3f1d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "tag": "7274752f-dda5-4883-8b3e-4dc473d91bf3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:19.134868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6b862d8e-51cb-40be-bba0-6ede8559f08a req-377a3b50-8e7b-4385-919b-a8189a3f1d81 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:19.153893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6b862d8e-51cb-40be-bba0-6ede8559f08a req-377a3b50-8e7b-4385-919b-a8189a3f1d81 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:19.210819 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6b862d8e-51cb-40be-bba0-6ede8559f08a req-377a3b50-8e7b-4385-919b-a8189a3f1d81 service nova] Creating event network-changed:7274752f-dda5-4883-8b3e-4dc473d91bf3 for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:19.239065 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6b862d8e-51cb-40be-bba0-6ede8559f08a req-377a3b50-8e7b-4385-919b-a8189a3f1d81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174567 May 19 04:45:19.245503 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1761/3434] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:19.544465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-929a7476-ab97-4eea-a850-c09d3b5b02d8 req-2583c1a1-98b8-4fe8-8e97-ce379d2fdf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29ff13b-411b-4e3a-8974-55cf7429a062", "name": "network-vif-unplugged", "status": "completed", "tag": "483885c7-b80b-46a5-bf42-a6ef218263a7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:19.559582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-929a7476-ab97-4eea-a850-c09d3b5b02d8 req-2583c1a1-98b8-4fe8-8e97-ce379d2fdf1f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:19.561334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-929a7476-ab97-4eea-a850-c09d3b5b02d8 req-2583c1a1-98b8-4fe8-8e97-ce379d2fdf1f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:19.600800 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-929a7476-ab97-4eea-a850-c09d3b5b02d8 req-2583c1a1-98b8-4fe8-8e97-ce379d2fdf1f service nova] Creating event network-vif-unplugged:483885c7-b80b-46a5-bf42-a6ef218263a7 for instance f29ff13b-411b-4e3a-8974-55cf7429a062 on n-h1-766726-30 May 19 04:45:19.612913 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-929a7476-ab97-4eea-a850-c09d3b5b02d8 req-2583c1a1-98b8-4fe8-8e97-ce379d2fdf1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072128 May 19 04:45:19.613383 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1762/3435] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:19.738214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c624aad9-44a7-4ace-9e7c-fbcadd4aa916 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:19.739817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c624aad9-44a7-4ace-9e7c-fbcadd4aa916 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:19.748871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c624aad9-44a7-4ace-9e7c-fbcadd4aa916 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:19.759283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c624aad9-44a7-4ace-9e7c-fbcadd4aa916 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:19.760501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c624aad9-44a7-4ace-9e7c-fbcadd4aa916 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:19.761836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c624aad9-44a7-4ace-9e7c-fbcadd4aa916 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:20.770246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-271fc6a8-f8fc-4034-ab33-6b67a7211415 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:20.786749 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-271fc6a8-f8fc-4034-ab33-6b67a7211415 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 200 len: 1505 microversion: 2.1 time: 1.850780 May 19 04:45:20.796617 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1674/3436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:18 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 1505 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:20.796854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d793920-7dbe-4fb1-8296-266e410f58b0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:20.805642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9d793920-7dbe-4fb1-8296-266e410f58b0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:20.836078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d793920-7dbe-4fb1-8296-266e410f58b0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:20.836884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d793920-7dbe-4fb1-8296-266e410f58b0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:20.837885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d793920-7dbe-4fb1-8296-266e410f58b0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:20.838480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d793920-7dbe-4fb1-8296-266e410f58b0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:21.111303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c624aad9-44a7-4ace-9e7c-fbcadd4aa916 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:21.120947 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c624aad9-44a7-4ace-9e7c-fbcadd4aa916 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 1.387969 May 19 04:45:21.137532 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1763/3437] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:19 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:21.143707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:21.158266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:21.175440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:21.177442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:21.179435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:21.180058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:21.508916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9d793920-7dbe-4fb1-8296-266e410f58b0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:21.512892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:21.521010 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9d793920-7dbe-4fb1-8296-266e410f58b0 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 0.725298 May 19 04:45:21.521859 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1675/3438] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:20 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:21.530821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:21.535211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-7e928fc1-0617-4157-816e-9bbfabff9d13 req-6fd3204f-7690-495d-a6b1-5aa89b6d30b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f45fc0-830a-4e19-a6da-713dee4d1484", "name": "network-vif-unplugged", "status": "completed", "tag": "1c0105bd-12fc-4a28-bacb-da55db20d3ca"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:21.537412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:21.539110 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9789aa61-0502-426d-90ef-1717a1ab7994 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.400042 May 19 04:45:21.539863 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1764/3439] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:21 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:21.556024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7e928fc1-0617-4157-816e-9bbfabff9d13 req-6fd3204f-7690-495d-a6b1-5aa89b6d30b0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:21.558559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7e928fc1-0617-4157-816e-9bbfabff9d13 req-6fd3204f-7690-495d-a6b1-5aa89b6d30b0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:21.563410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-10c9afee-a169-4361-bbcc-893a6ff98d7a req-3fa5e6c7-1789-42cc-9b9f-f102556bed3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "tag": "450ad028-f0c9-4f3f-944c-407e12871c4a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:21.574187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-10c9afee-a169-4361-bbcc-893a6ff98d7a req-3fa5e6c7-1789-42cc-9b9f-f102556bed3b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:21.574640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-10c9afee-a169-4361-bbcc-893a6ff98d7a req-3fa5e6c7-1789-42cc-9b9f-f102556bed3b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:21.583379 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-7e928fc1-0617-4157-816e-9bbfabff9d13 req-6fd3204f-7690-495d-a6b1-5aa89b6d30b0 service nova] Creating event network-vif-unplugged:1c0105bd-12fc-4a28-bacb-da55db20d3ca for instance 35f45fc0-830a-4e19-a6da-713dee4d1484 on n-h2-766726-30 May 19 04:45:21.590050 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-10c9afee-a169-4361-bbcc-893a6ff98d7a req-3fa5e6c7-1789-42cc-9b9f-f102556bed3b service nova] Creating event network-changed:450ad028-f0c9-4f3f-944c-407e12871c4a for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:21.598880 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-10c9afee-a169-4361-bbcc-893a6ff98d7a req-3fa5e6c7-1789-42cc-9b9f-f102556bed3b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045271 May 19 04:45:21.603678 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1765/3440] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:21.603958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-7e928fc1-0617-4157-816e-9bbfabff9d13 req-6fd3204f-7690-495d-a6b1-5aa89b6d30b0 service nova] Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:45:21.645935 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-7e928fc1-0617-4157-816e-9bbfabff9d13 req-6fd3204f-7690-495d-a6b1-5aa89b6d30b0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114676 May 19 04:45:21.646604 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1676/3441] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:21.808707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:21.810442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: f29ff13b-411b-4e3a-8974-55cf7429a062] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:21.818809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:21.819546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:21.820667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:21.821350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:21.838328 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] HTTP exception thrown: Instance f29ff13b-411b-4e3a-8974-55cf7429a062 could not be found. May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Request method failure captured: May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 HTTP/1.1 May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcrmU_NK0kMpwof90BNoa4aKF9anWlW2aFB6u5nUl1VtIl-fUp7RMBqV6MJSYeVVpdLKPyp7pvHkr8BfzgNeHJ3sCwXmNiZICaOH2Ym1NwcYmlbrBPxS_Q9lU331AzHV6l7DVvJWDZIbrJUZ0rXC4QcchmiS51ck447JD0Da5BOCZbI May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: cd18dc85a9074ccebec5de473b90fb27 May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerRescueTestJSON-87878147 May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd18dc85a9074ccebec5de473b90fb27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd18dc85a9074ccebec5de473b90fb27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd18dc85a9074ccebec5de473b90fb27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd18dc85a9074ccebec5de473b90fb27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerRescueTestJSON-87878147 May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: cd18dc85a9074ccebec5de473b90fb27 May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerRescueTestJSON-87878147 May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerRescueTestJSON-87878147-project May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b645d221b97b4d9fb5c3ae3bc0fec0ed May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerRescueTestJSON-87878147-project May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance f29ff13b-411b-4e3a-8974-55cf7429a062 could not be found. May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'f29ff13b-411b-4e3a-8974-55cf7429a062'} May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29ff13b-411b-4e3a-8974-55cf7429a062 could not be found. May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29ff13b-411b-4e3a-8974-55cf7429a062 could not be found. May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:21.840698 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:21.847320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:21.847320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:21.847320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:21.847320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:21.847320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:21.847320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29ff13b-411b-4e3a-8974-55cf7429a062 could not be found. May 19 04:45:21.847320 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:21.850607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Returning 404 to user: Instance f29ff13b-411b-4e3a-8974-55cf7429a062 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:21.851687 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66b0796e-126d-41d4-915a-d31d88089de1 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062" status: 404 len: 111 microversion: 2.1 time: 0.050892 May 19 04:45:21.852841 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1766/3442] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:21 2022] GET /compute/v2.1/servers/f29ff13b-411b-4e3a-8974-55cf7429a062 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:21.863491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8f58814c-43bc-4a2b-a362-590a623b9de3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:21.863998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8f58814c-43bc-4a2b-a362-590a623b9de3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:21.873480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f58814c-43bc-4a2b-a362-590a623b9de3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:21.874169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f58814c-43bc-4a2b-a362-590a623b9de3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:21.877203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f58814c-43bc-4a2b-a362-590a623b9de3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:21.877978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f58814c-43bc-4a2b-a362-590a623b9de3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:21.932135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8f58814c-43bc-4a2b-a362-590a623b9de3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:45:22.084606 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8f58814c-43bc-4a2b-a362-590a623b9de3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 204 len: 0 microversion: 2.1 time: 0.226525 May 19 04:45:22.086469 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1677/3443] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:21 2022] DELETE /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:45:22.094141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b9cd1d0c-b5a5-41ab-a755-368d2180dcb3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:22.095060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b9cd1d0c-b5a5-41ab-a755-368d2180dcb3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:22.111650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9cd1d0c-b5a5-41ab-a755-368d2180dcb3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:22.118148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9cd1d0c-b5a5-41ab-a755-368d2180dcb3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:22.120286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9cd1d0c-b5a5-41ab-a755-368d2180dcb3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:22.133797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9cd1d0c-b5a5-41ab-a755-368d2180dcb3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:22.142978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30d544cb-c40a-4b8b-a800-1b909940380b tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:22.143916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-30d544cb-c40a-4b8b-a800-1b909940380b tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:22.161381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30d544cb-c40a-4b8b-a800-1b909940380b tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:22.162815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30d544cb-c40a-4b8b-a800-1b909940380b tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:22.163619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30d544cb-c40a-4b8b-a800-1b909940380b tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:22.164068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30d544cb-c40a-4b8b-a800-1b909940380b tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:22.523998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-30d544cb-c40a-4b8b-a800-1b909940380b tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:22.525178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b9cd1d0c-b5a5-41ab-a755-368d2180dcb3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:22.526512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:22.537755 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b9cd1d0c-b5a5-41ab-a755-368d2180dcb3 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1491 microversion: 2.1 time: 0.447815 May 19 04:45:22.547735 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-30d544cb-c40a-4b8b-a800-1b909940380b tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.403278 May 19 04:45:22.547735 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1678/3444] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:22 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:22.550161 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1767/3445] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:22 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1491 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:22.557584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6ea753e7-8f58-446f-8467-342d1ee65449 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:22.558209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6ea753e7-8f58-446f-8467-342d1ee65449 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:22.559376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:22.560330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:22.567590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:22.568693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:22.569688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:22.570295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:22.581844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ea753e7-8f58-446f-8467-342d1ee65449 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:22.582533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ea753e7-8f58-446f-8467-342d1ee65449 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:22.583566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ea753e7-8f58-446f-8467-342d1ee65449 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:22.584168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ea753e7-8f58-446f-8467-342d1ee65449 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:22.709885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:22.723399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:22.735714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:22.737743 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e3edf4fd-faea-4df6-84fb-19dd55383159 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.182830 May 19 04:45:22.744455 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1768/3446] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:22 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:45:22.898291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6ea753e7-8f58-446f-8467-342d1ee65449 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:22.906492 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6ea753e7-8f58-446f-8467-342d1ee65449 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 0.363729 May 19 04:45:22.908615 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1679/3447] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:22 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:23.556558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3f870569-d30d-4797-ba12-c9aefdd80665 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:23.557313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3f870569-d30d-4797-ba12-c9aefdd80665 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:23.563760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59512300-4e6d-4e9d-bb67-d9b29c47c575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:23.564400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-59512300-4e6d-4e9d-bb67-d9b29c47c575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:23.574497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f870569-d30d-4797-ba12-c9aefdd80665 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:23.574954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f870569-d30d-4797-ba12-c9aefdd80665 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:23.575741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f870569-d30d-4797-ba12-c9aefdd80665 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:23.576185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f870569-d30d-4797-ba12-c9aefdd80665 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:23.582130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59512300-4e6d-4e9d-bb67-d9b29c47c575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:23.582583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59512300-4e6d-4e9d-bb67-d9b29c47c575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:23.583361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59512300-4e6d-4e9d-bb67-d9b29c47c575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:23.583800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59512300-4e6d-4e9d-bb67-d9b29c47c575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:23.834543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3f870569-d30d-4797-ba12-c9aefdd80665 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:23.843732 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3f870569-d30d-4797-ba12-c9aefdd80665 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1491 microversion: 2.1 time: 0.292454 May 19 04:45:23.845960 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1769/3448] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:23 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1491 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:23.852597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-95da6f95-d421-4cf6-a578-39bfb9ab78f5 req-106da82d-bd8b-45e0-9f88-0ac57ed126b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29ff13b-411b-4e3a-8974-55cf7429a062", "name": "network-vif-deleted", "tag": "483885c7-b80b-46a5-bf42-a6ef218263a7"}, {"name": "network-changed", "server_uuid": "35f45fc0-830a-4e19-a6da-713dee4d1484", "tag": "1c0105bd-12fc-4a28-bacb-da55db20d3ca"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:23.865344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-95da6f95-d421-4cf6-a578-39bfb9ab78f5 req-106da82d-bd8b-45e0-9f88-0ac57ed126b3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:23.865609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-59512300-4e6d-4e9d-bb67-d9b29c47c575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:23.866897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-95da6f95-d421-4cf6-a578-39bfb9ab78f5 req-106da82d-bd8b-45e0-9f88-0ac57ed126b3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:23.874932 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59512300-4e6d-4e9d-bb67-d9b29c47c575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.314854 May 19 04:45:23.875863 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1680/3449] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:23 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:23.880664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:23.881311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:23.885644 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-95da6f95-d421-4cf6-a578-39bfb9ab78f5 req-106da82d-bd8b-45e0-9f88-0ac57ed126b3 service nova] Creating event network-vif-deleted:483885c7-b80b-46a5-bf42-a6ef218263a7 for instance f29ff13b-411b-4e3a-8974-55cf7429a062 on n-h1-766726-30 May 19 04:45:23.886738 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-95da6f95-d421-4cf6-a578-39bfb9ab78f5 req-106da82d-bd8b-45e0-9f88-0ac57ed126b3 service nova] Creating event network-changed:1c0105bd-12fc-4a28-bacb-da55db20d3ca for instance 35f45fc0-830a-4e19-a6da-713dee4d1484 on n-h2-766726-30 May 19 04:45:23.893520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-95da6f95-d421-4cf6-a578-39bfb9ab78f5 req-106da82d-bd8b-45e0-9f88-0ac57ed126b3 service nova] Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 04:45:23.895657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:23.896309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:23.897711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:23.898328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:23.911729 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-95da6f95-d421-4cf6-a578-39bfb9ab78f5 req-106da82d-bd8b-45e0-9f88-0ac57ed126b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063380 May 19 04:45:23.913049 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1770/3450] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:23.927484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8c6716c7-fccb-42e9-8b32-47a483f657cc tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:23.928940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8c6716c7-fccb-42e9-8b32-47a483f657cc tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:23.936585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c6716c7-fccb-42e9-8b32-47a483f657cc tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:23.937706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c6716c7-fccb-42e9-8b32-47a483f657cc tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:23.938956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c6716c7-fccb-42e9-8b32-47a483f657cc tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:23.939624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c6716c7-fccb-42e9-8b32-47a483f657cc tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:23.943199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:23.980768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:23.992038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:23.993902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:23.995341 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4b067e1-3be0-4961-957a-763be2356c9a tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1604 microversion: 2.42 time: 0.118461 May 19 04:45:24.008013 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1681/3451] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:23 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1604 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:24.097436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8c6716c7-fccb-42e9-8b32-47a483f657cc tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:24.122251 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8c6716c7-fccb-42e9-8b32-47a483f657cc tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1468 microversion: 2.1 time: 0.202181 May 19 04:45:24.134064 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1771/3452] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:23 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1468 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:24.871997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-57e0ae48-e6c1-4891-81d9-2a1ce059253f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:24.873102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-57e0ae48-e6c1-4891-81d9-2a1ce059253f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:24.883243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57e0ae48-e6c1-4891-81d9-2a1ce059253f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:24.883956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57e0ae48-e6c1-4891-81d9-2a1ce059253f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:24.885034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57e0ae48-e6c1-4891-81d9-2a1ce059253f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:24.887787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57e0ae48-e6c1-4891-81d9-2a1ce059253f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:24.902156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-892c3c78-5abe-4464-9b46-214a1d5c8855 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:24.902884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-892c3c78-5abe-4464-9b46-214a1d5c8855 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:24.915387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-892c3c78-5abe-4464-9b46-214a1d5c8855 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:24.922777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-892c3c78-5abe-4464-9b46-214a1d5c8855 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:24.924332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-892c3c78-5abe-4464-9b46-214a1d5c8855 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:24.924851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-892c3c78-5abe-4464-9b46-214a1d5c8855 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:25.386157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-57e0ae48-e6c1-4891-81d9-2a1ce059253f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b645d221b97b4d9fb5c3ae3bc0fec0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd18dc85a9074ccebec5de473b90fb27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:25.398021 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-57e0ae48-e6c1-4891-81d9-2a1ce059253f tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 200 len: 1491 microversion: 2.1 time: 0.537365 May 19 04:45:25.413360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-892c3c78-5abe-4464-9b46-214a1d5c8855 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:25.417998 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1682/3453] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:24 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 1491 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:25.425801 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-892c3c78-5abe-4464-9b46-214a1d5c8855 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.537687 May 19 04:45:25.427177 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1772/3454] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:24 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:25.434435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d72c097c-a5a5-4a9b-9f68-162242b3bea5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:25.435371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d72c097c-a5a5-4a9b-9f68-162242b3bea5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:25.444317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d72c097c-a5a5-4a9b-9f68-162242b3bea5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:25.445106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d72c097c-a5a5-4a9b-9f68-162242b3bea5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:25.446196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d72c097c-a5a5-4a9b-9f68-162242b3bea5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:25.446851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d72c097c-a5a5-4a9b-9f68-162242b3bea5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:25.456207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:25.456972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:25.466090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:25.466612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:25.467450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:25.468167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:25.518022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:25.518651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:25.519332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lazy-loading 'fault' on Instance uuid f893d60d-f792-409a-99a4-ddfa34b26ab3 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:45:25.594022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:25.604278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:25.607763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bd8feb841f4876a7f1519525cf3fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47f533f04d498c872d7eebd936dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:25.608996 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed5cbc26-3606-4a54-bda0-bb9db7ef8249 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 200 len: 1371 microversion: 2.42 time: 0.183019 May 19 04:45:25.616210 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1683/3455] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:25 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:45:25.620846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d1d4cf13-1dfc-41da-ba4f-6074223bee84 req-a0391a05-5e99-4ff2-aff9-533e95a13af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab142e5-ae78-480f-96d6-bbe61f8574f7", "name": "network-vif-deleted", "tag": "33c8ede5-22d9-431c-9bd0-555f0928a3a9"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:25.642782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d1d4cf13-1dfc-41da-ba4f-6074223bee84 req-a0391a05-5e99-4ff2-aff9-533e95a13af8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:25.643219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d1d4cf13-1dfc-41da-ba4f-6074223bee84 req-a0391a05-5e99-4ff2-aff9-533e95a13af8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:25.691223 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d1d4cf13-1dfc-41da-ba4f-6074223bee84 req-a0391a05-5e99-4ff2-aff9-533e95a13af8 service nova] Creating event network-vif-deleted:33c8ede5-22d9-431c-9bd0-555f0928a3a9 for instance 0ab142e5-ae78-480f-96d6-bbe61f8574f7 on n-h1-766726-30 May 19 04:45:25.696045 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d1d4cf13-1dfc-41da-ba4f-6074223bee84 req-a0391a05-5e99-4ff2-aff9-533e95a13af8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078583 May 19 04:45:25.697031 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1684/3456] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:26.076517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d72c097c-a5a5-4a9b-9f68-162242b3bea5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:26.091783 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d72c097c-a5a5-4a9b-9f68-162242b3bea5 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1461 microversion: 2.1 time: 0.663045 May 19 04:45:26.092656 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1773/3457] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:25 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1461 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:26.109547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-94182c72-d219-410f-9de4-b1b2f8bc6126 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:26.110259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-94182c72-d219-410f-9de4-b1b2f8bc6126 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:26.132425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94182c72-d219-410f-9de4-b1b2f8bc6126 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.132777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94182c72-d219-410f-9de4-b1b2f8bc6126 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.133580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94182c72-d219-410f-9de4-b1b2f8bc6126 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.134013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-94182c72-d219-410f-9de4-b1b2f8bc6126 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.427410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:26.428303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] [instance: 0ab142e5-ae78-480f-96d6-bbe61f8574f7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:26.436746 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-94182c72-d219-410f-9de4-b1b2f8bc6126 tempest-MigrationsAdminTest-1160010530 tempest-MigrationsAdminTest-1160010530-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1614 microversion: 2.1 time: 0.317367 May 19 04:45:26.440971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.441617 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1685/3458] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:26 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1614 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:26.444645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.446943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.451016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.457880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74632ecd-1754-46c7-8176-fc991bf8a2f2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:26.458841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74632ecd-1754-46c7-8176-fc991bf8a2f2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:26.479055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74632ecd-1754-46c7-8176-fc991bf8a2f2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.479784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74632ecd-1754-46c7-8176-fc991bf8a2f2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.480872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74632ecd-1754-46c7-8176-fc991bf8a2f2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.491412 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] HTTP exception thrown: Instance 0ab142e5-ae78-480f-96d6-bbe61f8574f7 could not be found. May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Request method failure captured: May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 HTTP/1.1 May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcrmU_NK0kMpwof90BNoa4aKF9anWlW2aFB6u5nUl1VtIl-fUp7RMBqV6MJSYeVVpdLKPyp7pvHkr8BfzgNeHJ3sCwXmNiZICaOH2Ym1NwcYmlbrBPxS_Q9lU331AzHV6l7DVvJWDZIbrJUZ0rXC4QcchmiS51ck447JD0Da5BOCZbI May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: cd18dc85a9074ccebec5de473b90fb27 May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerRescueTestJSON-87878147 May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd18dc85a9074ccebec5de473b90fb27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd18dc85a9074ccebec5de473b90fb27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd18dc85a9074ccebec5de473b90fb27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd18dc85a9074ccebec5de473b90fb27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerRescueTestJSON-87878147 May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: cd18dc85a9074ccebec5de473b90fb27 May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerRescueTestJSON-87878147 May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerRescueTestJSON-87878147-project May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b645d221b97b4d9fb5c3ae3bc0fec0ed May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerRescueTestJSON-87878147-project May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 0ab142e5-ae78-480f-96d6-bbe61f8574f7 could not be found. May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '0ab142e5-ae78-480f-96d6-bbe61f8574f7'} May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab142e5-ae78-480f-96d6-bbe61f8574f7 could not be found. May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab142e5-ae78-480f-96d6-bbe61f8574f7 could not be found. May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:26.493289 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.498182 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:26.498182 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:26.498182 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:26.498182 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:26.498182 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:26.498182 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab142e5-ae78-480f-96d6-bbe61f8574f7 could not be found. May 19 04:45:26.498182 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.499419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] Returning 404 to user: Instance 0ab142e5-ae78-480f-96d6-bbe61f8574f7 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:26.502255 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-773307c0-4782-46f2-ad21-e964b2fa4d00 tempest-ServerRescueTestJSON-87878147 tempest-ServerRescueTestJSON-87878147-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7" status: 404 len: 111 microversion: 2.1 time: 0.079413 May 19 04:45:26.502669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74632ecd-1754-46c7-8176-fc991bf8a2f2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.503534 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1774/3459] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:26 2022] GET /compute/v2.1/servers/0ab142e5-ae78-480f-96d6-bbe61f8574f7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:26.509015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa4e5891-2303-4e1b-892c-f36036afb11b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:26.509896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aa4e5891-2303-4e1b-892c-f36036afb11b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:26.517322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa4e5891-2303-4e1b-892c-f36036afb11b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.518039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa4e5891-2303-4e1b-892c-f36036afb11b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.519176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa4e5891-2303-4e1b-892c-f36036afb11b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.519811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa4e5891-2303-4e1b-892c-f36036afb11b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.555671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aa4e5891-2303-4e1b-892c-f36036afb11b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:45:26.660664 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa4e5891-2303-4e1b-892c-f36036afb11b tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "DELETE /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 204 len: 0 microversion: 2.1 time: 0.154695 May 19 04:45:26.661929 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1775/3460] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:26 2022] DELETE /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:45:26.668738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:26.669570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:26.677494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.678290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.679073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.679517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.700931 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] HTTP exception thrown: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Request method failure captured: May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 HTTP/1.1 May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcmJk_uiQmB-__G6BRK74IeHh-549ySIOeKryaytLBvmPzWbgB_MBffPi5lAPEMOQZZRFGdMdFU7ljos3JxIcjsBZE76Syma913l_zb6KaRbaX73K17_CB1llzNPYhUnZ3FW9UCnYhOgvs0pDVVpkUW8FVJJPu84GzaNPAWPj-z1eyo May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.42 May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ce47f533f04d498c872d7eebd936dd7a May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-804157538 May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TaggedBootDevicesTest_v242-804157538 May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ce47f533f04d498c872d7eebd936dd7a May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-804157538 May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TaggedBootDevicesTest_v242-804157538-project May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: c8bd8feb841f4876a7f1519525cf3fb4 May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TaggedBootDevicesTest_v242-804157538-project May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'f893d60d-f792-409a-99a4-ddfa34b26ab3'} May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.702907 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Returning 404 to user: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0ec5ad6-7b23-4fd9-aa33-c767ea652bfc tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 404 len: 111 microversion: 2.42 time: 0.041205 May 19 04:45:26.707043 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1776/3461] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:26 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:45:26.710043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5dab8b94-3179-43e8-b43d-d96b16ba81cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:26.710657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5dab8b94-3179-43e8-b43d-d96b16ba81cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:26.720241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5dab8b94-3179-43e8-b43d-d96b16ba81cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.720696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5dab8b94-3179-43e8-b43d-d96b16ba81cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.721663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5dab8b94-3179-43e8-b43d-d96b16ba81cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:26.722115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5dab8b94-3179-43e8-b43d-d96b16ba81cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:26.857294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74632ecd-1754-46c7-8176-fc991bf8a2f2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:26.869331 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74632ecd-1754-46c7-8176-fc991bf8a2f2 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.426228 May 19 04:45:26.870238 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1686/3462] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:26 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:26.877932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-37d6331b-2933-4f3d-8ba5-0789c9caa6d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '.version_select at 0x7fd31483ab80>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:26.905507 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-37d6331b-2933-4f3d-8ba5-0789c9caa6d4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346713678" status: 204 len: 0 microversion: 2.42 time: 0.033630 May 19 04:45:26.906668 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1687/3463] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:45:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346713678 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:45:27.067409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5dab8b94-3179-43e8-b43d-d96b16ba81cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:27.072092 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5dab8b94-3179-43e8-b43d-d96b16ba81cb tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1467 microversion: 2.1 time: 0.365531 May 19 04:45:27.072830 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1777/3464] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:26 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1467 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:27.850379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-7c21a3bb-2132-42cf-a049-0856f43ce0e4 req-0625ce86-f6e5-4c4a-87c6-65206f577ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f45fc0-830a-4e19-a6da-713dee4d1484", "name": "network-vif-plugged", "status": "completed", "tag": "1c0105bd-12fc-4a28-bacb-da55db20d3ca"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:27.873635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7c21a3bb-2132-42cf-a049-0856f43ce0e4 req-0625ce86-f6e5-4c4a-87c6-65206f577ecb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:27.874106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7c21a3bb-2132-42cf-a049-0856f43ce0e4 req-0625ce86-f6e5-4c4a-87c6-65206f577ecb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:27.887052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da0fb1b8-5535-492c-9643-fbe3b00d9d23 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:27.888392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da0fb1b8-5535-492c-9643-fbe3b00d9d23 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:27.896340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da0fb1b8-5535-492c-9643-fbe3b00d9d23 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:27.902178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da0fb1b8-5535-492c-9643-fbe3b00d9d23 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:27.905457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da0fb1b8-5535-492c-9643-fbe3b00d9d23 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:27.909243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da0fb1b8-5535-492c-9643-fbe3b00d9d23 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:27.922321 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-7c21a3bb-2132-42cf-a049-0856f43ce0e4 req-0625ce86-f6e5-4c4a-87c6-65206f577ecb service nova] Creating event network-vif-plugged:1c0105bd-12fc-4a28-bacb-da55db20d3ca for instance 35f45fc0-830a-4e19-a6da-713dee4d1484 on n-h2-766726-30 May 19 04:45:27.937770 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-7c21a3bb-2132-42cf-a049-0856f43ce0e4 req-0625ce86-f6e5-4c4a-87c6-65206f577ecb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090895 May 19 04:45:27.943556 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1688/3465] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:28.090437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2e47e930-5b1b-436c-9988-931682878d09 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:28.091523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2e47e930-5b1b-436c-9988-931682878d09 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:28.103279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e47e930-5b1b-436c-9988-931682878d09 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:28.106104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e47e930-5b1b-436c-9988-931682878d09 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:28.107037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e47e930-5b1b-436c-9988-931682878d09 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:28.111823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e47e930-5b1b-436c-9988-931682878d09 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:28.884559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-da0fb1b8-5535-492c-9643-fbe3b00d9d23 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:28.894727 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da0fb1b8-5535-492c-9643-fbe3b00d9d23 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 1.011379 May 19 04:45:28.898622 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1778/3466] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:27 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:29.028781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d0152327-0932-416c-ab80-16835ff8aa08 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:29.029446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d0152327-0932-416c-ab80-16835ff8aa08 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:29.044276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0152327-0932-416c-ab80-16835ff8aa08 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:29.044887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0152327-0932-416c-ab80-16835ff8aa08 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:29.049191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0152327-0932-416c-ab80-16835ff8aa08 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:29.054920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0152327-0932-416c-ab80-16835ff8aa08 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:29.127050 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d0152327-0932-416c-ab80-16835ff8aa08 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/ips" status: 200 len: 148 microversion: 2.1 time: 0.102357 May 19 04:45:29.135951 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1779/3467] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:45:29 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/ips => generated 148 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:45:29.916082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-37591fa2-29c6-4c20-b1d6-5b22d16316ba tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:29.917458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-37591fa2-29c6-4c20-b1d6-5b22d16316ba tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:29.928739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37591fa2-29c6-4c20-b1d6-5b22d16316ba tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:29.937739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37591fa2-29c6-4c20-b1d6-5b22d16316ba tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:29.939271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37591fa2-29c6-4c20-b1d6-5b22d16316ba tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:29.943931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37591fa2-29c6-4c20-b1d6-5b22d16316ba tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:30.014305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2e47e930-5b1b-436c-9988-931682878d09 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:30.035176 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2e47e930-5b1b-436c-9988-931682878d09 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1467 microversion: 2.1 time: 1.948714 May 19 04:45:30.036526 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1689/3468] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:28 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1467 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:30.636157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-37591fa2-29c6-4c20-b1d6-5b22d16316ba tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:30.647713 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-37591fa2-29c6-4c20-b1d6-5b22d16316ba tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.735391 May 19 04:45:30.648310 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1780/3469] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:29 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:31.055137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be8cca21-08b7-4e60-b483-f75a9f80d736 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:31.055652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be8cca21-08b7-4e60-b483-f75a9f80d736 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:31.066746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be8cca21-08b7-4e60-b483-f75a9f80d736 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:31.072368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be8cca21-08b7-4e60-b483-f75a9f80d736 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:31.077673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be8cca21-08b7-4e60-b483-f75a9f80d736 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:31.078756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be8cca21-08b7-4e60-b483-f75a9f80d736 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:31.670683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a8c9e2e-9cda-4eae-b57b-1ce1b05879da tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:31.672021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a8c9e2e-9cda-4eae-b57b-1ce1b05879da tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:31.699108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a8c9e2e-9cda-4eae-b57b-1ce1b05879da tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:31.699564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a8c9e2e-9cda-4eae-b57b-1ce1b05879da tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:31.700338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a8c9e2e-9cda-4eae-b57b-1ce1b05879da tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:31.702711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a8c9e2e-9cda-4eae-b57b-1ce1b05879da tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:32.113231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-be8cca21-08b7-4e60-b483-f75a9f80d736 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:32.134535 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be8cca21-08b7-4e60-b483-f75a9f80d736 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1467 microversion: 2.1 time: 1.078316 May 19 04:45:32.147322 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1690/3470] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:31 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1467 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:33.154750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ea5385a8-2067-4821-be89-6a3c06719133 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:33.155676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ea5385a8-2067-4821-be89-6a3c06719133 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:33.188032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea5385a8-2067-4821-be89-6a3c06719133 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:33.190547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea5385a8-2067-4821-be89-6a3c06719133 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:33.193439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea5385a8-2067-4821-be89-6a3c06719133 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:33.196750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea5385a8-2067-4821-be89-6a3c06719133 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:33.243886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a8c9e2e-9cda-4eae-b57b-1ce1b05879da tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:33.260155 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a8c9e2e-9cda-4eae-b57b-1ce1b05879da tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 1.597021 May 19 04:45:33.273473 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1781/3471] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:31 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:33.292158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-881b8e32-a341-4f08-866d-02678e749d04 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ba8678a-04a7-4fda-a581-1be12ca41ece"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:33.294550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-881b8e32-a341-4f08-866d-02678e749d04 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:33.310342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:33.315338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-881b8e32-a341-4f08-866d-02678e749d04 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:33.316567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-881b8e32-a341-4f08-866d-02678e749d04 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:33.318092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-881b8e32-a341-4f08-866d-02678e749d04 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:33.320769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-881b8e32-a341-4f08-866d-02678e749d04 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:33.909914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-881b8e32-a341-4f08-866d-02678e749d04 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.634326 May 19 04:45:33.915213 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1782/3472] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:45:33 2022] POST /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments => generated 194 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:33.939343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6fe72bbb-5246-43e7-a5b6-0d36237ccd3f req-ab049e8a-b57b-47bf-8400-3843742ced8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f45fc0-830a-4e19-a6da-713dee4d1484", "name": "network-vif-deleted", "tag": "1c0105bd-12fc-4a28-bacb-da55db20d3ca"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:33.984666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6fe72bbb-5246-43e7-a5b6-0d36237ccd3f req-ab049e8a-b57b-47bf-8400-3843742ced8a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:33.987514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6fe72bbb-5246-43e7-a5b6-0d36237ccd3f req-ab049e8a-b57b-47bf-8400-3843742ced8a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:34.054072 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6fe72bbb-5246-43e7-a5b6-0d36237ccd3f req-ab049e8a-b57b-47bf-8400-3843742ced8a service nova] Creating event network-vif-deleted:1c0105bd-12fc-4a28-bacb-da55db20d3ca for instance 35f45fc0-830a-4e19-a6da-713dee4d1484 on n-h2-766726-30 May 19 04:45:34.079290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ea5385a8-2067-4821-be89-6a3c06719133 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:34.088763 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ea5385a8-2067-4821-be89-6a3c06719133 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 200 len: 1425 microversion: 2.1 time: 0.939893 May 19 04:45:34.098798 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6fe72bbb-5246-43e7-a5b6-0d36237ccd3f req-ab049e8a-b57b-47bf-8400-3843742ced8a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172211 May 19 04:45:34.105128 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1691/3473] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:33 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 1425 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:34.107934 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1783/3474] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:34.278139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13ddfa69-e9d0-4bf5-8313-ea6f296db330 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:34.279470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13ddfa69-e9d0-4bf5-8313-ea6f296db330 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:34.308925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13ddfa69-e9d0-4bf5-8313-ea6f296db330 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:34.319667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13ddfa69-e9d0-4bf5-8313-ea6f296db330 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:34.320670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13ddfa69-e9d0-4bf5-8313-ea6f296db330 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:34.321303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13ddfa69-e9d0-4bf5-8313-ea6f296db330 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.114164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:35.115707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 35f45fc0-830a-4e19-a6da-713dee4d1484] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:35.144187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.146122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.147551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.148131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.186119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-13ddfa69-e9d0-4bf5-8313-ea6f296db330 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:35.199828 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13ddfa69-e9d0-4bf5-8313-ea6f296db330 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.925818 May 19 04:45:35.200763 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1692/3475] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:34 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:35.230195 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] HTTP exception thrown: Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 could not be found. May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Request method failure captured: May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 HTTP/1.1 May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpWgmlef3j6tM1dxyiL8OdjwfmpR7ORcZsgmlNCNMvBl4u-vexQJORUkvcbyfFkNoMu44ErCY55hNIe0aIM6kDQj6ZXs2wo1uPiySJhjN0sRWsWc9-T7R9Qjk3Rhn_5VJ_--7khUPrG0DYADIL84dftVXB9nFJfVZt2yj3ocPYE03w May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 081114d9b091417fa7bce66a77583d8c May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-MigrationsAdminTest-954845502 May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_081114d9b091417fa7bce66a77583d8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-MigrationsAdminTest-954845502 May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 081114d9b091417fa7bce66a77583d8c May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-MigrationsAdminTest-954845502 May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-MigrationsAdminTest-954845502-project May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 55c593b7f2a04b0e820a505e8e8eb521 May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-MigrationsAdminTest-954845502-project May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 could not be found. May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '35f45fc0-830a-4e19-a6da-713dee4d1484'} May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 could not be found. May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 could not be found. May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.235024 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.239359 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.239359 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.239359 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.239359 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:35.239359 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:35.239359 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 could not be found. May 19 04:45:35.239359 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.254619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Returning 404 to user: Instance 35f45fc0-830a-4e19-a6da-713dee4d1484 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:35.256506 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96820349-3fd0-419d-8421-04abe14fb74e tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484" status: 404 len: 111 microversion: 2.1 time: 0.148247 May 19 04:45:35.261513 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1784/3476] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:35 2022] GET /compute/v2.1/servers/35f45fc0-830a-4e19-a6da-713dee4d1484 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:35.278004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-adb0b143-6bd6-4cee-a761-9f5ba0e3231a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:35.278991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-adb0b143-6bd6-4cee-a761-9f5ba0e3231a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:35.288972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adb0b143-6bd6-4cee-a761-9f5ba0e3231a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.289903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adb0b143-6bd6-4cee-a761-9f5ba0e3231a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.291067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adb0b143-6bd6-4cee-a761-9f5ba0e3231a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.293290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adb0b143-6bd6-4cee-a761-9f5ba0e3231a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.377666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-adb0b143-6bd6-4cee-a761-9f5ba0e3231a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:45:35.475604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:35.476731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:35.503574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.504689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.509632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.511748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.613703 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e HTTP/1.1 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'cb877d5d-0195-476d-b98e-214237ab958e'} May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:35.616700 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.621906 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.624634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:35.626442 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-725b443e-d026-410a-bcfb-fbca6f407ccf tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 404 len: 111 microversion: 2.1 time: 0.154132 May 19 04:45:35.630486 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1785/3477] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:35 2022] DELETE /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:35.639471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:35.640552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: cb877d5d-0195-476d-b98e-214237ab958e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:35.680941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.689443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.690467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.693027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.712727 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-adb0b143-6bd6-4cee-a761-9f5ba0e3231a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "DELETE /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 204 len: 0 microversion: 2.1 time: 0.438699 May 19 04:45:35.716838 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1693/3478] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:35 2022] DELETE /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:45:35.724360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a532c4c8-2150-4a6c-a2d5-5b7b7749d881 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:35.725214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a532c4c8-2150-4a6c-a2d5-5b7b7749d881 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:35.727026 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e HTTP/1.1 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'cb877d5d-0195-476d-b98e-214237ab958e'} May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.730421 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.735779 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.735779 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.735779 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.735779 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:35.735779 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:35.735779 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. May 19 04:45:35.735779 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.738606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance cb877d5d-0195-476d-b98e-214237ab958e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:35.739754 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-723fd8ec-5566-477c-bc78-5cf0e087e70e tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e" status: 404 len: 111 microversion: 2.1 time: 0.104792 May 19 04:45:35.743522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a532c4c8-2150-4a6c-a2d5-5b7b7749d881 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.744012 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1786/3479] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:35 2022] GET /compute/v2.1/servers/cb877d5d-0195-476d-b98e-214237ab958e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:35.749232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a532c4c8-2150-4a6c-a2d5-5b7b7749d881 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.750416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a532c4c8-2150-4a6c-a2d5-5b7b7749d881 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.751677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a532c4c8-2150-4a6c-a2d5-5b7b7749d881 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.762494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:35.764000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:35.777033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.778328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.779407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.780071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.802924 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e HTTP/1.1 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '3e655f22-e04e-407c-8d23-85c8a9356b7e'} May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:35.804910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.808672 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.822023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:35.830419 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bde69555-8910-4f55-ae17-a3976655a4b1 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 404 len: 111 microversion: 2.1 time: 0.082678 May 19 04:45:35.831727 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1787/3480] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:35 2022] DELETE /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:35.842311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:35.843474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] [instance: 3e655f22-e04e-407c-8d23-85c8a9356b7e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:35.865191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.865782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.866671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:35.867211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:35.891007 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] HTTP exception thrown: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Request method failure captured: May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e HTTP/1.1 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcofrXJ50PhUum4OEn35EgE6o65R0qtwfOO5WGStjc7Mk_doM0Hwqkf8QwcN6UxfgmAF9Mzjhia-1bRchJvQFpj1DTUE0CVFnBAiXURxB7LZldrrmA0s_BbaFR63JMNfy6Dt94kolyk0djeCN2vOj_4TJmXV41-WN4aCgKqu51urQMs May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90ef9ce51b2c4d59869b65ac106ed777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90ef9ce51b2c4d59869b65ac106ed777 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459310400 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1e14ea8dad314974bf5f4e8e51b88349 May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-1459310400-project May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '3e655f22-e04e-407c-8d23-85c8a9356b7e'} May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:35.933060 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.937143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:35.937143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:35.937143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:35.937143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:35.937143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:35.937143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. May 19 04:45:35.937143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:35.942251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] Returning 404 to user: Instance 3e655f22-e04e-407c-8d23-85c8a9356b7e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:35.943463 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1b3dd6b-d58a-432c-b11b-8635c1219c40 tempest-DeleteServersTestJSON-1459310400 tempest-DeleteServersTestJSON-1459310400-project] 10.222.0.58 "GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e" status: 404 len: 111 microversion: 2.1 time: 0.107258 May 19 04:45:35.954982 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1788/3481] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:35 2022] GET /compute/v2.1/servers/3e655f22-e04e-407c-8d23-85c8a9356b7e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:36.219325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99c03f9f-835c-42f8-9d1c-f5b4ccaa5c4c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:36.220261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-99c03f9f-835c-42f8-9d1c-f5b4ccaa5c4c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:36.240887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99c03f9f-835c-42f8-9d1c-f5b4ccaa5c4c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:36.241692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99c03f9f-835c-42f8-9d1c-f5b4ccaa5c4c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:36.242633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99c03f9f-835c-42f8-9d1c-f5b4ccaa5c4c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:36.244655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99c03f9f-835c-42f8-9d1c-f5b4ccaa5c4c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:36.374884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a532c4c8-2150-4a6c-a2d5-5b7b7749d881 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:36.390379 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a532c4c8-2150-4a6c-a2d5-5b7b7749d881 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1534 microversion: 2.1 time: 0.668723 May 19 04:45:36.405406 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1694/3482] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:35 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1534 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:36.536921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:36.538634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:36.564967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:36.566378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:36.567477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:36.569705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:36.617723 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] HTTP exception thrown: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Request method failure captured: May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 HTTP/1.1 May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmJk_uiQmB-__G6BRK74IeHh-549ySIOeKryaytLBvmPzWbgB_MBffPi5lAPEMOQZZRFGdMdFU7ljos3JxIcjsBZE76Syma913l_zb6KaRbaX73K17_CB1llzNPYhUnZ3FW9UCnYhOgvs0pDVVpkUW8FVJJPu84GzaNPAWPj-z1eyo May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.42 May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ce47f533f04d498c872d7eebd936dd7a May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-804157538 May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TaggedBootDevicesTest_v242-804157538 May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ce47f533f04d498c872d7eebd936dd7a May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-804157538 May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TaggedBootDevicesTest_v242-804157538-project May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c8bd8feb841f4876a7f1519525cf3fb4 May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TaggedBootDevicesTest_v242-804157538-project May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'f893d60d-f792-409a-99a4-ddfa34b26ab3'} May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:36.620487 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Returning 404 to user: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6bbd11c5-249d-4265-8ab4-1dd77b0c260f tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 404 len: 111 microversion: 2.42 time: 0.092397 May 19 04:45:36.627842 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1695/3483] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:45:36 2022] DELETE /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:45:36.632298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:36.632920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] [instance: f893d60d-f792-409a-99a4-ddfa34b26ab3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:36.641319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:36.642377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:36.643164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:36.643603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:36.673448 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] HTTP exception thrown: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Request method failure captured: May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 HTTP/1.1 May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcmJk_uiQmB-__G6BRK74IeHh-549ySIOeKryaytLBvmPzWbgB_MBffPi5lAPEMOQZZRFGdMdFU7ljos3JxIcjsBZE76Syma913l_zb6KaRbaX73K17_CB1llzNPYhUnZ3FW9UCnYhOgvs0pDVVpkUW8FVJJPu84GzaNPAWPj-z1eyo May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.42 May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ce47f533f04d498c872d7eebd936dd7a May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-804157538 May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce47f533f04d498c872d7eebd936dd7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TaggedBootDevicesTest_v242-804157538 May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ce47f533f04d498c872d7eebd936dd7a May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-804157538 May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TaggedBootDevicesTest_v242-804157538-project May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c8bd8feb841f4876a7f1519525cf3fb4 May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TaggedBootDevicesTest_v242-804157538-project May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'f893d60d-f792-409a-99a4-ddfa34b26ab3'} May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.674982 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] Returning 404 to user: Instance f893d60d-f792-409a-99a4-ddfa34b26ab3 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-054b44a7-c462-4c8a-99b9-90ea58555cf4 tempest-TaggedBootDevicesTest_v242-804157538 tempest-TaggedBootDevicesTest_v242-804157538-project] 10.222.0.58 "GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3" status: 404 len: 111 microversion: 2.42 time: 0.048296 May 19 04:45:36.679058 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1696/3484] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:45:36 2022] GET /compute/v2.1/servers/f893d60d-f792-409a-99a4-ddfa34b26ab3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:45:36.698722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99c03f9f-835c-42f8-9d1c-f5b4ccaa5c4c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:36.712860 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99c03f9f-835c-42f8-9d1c-f5b4ccaa5c4c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.497176 May 19 04:45:36.714669 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1789/3485] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:36 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:37.409859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ebc0a7a-6369-484b-a4da-16d92c37e2e3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:37.410418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4ebc0a7a-6369-484b-a4da-16d92c37e2e3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:37.422177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ebc0a7a-6369-484b-a4da-16d92c37e2e3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:37.423235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ebc0a7a-6369-484b-a4da-16d92c37e2e3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:37.430195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ebc0a7a-6369-484b-a4da-16d92c37e2e3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:37.430638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ebc0a7a-6369-484b-a4da-16d92c37e2e3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:37.435453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:37.730690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-362595bf-ecc2-4495-985e-886eaf455c25 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:37.731979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-362595bf-ecc2-4495-985e-886eaf455c25 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:37.751751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-362595bf-ecc2-4495-985e-886eaf455c25 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:37.752470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-362595bf-ecc2-4495-985e-886eaf455c25 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:37.753472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-362595bf-ecc2-4495-985e-886eaf455c25 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:37.756360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-362595bf-ecc2-4495-985e-886eaf455c25 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:37.807048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:38.945445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4ebc0a7a-6369-484b-a4da-16d92c37e2e3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:38.953110 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4ebc0a7a-6369-484b-a4da-16d92c37e2e3 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1534 microversion: 2.1 time: 1.547689 May 19 04:45:38.959068 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1697/3486] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:37 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1534 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:38.963819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a7550fa2-58a4-4b31-bfe1-5fc3a495155b req-134be29f-a425-416d-a6d8-22fbdaed5ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "name": "network-vif-plugged", "status": "completed", "tag": "450ad028-f0c9-4f3f-944c-407e12871c4a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:38.998659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a7550fa2-58a4-4b31-bfe1-5fc3a495155b req-134be29f-a425-416d-a6d8-22fbdaed5ad0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:38.999626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a7550fa2-58a4-4b31-bfe1-5fc3a495155b req-134be29f-a425-416d-a6d8-22fbdaed5ad0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:39.038073 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a7550fa2-58a4-4b31-bfe1-5fc3a495155b req-134be29f-a425-416d-a6d8-22fbdaed5ad0 service nova] Creating event network-vif-plugged:450ad028-f0c9-4f3f-944c-407e12871c4a for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:39.070643 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a7550fa2-58a4-4b31-bfe1-5fc3a495155b req-134be29f-a425-416d-a6d8-22fbdaed5ad0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110286 May 19 04:45:39.083605 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1698/3487] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:39.363354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-26904466-7364-4202-80bb-bd771ee7eca5 req-b061d703-2c73-47de-a1b9-cc840a8d41ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd7e64-3246-40ea-844d-5e88603a9e20", "name": "network-vif-deleted", "tag": "60433ce3-7f6a-48fa-9b49-9f65b436fd14"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:39.386525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-26904466-7364-4202-80bb-bd771ee7eca5 req-b061d703-2c73-47de-a1b9-cc840a8d41ea service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:39.387261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-26904466-7364-4202-80bb-bd771ee7eca5 req-b061d703-2c73-47de-a1b9-cc840a8d41ea service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:39.406524 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-26904466-7364-4202-80bb-bd771ee7eca5 req-b061d703-2c73-47de-a1b9-cc840a8d41ea service nova] Creating event network-vif-deleted:60433ce3-7f6a-48fa-9b49-9f65b436fd14 for instance 98bd7e64-3246-40ea-844d-5e88603a9e20 on n-h2-766726-30 May 19 04:45:39.425618 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-26904466-7364-4202-80bb-bd771ee7eca5 req-b061d703-2c73-47de-a1b9-cc840a8d41ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067168 May 19 04:45:39.429594 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1699/3488] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:45:39.467426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-362595bf-ecc2-4495-985e-886eaf455c25 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:39.477842 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-362595bf-ecc2-4495-985e-886eaf455c25 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 1.751470 May 19 04:45:39.481675 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1790/3489] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:37 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:39.972759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:39.973677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:39.990367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:39.990924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:39.991955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:39.992558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:40.064255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:40.064717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:40.065203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lazy-loading 'fault' on Instance uuid 98bd7e64-3246-40ea-844d-5e88603a9e20 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:45:40.190831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:40.197889 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-02322b02-c71d-430b-8e91-16c4cb83bf34 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 200 len: 1368 microversion: 2.1 time: 0.230843 May 19 04:45:40.198478 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1700/3490] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:39 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:40.498469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-765a69d3-a8d1-4ed8-9f28-ae27f3c54f31 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:40.499176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-765a69d3-a8d1-4ed8-9f28-ae27f3c54f31 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:40.509044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-765a69d3-a8d1-4ed8-9f28-ae27f3c54f31 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:40.509518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-765a69d3-a8d1-4ed8-9f28-ae27f3c54f31 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:40.510298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-765a69d3-a8d1-4ed8-9f28-ae27f3c54f31 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:40.510752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-765a69d3-a8d1-4ed8-9f28-ae27f3c54f31 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:40.832256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-765a69d3-a8d1-4ed8-9f28-ae27f3c54f31 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:40.846908 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-765a69d3-a8d1-4ed8-9f28-ae27f3c54f31 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 0.351903 May 19 04:45:40.849317 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1791/3491] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:40 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:41.215608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:41.216348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 98bd7e64-3246-40ea-844d-5e88603a9e20] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:41.227088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:41.235930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:41.236789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:41.237265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:41.267579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8945e3d3-3a99-4308-8c8b-5a94494b6e80 req-99a13ad0-5231-4cd6-b6ee-f7c5f61e3a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "name": "network-vif-plugged", "status": "completed", "tag": "fe5abfb6-6a72-4662-bb44-c0ace3be9e2b"}, {"server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "name": "network-vif-plugged", "status": "completed", "tag": "7274752f-dda5-4883-8b3e-4dc473d91bf3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:41.281207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8945e3d3-3a99-4308-8c8b-5a94494b6e80 req-99a13ad0-5231-4cd6-b6ee-f7c5f61e3a0b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:41.284158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8945e3d3-3a99-4308-8c8b-5a94494b6e80 req-99a13ad0-5231-4cd6-b6ee-f7c5f61e3a0b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:41.296731 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] HTTP exception thrown: Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 could not be found. May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Request method failure captured: May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 HTTP/1.1 May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpWgmlef3j6tM1dxyiL8OdjwfmpR7ORcZsgmlNCNMvBl4u-vexQJORUkvcbyfFkNoMu44ErCY55hNIe0aIM6kDQj6ZXs2wo1uPiySJhjN0sRWsWc9-T7R9Qjk3Rhn_5VJ_--7khUPrG0DYADIL84dftVXB9nFJfVZt2yj3ocPYE03w May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 081114d9b091417fa7bce66a77583d8c May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-MigrationsAdminTest-954845502 May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_081114d9b091417fa7bce66a77583d8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-MigrationsAdminTest-954845502 May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 081114d9b091417fa7bce66a77583d8c May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-MigrationsAdminTest-954845502 May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-MigrationsAdminTest-954845502-project May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 55c593b7f2a04b0e820a505e8e8eb521 May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-MigrationsAdminTest-954845502-project May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 could not be found. May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '98bd7e64-3246-40ea-844d-5e88603a9e20'} May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 could not be found. May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 could not be found. May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:41.302007 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:41.308822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:41.308822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:41.308822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:41.308822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:41.308822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:41.308822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 could not be found. May 19 04:45:41.308822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:41.308822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Returning 404 to user: Instance 98bd7e64-3246-40ea-844d-5e88603a9e20 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:41.308822 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b850d0c9-cd20-43ac-874d-ae3b3742165d tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20" status: 404 len: 111 microversion: 2.1 time: 0.092945 May 19 04:45:41.311268 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1701/3492] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:41 2022] GET /compute/v2.1/servers/98bd7e64-3246-40ea-844d-5e88603a9e20 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:41.311439 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8945e3d3-3a99-4308-8c8b-5a94494b6e80 req-99a13ad0-5231-4cd6-b6ee-f7c5f61e3a0b service nova] Creating event network-vif-plugged:fe5abfb6-6a72-4662-bb44-c0ace3be9e2b for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:41.311898 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8945e3d3-3a99-4308-8c8b-5a94494b6e80 req-99a13ad0-5231-4cd6-b6ee-f7c5f61e3a0b service nova] Creating event network-vif-plugged:7274752f-dda5-4883-8b3e-4dc473d91bf3 for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:41.318189 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8945e3d3-3a99-4308-8c8b-5a94494b6e80 req-99a13ad0-5231-4cd6-b6ee-f7c5f61e3a0b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054897 May 19 04:45:41.320442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-95ce6885-a9d5-4bc4-8155-ae082fea9537 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:41.320948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-95ce6885-a9d5-4bc4-8155-ae082fea9537 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:41.322823 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1792/3493] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:45:41.336780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95ce6885-a9d5-4bc4-8155-ae082fea9537 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:41.337648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95ce6885-a9d5-4bc4-8155-ae082fea9537 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:41.338680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95ce6885-a9d5-4bc4-8155-ae082fea9537 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:41.339357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95ce6885-a9d5-4bc4-8155-ae082fea9537 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:41.418430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-95ce6885-a9d5-4bc4-8155-ae082fea9537 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:45:41.603503 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-95ce6885-a9d5-4bc4-8155-ae082fea9537 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "DELETE /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 204 len: 0 microversion: 2.1 time: 0.292617 May 19 04:45:41.608272 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1702/3494] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:41 2022] DELETE /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:45:41.616673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d64d0419-5fd9-4802-899f-48eafa9fa3ac tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:41.617442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d64d0419-5fd9-4802-899f-48eafa9fa3ac tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:41.640810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d64d0419-5fd9-4802-899f-48eafa9fa3ac tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:41.642132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d64d0419-5fd9-4802-899f-48eafa9fa3ac tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:41.646534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d64d0419-5fd9-4802-899f-48eafa9fa3ac tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:41.647257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d64d0419-5fd9-4802-899f-48eafa9fa3ac tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:41.868017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab4aed5b-6154-4d26-8ae7-78675baf10f1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:41.868772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ab4aed5b-6154-4d26-8ae7-78675baf10f1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:41.884680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab4aed5b-6154-4d26-8ae7-78675baf10f1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:41.885388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab4aed5b-6154-4d26-8ae7-78675baf10f1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:41.888224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab4aed5b-6154-4d26-8ae7-78675baf10f1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:41.892739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab4aed5b-6154-4d26-8ae7-78675baf10f1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:43.060685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d64d0419-5fd9-4802-899f-48eafa9fa3ac tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:43.074196 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d64d0419-5fd9-4802-899f-48eafa9fa3ac tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1467 microversion: 2.1 time: 1.460417 May 19 04:45:43.077349 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1793/3495] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:41 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1467 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:43.330436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab4aed5b-6154-4d26-8ae7-78675baf10f1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:43.343718 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab4aed5b-6154-4d26-8ae7-78675baf10f1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1354 microversion: 2.1 time: 1.483494 May 19 04:45:43.349687 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1703/3496] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:41 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1354 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:44.099790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ee78ecca-a672-40db-967f-2b64a8c92295 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:44.100492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ee78ecca-a672-40db-967f-2b64a8c92295 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:44.110866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee78ecca-a672-40db-967f-2b64a8c92295 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:44.115079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee78ecca-a672-40db-967f-2b64a8c92295 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:44.116116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee78ecca-a672-40db-967f-2b64a8c92295 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:44.116573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee78ecca-a672-40db-967f-2b64a8c92295 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:44.348603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ee78ecca-a672-40db-967f-2b64a8c92295 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:44.356889 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ee78ecca-a672-40db-967f-2b64a8c92295 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 200 len: 1425 microversion: 2.1 time: 0.260944 May 19 04:45:44.366319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d4523ca7-4735-4735-89f4-83a39c862af3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:44.367541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d4523ca7-4735-4735-89f4-83a39c862af3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:44.374057 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1794/3497] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:44 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 1425 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:44.378606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4523ca7-4735-4735-89f4-83a39c862af3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:44.384260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4523ca7-4735-4735-89f4-83a39c862af3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:44.385369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4523ca7-4735-4735-89f4-83a39c862af3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:44.386118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4523ca7-4735-4735-89f4-83a39c862af3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:44.587217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ecbfdc3a-163a-47ba-9f5f-2f166e1c44c8 req-b10f0947-3cff-4643-b21d-70a48aeeba17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386556b3-9bff-473a-94c3-61225505b4ff", "name": "network-vif-deleted", "tag": "b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:44.612290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ecbfdc3a-163a-47ba-9f5f-2f166e1c44c8 req-b10f0947-3cff-4643-b21d-70a48aeeba17 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:44.617118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ecbfdc3a-163a-47ba-9f5f-2f166e1c44c8 req-b10f0947-3cff-4643-b21d-70a48aeeba17 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:44.647999 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ecbfdc3a-163a-47ba-9f5f-2f166e1c44c8 req-b10f0947-3cff-4643-b21d-70a48aeeba17 service nova] Creating event network-vif-deleted:b5d9b1b3-db0f-4bdb-ad36-ff4cccd425e5 for instance 386556b3-9bff-473a-94c3-61225505b4ff on n-h2-766726-30 May 19 04:45:44.663318 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ecbfdc3a-163a-47ba-9f5f-2f166e1c44c8 req-b10f0947-3cff-4643-b21d-70a48aeeba17 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081612 May 19 04:45:44.665623 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1795/3498] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:45:45.276202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d4523ca7-4735-4735-89f4-83a39c862af3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:45.296918 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d4523ca7-4735-4735-89f4-83a39c862af3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1803 microversion: 2.1 time: 0.934500 May 19 04:45:45.298774 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1704/3499] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:44 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1803 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:45:45.335816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86064c72-3892-418d-9dd9-1970bd3e52cc tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:45.339528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86064c72-3892-418d-9dd9-1970bd3e52cc tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:45.355801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86064c72-3892-418d-9dd9-1970bd3e52cc tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.356806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86064c72-3892-418d-9dd9-1970bd3e52cc tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.358071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86064c72-3892-418d-9dd9-1970bd3e52cc tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.358700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86064c72-3892-418d-9dd9-1970bd3e52cc tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.391994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:45.393444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 386556b3-9bff-473a-94c3-61225505b4ff] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:45.408303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:45.418202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.419285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.421180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.421466 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86064c72-3892-418d-9dd9-1970bd3e52cc tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016/ips" status: 200 len: 217 microversion: 2.1 time: 0.105112 May 19 04:45:45.424001 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1796/3500] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:45:45 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016/ips => generated 217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:45.424940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.435486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-24b5193c-7b58-4d9b-9c91-7ca3472bae6c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:45.445747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-24b5193c-7b58-4d9b-9c91-7ca3472bae6c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:45.456947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24b5193c-7b58-4d9b-9c91-7ca3472bae6c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.457671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24b5193c-7b58-4d9b-9c91-7ca3472bae6c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.458606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24b5193c-7b58-4d9b-9c91-7ca3472bae6c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.459198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-24b5193c-7b58-4d9b-9c91-7ca3472bae6c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.463792 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] HTTP exception thrown: Instance 386556b3-9bff-473a-94c3-61225505b4ff could not be found. May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Request method failure captured: May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff HTTP/1.1 May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpWgmlef3j6tM1dxyiL8OdjwfmpR7ORcZsgmlNCNMvBl4u-vexQJORUkvcbyfFkNoMu44ErCY55hNIe0aIM6kDQj6ZXs2wo1uPiySJhjN0sRWsWc9-T7R9Qjk3Rhn_5VJ_--7khUPrG0DYADIL84dftVXB9nFJfVZt2yj3ocPYE03w May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 081114d9b091417fa7bce66a77583d8c May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-MigrationsAdminTest-954845502 May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_081114d9b091417fa7bce66a77583d8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-MigrationsAdminTest-954845502 May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 081114d9b091417fa7bce66a77583d8c May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-MigrationsAdminTest-954845502 May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-MigrationsAdminTest-954845502-project May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 55c593b7f2a04b0e820a505e8e8eb521 May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-MigrationsAdminTest-954845502-project May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 386556b3-9bff-473a-94c3-61225505b4ff could not be found. May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '386556b3-9bff-473a-94c3-61225505b4ff'} May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 386556b3-9bff-473a-94c3-61225505b4ff could not be found. May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 386556b3-9bff-473a-94c3-61225505b4ff could not be found. May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:45.467734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:45.475584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:45.475584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:45.475584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:45.475584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:45.475584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:45.475584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 386556b3-9bff-473a-94c3-61225505b4ff could not be found. May 19 04:45:45.475584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:45:45.480723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Returning 404 to user: Instance 386556b3-9bff-473a-94c3-61225505b4ff could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:45.486222 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2378ae7e-8e7f-46b1-87ed-c18c2dc80d06 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff" status: 404 len: 111 microversion: 2.1 time: 0.099695 May 19 04:45:45.490453 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1705/3501] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:45 2022] GET /compute/v2.1/servers/386556b3-9bff-473a-94c3-61225505b4ff => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:45:45.501938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bc69c8ad-f2fb-4bb4-8ae5-93e781c149b2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:45.503028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bc69c8ad-f2fb-4bb4-8ae5-93e781c149b2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:45.522790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc69c8ad-f2fb-4bb4-8ae5-93e781c149b2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.526812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc69c8ad-f2fb-4bb4-8ae5-93e781c149b2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.528485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc69c8ad-f2fb-4bb4-8ae5-93e781c149b2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.534682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-24b5193c-7b58-4d9b-9c91-7ca3472bae6c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:45:45.535203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc69c8ad-f2fb-4bb4-8ae5-93e781c149b2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.574199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bc69c8ad-f2fb-4bb4-8ae5-93e781c149b2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:45:45.703190 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bc69c8ad-f2fb-4bb4-8ae5-93e781c149b2 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 204 len: 0 microversion: 2.1 time: 0.208465 May 19 04:45:45.705319 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1706/3502] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:45 2022] DELETE /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:45:45.716059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-071b4ddb-740e-4e38-97bf-0f15b1202c56 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:45.717493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-071b4ddb-740e-4e38-97bf-0f15b1202c56 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:45.725262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-071b4ddb-740e-4e38-97bf-0f15b1202c56 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.726167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-071b4ddb-740e-4e38-97bf-0f15b1202c56 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.727386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-071b4ddb-740e-4e38-97bf-0f15b1202c56 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.728042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-071b4ddb-740e-4e38-97bf-0f15b1202c56 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.810420 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-24b5193c-7b58-4d9b-9c91-7ca3472bae6c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 204 len: 0 microversion: 2.1 time: 0.378065 May 19 04:45:45.811400 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1797/3503] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:45:45 2022] DELETE /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:45:45.846300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba9c3953-27c2-4117-9892-a358a4e44421 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:45.849702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba9c3953-27c2-4117-9892-a358a4e44421 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:45.882103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba9c3953-27c2-4117-9892-a358a4e44421 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.890382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba9c3953-27c2-4117-9892-a358a4e44421 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:45.892022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba9c3953-27c2-4117-9892-a358a4e44421 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:45.892653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba9c3953-27c2-4117-9892-a358a4e44421 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:47.603979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-071b4ddb-740e-4e38-97bf-0f15b1202c56 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:47.630005 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-071b4ddb-740e-4e38-97bf-0f15b1202c56 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1469 microversion: 2.1 time: 1.920007 May 19 04:45:47.631223 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1707/3504] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:45 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1469 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:48.082654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba9c3953-27c2-4117-9892-a358a4e44421 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:48.107147 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba9c3953-27c2-4117-9892-a358a4e44421 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1809 microversion: 2.1 time: 2.287328 May 19 04:45:48.108089 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1798/3505] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:45 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1809 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:48.654438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2613655-2ed2-44ce-944e-2a35f44cee25 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:48.655755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b2613655-2ed2-44ce-944e-2a35f44cee25 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:48.676353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2613655-2ed2-44ce-944e-2a35f44cee25 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:48.678765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2613655-2ed2-44ce-944e-2a35f44cee25 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:48.682267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2613655-2ed2-44ce-944e-2a35f44cee25 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:48.684623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2613655-2ed2-44ce-944e-2a35f44cee25 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:49.129933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5da317d3-6fb3-4d74-b6e4-9d873a3f8ca5 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:49.130844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5da317d3-6fb3-4d74-b6e4-9d873a3f8ca5 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:49.147669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5da317d3-6fb3-4d74-b6e4-9d873a3f8ca5 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:49.149872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5da317d3-6fb3-4d74-b6e4-9d873a3f8ca5 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:49.151659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5da317d3-6fb3-4d74-b6e4-9d873a3f8ca5 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:49.155529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5da317d3-6fb3-4d74-b6e4-9d873a3f8ca5 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:50.390406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b2613655-2ed2-44ce-944e-2a35f44cee25 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:50.399869 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b2613655-2ed2-44ce-944e-2a35f44cee25 tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1469 microversion: 2.1 time: 1.754758 May 19 04:45:50.406497 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1708/3506] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:48 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1469 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:51.105560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f0e43dbe-1819-41f5-aee2-29de3b2fb7a7 req-3183a48d-7711-4baf-8ebd-df7ed0529f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "name": "network-vif-deleted", "tag": "450ad028-f0c9-4f3f-944c-407e12871c4a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:51.128847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f0e43dbe-1819-41f5-aee2-29de3b2fb7a7 req-3183a48d-7711-4baf-8ebd-df7ed0529f8e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:51.129723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f0e43dbe-1819-41f5-aee2-29de3b2fb7a7 req-3183a48d-7711-4baf-8ebd-df7ed0529f8e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:51.182451 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f0e43dbe-1819-41f5-aee2-29de3b2fb7a7 req-3183a48d-7711-4baf-8ebd-df7ed0529f8e service nova] Creating event network-vif-deleted:450ad028-f0c9-4f3f-944c-407e12871c4a for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:51.222112 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f0e43dbe-1819-41f5-aee2-29de3b2fb7a7 req-3183a48d-7711-4baf-8ebd-df7ed0529f8e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100914 May 19 04:45:51.225313 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1709/3507] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:45:51.425750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7b61a855-0603-47bd-9662-fecb7b18cbaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:51.427086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7b61a855-0603-47bd-9662-fecb7b18cbaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:51.438540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b61a855-0603-47bd-9662-fecb7b18cbaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:51.439282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b61a855-0603-47bd-9662-fecb7b18cbaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:51.440384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b61a855-0603-47bd-9662-fecb7b18cbaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:51.441162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b61a855-0603-47bd-9662-fecb7b18cbaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:51.886837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7b61a855-0603-47bd-9662-fecb7b18cbaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:51.900094 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7b61a855-0603-47bd-9662-fecb7b18cbaa tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1427 microversion: 2.1 time: 0.479978 May 19 04:45:51.901696 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1710/3508] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:51 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1427 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:52.333929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cae6be4-be89-4b5d-a5bf-be61960edbaf tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'create', calling method: .version_select at 0x7fd315b3f9d0>, body: {"keypair": {"name": "tempest-keypair-278839671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlgAsEDTAAXqXDbPJCcgeg4XlXn2ff2VAl6fRz0y30yu89Vhxcfx2TfAIlewB0PafihlMHda4+WMGuBOZFNtxSbk1vzcJXnYtPvAMgCVwepp8IxGyuokcaF6M/XcmgWwQ=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:52.416624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-0cae6be4-be89-4b5d-a5bf-be61960edbaf tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for project 346e3945e25c4638bef347149d914e61. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:45:52.448765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-0cae6be4-be89-4b5d-a5bf-be61960edbaf tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for user 87d19ae04b1d4f0e9e23872d9c2cd0a4 and project 346e3945e25c4638bef347149d914e61. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:45:52.525569 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0cae6be4-be89-4b5d-a5bf-be61960edbaf tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.560306 May 19 04:45:52.527102 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1711/3509] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:45:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:45:52.535892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2a87aa44-7971-42ff-bf1f-02064e636895 req-66ed50ad-afcc-4d6a-9612-048525d0e46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "name": "network-vif-unplugged", "status": "completed", "tag": "fe5abfb6-6a72-4662-bb44-c0ace3be9e2b"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:52.557535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2a87aa44-7971-42ff-bf1f-02064e636895 req-66ed50ad-afcc-4d6a-9612-048525d0e46f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:52.558735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2a87aa44-7971-42ff-bf1f-02064e636895 req-66ed50ad-afcc-4d6a-9612-048525d0e46f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:52.601377 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2a87aa44-7971-42ff-bf1f-02064e636895 req-66ed50ad-afcc-4d6a-9612-048525d0e46f service nova] Creating event network-vif-unplugged:fe5abfb6-6a72-4662-bb44-c0ace3be9e2b for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:52.616184 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2a87aa44-7971-42ff-bf1f-02064e636895 req-66ed50ad-afcc-4d6a-9612-048525d0e46f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086911 May 19 04:45:52.617962 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1712/3510] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:52.918567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d48fcf42-bd85-418d-b098-8a499655345c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:52.919680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d48fcf42-bd85-418d-b098-8a499655345c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:52.953299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d48fcf42-bd85-418d-b098-8a499655345c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:52.956645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d48fcf42-bd85-418d-b098-8a499655345c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:52.957817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d48fcf42-bd85-418d-b098-8a499655345c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:52.958248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d48fcf42-bd85-418d-b098-8a499655345c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:52.958510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5da317d3-6fb3-4d74-b6e4-9d873a3f8ca5 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:52.978802 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5da317d3-6fb3-4d74-b6e4-9d873a3f8ca5 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1788 microversion: 2.1 time: 3.849683 May 19 04:45:52.988388 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1799/3511] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:49 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1788 bytes in 3855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:53.392265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d48fcf42-bd85-418d-b098-8a499655345c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c593b7f2a04b0e820a505e8e8eb521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081114d9b091417fa7bce66a77583d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:53.408323 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d48fcf42-bd85-418d-b098-8a499655345c tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 200 len: 1298 microversion: 2.1 time: 0.494424 May 19 04:45:53.411283 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1713/3512] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:52 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 1298 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:53.650009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-870799ec-cffa-4e11-b1f1-12800e21a311 req-450ca1f9-706a-4c34-a52b-11261f8544c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a73785c-f5e6-40ba-a07f-4a385e57a0dd", "name": "network-vif-deleted", "tag": "ff46de4a-5688-469b-9504-e82ae8240d7d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:53.682517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-870799ec-cffa-4e11-b1f1-12800e21a311 req-450ca1f9-706a-4c34-a52b-11261f8544c7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:53.683027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-870799ec-cffa-4e11-b1f1-12800e21a311 req-450ca1f9-706a-4c34-a52b-11261f8544c7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:53.724528 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-870799ec-cffa-4e11-b1f1-12800e21a311 req-450ca1f9-706a-4c34-a52b-11261f8544c7 service nova] Creating event network-vif-deleted:ff46de4a-5688-469b-9504-e82ae8240d7d for instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd on n-h2-766726-30 May 19 04:45:53.739481 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-870799ec-cffa-4e11-b1f1-12800e21a311 req-450ca1f9-706a-4c34-a52b-11261f8544c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093090 May 19 04:45:53.744371 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1800/3513] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:53.996452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b420121-90b4-467d-8ee7-851fdce46d13 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:53.998150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b420121-90b4-467d-8ee7-851fdce46d13 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:54.013505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b420121-90b4-467d-8ee7-851fdce46d13 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:54.013975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b420121-90b4-467d-8ee7-851fdce46d13 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:54.014762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b420121-90b4-467d-8ee7-851fdce46d13 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:54.015206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b420121-90b4-467d-8ee7-851fdce46d13 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:54.426789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:54.427659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] [instance: 4a73785c-f5e6-40ba-a07f-4a385e57a0dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:54.449605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:54.450061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:54.451201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:54.452973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:54.505447 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] HTTP exception thrown: Instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd could not be found. May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Request method failure captured: May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd HTTP/1.1 May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpWgmlef3j6tM1dxyiL8OdjwfmpR7ORcZsgmlNCNMvBl4u-vexQJORUkvcbyfFkNoMu44ErCY55hNIe0aIM6kDQj6ZXs2wo1uPiySJhjN0sRWsWc9-T7R9Qjk3Rhn_5VJ_--7khUPrG0DYADIL84dftVXB9nFJfVZt2yj3ocPYE03w May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 081114d9b091417fa7bce66a77583d8c May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-MigrationsAdminTest-954845502 May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/081114d9b091417fa7bce66a77583d8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_081114d9b091417fa7bce66a77583d8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-MigrationsAdminTest-954845502 May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 081114d9b091417fa7bce66a77583d8c May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-MigrationsAdminTest-954845502 May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-MigrationsAdminTest-954845502-project May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 55c593b7f2a04b0e820a505e8e8eb521 May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-MigrationsAdminTest-954845502-project May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd could not be found. May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '4a73785c-f5e6-40ba-a07f-4a385e57a0dd'} May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd could not be found. May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd could not be found. May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:45:54.511788 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:54.516267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:45:54.516267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:45:54.516267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:45:54.516267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:45:54.516267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:45:54.516267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd could not be found. May 19 04:45:54.516267 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:45:54.528549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] Returning 404 to user: Instance 4a73785c-f5e6-40ba-a07f-4a385e57a0dd could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:45:54.530000 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b61196e9-3575-4bc1-973d-b5b993f3cf4a tempest-MigrationsAdminTest-954845502 tempest-MigrationsAdminTest-954845502-project] 10.222.0.58 "GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd" status: 404 len: 111 microversion: 2.1 time: 0.108800 May 19 04:45:54.539850 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1801/3514] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:54 2022] GET /compute/v2.1/servers/4a73785c-f5e6-40ba-a07f-4a385e57a0dd => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:45:54.669720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-d254f3f6-e430-42eb-bcd0-7c6a3947d6a9 req-e0b109e4-f32e-4ba1-98d6-17bef51c8cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "name": "network-vif-unplugged", "status": "completed", "tag": "7274752f-dda5-4883-8b3e-4dc473d91bf3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:54.703754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d254f3f6-e430-42eb-bcd0-7c6a3947d6a9 req-e0b109e4-f32e-4ba1-98d6-17bef51c8cf9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:54.704664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d254f3f6-e430-42eb-bcd0-7c6a3947d6a9 req-e0b109e4-f32e-4ba1-98d6-17bef51c8cf9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:54.735756 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-d254f3f6-e430-42eb-bcd0-7c6a3947d6a9 req-e0b109e4-f32e-4ba1-98d6-17bef51c8cf9 service nova] Creating event network-vif-unplugged:7274752f-dda5-4883-8b3e-4dc473d91bf3 for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:54.748309 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-d254f3f6-e430-42eb-bcd0-7c6a3947d6a9 req-e0b109e4-f32e-4ba1-98d6-17bef51c8cf9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080788 May 19 04:45:54.750443 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1802/3515] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:45:55.065255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b420121-90b4-467d-8ee7-851fdce46d13 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:55.078062 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b420121-90b4-467d-8ee7-851fdce46d13 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1674 microversion: 2.1 time: 1.081246 May 19 04:45:55.079853 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1714/3516] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:53 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1674 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:56.096587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9737f0fd-ed1e-4f5e-a820-b38d205aa153 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:56.097322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9737f0fd-ed1e-4f5e-a820-b38d205aa153 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:56.106116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9737f0fd-ed1e-4f5e-a820-b38d205aa153 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:56.106748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9737f0fd-ed1e-4f5e-a820-b38d205aa153 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:56.107639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9737f0fd-ed1e-4f5e-a820-b38d205aa153 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:56.108172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9737f0fd-ed1e-4f5e-a820-b38d205aa153 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:56.242105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1324337935", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81db7320-40b5-42ac-aa1c-5de5a86ce20d"}], "security_groups": [{"name": "tempest-securitygroup--840207902"}], "key_name": "tempest-keypair-278839671", "user_data": "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:56.530485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] validate_networks() for [('81db7320-40b5-42ac-aa1c-5de5a86ce20d', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:45:56.954709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9737f0fd-ed1e-4f5e-a820-b38d205aa153 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:56.970612 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9737f0fd-ed1e-4f5e-a820-b38d205aa153 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1653 microversion: 2.1 time: 0.871244 May 19 04:45:56.971667 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1803/3517] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:56 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1653 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:56.980892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f8d2d834-ed8c-4c7c-991b-329c72a2d570 req-dff18c4d-1ea2-4774-ad9d-ae9f523b2a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "name": "network-vif-deleted", "tag": "fe5abfb6-6a72-4662-bb44-c0ace3be9e2b"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:45:56.997923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f8d2d834-ed8c-4c7c-991b-329c72a2d570 req-dff18c4d-1ea2-4774-ad9d-ae9f523b2a53 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:57.009899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f8d2d834-ed8c-4c7c-991b-329c72a2d570 req-dff18c4d-1ea2-4774-ad9d-ae9f523b2a53 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:57.031829 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f8d2d834-ed8c-4c7c-991b-329c72a2d570 req-dff18c4d-1ea2-4774-ad9d-ae9f523b2a53 service nova] Creating event network-vif-deleted:fe5abfb6-6a72-4662-bb44-c0ace3be9e2b for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:45:57.038846 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f8d2d834-ed8c-4c7c-991b-329c72a2d570 req-dff18c4d-1ea2-4774-ad9d-ae9f523b2a53 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065565 May 19 04:45:57.044238 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1804/3518] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:45:57.527168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:45:57.528375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:45:57.529195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:45:57.529878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:45:57.531027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:45:57.557858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:57.560767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:57.561940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:57.564905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:57.604289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:45:57.658583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:45:57.692445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for user 87d19ae04b1d4f0e9e23872d9c2cd0a4 and project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:45:57.744707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:45:57.754471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:45:57.974137 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-70ec524d-6cbf-4488-b451-c550192991a4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.736545 May 19 04:45:57.975005 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1715/3519] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:45:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 04:45:57.986356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9f9ba724-d725-4fbe-beb8-1f63b9fb74e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:57.987184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9f9ba724-d725-4fbe-beb8-1f63b9fb74e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:58.008561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1fcc803c-72c9-4d3d-a35e-c63587e76eca tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:45:58.008857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1fcc803c-72c9-4d3d-a35e-c63587e76eca tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:45:58.070204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fcc803c-72c9-4d3d-a35e-c63587e76eca tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:58.077841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fcc803c-72c9-4d3d-a35e-c63587e76eca tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:58.079310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fcc803c-72c9-4d3d-a35e-c63587e76eca tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:45:58.079763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fcc803c-72c9-4d3d-a35e-c63587e76eca tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:45:59.079049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9f9ba724-d725-4fbe-beb8-1f63b9fb74e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:59.088185 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9f9ba724-d725-4fbe-beb8-1f63b9fb74e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1238 microversion: 2.1 time: 1.107092 May 19 04:45:59.099186 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1805/3520] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:57 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1238 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:45:59.796420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1fcc803c-72c9-4d3d-a35e-c63587e76eca tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:45:59.848762 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1fcc803c-72c9-4d3d-a35e-c63587e76eca tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1454 microversion: 2.1 time: 1.845594 May 19 04:45:59.852755 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1716/3521] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:45:57 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1454 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:00.105870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3605fd2-15a8-453e-82a7-ab521049b5f6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:00.106545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e3605fd2-15a8-453e-82a7-ab521049b5f6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:00.136332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3605fd2-15a8-453e-82a7-ab521049b5f6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:00.136799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3605fd2-15a8-453e-82a7-ab521049b5f6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:00.137628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3605fd2-15a8-453e-82a7-ab521049b5f6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:00.144872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3605fd2-15a8-453e-82a7-ab521049b5f6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:00.206683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f2a15a96-7969-40bd-8750-35f22fb9f355 req-180a474d-fb54-4a62-b340-5bcf575118cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d751c7-29c0-4cc6-bb91-206e4ca07016", "name": "network-vif-deleted", "tag": "7274752f-dda5-4883-8b3e-4dc473d91bf3"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:00.243286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f2a15a96-7969-40bd-8750-35f22fb9f355 req-180a474d-fb54-4a62-b340-5bcf575118cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:00.245159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f2a15a96-7969-40bd-8750-35f22fb9f355 req-180a474d-fb54-4a62-b340-5bcf575118cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:00.324407 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f2a15a96-7969-40bd-8750-35f22fb9f355 req-180a474d-fb54-4a62-b340-5bcf575118cb service nova] Creating event network-vif-deleted:7274752f-dda5-4883-8b3e-4dc473d91bf3 for instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 on n-h1-766726-30 May 19 04:46:00.351299 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f2a15a96-7969-40bd-8750-35f22fb9f355 req-180a474d-fb54-4a62-b340-5bcf575118cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152436 May 19 04:46:00.356904 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1717/3522] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:00.901286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:00.903746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:00.940940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:00.951088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:00.955369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:00.956828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:01.072479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:01.073530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:01.074163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lazy-loading 'fault' on Instance uuid a1d751c7-29c0-4cc6-bb91-206e4ca07016 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:46:01.346661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3605fd2-15a8-453e-82a7-ab521049b5f6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:01.359175 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e3605fd2-15a8-453e-82a7-ab521049b5f6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1290 microversion: 2.1 time: 1.253542 May 19 04:46:01.360913 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1806/3523] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:00 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1290 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:01.477736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:01.495140 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d1758c69-b312-43dc-86a1-078de781e57f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 200 len: 1302 microversion: 2.1 time: 0.628507 May 19 04:46:01.496422 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1718/3524] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:00 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 1302 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:02.191495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-58ed19ad-5f29-4c20-9f46-fdc8af2c83d7 tempest-NetworksTest-1626036543 tempest-NetworksTest-1626036543-project-admin] Calling method '.version_select at 0x7fd314d8a280>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:02.377831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31f365fd-e6a1-4044-b7df-26589f314dce tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:02.379459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31f365fd-e6a1-4044-b7df-26589f314dce tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:02.407332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31f365fd-e6a1-4044-b7df-26589f314dce tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:02.408688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31f365fd-e6a1-4044-b7df-26589f314dce tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:02.412963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31f365fd-e6a1-4044-b7df-26589f314dce tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:02.413671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31f365fd-e6a1-4044-b7df-26589f314dce tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:02.847318 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-58ed19ad-5f29-4c20-9f46-fdc8af2c83d7 tempest-NetworksTest-1626036543 tempest-NetworksTest-1626036543-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 8762 microversion: 2.1 time: 0.927091 May 19 04:46:02.848093 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1807/3525] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:46:01 2022] GET /compute/v2.1/os-networks => generated 8762 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:02.858763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:02.859445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:02.880849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:02.881619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:02.883386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:02.884657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:02.929737 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] HTTP exception thrown: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Request method failure captured: May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 HTTP/1.1 May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihctGfDia8NUXzCbg7zns3hbxvKaLQWPqxwfNmoBF-8GvHZ5-JD_dGVrcfK4OJM74DzpSRUvvgnV9fyvD5lpZ2pB463jLJri6Wgov_90bmNxwN5ZCkDfddj_eU65lstAThb0dxd7J31kMAVpElDX4uRubALr-1KGcqQY1eGO-POyMc1Y May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: b6633f964e254f10a5209671d95504f1 May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestMultiNic-876429789 May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6633f964e254f10a5209671d95504f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6633f964e254f10a5209671d95504f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestMultiNic-876429789 May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: b6633f964e254f10a5209671d95504f1 May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestMultiNic-876429789 May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestMultiNic-876429789-project May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 811f04490bc64b769f287f1f44577a3b May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestMultiNic-876429789-project May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'a1d751c7-29c0-4cc6-bb91-206e4ca07016'} May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:02.931480 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:02.937287 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:02.937287 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:02.937287 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:02.937287 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:46:02.937287 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:46:02.937287 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:46:02.937287 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:02.937287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Returning 404 to user: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:46:02.937287 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac9d52fc-ba1f-4c8f-a17e-1da354f674f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 404 len: 111 microversion: 2.1 time: 0.078344 May 19 04:46:02.944353 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1808/3526] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:02 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:46:02.963031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c0126d4e-48a4-4978-a85e-746a10b87b89 tempest-NetworksTest-1626036543 tempest-NetworksTest-1626036543-project-admin] Calling method '.version_select at 0x7fd314d93a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:03.140170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31f365fd-e6a1-4044-b7df-26589f314dce tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:03.155993 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31f365fd-e6a1-4044-b7df-26589f314dce tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1296 microversion: 2.1 time: 0.782426 May 19 04:46:03.161388 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1719/3527] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:02 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1296 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:03.468817 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c0126d4e-48a4-4978-a85e-746a10b87b89 tempest-NetworksTest-1626036543 tempest-NetworksTest-1626036543-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks/43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b" status: 200 len: 652 microversion: 2.1 time: 0.521166 May 19 04:46:03.469564 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1809/3528] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:46:02 2022] GET /compute/v2.1/os-networks/43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b => generated 652 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:03.478361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-103f36ea-5b0d-4a64-98e0-2e21b8d00269 tempest-NetworksTest-1626036543 tempest-NetworksTest-1626036543-project-admin] Calling method '.version_select at 0x7fd314d93f70>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:03.921070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1756864906", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:04.052699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] validate_networks() for [('a9af2bd0-1c1c-4510-a700-3a020ba6746b', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:04.136543 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-103f36ea-5b0d-4a64-98e0-2e21b8d00269 tempest-NetworksTest-1626036543 tempest-NetworksTest-1626036543-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 8762 microversion: 2.1 time: 0.661801 May 19 04:46:04.137200 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1810/3529] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:46:03 2022] GET /compute/v2.1/os-networks => generated 8762 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:46:04.176634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55e8af13-4eb3-4252-bdca-6e39d398866a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:04.177813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-55e8af13-4eb3-4252-bdca-6e39d398866a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:04.190545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:04.193288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55e8af13-4eb3-4252-bdca-6e39d398866a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:04.194356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55e8af13-4eb3-4252-bdca-6e39d398866a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:04.196541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55e8af13-4eb3-4252-bdca-6e39d398866a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:04.199997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55e8af13-4eb3-4252-bdca-6e39d398866a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:04.666296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55e8af13-4eb3-4252-bdca-6e39d398866a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:04.680516 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-55e8af13-4eb3-4252-bdca-6e39d398866a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 0.509831 May 19 04:46:04.694693 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1811/3530] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:04 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:46:05.703955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8838a833-ab91-4b9b-932c-22ee06184a4f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:05.703955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8838a833-ab91-4b9b-932c-22ee06184a4f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:05.740719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8838a833-ab91-4b9b-932c-22ee06184a4f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:05.742489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8838a833-ab91-4b9b-932c-22ee06184a4f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:05.745091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8838a833-ab91-4b9b-932c-22ee06184a4f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:05.745783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8838a833-ab91-4b9b-932c-22ee06184a4f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:06.722125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8838a833-ab91-4b9b-932c-22ee06184a4f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:06.731601 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8838a833-ab91-4b9b-932c-22ee06184a4f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 1.033969 May 19 04:46:06.746252 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1812/3531] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:05 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:46:07.598962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:07.725938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=10 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:07.754570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-742b80f7-3c5b-49f3-9cfa-ae9a0b01b1bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:07.755392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-742b80f7-3c5b-49f3-9cfa-ae9a0b01b1bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:07.774350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-742b80f7-3c5b-49f3-9cfa-ae9a0b01b1bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:07.781603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-742b80f7-3c5b-49f3-9cfa-ae9a0b01b1bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:07.782558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-742b80f7-3c5b-49f3-9cfa-ae9a0b01b1bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:07.783090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-742b80f7-3c5b-49f3-9cfa-ae9a0b01b1bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:08.029303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:08.030377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:08.031540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:08.031969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:08.033028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:08.050862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:08.051531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:08.053495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:08.053943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:08.107371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Getting quotas for project a5f3b608f2294ee78ba1865a9494fbcf. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:08.124154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Getting quotas for user 263de26333b245db8642fc41d532da88 and project a5f3b608f2294ee78ba1865a9494fbcf. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:08.177964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:08.180338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:08.306952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-742b80f7-3c5b-49f3-9cfa-ae9a0b01b1bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:08.313131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:08.316026 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-742b80f7-3c5b-49f3-9cfa-ae9a0b01b1bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 0.566559 May 19 04:46:08.326994 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1813/3532] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:07 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:46:08.349566 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-56f1c32e-f851-48c0-80c6-41cfcaeb4f37 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.916940 May 19 04:46:08.352243 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1720/3533] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:46:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 4920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 04:46:08.362838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-38022cd9-4e12-44d5-ad3e-b91cfa04c496 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:08.364810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-38022cd9-4e12-44d5-ad3e-b91cfa04c496 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:08.762084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-38022cd9-4e12-44d5-ad3e-b91cfa04c496 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:08.789224 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-38022cd9-4e12-44d5-ad3e-b91cfa04c496 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1223 microversion: 2.1 time: 0.429767 May 19 04:46:08.792518 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1814/3534] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:08 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1223 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:09.336427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30fee943-5055-4339-85b4-fdbeb59a7c8c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:09.337842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-30fee943-5055-4339-85b4-fdbeb59a7c8c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:09.346425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30fee943-5055-4339-85b4-fdbeb59a7c8c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:09.347121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30fee943-5055-4339-85b4-fdbeb59a7c8c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:09.348206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30fee943-5055-4339-85b4-fdbeb59a7c8c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:09.348800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30fee943-5055-4339-85b4-fdbeb59a7c8c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:09.810363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d00ab45-aa9e-4d47-8025-6e9f07025845 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:09.810992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7d00ab45-aa9e-4d47-8025-6e9f07025845 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:09.828256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d00ab45-aa9e-4d47-8025-6e9f07025845 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:09.836194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d00ab45-aa9e-4d47-8025-6e9f07025845 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:09.837385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d00ab45-aa9e-4d47-8025-6e9f07025845 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:09.838360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d00ab45-aa9e-4d47-8025-6e9f07025845 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:10.090677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-30fee943-5055-4339-85b4-fdbeb59a7c8c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:10.099908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7d00ab45-aa9e-4d47-8025-6e9f07025845 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:10.112815 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-30fee943-5055-4339-85b4-fdbeb59a7c8c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 0.782533 May 19 04:46:10.113277 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d00ab45-aa9e-4d47-8025-6e9f07025845 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1219 microversion: 2.1 time: 0.303502 May 19 04:46:10.113912 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1815/3535] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:09 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1219 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:10.115827 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1721/3536] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:09 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:11.011675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f1c11c7c-aff8-4ea5-a75a-680bcf1c3af6 req-b386e768-c78a-465c-b41c-1f31b110daa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:11.047906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f1c11c7c-aff8-4ea5-a75a-680bcf1c3af6 req-b386e768-c78a-465c-b41c-1f31b110daa0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:11.048803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f1c11c7c-aff8-4ea5-a75a-680bcf1c3af6 req-b386e768-c78a-465c-b41c-1f31b110daa0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:11.092167 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f1c11c7c-aff8-4ea5-a75a-680bcf1c3af6 req-b386e768-c78a-465c-b41c-1f31b110daa0 service nova] Creating event network-changed:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:46:11.115363 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f1c11c7c-aff8-4ea5-a75a-680bcf1c3af6 req-b386e768-c78a-465c-b41c-1f31b110daa0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105442 May 19 04:46:11.116035 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1816/3537] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:46:11.132002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-67717356-0e2c-4ea8-b904-1cc2054b0d21 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:11.133278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-67717356-0e2c-4ea8-b904-1cc2054b0d21 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:11.133546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-213fa29a-1501-41a0-8fef-4f369e559e65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:11.134267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-213fa29a-1501-41a0-8fef-4f369e559e65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:11.149578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67717356-0e2c-4ea8-b904-1cc2054b0d21 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:11.158556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67717356-0e2c-4ea8-b904-1cc2054b0d21 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:11.161274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-213fa29a-1501-41a0-8fef-4f369e559e65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:11.162512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-213fa29a-1501-41a0-8fef-4f369e559e65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:11.166487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-213fa29a-1501-41a0-8fef-4f369e559e65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:11.167282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-213fa29a-1501-41a0-8fef-4f369e559e65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:11.173311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67717356-0e2c-4ea8-b904-1cc2054b0d21 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:11.181400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67717356-0e2c-4ea8-b904-1cc2054b0d21 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:11.516636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-67717356-0e2c-4ea8-b904-1cc2054b0d21 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:11.543182 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-67717356-0e2c-4ea8-b904-1cc2054b0d21 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1281 microversion: 2.1 time: 0.414971 May 19 04:46:11.548520 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1722/3538] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:11 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1281 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:12.562480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2deb0f48-f724-4580-a433-d46f79f291d9 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:12.563087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2deb0f48-f724-4580-a433-d46f79f291d9 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:12.576688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2deb0f48-f724-4580-a433-d46f79f291d9 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:12.577335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2deb0f48-f724-4580-a433-d46f79f291d9 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:12.578288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2deb0f48-f724-4580-a433-d46f79f291d9 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:12.587152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2deb0f48-f724-4580-a433-d46f79f291d9 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:12.654561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-213fa29a-1501-41a0-8fef-4f369e559e65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:12.669325 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-213fa29a-1501-41a0-8fef-4f369e559e65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 1.540535 May 19 04:46:12.680646 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1817/3539] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:11 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:13.164358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2deb0f48-f724-4580-a433-d46f79f291d9 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:13.179242 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2deb0f48-f724-4580-a433-d46f79f291d9 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1323 microversion: 2.1 time: 0.622601 May 19 04:46:13.188262 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1723/3540] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:12 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1323 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:46:13.696876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-baa925ee-3263-412b-bc61-83add11bc7d1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:13.697980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-baa925ee-3263-412b-bc61-83add11bc7d1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:13.709656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-baa925ee-3263-412b-bc61-83add11bc7d1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:13.713877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-baa925ee-3263-412b-bc61-83add11bc7d1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:13.715770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-baa925ee-3263-412b-bc61-83add11bc7d1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:13.718661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-baa925ee-3263-412b-bc61-83add11bc7d1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:14.205788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f90e63a-fa1d-4dce-a305-5b7cb3645bf3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:14.206399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6f90e63a-fa1d-4dce-a305-5b7cb3645bf3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:14.232500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f90e63a-fa1d-4dce-a305-5b7cb3645bf3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:14.233671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f90e63a-fa1d-4dce-a305-5b7cb3645bf3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:14.234738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f90e63a-fa1d-4dce-a305-5b7cb3645bf3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:14.235352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f90e63a-fa1d-4dce-a305-5b7cb3645bf3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:14.700736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-baa925ee-3263-412b-bc61-83add11bc7d1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:14.720791 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-baa925ee-3263-412b-bc61-83add11bc7d1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 1.028794 May 19 04:46:14.731977 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1818/3541] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:13 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:46:15.154507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-554772279", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:15.238502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:15.646416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6f90e63a-fa1d-4dce-a305-5b7cb3645bf3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:15.658160 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f90e63a-fa1d-4dce-a305-5b7cb3645bf3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1323 microversion: 2.1 time: 1.457512 May 19 04:46:15.669683 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1724/3542] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:14 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1323 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:15.755039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99ca2934-1ffb-44a6-a79e-331508739353 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:15.755867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99ca2934-1ffb-44a6-a79e-331508739353 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:15.764056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:15.766884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99ca2934-1ffb-44a6-a79e-331508739353 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:15.767706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99ca2934-1ffb-44a6-a79e-331508739353 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:15.769002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99ca2934-1ffb-44a6-a79e-331508739353 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:15.769706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99ca2934-1ffb-44a6-a79e-331508739353 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:16.817134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99ca2934-1ffb-44a6-a79e-331508739353 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:16.835762 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99ca2934-1ffb-44a6-a79e-331508739353 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 1.087467 May 19 04:46:16.837315 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1725/3543] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:15 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:46:16.851572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ba8678a-04a7-4fda-a581-1be12ca41ece"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:16.854865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:16.871920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:16.872650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:16.875433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:16.878398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:17.080909 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Invalid volume: volume 5ba8678a-04a7-4fda-a581-1be12ca41ece is already attached to instances: 23673e55-0886-4f7e-bbf3-57c29b063597 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments HTTP/1.1 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 74 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: {"volumeAttachment": {"volumeId": "5ba8678a-04a7-4fda-a581-1be12ca41ece"}} May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid volume: volume 5ba8678a-04a7-4fda-a581-1be12ca41ece is already attached to instances: 23673e55-0886-4f7e-bbf3-57c29b063597 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'server_id': '23673e55-0886-4f7e-bbf3-57c29b063597', 'body': {'volumeAttachment': {'volumeId': '5ba8678a-04a7-4fda-a581-1be12ca41ece'}}} May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5ba8678a-04a7-4fda-a581-1be12ca41ece is already attached to instances: 23673e55-0886-4f7e-bbf3-57c29b063597 May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:46:17.083045 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5ba8678a-04a7-4fda-a581-1be12ca41ece is already attached to instances: 23673e55-0886-4f7e-bbf3-57c29b063597 May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5ba8678a-04a7-4fda-a581-1be12ca41ece is already attached to instances: 23673e55-0886-4f7e-bbf3-57c29b063597 May 19 04:46:17.087560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:17.096586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 400 to user: Invalid volume: volume 5ba8678a-04a7-4fda-a581-1be12ca41ece is already attached to instances: 23673e55-0886-4f7e-bbf3-57c29b063597 {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:46:17.098056 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8bd0a81a-19c9-4911-93b9-ecfa9a463c84 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.259011 May 19 04:46:17.100647 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1726/3544] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:46:16 2022] POST /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments => generated 174 bytes in 263 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:46:17.123637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dfa2508e-768e-4b52-9ee6-4257ef6b1328 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:17.131776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dfa2508e-768e-4b52-9ee6-4257ef6b1328 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:17.161757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfa2508e-768e-4b52-9ee6-4257ef6b1328 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:17.163904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfa2508e-768e-4b52-9ee6-4257ef6b1328 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:17.166460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfa2508e-768e-4b52-9ee6-4257ef6b1328 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:17.167500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfa2508e-768e-4b52-9ee6-4257ef6b1328 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:17.797893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:17.798379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:17.798776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:17.799374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:17.799976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:17.816935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:17.817707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:17.818699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:17.819301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:17.850242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Getting quotas for project bd1653e189894a0394e865ab24170be7. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:17.864415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Getting quotas for user c736259c32d4429383b6c8d7f57f33a5 and project bd1653e189894a0394e865ab24170be7. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:17.881334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:17.884195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:18.016516 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e5fd4a86-a625-4eef-9274-b87f5fbfe612 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.067844 May 19 04:46:18.017949 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1819/3545] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:46:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:46:18.045246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d7973f68-e4ba-4d32-89b0-2c3975080f26 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:18.045803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d7973f68-e4ba-4d32-89b0-2c3975080f26 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:18.067962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7973f68-e4ba-4d32-89b0-2c3975080f26 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:18.069722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7973f68-e4ba-4d32-89b0-2c3975080f26 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:18.070687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7973f68-e4ba-4d32-89b0-2c3975080f26 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:18.071293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7973f68-e4ba-4d32-89b0-2c3975080f26 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:18.072178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:18.165355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:18.175116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dfa2508e-768e-4b52-9ee6-4257ef6b1328 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:18.194105 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dfa2508e-768e-4b52-9ee6-4257ef6b1328 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1323 microversion: 2.1 time: 1.090594 May 19 04:46:18.197340 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1727/3546] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:17 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1323 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:18.221527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f767bf1-5b25-4900-9d5d-caceaceac9e2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:18.224617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6f767bf1-5b25-4900-9d5d-caceaceac9e2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:18.262858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f767bf1-5b25-4900-9d5d-caceaceac9e2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:18.263617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f767bf1-5b25-4900-9d5d-caceaceac9e2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:18.264075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-d7973f68-e4ba-4d32-89b0-2c3975080f26 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lazy-loading 'services' on Instance uuid 23673e55-0886-4f7e-bbf3-57c29b063597 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:46:18.266388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f767bf1-5b25-4900-9d5d-caceaceac9e2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:18.267663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f767bf1-5b25-4900-9d5d-caceaceac9e2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:18.534569 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d7973f68-e4ba-4d32-89b0-2c3975080f26 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments/5ba8678a-04a7-4fda-a581-1be12ca41ece" status: 202 len: 0 microversion: 2.1 time: 0.514175 May 19 04:46:18.539806 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1820/3547] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 04:46:18 2022] DELETE /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments/5ba8678a-04a7-4fda-a581-1be12ca41ece => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:46:18.556339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1341185724", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:18.687844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:19.853709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6f767bf1-5b25-4900-9d5d-caceaceac9e2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:19.871266 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f767bf1-5b25-4900-9d5d-caceaceac9e2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 1.670005 May 19 04:46:19.873445 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1728/3548] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:18 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:19.893851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f49211bf-4e10-440c-b1b0-ce0fa3c49206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:19.895909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f49211bf-4e10-440c-b1b0-ce0fa3c49206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:19.918743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f49211bf-4e10-440c-b1b0-ce0fa3c49206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:19.926073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f49211bf-4e10-440c-b1b0-ce0fa3c49206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:19.930725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f49211bf-4e10-440c-b1b0-ce0fa3c49206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:19.931214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f49211bf-4e10-440c-b1b0-ce0fa3c49206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:20.021982 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f49211bf-4e10-440c-b1b0-ce0fa3c49206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144005 May 19 04:46:20.022592 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1729/3549] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:46:19 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:20.045905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-db7fe102-5da0-4e05-b9f2-aad72335d47a req-1d75e9bc-59a7-42ed-b436-17df560749c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe", "tag": "b5d2cce6-de74-48ec-83dd-509de85ddfaa"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:20.074432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-db7fe102-5da0-4e05-b9f2-aad72335d47a req-1d75e9bc-59a7-42ed-b436-17df560749c2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:20.074791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-db7fe102-5da0-4e05-b9f2-aad72335d47a req-1d75e9bc-59a7-42ed-b436-17df560749c2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:20.123760 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-db7fe102-5da0-4e05-b9f2-aad72335d47a req-1d75e9bc-59a7-42ed-b436-17df560749c2 service nova] Creating event network-changed:b5d2cce6-de74-48ec-83dd-509de85ddfaa for instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe on n-h1-766726-30 May 19 04:46:20.142336 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-db7fe102-5da0-4e05-b9f2-aad72335d47a req-1d75e9bc-59a7-42ed-b436-17df560749c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118368 May 19 04:46:20.143687 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1730/3550] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:20.153832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dbee2026-a322-44cc-93a6-6192df9b09b0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:20.158195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dbee2026-a322-44cc-93a6-6192df9b09b0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:20.174190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbee2026-a322-44cc-93a6-6192df9b09b0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:20.175003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbee2026-a322-44cc-93a6-6192df9b09b0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:20.176209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbee2026-a322-44cc-93a6-6192df9b09b0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:20.176855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbee2026-a322-44cc-93a6-6192df9b09b0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:20.843019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:20.844328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:20.845296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:20.845936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:20.846595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:20.858230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=11 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:20.864302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:20.867184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:20.876636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:20.878523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:20.951141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Getting quotas for project bd1653e189894a0394e865ab24170be7. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:20.968795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Getting quotas for user c736259c32d4429383b6c8d7f57f33a5 and project bd1653e189894a0394e865ab24170be7. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:21.002989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:21.010211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:21.125437 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cb2acb43-de9d-4d6e-95b5-ec1e90fc103b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.583145 May 19 04:46:21.131907 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1821/3551] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:46:21.137134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1667500165", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "182008a0-9229-4ff4-b3f1-b6f06c5c6665"}, {"uuid": "bdc7b312-c843-4d32-807a-fcecfa3e5b20"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:21.257432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] validate_networks() for [('182008a0-9229-4ff4-b3f1-b6f06c5c6665', None, None, None, None, None), ('bdc7b312-c843-4d32-807a-fcecfa3e5b20', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:21.963852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dbee2026-a322-44cc-93a6-6192df9b09b0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:21.974742 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dbee2026-a322-44cc-93a6-6192df9b09b0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1323 microversion: 2.1 time: 1.829585 May 19 04:46:21.991122 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1731/3552] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:20 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1323 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:22.011616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf6df6d6-a6a1-4c62-a484-02fe0bea823c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:22.012257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf6df6d6-a6a1-4c62-a484-02fe0bea823c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:22.038103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf6df6d6-a6a1-4c62-a484-02fe0bea823c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:22.039235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf6df6d6-a6a1-4c62-a484-02fe0bea823c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:22.040043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf6df6d6-a6a1-4c62-a484-02fe0bea823c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:22.040487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf6df6d6-a6a1-4c62-a484-02fe0bea823c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:23.587431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cf6df6d6-a6a1-4c62-a484-02fe0bea823c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:23.597742 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf6df6d6-a6a1-4c62-a484-02fe0bea823c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 1.605053 May 19 04:46:23.601406 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1732/3553] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:21 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:23.612696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f50b5865-24a7-44a7-90c1-f4cb149b4ced tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:23.616604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f50b5865-24a7-44a7-90c1-f4cb149b4ced tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:23.634762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f50b5865-24a7-44a7-90c1-f4cb149b4ced tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:23.636179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f50b5865-24a7-44a7-90c1-f4cb149b4ced tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:23.639406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f50b5865-24a7-44a7-90c1-f4cb149b4ced tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:23.640594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f50b5865-24a7-44a7-90c1-f4cb149b4ced tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:23.706913 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f50b5865-24a7-44a7-90c1-f4cb149b4ced tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102762 May 19 04:46:23.707823 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1733/3554] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:46:23 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:23.717561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2dcb0e04-6241-48ae-a0e5-b3d9393d5a2b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:23.718505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2dcb0e04-6241-48ae-a0e5-b3d9393d5a2b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:23.727494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2dcb0e04-6241-48ae-a0e5-b3d9393d5a2b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:23.728296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2dcb0e04-6241-48ae-a0e5-b3d9393d5a2b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:23.729807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2dcb0e04-6241-48ae-a0e5-b3d9393d5a2b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:23.730496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2dcb0e04-6241-48ae-a0e5-b3d9393d5a2b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:23.764657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:23.902095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2dcb0e04-6241-48ae-a0e5-b3d9393d5a2b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:23.919621 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2dcb0e04-6241-48ae-a0e5-b3d9393d5a2b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 200 len: 1272 microversion: 2.1 time: 0.205151 May 19 04:46:23.922182 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1734/3555] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:23 2022] GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:23.940777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1381486968", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "29c7ba19-d9c8-41b4-a51b-9142cc20cc9e"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:24.045187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] validate_networks() for [('29c7ba19-d9c8-41b4-a51b-9142cc20cc9e', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:24.692428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:24.693049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:24.693416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:24.694184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:24.694771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:24.710982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:24.711643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:24.712829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:24.715949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:24.760096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Getting quotas for project b6633f964e254f10a5209671d95504f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:24.782617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Getting quotas for user 811f04490bc64b769f287f1f44577a3b and project b6633f964e254f10a5209671d95504f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:24.818982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:24.822920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:24.953349 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f99341bb-5386-446e-baa0-6a4aea6ed27e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.819925 May 19 04:46:24.967866 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1822/3556] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:46:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:46:25.018591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1d4a3f00-c519-4575-bb9c-56c71cf1b09f req-a5d9dd75-b3c5-4c62-bdb4-48be2600f07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "name": "network-vif-plugged", "status": "completed", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:25.057510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1d4a3f00-c519-4575-bb9c-56c71cf1b09f req-a5d9dd75-b3c5-4c62-bdb4-48be2600f07f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:25.058127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1d4a3f00-c519-4575-bb9c-56c71cf1b09f req-a5d9dd75-b3c5-4c62-bdb4-48be2600f07f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:25.086135 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1d4a3f00-c519-4575-bb9c-56c71cf1b09f req-a5d9dd75-b3c5-4c62-bdb4-48be2600f07f service nova] Creating event network-vif-plugged:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:46:25.098866 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1d4a3f00-c519-4575-bb9c-56c71cf1b09f req-a5d9dd75-b3c5-4c62-bdb4-48be2600f07f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127213 May 19 04:46:25.099656 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1823/3557] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:25.422493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-580132421", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "7d976320-2bf9-42c1-ae4e-6f6093023bd3"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:25.524167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] validate_networks() for [('7d976320-2bf9-42c1-ae4e-6f6093023bd3', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:25.527277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:25.527772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:25.528170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:25.528581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:25.528998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:25.546814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:25.547272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:25.548078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:25.548521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:25.601234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Getting quotas for project a4a8edf1aa5242218363358ec4eda15e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:25.614642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Getting quotas for user 7d32564afc494346bdfb99f4729fdacf and project a4a8edf1aa5242218363358ec4eda15e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:25.657497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:25.662342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:25.754659 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79c72cef-8748-4394-a9c5-bde9fefaad7d tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830530 May 19 04:46:25.755958 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1735/3558] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:46:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:46:25.775428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cd91a5e-91f1-4229-bd27-d6f62057239a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:25.776294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0cd91a5e-91f1-4229-bd27-d6f62057239a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:25.786645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cd91a5e-91f1-4229-bd27-d6f62057239a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:25.787401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cd91a5e-91f1-4229-bd27-d6f62057239a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:25.789163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cd91a5e-91f1-4229-bd27-d6f62057239a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:25.790049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cd91a5e-91f1-4229-bd27-d6f62057239a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:26.854376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0cd91a5e-91f1-4229-bd27-d6f62057239a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:26.863109 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0cd91a5e-91f1-4229-bd27-d6f62057239a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1323 microversion: 2.1 time: 1.105846 May 19 04:46:26.869852 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1736/3559] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:25 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1323 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:26.888827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f3fdc424-91d0-4a22-af6a-68384085501e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:26.893561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f3fdc424-91d0-4a22-af6a-68384085501e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:26.907880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3fdc424-91d0-4a22-af6a-68384085501e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:26.913266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3fdc424-91d0-4a22-af6a-68384085501e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:26.914463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3fdc424-91d0-4a22-af6a-68384085501e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:26.918700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3fdc424-91d0-4a22-af6a-68384085501e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:28.524207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f3fdc424-91d0-4a22-af6a-68384085501e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:28.538008 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f3fdc424-91d0-4a22-af6a-68384085501e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1363 microversion: 2.1 time: 1.656461 May 19 04:46:28.538624 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1737/3560] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:26 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1363 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:28.551384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7775bc35-c91a-4a41-b52d-61ff00dc6273 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:28.552616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7775bc35-c91a-4a41-b52d-61ff00dc6273 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:28.559643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7775bc35-c91a-4a41-b52d-61ff00dc6273 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:28.560376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7775bc35-c91a-4a41-b52d-61ff00dc6273 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:28.565836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7775bc35-c91a-4a41-b52d-61ff00dc6273 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:28.570288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7775bc35-c91a-4a41-b52d-61ff00dc6273 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:28.642080 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7775bc35-c91a-4a41-b52d-61ff00dc6273 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091164 May 19 04:46:28.643316 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1738/3561] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:46:28 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:28.649905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f36c3094-aad4-4ada-aa7d-32ea26958734 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:28.650536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f36c3094-aad4-4ada-aa7d-32ea26958734 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:28.664982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36c3094-aad4-4ada-aa7d-32ea26958734 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:28.665474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36c3094-aad4-4ada-aa7d-32ea26958734 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:28.666263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36c3094-aad4-4ada-aa7d-32ea26958734 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:28.666711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36c3094-aad4-4ada-aa7d-32ea26958734 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:28.929980 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 04:46:28.932878 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 04:46:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.58) !!! May 19 04:46:29.471661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f36c3094-aad4-4ada-aa7d-32ea26958734 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:29.486281 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f36c3094-aad4-4ada-aa7d-32ea26958734 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 200 len: 1314 microversion: 2.1 time: 0.841846 May 19 04:46:29.499718 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1739/3562] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:28 2022] GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:29.506280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7373bdc9-6f7e-43eb-8609-1339d8869484 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:29.507276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7373bdc9-6f7e-43eb-8609-1339d8869484 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:29.515835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7373bdc9-6f7e-43eb-8609-1339d8869484 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:29.518021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7373bdc9-6f7e-43eb-8609-1339d8869484 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:29.519155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7373bdc9-6f7e-43eb-8609-1339d8869484 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:29.520142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7373bdc9-6f7e-43eb-8609-1339d8869484 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:29.705420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:29.705855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:29.706414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:29.706853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:29.707319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:29.729509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:29.730043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:29.732210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:29.732676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:29.775278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Getting quotas for project 9838454858ac42269ad4bc9d4e85aaf3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:29.782798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Getting quotas for user c8046d338db34f599961b3590a96cea0 and project 9838454858ac42269ad4bc9d4e85aaf3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:29.811595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:29.815021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:29.883759 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bea5c3b8-0c0d-4a01-ab92-8aa219b39233 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.780395 May 19 04:46:29.885504 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1824/3563] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:46:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 4784 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:46:29.894262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99ce761f-52a2-49e3-ba03-544ff73c0739 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:29.898559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-99ce761f-52a2-49e3-ba03-544ff73c0739 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:29.934977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99ce761f-52a2-49e3-ba03-544ff73c0739 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:29.935658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99ce761f-52a2-49e3-ba03-544ff73c0739 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:29.936223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99ce761f-52a2-49e3-ba03-544ff73c0739 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:29.936694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99ce761f-52a2-49e3-ba03-544ff73c0739 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:30.213956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99ce761f-52a2-49e3-ba03-544ff73c0739 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:30.228799 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99ce761f-52a2-49e3-ba03-544ff73c0739 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1272 microversion: 2.1 time: 0.341936 May 19 04:46:30.229460 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1825/3564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:29 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:30.248828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5c951d2-6189-49e2-adc1-a26487e871b7 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:30.251652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5c951d2-6189-49e2-adc1-a26487e871b7 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:30.266010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5c951d2-6189-49e2-adc1-a26487e871b7 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:30.266754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5c951d2-6189-49e2-adc1-a26487e871b7 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:30.267721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5c951d2-6189-49e2-adc1-a26487e871b7 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:30.268366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5c951d2-6189-49e2-adc1-a26487e871b7 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:30.441991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7373bdc9-6f7e-43eb-8609-1339d8869484 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:30.450506 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7373bdc9-6f7e-43eb-8609-1339d8869484 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1313 microversion: 2.1 time: 0.948983 May 19 04:46:30.451119 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1740/3565] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:29 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1313 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:30.471531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a8eaaaf4-5930-4bc5-aa16-97b4f0551319 req-290455cb-f185-42df-9454-b8fab4694d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31", "tag": "31a4c6f4-b707-4bc5-bb17-5f1f5cb1e5cc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:30.508771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a8eaaaf4-5930-4bc5-aa16-97b4f0551319 req-290455cb-f185-42df-9454-b8fab4694d1d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:30.509358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a8eaaaf4-5930-4bc5-aa16-97b4f0551319 req-290455cb-f185-42df-9454-b8fab4694d1d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:30.535597 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a8eaaaf4-5930-4bc5-aa16-97b4f0551319 req-290455cb-f185-42df-9454-b8fab4694d1d service nova] Creating event network-changed:31a4c6f4-b707-4bc5-bb17-5f1f5cb1e5cc for instance 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 on n-h1-766726-30 May 19 04:46:30.542080 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a8eaaaf4-5930-4bc5-aa16-97b4f0551319 req-290455cb-f185-42df-9454-b8fab4694d1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076104 May 19 04:46:30.543290 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1741/3566] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:30.548922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-196e4ff7-dccc-4e51-9607-6ea2905839ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:30.549879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-196e4ff7-dccc-4e51-9607-6ea2905839ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:30.558690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-196e4ff7-dccc-4e51-9607-6ea2905839ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:30.560111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-196e4ff7-dccc-4e51-9607-6ea2905839ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:30.561107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-196e4ff7-dccc-4e51-9607-6ea2905839ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:30.562377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-196e4ff7-dccc-4e51-9607-6ea2905839ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:30.949812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5c951d2-6189-49e2-adc1-a26487e871b7 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:30.965933 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5c951d2-6189-49e2-adc1-a26487e871b7 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1323 microversion: 2.1 time: 0.724482 May 19 04:46:30.979070 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1826/3567] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:30 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1323 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:30.994206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-79d381dd-ad94-4aa1-a86c-464821098c7f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:30.999860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-79d381dd-ad94-4aa1-a86c-464821098c7f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:31.012501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79d381dd-ad94-4aa1-a86c-464821098c7f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:31.013364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79d381dd-ad94-4aa1-a86c-464821098c7f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:31.014427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79d381dd-ad94-4aa1-a86c-464821098c7f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:31.015130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79d381dd-ad94-4aa1-a86c-464821098c7f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:31.067552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-79d381dd-ad94-4aa1-a86c-464821098c7f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085164 May 19 04:46:31.070113 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1827/3568] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:46:30 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:31.086432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:31.091001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:31.106444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:31.109139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:31.110056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:31.111605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:31.936864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-196e4ff7-dccc-4e51-9607-6ea2905839ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:31.948057 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-196e4ff7-dccc-4e51-9607-6ea2905839ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1550 microversion: 2.1 time: 1.402915 May 19 04:46:31.949403 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1742/3569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:30 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1550 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:31.959484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2dde08d9-725a-4c9f-a455-2a796bcc5b70 req-b7f2ebc7-3a50-47d0-85c1-b8c0e23fddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe", "name": "network-vif-plugged", "status": "completed", "tag": "b5d2cce6-de74-48ec-83dd-509de85ddfaa"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:31.970940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2dde08d9-725a-4c9f-a455-2a796bcc5b70 req-b7f2ebc7-3a50-47d0-85c1-b8c0e23fddc7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:31.971915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2dde08d9-725a-4c9f-a455-2a796bcc5b70 req-b7f2ebc7-3a50-47d0-85c1-b8c0e23fddc7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:32.016087 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2dde08d9-725a-4c9f-a455-2a796bcc5b70 req-b7f2ebc7-3a50-47d0-85c1-b8c0e23fddc7 service nova] Creating event network-vif-plugged:b5d2cce6-de74-48ec-83dd-509de85ddfaa for instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe on n-h1-766726-30 May 19 04:46:32.026031 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2dde08d9-725a-4c9f-a455-2a796bcc5b70 req-b7f2ebc7-3a50-47d0-85c1-b8c0e23fddc7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071823 May 19 04:46:32.028753 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1743/3570] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:32.045549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-759f6ceb-16e2-4867-9235-591773c0e051 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:32.049314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-759f6ceb-16e2-4867-9235-591773c0e051 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:32.079362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-759f6ceb-16e2-4867-9235-591773c0e051 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:32.097514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-759f6ceb-16e2-4867-9235-591773c0e051 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:32.100756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:32.101993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-759f6ceb-16e2-4867-9235-591773c0e051 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:32.104853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-759f6ceb-16e2-4867-9235-591773c0e051 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:32.114991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:32.116542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:32.117773 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fbe8dec4-c97a-4517-ba2e-3cfab4ceaedb tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1262 microversion: 2.21 time: 1.043684 May 19 04:46:32.137488 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1828/3571] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:31 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1262 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:32.150282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b233dbfa-899a-47af-9d47-df4f67411055 req-f5559376-829f-47f9-8887-2e9b30e24324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b11dd9-99d7-422e-9399-37f52d453bee", "tag": "3f9d85c4-dcc4-422a-8896-34e1a8644e85"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:32.173325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b233dbfa-899a-47af-9d47-df4f67411055 req-f5559376-829f-47f9-8887-2e9b30e24324 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:32.174011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b233dbfa-899a-47af-9d47-df4f67411055 req-f5559376-829f-47f9-8887-2e9b30e24324 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:32.203232 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b233dbfa-899a-47af-9d47-df4f67411055 req-f5559376-829f-47f9-8887-2e9b30e24324 service nova] Creating event network-changed:3f9d85c4-dcc4-422a-8896-34e1a8644e85 for instance 27b11dd9-99d7-422e-9399-37f52d453bee on n-h2-766726-30 May 19 04:46:32.212513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b233dbfa-899a-47af-9d47-df4f67411055 req-f5559376-829f-47f9-8887-2e9b30e24324 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073647 May 19 04:46:32.213781 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1829/3572] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:32.227138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09d5f667-25fd-453b-94a0-d7ce8410cc97 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:32.227876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-09d5f667-25fd-453b-94a0-d7ce8410cc97 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:32.249629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09d5f667-25fd-453b-94a0-d7ce8410cc97 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:32.250232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09d5f667-25fd-453b-94a0-d7ce8410cc97 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:32.251140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09d5f667-25fd-453b-94a0-d7ce8410cc97 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:32.251506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09d5f667-25fd-453b-94a0-d7ce8410cc97 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:33.048433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-09d5f667-25fd-453b-94a0-d7ce8410cc97 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:33.073917 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-09d5f667-25fd-453b-94a0-d7ce8410cc97 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1314 microversion: 2.1 time: 0.849836 May 19 04:46:33.086358 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1830/3573] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:32 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:33.095448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f6f04fbb-7d32-4b70-bcaf-0fffd6ed3f3a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:33.096737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f6f04fbb-7d32-4b70-bcaf-0fffd6ed3f3a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:33.107390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6f04fbb-7d32-4b70-bcaf-0fffd6ed3f3a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:33.109159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6f04fbb-7d32-4b70-bcaf-0fffd6ed3f3a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:33.110190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6f04fbb-7d32-4b70-bcaf-0fffd6ed3f3a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:33.110799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6f04fbb-7d32-4b70-bcaf-0fffd6ed3f3a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:33.161654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-759f6ceb-16e2-4867-9235-591773c0e051 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:33.176291 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-759f6ceb-16e2-4867-9235-591773c0e051 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 200 len: 1314 microversion: 2.1 time: 1.144137 May 19 04:46:33.178396 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1744/3574] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:32 2022] GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 1314 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:33.185657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-88f5d5e2-cc51-4a45-b2d0-994fd0fac190 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:33.186996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-88f5d5e2-cc51-4a45-b2d0-994fd0fac190 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:33.195627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88f5d5e2-cc51-4a45-b2d0-994fd0fac190 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:33.196578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88f5d5e2-cc51-4a45-b2d0-994fd0fac190 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:33.197592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88f5d5e2-cc51-4a45-b2d0-994fd0fac190 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:33.213981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-88f5d5e2-cc51-4a45-b2d0-994fd0fac190 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:33.529122 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-88f5d5e2-cc51-4a45-b2d0-994fd0fac190 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.349227 May 19 04:46:33.539177 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1745/3575] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:46:33 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/os-interface => generated 284 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:33.555176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2bac081d-76d5-4d67-b028-0008385d08da tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:33.556570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2bac081d-76d5-4d67-b028-0008385d08da tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:33.565526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bac081d-76d5-4d67-b028-0008385d08da tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:33.566873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bac081d-76d5-4d67-b028-0008385d08da tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:33.569034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bac081d-76d5-4d67-b028-0008385d08da tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:33.571136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bac081d-76d5-4d67-b028-0008385d08da tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:33.812772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f6f04fbb-7d32-4b70-bcaf-0fffd6ed3f3a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:33.824609 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f6f04fbb-7d32-4b70-bcaf-0fffd6ed3f3a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1334 microversion: 2.1 time: 0.734357 May 19 04:46:33.837052 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1831/3576] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:33 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1334 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:33.854901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-211ebcae-02b5-40e2-81d7-0bb4bcd1d9d0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:33.864402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-211ebcae-02b5-40e2-81d7-0bb4bcd1d9d0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:33.882773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:33.886188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-211ebcae-02b5-40e2-81d7-0bb4bcd1d9d0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:33.886869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-211ebcae-02b5-40e2-81d7-0bb4bcd1d9d0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:33.887843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-211ebcae-02b5-40e2-81d7-0bb4bcd1d9d0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:33.888624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-211ebcae-02b5-40e2-81d7-0bb4bcd1d9d0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:33.970935 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-211ebcae-02b5-40e2-81d7-0bb4bcd1d9d0 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131629 May 19 04:46:33.972105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1832/3577] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:46:33 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:33.979704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2b912b93-427a-42af-b0c2-3f92df4da356 req-514fb544-1d1a-45af-9533-5ae61b100387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87f9a61-c221-4f63-8224-311f9ea3ddb5", "tag": "63f349eb-7fe7-4e19-86d2-ae264048d497"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:33.994780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2b912b93-427a-42af-b0c2-3f92df4da356 req-514fb544-1d1a-45af-9533-5ae61b100387 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:33.997567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2b912b93-427a-42af-b0c2-3f92df4da356 req-514fb544-1d1a-45af-9533-5ae61b100387 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.023200 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2b912b93-427a-42af-b0c2-3f92df4da356 req-514fb544-1d1a-45af-9533-5ae61b100387 service nova] Creating event network-changed:63f349eb-7fe7-4e19-86d2-ae264048d497 for instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 on n-h2-766726-30 May 19 04:46:34.033741 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2b912b93-427a-42af-b0c2-3f92df4da356 req-514fb544-1d1a-45af-9533-5ae61b100387 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059003 May 19 04:46:34.034998 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1833/3578] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:34.041550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:34.043212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:34.052471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:34.053855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.056291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:34.058585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.063314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2bac081d-76d5-4d67-b028-0008385d08da tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:34.073471 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2bac081d-76d5-4d67-b028-0008385d08da tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1323 microversion: 2.1 time: 0.528008 May 19 04:46:34.074061 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1746/3579] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:33 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1323 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:34.094924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-597fa248-74b8-4719-b1d8-c53e4be31b6c tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:34.095556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-597fa248-74b8-4719-b1d8-c53e4be31b6c tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:34.109943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-597fa248-74b8-4719-b1d8-c53e4be31b6c tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:34.110398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-597fa248-74b8-4719-b1d8-c53e4be31b6c tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.111194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-597fa248-74b8-4719-b1d8-c53e4be31b6c tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:34.118896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-597fa248-74b8-4719-b1d8-c53e4be31b6c tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.195581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:34.207024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:34.210201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:34.214320 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-28be27b7-598e-43be-af5e-8458d3b383fe tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1316 microversion: 2.21 time: 0.177838 May 19 04:46:34.215718 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1834/3580] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:34 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:34.230070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5acc71e2-2e90-431b-b763-138931129a8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:34.230639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5acc71e2-2e90-431b-b763-138931129a8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:34.243886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5acc71e2-2e90-431b-b763-138931129a8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:34.244335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5acc71e2-2e90-431b-b763-138931129a8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.245136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5acc71e2-2e90-431b-b763-138931129a8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:34.258040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5acc71e2-2e90-431b-b763-138931129a8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.676607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-597fa248-74b8-4719-b1d8-c53e4be31b6c tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:34.705312 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-597fa248-74b8-4719-b1d8-c53e4be31b6c tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1314 microversion: 2.1 time: 0.616910 May 19 04:46:34.712854 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1747/3581] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:34 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:34.729043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-418dc8e0-9f12-485e-b173-12d15a472bf3 req-a60e95d7-2833-49e9-a78e-b63e9c8f1c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31", "name": "network-vif-plugged", "status": "completed", "tag": "31a4c6f4-b707-4bc5-bb17-5f1f5cb1e5cc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:34.740089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-418dc8e0-9f12-485e-b173-12d15a472bf3 req-a60e95d7-2833-49e9-a78e-b63e9c8f1c41 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:34.741280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-418dc8e0-9f12-485e-b173-12d15a472bf3 req-a60e95d7-2833-49e9-a78e-b63e9c8f1c41 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.756225 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-418dc8e0-9f12-485e-b173-12d15a472bf3 req-a60e95d7-2833-49e9-a78e-b63e9c8f1c41 service nova] Creating event network-vif-plugged:31a4c6f4-b707-4bc5-bb17-5f1f5cb1e5cc for instance 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 on n-h1-766726-30 May 19 04:46:34.781665 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-418dc8e0-9f12-485e-b173-12d15a472bf3 req-a60e95d7-2833-49e9-a78e-b63e9c8f1c41 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065764 May 19 04:46:34.782891 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1748/3582] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:34.853833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-39e65a3d-8fb8-49c9-902b-3f983ea93b0c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:34.855050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-39e65a3d-8fb8-49c9-902b-3f983ea93b0c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:34.864621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39e65a3d-8fb8-49c9-902b-3f983ea93b0c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:34.865304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39e65a3d-8fb8-49c9-902b-3f983ea93b0c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.866356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39e65a3d-8fb8-49c9-902b-3f983ea93b0c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:34.869281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39e65a3d-8fb8-49c9-902b-3f983ea93b0c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:34.925892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5acc71e2-2e90-431b-b763-138931129a8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:34.938789 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5acc71e2-2e90-431b-b763-138931129a8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 200 len: 1314 microversion: 2.1 time: 0.720750 May 19 04:46:34.939722 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1835/3583] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:34 2022] GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:34.991270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a639652-17dc-489a-b0a0-a3c8fd55034d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:34.994172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1a639652-17dc-489a-b0a0-a3c8fd55034d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:35.038989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a639652-17dc-489a-b0a0-a3c8fd55034d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:35.044848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a639652-17dc-489a-b0a0-a3c8fd55034d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:35.048866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a639652-17dc-489a-b0a0-a3c8fd55034d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:35.049794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a639652-17dc-489a-b0a0-a3c8fd55034d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:35.063092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:35.132763 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1a639652-17dc-489a-b0a0-a3c8fd55034d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151987 May 19 04:46:35.133736 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1836/3584] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:46:34 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:35.140081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b4e61e9-95fa-4942-bf2a-b7c277fe49f4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:35.140736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b4e61e9-95fa-4942-bf2a-b7c277fe49f4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:35.150383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b4e61e9-95fa-4942-bf2a-b7c277fe49f4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:35.150904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b4e61e9-95fa-4942-bf2a-b7c277fe49f4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:35.151751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b4e61e9-95fa-4942-bf2a-b7c277fe49f4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:35.152196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b4e61e9-95fa-4942-bf2a-b7c277fe49f4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:35.574278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:35.643901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:35.771646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-39e65a3d-8fb8-49c9-902b-3f983ea93b0c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:35.780902 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-39e65a3d-8fb8-49c9-902b-3f983ea93b0c tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1334 microversion: 2.1 time: 0.930674 May 19 04:46:35.781952 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1749/3585] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:34 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1334 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:35.790504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:35.791380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:35.798439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:35.799078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:35.799959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:35.800637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:35.930759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b4e61e9-95fa-4942-bf2a-b7c277fe49f4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:35.942493 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b4e61e9-95fa-4942-bf2a-b7c277fe49f4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1518 microversion: 2.1 time: 0.807571 May 19 04:46:35.944324 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1837/3586] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:35 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1518 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:35.950572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e0fa788c-f7f4-4d82-ad51-2ce53f674b81 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:35.951654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e0fa788c-f7f4-4d82-ad51-2ce53f674b81 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:35.960212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0fa788c-f7f4-4d82-ad51-2ce53f674b81 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:35.961307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0fa788c-f7f4-4d82-ad51-2ce53f674b81 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:35.962458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0fa788c-f7f4-4d82-ad51-2ce53f674b81 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:35.963506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0fa788c-f7f4-4d82-ad51-2ce53f674b81 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.446259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:36.456969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:36.458887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:36.460211 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87201aa0-be96-4d1e-9cb1-178271fc6916 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1358 microversion: 2.21 time: 0.676893 May 19 04:46:36.461039 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1750/3587] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:35 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1358 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:36.466522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-56ecbf40-6a70-4d54-89a5-5bbb886c5caf req-b7cf901b-01f6-470a-a079-9f1ccf872c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9c050e-14dc-4fc6-99de-214670f86fd9", "tag": "f7f889bc-ab8a-43b0-a341-d72548efd84f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:36.479332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-56ecbf40-6a70-4d54-89a5-5bbb886c5caf req-b7cf901b-01f6-470a-a079-9f1ccf872c0d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.480155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-56ecbf40-6a70-4d54-89a5-5bbb886c5caf req-b7cf901b-01f6-470a-a079-9f1ccf872c0d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.502048 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-56ecbf40-6a70-4d54-89a5-5bbb886c5caf req-b7cf901b-01f6-470a-a079-9f1ccf872c0d service nova] Creating event network-changed:f7f889bc-ab8a-43b0-a341-d72548efd84f for instance 9d9c050e-14dc-4fc6-99de-214670f86fd9 on n-h2-766726-30 May 19 04:46:36.513880 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-56ecbf40-6a70-4d54-89a5-5bbb886c5caf req-b7cf901b-01f6-470a-a079-9f1ccf872c0d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049516 May 19 04:46:36.515395 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1751/3588] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:36.526099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff241bde-88c4-4b6f-8297-ae696529b158 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:36.527869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff241bde-88c4-4b6f-8297-ae696529b158 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:36.538336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff241bde-88c4-4b6f-8297-ae696529b158 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.538879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff241bde-88c4-4b6f-8297-ae696529b158 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.539733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff241bde-88c4-4b6f-8297-ae696529b158 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.540365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff241bde-88c4-4b6f-8297-ae696529b158 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.567975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e0fa788c-f7f4-4d82-ad51-2ce53f674b81 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:36.579739 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e0fa788c-f7f4-4d82-ad51-2ce53f674b81 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1314 microversion: 2.1 time: 0.632576 May 19 04:46:36.581559 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1838/3589] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:35 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:36.588970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6a705949-4a44-4c14-8585-c2b8807b0f5c tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:36.590338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6a705949-4a44-4c14-8585-c2b8807b0f5c tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:36.598395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a705949-4a44-4c14-8585-c2b8807b0f5c tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.598990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a705949-4a44-4c14-8585-c2b8807b0f5c tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.599884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a705949-4a44-4c14-8585-c2b8807b0f5c tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.601347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a705949-4a44-4c14-8585-c2b8807b0f5c tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.630272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-6a705949-4a44-4c14-8585-c2b8807b0f5c tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lazy-loading 'flavor' on Instance uuid 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:46:36.708939 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6a705949-4a44-4c14-8585-c2b8807b0f5c tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action" status: 200 len: 32 microversion: 2.1 time: 0.125845 May 19 04:46:36.709873 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1839/3590] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:46:36 2022] POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action => generated 32 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:46:36.726729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-884bf0b5-0c57-4ed8-ae65-051f266b30eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:36.728638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-884bf0b5-0c57-4ed8-ae65-051f266b30eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:36.737979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-884bf0b5-0c57-4ed8-ae65-051f266b30eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.737979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-884bf0b5-0c57-4ed8-ae65-051f266b30eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.739641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-884bf0b5-0c57-4ed8-ae65-051f266b30eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.739641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-884bf0b5-0c57-4ed8-ae65-051f266b30eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.787014 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-884bf0b5-0c57-4ed8-ae65-051f266b30eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069764 May 19 04:46:36.789841 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1840/3591] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:46:36 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:46:36.794134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1ab23ec2-65c0-430c-8c03-e57cf0f0d15d req-fea36d0f-2ee2-41df-a460-19d12a74157d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87f9a61-c221-4f63-8224-311f9ea3ddb5", "tag": "2170672b-203e-415a-bf08-98be872f15f3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:36.804966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1ab23ec2-65c0-430c-8c03-e57cf0f0d15d req-fea36d0f-2ee2-41df-a460-19d12a74157d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.805822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1ab23ec2-65c0-430c-8c03-e57cf0f0d15d req-fea36d0f-2ee2-41df-a460-19d12a74157d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.825412 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1ab23ec2-65c0-430c-8c03-e57cf0f0d15d req-fea36d0f-2ee2-41df-a460-19d12a74157d service nova] Creating event network-changed:2170672b-203e-415a-bf08-98be872f15f3 for instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 on n-h2-766726-30 May 19 04:46:36.835159 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1ab23ec2-65c0-430c-8c03-e57cf0f0d15d req-fea36d0f-2ee2-41df-a460-19d12a74157d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044832 May 19 04:46:36.836594 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1841/3592] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:36.863809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b64a963f-6eab-472b-bee2-4d1c94a75a99 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:36.864954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b64a963f-6eab-472b-bee2-4d1c94a75a99 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:36.872668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b64a963f-6eab-472b-bee2-4d1c94a75a99 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.873158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b64a963f-6eab-472b-bee2-4d1c94a75a99 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.873985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b64a963f-6eab-472b-bee2-4d1c94a75a99 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.874571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b64a963f-6eab-472b-bee2-4d1c94a75a99 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.926955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff241bde-88c4-4b6f-8297-ae696529b158 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:36.936590 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff241bde-88c4-4b6f-8297-ae696529b158 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 200 len: 1464 microversion: 2.1 time: 0.418171 May 19 04:46:36.938370 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1752/3593] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:36 2022] GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 1464 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:36.943454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-39d3078d-14f1-45da-95a5-a76aa5363732 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:36.944567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-39d3078d-14f1-45da-95a5-a76aa5363732 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:36.951669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39d3078d-14f1-45da-95a5-a76aa5363732 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.952736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39d3078d-14f1-45da-95a5-a76aa5363732 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:36.953782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39d3078d-14f1-45da-95a5-a76aa5363732 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:36.954298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39d3078d-14f1-45da-95a5-a76aa5363732 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.310936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b64a963f-6eab-472b-bee2-4d1c94a75a99 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:37.334450 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b64a963f-6eab-472b-bee2-4d1c94a75a99 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.481156 May 19 04:46:37.335393 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1842/3594] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:36 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:37.344261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-054894be-9cc6-4d2f-a1fd-2903ce896468 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:37.345112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-054894be-9cc6-4d2f-a1fd-2903ce896468 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:37.352141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-054894be-9cc6-4d2f-a1fd-2903ce896468 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.352911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-054894be-9cc6-4d2f-a1fd-2903ce896468 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.353940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-054894be-9cc6-4d2f-a1fd-2903ce896468 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.354615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-054894be-9cc6-4d2f-a1fd-2903ce896468 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.383994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-39d3078d-14f1-45da-95a5-a76aa5363732 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:37.396013 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-39d3078d-14f1-45da-95a5-a76aa5363732 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1334 microversion: 2.1 time: 0.455615 May 19 04:46:37.396617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-054894be-9cc6-4d2f-a1fd-2903ce896468 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:46:37.397885 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1753/3595] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:36 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1334 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:37.404823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0477046-7ca6-4af9-bb3a-4047385ec74a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:37.409955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d0477046-7ca6-4af9-bb3a-4047385ec74a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:37.421652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0477046-7ca6-4af9-bb3a-4047385ec74a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.422487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0477046-7ca6-4af9-bb3a-4047385ec74a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.425343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0477046-7ca6-4af9-bb3a-4047385ec74a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.426038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0477046-7ca6-4af9-bb3a-4047385ec74a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.460544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:37.510641 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-054894be-9cc6-4d2f-a1fd-2903ce896468 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 204 len: 0 microversion: 2.1 time: 0.173029 May 19 04:46:37.511867 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1843/3596] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:46:37 2022] DELETE /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:46:37.518917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-34eca3b3-213d-4e8c-a28e-a08aa3757e1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:37.519857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-34eca3b3-213d-4e8c-a28e-a08aa3757e1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:37.526880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-34eca3b3-213d-4e8c-a28e-a08aa3757e1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.527747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-34eca3b3-213d-4e8c-a28e-a08aa3757e1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.528822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-34eca3b3-213d-4e8c-a28e-a08aa3757e1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.529470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-34eca3b3-213d-4e8c-a28e-a08aa3757e1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.770413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d0477046-7ca6-4af9-bb3a-4047385ec74a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:37.778499 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d0477046-7ca6-4af9-bb3a-4047385ec74a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1313 microversion: 2.1 time: 0.379315 May 19 04:46:37.779415 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1754/3597] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:37 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:37.784986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:37.785810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:37.792164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.792833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.793450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.794066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.815204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-34eca3b3-213d-4e8c-a28e-a08aa3757e1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:37.844914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-34eca3b3-213d-4e8c-a28e-a08aa3757e1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1550 microversion: 2.1 time: 0.331123 May 19 04:46:37.857003 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1844/3598] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:37 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1550 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:37.873911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d65bdc75-1032-4196-8351-fb1ec35974bd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:37.875135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d65bdc75-1032-4196-8351-fb1ec35974bd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:37.887180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d65bdc75-1032-4196-8351-fb1ec35974bd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.888810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d65bdc75-1032-4196-8351-fb1ec35974bd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.890406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d65bdc75-1032-4196-8351-fb1ec35974bd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:37.891062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d65bdc75-1032-4196-8351-fb1ec35974bd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:37.977597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:37.988451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:37.990879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:37.993149 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-366e3f32-b384-4337-b32b-958e75f522d2 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1358 microversion: 2.21 time: 0.212525 May 19 04:46:37.997892 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1755/3599] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:37 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:38.003753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5a5c761d-5701-494c-a25a-dfaa3a6a6135 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:38.004634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5a5c761d-5701-494c-a25a-dfaa3a6a6135 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:38.015081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a5c761d-5701-494c-a25a-dfaa3a6a6135 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.015825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a5c761d-5701-494c-a25a-dfaa3a6a6135 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.016794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a5c761d-5701-494c-a25a-dfaa3a6a6135 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.017727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a5c761d-5701-494c-a25a-dfaa3a6a6135 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.273996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d65bdc75-1032-4196-8351-fb1ec35974bd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:38.284793 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d65bdc75-1032-4196-8351-fb1ec35974bd tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1680 microversion: 2.1 time: 0.423150 May 19 04:46:38.286748 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1845/3600] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:37 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1680 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:38.294875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d79d9c10-fbbf-4b2b-9d25-659473b107b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:38.296268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d79d9c10-fbbf-4b2b-9d25-659473b107b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:38.307630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d79d9c10-fbbf-4b2b-9d25-659473b107b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.308366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d79d9c10-fbbf-4b2b-9d25-659473b107b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.309386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d79d9c10-fbbf-4b2b-9d25-659473b107b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.310013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d79d9c10-fbbf-4b2b-9d25-659473b107b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.336557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5a5c761d-5701-494c-a25a-dfaa3a6a6135 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:38.347996 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5a5c761d-5701-494c-a25a-dfaa3a6a6135 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1314 microversion: 2.1 time: 0.348382 May 19 04:46:38.349361 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1756/3601] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:37 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:38.362930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bf9980c0-1d31-4773-8078-1fe2a233d744 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:38.363562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bf9980c0-1d31-4773-8078-1fe2a233d744 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:38.372121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf9980c0-1d31-4773-8078-1fe2a233d744 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.372578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf9980c0-1d31-4773-8078-1fe2a233d744 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.373432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf9980c0-1d31-4773-8078-1fe2a233d744 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.374385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf9980c0-1d31-4773-8078-1fe2a233d744 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.676781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d79d9c10-fbbf-4b2b-9d25-659473b107b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:38.678377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bf9980c0-1d31-4773-8078-1fe2a233d744 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:38.696208 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bf9980c0-1d31-4773-8078-1fe2a233d744 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.345397 May 19 04:46:38.698431 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d79d9c10-fbbf-4b2b-9d25-659473b107b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1550 microversion: 2.1 time: 0.410276 May 19 04:46:38.702822 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1757/3603] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:38 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:38.703042 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1846/3603] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:38 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1550 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:38.713442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-03257dd4-4a2d-4916-8269-56cc0a7bd837 req-6d9cb9e3-c854-4284-9970-395e11bf19a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99cc683-67b1-485b-8022-10ac5e94c4ec", "tag": "491e22c5-661b-425b-b029-fec3ede46a66"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:38.715789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-660a113a-e5d8-41b2-bfc1-81b78bd2f377 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:38.717112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-660a113a-e5d8-41b2-bfc1-81b78bd2f377 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:38.737379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-660a113a-e5d8-41b2-bfc1-81b78bd2f377 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.739779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-660a113a-e5d8-41b2-bfc1-81b78bd2f377 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.740621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-660a113a-e5d8-41b2-bfc1-81b78bd2f377 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.757264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-660a113a-e5d8-41b2-bfc1-81b78bd2f377 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.763899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-03257dd4-4a2d-4916-8269-56cc0a7bd837 req-6d9cb9e3-c854-4284-9970-395e11bf19a1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.764924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-03257dd4-4a2d-4916-8269-56cc0a7bd837 req-6d9cb9e3-c854-4284-9970-395e11bf19a1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.788766 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-03257dd4-4a2d-4916-8269-56cc0a7bd837 req-6d9cb9e3-c854-4284-9970-395e11bf19a1 service nova] Creating event network-changed:491e22c5-661b-425b-b029-fec3ede46a66 for instance c99cc683-67b1-485b-8022-10ac5e94c4ec on n-h1-766726-30 May 19 04:46:38.802451 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-03257dd4-4a2d-4916-8269-56cc0a7bd837 req-6d9cb9e3-c854-4284-9970-395e11bf19a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097032 May 19 04:46:38.805945 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1758/3604] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:38.811797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e91207c0-be28-4700-8364-9ba722d94705 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:38.818413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e91207c0-be28-4700-8364-9ba722d94705 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:38.834499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e91207c0-be28-4700-8364-9ba722d94705 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.836340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e91207c0-be28-4700-8364-9ba722d94705 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:38.840438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e91207c0-be28-4700-8364-9ba722d94705 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:38.841223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e91207c0-be28-4700-8364-9ba722d94705 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:39.637771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e91207c0-be28-4700-8364-9ba722d94705 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:39.653201 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e91207c0-be28-4700-8364-9ba722d94705 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1313 microversion: 2.1 time: 0.845519 May 19 04:46:39.654848 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1759/3605] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:38 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1313 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:39.660337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5d457a92-4a7f-4cc9-bbe0-46c162ee5159 req-753aec44-fc74-4e33-bf69-720b87fa0f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:39.677788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-660a113a-e5d8-41b2-bfc1-81b78bd2f377 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:39.687287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5d457a92-4a7f-4cc9-bbe0-46c162ee5159 req-753aec44-fc74-4e33-bf69-720b87fa0f35 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:39.688225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5d457a92-4a7f-4cc9-bbe0-46c162ee5159 req-753aec44-fc74-4e33-bf69-720b87fa0f35 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:39.690789 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-660a113a-e5d8-41b2-bfc1-81b78bd2f377 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1334 microversion: 2.1 time: 0.986339 May 19 04:46:39.696032 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1847/3606] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:38 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1334 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:39.711077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:39.713132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:39.726662 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5d457a92-4a7f-4cc9-bbe0-46c162ee5159 req-753aec44-fc74-4e33-bf69-720b87fa0f35 service nova] Creating event network-changed:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:46:39.728410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:39.729370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:39.731114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:39.731729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:39.740490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5d457a92-4a7f-4cc9-bbe0-46c162ee5159 req-753aec44-fc74-4e33-bf69-720b87fa0f35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084125 May 19 04:46:39.741137 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1760/3607] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:39.753396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8d02ed9c-6baf-4592-9d16-1f73dcdb36eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:39.754170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8d02ed9c-6baf-4592-9d16-1f73dcdb36eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:39.756163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:39.771028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d02ed9c-6baf-4592-9d16-1f73dcdb36eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:39.771817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d02ed9c-6baf-4592-9d16-1f73dcdb36eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:39.774971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d02ed9c-6baf-4592-9d16-1f73dcdb36eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:39.775598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d02ed9c-6baf-4592-9d16-1f73dcdb36eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:39.799961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=17 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:40.264244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:40.289823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:40.291583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:40.292789 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e759225d-3768-4808-b230-2ebad7f2852d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1358 microversion: 2.21 time: 0.595498 May 19 04:46:40.311285 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1848/3608] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:39 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1358 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:40.316366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a833a2ee-2543-455b-85b5-f64d5f6c51b3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:40.316995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a833a2ee-2543-455b-85b5-f64d5f6c51b3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:40.338608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a833a2ee-2543-455b-85b5-f64d5f6c51b3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:40.346132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a833a2ee-2543-455b-85b5-f64d5f6c51b3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:40.346990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a833a2ee-2543-455b-85b5-f64d5f6c51b3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:40.347485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a833a2ee-2543-455b-85b5-f64d5f6c51b3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:40.387396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8d02ed9c-6baf-4592-9d16-1f73dcdb36eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:40.396318 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8d02ed9c-6baf-4592-9d16-1f73dcdb36eb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1680 microversion: 2.1 time: 0.653975 May 19 04:46:40.406283 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1761/3609] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:39 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1680 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:40.412955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7490400f-c69e-450f-bf8b-d8bc78b2f436 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:40.413626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7490400f-c69e-450f-bf8b-d8bc78b2f436 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:40.428928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7490400f-c69e-450f-bf8b-d8bc78b2f436 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:40.429672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7490400f-c69e-450f-bf8b-d8bc78b2f436 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:40.430639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7490400f-c69e-450f-bf8b-d8bc78b2f436 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:40.431249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7490400f-c69e-450f-bf8b-d8bc78b2f436 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:40.873726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a833a2ee-2543-455b-85b5-f64d5f6c51b3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:40.876035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:40.887171 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a833a2ee-2543-455b-85b5-f64d5f6c51b3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1314 microversion: 2.1 time: 0.574475 May 19 04:46:40.888720 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1849/3610] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:40 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:40.894175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a92df021-a5db-4e1b-aa26-736bebc087b8 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:40.901472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a92df021-a5db-4e1b-aa26-736bebc087b8 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:40.919568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a92df021-a5db-4e1b-aa26-736bebc087b8 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:40.920027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a92df021-a5db-4e1b-aa26-736bebc087b8 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:40.920860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a92df021-a5db-4e1b-aa26-736bebc087b8 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:40.921334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a92df021-a5db-4e1b-aa26-736bebc087b8 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:40.954032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7490400f-c69e-450f-bf8b-d8bc78b2f436 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:40.972093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7490400f-c69e-450f-bf8b-d8bc78b2f436 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1550 microversion: 2.1 time: 0.563436 May 19 04:46:40.983749 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1762/3611] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:40 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1550 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:40.991853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-802a5472-7eda-4f25-82b6-a968142e66d4 req-b3e27c0b-dcdc-4351-963a-6f2a4178d892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b11dd9-99d7-422e-9399-37f52d453bee", "name": "network-vif-plugged", "status": "completed", "tag": "3f9d85c4-dcc4-422a-8896-34e1a8644e85"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:41.002611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-802a5472-7eda-4f25-82b6-a968142e66d4 req-b3e27c0b-dcdc-4351-963a-6f2a4178d892 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:41.003293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-802a5472-7eda-4f25-82b6-a968142e66d4 req-b3e27c0b-dcdc-4351-963a-6f2a4178d892 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:41.032152 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-802a5472-7eda-4f25-82b6-a968142e66d4 req-b3e27c0b-dcdc-4351-963a-6f2a4178d892 service nova] Creating event network-vif-plugged:3f9d85c4-dcc4-422a-8896-34e1a8644e85 for instance 27b11dd9-99d7-422e-9399-37f52d453bee on n-h2-766726-30 May 19 04:46:41.042990 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-802a5472-7eda-4f25-82b6-a968142e66d4 req-b3e27c0b-dcdc-4351-963a-6f2a4178d892 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057640 May 19 04:46:41.043920 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1763/3612] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:41.050117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-421cb553-e71a-4bad-9c8d-385c0c14de44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:41.051098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-421cb553-e71a-4bad-9c8d-385c0c14de44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:41.062531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-421cb553-e71a-4bad-9c8d-385c0c14de44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:41.082301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-421cb553-e71a-4bad-9c8d-385c0c14de44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:41.084170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-421cb553-e71a-4bad-9c8d-385c0c14de44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:41.085601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-421cb553-e71a-4bad-9c8d-385c0c14de44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:41.550385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a92df021-a5db-4e1b-aa26-736bebc087b8 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:41.562607 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a92df021-a5db-4e1b-aa26-736bebc087b8 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.672033 May 19 04:46:41.572668 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1850/3613] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:40 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:41.579000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb61f976-a544-4803-8337-1612af4829f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:41.580008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eb61f976-a544-4803-8337-1612af4829f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:41.587971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb61f976-a544-4803-8337-1612af4829f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:41.588804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb61f976-a544-4803-8337-1612af4829f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:41.589866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb61f976-a544-4803-8337-1612af4829f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:41.590525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb61f976-a544-4803-8337-1612af4829f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:41.603547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-421cb553-e71a-4bad-9c8d-385c0c14de44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:41.615218 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-421cb553-e71a-4bad-9c8d-385c0c14de44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1313 microversion: 2.1 time: 0.569821 May 19 04:46:41.616922 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1764/3614] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:41 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:41.630713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:41.631916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:41.638407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:41.640444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:41.641446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:41.642052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:42.509236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:42.523413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eb61f976-a544-4803-8337-1612af4829f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:42.546564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:42.549121 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eb61f976-a544-4803-8337-1612af4829f7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1334 microversion: 2.1 time: 0.974141 May 19 04:46:42.549907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:42.560488 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1851/3615] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:41 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1334 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:42.566406 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0a20d4f8-c8ea-4786-8af3-efee11d798c5 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1358 microversion: 2.21 time: 0.943341 May 19 04:46:42.567024 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1765/3616] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:41 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1358 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:42.587602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27902952-39d0-414c-8c7a-4d830308a047 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:42.588610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27902952-39d0-414c-8c7a-4d830308a047 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:42.591158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b8536ab4-0301-45e4-bcd7-b227c6891e36 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:42.591743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b8536ab4-0301-45e4-bcd7-b227c6891e36 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:42.598755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27902952-39d0-414c-8c7a-4d830308a047 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:42.599214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27902952-39d0-414c-8c7a-4d830308a047 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:42.600749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27902952-39d0-414c-8c7a-4d830308a047 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:42.601211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27902952-39d0-414c-8c7a-4d830308a047 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:42.605877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8536ab4-0301-45e4-bcd7-b227c6891e36 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:42.606467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8536ab4-0301-45e4-bcd7-b227c6891e36 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:42.607254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8536ab4-0301-45e4-bcd7-b227c6891e36 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:42.607694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8536ab4-0301-45e4-bcd7-b227c6891e36 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:42.727584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27902952-39d0-414c-8c7a-4d830308a047 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:42.736102 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27902952-39d0-414c-8c7a-4d830308a047 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 200 len: 1612 microversion: 2.1 time: 0.173204 May 19 04:46:42.737001 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1852/3617] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:42 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 1612 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:42.743437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-01e75d46-2e3d-422d-bcfe-c24bb58a9c93 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:42.744318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-01e75d46-2e3d-422d-bcfe-c24bb58a9c93 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:42.753482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01e75d46-2e3d-422d-bcfe-c24bb58a9c93 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:42.754317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01e75d46-2e3d-422d-bcfe-c24bb58a9c93 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:42.756090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01e75d46-2e3d-422d-bcfe-c24bb58a9c93 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:42.756711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01e75d46-2e3d-422d-bcfe-c24bb58a9c93 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.058162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b8536ab4-0301-45e4-bcd7-b227c6891e36 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:43.073461 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b8536ab4-0301-45e4-bcd7-b227c6891e36 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1314 microversion: 2.1 time: 0.505306 May 19 04:46:43.074066 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1766/3618] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:42 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:43.091017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-efae49ef-f7bb-410c-815f-fd290efccca3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:43.091639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-efae49ef-f7bb-410c-815f-fd290efccca3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:43.106760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efae49ef-f7bb-410c-815f-fd290efccca3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.107210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efae49ef-f7bb-410c-815f-fd290efccca3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.108513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efae49ef-f7bb-410c-815f-fd290efccca3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.108975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efae49ef-f7bb-410c-815f-fd290efccca3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.160499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-01e75d46-2e3d-422d-bcfe-c24bb58a9c93 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:43.174368 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-01e75d46-2e3d-422d-bcfe-c24bb58a9c93 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.432465 May 19 04:46:43.177170 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1853/3619] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:42 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:43.190688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0732993e-960c-4776-8b37-081ff19e8de6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:43.191560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0732993e-960c-4776-8b37-081ff19e8de6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:43.198113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0732993e-960c-4776-8b37-081ff19e8de6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.198784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0732993e-960c-4776-8b37-081ff19e8de6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.199716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0732993e-960c-4776-8b37-081ff19e8de6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.200311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0732993e-960c-4776-8b37-081ff19e8de6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.450460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0732993e-960c-4776-8b37-081ff19e8de6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:43.460193 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0732993e-960c-4776-8b37-081ff19e8de6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1463 microversion: 2.1 time: 0.280787 May 19 04:46:43.462190 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1854/3620] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:43 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1463 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:43.467174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-96864ee2-4176-4832-94de-bba000922610 req-e1f588bb-43ac-4379-9f0d-8dae29aed72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23673e55-0886-4f7e-bbf3-57c29b063597", "name": "network-vif-deleted", "tag": "92204e48-6abb-409f-ab4f-82447be821fa"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:43.477067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-96864ee2-4176-4832-94de-bba000922610 req-e1f588bb-43ac-4379-9f0d-8dae29aed72e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.477785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-96864ee2-4176-4832-94de-bba000922610 req-e1f588bb-43ac-4379-9f0d-8dae29aed72e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.511061 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-96864ee2-4176-4832-94de-bba000922610 req-e1f588bb-43ac-4379-9f0d-8dae29aed72e service nova] Creating event network-vif-deleted:92204e48-6abb-409f-ab4f-82447be821fa for instance 23673e55-0886-4f7e-bbf3-57c29b063597 on n-h1-766726-30 May 19 04:46:43.523602 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-96864ee2-4176-4832-94de-bba000922610 req-e1f588bb-43ac-4379-9f0d-8dae29aed72e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059819 May 19 04:46:43.524808 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1855/3621] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:43.549880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ef2c709e-fe73-446f-aee8-fc64a93d2b28 req-1449f027-0087-4969-b295-2e919717ce8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9c050e-14dc-4fc6-99de-214670f86fd9", "name": "network-vif-plugged", "status": "completed", "tag": "f7f889bc-ab8a-43b0-a341-d72548efd84f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:43.567706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-efae49ef-f7bb-410c-815f-fd290efccca3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:43.578458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-efae49ef-f7bb-410c-815f-fd290efccca3 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.503271 May 19 04:46:43.579043 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1767/3622] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:43 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:43.580657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ef2c709e-fe73-446f-aee8-fc64a93d2b28 req-1449f027-0087-4969-b295-2e919717ce8a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.581639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ef2c709e-fe73-446f-aee8-fc64a93d2b28 req-1449f027-0087-4969-b295-2e919717ce8a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.586231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dc46911d-6753-48e8-a204-891061700628 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:43.586850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dc46911d-6753-48e8-a204-891061700628 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:43.594620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:43.596419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc46911d-6753-48e8-a204-891061700628 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.597033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc46911d-6753-48e8-a204-891061700628 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.598085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc46911d-6753-48e8-a204-891061700628 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.598715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc46911d-6753-48e8-a204-891061700628 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.621690 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ef2c709e-fe73-446f-aee8-fc64a93d2b28 req-1449f027-0087-4969-b295-2e919717ce8a service nova] Creating event network-vif-plugged:f7f889bc-ab8a-43b0-a341-d72548efd84f for instance 9d9c050e-14dc-4fc6-99de-214670f86fd9 on n-h2-766726-30 May 19 04:46:43.634731 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ef2c709e-fe73-446f-aee8-fc64a93d2b28 req-1449f027-0087-4969-b295-2e919717ce8a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107753 May 19 04:46:43.636025 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1856/3623] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:43.644438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d00c3f2-3a1a-41ca-9876-d354761ac9cb tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:43.654092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d00c3f2-3a1a-41ca-9876-d354761ac9cb tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:43.662889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d00c3f2-3a1a-41ca-9876-d354761ac9cb tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.663838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d00c3f2-3a1a-41ca-9876-d354761ac9cb tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.664912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d00c3f2-3a1a-41ca-9876-d354761ac9cb tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.665454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d00c3f2-3a1a-41ca-9876-d354761ac9cb tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.934188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dc46911d-6753-48e8-a204-891061700628 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:43.944096 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dc46911d-6753-48e8-a204-891061700628 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.363178 May 19 04:46:43.959277 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1768/3624] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:43 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:43.968297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:43.972754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d00c3f2-3a1a-41ca-9876-d354761ac9cb tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:43.973146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:43.984583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.985543 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d00c3f2-3a1a-41ca-9876-d354761ac9cb tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1334 microversion: 2.1 time: 0.347919 May 19 04:46:43.986694 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1857/3625] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:43 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1334 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:43.987335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:43.989157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:43.992333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1034377724", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "27b11dd9-99d7-422e-9399-37f52d453bee"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:43.992976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.071820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] validate_networks() for None {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:44.296523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:44.307084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:44.309156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:44.310649 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e4a99555-b62d-4092-8dc9-9d626bed6a6f tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1358 microversion: 2.21 time: 0.349692 May 19 04:46:44.317516 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1769/3626] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:43 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:44.330700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:44.332621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:44.341421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.342179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.343457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.344157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.370609 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 HTTP/1.1 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '23673e55-0886-4f7e-bbf3-57c29b063597'} May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:44.372925 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:44.380519 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:44.380519 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:44.380519 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:44.380519 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:46:44.380519 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:46:44.380519 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:46:44.380519 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:46:44.382840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:46:44.383925 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-55b02cc0-7735-4991-9564-2ed9f0aef1ba tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 404 len: 111 microversion: 2.1 time: 0.064801 May 19 04:46:44.385283 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1770/3627] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:44 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:46:44.391474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da4a0a3f-485b-499e-8cb2-de2fd3a7e4d4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-530649582"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:44.393688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da4a0a3f-485b-499e-8cb2-de2fd3a7e4d4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:44.401310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da4a0a3f-485b-499e-8cb2-de2fd3a7e4d4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.401994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da4a0a3f-485b-499e-8cb2-de2fd3a7e4d4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.403154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da4a0a3f-485b-499e-8cb2-de2fd3a7e4d4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.403810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da4a0a3f-485b-499e-8cb2-de2fd3a7e4d4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.468039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:44.468578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:44.469152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:44.469526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:44.470251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:44.484544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.485009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.485852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.486399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.508080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Getting quotas for project bd1653e189894a0394e865ab24170be7. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:44.517733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Getting quotas for user c736259c32d4429383b6c8d7f57f33a5 and project bd1653e189894a0394e865ab24170be7. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:44.535051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:44.539743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:44.605797 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-45e8c186-bcbc-4fc7-b4d4-100e4a1bc198 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617431 May 19 04:46:44.607478 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1858/3628] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:46:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:46:44.614125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f61a0bb3-2948-4c92-8328-bb27cde54832 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:44.615240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f61a0bb3-2948-4c92-8328-bb27cde54832 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:44.653545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f61a0bb3-2948-4c92-8328-bb27cde54832 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.654125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f61a0bb3-2948-4c92-8328-bb27cde54832 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.656007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f61a0bb3-2948-4c92-8328-bb27cde54832 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.657983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f61a0bb3-2948-4c92-8328-bb27cde54832 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.783443 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da4a0a3f-485b-499e-8cb2-de2fd3a7e4d4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.396338 May 19 04:46:44.802449 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1771/3629] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:46:44 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 19 04:46:44.808229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-886cc0e2-6e74-4481-b908-5734e43d9cda tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '.version_select at 0x7fd3148ad550>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:44.837968 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-886cc0e2-6e74-4481-b908-5734e43d9cda tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588461752" status: 202 len: 0 microversion: 2.1 time: 0.033588 May 19 04:46:44.838430 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1772/3630] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:46:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588461752 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:46:44.851202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bb23c7d3-175e-4e6e-9b5f-12e13b4283d6 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:44.852874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bb23c7d3-175e-4e6e-9b5f-12e13b4283d6 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:44.859809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb23c7d3-175e-4e6e-9b5f-12e13b4283d6 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.860147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb23c7d3-175e-4e6e-9b5f-12e13b4283d6 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.860923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb23c7d3-175e-4e6e-9b5f-12e13b4283d6 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:44.861662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb23c7d3-175e-4e6e-9b5f-12e13b4283d6 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:44.881043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:45.067060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f61a0bb3-2948-4c92-8328-bb27cde54832 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:45.082044 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f61a0bb3-2948-4c92-8328-bb27cde54832 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1314 microversion: 2.1 time: 0.472225 May 19 04:46:45.084029 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1859/3631] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:44 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:45.093135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1cf722e1-ada0-49a7-8f23-3cb545d59741 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:45.104855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1cf722e1-ada0-49a7-8f23-3cb545d59741 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:45.253505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb23c7d3-175e-4e6e-9b5f-12e13b4283d6 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:45.267873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1cf722e1-ada0-49a7-8f23-3cb545d59741 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:45.280125 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bb23c7d3-175e-4e6e-9b5f-12e13b4283d6 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.439669 May 19 04:46:45.280707 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1773/3632] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:44 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:45.283092 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1cf722e1-ada0-49a7-8f23-3cb545d59741 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1214 microversion: 2.1 time: 0.196257 May 19 04:46:45.286120 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1860/3633] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:45 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:45.297395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a46452d8-495f-4c69-a6e3-5c17222605d9 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:45.298368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a46452d8-495f-4c69-a6e3-5c17222605d9 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:45.305929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a46452d8-495f-4c69-a6e3-5c17222605d9 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:45.306646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a46452d8-495f-4c69-a6e3-5c17222605d9 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:45.307796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a46452d8-495f-4c69-a6e3-5c17222605d9 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:45.308396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a46452d8-495f-4c69-a6e3-5c17222605d9 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:45.330494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:45.331111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:45.367552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:45.368010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:45.368836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:45.369285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:45.642664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a46452d8-495f-4c69-a6e3-5c17222605d9 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:45.655784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:45.661388 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a46452d8-495f-4c69-a6e3-5c17222605d9 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1334 microversion: 2.1 time: 0.374798 May 19 04:46:45.662875 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1774/3634] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:45 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1334 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:45.678523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:45.680022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:45.681730 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f87540bf-ae45-41ae-9a81-3c6dfceecf9a tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1358 microversion: 2.21 time: 0.354814 May 19 04:46:45.683224 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1861/3635] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:45 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:45.688762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ff25b150-1b84-467e-9c00-da638860303b req-15f96d4a-2c48-417b-b669-2f8777f7d715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87f9a61-c221-4f63-8224-311f9ea3ddb5", "name": "network-vif-plugged", "status": "completed", "tag": "2170672b-203e-415a-bf08-98be872f15f3"}, {"server_uuid": "a87f9a61-c221-4f63-8224-311f9ea3ddb5", "name": "network-vif-plugged", "status": "completed", "tag": "63f349eb-7fe7-4e19-86d2-ae264048d497"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:45.698894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ff25b150-1b84-467e-9c00-da638860303b req-15f96d4a-2c48-417b-b669-2f8777f7d715 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:45.699697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ff25b150-1b84-467e-9c00-da638860303b req-15f96d4a-2c48-417b-b669-2f8777f7d715 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:45.713274 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ff25b150-1b84-467e-9c00-da638860303b req-15f96d4a-2c48-417b-b669-2f8777f7d715 service nova] Creating event network-vif-plugged:2170672b-203e-415a-bf08-98be872f15f3 for instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 on n-h2-766726-30 May 19 04:46:45.714300 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ff25b150-1b84-467e-9c00-da638860303b req-15f96d4a-2c48-417b-b669-2f8777f7d715 service nova] Creating event network-vif-plugged:63f349eb-7fe7-4e19-86d2-ae264048d497 for instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 on n-h2-766726-30 May 19 04:46:45.739601 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ff25b150-1b84-467e-9c00-da638860303b req-15f96d4a-2c48-417b-b669-2f8777f7d715 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054143 May 19 04:46:45.740605 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1862/3636] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:45.813780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-631712314", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:45.870264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] validate_networks() for [('4f13e0de-8a49-429b-a6a1-196e5191a8c1', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:46.100600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-57c26236-738e-4bbd-aa91-c39239118fdd tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:46.101631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-57c26236-738e-4bbd-aa91-c39239118fdd tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:46.109388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c26236-738e-4bbd-aa91-c39239118fdd tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:46.109829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c26236-738e-4bbd-aa91-c39239118fdd tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:46.110819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c26236-738e-4bbd-aa91-c39239118fdd tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:46.111412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c26236-738e-4bbd-aa91-c39239118fdd tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:46.516097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:46.516514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:46.517016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:46.517456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:46.517878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:46.526587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-57c26236-738e-4bbd-aa91-c39239118fdd tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:46.527332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:46.527779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:46.528563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:46.529245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:46.539415 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-57c26236-738e-4bbd-aa91-c39239118fdd tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1498 microversion: 2.1 time: 0.443334 May 19 04:46:46.540262 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1863/3637] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:46 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1498 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:46.545467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72e98224-20d0-43c4-9935-6059ce5c0e9c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: .version_select at 0x7fd315c2a4c0>, body: {"keypair": {"name": "tempest-keypair-213532087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQjGsESNw8HLqTqTuCbneiHw64pQ0eiRuGgiX9GsXj6iWavam1KtlsTdaSOrcJVEGt+IQXgB3+tKJbUBefqPWCIvCixcZZHwsBCbmt7LqY7pYqB8kGQU8/ppsau9NRV9w=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:46.546784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Getting quotas for project a34f414629e3407b8bf0b90a6e2938ca. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:46.552353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Getting quotas for user 7ee053217f394bf9a08913b7615d3bc9 and project a34f414629e3407b8bf0b90a6e2938ca. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:46.560988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-72e98224-20d0-43c4-9935-6059ce5c0e9c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for project 0db6b7171e3b4a2db160855939246a40. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:46.566593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:46.568902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:46.572470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-72e98224-20d0-43c4-9935-6059ce5c0e9c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for user a651109c72e84cab9e712ad5fbd002b6 and project 0db6b7171e3b4a2db160855939246a40. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:46.610342 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72e98224-20d0-43c4-9935-6059ce5c0e9c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068541 May 19 04:46:46.611698 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1864/3638] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:46:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:46.620425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-36d51387-6505-4486-81c4-20e60b2c4eb2 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:46.621047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-36d51387-6505-4486-81c4-20e60b2c4eb2 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:46.626196 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-efa7e9f5-3a4e-4c2c-8fd5-f6771213e143 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961774 May 19 04:46:46.627046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1775/3639] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:46:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:46:46.631325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9cd42b72-b8f9-4088-8f00-aef7791effdb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:46.631996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9cd42b72-b8f9-4088-8f00-aef7791effdb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:46.634532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36d51387-6505-4486-81c4-20e60b2c4eb2 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:46.635187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36d51387-6505-4486-81c4-20e60b2c4eb2 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:46.636572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36d51387-6505-4486-81c4-20e60b2c4eb2 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:46.637379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36d51387-6505-4486-81c4-20e60b2c4eb2 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:46.638965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9cd42b72-b8f9-4088-8f00-aef7791effdb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:46.639581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9cd42b72-b8f9-4088-8f00-aef7791effdb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:46.640542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9cd42b72-b8f9-4088-8f00-aef7791effdb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:46.641351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9cd42b72-b8f9-4088-8f00-aef7791effdb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:46.794328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9cd42b72-b8f9-4088-8f00-aef7791effdb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:46.803551 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9cd42b72-b8f9-4088-8f00-aef7791effdb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1272 microversion: 2.1 time: 0.174334 May 19 04:46:46.806528 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1776/3640] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:46 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:46.818888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-95748009-d489-4d4d-9908-568cc41986ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:46.820070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-95748009-d489-4d4d-9908-568cc41986ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:47.058424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-95748009-d489-4d4d-9908-568cc41986ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:47.066608 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-95748009-d489-4d4d-9908-568cc41986ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1216 microversion: 2.1 time: 0.257813 May 19 04:46:47.067196 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1777/3641] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:46 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1216 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:47.087687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cee02ed-53d2-4020-98a7-9646292e7b2e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:47.088312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0cee02ed-53d2-4020-98a7-9646292e7b2e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:47.102334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-36d51387-6505-4486-81c4-20e60b2c4eb2 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:47.108501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cee02ed-53d2-4020-98a7-9646292e7b2e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.108981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cee02ed-53d2-4020-98a7-9646292e7b2e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.110294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cee02ed-53d2-4020-98a7-9646292e7b2e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.110949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cee02ed-53d2-4020-98a7-9646292e7b2e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.123174 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-36d51387-6505-4486-81c4-20e60b2c4eb2 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.510110 May 19 04:46:47.133168 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1865/3642] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:46 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:47.133168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:47.133168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:47.147655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:47.157701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.158136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.159110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.159898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.418444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0cee02ed-53d2-4020-98a7-9646292e7b2e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:47.428308 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0cee02ed-53d2-4020-98a7-9646292e7b2e tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1334 microversion: 2.1 time: 0.349864 May 19 04:46:47.429782 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1778/3643] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:47 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1334 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:47.436639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf0c2b20-bf1f-4377-884f-821e54a886f3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:47.437658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf0c2b20-bf1f-4377-884f-821e54a886f3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:47.445620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf0c2b20-bf1f-4377-884f-821e54a886f3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.446874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf0c2b20-bf1f-4377-884f-821e54a886f3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.447934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf0c2b20-bf1f-4377-884f-821e54a886f3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.449194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf0c2b20-bf1f-4377-884f-821e54a886f3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.476923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:47.485059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf0c2b20-bf1f-4377-884f-821e54a886f3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:46:47.486431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:47.487942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:47.489123 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-487c16d2-f9c6-4738-bd07-e1a829319367 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1358 microversion: 2.21 time: 0.361612 May 19 04:46:47.489698 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1866/3644] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:47 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1358 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:47.592516 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf0c2b20-bf1f-4377-884f-821e54a886f3 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 204 len: 0 microversion: 2.1 time: 0.161139 May 19 04:46:47.593250 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1779/3645] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:46:47 2022] DELETE /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:46:47.601427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6f93526-e699-43bd-a865-18f94f312205 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:47.602043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6f93526-e699-43bd-a865-18f94f312205 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:47.608705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6f93526-e699-43bd-a865-18f94f312205 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.609385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6f93526-e699-43bd-a865-18f94f312205 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.610153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6f93526-e699-43bd-a865-18f94f312205 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.610754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6f93526-e699-43bd-a865-18f94f312205 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.766989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-7120ea09-e46a-4dab-81a8-3c06b9a2e622 req-ce168b38-cff3-4981-bc90-736774112df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99cc683-67b1-485b-8022-10ac5e94c4ec", "name": "network-vif-plugged", "status": "completed", "tag": "491e22c5-661b-425b-b029-fec3ede46a66"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:47.781665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7120ea09-e46a-4dab-81a8-3c06b9a2e622 req-ce168b38-cff3-4981-bc90-736774112df0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.782233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7120ea09-e46a-4dab-81a8-3c06b9a2e622 req-ce168b38-cff3-4981-bc90-736774112df0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.800686 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-7120ea09-e46a-4dab-81a8-3c06b9a2e622 req-ce168b38-cff3-4981-bc90-736774112df0 service nova] Creating event network-vif-plugged:491e22c5-661b-425b-b029-fec3ede46a66 for instance c99cc683-67b1-485b-8022-10ac5e94c4ec on n-h1-766726-30 May 19 04:46:47.807057 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-7120ea09-e46a-4dab-81a8-3c06b9a2e622 req-ce168b38-cff3-4981-bc90-736774112df0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045234 May 19 04:46:47.808176 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1780/3646] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:46:47.829172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e6f93526-e699-43bd-a865-18f94f312205 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:47.834569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df0b4ffa-78d3-4011-9755-e6b1a879fd3b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:47.836189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-df0b4ffa-78d3-4011-9755-e6b1a879fd3b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:47.846841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df0b4ffa-78d3-4011-9755-e6b1a879fd3b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.847395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df0b4ffa-78d3-4011-9755-e6b1a879fd3b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.848271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df0b4ffa-78d3-4011-9755-e6b1a879fd3b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:47.849068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df0b4ffa-78d3-4011-9755-e6b1a879fd3b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:47.863089 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6f93526-e699-43bd-a865-18f94f312205 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1504 microversion: 2.1 time: 0.265492 May 19 04:46:47.878218 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1867/3647] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:47 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:48.085921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-21ed93aa-c374-444a-ada7-07d91a32d921 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:48.086813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-21ed93aa-c374-444a-ada7-07d91a32d921 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:48.111358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21ed93aa-c374-444a-ada7-07d91a32d921 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:48.112502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21ed93aa-c374-444a-ada7-07d91a32d921 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:48.113499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21ed93aa-c374-444a-ada7-07d91a32d921 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:48.114106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21ed93aa-c374-444a-ada7-07d91a32d921 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:48.283129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-21ed93aa-c374-444a-ada7-07d91a32d921 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:48.291869 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-21ed93aa-c374-444a-ada7-07d91a32d921 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1286 microversion: 2.1 time: 0.209907 May 19 04:46:48.293070 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1868/3648] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:48 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:48.298088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d23ab1fe-e3dc-4280-aead-0ba848f3a065 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:48.298982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d23ab1fe-e3dc-4280-aead-0ba848f3a065 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:48.305760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d23ab1fe-e3dc-4280-aead-0ba848f3a065 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:48.306469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d23ab1fe-e3dc-4280-aead-0ba848f3a065 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:48.307432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d23ab1fe-e3dc-4280-aead-0ba848f3a065 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:48.308040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d23ab1fe-e3dc-4280-aead-0ba848f3a065 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:48.446139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df0b4ffa-78d3-4011-9755-e6b1a879fd3b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:48.464878 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-df0b4ffa-78d3-4011-9755-e6b1a879fd3b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1314 microversion: 2.1 time: 0.636530 May 19 04:46:48.467115 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1781/3649] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:47 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:48.479309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-83f01ac1-1097-4fd6-9fc3-5afab647d357 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:48.480216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-83f01ac1-1097-4fd6-9fc3-5afab647d357 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:48.487277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83f01ac1-1097-4fd6-9fc3-5afab647d357 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:48.487980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83f01ac1-1097-4fd6-9fc3-5afab647d357 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:48.489311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83f01ac1-1097-4fd6-9fc3-5afab647d357 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:48.489946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83f01ac1-1097-4fd6-9fc3-5afab647d357 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:49.007763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d23ab1fe-e3dc-4280-aead-0ba848f3a065 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:49.016280 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d23ab1fe-e3dc-4280-aead-0ba848f3a065 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.722000 May 19 04:46:49.016902 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1869/3650] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:48 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:49.029293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:49.030483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:49.037636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:49.038094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:49.038947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:49.039581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:49.122430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-83f01ac1-1097-4fd6-9fc3-5afab647d357 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:49.130213 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-83f01ac1-1097-4fd6-9fc3-5afab647d357 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1334 microversion: 2.1 time: 0.657387 May 19 04:46:49.130785 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1782/3651] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:48 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1334 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:49.145582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-290891945", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6598bc70-0651-4830-84b7-60a72f799274"}], "security_groups": [{"name": "tempest-securitygroup--1292984347"}], "key_name": "tempest-keypair-213532087", "user_data": "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:49.505956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] validate_networks() for [('6598bc70-0651-4830-84b7-60a72f799274', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:49.527747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:49.535901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:49.537428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:49.538547 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8e7bccb0-7ea4-42f3-b32e-aab81c799556 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1358 microversion: 2.21 time: 0.520523 May 19 04:46:49.539103 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1870/3652] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:49 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1358 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:49.543732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e2ba467-9e5e-4488-8986-247a7a148629 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:49.544471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6e2ba467-9e5e-4488-8986-247a7a148629 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:49.550609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e2ba467-9e5e-4488-8986-247a7a148629 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:49.551055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e2ba467-9e5e-4488-8986-247a7a148629 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:49.551841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e2ba467-9e5e-4488-8986-247a7a148629 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:49.552278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e2ba467-9e5e-4488-8986-247a7a148629 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:49.556240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:50.068919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6e2ba467-9e5e-4488-8986-247a7a148629 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:50.082145 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e2ba467-9e5e-4488-8986-247a7a148629 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 200 len: 1504 microversion: 2.1 time: 0.541635 May 19 04:46:50.083348 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1871/3653] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:49 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:50.092864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-38c89d7f-0a16-4ff3-bb91-8b6cf3d68ffa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:50.093593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-38c89d7f-0a16-4ff3-bb91-8b6cf3d68ffa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:50.101537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38c89d7f-0a16-4ff3-bb91-8b6cf3d68ffa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:50.105047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38c89d7f-0a16-4ff3-bb91-8b6cf3d68ffa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:50.106484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38c89d7f-0a16-4ff3-bb91-8b6cf3d68ffa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:50.107045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38c89d7f-0a16-4ff3-bb91-8b6cf3d68ffa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:50.242910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-38c89d7f-0a16-4ff3-bb91-8b6cf3d68ffa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:50.260622 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-38c89d7f-0a16-4ff3-bb91-8b6cf3d68ffa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1274 microversion: 2.1 time: 0.175546 May 19 04:46:50.274083 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1872/3654] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:50 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:50.280881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0fa3c730-5a45-4f6a-bfec-cad8941717a8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:50.281849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0fa3c730-5a45-4f6a-bfec-cad8941717a8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:50.290090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0fa3c730-5a45-4f6a-bfec-cad8941717a8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:50.290842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0fa3c730-5a45-4f6a-bfec-cad8941717a8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:50.292160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0fa3c730-5a45-4f6a-bfec-cad8941717a8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:50.292849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0fa3c730-5a45-4f6a-bfec-cad8941717a8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:50.850983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0fa3c730-5a45-4f6a-bfec-cad8941717a8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:50.860382 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0fa3c730-5a45-4f6a-bfec-cad8941717a8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1314 microversion: 2.1 time: 0.584725 May 19 04:46:50.885126 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1873/3655] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:50 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:50.904144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af150895-8a45-49a3-8c8a-6ba7f173b730 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:50.904863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af150895-8a45-49a3-8c8a-6ba7f173b730 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:50.921196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af150895-8a45-49a3-8c8a-6ba7f173b730 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:50.922066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af150895-8a45-49a3-8c8a-6ba7f173b730 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:50.923155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af150895-8a45-49a3-8c8a-6ba7f173b730 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:50.923832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af150895-8a45-49a3-8c8a-6ba7f173b730 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:51.371685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:51.372181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:51.372807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:51.373307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:51.374997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:51.392159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-af150895-8a45-49a3-8c8a-6ba7f173b730 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:51.396438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:51.396905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:51.399071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:51.400080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:51.403754 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af150895-8a45-49a3-8c8a-6ba7f173b730 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.505948 May 19 04:46:51.419971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1874/3656] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:50 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:51.425214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for project 0db6b7171e3b4a2db160855939246a40. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:51.426571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-305fbc2a-af02-4f51-b2d7-ba83a605b976 req-e9aee1cb-16fe-47cb-b95c-b86c168aa063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "name": "network-vif-plugged", "status": "completed", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:51.434389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Getting quotas for user a651109c72e84cab9e712ad5fbd002b6 and project 0db6b7171e3b4a2db160855939246a40. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:51.450182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-305fbc2a-af02-4f51-b2d7-ba83a605b976 req-e9aee1cb-16fe-47cb-b95c-b86c168aa063 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:51.451031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:51.451489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-305fbc2a-af02-4f51-b2d7-ba83a605b976 req-e9aee1cb-16fe-47cb-b95c-b86c168aa063 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:51.455135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:51.465471 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-305fbc2a-af02-4f51-b2d7-ba83a605b976 req-e9aee1cb-16fe-47cb-b95c-b86c168aa063 service nova] Creating event network-vif-plugged:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:46:51.473333 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-305fbc2a-af02-4f51-b2d7-ba83a605b976 req-e9aee1cb-16fe-47cb-b95c-b86c168aa063 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050038 May 19 04:46:51.479350 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1875/3657] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:51.492423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f6acd58-f9fb-49a8-8727-480939171c8a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:51.493753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f6acd58-f9fb-49a8-8727-480939171c8a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:51.502753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f6acd58-f9fb-49a8-8727-480939171c8a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:51.505163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f6acd58-f9fb-49a8-8727-480939171c8a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:51.506291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f6acd58-f9fb-49a8-8727-480939171c8a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:51.506960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f6acd58-f9fb-49a8-8727-480939171c8a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:51.536887 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-091d7a1a-881a-4fd3-8890-25b981840057 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.395676 May 19 04:46:51.544319 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1783/3658] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:46:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:46:51.551080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:51.552003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:51.560812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:51.561605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:51.562599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:51.563495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:52.322532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:52.344222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f6acd58-f9fb-49a8-8727-480939171c8a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:52.353264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:52.355393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:52.361273 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4307cd7c-0c45-442e-be25-900e28e07644 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1551 microversion: 2.21 time: 0.815552 May 19 04:46:52.363950 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f6acd58-f9fb-49a8-8727-480939171c8a tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1670 microversion: 2.1 time: 0.882042 May 19 04:46:52.364559 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1876/3659] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:51 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1670 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:52.365428 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1784/3660] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:51 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1551 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:52.378001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:52.378339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 9d9c050e-14dc-4fc6-99de-214670f86fd9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:52.385603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:52.386064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:52.386849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:52.387292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:52.440176 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] HTTP exception thrown: Instance 9d9c050e-14dc-4fc6-99de-214670f86fd9 could not be found. May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Request method failure captured: May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 HTTP/1.1 May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcuYeIKWdBXb_hzy0-ZPuYVv7PfvxII9LMD8hKtj1aVCFPPNO3woJBYhy9I92fBoYh9ezzeKVoZSx5Px8td58mTKXS7HlnYP6pRTMhtxdlW7d9F6mjpBT1yL1I7De_pc3l97PiM57bKVelmqezOIaSGJnIESoo3nDogd_JDFaSCaV1Y May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a4a8edf1aa5242218363358ec4eda15e May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesActionsTest-59752133 May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a4a8edf1aa5242218363358ec4eda15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4a8edf1aa5242218363358ec4eda15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4a8edf1aa5242218363358ec4eda15e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a4a8edf1aa5242218363358ec4eda15e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesActionsTest-59752133 May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a4a8edf1aa5242218363358ec4eda15e May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesActionsTest-59752133 May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesActionsTest-59752133-project May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7d32564afc494346bdfb99f4729fdacf May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesActionsTest-59752133-project May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 9d9c050e-14dc-4fc6-99de-214670f86fd9 could not be found. May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '9d9c050e-14dc-4fc6-99de-214670f86fd9'} May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9c050e-14dc-4fc6-99de-214670f86fd9 could not be found. May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9c050e-14dc-4fc6-99de-214670f86fd9 could not be found. May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:52.445315 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:52.450724 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:52.450724 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:52.450724 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:46:52.450724 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:46:52.450724 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9c050e-14dc-4fc6-99de-214670f86fd9 could not be found. May 19 04:46:52.450724 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:52.450724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Returning 404 to user: Instance 9d9c050e-14dc-4fc6-99de-214670f86fd9 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:46:52.450724 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4fac9de4-ff09-4286-bc20-aca733310b35 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9" status: 404 len: 111 microversion: 2.1 time: 0.081409 May 19 04:46:52.450724 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1877/3661] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:52 2022] GET /compute/v2.1/servers/9d9c050e-14dc-4fc6-99de-214670f86fd9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:46:52.460762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-26740b16-7aa7-4bdd-bd50-8eecd3a9871c req-b6034ae7-d36b-42f6-9f75-080477b2847a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9c050e-14dc-4fc6-99de-214670f86fd9", "name": "network-vif-deleted", "tag": "f7f889bc-ab8a-43b0-a341-d72548efd84f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:52.480016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-00db5563-e260-4d79-a536-c95acb6a5124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:52.480658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-00db5563-e260-4d79-a536-c95acb6a5124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:52.492803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-26740b16-7aa7-4bdd-bd50-8eecd3a9871c req-b6034ae7-d36b-42f6-9f75-080477b2847a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:52.499168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-26740b16-7aa7-4bdd-bd50-8eecd3a9871c req-b6034ae7-d36b-42f6-9f75-080477b2847a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:52.518910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00db5563-e260-4d79-a536-c95acb6a5124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:52.523622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00db5563-e260-4d79-a536-c95acb6a5124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:52.525806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00db5563-e260-4d79-a536-c95acb6a5124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:52.529039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00db5563-e260-4d79-a536-c95acb6a5124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:52.541681 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-26740b16-7aa7-4bdd-bd50-8eecd3a9871c req-b6034ae7-d36b-42f6-9f75-080477b2847a service nova] Creating event network-vif-deleted:f7f889bc-ab8a-43b0-a341-d72548efd84f for instance 9d9c050e-14dc-4fc6-99de-214670f86fd9 on n-h2-766726-30 May 19 04:46:52.571490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-26740b16-7aa7-4bdd-bd50-8eecd3a9871c req-b6034ae7-d36b-42f6-9f75-080477b2847a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203717 May 19 04:46:52.573750 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1785/3662] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:52.595770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3750a5fe-1c76-43c7-a4ba-86c88da5112c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:52.610093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3750a5fe-1c76-43c7-a4ba-86c88da5112c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:52.626061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3750a5fe-1c76-43c7-a4ba-86c88da5112c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:52.633963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3750a5fe-1c76-43c7-a4ba-86c88da5112c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:52.635837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3750a5fe-1c76-43c7-a4ba-86c88da5112c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:52.636592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3750a5fe-1c76-43c7-a4ba-86c88da5112c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:52.903308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3750a5fe-1c76-43c7-a4ba-86c88da5112c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:52.913805 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3750a5fe-1c76-43c7-a4ba-86c88da5112c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1236 microversion: 2.1 time: 0.336273 May 19 04:46:52.915121 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1786/3663] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:52 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1236 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:52.920973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-492994cb-fba3-42d7-b5e0-5c503e4d06ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:52.922294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-492994cb-fba3-42d7-b5e0-5c503e4d06ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:52.931395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-492994cb-fba3-42d7-b5e0-5c503e4d06ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:52.932529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-492994cb-fba3-42d7-b5e0-5c503e4d06ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:52.933569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-492994cb-fba3-42d7-b5e0-5c503e4d06ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:52.934272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-492994cb-fba3-42d7-b5e0-5c503e4d06ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:53.172303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-00db5563-e260-4d79-a536-c95acb6a5124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:53.184383 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-00db5563-e260-4d79-a536-c95acb6a5124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1316 microversion: 2.1 time: 0.735675 May 19 04:46:53.201097 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1878/3664] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:52 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1316 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:53.215245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fde5d9a9-6cdd-4f73-b56c-9d940db6dfae tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:53.216372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fde5d9a9-6cdd-4f73-b56c-9d940db6dfae tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:53.232547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fde5d9a9-6cdd-4f73-b56c-9d940db6dfae tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:53.233894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fde5d9a9-6cdd-4f73-b56c-9d940db6dfae tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:53.236693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fde5d9a9-6cdd-4f73-b56c-9d940db6dfae tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:53.237440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fde5d9a9-6cdd-4f73-b56c-9d940db6dfae tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:53.274480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fde5d9a9-6cdd-4f73-b56c-9d940db6dfae tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:46:53.376615 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fde5d9a9-6cdd-4f73-b56c-9d940db6dfae tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 204 len: 0 microversion: 2.21 time: 0.172523 May 19 04:46:53.377742 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1879/3665] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:46:53 2022] DELETE /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:46:53.393014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8836ab85-1e51-4380-92ac-d84257770267 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:53.395314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8836ab85-1e51-4380-92ac-d84257770267 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:53.403295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8836ab85-1e51-4380-92ac-d84257770267 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:53.404098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8836ab85-1e51-4380-92ac-d84257770267 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:53.405980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8836ab85-1e51-4380-92ac-d84257770267 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:53.406612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8836ab85-1e51-4380-92ac-d84257770267 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:53.433044 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8836ab85-1e51-4380-92ac-d84257770267 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5/ips" status: 200 len: 180 microversion: 2.1 time: 0.049922 May 19 04:46:53.434414 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1880/3666] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:46:53 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5/ips => generated 180 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:53.442293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c345003b-88cf-434e-8f75-a33068156f7f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:53.443332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c345003b-88cf-434e-8f75-a33068156f7f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:53.450506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c345003b-88cf-434e-8f75-a33068156f7f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:53.451226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c345003b-88cf-434e-8f75-a33068156f7f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:53.452623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c345003b-88cf-434e-8f75-a33068156f7f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:53.453291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c345003b-88cf-434e-8f75-a33068156f7f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:53.477627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-492994cb-fba3-42d7-b5e0-5c503e4d06ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:53.501301 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-492994cb-fba3-42d7-b5e0-5c503e4d06ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1314 microversion: 2.1 time: 0.584420 May 19 04:46:53.502788 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1787/3667] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:52 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:53.509837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-644975583", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "29c7ba19-d9c8-41b4-a51b-9142cc20cc9e"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:53.587088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] validate_networks() for [('29c7ba19-d9c8-41b4-a51b-9142cc20cc9e', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:46:53.686958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c345003b-88cf-434e-8f75-a33068156f7f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:53.694978 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c345003b-88cf-434e-8f75-a33068156f7f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.258707 May 19 04:46:53.707366 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1881/3668] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:53 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:53.712399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:53.713010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:53.725402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:53.726104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:53.727049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:53.727657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:53.978989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:53.988259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:53.989995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:53.991279 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-146de649-28ef-4c69-94cd-1dda50a7205c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1557 microversion: 2.21 time: 0.282785 May 19 04:46:53.992078 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1882/3669] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:53 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1557 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:53.997061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-374afc65-b5bf-47cf-a546-f0df730115c7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:53.997588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-374afc65-b5bf-47cf-a546-f0df730115c7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:54.007391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-374afc65-b5bf-47cf-a546-f0df730115c7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.007391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-374afc65-b5bf-47cf-a546-f0df730115c7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.007391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-374afc65-b5bf-47cf-a546-f0df730115c7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.007391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-374afc65-b5bf-47cf-a546-f0df730115c7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.039378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-374afc65-b5bf-47cf-a546-f0df730115c7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:46:54.109683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:46:54.110347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:46:54.111611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:46:54.112194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:46:54.112853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:46:54.123196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.124683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.125685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.126292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.143093 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-374afc65-b5bf-47cf-a546-f0df730115c7 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 204 len: 0 microversion: 2.1 time: 0.149859 May 19 04:46:54.147638 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1883/3670] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:46:53 2022] DELETE /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:46:54.156063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a319247a-c2c3-4176-a9ae-78c86e414013 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:54.156902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a319247a-c2c3-4176-a9ae-78c86e414013 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:54.163863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a319247a-c2c3-4176-a9ae-78c86e414013 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.171005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a319247a-c2c3-4176-a9ae-78c86e414013 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.171005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a319247a-c2c3-4176-a9ae-78c86e414013 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.171005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a319247a-c2c3-4176-a9ae-78c86e414013 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.182109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Getting quotas for project a4a8edf1aa5242218363358ec4eda15e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:46:54.188357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Getting quotas for user 7d32564afc494346bdfb99f4729fdacf and project a4a8edf1aa5242218363358ec4eda15e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:46:54.206504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:46:54.208921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:46:54.237802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a319247a-c2c3-4176-a9ae-78c86e414013 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:54.249356 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a319247a-c2c3-4176-a9ae-78c86e414013 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1310 microversion: 2.1 time: 0.098557 May 19 04:46:54.250269 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1884/3671] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:54 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:54.264828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-08ab870b-d58b-4f21-a490-52a463d4cba1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:54.265034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-08ab870b-d58b-4f21-a490-52a463d4cba1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:54.268212 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cff7ae69-7780-4130-874c-20c7219e46a1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764081 May 19 04:46:54.271907 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1788/3672] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:46:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:46:54.279899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3443b15c-da12-4508-b98a-773425d6565c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:54.281068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3443b15c-da12-4508-b98a-773425d6565c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:54.292817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3443b15c-da12-4508-b98a-773425d6565c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.293606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3443b15c-da12-4508-b98a-773425d6565c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.294776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3443b15c-da12-4508-b98a-773425d6565c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.296094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3443b15c-da12-4508-b98a-773425d6565c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.304221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08ab870b-d58b-4f21-a490-52a463d4cba1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.304683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08ab870b-d58b-4f21-a490-52a463d4cba1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.305506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08ab870b-d58b-4f21-a490-52a463d4cba1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.305953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08ab870b-d58b-4f21-a490-52a463d4cba1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.501463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:54.662966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08ab870b-d58b-4f21-a490-52a463d4cba1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:54.671411 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-08ab870b-d58b-4f21-a490-52a463d4cba1 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1676 microversion: 2.1 time: 0.410808 May 19 04:46:54.681419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3443b15c-da12-4508-b98a-773425d6565c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:54.688802 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1885/3673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:54 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1676 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:54.694459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a39edfe-9597-4846-8afc-a1dc1045cedb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:54.695068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1a39edfe-9597-4846-8afc-a1dc1045cedb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:54.697422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3443b15c-da12-4508-b98a-773425d6565c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1316 microversion: 2.1 time: 0.422033 May 19 04:46:54.698044 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1789/3674] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:54 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:54.702654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c765d678-6d3d-4e61-98c2-f7454f08754d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:54.703228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c765d678-6d3d-4e61-98c2-f7454f08754d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:54.736703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c765d678-6d3d-4e61-98c2-f7454f08754d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.737278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c765d678-6d3d-4e61-98c2-f7454f08754d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.738132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c765d678-6d3d-4e61-98c2-f7454f08754d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.738703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c765d678-6d3d-4e61-98c2-f7454f08754d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:54.947790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1a39edfe-9597-4846-8afc-a1dc1045cedb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:54.955492 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1a39edfe-9597-4846-8afc-a1dc1045cedb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 200 len: 1213 microversion: 2.1 time: 0.264868 May 19 04:46:54.956934 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1886/3675] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:54 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 1213 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:54.976181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9a0b633e-9cab-43a8-a2ec-146d344b3ba0 req-6b1f9c9f-679b-4b1a-a860-c6249bf8d29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b4bcbe-7d32-413b-930b-07d50a120398", "tag": "f79d1dee-e2d5-4826-9e04-92b13dc0d7c1"}, {"name": "network-changed", "server_uuid": "878aa03f-a366-4d71-b678-1c749fc143c6", "tag": "ba6e6c22-0bce-4292-b1fd-46293b3f4ad6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:54.999030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9a0b633e-9cab-43a8-a2ec-146d344b3ba0 req-6b1f9c9f-679b-4b1a-a860-c6249bf8d29e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:54.999565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9a0b633e-9cab-43a8-a2ec-146d344b3ba0 req-6b1f9c9f-679b-4b1a-a860-c6249bf8d29e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:55.003430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:55.016585 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9a0b633e-9cab-43a8-a2ec-146d344b3ba0 req-6b1f9c9f-679b-4b1a-a860-c6249bf8d29e service nova] Creating event network-changed:f79d1dee-e2d5-4826-9e04-92b13dc0d7c1 for instance 64b4bcbe-7d32-413b-930b-07d50a120398 on n-h2-766726-30 May 19 04:46:55.017106 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9a0b633e-9cab-43a8-a2ec-146d344b3ba0 req-6b1f9c9f-679b-4b1a-a860-c6249bf8d29e service nova] Creating event network-changed:ba6e6c22-0bce-4292-b1fd-46293b3f4ad6 for instance 878aa03f-a366-4d71-b678-1c749fc143c6 on n-h1-766726-30 May 19 04:46:55.031334 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9a0b633e-9cab-43a8-a2ec-146d344b3ba0 req-6b1f9c9f-679b-4b1a-a860-c6249bf8d29e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058796 May 19 04:46:55.031943 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1887/3676] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:55.037918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3462ab60-017a-434a-aec5-6f8d0c47bc4a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:55.038635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3462ab60-017a-434a-aec5-6f8d0c47bc4a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:55.049401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3462ab60-017a-434a-aec5-6f8d0c47bc4a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:55.050161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3462ab60-017a-434a-aec5-6f8d0c47bc4a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:55.051151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3462ab60-017a-434a-aec5-6f8d0c47bc4a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:55.052282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3462ab60-017a-434a-aec5-6f8d0c47bc4a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:55.321658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c765d678-6d3d-4e61-98c2-f7454f08754d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:55.332824 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c765d678-6d3d-4e61-98c2-f7454f08754d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1314 microversion: 2.1 time: 0.633719 May 19 04:46:55.334749 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1790/3677] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:54 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:55.341280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:55.342345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:55.345845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:55.352898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:55.353702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:55.354680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:55.355348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:55.395240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3462ab60-017a-434a-aec5-6f8d0c47bc4a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:55.403701 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3462ab60-017a-434a-aec5-6f8d0c47bc4a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.370432 May 19 04:46:55.413861 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1888/3678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:55 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:55.420308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72dd2588-be27-4468-a05f-4e4110012459 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:55.421560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72dd2588-be27-4468-a05f-4e4110012459 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:55.429202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72dd2588-be27-4468-a05f-4e4110012459 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:55.429995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72dd2588-be27-4468-a05f-4e4110012459 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:55.431000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72dd2588-be27-4468-a05f-4e4110012459 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:55.431651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72dd2588-be27-4468-a05f-4e4110012459 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:55.759272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-72dd2588-be27-4468-a05f-4e4110012459 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:55.772173 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72dd2588-be27-4468-a05f-4e4110012459 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1298 microversion: 2.1 time: 0.354525 May 19 04:46:55.781416 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1889/3679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:55 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1298 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:55.789650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-642fb59f-7c71-4b03-995c-a05d498e8364 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:55.790573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-642fb59f-7c71-4b03-995c-a05d498e8364 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:55.807988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-642fb59f-7c71-4b03-995c-a05d498e8364 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:55.808900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-642fb59f-7c71-4b03-995c-a05d498e8364 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:55.809864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-642fb59f-7c71-4b03-995c-a05d498e8364 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:55.811871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-642fb59f-7c71-4b03-995c-a05d498e8364 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:56.571035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:56.585241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:56.587612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:56.588828 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31fd47fe-4414-42ec-8c38-fe45be77932e tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1557 microversion: 2.21 time: 1.252656 May 19 04:46:56.605904 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1791/3680] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:55 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1557 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:56.611924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30d8756a-d33a-4963-8b80-c2a87d70f9ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:56.613660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-30d8756a-d33a-4963-8b80-c2a87d70f9ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:56.625191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30d8756a-d33a-4963-8b80-c2a87d70f9ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:56.627180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30d8756a-d33a-4963-8b80-c2a87d70f9ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:56.628164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30d8756a-d33a-4963-8b80-c2a87d70f9ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:56.628768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30d8756a-d33a-4963-8b80-c2a87d70f9ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:57.018447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-642fb59f-7c71-4b03-995c-a05d498e8364 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '811f04490bc64b769f287f1f44577a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6633f964e254f10a5209671d95504f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:57.041165 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-642fb59f-7c71-4b03-995c-a05d498e8364 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 200 len: 1676 microversion: 2.1 time: 1.258140 May 19 04:46:57.043170 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1890/3681] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:55 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 1676 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:57.070660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-87e0fa50-5118-4753-847c-778eb6041b98 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:57.077046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-87e0fa50-5118-4753-847c-778eb6041b98 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:57.107475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87e0fa50-5118-4753-847c-778eb6041b98 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:57.109006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87e0fa50-5118-4753-847c-778eb6041b98 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:57.113043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87e0fa50-5118-4753-847c-778eb6041b98 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:57.116214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87e0fa50-5118-4753-847c-778eb6041b98 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:57.659439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-30d8756a-d33a-4963-8b80-c2a87d70f9ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:57.672702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:46:57.690876 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-30d8756a-d33a-4963-8b80-c2a87d70f9ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1316 microversion: 2.1 time: 1.082766 May 19 04:46:57.691450 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1792/3682] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:56 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1316 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:57.717901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f35a86fa-3591-411c-b03b-e283e0bebab9 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:57.718756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f35a86fa-3591-411c-b03b-e283e0bebab9 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:57.742348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f35a86fa-3591-411c-b03b-e283e0bebab9 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:57.742878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f35a86fa-3591-411c-b03b-e283e0bebab9 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:57.747563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f35a86fa-3591-411c-b03b-e283e0bebab9 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:57.748559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f35a86fa-3591-411c-b03b-e283e0bebab9 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:57.763332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87e0fa50-5118-4753-847c-778eb6041b98 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:57.771988 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-87e0fa50-5118-4753-847c-778eb6041b98 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 200 len: 1313 microversion: 2.1 time: 0.725469 May 19 04:46:57.784618 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1891/3683] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:57 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:57.789833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39c557f2-3780-4f94-bce8-b6a632898c03 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:57.790747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39c557f2-3780-4f94-bce8-b6a632898c03 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:57.806590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c557f2-3780-4f94-bce8-b6a632898c03 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:57.807311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c557f2-3780-4f94-bce8-b6a632898c03 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:57.808289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c557f2-3780-4f94-bce8-b6a632898c03 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:57.808899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c557f2-3780-4f94-bce8-b6a632898c03 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.452402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39c557f2-3780-4f94-bce8-b6a632898c03 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:58.472543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f35a86fa-3591-411c-b03b-e283e0bebab9 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:58.484774 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f35a86fa-3591-411c-b03b-e283e0bebab9 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1314 microversion: 2.1 time: 0.791161 May 19 04:46:58.485047 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39c557f2-3780-4f94-bce8-b6a632898c03 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.698662 May 19 04:46:58.485537 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1892/3684] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:57 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:58.500323 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1793/3685] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:57 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1314 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:58.507130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-aaf11f3b-a7d4-4f2f-99b3-3c33dd872d39 req-d720ec7f-47ec-499a-b1b6-2668bda7fe49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87f9a61-c221-4f63-8224-311f9ea3ddb5", "name": "network-vif-deleted", "tag": "2170672b-203e-415a-bf08-98be872f15f3"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:58.511752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8354d713-289b-4fed-ab77-f44b25c6202b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:58.512555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8354d713-289b-4fed-ab77-f44b25c6202b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:58.522223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-aaf11f3b-a7d4-4f2f-99b3-3c33dd872d39 req-d720ec7f-47ec-499a-b1b6-2668bda7fe49 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.522839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-aaf11f3b-a7d4-4f2f-99b3-3c33dd872d39 req-d720ec7f-47ec-499a-b1b6-2668bda7fe49 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.545159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8354d713-289b-4fed-ab77-f44b25c6202b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.545628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8354d713-289b-4fed-ab77-f44b25c6202b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.547937 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-aaf11f3b-a7d4-4f2f-99b3-3c33dd872d39 req-d720ec7f-47ec-499a-b1b6-2668bda7fe49 service nova] Creating event network-vif-deleted:2170672b-203e-415a-bf08-98be872f15f3 for instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 on n-h2-766726-30 May 19 04:46:58.548716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8354d713-289b-4fed-ab77-f44b25c6202b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.550177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8354d713-289b-4fed-ab77-f44b25c6202b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.555267 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-aaf11f3b-a7d4-4f2f-99b3-3c33dd872d39 req-d720ec7f-47ec-499a-b1b6-2668bda7fe49 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052462 May 19 04:46:58.556680 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1794/3686] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:58.566013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:58.578033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:58.594406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.595224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.596663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.597394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.636995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.637613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.638325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lazy-loading 'fault' on Instance uuid c99cc683-67b1-485b-8022-10ac5e94c4ec {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:46:58.705902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8354d713-289b-4fed-ab77-f44b25c6202b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:58.720238 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8354d713-289b-4fed-ab77-f44b25c6202b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1298 microversion: 2.1 time: 0.228509 May 19 04:46:58.730889 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1893/3687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:58 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1298 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:58.734669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:58.737108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9e6efb10-9c69-4202-94d4-52cedfb0b80f req-1ba60ca9-f38a-4c98-8fe2-2ba9c5c53eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99cc683-67b1-485b-8022-10ac5e94c4ec", "name": "network-vif-deleted", "tag": "491e22c5-661b-425b-b029-fec3ede46a66"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:58.747425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9e6efb10-9c69-4202-94d4-52cedfb0b80f req-1ba60ca9-f38a-4c98-8fe2-2ba9c5c53eb2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.748218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9e6efb10-9c69-4202-94d4-52cedfb0b80f req-1ba60ca9-f38a-4c98-8fe2-2ba9c5c53eb2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.762275 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9e6efb10-9c69-4202-94d4-52cedfb0b80f req-1ba60ca9-f38a-4c98-8fe2-2ba9c5c53eb2 service nova] Creating event network-vif-deleted:491e22c5-661b-425b-b029-fec3ede46a66 for instance c99cc683-67b1-485b-8022-10ac5e94c4ec on n-h1-766726-30 May 19 04:46:58.767994 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9e6efb10-9c69-4202-94d4-52cedfb0b80f req-1ba60ca9-f38a-4c98-8fe2-2ba9c5c53eb2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035641 May 19 04:46:58.769716 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1894/3688] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:58.777936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:58.778925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:58.788641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.789458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.790541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.790795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:58.791501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.802717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8046d338db34f599961b3590a96cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9838454858ac42269ad4bc9d4e85aaf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:58.815310 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-476b06d8-bb05-496d-977e-7bfe0e7ed10d tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 200 len: 1348 microversion: 2.21 time: 0.257069 May 19 04:46:58.819309 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1795/3689] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:46:58 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 1348 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:46:58.834219 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] HTTP exception thrown: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:46:58.834819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6563932b-bc35-4fc3-b653-cda26790ec33 req-06d5bcc8-085b-4def-b45c-a8b8db8bfcca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b4bcbe-7d32-413b-930b-07d50a120398", "name": "network-vif-plugged", "status": "completed", "tag": "f79d1dee-e2d5-4826-9e04-92b13dc0d7c1"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Request method failure captured: May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 HTTP/1.1 May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihctGfDia8NUXzCbg7zns3hbxvKaLQWPqxwfNmoBF-8GvHZ5-JD_dGVrcfK4OJM74DzpSRUvvgnV9fyvD5lpZ2pB463jLJri6Wgov_90bmNxwN5ZCkDfddj_eU65lstAThb0dxd7J31kMAVpElDX4uRubALr-1KGcqQY1eGO-POyMc1Y May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: b6633f964e254f10a5209671d95504f1 May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestMultiNic-876429789 May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6633f964e254f10a5209671d95504f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6633f964e254f10a5209671d95504f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestMultiNic-876429789 May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: b6633f964e254f10a5209671d95504f1 May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestMultiNic-876429789 May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestMultiNic-876429789-project May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 811f04490bc64b769f287f1f44577a3b May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestMultiNic-876429789-project May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'a87f9a61-c221-4f63-8224-311f9ea3ddb5'} May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:46:58.842259 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:58.848278 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:46:58.848278 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:46:58.848278 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:46:58.848278 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:46:58.848278 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:46:58.848278 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:46:58.848278 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:46:58.851480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Returning 404 to user: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:46:58.858340 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9f523b80-8681-44d3-bd5f-a60e5d16b3a3 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 404 len: 111 microversion: 2.1 time: 0.083240 May 19 04:46:58.859949 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1895/3690] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:58 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:46:58.868013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-23123cb0-860a-48cd-9b27-7b28d0379edb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:58.869986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-23123cb0-860a-48cd-9b27-7b28d0379edb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:58.875783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6563932b-bc35-4fc3-b653-cda26790ec33 req-06d5bcc8-085b-4def-b45c-a8b8db8bfcca service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.879659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6563932b-bc35-4fc3-b653-cda26790ec33 req-06d5bcc8-085b-4def-b45c-a8b8db8bfcca service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.883762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23123cb0-860a-48cd-9b27-7b28d0379edb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.884373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23123cb0-860a-48cd-9b27-7b28d0379edb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.885840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23123cb0-860a-48cd-9b27-7b28d0379edb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.886935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23123cb0-860a-48cd-9b27-7b28d0379edb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.902600 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6563932b-bc35-4fc3-b653-cda26790ec33 req-06d5bcc8-085b-4def-b45c-a8b8db8bfcca service nova] Creating event network-vif-plugged:f79d1dee-e2d5-4826-9e04-92b13dc0d7c1 for instance 64b4bcbe-7d32-413b-930b-07d50a120398 on n-h2-766726-30 May 19 04:46:58.918149 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6563932b-bc35-4fc3-b653-cda26790ec33 req-06d5bcc8-085b-4def-b45c-a8b8db8bfcca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097106 May 19 04:46:58.919300 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1796/3691] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:46:58.926214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cd90051-f84b-442b-b11f-d39b4e1ea711 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:58.931121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0cd90051-f84b-442b-b11f-d39b4e1ea711 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:58.944094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cd90051-f84b-442b-b11f-d39b4e1ea711 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.954077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cd90051-f84b-442b-b11f-d39b4e1ea711 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:58.955282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cd90051-f84b-442b-b11f-d39b4e1ea711 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:58.955941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cd90051-f84b-442b-b11f-d39b4e1ea711 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:59.765001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23123cb0-860a-48cd-9b27-7b28d0379edb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:59.777767 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-23123cb0-860a-48cd-9b27-7b28d0379edb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1316 microversion: 2.1 time: 0.916467 May 19 04:46:59.778721 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1896/3692] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:58 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1316 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:59.787249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8e403cbf-d95e-4041-a8df-15558eafa1e2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:59.796163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0cd90051-f84b-442b-b11f-d39b4e1ea711 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:46:59.806841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e403cbf-d95e-4041-a8df-15558eafa1e2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:59.813718 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0cd90051-f84b-442b-b11f-d39b4e1ea711 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 200 len: 1313 microversion: 2.1 time: 0.884147 May 19 04:46:59.814656 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1797/3693] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:58 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 1313 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:46:59.819672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-696efd03-c979-4ab6-81d4-635807eb732f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:46:59.820328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-696efd03-c979-4ab6-81d4-635807eb732f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:46:59.824783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e403cbf-d95e-4041-a8df-15558eafa1e2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:59.825196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e403cbf-d95e-4041-a8df-15558eafa1e2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:59.825992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e403cbf-d95e-4041-a8df-15558eafa1e2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:59.826480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e403cbf-d95e-4041-a8df-15558eafa1e2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:59.847507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-696efd03-c979-4ab6-81d4-635807eb732f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:59.848230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-696efd03-c979-4ab6-81d4-635807eb732f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:46:59.881956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-696efd03-c979-4ab6-81d4-635807eb732f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:46:59.884161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-696efd03-c979-4ab6-81d4-635807eb732f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.078265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e403cbf-d95e-4041-a8df-15558eafa1e2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:01.090744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-696efd03-c979-4ab6-81d4-635807eb732f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:01.101560 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8e403cbf-d95e-4041-a8df-15558eafa1e2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1314 microversion: 2.1 time: 1.320923 May 19 04:47:01.113364 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-696efd03-c979-4ab6-81d4-635807eb732f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 1.289374 May 19 04:47:01.117713 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1897/3694] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:59 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1314 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:01.118446 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1798/3695] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:46:59 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:01.125250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:01.128502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:01.129021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2e20984-cd1a-4b42-9636-490f12793ed3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:01.137928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d2e20984-cd1a-4b42-9636-490f12793ed3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:01.141802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.144181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.145825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2e20984-cd1a-4b42-9636-490f12793ed3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.146997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2e20984-cd1a-4b42-9636-490f12793ed3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.147142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.147789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.148267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2e20984-cd1a-4b42-9636-490f12793ed3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.148890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2e20984-cd1a-4b42-9636-490f12793ed3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.178795 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] HTTP exception thrown: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Request method failure captured: May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec HTTP/1.1 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcueRtSJp708cEGIWbnxzSqPpic7cOdXeYlWK1QumkSP4A84r6Xg8vrLso-pHOkwCSurPjHzzkZ0mG8fMu_OKkyXzU5xplc2xDW86eYEJO9hNUPD2OdeVv6qDQ3CMGjnNV9YQ9Tx4NukXkMra01SvZ2ZCNi7R-qg6nqEus30Px6xRY4 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.21 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 9838454858ac42269ad4bc9d4e85aaf3 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-InstanceActionsV221TestJSON-859703887 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-InstanceActionsV221TestJSON-859703887 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 9838454858ac42269ad4bc9d4e85aaf3 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-859703887 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-InstanceActionsV221TestJSON-859703887-project May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c8046d338db34f599961b3590a96cea0 May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-InstanceActionsV221TestJSON-859703887-project May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c99cc683-67b1-485b-8022-10ac5e94c4ec'} May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:01.181864 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Returning 404 to user: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-84b6ca7f-69e6-42ab-ace5-2f58529eb642 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 404 len: 111 microversion: 2.21 time: 0.064210 May 19 04:47:01.187066 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1799/3696] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:47:01 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:47:01.191245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e73004d6-4a2f-4851-9036-a46fc8a93c2e req-f7979670-f5f2-4c10-826c-47308ea1c437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87f9a61-c221-4f63-8224-311f9ea3ddb5", "name": "network-vif-deleted", "tag": "63f349eb-7fe7-4e19-86d2-ae264048d497"}, {"name": "network-changed", "server_uuid": "7633c180-2587-4beb-8826-c5ad40ac2200", "tag": "4419dcb4-15b4-4a86-a4cd-43aaa52c10f3"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:01.201333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e73004d6-4a2f-4851-9036-a46fc8a93c2e req-f7979670-f5f2-4c10-826c-47308ea1c437 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.201876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e73004d6-4a2f-4851-9036-a46fc8a93c2e req-f7979670-f5f2-4c10-826c-47308ea1c437 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.217353 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e73004d6-4a2f-4851-9036-a46fc8a93c2e req-f7979670-f5f2-4c10-826c-47308ea1c437 service nova] Creating event network-vif-deleted:63f349eb-7fe7-4e19-86d2-ae264048d497 for instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 on n-h2-766726-30 May 19 04:47:01.218061 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e73004d6-4a2f-4851-9036-a46fc8a93c2e req-f7979670-f5f2-4c10-826c-47308ea1c437 service nova] Creating event network-changed:4419dcb4-15b4-4a86-a4cd-43aaa52c10f3 for instance 7633c180-2587-4beb-8826-c5ad40ac2200 on n-h1-766726-30 May 19 04:47:01.228015 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e73004d6-4a2f-4851-9036-a46fc8a93c2e req-f7979670-f5f2-4c10-826c-47308ea1c437 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040611 May 19 04:47:01.229108 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1800/3697] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:01.238360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-42059548-5208-442e-8256-4b9a4b07206f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:01.239603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-42059548-5208-442e-8256-4b9a4b07206f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:01.251396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42059548-5208-442e-8256-4b9a4b07206f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.251749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42059548-5208-442e-8256-4b9a4b07206f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.254036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42059548-5208-442e-8256-4b9a4b07206f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.256410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42059548-5208-442e-8256-4b9a4b07206f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.631990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d2e20984-cd1a-4b42-9636-490f12793ed3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:01.645559 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2e20984-cd1a-4b42-9636-490f12793ed3 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1366 microversion: 2.1 time: 0.520953 May 19 04:47:01.648318 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1898/3698] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:01 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1366 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:01.660995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-07edc22e-9383-47a4-875d-7e795ca3538e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:01.662846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-07edc22e-9383-47a4-875d-7e795ca3538e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:01.674679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07edc22e-9383-47a4-875d-7e795ca3538e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.675438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07edc22e-9383-47a4-875d-7e795ca3538e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.676436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07edc22e-9383-47a4-875d-7e795ca3538e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.677128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07edc22e-9383-47a4-875d-7e795ca3538e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.695583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-42059548-5208-442e-8256-4b9a4b07206f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:01.707145 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-42059548-5208-442e-8256-4b9a4b07206f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1316 microversion: 2.1 time: 0.476281 May 19 04:47:01.710507 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1801/3699] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:01 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:01.727175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-77a02cfd-0f5f-4e15-a446-f332b98136bd tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '.version_select at 0x7fd3148485e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:01.728259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-77a02cfd-0f5f-4e15-a446-f332b98136bd tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:01.735126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77a02cfd-0f5f-4e15-a446-f332b98136bd tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.738976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77a02cfd-0f5f-4e15-a446-f332b98136bd tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.740245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77a02cfd-0f5f-4e15-a446-f332b98136bd tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.740885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77a02cfd-0f5f-4e15-a446-f332b98136bd tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.953002 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-77a02cfd-0f5f-4e15-a446-f332b98136bd tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.241336 May 19 04:47:01.953893 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1802/3700] 10.222.0.58 () {60 vars in 1336 bytes} [Thu May 19 04:47:01 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec/os-instance-actions => generated 611 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:47:01.971345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:01.971345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:01.979057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.979568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:01.980366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:01.980809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:02.002219 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] HTTP exception thrown: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Request method failure captured: May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec HTTP/1.1 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcueRtSJp708cEGIWbnxzSqPpic7cOdXeYlWK1QumkSP4A84r6Xg8vrLso-pHOkwCSurPjHzzkZ0mG8fMu_OKkyXzU5xplc2xDW86eYEJO9hNUPD2OdeVv6qDQ3CMGjnNV9YQ9Tx4NukXkMra01SvZ2ZCNi7R-qg6nqEus30Px6xRY4 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.21 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 9838454858ac42269ad4bc9d4e85aaf3 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-InstanceActionsV221TestJSON-859703887 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-InstanceActionsV221TestJSON-859703887 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 9838454858ac42269ad4bc9d4e85aaf3 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-859703887 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-InstanceActionsV221TestJSON-859703887-project May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c8046d338db34f599961b3590a96cea0 May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-InstanceActionsV221TestJSON-859703887-project May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c99cc683-67b1-485b-8022-10ac5e94c4ec'} May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:02.004012 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.008165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Returning 404 to user: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:02.010985 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ad84604-d340-4565-9c7d-219ea5453692 tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 404 len: 111 microversion: 2.21 time: 0.040747 May 19 04:47:02.014418 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1803/3701] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:47:01 2022] DELETE /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:47:02.030470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:02.031513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] [instance: c99cc683-67b1-485b-8022-10ac5e94c4ec] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:02.054289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:02.054749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:02.055539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:02.055978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:02.094411 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] HTTP exception thrown: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Request method failure captured: May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec HTTP/1.1 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcueRtSJp708cEGIWbnxzSqPpic7cOdXeYlWK1QumkSP4A84r6Xg8vrLso-pHOkwCSurPjHzzkZ0mG8fMu_OKkyXzU5xplc2xDW86eYEJO9hNUPD2OdeVv6qDQ3CMGjnNV9YQ9Tx4NukXkMra01SvZ2ZCNi7R-qg6nqEus30Px6xRY4 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.21 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 9838454858ac42269ad4bc9d4e85aaf3 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-InstanceActionsV221TestJSON-859703887 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9838454858ac42269ad4bc9d4e85aaf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-InstanceActionsV221TestJSON-859703887 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 9838454858ac42269ad4bc9d4e85aaf3 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-859703887 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-InstanceActionsV221TestJSON-859703887-project May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c8046d338db34f599961b3590a96cea0 May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-InstanceActionsV221TestJSON-859703887-project May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c99cc683-67b1-485b-8022-10ac5e94c4ec'} May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.096833 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:02.101812 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.101812 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:02.101812 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:02.101812 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:02.101812 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:02.101812 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:02.101812 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. May 19 04:47:02.101812 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:02.108734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] Returning 404 to user: Instance c99cc683-67b1-485b-8022-10ac5e94c4ec could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:02.110178 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-93e905c5-c78f-49f9-b9a7-481e147c654c tempest-InstanceActionsV221TestJSON-859703887 tempest-InstanceActionsV221TestJSON-859703887-project] 10.222.0.58 "GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec" status: 404 len: 111 microversion: 2.21 time: 0.090494 May 19 04:47:02.111574 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1804/3702] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:47:02 2022] GET /compute/v2.1/servers/c99cc683-67b1-485b-8022-10ac5e94c4ec => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:47:02.136778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5add137d-543e-4bb1-8a3f-83cd630f3951 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:02.137429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5add137d-543e-4bb1-8a3f-83cd630f3951 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:02.145549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5add137d-543e-4bb1-8a3f-83cd630f3951 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:02.145919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5add137d-543e-4bb1-8a3f-83cd630f3951 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:02.146704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5add137d-543e-4bb1-8a3f-83cd630f3951 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:02.147152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5add137d-543e-4bb1-8a3f-83cd630f3951 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:02.345543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-07edc22e-9383-47a4-875d-7e795ca3538e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:02.354183 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-07edc22e-9383-47a4-875d-7e795ca3538e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 200 len: 1313 microversion: 2.1 time: 0.702976 May 19 04:47:02.358546 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1899/3703] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:01 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 1313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:02.370559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-56f9e50a-e3e5-4d30-a4c2-556d89d7beb6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:02.371734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-56f9e50a-e3e5-4d30-a4c2-556d89d7beb6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:02.399043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56f9e50a-e3e5-4d30-a4c2-556d89d7beb6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:02.399512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56f9e50a-e3e5-4d30-a4c2-556d89d7beb6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:02.400325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56f9e50a-e3e5-4d30-a4c2-556d89d7beb6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:02.401396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56f9e50a-e3e5-4d30-a4c2-556d89d7beb6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:02.787916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-56f9e50a-e3e5-4d30-a4c2-556d89d7beb6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:02.804526 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-56f9e50a-e3e5-4d30-a4c2-556d89d7beb6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1464 microversion: 2.1 time: 0.442246 May 19 04:47:02.820238 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1900/3704] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:02 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1464 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:02.835913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b3a3d202-1508-437e-b2f0-8d8460ee13db tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:02.838537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b3a3d202-1508-437e-b2f0-8d8460ee13db tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:02.852949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3a3d202-1508-437e-b2f0-8d8460ee13db tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:02.856193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3a3d202-1508-437e-b2f0-8d8460ee13db tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:02.857631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3a3d202-1508-437e-b2f0-8d8460ee13db tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:02.858326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3a3d202-1508-437e-b2f0-8d8460ee13db tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:03.278838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5add137d-543e-4bb1-8a3f-83cd630f3951 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:03.290107 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5add137d-543e-4bb1-8a3f-83cd630f3951 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 1.158522 May 19 04:47:03.296242 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1805/3705] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:02 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:03.305884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ba1706c-49a9-4772-afed-0457b99b2d25 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:03.307026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9ba1706c-49a9-4772-afed-0457b99b2d25 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:03.324565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ba1706c-49a9-4772-afed-0457b99b2d25 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:03.328669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ba1706c-49a9-4772-afed-0457b99b2d25 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:03.329904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ba1706c-49a9-4772-afed-0457b99b2d25 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:03.330557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ba1706c-49a9-4772-afed-0457b99b2d25 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:03.401390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b3a3d202-1508-437e-b2f0-8d8460ee13db tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:03.418247 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b3a3d202-1508-437e-b2f0-8d8460ee13db tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1366 microversion: 2.1 time: 0.595952 May 19 04:47:03.421797 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1901/3706] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:02 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1366 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:03.740483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4d3ba3e-b2b0-4a97-a272-d244fa9867b4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:03.744618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c4d3ba3e-b2b0-4a97-a272-d244fa9867b4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Searching by: {'deleted': False, 'project_id': '20014a46c1174a4da41ed0afb99bcfab'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:03.775710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4d3ba3e-b2b0-4a97-a272-d244fa9867b4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:03.776577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4d3ba3e-b2b0-4a97-a272-d244fa9867b4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:03.778542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4d3ba3e-b2b0-4a97-a272-d244fa9867b4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:03.779763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4d3ba3e-b2b0-4a97-a272-d244fa9867b4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:03.844993 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c4d3ba3e-b2b0-4a97-a272-d244fa9867b4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.421655 May 19 04:47:03.867386 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1902/3707] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:47:03 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:47:03.967746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8710ad73-e8cf-4a92-b09b-c326e14ae51b req-64a28a64-d060-4584-a0c9-792a854cdb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878aa03f-a366-4d71-b678-1c749fc143c6", "name": "network-vif-plugged", "status": "completed", "tag": "ba6e6c22-0bce-4292-b1fd-46293b3f4ad6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:03.981635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8710ad73-e8cf-4a92-b09b-c326e14ae51b req-64a28a64-d060-4584-a0c9-792a854cdb30 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:03.982795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8710ad73-e8cf-4a92-b09b-c326e14ae51b req-64a28a64-d060-4584-a0c9-792a854cdb30 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.010212 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8710ad73-e8cf-4a92-b09b-c326e14ae51b req-64a28a64-d060-4584-a0c9-792a854cdb30 service nova] Creating event network-vif-plugged:ba6e6c22-0bce-4292-b1fd-46293b3f4ad6 for instance 878aa03f-a366-4d71-b678-1c749fc143c6 on n-h1-766726-30 May 19 04:47:04.018140 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8710ad73-e8cf-4a92-b09b-c326e14ae51b req-64a28a64-d060-4584-a0c9-792a854cdb30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147592 May 19 04:47:04.019263 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1903/3708] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:04.027995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a4071ded-f100-4dda-a1f2-8c4823e27fbe tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:04.028723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a4071ded-f100-4dda-a1f2-8c4823e27fbe tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:04.036017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4071ded-f100-4dda-a1f2-8c4823e27fbe tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.036481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4071ded-f100-4dda-a1f2-8c4823e27fbe tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.037441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4071ded-f100-4dda-a1f2-8c4823e27fbe tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.037789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4071ded-f100-4dda-a1f2-8c4823e27fbe tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.048586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9ba1706c-49a9-4772-afed-0457b99b2d25 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:04.059562 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ba1706c-49a9-4772-afed-0457b99b2d25 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1316 microversion: 2.1 time: 0.761373 May 19 04:47:04.060550 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1806/3709] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:03 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1316 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:04.069098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-dfa34390-164a-47ed-95de-ecab25bdf619 req-37509af6-0d85-4586-bd4a-ae4d37b9a1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ca519a-97b0-4dca-9d06-c04dc5b5a42b", "tag": "202be358-9adf-447e-9372-327b229c28d5"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:04.084473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dfa34390-164a-47ed-95de-ecab25bdf619 req-37509af6-0d85-4586-bd4a-ae4d37b9a1b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.085667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dfa34390-164a-47ed-95de-ecab25bdf619 req-37509af6-0d85-4586-bd4a-ae4d37b9a1b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.120650 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-dfa34390-164a-47ed-95de-ecab25bdf619 req-37509af6-0d85-4586-bd4a-ae4d37b9a1b7 service nova] Creating event network-changed:202be358-9adf-447e-9372-327b229c28d5 for instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b on n-h2-766726-30 May 19 04:47:04.129274 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-dfa34390-164a-47ed-95de-ecab25bdf619 req-37509af6-0d85-4586-bd4a-ae4d37b9a1b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067136 May 19 04:47:04.129906 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1807/3710] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:04.139847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:04.140454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:04.149865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:04.165251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.165715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.166517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.166966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.201843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=20 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:04.203376 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] HTTP exception thrown: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Request method failure captured: May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 HTTP/1.1 May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihctGfDia8NUXzCbg7zns3hbxvKaLQWPqxwfNmoBF-8GvHZ5-JD_dGVrcfK4OJM74DzpSRUvvgnV9fyvD5lpZ2pB463jLJri6Wgov_90bmNxwN5ZCkDfddj_eU65lstAThb0dxd7J31kMAVpElDX4uRubALr-1KGcqQY1eGO-POyMc1Y May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: b6633f964e254f10a5209671d95504f1 May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestMultiNic-876429789 May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6633f964e254f10a5209671d95504f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6633f964e254f10a5209671d95504f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestMultiNic-876429789 May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: b6633f964e254f10a5209671d95504f1 May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestMultiNic-876429789 May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestMultiNic-876429789-project May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 811f04490bc64b769f287f1f44577a3b May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestMultiNic-876429789-project May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'a87f9a61-c221-4f63-8224-311f9ea3ddb5'} May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:04.205273 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Returning 404 to user: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29781bc0-ebc7-42fe-b4ec-a3d6d5da9575 tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 404 len: 111 microversion: 2.1 time: 0.075702 May 19 04:47:04.211148 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1808/3711] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:47:04 2022] DELETE /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:47:04.213044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:04.224279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Searching by: {'deleted': False} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:04.231599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.232279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.233142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.233763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.364836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a4071ded-f100-4dda-a1f2-8c4823e27fbe tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:04.375033 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a4071ded-f100-4dda-a1f2-8c4823e27fbe tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 200 len: 1313 microversion: 2.1 time: 0.354443 May 19 04:47:04.380688 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1904/3712] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:04 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:04.423333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:04.425872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a87f9a61-c221-4f63-8224-311f9ea3ddb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:04.441682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:47:04.443010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.443805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.444887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.447858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.468925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] HTTP exception thrown: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Request method failure captured: May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 HTTP/1.1 May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihctGfDia8NUXzCbg7zns3hbxvKaLQWPqxwfNmoBF-8GvHZ5-JD_dGVrcfK4OJM74DzpSRUvvgnV9fyvD5lpZ2pB463jLJri6Wgov_90bmNxwN5ZCkDfddj_eU65lstAThb0dxd7J31kMAVpElDX4uRubALr-1KGcqQY1eGO-POyMc1Y May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: b6633f964e254f10a5209671d95504f1 May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestMultiNic-876429789 May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6633f964e254f10a5209671d95504f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6633f964e254f10a5209671d95504f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestMultiNic-876429789 May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: b6633f964e254f10a5209671d95504f1 May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestMultiNic-876429789 May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestMultiNic-876429789-project May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 811f04490bc64b769f287f1f44577a3b May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestMultiNic-876429789-project May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'a87f9a61-c221-4f63-8224-311f9ea3ddb5'} May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:04.470926 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:04.474987 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:04.474987 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:04.474987 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:04.474987 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:04.474987 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:04.474987 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. May 19 04:47:04.474987 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:04.485770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Returning 404 to user: Instance a87f9a61-c221-4f63-8224-311f9ea3ddb5 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:04.487002 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b111e5a5-978b-4352-a997-97f4a67023ec tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5" status: 404 len: 111 microversion: 2.1 time: 0.102715 May 19 04:47:04.488170 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1905/3713] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:04 2022] GET /compute/v2.1/servers/a87f9a61-c221-4f63-8224-311f9ea3ddb5 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:47:04.495681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a3743219-dfff-4834-9c0a-506610eaab46 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:04.496969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a3743219-dfff-4834-9c0a-506610eaab46 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:04.505600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3743219-dfff-4834-9c0a-506610eaab46 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.506434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3743219-dfff-4834-9c0a-506610eaab46 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.507496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3743219-dfff-4834-9c0a-506610eaab46 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.508159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3743219-dfff-4834-9c0a-506610eaab46 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.584427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.584949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.716561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a3743219-dfff-4834-9c0a-506610eaab46 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:04.726362 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a3743219-dfff-4834-9c0a-506610eaab46 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.236913 May 19 04:47:04.739129 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1906/3714] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:04 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:04.739695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b45c84d-55ca-4095-adee-1704c291cc5b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:04.741903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9b45c84d-55ca-4095-adee-1704c291cc5b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:04.753776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b45c84d-55ca-4095-adee-1704c291cc5b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.758427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b45c84d-55ca-4095-adee-1704c291cc5b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.761054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b45c84d-55ca-4095-adee-1704c291cc5b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:04.762316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b45c84d-55ca-4095-adee-1704c291cc5b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:04.964100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=14 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:05.070534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9b45c84d-55ca-4095-adee-1704c291cc5b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:05.075411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:05.088505 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9b45c84d-55ca-4095-adee-1704c291cc5b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1366 microversion: 2.1 time: 0.357011 May 19 04:47:05.089665 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1907/3715] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:04 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:05.095399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.096164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:05.101644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:05.106053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.106752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.107654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.108174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.126261 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] HTTP exception thrown: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Request method failure captured: May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 HTTP/1.1 May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihctGfDia8NUXzCbg7zns3hbxvKaLQWPqxwfNmoBF-8GvHZ5-JD_dGVrcfK4OJM74DzpSRUvvgnV9fyvD5lpZ2pB463jLJri6Wgov_90bmNxwN5ZCkDfddj_eU65lstAThb0dxd7J31kMAVpElDX4uRubALr-1KGcqQY1eGO-POyMc1Y May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: b6633f964e254f10a5209671d95504f1 May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestMultiNic-876429789 May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6633f964e254f10a5209671d95504f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6633f964e254f10a5209671d95504f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestMultiNic-876429789 May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: b6633f964e254f10a5209671d95504f1 May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestMultiNic-876429789 May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestMultiNic-876429789-project May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 811f04490bc64b769f287f1f44577a3b May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestMultiNic-876429789-project May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'a1d751c7-29c0-4cc6-bb91-206e4ca07016'} May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:05.128112 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Returning 404 to user: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1e9f3eb7-7cc4-4a0f-8c15-575021dea34f tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 404 len: 111 microversion: 2.1 time: 0.039084 May 19 04:47:05.132343 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1908/3716] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:47:05 2022] DELETE /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:47:05.137611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b3b00fd-4ea8-4f83-af37-8ca9e12ecd2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.138100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b3b00fd-4ea8-4f83-af37-8ca9e12ecd2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:05.146789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b3b00fd-4ea8-4f83-af37-8ca9e12ecd2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.147607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b3b00fd-4ea8-4f83-af37-8ca9e12ecd2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.161920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b3b00fd-4ea8-4f83-af37-8ca9e12ecd2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.162394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b3b00fd-4ea8-4f83-af37-8ca9e12ecd2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.192885 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b8f88bc8-4d7c-46c6-8169-e06a1247fb09 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12748 microversion: 2.1 time: 0.984401 May 19 04:47:05.194392 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1809/3717] 10.222.0.58 () {58 vars in 1170 bytes} [Thu May 19 04:47:04 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12748 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:47:05.202125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.202752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] [instance: a1d751c7-29c0-4cc6-bb91-206e4ca07016] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:05.214386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.215118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.216204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.216688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.233324 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] HTTP exception thrown: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Request method failure captured: May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 HTTP/1.1 May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihctGfDia8NUXzCbg7zns3hbxvKaLQWPqxwfNmoBF-8GvHZ5-JD_dGVrcfK4OJM74DzpSRUvvgnV9fyvD5lpZ2pB463jLJri6Wgov_90bmNxwN5ZCkDfddj_eU65lstAThb0dxd7J31kMAVpElDX4uRubALr-1KGcqQY1eGO-POyMc1Y May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: b6633f964e254f10a5209671d95504f1 May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestMultiNic-876429789 May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6633f964e254f10a5209671d95504f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6633f964e254f10a5209671d95504f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6633f964e254f10a5209671d95504f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestMultiNic-876429789 May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: b6633f964e254f10a5209671d95504f1 May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestMultiNic-876429789 May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestMultiNic-876429789-project May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 811f04490bc64b769f287f1f44577a3b May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestMultiNic-876429789-project May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'a1d751c7-29c0-4cc6-bb91-206e4ca07016'} May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:05.234912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] Returning 404 to user: Instance a1d751c7-29c0-4cc6-bb91-206e4ca07016 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-319662ea-323f-49f3-8774-12c343f5095d tempest-ServersTestMultiNic-876429789 tempest-ServersTestMultiNic-876429789-project] 10.222.0.58 "GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016" status: 404 len: 111 microversion: 2.1 time: 0.039821 May 19 04:47:05.238991 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1810/3718] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers/a1d751c7-29c0-4cc6-bb91-206e4ca07016 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:47:05.244349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce717630-7f23-4c44-a798-c3eefd0db83a tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.249432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ce717630-7f23-4c44-a798-c3eefd0db83a tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Searching by: {'deleted': False, 'project_id': '20014a46c1174a4da41ed0afb99bcfab'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:05.255470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce717630-7f23-4c44-a798-c3eefd0db83a tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.256335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce717630-7f23-4c44-a798-c3eefd0db83a tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.257299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce717630-7f23-4c44-a798-c3eefd0db83a tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.257914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce717630-7f23-4c44-a798-c3eefd0db83a tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.296723 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce717630-7f23-4c44-a798-c3eefd0db83a tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?tenant_id=bd1653e189894a0394e865ab24170be7" status: 200 len: 15 microversion: 2.1 time: 0.058476 May 19 04:47:05.307116 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1811/3719] 10.222.0.58 () {58 vars in 1230 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers/detail?tenant_id=bd1653e189894a0394e865ab24170be7 => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:47:05.314394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.319948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Searching by: {'tenant_id': 'bd1653e189894a0394e865ab24170be7', 'deleted': False} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:05.325203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.325861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.328128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.328814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.363432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b3b00fd-4ea8-4f83-af37-8ca9e12ecd2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:05.369464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:47:05.372889 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b3b00fd-4ea8-4f83-af37-8ca9e12ecd2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1316 microversion: 2.1 time: 0.240906 May 19 04:47:05.374925 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1909/3720] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:05.399860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a30b3c1a-041e-4529-a4e7-2de60b8d6d40 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.400731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a30b3c1a-041e-4529-a4e7-2de60b8d6d40 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:05.407442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a30b3c1a-041e-4529-a4e7-2de60b8d6d40 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.407897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a30b3c1a-041e-4529-a4e7-2de60b8d6d40 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.408681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a30b3c1a-041e-4529-a4e7-2de60b8d6d40 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.409144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a30b3c1a-041e-4529-a4e7-2de60b8d6d40 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.423174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.423626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.599532 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c8e442db-6d94-49ca-ab93-914625dbc681 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=bd1653e189894a0394e865ab24170be7" status: 200 len: 4833 microversion: 2.1 time: 0.289438 May 19 04:47:05.600264 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1812/3721] 10.222.0.58 () {58 vars in 1256 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=bd1653e189894a0394e865ab24170be7 => generated 4833 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:05.618407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5747812-3e7e-4283-bf45-edb87081c985 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.624652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b5747812-3e7e-4283-bf45-edb87081c985 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Searching by: {'tenant_id': '20014a46c1174a4da41ed0afb99bcfab', 'deleted': False} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:05.630378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5747812-3e7e-4283-bf45-edb87081c985 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.631054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5747812-3e7e-4283-bf45-edb87081c985 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.632108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5747812-3e7e-4283-bf45-edb87081c985 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.632769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5747812-3e7e-4283-bf45-edb87081c985 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.637067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a30b3c1a-041e-4529-a4e7-2de60b8d6d40 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:05.645464 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a30b3c1a-041e-4529-a4e7-2de60b8d6d40 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 200 len: 1313 microversion: 2.1 time: 0.251411 May 19 04:47:05.646783 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1910/3722] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:47:05.671948 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5747812-3e7e-4283-bf45-edb87081c985 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=20014a46c1174a4da41ed0afb99bcfab" status: 200 len: 15 microversion: 2.1 time: 0.057102 May 19 04:47:05.672605 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1813/3723] 10.222.0.58 () {58 vars in 1256 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=20014a46c1174a4da41ed0afb99bcfab => generated 15 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:47:05.688939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fc402ad-88ac-45e5-bb34-e4e225921145 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.694117 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4fc402ad-88ac-45e5-bb34-e4e225921145 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009210 May 19 04:47:05.694957 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1911/3724] 10.222.0.58 () {58 vars in 1188 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:47:05.711030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-daae7324-aaba-42f2-a814-e8c1c9d24ded tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:05.711998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-daae7324-aaba-42f2-a814-e8c1c9d24ded tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:05.718845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-daae7324-aaba-42f2-a814-e8c1c9d24ded tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.719298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-daae7324-aaba-42f2-a814-e8c1c9d24ded tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.720066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-daae7324-aaba-42f2-a814-e8c1c9d24ded tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.720504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-daae7324-aaba-42f2-a814-e8c1c9d24ded tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.721949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e8a7eba-4b52-47f6-9a7e-165e154339bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.722695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6e8a7eba-4b52-47f6-9a7e-165e154339bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:05.728887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8a7eba-4b52-47f6-9a7e-165e154339bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.729381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8a7eba-4b52-47f6-9a7e-165e154339bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.730321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8a7eba-4b52-47f6-9a7e-165e154339bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.730762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8a7eba-4b52-47f6-9a7e-165e154339bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.755698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:05.802777 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-daae7324-aaba-42f2-a814-e8c1c9d24ded tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action" status: 202 len: 0 microversion: 2.1 time: 0.096300 May 19 04:47:05.803900 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1814/3725] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:05 2022] POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:47:05.809486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-26b63ecc-edf6-4e20-8e32-a0993d77865d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.810346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-26b63ecc-edf6-4e20-8e32-a0993d77865d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:05.817551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26b63ecc-edf6-4e20-8e32-a0993d77865d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.818034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26b63ecc-edf6-4e20-8e32-a0993d77865d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.818833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26b63ecc-edf6-4e20-8e32-a0993d77865d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.819272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26b63ecc-edf6-4e20-8e32-a0993d77865d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.913260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6e8a7eba-4b52-47f6-9a7e-165e154339bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:05.922609 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e8a7eba-4b52-47f6-9a7e-165e154339bc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 0.204209 May 19 04:47:05.923253 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1912/3726] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:05.927969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2a426ae-da13-47a9-ac3a-d96df26c7d44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:05.932047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c2a426ae-da13-47a9-ac3a-d96df26c7d44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:05.932527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c2a426ae-da13-47a9-ac3a-d96df26c7d44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'bd1653e189894a0394e865ab24170be7'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:05.938317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2a426ae-da13-47a9-ac3a-d96df26c7d44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.938808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2a426ae-da13-47a9-ac3a-d96df26c7d44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.939620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2a426ae-da13-47a9-ac3a-d96df26c7d44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:05.940246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2a426ae-da13-47a9-ac3a-d96df26c7d44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:05.973634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-c2a426ae-da13-47a9-ac3a-d96df26c7d44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:47:05.986258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-26b63ecc-edf6-4e20-8e32-a0993d77865d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:06.001382 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-26b63ecc-edf6-4e20-8e32-a0993d77865d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.195178 May 19 04:47:06.006308 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1815/3727] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:06.034601 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2a426ae-da13-47a9-ac3a-d96df26c7d44 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.110268 May 19 04:47:06.040649 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1913/3728] 10.222.0.58 () {58 vars in 1149 bytes} [Thu May 19 04:47:05 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:06.040828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f5470c06-4ce2-492f-b187-a3fceff0da7c req-09842ae0-8cf8-474d-9998-863b66184507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7633c180-2587-4beb-8826-c5ad40ac2200", "name": "network-vif-plugged", "status": "completed", "tag": "4419dcb4-15b4-4a86-a4cd-43aaa52c10f3"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:06.046453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f5470c06-4ce2-492f-b187-a3fceff0da7c req-09842ae0-8cf8-474d-9998-863b66184507 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.046894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f5470c06-4ce2-492f-b187-a3fceff0da7c req-09842ae0-8cf8-474d-9998-863b66184507 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.050382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60a5e95b-c55f-48bf-a0c5-01b1dd721c2c tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:06.053924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60a5e95b-c55f-48bf-a0c5-01b1dd721c2c tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:06.060693 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f5470c06-4ce2-492f-b187-a3fceff0da7c req-09842ae0-8cf8-474d-9998-863b66184507 service nova] Creating event network-vif-plugged:4419dcb4-15b4-4a86-a4cd-43aaa52c10f3 for instance 7633c180-2587-4beb-8826-c5ad40ac2200 on n-h1-766726-30 May 19 04:47:06.060909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60a5e95b-c55f-48bf-a0c5-01b1dd721c2c tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.061366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60a5e95b-c55f-48bf-a0c5-01b1dd721c2c tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.062316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60a5e95b-c55f-48bf-a0c5-01b1dd721c2c tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.063021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60a5e95b-c55f-48bf-a0c5-01b1dd721c2c tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.068349 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f5470c06-4ce2-492f-b187-a3fceff0da7c req-09842ae0-8cf8-474d-9998-863b66184507 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037146 May 19 04:47:06.074254 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1816/3729] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:06.112106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92589de9-315b-4702-8544-3d076a1ec700 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:06.113844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-92589de9-315b-4702-8544-3d076a1ec700 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:06.123810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92589de9-315b-4702-8544-3d076a1ec700 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.125051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92589de9-315b-4702-8544-3d076a1ec700 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.126167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92589de9-315b-4702-8544-3d076a1ec700 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.127225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92589de9-315b-4702-8544-3d076a1ec700 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.186758 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60a5e95b-c55f-48bf-a0c5-01b1dd721c2c tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action" status: 202 len: 0 microversion: 2.1 time: 0.144898 May 19 04:47:06.187412 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1914/3730] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:06 2022] POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:47:06.195529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0a71127-9101-4373-9071-70e9c4f112d4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:06.196512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f0a71127-9101-4373-9071-70e9c4f112d4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:06.203492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a71127-9101-4373-9071-70e9c4f112d4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.203944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a71127-9101-4373-9071-70e9c4f112d4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.204721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a71127-9101-4373-9071-70e9c4f112d4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.205187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a71127-9101-4373-9071-70e9c4f112d4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.735115 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0a71127-9101-4373-9071-70e9c4f112d4 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1616 microversion: 2.1 time: 0.542871 May 19 04:47:06.749453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1915/3731] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:06 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1616 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:47:06.749809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-92589de9-315b-4702-8544-3d076a1ec700 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:06.757554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5fd593d5-9402-4c5c-a874-62f6c718dbfe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:06.758199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5fd593d5-9402-4c5c-a874-62f6c718dbfe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:06.759435 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92589de9-315b-4702-8544-3d076a1ec700 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1366 microversion: 2.1 time: 0.651445 May 19 04:47:06.770798 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1817/3732] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:06 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1366 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:47:06.781328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-391fa59d-85e2-4bb4-90e5-e88b6e62e6eb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:06.781961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-391fa59d-85e2-4bb4-90e5-e88b6e62e6eb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:06.784803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fd593d5-9402-4c5c-a874-62f6c718dbfe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.785282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fd593d5-9402-4c5c-a874-62f6c718dbfe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.786065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fd593d5-9402-4c5c-a874-62f6c718dbfe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.787777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fd593d5-9402-4c5c-a874-62f6c718dbfe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.796177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-391fa59d-85e2-4bb4-90e5-e88b6e62e6eb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.796913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-391fa59d-85e2-4bb4-90e5-e88b6e62e6eb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:06.797905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-391fa59d-85e2-4bb4-90e5-e88b6e62e6eb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:06.801638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-391fa59d-85e2-4bb4-90e5-e88b6e62e6eb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:07.153204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5fd593d5-9402-4c5c-a874-62f6c718dbfe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:07.169560 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5fd593d5-9402-4c5c-a874-62f6c718dbfe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.430291 May 19 04:47:07.173570 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1916/3733] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:06 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:07.178291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-05102625-6ce5-4a3a-80f1-b788ca377164 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:07.178930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-391fa59d-85e2-4bb4-90e5-e88b6e62e6eb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:07.183302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-05102625-6ce5-4a3a-80f1-b788ca377164 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:07.189034 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-391fa59d-85e2-4bb4-90e5-e88b6e62e6eb tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 200 len: 1313 microversion: 2.1 time: 0.416797 May 19 04:47:07.195373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05102625-6ce5-4a3a-80f1-b788ca377164 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:07.195838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05102625-6ce5-4a3a-80f1-b788ca377164 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:07.196612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05102625-6ce5-4a3a-80f1-b788ca377164 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:07.197049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05102625-6ce5-4a3a-80f1-b788ca377164 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:07.199986 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1818/3734] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:06 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:07.205116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6bd336cc-9305-4265-acf2-a88e08284986 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:07.205958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6bd336cc-9305-4265-acf2-a88e08284986 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:07.216353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6bd336cc-9305-4265-acf2-a88e08284986 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:07.217655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6bd336cc-9305-4265-acf2-a88e08284986 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:07.220636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6bd336cc-9305-4265-acf2-a88e08284986 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:07.221297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6bd336cc-9305-4265-acf2-a88e08284986 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:07.545059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6bd336cc-9305-4265-acf2-a88e08284986 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:07.548519 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-05102625-6ce5-4a3a-80f1-b788ca377164 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1616 microversion: 2.1 time: 0.373660 May 19 04:47:07.549475 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1917/3735] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:07 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1616 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:07.554571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5d7c78e7-f73a-4b9e-8746-531e8ce2374f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:07.555508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5d7c78e7-f73a-4b9e-8746-531e8ce2374f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:07.555891 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6bd336cc-9305-4265-acf2-a88e08284986 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.354734 May 19 04:47:07.556745 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1819/3736] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:07 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:07.563580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d7c78e7-f73a-4b9e-8746-531e8ce2374f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:07.564376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d7c78e7-f73a-4b9e-8746-531e8ce2374f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:07.564857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-716400539", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:07.565703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d7c78e7-f73a-4b9e-8746-531e8ce2374f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:07.566386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d7c78e7-f73a-4b9e-8746-531e8ce2374f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:07.624582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] validate_networks() for [('4f13e0de-8a49-429b-a6a1-196e5191a8c1', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:47:07.806605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d7c78e7-f73a-4b9e-8746-531e8ce2374f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:07.815098 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5d7c78e7-f73a-4b9e-8746-531e8ce2374f tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1524 microversion: 2.1 time: 0.264300 May 19 04:47:07.815694 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1918/3737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:07 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1524 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:07.961613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1125150857", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "d10cb2e4-7049-47dc-8c4b-92fd0edcd287"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:08.019684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] validate_networks() for [('d10cb2e4-7049-47dc-8c4b-92fd0edcd287', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:47:08.444429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:47:08.444994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:47:08.445353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:47:08.445763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:47:08.446865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:47:08.457263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:08.458006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:08.458798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:08.459405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:08.484153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Getting quotas for project a34f414629e3407b8bf0b90a6e2938ca. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:47:08.490847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Getting quotas for user 7ee053217f394bf9a08913b7615d3bc9 and project a34f414629e3407b8bf0b90a6e2938ca. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:47:08.506382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:47:08.509788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:47:08.563241 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97bfd844-7779-4867-8ef0-7f99167a0924 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004440 May 19 04:47:08.564267 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1820/3738] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:47:08.570018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-869993ad-4020-4a84-8c5f-dd4008476a35 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:08.576135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-869993ad-4020-4a84-8c5f-dd4008476a35 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Searching by: {'host': 'n-h2-766726-30', 'deleted': False} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:08.588503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-869993ad-4020-4a84-8c5f-dd4008476a35 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:08.588957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-869993ad-4020-4a84-8c5f-dd4008476a35 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:08.589787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-869993ad-4020-4a84-8c5f-dd4008476a35 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:08.590225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-869993ad-4020-4a84-8c5f-dd4008476a35 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:08.701589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-869993ad-4020-4a84-8c5f-dd4008476a35 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:47:08.766870 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-869993ad-4020-4a84-8c5f-dd4008476a35 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=n-h2-766726-30&all_tenants=1" status: 200 len: 1320 microversion: 2.1 time: 0.201264 May 19 04:47:08.767471 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1821/3739] 10.222.0.58 () {58 vars in 1191 bytes} [Thu May 19 04:47:08 2022] GET /compute/v2.1/servers?host=n-h2-766726-30&all_tenants=1 => generated 1320 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:08.772555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24794c4d-5d2a-4dac-9d63-b01a6a1d735f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1902689207"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:08.773917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-24794c4d-5d2a-4dac-9d63-b01a6a1d735f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:08.781514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24794c4d-5d2a-4dac-9d63-b01a6a1d735f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:08.781887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24794c4d-5d2a-4dac-9d63-b01a6a1d735f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:08.782661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24794c4d-5d2a-4dac-9d63-b01a6a1d735f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:08.783223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24794c4d-5d2a-4dac-9d63-b01a6a1d735f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:08.792325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:47:08.793387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:47:08.795687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:47:08.796331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:47:08.796944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:47:08.810446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:08.820614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:08.822919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:08.823592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:08.846107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Getting quotas for project d1a970b4e5cb4fbf83273d687ea30472. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:47:08.851993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Getting quotas for user 582fe0e0beba4435b01b21db35d384af and project d1a970b4e5cb4fbf83273d687ea30472. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:47:08.867562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Going to run 2 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:47:08.870373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:47:08.914893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:47:09.013748 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d941aeff-8e38-41c4-b19b-5682530a4d37 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.196730 May 19 04:47:09.019140 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1919/3740] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:47:09.020377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a0cb54c-217e-42bc-9536-f8cb7adcc632 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:09.021164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a0cb54c-217e-42bc-9536-f8cb7adcc632 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:09.030158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a0cb54c-217e-42bc-9536-f8cb7adcc632 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.030760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a0cb54c-217e-42bc-9536-f8cb7adcc632 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.031943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a0cb54c-217e-42bc-9536-f8cb7adcc632 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.032606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a0cb54c-217e-42bc-9536-f8cb7adcc632 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.190262 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-24794c4d-5d2a-4dac-9d63-b01a6a1d735f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.420391 May 19 04:47:09.197280 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1822/3741] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:08 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 19 04:47:09.208199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69ad7e87-9e83-43fd-ac4c-de3e25734ef1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:09.209750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-69ad7e87-9e83-43fd-ac4c-de3e25734ef1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:09.223929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69ad7e87-9e83-43fd-ac4c-de3e25734ef1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.225136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69ad7e87-9e83-43fd-ac4c-de3e25734ef1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.226029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69ad7e87-9e83-43fd-ac4c-de3e25734ef1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.228876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69ad7e87-9e83-43fd-ac4c-de3e25734ef1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.455338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a0cb54c-217e-42bc-9536-f8cb7adcc632 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:09.463603 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a0cb54c-217e-42bc-9536-f8cb7adcc632 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1366 microversion: 2.1 time: 0.447536 May 19 04:47:09.464185 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1920/3742] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:09 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:09.478538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ede977f8-b05b-43a5-85b2-9007bc666828 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:09.479254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ede977f8-b05b-43a5-85b2-9007bc666828 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:09.486613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ede977f8-b05b-43a5-85b2-9007bc666828 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.487069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ede977f8-b05b-43a5-85b2-9007bc666828 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.487871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ede977f8-b05b-43a5-85b2-9007bc666828 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.488313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ede977f8-b05b-43a5-85b2-9007bc666828 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.552110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69ad7e87-9e83-43fd-ac4c-de3e25734ef1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:09.561823 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69ad7e87-9e83-43fd-ac4c-de3e25734ef1 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 200 len: 1496 microversion: 2.1 time: 0.362650 May 19 04:47:09.562982 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1823/3743] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:09 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 1496 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:09.572766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-45960c22-74f1-43da-9ae8-48f7ccacff3f tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:09.589385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-45960c22-74f1-43da-9ae8-48f7ccacff3f tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:09.616183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45960c22-74f1-43da-9ae8-48f7ccacff3f tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.624897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45960c22-74f1-43da-9ae8-48f7ccacff3f tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.625962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45960c22-74f1-43da-9ae8-48f7ccacff3f tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.626422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45960c22-74f1-43da-9ae8-48f7ccacff3f tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.659566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ede977f8-b05b-43a5-85b2-9007bc666828 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:09.667541 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ede977f8-b05b-43a5-85b2-9007bc666828 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1212 microversion: 2.1 time: 0.202154 May 19 04:47:09.668156 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1921/3744] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:09 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1212 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:09.693944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64c9467b-0577-493f-8104-4d0b8eea0425 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:09.694532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64c9467b-0577-493f-8104-4d0b8eea0425 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:09.703710 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-45960c22-74f1-43da-9ae8-48f7ccacff3f tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.139319 May 19 04:47:09.704570 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1824/3745] 10.222.0.58 () {58 vars in 1195 bytes} [Thu May 19 04:47:09 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:47:09.710607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64c9467b-0577-493f-8104-4d0b8eea0425 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.711280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64c9467b-0577-493f-8104-4d0b8eea0425 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.712251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64c9467b-0577-493f-8104-4d0b8eea0425 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.717720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c339f026-b702-4d4c-9e5f-6c4e27a6f5b7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:09.721628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c339f026-b702-4d4c-9e5f-6c4e27a6f5b7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:09.722369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c339f026-b702-4d4c-9e5f-6c4e27a6f5b7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Searching by: {'deleted': False, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:09.724053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64c9467b-0577-493f-8104-4d0b8eea0425 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.755500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c339f026-b702-4d4c-9e5f-6c4e27a6f5b7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.756202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c339f026-b702-4d4c-9e5f-6c4e27a6f5b7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.757026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c339f026-b702-4d4c-9e5f-6c4e27a6f5b7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.761696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c339f026-b702-4d4c-9e5f-6c4e27a6f5b7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.808969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-c339f026-b702-4d4c-9e5f-6c4e27a6f5b7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:47:09.860528 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c339f026-b702-4d4c-9e5f-6c4e27a6f5b7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.154321 May 19 04:47:09.863574 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1825/3746] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:47:09 2022] GET /compute/v2.1/servers => generated 677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:09.875642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c0ba29e5-78ca-4b25-bd2f-dfef606537ae tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:09.876549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c0ba29e5-78ca-4b25-bd2f-dfef606537ae tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:09.888644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0ba29e5-78ca-4b25-bd2f-dfef606537ae tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.897459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0ba29e5-78ca-4b25-bd2f-dfef606537ae tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:09.898323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0ba29e5-78ca-4b25-bd2f-dfef606537ae tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:09.898744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0ba29e5-78ca-4b25-bd2f-dfef606537ae tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:10.136143 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c0ba29e5-78ca-4b25-bd2f-dfef606537ae tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action" status: 202 len: 0 microversion: 2.1 time: 0.270506 May 19 04:47:10.146027 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1826/3747] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:09 2022] POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:47:10.174314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce568c67-910d-4bf8-9599-b8cc8937d877 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:10.175030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ce568c67-910d-4bf8-9599-b8cc8937d877 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:10.194670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce568c67-910d-4bf8-9599-b8cc8937d877 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:10.195233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce568c67-910d-4bf8-9599-b8cc8937d877 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:10.212060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce568c67-910d-4bf8-9599-b8cc8937d877 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:10.212581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce568c67-910d-4bf8-9599-b8cc8937d877 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:10.733850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ce568c67-910d-4bf8-9599-b8cc8937d877 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:10.743849 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce568c67-910d-4bf8-9599-b8cc8937d877 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1224 microversion: 2.1 time: 0.596591 May 19 04:47:10.748739 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1827/3748] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:10 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1224 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:10.763109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:10.766108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:10.775625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:10.776438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:10.777692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:10.778437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:10.872150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-64c9467b-0577-493f-8104-4d0b8eea0425 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:10.891924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:10.900375 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64c9467b-0577-493f-8104-4d0b8eea0425 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1504 microversion: 2.1 time: 1.210998 May 19 04:47:10.901404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:10.902120 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1922/3749] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:09 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1504 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:10.912796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:47:10.917677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a620a51-3f48-4271-ab0a-b3ca4d75535e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:10.918491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a620a51-3f48-4271-ab0a-b3ca4d75535e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:10.923628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:47:10.924335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:47:10.924922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:47:10.926178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:47:10.934885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a620a51-3f48-4271-ab0a-b3ca4d75535e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:10.937040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a620a51-3f48-4271-ab0a-b3ca4d75535e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:10.940439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a620a51-3f48-4271-ab0a-b3ca4d75535e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:10.941113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a620a51-3f48-4271-ab0a-b3ca4d75535e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:10.985761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a620a51-3f48-4271-ab0a-b3ca4d75535e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:47:11.025946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:11.056059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:11.099823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:11.100711 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a620a51-3f48-4271-ab0a-b3ca4d75535e tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 204 len: 0 microversion: 2.1 time: 0.195407 May 19 04:47:11.102502 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1923/3750] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:47:10 2022] DELETE /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:47:11.106232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:11.108770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:11.109291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:11.110602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4db4ff76-d455-4d99-a6e1-e16b7a31cd89 req-ebf2732f-abda-4ae4-a34b-605a79267d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ca519a-97b0-4dca-9d06-c04dc5b5a42b", "name": "network-vif-plugged", "status": "completed", "tag": "202be358-9adf-447e-9372-327b229c28d5"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:11.123190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4db4ff76-d455-4d99-a6e1-e16b7a31cd89 req-ebf2732f-abda-4ae4-a34b-605a79267d5a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:11.124687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4db4ff76-d455-4d99-a6e1-e16b7a31cd89 req-ebf2732f-abda-4ae4-a34b-605a79267d5a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:11.139872 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4db4ff76-d455-4d99-a6e1-e16b7a31cd89 req-ebf2732f-abda-4ae4-a34b-605a79267d5a service nova] Creating event network-vif-plugged:202be358-9adf-447e-9372-327b229c28d5 for instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b on n-h2-766726-30 May 19 04:47:11.147621 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4db4ff76-d455-4d99-a6e1-e16b7a31cd89 req-ebf2732f-abda-4ae4-a34b-605a79267d5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043468 May 19 04:47:11.153239 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1924/3751] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:11.166371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c2b9476-8b6c-4024-b437-8a23ae835ad6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:11.168784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6c2b9476-8b6c-4024-b437-8a23ae835ad6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:11.187328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c2b9476-8b6c-4024-b437-8a23ae835ad6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:11.187763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c2b9476-8b6c-4024-b437-8a23ae835ad6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:11.188596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c2b9476-8b6c-4024-b437-8a23ae835ad6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:11.192533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c2b9476-8b6c-4024-b437-8a23ae835ad6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:11.220613 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b951d540-3589-4cd7-bb81-84c633c31608 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action" status: 202 len: 1067 microversion: 2.1 time: 0.461954 May 19 04:47:11.224578 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1828/3752] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:10 2022] POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action => generated 1067 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 19 04:47:11.250775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa265946-404c-4339-978e-6f7131a39949 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:11.251474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa265946-404c-4339-978e-6f7131a39949 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:11.267271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa265946-404c-4339-978e-6f7131a39949 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:11.271011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa265946-404c-4339-978e-6f7131a39949 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:11.291287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa265946-404c-4339-978e-6f7131a39949 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:11.294540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa265946-404c-4339-978e-6f7131a39949 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:11.470986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fa265946-404c-4339-978e-6f7131a39949 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:11.486130 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fa265946-404c-4339-978e-6f7131a39949 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1274 microversion: 2.1 time: 0.256151 May 19 04:47:11.486729 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1829/3753] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:11 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:11.491555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-57e8d6f9-54ac-4cf6-9b1e-780ae80c5f15 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Action: 'create', calling method: .version_select at 0x7fd314880310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1639363277", "description": "tempest-description-1045222568"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:11.672931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6c2b9476-8b6c-4024-b437-8a23ae835ad6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:11.697492 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6c2b9476-8b6c-4024-b437-8a23ae835ad6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1366 microversion: 2.1 time: 0.542018 May 19 04:47:11.698301 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1925/3754] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:11 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1366 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:11.722055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-333008ff-2c59-4b8a-8f9c-57d6c2457c57 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:11.723334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-333008ff-2c59-4b8a-8f9c-57d6c2457c57 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:11.733189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-333008ff-2c59-4b8a-8f9c-57d6c2457c57 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:11.733924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-333008ff-2c59-4b8a-8f9c-57d6c2457c57 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:11.735609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-333008ff-2c59-4b8a-8f9c-57d6c2457c57 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:11.736206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-333008ff-2c59-4b8a-8f9c-57d6c2457c57 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:12.003679 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-57e8d6f9-54ac-4cf6-9b1e-780ae80c5f15 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.514887 May 19 04:47:12.015125 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1830/3755] 10.222.0.58 () {60 vars in 1179 bytes} [Thu May 19 04:47:11 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:12.020610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed5603d9-2984-4bba-9ebd-912488118a6b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:12.022074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed5603d9-2984-4bba-9ebd-912488118a6b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:12.031321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5603d9-2984-4bba-9ebd-912488118a6b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:12.032250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5603d9-2984-4bba-9ebd-912488118a6b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:12.035170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5603d9-2984-4bba-9ebd-912488118a6b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:12.036142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5603d9-2984-4bba-9ebd-912488118a6b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:12.075495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-333008ff-2c59-4b8a-8f9c-57d6c2457c57 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d32564afc494346bdfb99f4729fdacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a8edf1aa5242218363358ec4eda15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:12.089282 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-333008ff-2c59-4b8a-8f9c-57d6c2457c57 tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 200 len: 1502 microversion: 2.1 time: 0.389276 May 19 04:47:12.093420 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1926/3756] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:11 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 1502 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:12.103179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e12a6c7-c0da-4fc6-bce2-a7c94952559b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:12.104909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5e12a6c7-c0da-4fc6-bce2-a7c94952559b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:12.123788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e12a6c7-c0da-4fc6-bce2-a7c94952559b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:12.124258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e12a6c7-c0da-4fc6-bce2-a7c94952559b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:12.126752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e12a6c7-c0da-4fc6-bce2-a7c94952559b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:12.127403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e12a6c7-c0da-4fc6-bce2-a7c94952559b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:12.288372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e12a6c7-c0da-4fc6-bce2-a7c94952559b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:12.299214 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e12a6c7-c0da-4fc6-bce2-a7c94952559b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1280 microversion: 2.1 time: 0.204475 May 19 04:47:12.312563 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1927/3757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:12 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:12.318443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d6003b3-0d10-49ab-8e55-ef678ca71bc4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1639363277"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:12.319559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d6003b3-0d10-49ab-8e55-ef678ca71bc4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:12.338699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6003b3-0d10-49ab-8e55-ef678ca71bc4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:12.340975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6003b3-0d10-49ab-8e55-ef678ca71bc4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:12.342234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6003b3-0d10-49ab-8e55-ef678ca71bc4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:12.344223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d6003b3-0d10-49ab-8e55-ef678ca71bc4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:12.514422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed5603d9-2984-4bba-9ebd-912488118a6b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:12.530956 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed5603d9-2984-4bba-9ebd-912488118a6b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1471 microversion: 2.1 time: 0.514526 May 19 04:47:12.531843 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1831/3758] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:12 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1471 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:12.536766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc680416-cc2c-4669-86cf-6d203a5c9a83 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:12.538726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fc680416-cc2c-4669-86cf-6d203a5c9a83 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:12.550517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc680416-cc2c-4669-86cf-6d203a5c9a83 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:12.550979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc680416-cc2c-4669-86cf-6d203a5c9a83 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:12.551772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc680416-cc2c-4669-86cf-6d203a5c9a83 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:12.552222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc680416-cc2c-4669-86cf-6d203a5c9a83 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:12.916460 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.network.security_group_api [None req-6d6003b3-0d10-49ab-8e55-ef678ca71bc4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Adding security group cb6606a4-1c67-4694-880d-c935f1126b0d to port b5d2cce6-de74-48ec-83dd-509de85ddfaa May 19 04:47:13.184758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fc680416-cc2c-4669-86cf-6d203a5c9a83 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:13.201802 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc680416-cc2c-4669-86cf-6d203a5c9a83 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1316 microversion: 2.1 time: 0.667951 May 19 04:47:13.212921 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1832/3759] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:12 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:13.219334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2991a635-8672-4714-8f00-70fdf125bbca tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:13.219964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2991a635-8672-4714-8f00-70fdf125bbca tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:13.226616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2991a635-8672-4714-8f00-70fdf125bbca tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:13.227070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2991a635-8672-4714-8f00-70fdf125bbca tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:13.227842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2991a635-8672-4714-8f00-70fdf125bbca tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:13.228278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2991a635-8672-4714-8f00-70fdf125bbca tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:14.093365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2991a635-8672-4714-8f00-70fdf125bbca tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:14.105690 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2991a635-8672-4714-8f00-70fdf125bbca tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1556 microversion: 2.1 time: 0.891414 May 19 04:47:14.106289 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1833/3760] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:13 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1556 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:14.113784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:14.114792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] [instance: 7633c180-2587-4beb-8826-c5ad40ac2200] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:14.121601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:14.122271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:14.123755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:14.124350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:14.143120 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] HTTP exception thrown: Instance 7633c180-2587-4beb-8826-c5ad40ac2200 could not be found. May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Request method failure captured: May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 HTTP/1.1 May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcuYeIKWdBXb_hzy0-ZPuYVv7PfvxII9LMD8hKtj1aVCFPPNO3woJBYhy9I92fBoYh9ezzeKVoZSx5Px8td58mTKXS7HlnYP6pRTMhtxdlW7d9F6mjpBT1yL1I7De_pc3l97PiM57bKVelmqezOIaSGJnIESoo3nDogd_JDFaSCaV1Y May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a4a8edf1aa5242218363358ec4eda15e May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-VolumesActionsTest-59752133 May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a4a8edf1aa5242218363358ec4eda15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4a8edf1aa5242218363358ec4eda15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4a8edf1aa5242218363358ec4eda15e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a4a8edf1aa5242218363358ec4eda15e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-VolumesActionsTest-59752133 May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a4a8edf1aa5242218363358ec4eda15e May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-VolumesActionsTest-59752133 May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-VolumesActionsTest-59752133-project May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7d32564afc494346bdfb99f4729fdacf May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-VolumesActionsTest-59752133-project May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 7633c180-2587-4beb-8826-c5ad40ac2200 could not be found. May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '7633c180-2587-4beb-8826-c5ad40ac2200'} May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7633c180-2587-4beb-8826-c5ad40ac2200 could not be found. May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7633c180-2587-4beb-8826-c5ad40ac2200 could not be found. May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:14.145316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:14.150754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:14.150754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:14.150754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:14.150754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:14.150754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7633c180-2587-4beb-8826-c5ad40ac2200 could not be found. May 19 04:47:14.150754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:14.150754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] Returning 404 to user: Instance 7633c180-2587-4beb-8826-c5ad40ac2200 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:14.152544 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-86b527b1-2123-42e2-b8f7-c83132c8779f tempest-VolumesActionsTest-59752133 tempest-VolumesActionsTest-59752133-project] 10.222.0.58 "GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200" status: 404 len: 111 microversion: 2.1 time: 0.044684 May 19 04:47:14.153884 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1834/3761] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:14 2022] GET /compute/v2.1/servers/7633c180-2587-4beb-8826-c5ad40ac2200 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:47:14.171468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5c8fee7c-5abd-464b-86bf-085182f204f8 req-03aa1556-4495-4be6-b2c9-1b7ea8b62c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "name": "network-vif-unplugged", "status": "completed", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:14.194188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5c8fee7c-5abd-464b-86bf-085182f204f8 req-03aa1556-4495-4be6-b2c9-1b7ea8b62c63 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:14.197548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5c8fee7c-5abd-464b-86bf-085182f204f8 req-03aa1556-4495-4be6-b2c9-1b7ea8b62c63 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:14.221547 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5c8fee7c-5abd-464b-86bf-085182f204f8 req-03aa1556-4495-4be6-b2c9-1b7ea8b62c63 service nova] Creating event network-vif-unplugged:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:47:14.227919 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5c8fee7c-5abd-464b-86bf-085182f204f8 req-03aa1556-4495-4be6-b2c9-1b7ea8b62c63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072547 May 19 04:47:14.231757 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1835/3762] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:14.245537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0d5ca6ff-5b39-4765-842c-b929ebfd55ee tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:14.246521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0d5ca6ff-5b39-4765-842c-b929ebfd55ee tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:14.265667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d5ca6ff-5b39-4765-842c-b929ebfd55ee tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:14.277882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d5ca6ff-5b39-4765-842c-b929ebfd55ee tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:14.278745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d5ca6ff-5b39-4765-842c-b929ebfd55ee tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:14.279290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d5ca6ff-5b39-4765-842c-b929ebfd55ee tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:14.456288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0d5ca6ff-5b39-4765-842c-b929ebfd55ee tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:14.463831 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0d5ca6ff-5b39-4765-842c-b929ebfd55ee tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1278 microversion: 2.1 time: 0.230662 May 19 04:47:14.473336 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1836/3763] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:14 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:14.473336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a9e36529-0dee-4bc4-97e8-ae706a474fc3 req-22af6aa4-85a3-4cb7-bc7b-75371026021a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7633c180-2587-4beb-8826-c5ad40ac2200", "name": "network-vif-deleted", "tag": "4419dcb4-15b4-4a86-a4cd-43aaa52c10f3"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:14.498444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a9e36529-0dee-4bc4-97e8-ae706a474fc3 req-22af6aa4-85a3-4cb7-bc7b-75371026021a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:14.498908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a9e36529-0dee-4bc4-97e8-ae706a474fc3 req-22af6aa4-85a3-4cb7-bc7b-75371026021a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:14.512763 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a9e36529-0dee-4bc4-97e8-ae706a474fc3 req-22af6aa4-85a3-4cb7-bc7b-75371026021a service nova] Creating event network-vif-deleted:4419dcb4-15b4-4a86-a4cd-43aaa52c10f3 for instance 7633c180-2587-4beb-8826-c5ad40ac2200 on n-h1-766726-30 May 19 04:47:14.517975 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a9e36529-0dee-4bc4-97e8-ae706a474fc3 req-22af6aa4-85a3-4cb7-bc7b-75371026021a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052264 May 19 04:47:14.518526 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1837/3764] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:14.524552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e2c6189-185b-40a1-94fc-981ec7481ab5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:14.525323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e2c6189-185b-40a1-94fc-981ec7481ab5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:14.543233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e2c6189-185b-40a1-94fc-981ec7481ab5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:14.543977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e2c6189-185b-40a1-94fc-981ec7481ab5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:14.545696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e2c6189-185b-40a1-94fc-981ec7481ab5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:14.546367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e2c6189-185b-40a1-94fc-981ec7481ab5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:15.001888 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d6003b3-0d10-49ab-8e55-ef678ca71bc4 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action" status: 202 len: 0 microversion: 2.1 time: 2.687673 May 19 04:47:15.002511 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1928/3765] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:12 2022] POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action => generated 0 bytes in 2689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:47:15.012485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-073e28e4-7eb1-4c27-ae73-7a3012ae3c5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:15.013126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-073e28e4-7eb1-4c27-ae73-7a3012ae3c5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:15.038351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-073e28e4-7eb1-4c27-ae73-7a3012ae3c5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:15.039197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-073e28e4-7eb1-4c27-ae73-7a3012ae3c5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:15.040531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-073e28e4-7eb1-4c27-ae73-7a3012ae3c5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:15.041091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-073e28e4-7eb1-4c27-ae73-7a3012ae3c5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:15.395725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e2c6189-185b-40a1-94fc-981ec7481ab5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:15.410822 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e2c6189-185b-40a1-94fc-981ec7481ab5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1471 microversion: 2.1 time: 0.891009 May 19 04:47:15.420909 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1838/3766] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:14 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1471 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:15.438324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ed6034f-253c-4f99-97e1-400a5384eccb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:15.439116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4ed6034f-253c-4f99-97e1-400a5384eccb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:15.446076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ed6034f-253c-4f99-97e1-400a5384eccb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:15.446878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ed6034f-253c-4f99-97e1-400a5384eccb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:15.447845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ed6034f-253c-4f99-97e1-400a5384eccb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:15.448458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ed6034f-253c-4f99-97e1-400a5384eccb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:15.503842 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-073e28e4-7eb1-4c27-ae73-7a3012ae3c5d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.499675 May 19 04:47:15.506370 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1929/3767] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:47:15 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-interface => generated 285 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:15.512033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-61cc56da-cd9f-4262-9b90-54f59a47770e tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1639363277"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:15.512792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-61cc56da-cd9f-4262-9b90-54f59a47770e tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:15.528312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61cc56da-cd9f-4262-9b90-54f59a47770e tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:15.529359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61cc56da-cd9f-4262-9b90-54f59a47770e tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:15.534348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61cc56da-cd9f-4262-9b90-54f59a47770e tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:15.535004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61cc56da-cd9f-4262-9b90-54f59a47770e tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:16.070594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4ed6034f-253c-4f99-97e1-400a5384eccb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:16.083968 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4ed6034f-253c-4f99-97e1-400a5384eccb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1316 microversion: 2.1 time: 0.659905 May 19 04:47:16.084893 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1839/3768] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:15 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:16.097715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-7a2bb12f-92dd-420f-847c-4403ca7d3f5f req-8524a807-50bc-4d78-9b56-d8a017f58972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe", "tag": "b5d2cce6-de74-48ec-83dd-509de85ddfaa"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:16.114396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7a2bb12f-92dd-420f-847c-4403ca7d3f5f req-8524a807-50bc-4d78-9b56-d8a017f58972 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:16.114900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7a2bb12f-92dd-420f-847c-4403ca7d3f5f req-8524a807-50bc-4d78-9b56-d8a017f58972 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:16.143338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-7a2bb12f-92dd-420f-847c-4403ca7d3f5f req-8524a807-50bc-4d78-9b56-d8a017f58972 service nova] Creating event network-changed:b5d2cce6-de74-48ec-83dd-509de85ddfaa for instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe on n-h1-766726-30 May 19 04:47:16.149141 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-7a2bb12f-92dd-420f-847c-4403ca7d3f5f req-8524a807-50bc-4d78-9b56-d8a017f58972 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063011 May 19 04:47:16.150248 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1840/3769] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:16.157324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0fc61831-6a45-4605-bfc1-19219ccc9f7c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:16.158366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0fc61831-6a45-4605-bfc1-19219ccc9f7c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:16.166197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc61831-6a45-4605-bfc1-19219ccc9f7c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:16.167099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc61831-6a45-4605-bfc1-19219ccc9f7c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:16.168056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc61831-6a45-4605-bfc1-19219ccc9f7c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:16.168773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc61831-6a45-4605-bfc1-19219ccc9f7c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:16.527213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0fc61831-6a45-4605-bfc1-19219ccc9f7c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:16.546878 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0fc61831-6a45-4605-bfc1-19219ccc9f7c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1278 microversion: 2.1 time: 0.395181 May 19 04:47:16.550900 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1841/3770] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:16 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1278 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:16.577764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2542c5e7-6200-4ca6-8a68-2325cc00914a req-fa51846f-f37d-4cc1-9b88-ae27818b3c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "name": "network-vif-plugged", "status": "completed", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:16.591904 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.network.security_group_api [None req-61cc56da-cd9f-4262-9b90-54f59a47770e tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Removing security group cb6606a4-1c67-4694-880d-c935f1126b0d from port b5d2cce6-de74-48ec-83dd-509de85ddfaa May 19 04:47:16.603125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2542c5e7-6200-4ca6-8a68-2325cc00914a req-fa51846f-f37d-4cc1-9b88-ae27818b3c92 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:16.603578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2542c5e7-6200-4ca6-8a68-2325cc00914a req-fa51846f-f37d-4cc1-9b88-ae27818b3c92 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:16.649854 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2542c5e7-6200-4ca6-8a68-2325cc00914a req-fa51846f-f37d-4cc1-9b88-ae27818b3c92 service nova] Creating event network-vif-plugged:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:47:16.663325 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2542c5e7-6200-4ca6-8a68-2325cc00914a req-fa51846f-f37d-4cc1-9b88-ae27818b3c92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106696 May 19 04:47:16.664894 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1842/3771] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:16.690857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e75237f6-5ab2-4059-9cbd-33d89a2b6723 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:16.694951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e75237f6-5ab2-4059-9cbd-33d89a2b6723 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:16.741506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e75237f6-5ab2-4059-9cbd-33d89a2b6723 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:16.742232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e75237f6-5ab2-4059-9cbd-33d89a2b6723 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:16.743433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e75237f6-5ab2-4059-9cbd-33d89a2b6723 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:16.744116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e75237f6-5ab2-4059-9cbd-33d89a2b6723 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:18.502227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=10 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:18.835327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:18.859944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:19.071573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e75237f6-5ab2-4059-9cbd-33d89a2b6723 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:19.093389 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e75237f6-5ab2-4059-9cbd-33d89a2b6723 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1471 microversion: 2.1 time: 2.420674 May 19 04:47:19.106059 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1843/3772] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:16 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1471 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:19.117811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b695325-5fed-4673-af5f-8279747ad5be tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:19.119638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1b695325-5fed-4673-af5f-8279747ad5be tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:19.134325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b695325-5fed-4673-af5f-8279747ad5be tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:19.136899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b695325-5fed-4673-af5f-8279747ad5be tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:19.141552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b695325-5fed-4673-af5f-8279747ad5be tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:19.146454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b695325-5fed-4673-af5f-8279747ad5be tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:19.189067 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-61cc56da-cd9f-4262-9b90-54f59a47770e tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action" status: 202 len: 0 microversion: 2.1 time: 3.681244 May 19 04:47:19.195722 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1930/3773] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:15 2022] POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action => generated 0 bytes in 3688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:47:19.575336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-48489075", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "bf96e94b-6549-4885-897f-a63bc54066df"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:19.771366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=16 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:20.173419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1b695325-5fed-4673-af5f-8279747ad5be tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:20.185421 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1b695325-5fed-4673-af5f-8279747ad5be tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1316 microversion: 2.1 time: 1.076061 May 19 04:47:20.206902 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1844/3774] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:19 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1316 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:20.213888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29c65355-7b1f-4be9-a448-00ceb2596dfe tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:20.225670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-29c65355-7b1f-4be9-a448-00ceb2596dfe tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:20.240920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29c65355-7b1f-4be9-a448-00ceb2596dfe tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:20.246777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29c65355-7b1f-4be9-a448-00ceb2596dfe tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:20.249585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29c65355-7b1f-4be9-a448-00ceb2596dfe tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:20.250165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29c65355-7b1f-4be9-a448-00ceb2596dfe tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:21.787906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-29c65355-7b1f-4be9-a448-00ceb2596dfe tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:21.802365 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29c65355-7b1f-4be9-a448-00ceb2596dfe tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1320 microversion: 2.1 time: 1.592208 May 19 04:47:21.811792 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1845/3775] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:20 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1320 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:21.817626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1652a379-70c2-4b62-8464-d4c8b6cab091 req-a552c10a-5f78-47d1-8317-cfd3d4c0fc7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ba435c-005c-4eff-beba-73270faa88e2", "tag": "ea0fff18-4ddf-46b4-939f-45b0a3c13122"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:21.838549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1652a379-70c2-4b62-8464-d4c8b6cab091 req-a552c10a-5f78-47d1-8317-cfd3d4c0fc7c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:21.838995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1652a379-70c2-4b62-8464-d4c8b6cab091 req-a552c10a-5f78-47d1-8317-cfd3d4c0fc7c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:21.861615 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1652a379-70c2-4b62-8464-d4c8b6cab091 req-a552c10a-5f78-47d1-8317-cfd3d4c0fc7c service nova] Creating event network-changed:ea0fff18-4ddf-46b4-939f-45b0a3c13122 for instance c5ba435c-005c-4eff-beba-73270faa88e2 on n-h2-766726-30 May 19 04:47:21.881999 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1652a379-70c2-4b62-8464-d4c8b6cab091 req-a552c10a-5f78-47d1-8317-cfd3d4c0fc7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068673 May 19 04:47:21.882901 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1846/3776] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:21.892798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a58be60e-760a-47e2-9c03-ad135119edda tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Action: 'create', calling method: .version_select at 0x7fd31b743ee0>, body: {"pool": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:25.582090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:27.012175 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a58be60e-760a-47e2-9c03-ad135119edda tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.127862 May 19 04:47:27.017474 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1847/3777] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:47:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:27.025688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-21d0049e-01aa-409d-bda6-657a3180e903 req-fae28dd3-25e6-44fe-b3ee-2ca77dd2fefb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ca519a-97b0-4dca-9d06-c04dc5b5a42b", "tag": "202be358-9adf-447e-9372-327b229c28d5"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:27.047524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-21d0049e-01aa-409d-bda6-657a3180e903 req-fae28dd3-25e6-44fe-b3ee-2ca77dd2fefb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:27.048380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-21d0049e-01aa-409d-bda6-657a3180e903 req-fae28dd3-25e6-44fe-b3ee-2ca77dd2fefb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:27.074809 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-21d0049e-01aa-409d-bda6-657a3180e903 req-fae28dd3-25e6-44fe-b3ee-2ca77dd2fefb service nova] Creating event network-changed:202be358-9adf-447e-9372-327b229c28d5 for instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b on n-h2-766726-30 May 19 04:47:27.083981 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-21d0049e-01aa-409d-bda6-657a3180e903 req-fae28dd3-25e6-44fe-b3ee-2ca77dd2fefb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064962 May 19 04:47:27.088301 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1848/3778] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:27.103968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ceea9ff0-4742-4e23-8f37-38998e7e6a55 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:27.105508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ceea9ff0-4742-4e23-8f37-38998e7e6a55 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:27.119449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ceea9ff0-4742-4e23-8f37-38998e7e6a55 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:27.120315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ceea9ff0-4742-4e23-8f37-38998e7e6a55 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:27.121663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ceea9ff0-4742-4e23-8f37-38998e7e6a55 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:27.128832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ceea9ff0-4742-4e23-8f37-38998e7e6a55 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:27.464483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ceea9ff0-4742-4e23-8f37-38998e7e6a55 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:27.478666 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ceea9ff0-4742-4e23-8f37-38998e7e6a55 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1477 microversion: 2.1 time: 0.385557 May 19 04:47:27.483430 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1849/3779] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:27 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1477 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:27.499827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd9e14f2-3060-444c-91ac-31f905f6071a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:27.506386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bd9e14f2-3060-444c-91ac-31f905f6071a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:27.523709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd9e14f2-3060-444c-91ac-31f905f6071a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:27.527424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd9e14f2-3060-444c-91ac-31f905f6071a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:27.534153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd9e14f2-3060-444c-91ac-31f905f6071a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:27.536628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd9e14f2-3060-444c-91ac-31f905f6071a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:27.594999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:27.829024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bd9e14f2-3060-444c-91ac-31f905f6071a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:27.839210 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd9e14f2-3060-444c-91ac-31f905f6071a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1316 microversion: 2.1 time: 0.354024 May 19 04:47:27.849514 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1850/3780] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:27 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:27.849514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f67aa446-d462-463d-90d6-75e737c8a2e9 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:27.849514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f67aa446-d462-463d-90d6-75e737c8a2e9 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:27.853700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f67aa446-d462-463d-90d6-75e737c8a2e9 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:27.854155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f67aa446-d462-463d-90d6-75e737c8a2e9 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:27.854984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f67aa446-d462-463d-90d6-75e737c8a2e9 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:27.855393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f67aa446-d462-463d-90d6-75e737c8a2e9 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:28.177377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f67aa446-d462-463d-90d6-75e737c8a2e9 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:28.199016 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f67aa446-d462-463d-90d6-75e737c8a2e9 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1320 microversion: 2.1 time: 0.357680 May 19 04:47:28.213465 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1851/3781] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:27 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:28.222185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-cb802fd3-c644-44f3-9c04-4ba30dd96525 req-45ae25a1-e68f-4698-835f-7353e2f21647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe", "tag": "b5d2cce6-de74-48ec-83dd-509de85ddfaa"}, {"name": "network-changed", "server_uuid": "78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6", "tag": "40d3c125-81b9-4ee7-bb9f-f2bcb928941f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:28.247624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cb802fd3-c644-44f3-9c04-4ba30dd96525 req-45ae25a1-e68f-4698-835f-7353e2f21647 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:28.254494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cb802fd3-c644-44f3-9c04-4ba30dd96525 req-45ae25a1-e68f-4698-835f-7353e2f21647 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:28.283790 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cb802fd3-c644-44f3-9c04-4ba30dd96525 req-45ae25a1-e68f-4698-835f-7353e2f21647 service nova] Creating event network-changed:b5d2cce6-de74-48ec-83dd-509de85ddfaa for instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe on n-h1-766726-30 May 19 04:47:28.286745 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cb802fd3-c644-44f3-9c04-4ba30dd96525 req-45ae25a1-e68f-4698-835f-7353e2f21647 service nova] Creating event network-changed:40d3c125-81b9-4ee7-bb9f-f2bcb928941f for instance 78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6 on n-h2-766726-30 May 19 04:47:28.307827 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-cb802fd3-c644-44f3-9c04-4ba30dd96525 req-45ae25a1-e68f-4698-835f-7353e2f21647 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089208 May 19 04:47:28.332550 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1852/3782] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:28.364003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.204"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:28.369017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:28.400797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:28.404394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:28.408436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:28.412156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:28.543313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Acquired lock "refresh_cache-6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:47:29.604678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:32.247875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Building network info cache for instance {{(pid=124819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:47:32.530510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] validate_networks() for [('bf96e94b-6549-4885-897f-a63bc54066df', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:47:33.193896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:47:33.194998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:47:33.195906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:47:33.196695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:47:33.197313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:47:33.211998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:33.212704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:33.213750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:33.218949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:33.264290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Getting quotas for project 2bb0ddaaa4be4905805c063c2901ea69. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:47:33.276176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Getting quotas for user fdf4c99c319941c38a0d75d974869962 and project 2bb0ddaaa4be4905805c063c2901ea69. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:47:33.323957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:47:33.336148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:47:33.463590 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af4cba4a-cac0-4eb6-8671-4b2c1d9fb9ab tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.266022 May 19 04:47:33.464262 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1931/3783] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:47:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 14268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:47:33.483052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6a7cd510-9974-42d2-b45f-78c1e6c73bcb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:33.490662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6a7cd510-9974-42d2-b45f-78c1e6c73bcb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:33.506480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a7cd510-9974-42d2-b45f-78c1e6c73bcb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:33.507159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a7cd510-9974-42d2-b45f-78c1e6c73bcb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:33.510478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a7cd510-9974-42d2-b45f-78c1e6c73bcb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:33.511141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a7cd510-9974-42d2-b45f-78c1e6c73bcb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:33.762051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Updating instance_info_cache with network_info: [{"id": "b5d2cce6-de74-48ec-83dd-509de85ddfaa", "address": "fa:16:3e:4e:aa:dc", "network": {"id": "a9af2bd0-1c1c-4510-a700-3a020ba6746b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-574643229-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a5f3b608f2294ee78ba1865a9494fbcf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5d2cce6-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:47:33.791498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Releasing lock "refresh_cache-6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:47:33.792324 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9a53980b-6aa9-43c4-a7d2-2b67acd94b2d tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action" status: 202 len: 0 microversion: 2.1 time: 5.454286 May 19 04:47:33.792953 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1853/3784] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:28 2022] POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action => generated 0 bytes in 5459 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 04:47:33.809132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d107d425-a3ce-4a48-894a-52e5232e3a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:33.811311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6a7cd510-9974-42d2-b45f-78c1e6c73bcb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:33.812037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d107d425-a3ce-4a48-894a-52e5232e3a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:33.821902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d107d425-a3ce-4a48-894a-52e5232e3a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:33.822352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d107d425-a3ce-4a48-894a-52e5232e3a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:33.823251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d107d425-a3ce-4a48-894a-52e5232e3a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:33.823688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d107d425-a3ce-4a48-894a-52e5232e3a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:33.824298 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6a7cd510-9974-42d2-b45f-78c1e6c73bcb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1477 microversion: 2.1 time: 0.351426 May 19 04:47:33.835348 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1932/3785] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:33 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1477 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:33.840969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5552c93c-abd3-4046-a6ae-34df3f8f9124 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:33.841813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5552c93c-abd3-4046-a6ae-34df3f8f9124 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:33.849627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5552c93c-abd3-4046-a6ae-34df3f8f9124 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:33.850782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5552c93c-abd3-4046-a6ae-34df3f8f9124 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:33.851964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5552c93c-abd3-4046-a6ae-34df3f8f9124 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:33.852724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5552c93c-abd3-4046-a6ae-34df3f8f9124 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:34.087551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d107d425-a3ce-4a48-894a-52e5232e3a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:34.096232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5552c93c-abd3-4046-a6ae-34df3f8f9124 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:34.103217 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d107d425-a3ce-4a48-894a-52e5232e3a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1316 microversion: 2.1 time: 0.308529 May 19 04:47:34.113671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5552c93c-abd3-4046-a6ae-34df3f8f9124 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1320 microversion: 2.1 time: 0.270070 May 19 04:47:34.114745 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1854/3786] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:33 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:34.119751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1dbeef5b-1e33-427c-8473-37315b3900c5 req-0653795e-f6f7-4296-b0c4-60e0b566520c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ba435c-005c-4eff-beba-73270faa88e2", "name": "network-vif-plugged", "status": "completed", "tag": "ea0fff18-4ddf-46b4-939f-45b0a3c13122"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:34.122783 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1933/3787] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:33 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:34.131686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1dbeef5b-1e33-427c-8473-37315b3900c5 req-0653795e-f6f7-4296-b0c4-60e0b566520c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:34.132397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1dbeef5b-1e33-427c-8473-37315b3900c5 req-0653795e-f6f7-4296-b0c4-60e0b566520c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:34.134762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1aa5b27e-ca35-47d3-aa1e-9fbb5c4b7da0 req-8c12be78-4530-46e5-97e4-870b172dd701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dda6fb1-ce7e-4825-9bb0-151d7d878664", "tag": "5c46504b-06b1-49f4-afe0-02f78b2ba0d6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:34.148916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1aa5b27e-ca35-47d3-aa1e-9fbb5c4b7da0 req-8c12be78-4530-46e5-97e4-870b172dd701 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:34.150131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1aa5b27e-ca35-47d3-aa1e-9fbb5c4b7da0 req-8c12be78-4530-46e5-97e4-870b172dd701 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:34.159335 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1dbeef5b-1e33-427c-8473-37315b3900c5 req-0653795e-f6f7-4296-b0c4-60e0b566520c service nova] Creating event network-vif-plugged:ea0fff18-4ddf-46b4-939f-45b0a3c13122 for instance c5ba435c-005c-4eff-beba-73270faa88e2 on n-h2-766726-30 May 19 04:47:34.164593 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1aa5b27e-ca35-47d3-aa1e-9fbb5c4b7da0 req-8c12be78-4530-46e5-97e4-870b172dd701 service nova] Creating event network-changed:5c46504b-06b1-49f4-afe0-02f78b2ba0d6 for instance 3dda6fb1-ce7e-4825-9bb0-151d7d878664 on n-h1-766726-30 May 19 04:47:34.166936 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1dbeef5b-1e33-427c-8473-37315b3900c5 req-0653795e-f6f7-4296-b0c4-60e0b566520c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050436 May 19 04:47:34.168729 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1855/3788] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:34.174527 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1aa5b27e-ca35-47d3-aa1e-9fbb5c4b7da0 req-8c12be78-4530-46e5-97e4-870b172dd701 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049351 May 19 04:47:34.175549 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1934/3789] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:34.179717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c021ab7-9548-452c-8dc7-da3655ea3dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:34.180603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3c021ab7-9548-452c-8dc7-da3655ea3dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:34.185125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c111dd51-95a3-4b6a-9a0c-2ac624eddf9d tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:34.185340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c111dd51-95a3-4b6a-9a0c-2ac624eddf9d tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:34.192025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c021ab7-9548-452c-8dc7-da3655ea3dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:34.192931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c021ab7-9548-452c-8dc7-da3655ea3dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:34.194030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c021ab7-9548-452c-8dc7-da3655ea3dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:34.194481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c021ab7-9548-452c-8dc7-da3655ea3dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:34.319897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c111dd51-95a3-4b6a-9a0c-2ac624eddf9d tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:34.329511 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c111dd51-95a3-4b6a-9a0c-2ac624eddf9d tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1215 microversion: 2.1 time: 0.151599 May 19 04:47:34.330858 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1935/3790] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:34 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:34.338396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.204"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:34.740253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:34.755646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:34.756847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:34.757668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:34.758112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:34.774789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c021ab7-9548-452c-8dc7-da3655ea3dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:34.801058 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3c021ab7-9548-452c-8dc7-da3655ea3dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.629073 May 19 04:47:34.802038 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1856/3791] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:34 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:34.821679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-662a4550-5d7c-4a20-af97-c4bd6414ba45 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1391797737"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:34.827686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-662a4550-5d7c-4a20-af97-c4bd6414ba45 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:34.842642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-662a4550-5d7c-4a20-af97-c4bd6414ba45 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:34.843731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-662a4550-5d7c-4a20-af97-c4bd6414ba45 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:34.844977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-662a4550-5d7c-4a20-af97-c4bd6414ba45 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:34.846125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-662a4550-5d7c-4a20-af97-c4bd6414ba45 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:35.420254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-662a4550-5d7c-4a20-af97-c4bd6414ba45 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.603587 May 19 04:47:35.421347 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1857/3792] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:34 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) May 19 04:47:35.427735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5a46d25f-ff98-4f2b-abe0-acff2c3b4ee4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:35.433445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5a46d25f-ff98-4f2b-abe0-acff2c3b4ee4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:35.445294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a46d25f-ff98-4f2b-abe0-acff2c3b4ee4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:35.445776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a46d25f-ff98-4f2b-abe0-acff2c3b4ee4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:35.446714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a46d25f-ff98-4f2b-abe0-acff2c3b4ee4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:35.447240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a46d25f-ff98-4f2b-abe0-acff2c3b4ee4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:35.529304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Acquired lock "refresh_cache-6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:47:35.791925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5a46d25f-ff98-4f2b-abe0-acff2c3b4ee4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:35.807122 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5a46d25f-ff98-4f2b-abe0-acff2c3b4ee4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1477 microversion: 2.1 time: 0.384029 May 19 04:47:35.810410 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1858/3793] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:35 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:35.827250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e48883e-c973-46fa-b89b-e428b715df58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:35.828516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e48883e-c973-46fa-b89b-e428b715df58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:35.856554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e48883e-c973-46fa-b89b-e428b715df58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:35.869424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e48883e-c973-46fa-b89b-e428b715df58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:35.870857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e48883e-c973-46fa-b89b-e428b715df58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:35.871285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e48883e-c973-46fa-b89b-e428b715df58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:36.411494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e48883e-c973-46fa-b89b-e428b715df58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:36.421959 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e48883e-c973-46fa-b89b-e428b715df58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1316 microversion: 2.1 time: 0.609656 May 19 04:47:36.424102 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1859/3794] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:35 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:36.428808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-39e4171f-5aa9-4bae-b0be-1a29db2b879a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:36.429454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-39e4171f-5aa9-4bae-b0be-1a29db2b879a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:36.464118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39e4171f-5aa9-4bae-b0be-1a29db2b879a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:36.464118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39e4171f-5aa9-4bae-b0be-1a29db2b879a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:36.464602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39e4171f-5aa9-4bae-b0be-1a29db2b879a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:36.464896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39e4171f-5aa9-4bae-b0be-1a29db2b879a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:37.147635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-39e4171f-5aa9-4bae-b0be-1a29db2b879a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:37.159442 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-39e4171f-5aa9-4bae-b0be-1a29db2b879a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1320 microversion: 2.1 time: 0.734203 May 19 04:47:37.172074 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1860/3795] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:36 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1320 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:37.179781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2e2f9d9a-92a2-4ef8-a35a-e692c15b8a78 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:37.184020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2e2f9d9a-92a2-4ef8-a35a-e692c15b8a78 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:37.198843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e2f9d9a-92a2-4ef8-a35a-e692c15b8a78 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:37.201466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e2f9d9a-92a2-4ef8-a35a-e692c15b8a78 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:37.202471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e2f9d9a-92a2-4ef8-a35a-e692c15b8a78 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:37.203691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e2f9d9a-92a2-4ef8-a35a-e692c15b8a78 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:37.429516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Building network info cache for instance {{(pid=124818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:47:37.527890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2e2f9d9a-92a2-4ef8-a35a-e692c15b8a78 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:37.538358 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2e2f9d9a-92a2-4ef8-a35a-e692c15b8a78 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1315 microversion: 2.1 time: 0.364842 May 19 04:47:37.540004 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1861/3796] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:37 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:37.545534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b1dcd6eb-bea1-44b3-a76f-1792e4fb9cde tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:37.546702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b1dcd6eb-bea1-44b3-a76f-1792e4fb9cde tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:37.553834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1dcd6eb-bea1-44b3-a76f-1792e4fb9cde tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:37.554751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1dcd6eb-bea1-44b3-a76f-1792e4fb9cde tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:37.555771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1dcd6eb-bea1-44b3-a76f-1792e4fb9cde tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:37.556611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1dcd6eb-bea1-44b3-a76f-1792e4fb9cde tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:38.120070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b1dcd6eb-bea1-44b3-a76f-1792e4fb9cde tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:38.134877 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b1dcd6eb-bea1-44b3-a76f-1792e4fb9cde tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1686 microversion: 2.1 time: 0.593666 May 19 04:47:38.139837 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1862/3797] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:37 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1686 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:38.150858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-217bf2ca-c55f-4710-9379-544cc5aa8694 req-820130d7-b71a-4965-a4b6-84e442f8426a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b11dd9-99d7-422e-9399-37f52d453bee", "name": "network-vif-plugged", "status": "completed", "tag": "3f9d85c4-dcc4-422a-8896-34e1a8644e85"}, {"server_uuid": "3dda6fb1-ce7e-4825-9bb0-151d7d878664", "name": "network-vif-plugged", "status": "completed", "tag": "5c46504b-06b1-49f4-afe0-02f78b2ba0d6"}, {"server_uuid": "78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6", "name": "network-vif-plugged", "status": "completed", "tag": "40d3c125-81b9-4ee7-bb9f-f2bcb928941f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:38.171745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-217bf2ca-c55f-4710-9379-544cc5aa8694 req-820130d7-b71a-4965-a4b6-84e442f8426a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:38.172580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-217bf2ca-c55f-4710-9379-544cc5aa8694 req-820130d7-b71a-4965-a4b6-84e442f8426a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:38.190971 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-217bf2ca-c55f-4710-9379-544cc5aa8694 req-820130d7-b71a-4965-a4b6-84e442f8426a service nova] Creating event network-vif-plugged:3f9d85c4-dcc4-422a-8896-34e1a8644e85 for instance 27b11dd9-99d7-422e-9399-37f52d453bee on n-h2-766726-30 May 19 04:47:38.191669 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-217bf2ca-c55f-4710-9379-544cc5aa8694 req-820130d7-b71a-4965-a4b6-84e442f8426a service nova] Creating event network-vif-plugged:5c46504b-06b1-49f4-afe0-02f78b2ba0d6 for instance 3dda6fb1-ce7e-4825-9bb0-151d7d878664 on n-h1-766726-30 May 19 04:47:38.192473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-217bf2ca-c55f-4710-9379-544cc5aa8694 req-820130d7-b71a-4965-a4b6-84e442f8426a service nova] Creating event network-vif-plugged:40d3c125-81b9-4ee7-bb9f-f2bcb928941f for instance 78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6 on n-h2-766726-30 May 19 04:47:38.206685 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-217bf2ca-c55f-4710-9379-544cc5aa8694 req-820130d7-b71a-4965-a4b6-84e442f8426a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.065060 May 19 04:47:38.208061 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1863/3798] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:38.213920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-4b6670ba-7976-4756-9fe2-ecaceadebd16 req-6b9e8ef2-7adf-4699-982f-b3bd2fb9a83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe", "tag": "b5d2cce6-de74-48ec-83dd-509de85ddfaa"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:38.225576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4b6670ba-7976-4756-9fe2-ecaceadebd16 req-6b9e8ef2-7adf-4699-982f-b3bd2fb9a83c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:38.226289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4b6670ba-7976-4756-9fe2-ecaceadebd16 req-6b9e8ef2-7adf-4699-982f-b3bd2fb9a83c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:38.240463 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-4b6670ba-7976-4756-9fe2-ecaceadebd16 req-6b9e8ef2-7adf-4699-982f-b3bd2fb9a83c service nova] Creating event network-changed:b5d2cce6-de74-48ec-83dd-509de85ddfaa for instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe on n-h1-766726-30 May 19 04:47:38.247656 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-4b6670ba-7976-4756-9fe2-ecaceadebd16 req-6b9e8ef2-7adf-4699-982f-b3bd2fb9a83c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036832 May 19 04:47:38.249910 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1864/3799] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:38.255892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f684ea17-16f7-4543-806a-1735c39fa7de tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:38.257043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f684ea17-16f7-4543-806a-1735c39fa7de tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:38.267612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f684ea17-16f7-4543-806a-1735c39fa7de tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:38.268308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f684ea17-16f7-4543-806a-1735c39fa7de tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:38.269458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f684ea17-16f7-4543-806a-1735c39fa7de tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:38.270309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f684ea17-16f7-4543-806a-1735c39fa7de tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:38.586536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f684ea17-16f7-4543-806a-1735c39fa7de tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:38.594614 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f684ea17-16f7-4543-806a-1735c39fa7de tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1477 microversion: 2.1 time: 0.343354 May 19 04:47:38.603909 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1865/3800] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:38 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1477 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:38.619146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Updating instance_info_cache with network_info: [{"id": "b5d2cce6-de74-48ec-83dd-509de85ddfaa", "address": "fa:16:3e:4e:aa:dc", "network": {"id": "a9af2bd0-1c1c-4510-a700-3a020ba6746b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-574643229-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a5f3b608f2294ee78ba1865a9494fbcf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5d2cce6-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:47:38.654133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Releasing lock "refresh_cache-6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:47:38.655255 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e70ca59d-fb4f-4acc-aa7d-2b9a6561dead tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action" status: 202 len: 0 microversion: 2.1 time: 4.323208 May 19 04:47:38.658502 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1936/3801] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:34 2022] POST /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe/action => generated 0 bytes in 4327 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 04:47:38.671728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-717514ea-163a-4dce-b4bc-bcd1782d7c1e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:38.672562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-717514ea-163a-4dce-b4bc-bcd1782d7c1e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:38.695081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-717514ea-163a-4dce-b4bc-bcd1782d7c1e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:38.699076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-717514ea-163a-4dce-b4bc-bcd1782d7c1e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:38.701306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-717514ea-163a-4dce-b4bc-bcd1782d7c1e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:38.702803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-717514ea-163a-4dce-b4bc-bcd1782d7c1e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:38.754023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6e69212d-39b9-4009-a00c-f1066abfcf78 req-f02d35bc-a709-49b3-89a3-dafe227ed657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb046817-7e52-4f80-9158-8097be612892", "tag": "f89cb6b4-303d-402d-b20e-fbf5fed092f4"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:38.772981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6e69212d-39b9-4009-a00c-f1066abfcf78 req-f02d35bc-a709-49b3-89a3-dafe227ed657 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:38.776199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6e69212d-39b9-4009-a00c-f1066abfcf78 req-f02d35bc-a709-49b3-89a3-dafe227ed657 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:38.801755 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6e69212d-39b9-4009-a00c-f1066abfcf78 req-f02d35bc-a709-49b3-89a3-dafe227ed657 service nova] Creating event network-changed:f89cb6b4-303d-402d-b20e-fbf5fed092f4 for instance bb046817-7e52-4f80-9158-8097be612892 on n-h1-766726-30 May 19 04:47:38.807139 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6e69212d-39b9-4009-a00c-f1066abfcf78 req-f02d35bc-a709-49b3-89a3-dafe227ed657 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209034 May 19 04:47:38.808250 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1866/3802] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:38.814004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0c5f372-ef58-43e4-b53a-63407c393304 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:38.814856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b0c5f372-ef58-43e4-b53a-63407c393304 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:38.823364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0c5f372-ef58-43e4-b53a-63407c393304 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:38.823989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0c5f372-ef58-43e4-b53a-63407c393304 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:38.824947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0c5f372-ef58-43e4-b53a-63407c393304 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:38.825526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0c5f372-ef58-43e4-b53a-63407c393304 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:39.032781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-717514ea-163a-4dce-b4bc-bcd1782d7c1e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:39.040471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b0c5f372-ef58-43e4-b53a-63407c393304 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:39.042189 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-717514ea-163a-4dce-b4bc-bcd1782d7c1e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1505 microversion: 2.1 time: 0.382401 May 19 04:47:39.046327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:39.047195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1937/3803] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:38 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:39.057071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86239bdc-77fb-48e4-ad34-44cc4205dac3 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:39.058101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86239bdc-77fb-48e4-ad34-44cc4205dac3 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:39.061417 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0c5f372-ef58-43e4-b53a-63407c393304 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1320 microversion: 2.1 time: 0.251664 May 19 04:47:39.062443 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1867/3804] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:38 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:39.067128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b8c044e-aedd-4526-9d4d-dd6c28a35c43 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '.version_select at 0x7fd31b743670>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:39.077281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86239bdc-77fb-48e4-ad34-44cc4205dac3 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:39.078122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86239bdc-77fb-48e4-ad34-44cc4205dac3 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:39.079424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86239bdc-77fb-48e4-ad34-44cc4205dac3 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:39.080103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86239bdc-77fb-48e4-ad34-44cc4205dac3 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:39.758260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86239bdc-77fb-48e4-ad34-44cc4205dac3 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:39.769802 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86239bdc-77fb-48e4-ad34-44cc4205dac3 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1315 microversion: 2.1 time: 0.721102 May 19 04:47:39.775845 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1938/3805] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:39 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:39.790002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3f312558-2814-4ff3-b626-3ee499b94c01 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:39.792205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3f312558-2814-4ff3-b626-3ee499b94c01 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:39.809931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f312558-2814-4ff3-b626-3ee499b94c01 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:39.816675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f312558-2814-4ff3-b626-3ee499b94c01 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:39.822150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f312558-2814-4ff3-b626-3ee499b94c01 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:39.822903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f312558-2814-4ff3-b626-3ee499b94c01 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:39.930445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3f312558-2814-4ff3-b626-3ee499b94c01 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:47:40.081465 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3f312558-2814-4ff3-b626-3ee499b94c01 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 204 len: 0 microversion: 2.1 time: 0.300982 May 19 04:47:40.082067 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1939/3806] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:47:39 2022] DELETE /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:47:40.088788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fa62d87c-23ab-4eca-a201-a0cac2c2eb22 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:40.089576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fa62d87c-23ab-4eca-a201-a0cac2c2eb22 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:40.116368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa62d87c-23ab-4eca-a201-a0cac2c2eb22 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:40.117978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa62d87c-23ab-4eca-a201-a0cac2c2eb22 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:40.120059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa62d87c-23ab-4eca-a201-a0cac2c2eb22 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:40.121610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fa62d87c-23ab-4eca-a201-a0cac2c2eb22 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:40.414613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fa62d87c-23ab-4eca-a201-a0cac2c2eb22 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:40.455561 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fa62d87c-23ab-4eca-a201-a0cac2c2eb22 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1686 microversion: 2.1 time: 0.368484 May 19 04:47:40.456617 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1940/3807] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:40 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1686 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:40.462383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-002f4b72-895b-475d-9fd0-defa50266130 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:40.463510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-002f4b72-895b-475d-9fd0-defa50266130 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:40.471744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-002f4b72-895b-475d-9fd0-defa50266130 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:40.472443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-002f4b72-895b-475d-9fd0-defa50266130 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:40.473277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-002f4b72-895b-475d-9fd0-defa50266130 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:40.473788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-002f4b72-895b-475d-9fd0-defa50266130 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:40.681676 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1b8c044e-aedd-4526-9d4d-dd6c28a35c43 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/fd8cce4b-f35c-497f-81bf-baf298ff6f65" status: 202 len: 0 microversion: 2.1 time: 1.618044 May 19 04:47:40.686559 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1868/3808] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:47:39 2022] DELETE /compute/v2.1/os-floating-ips/fd8cce4b-f35c-497f-81bf-baf298ff6f65 => generated 0 bytes in 1623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:47:40.694436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-787d24f8-dabf-4676-b779-407837f6010a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:40.695330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-787d24f8-dabf-4676-b779-407837f6010a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:40.732145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-787d24f8-dabf-4676-b779-407837f6010a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:40.735954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-787d24f8-dabf-4676-b779-407837f6010a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:40.737140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-787d24f8-dabf-4676-b779-407837f6010a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:40.737754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-787d24f8-dabf-4676-b779-407837f6010a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:40.811415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-002f4b72-895b-475d-9fd0-defa50266130 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:40.823986 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-002f4b72-895b-475d-9fd0-defa50266130 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1463 microversion: 2.1 time: 0.365894 May 19 04:47:40.828724 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1941/3809] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:40 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1463 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:40.838274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b666e9d9-cbc9-4b1b-9491-591b2a853d2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:40.839253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b666e9d9-cbc9-4b1b-9491-591b2a853d2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:40.852050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b666e9d9-cbc9-4b1b-9491-591b2a853d2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:40.852576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b666e9d9-cbc9-4b1b-9491-591b2a853d2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:40.857476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b666e9d9-cbc9-4b1b-9491-591b2a853d2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:40.858324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b666e9d9-cbc9-4b1b-9491-591b2a853d2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:41.146060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-787d24f8-dabf-4676-b779-407837f6010a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:41.159465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b666e9d9-cbc9-4b1b-9491-591b2a853d2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:41.168685 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b666e9d9-cbc9-4b1b-9491-591b2a853d2d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1511 microversion: 2.1 time: 0.338549 May 19 04:47:41.170709 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-787d24f8-dabf-4676-b779-407837f6010a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1320 microversion: 2.1 time: 0.482560 May 19 04:47:41.171520 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1869/3810] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:40 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1320 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:41.173857 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1942/3811] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:40 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:41.183417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0c1a0110-8ba6-45cc-9cda-098fb495b55d req-ca89493d-89c0-47fb-999d-799132d33fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe", "tag": "b5d2cce6-de74-48ec-83dd-509de85ddfaa"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:41.184065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-720aca54-eb86-48b5-9658-0c6c1d77c094 req-2bd61330-37a0-4904-920b-73eea0f58dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "name": "network-vif-unplugged", "status": "completed", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:41.202712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0c1a0110-8ba6-45cc-9cda-098fb495b55d req-ca89493d-89c0-47fb-999d-799132d33fa7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:41.203634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0c1a0110-8ba6-45cc-9cda-098fb495b55d req-ca89493d-89c0-47fb-999d-799132d33fa7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:41.207793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=80 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:41.210822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-720aca54-eb86-48b5-9658-0c6c1d77c094 req-2bd61330-37a0-4904-920b-73eea0f58dca service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:41.211480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-720aca54-eb86-48b5-9658-0c6c1d77c094 req-2bd61330-37a0-4904-920b-73eea0f58dca service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:41.225990 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-720aca54-eb86-48b5-9658-0c6c1d77c094 req-2bd61330-37a0-4904-920b-73eea0f58dca service nova] Creating event network-vif-unplugged:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:47:41.232479 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-720aca54-eb86-48b5-9658-0c6c1d77c094 req-2bd61330-37a0-4904-920b-73eea0f58dca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058418 May 19 04:47:41.233777 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1870/3812] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:41.233934 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0c1a0110-8ba6-45cc-9cda-098fb495b55d req-ca89493d-89c0-47fb-999d-799132d33fa7 service nova] Creating event network-changed:b5d2cce6-de74-48ec-83dd-509de85ddfaa for instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe on n-h1-766726-30 May 19 04:47:41.241225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c9a0fbf7-057a-4852-9a02-1cd4f7f0b4f1 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '.version_select at 0x7fd315a66d30>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:41.243896 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0c1a0110-8ba6-45cc-9cda-098fb495b55d req-ca89493d-89c0-47fb-999d-799132d33fa7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068024 May 19 04:47:41.244691 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1943/3813] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:41.258471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41534075-cfe1-4993-a03f-ae5765c09e85 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:41.262778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-41534075-cfe1-4993-a03f-ae5765c09e85 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:41.279688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41534075-cfe1-4993-a03f-ae5765c09e85 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:41.280123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41534075-cfe1-4993-a03f-ae5765c09e85 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:41.281047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41534075-cfe1-4993-a03f-ae5765c09e85 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:41.281499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41534075-cfe1-4993-a03f-ae5765c09e85 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:41.589237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-41534075-cfe1-4993-a03f-ae5765c09e85 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:41.599790 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-41534075-cfe1-4993-a03f-ae5765c09e85 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1315 microversion: 2.1 time: 0.353996 May 19 04:47:41.613388 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1944/3814] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:41 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:41.618360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a055933-2ab1-4409-8257-ff92b0e11263 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:41.618987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a055933-2ab1-4409-8257-ff92b0e11263 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:41.635427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a055933-2ab1-4409-8257-ff92b0e11263 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:41.640010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a055933-2ab1-4409-8257-ff92b0e11263 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:41.642189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a055933-2ab1-4409-8257-ff92b0e11263 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:41.642945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a055933-2ab1-4409-8257-ff92b0e11263 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:41.991179 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c9a0fbf7-057a-4852-9a02-1cd4f7f0b4f1 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/cb6606a4-1c67-4694-880d-c935f1126b0d" status: 202 len: 0 microversion: 2.1 time: 0.755811 May 19 04:47:41.991772 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1871/3815] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:47:41 2022] DELETE /compute/v2.1/os-security-groups/cb6606a4-1c67-4694-880d-c935f1126b0d => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:47:41.998150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dd2b6a6a-5f80-48bb-89bb-9f2980916041 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:41.999118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dd2b6a6a-5f80-48bb-89bb-9f2980916041 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:42.014475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd2b6a6a-5f80-48bb-89bb-9f2980916041 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.015218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd2b6a6a-5f80-48bb-89bb-9f2980916041 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.023456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd2b6a6a-5f80-48bb-89bb-9f2980916041 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.024154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd2b6a6a-5f80-48bb-89bb-9f2980916041 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.063357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0a055933-2ab1-4409-8257-ff92b0e11263 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:42.077469 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a055933-2ab1-4409-8257-ff92b0e11263 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1463 microversion: 2.1 time: 0.462823 May 19 04:47:42.093411 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1945/3816] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:41 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1463 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:42.116033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-deab8756-f283-44eb-b70c-a836f7a8253a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:42.116884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-deab8756-f283-44eb-b70c-a836f7a8253a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:42.142243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-deab8756-f283-44eb-b70c-a836f7a8253a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.145648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-deab8756-f283-44eb-b70c-a836f7a8253a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.146682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-deab8756-f283-44eb-b70c-a836f7a8253a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.147515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-deab8756-f283-44eb-b70c-a836f7a8253a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.206272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-deab8756-f283-44eb-b70c-a836f7a8253a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:47:42.291301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:42.351254 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-deab8756-f283-44eb-b70c-a836f7a8253a tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 204 len: 0 microversion: 2.1 time: 0.255670 May 19 04:47:42.352443 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1946/3817] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:47:42 2022] DELETE /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:47:42.375840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:42.380107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:42.392874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.393513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.394411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.394975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.451723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dd2b6a6a-5f80-48bb-89bb-9f2980916041 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:42.464589 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dd2b6a6a-5f80-48bb-89bb-9f2980916041 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1686 microversion: 2.1 time: 0.471405 May 19 04:47:42.468968 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1872/3818] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:41 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1686 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:42.478299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cbb4d92-bf0c-4a3f-8d09-5abe147ec54d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:42.482484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0cbb4d92-bf0c-4a3f-8d09-5abe147ec54d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:42.490775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cbb4d92-bf0c-4a3f-8d09-5abe147ec54d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.491246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cbb4d92-bf0c-4a3f-8d09-5abe147ec54d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.495920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cbb4d92-bf0c-4a3f-8d09-5abe147ec54d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.496492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cbb4d92-bf0c-4a3f-8d09-5abe147ec54d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.566603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:47:42.567036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:47:42.567524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:47:42.567936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:47:42.568838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:47:42.682097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:42.699335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.699863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.701096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.701895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.777859 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c19104d-e978-409a-bca3-5328c43db777 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action" status: 202 len: 1067 microversion: 2.1 time: 0.423197 May 19 04:47:42.789431 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1947/3819] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:47:42 2022] POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action => generated 1067 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 19 04:47:42.789795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0cbb4d92-bf0c-4a3f-8d09-5abe147ec54d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:42.789930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5835a816-ea8a-4f52-ba32-ec2e51286284 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:42.789930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5835a816-ea8a-4f52-ba32-ec2e51286284 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:42.803877 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0cbb4d92-bf0c-4a3f-8d09-5abe147ec54d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 200 len: 1507 microversion: 2.1 time: 0.333435 May 19 04:47:42.815341 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1873/3820] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:42 2022] GET /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:42.817267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5835a816-ea8a-4f52-ba32-ec2e51286284 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.818593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5835a816-ea8a-4f52-ba32-ec2e51286284 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.819927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5835a816-ea8a-4f52-ba32-ec2e51286284 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.821592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5835a816-ea8a-4f52-ba32-ec2e51286284 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.821738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5e121ed9-3366-432e-a95f-c6bc42027ce0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:42.822509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5e121ed9-3366-432e-a95f-c6bc42027ce0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:42.830927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e121ed9-3366-432e-a95f-c6bc42027ce0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.831541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e121ed9-3366-432e-a95f-c6bc42027ce0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:42.832416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e121ed9-3366-432e-a95f-c6bc42027ce0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:42.832934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e121ed9-3366-432e-a95f-c6bc42027ce0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:43.250691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5e121ed9-3366-432e-a95f-c6bc42027ce0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:43.294987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:43.322944 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5e121ed9-3366-432e-a95f-c6bc42027ce0 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1510 microversion: 2.1 time: 0.515562 May 19 04:47:43.324233 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1874/3821] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:42 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1510 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:43.351445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2f735fe-a86b-4571-b500-eec35b8eb226 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:43.352534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e2f735fe-a86b-4571-b500-eec35b8eb226 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:43.368877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2f735fe-a86b-4571-b500-eec35b8eb226 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:43.369827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2f735fe-a86b-4571-b500-eec35b8eb226 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:43.371151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2f735fe-a86b-4571-b500-eec35b8eb226 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:43.374757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2f735fe-a86b-4571-b500-eec35b8eb226 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:43.427018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5835a816-ea8a-4f52-ba32-ec2e51286284 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:43.436125 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5835a816-ea8a-4f52-ba32-ec2e51286284 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 200 len: 1511 microversion: 2.1 time: 0.654692 May 19 04:47:43.449094 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1948/3822] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:42 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 1511 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:43.449094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c27f451-34b4-4117-adad-06f9b92fe1ce tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:43.449094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c27f451-34b4-4117-adad-06f9b92fe1ce tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:43.456600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c27f451-34b4-4117-adad-06f9b92fe1ce tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:43.457249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c27f451-34b4-4117-adad-06f9b92fe1ce tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:43.458142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c27f451-34b4-4117-adad-06f9b92fe1ce tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:43.458705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c27f451-34b4-4117-adad-06f9b92fe1ce tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:43.922612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5c27f451-34b4-4117-adad-06f9b92fe1ce tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:43.938403 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c27f451-34b4-4117-adad-06f9b92fe1ce tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.496387 May 19 04:47:43.944702 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1949/3823] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:43 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:43.959309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1af5ba0f-3fc9-44a4-a215-311d61b09e05 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:43.969228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1af5ba0f-3fc9-44a4-a215-311d61b09e05 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:43.982019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1af5ba0f-3fc9-44a4-a215-311d61b09e05 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:43.996544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1af5ba0f-3fc9-44a4-a215-311d61b09e05 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:43.999023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1af5ba0f-3fc9-44a4-a215-311d61b09e05 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.005489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1af5ba0f-3fc9-44a4-a215-311d61b09e05 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.037500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e2f735fe-a86b-4571-b500-eec35b8eb226 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:44.051455 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2f735fe-a86b-4571-b500-eec35b8eb226 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1315 microversion: 2.1 time: 0.725266 May 19 04:47:44.062118 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1875/3824] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:43 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:44.079264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ba3586b1-f1a5-460e-977f-d5a8364cf574 req-31c8f9ab-7fb5-449a-bfaf-68678833771a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "name": "network-vif-plugged", "status": "completed", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:44.100073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ba3586b1-f1a5-460e-977f-d5a8364cf574 req-31c8f9ab-7fb5-449a-bfaf-68678833771a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.100525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ba3586b1-f1a5-460e-977f-d5a8364cf574 req-31c8f9ab-7fb5-449a-bfaf-68678833771a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.142878 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ba3586b1-f1a5-460e-977f-d5a8364cf574 req-31c8f9ab-7fb5-449a-bfaf-68678833771a service nova] Creating event network-vif-plugged:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:47:44.148782 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ba3586b1-f1a5-460e-977f-d5a8364cf574 req-31c8f9ab-7fb5-449a-bfaf-68678833771a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090258 May 19 04:47:44.152310 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1876/3825] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:44.170166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ea33d1a4-407c-4e45-86c8-2920749e4c7c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:44.170888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ea33d1a4-407c-4e45-86c8-2920749e4c7c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:44.181404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea33d1a4-407c-4e45-86c8-2920749e4c7c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.181769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea33d1a4-407c-4e45-86c8-2920749e4c7c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.182550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea33d1a4-407c-4e45-86c8-2920749e4c7c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.182994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ea33d1a4-407c-4e45-86c8-2920749e4c7c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.220674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1af5ba0f-3fc9-44a4-a215-311d61b09e05 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:44.230073 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1af5ba0f-3fc9-44a4-a215-311d61b09e05 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6" status: 200 len: 1507 microversion: 2.1 time: 0.274791 May 19 04:47:44.231656 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1950/3826] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:43 2022] GET /compute/v2.1/servers/78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6 => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:44.237726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-bf831c62-2e2e-484a-9e85-48baae3f40b8 req-24850024-13a3-4c15-b82f-a46100b9c8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ba435c-005c-4eff-beba-73270faa88e2", "name": "network-vif-deleted", "tag": "ea0fff18-4ddf-46b4-939f-45b0a3c13122"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:44.248481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bf831c62-2e2e-484a-9e85-48baae3f40b8 req-24850024-13a3-4c15-b82f-a46100b9c8e5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.249259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bf831c62-2e2e-484a-9e85-48baae3f40b8 req-24850024-13a3-4c15-b82f-a46100b9c8e5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.287907 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-bf831c62-2e2e-484a-9e85-48baae3f40b8 req-24850024-13a3-4c15-b82f-a46100b9c8e5 service nova] Creating event network-vif-deleted:ea0fff18-4ddf-46b4-939f-45b0a3c13122 for instance c5ba435c-005c-4eff-beba-73270faa88e2 on n-h2-766726-30 May 19 04:47:44.304994 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-bf831c62-2e2e-484a-9e85-48baae3f40b8 req-24850024-13a3-4c15-b82f-a46100b9c8e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071719 May 19 04:47:44.313631 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1951/3827] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:44.320164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-68304a4c-45be-4ddf-9f84-41859c9412f6 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:44.322131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-68304a4c-45be-4ddf-9f84-41859c9412f6 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:44.333026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:44.343523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68304a4c-45be-4ddf-9f84-41859c9412f6 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.345588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68304a4c-45be-4ddf-9f84-41859c9412f6 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.347551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68304a4c-45be-4ddf-9f84-41859c9412f6 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.350068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-68304a4c-45be-4ddf-9f84-41859c9412f6 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.415520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-68304a4c-45be-4ddf-9f84-41859c9412f6 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:47:44.495804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ea33d1a4-407c-4e45-86c8-2920749e4c7c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:44.504818 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ea33d1a4-407c-4e45-86c8-2920749e4c7c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 0.350636 May 19 04:47:44.515876 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1877/3828] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:44 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:44.537884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a59a2dfb-2d9e-42d5-9612-2def6abe76ca tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:44.539054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a59a2dfb-2d9e-42d5-9612-2def6abe76ca tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:44.550861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a59a2dfb-2d9e-42d5-9612-2def6abe76ca tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.551612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a59a2dfb-2d9e-42d5-9612-2def6abe76ca tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.552394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a59a2dfb-2d9e-42d5-9612-2def6abe76ca tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.552835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a59a2dfb-2d9e-42d5-9612-2def6abe76ca tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.612943 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-68304a4c-45be-4ddf-9f84-41859c9412f6 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6" status: 204 len: 0 microversion: 2.1 time: 0.295871 May 19 04:47:44.616789 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1952/3829] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:47:44 2022] DELETE /compute/v2.1/servers/78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:47:44.621681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:44.622395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:44.629762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.630041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.630985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.631613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.650080 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 HTTP/1.1 May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c5ba435c-005c-4eff-beba-73270faa88e2'} May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:44.652189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-848e5130-52c4-4e72-bba1-66d330bef598 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 404 len: 111 microversion: 2.1 time: 0.039222 May 19 04:47:44.658888 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1953/3830] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:44 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:47:44.661558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39496d41-2ab9-463d-be5b-c4ad624e5507 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:44.661798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39496d41-2ab9-463d-be5b-c4ad624e5507 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:44.670737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39496d41-2ab9-463d-be5b-c4ad624e5507 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.671379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39496d41-2ab9-463d-be5b-c4ad624e5507 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.672402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39496d41-2ab9-463d-be5b-c4ad624e5507 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.673109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39496d41-2ab9-463d-be5b-c4ad624e5507 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.726258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39496d41-2ab9-463d-be5b-c4ad624e5507 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 3dda6fb1-ce7e-4825-9bb0-151d7d878664] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:47:44.796467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a59a2dfb-2d9e-42d5-9612-2def6abe76ca tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:44.807455 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a59a2dfb-2d9e-42d5-9612-2def6abe76ca tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1510 microversion: 2.1 time: 0.289631 May 19 04:47:44.833255 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1878/3831] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:44 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:44.842006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-28e62163-05d6-41a5-b09a-9796910c061c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:44.842538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-28e62163-05d6-41a5-b09a-9796910c061c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:44.869327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28e62163-05d6-41a5-b09a-9796910c061c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.869824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28e62163-05d6-41a5-b09a-9796910c061c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.870810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28e62163-05d6-41a5-b09a-9796910c061c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:44.871246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28e62163-05d6-41a5-b09a-9796910c061c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:44.967256 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39496d41-2ab9-463d-be5b-c4ad624e5507 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664" status: 204 len: 0 microversion: 2.1 time: 0.309681 May 19 04:47:44.974303 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1954/3832] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:47:44 2022] DELETE /compute/v2.1/servers/3dda6fb1-ce7e-4825-9bb0-151d7d878664 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:47:44.996387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-845c6c8c-5f55-4a7d-9610-2d82369db66c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:44.998506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-845c6c8c-5f55-4a7d-9610-2d82369db66c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:45.005350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-845c6c8c-5f55-4a7d-9610-2d82369db66c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:45.006056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-845c6c8c-5f55-4a7d-9610-2d82369db66c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:45.007027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-845c6c8c-5f55-4a7d-9610-2d82369db66c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:45.008133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-845c6c8c-5f55-4a7d-9610-2d82369db66c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:45.195970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-28e62163-05d6-41a5-b09a-9796910c061c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:45.208626 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-28e62163-05d6-41a5-b09a-9796910c061c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.373515 May 19 04:47:45.224326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-845c6c8c-5f55-4a7d-9610-2d82369db66c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:45.227365 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1879/3833] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:44 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:45.235513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-845c6c8c-5f55-4a7d-9610-2d82369db66c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.258698 May 19 04:47:45.236630 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1955/3834] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:44 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:45.241692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-766286392", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "d10cb2e4-7049-47dc-8c4b-92fd0edcd287"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:45.259449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e6f5a6a-ba66-4155-a960-db86e2b5ec4a tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:45.260247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e6f5a6a-ba66-4155-a960-db86e2b5ec4a tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:45.268187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e6f5a6a-ba66-4155-a960-db86e2b5ec4a tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:45.268753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e6f5a6a-ba66-4155-a960-db86e2b5ec4a tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:45.269765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e6f5a6a-ba66-4155-a960-db86e2b5ec4a tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:45.270461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e6f5a6a-ba66-4155-a960-db86e2b5ec4a tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:45.321883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] validate_networks() for [('d10cb2e4-7049-47dc-8c4b-92fd0edcd287', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:47:45.499628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8e6f5a6a-ba66-4155-a960-db86e2b5ec4a tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:45.509611 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e6f5a6a-ba66-4155-a960-db86e2b5ec4a tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1315 microversion: 2.1 time: 0.266040 May 19 04:47:45.512659 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1880/3835] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:45 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:45.516592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-adbcb2f3-10ad-47f4-bdcb-621631693d43 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-adbcb2f3-10ad-47f4-bdcb-621631693d43 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 163 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": 12345, "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 12345 May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:47:45.519474 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 19 04:47:45.524599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:45.526638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-adbcb2f3-10ad-47f4-bdcb-621631693d43 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:45.527652 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-adbcb2f3-10ad-47f4-bdcb-621631693d43 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015697 May 19 04:47:45.529236 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1881/3836] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:47:45 2022] POST /compute/v2.1/servers => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:47:45.537762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7ace89b-cd75-4628-8382-f34c5129a8fb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:45.539115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7ace89b-cd75-4628-8382-f34c5129a8fb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:45.550420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ace89b-cd75-4628-8382-f34c5129a8fb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:45.551164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ace89b-cd75-4628-8382-f34c5129a8fb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:45.552156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ace89b-cd75-4628-8382-f34c5129a8fb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:45.552760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ace89b-cd75-4628-8382-f34c5129a8fb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:46.701848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7ace89b-cd75-4628-8382-f34c5129a8fb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:46.737036 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7ace89b-cd75-4628-8382-f34c5129a8fb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 1.206489 May 19 04:47:46.754525 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1882/3837] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:45 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:46.762906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-401f2e4e-1534-489c-979a-d0e2778386f1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:46.763996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-401f2e4e-1534-489c-979a-d0e2778386f1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:46.772782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-401f2e4e-1534-489c-979a-d0e2778386f1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:46.773553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-401f2e4e-1534-489c-979a-d0e2778386f1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:46.777224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-401f2e4e-1534-489c-979a-d0e2778386f1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:46.779909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-401f2e4e-1534-489c-979a-d0e2778386f1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:46.928774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:47:46.929838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:47:46.931586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:47:46.932206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:47:46.932935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:47:46.961769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:46.962450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:46.966583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:46.967288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:47.022069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Getting quotas for project d1a970b4e5cb4fbf83273d687ea30472. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:47:47.027411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:47.036836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Getting quotas for user 582fe0e0beba4435b01b21db35d384af and project d1a970b4e5cb4fbf83273d687ea30472. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:47:47.083352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Going to run 2 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:47:47.087711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 2e7f7404-29e2-440c-9401-8140ee40b93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:47:47.118604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-401f2e4e-1534-489c-979a-d0e2778386f1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:47.129693 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-401f2e4e-1534-489c-979a-d0e2778386f1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.372015 May 19 04:47:47.130410 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1883/3838] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:46 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:47.146587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:47.147355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:47.147833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=2e7f7404-29e2-440c-9401-8140ee40b93c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:47:47.158822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:47.159291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:47.160350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:47.161595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:47.233285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:47.233738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:47.237729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lazy-loading 'fault' on Instance uuid 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:47:47.294626 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f924bfba-6169-453d-81a4-ca823a48f05d tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.056237 May 19 04:47:47.298385 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1956/3839] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:47:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 2058 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 19 04:47:47.302215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9033204c-93bd-444e-b2f7-f8b67916bcdb req-074ed2e6-4fe8-4c1d-9682-cca35b767495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb046817-7e52-4f80-9158-8097be612892", "name": "network-vif-plugged", "status": "completed", "tag": "f89cb6b4-303d-402d-b20e-fbf5fed092f4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:47.321063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9033204c-93bd-444e-b2f7-f8b67916bcdb req-074ed2e6-4fe8-4c1d-9682-cca35b767495 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:47.321540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9033204c-93bd-444e-b2f7-f8b67916bcdb req-074ed2e6-4fe8-4c1d-9682-cca35b767495 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:47.355996 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9033204c-93bd-444e-b2f7-f8b67916bcdb req-074ed2e6-4fe8-4c1d-9682-cca35b767495 service nova] Creating event network-vif-plugged:f89cb6b4-303d-402d-b20e-fbf5fed092f4 for instance bb046817-7e52-4f80-9158-8097be612892 on n-h1-766726-30 May 19 04:47:47.365892 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9033204c-93bd-444e-b2f7-f8b67916bcdb req-074ed2e6-4fe8-4c1d-9682-cca35b767495 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068166 May 19 04:47:47.367289 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1957/3840] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:47.380989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b09c984e-1ea2-4665-9260-ee02abc0438c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:47.382075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b09c984e-1ea2-4665-9260-ee02abc0438c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:47.398395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b09c984e-1ea2-4665-9260-ee02abc0438c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:47.399868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b09c984e-1ea2-4665-9260-ee02abc0438c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:47.399868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b09c984e-1ea2-4665-9260-ee02abc0438c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:47.400752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b09c984e-1ea2-4665-9260-ee02abc0438c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:47.487186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263de26333b245db8642fc41d532da88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f3b608f2294ee78ba1865a9494fbcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:47.494997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eac2a725-e17f-421a-9bb8-d4d974c417b5 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 200 len: 1313 microversion: 2.1 time: 0.363513 May 19 04:47:47.495871 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1884/3841] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:47 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:47.513605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1ef8d854-a672-41e5-ba57-9c11922345d7 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:47.514343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1ef8d854-a672-41e5-ba57-9c11922345d7 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:47.535219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ef8d854-a672-41e5-ba57-9c11922345d7 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:47.536550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ef8d854-a672-41e5-ba57-9c11922345d7 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:47.537553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ef8d854-a672-41e5-ba57-9c11922345d7 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:47.538552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ef8d854-a672-41e5-ba57-9c11922345d7 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:47.963056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b09c984e-1ea2-4665-9260-ee02abc0438c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:47.979075 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b09c984e-1ea2-4665-9260-ee02abc0438c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.609794 May 19 04:47:47.980013 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1958/3842] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:47 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:48.014725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-21c1101f-a051-4380-9327-270bef3c4100 req-462ff459-7650-4459-ac12-dff681edf683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe", "name": "network-vif-deleted", "tag": "b5d2cce6-de74-48ec-83dd-509de85ddfaa"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:48.047387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-21c1101f-a051-4380-9327-270bef3c4100 req-462ff459-7650-4459-ac12-dff681edf683 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.047882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-21c1101f-a051-4380-9327-270bef3c4100 req-462ff459-7650-4459-ac12-dff681edf683 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.088939 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-21c1101f-a051-4380-9327-270bef3c4100 req-462ff459-7650-4459-ac12-dff681edf683 service nova] Creating event network-vif-deleted:b5d2cce6-de74-48ec-83dd-509de85ddfaa for instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe on n-h1-766726-30 May 19 04:47:48.106761 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-21c1101f-a051-4380-9327-270bef3c4100 req-462ff459-7650-4459-ac12-dff681edf683 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124553 May 19 04:47:48.113969 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1959/3843] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:48.115493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1ef8d854-a672-41e5-ba57-9c11922345d7 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:48.125465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-57612856-95b1-4c15-bfcf-f1e4cbfdc7cd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:48.126249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-57612856-95b1-4c15-bfcf-f1e4cbfdc7cd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:48.142748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57612856-95b1-4c15-bfcf-f1e4cbfdc7cd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.143265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57612856-95b1-4c15-bfcf-f1e4cbfdc7cd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.148239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57612856-95b1-4c15-bfcf-f1e4cbfdc7cd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.149557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57612856-95b1-4c15-bfcf-f1e4cbfdc7cd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.150207 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1ef8d854-a672-41e5-ba57-9c11922345d7 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1315 microversion: 2.1 time: 0.643420 May 19 04:47:48.151564 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1885/3844] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:47 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:48.158155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-514e615b-5433-4dc5-877a-a7b4ae5378be tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:48.163163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-514e615b-5433-4dc5-877a-a7b4ae5378be tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:48.164136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-514e615b-5433-4dc5-877a-a7b4ae5378be tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Searching by: {'deleted': False, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:47:48.194721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-514e615b-5433-4dc5-877a-a7b4ae5378be tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.195212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-514e615b-5433-4dc5-877a-a7b4ae5378be tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.196156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-514e615b-5433-4dc5-877a-a7b4ae5378be tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.196616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-514e615b-5433-4dc5-877a-a7b4ae5378be tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.263306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-514e615b-5433-4dc5-877a-a7b4ae5378be tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:47:48.377800 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-514e615b-5433-4dc5-877a-a7b4ae5378be tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.216680 May 19 04:47:48.384428 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1886/3845] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:47:48 2022] GET /compute/v2.1/servers => generated 1335 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:48.395169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f288103e-0d22-4e1e-856f-e3523bfcfcdd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:48.395800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f288103e-0d22-4e1e-856f-e3523bfcfcdd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:48.411595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f288103e-0d22-4e1e-856f-e3523bfcfcdd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.415800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f288103e-0d22-4e1e-856f-e3523bfcfcdd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.418911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f288103e-0d22-4e1e-856f-e3523bfcfcdd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.420646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f288103e-0d22-4e1e-856f-e3523bfcfcdd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.797249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-57612856-95b1-4c15-bfcf-f1e4cbfdc7cd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:48.807514 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-57612856-95b1-4c15-bfcf-f1e4cbfdc7cd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.691670 May 19 04:47:48.808119 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1960/3846] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:48 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:48.823338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b111c548-d5ce-4414-8d0e-1692e2c34758 req-a22e1751-b374-45f1-9476-93f4cee94da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6", "name": "network-vif-deleted", "tag": "40d3c125-81b9-4ee7-bb9f-f2bcb928941f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:48.836453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b111c548-d5ce-4414-8d0e-1692e2c34758 req-a22e1751-b374-45f1-9476-93f4cee94da5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.840868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b111c548-d5ce-4414-8d0e-1692e2c34758 req-a22e1751-b374-45f1-9476-93f4cee94da5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.884955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:48.887769 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b111c548-d5ce-4414-8d0e-1692e2c34758 req-a22e1751-b374-45f1-9476-93f4cee94da5 service nova] Creating event network-vif-deleted:40d3c125-81b9-4ee7-bb9f-f2bcb928941f for instance 78d04e92-61b9-4dc8-ba5d-8ce0e03a29f6 on n-h2-766726-30 May 19 04:47:48.888983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f288103e-0d22-4e1e-856f-e3523bfcfcdd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:48.900477 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b111c548-d5ce-4414-8d0e-1692e2c34758 req-a22e1751-b374-45f1-9476-93f4cee94da5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081140 May 19 04:47:48.903898 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f288103e-0d22-4e1e-856f-e3523bfcfcdd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 0.522614 May 19 04:47:48.910245 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1887/3847] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:48 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:48.919778 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1961/3848] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:48.931303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1972bdca-8991-4cbf-8876-982a6d67cc61 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:48.937333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1972bdca-8991-4cbf-8876-982a6d67cc61 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:48.943507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:48.944227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] [instance: 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:48.969121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1972bdca-8991-4cbf-8876-982a6d67cc61 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.970093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1972bdca-8991-4cbf-8876-982a6d67cc61 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.971512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1972bdca-8991-4cbf-8876-982a6d67cc61 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.972753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1972bdca-8991-4cbf-8876-982a6d67cc61 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.975290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.975784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.976744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:48.979616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:48.984685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:49.012750 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] HTTP exception thrown: Instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe could not be found. May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Request method failure captured: May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe HTTP/1.1 May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcuK-3JNHlvdfTx6MEWNydUfNZsbc7VSNx2zfS9HlJrzBLmM7GDmRJ4s5Wyt5HdXPlA-E0dtyWmqC0EJReVX6rg5pgAT-xUKsLmIzLQScc8f4ndCsVamRDihLiLf0gmOs81ZEI0zgmjwk9zugSlLukw3xJ9vCr-aPPBPRKJCDXpUoOQ May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a5f3b608f2294ee78ba1865a9494fbcf May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1362650789 May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a5f3b608f2294ee78ba1865a9494fbcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5f3b608f2294ee78ba1865a9494fbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5f3b608f2294ee78ba1865a9494fbcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a5f3b608f2294ee78ba1865a9494fbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1362650789 May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a5f3b608f2294ee78ba1865a9494fbcf May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1362650789 May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerRescueTestJSONUnderV235-1362650789-project May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 263de26333b245db8642fc41d532da88 May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1362650789-project May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe could not be found. May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe'} May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe could not be found. May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe could not be found. May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:49.019139 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:49.023400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:49.023400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:49.023400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:49.023400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:49.023400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:49.023400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:49.023400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe could not be found. May 19 04:47:49.023400 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:49.025909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] Returning 404 to user: Instance 6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:49.027146 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5bc56fd8-d810-4eb8-a503-f536e9eda704 tempest-ServerRescueTestJSONUnderV235-1362650789 tempest-ServerRescueTestJSONUnderV235-1362650789-project] 10.222.0.58 "GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe" status: 404 len: 111 microversion: 2.1 time: 0.100543 May 19 04:47:49.034160 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1962/3849] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:48 2022] GET /compute/v2.1/servers/6a32bb78-12bd-418e-92d4-e3e5e3c8cdbe => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:47:49.039991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e723f12-8041-4cfb-a431-406816f2d647 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:49.041208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3e723f12-8041-4cfb-a431-406816f2d647 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:49.066109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e723f12-8041-4cfb-a431-406816f2d647 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:49.066854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e723f12-8041-4cfb-a431-406816f2d647 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:49.067887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e723f12-8041-4cfb-a431-406816f2d647 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:49.069559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e723f12-8041-4cfb-a431-406816f2d647 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:49.193521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1972bdca-8991-4cbf-8876-982a6d67cc61 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:49.219938 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1972bdca-8991-4cbf-8876-982a6d67cc61 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1221 microversion: 2.1 time: 0.302123 May 19 04:47:49.227474 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1888/3850] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:48 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1221 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:49.249727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e4498c6b-e374-4883-8a2b-de7535cdedd8 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:49.250752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e4498c6b-e374-4883-8a2b-de7535cdedd8 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:49.276369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4498c6b-e374-4883-8a2b-de7535cdedd8 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:49.282207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4498c6b-e374-4883-8a2b-de7535cdedd8 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:49.284167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4498c6b-e374-4883-8a2b-de7535cdedd8 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:49.286855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4498c6b-e374-4883-8a2b-de7535cdedd8 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.037771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3e723f12-8041-4cfb-a431-406816f2d647 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:50.051472 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3e723f12-8041-4cfb-a431-406816f2d647 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 1.013619 May 19 04:47:50.054356 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1963/3851] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:49 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:50.089411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db11a414-27b4-466a-b4b4-84634817bc81 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:50.092048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-db11a414-27b4-466a-b4b4-84634817bc81 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:50.117202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db11a414-27b4-466a-b4b4-84634817bc81 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.118265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db11a414-27b4-466a-b4b4-84634817bc81 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.122973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db11a414-27b4-466a-b4b4-84634817bc81 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.127521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db11a414-27b4-466a-b4b4-84634817bc81 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.196918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4498c6b-e374-4883-8a2b-de7535cdedd8 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:50.226191 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e4498c6b-e374-4883-8a2b-de7535cdedd8 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1503 microversion: 2.1 time: 0.985744 May 19 04:47:50.227172 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1889/3852] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:49 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1503 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:50.242901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5bac7b62-47bd-4944-b754-5998f04d618b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:50.246377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5bac7b62-47bd-4944-b754-5998f04d618b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:50.263415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bac7b62-47bd-4944-b754-5998f04d618b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.272534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bac7b62-47bd-4944-b754-5998f04d618b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.273757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bac7b62-47bd-4944-b754-5998f04d618b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.274398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bac7b62-47bd-4944-b754-5998f04d618b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.533432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5bac7b62-47bd-4944-b754-5998f04d618b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:50.542916 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5bac7b62-47bd-4944-b754-5998f04d618b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1277 microversion: 2.1 time: 0.304157 May 19 04:47:50.550302 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1890/3853] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:50 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1277 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:47:50.559021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cec812a7-41b6-4ff5-8f55-f3e212fe45f1 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:50.559927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cec812a7-41b6-4ff5-8f55-f3e212fe45f1 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:50.581256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cec812a7-41b6-4ff5-8f55-f3e212fe45f1 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.584763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cec812a7-41b6-4ff5-8f55-f3e212fe45f1 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.586056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cec812a7-41b6-4ff5-8f55-f3e212fe45f1 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.587339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cec812a7-41b6-4ff5-8f55-f3e212fe45f1 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.656868 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cec812a7-41b6-4ff5-8f55-f3e212fe45f1 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892/ips" status: 200 len: 108 microversion: 2.1 time: 0.100119 May 19 04:47:50.658260 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1891/3854] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:47:50 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892/ips => generated 108 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:50.687987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32cf99f1-4b9d-4906-8f2f-84bb026c3b98 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:50.691440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-32cf99f1-4b9d-4906-8f2f-84bb026c3b98 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:50.708314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32cf99f1-4b9d-4906-8f2f-84bb026c3b98 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.714539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32cf99f1-4b9d-4906-8f2f-84bb026c3b98 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.717936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32cf99f1-4b9d-4906-8f2f-84bb026c3b98 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.718433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32cf99f1-4b9d-4906-8f2f-84bb026c3b98 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.777311 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-32cf99f1-4b9d-4906-8f2f-84bb026c3b98 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892/ips" status: 200 len: 108 microversion: 2.1 time: 0.105328 May 19 04:47:50.785652 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1892/3855] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:47:50 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892/ips => generated 108 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:50.804244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bb92242a-f7a1-456a-b330-bada0d3af8a6 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:50.805149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bb92242a-f7a1-456a-b330-bada0d3af8a6 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:50.819795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb92242a-f7a1-456a-b330-bada0d3af8a6 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.820977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb92242a-f7a1-456a-b330-bada0d3af8a6 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.823083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb92242a-f7a1-456a-b330-bada0d3af8a6 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.824148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb92242a-f7a1-456a-b330-bada0d3af8a6 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.881422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bb92242a-f7a1-456a-b330-bada0d3af8a6 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892/ips/tempest-ServerAddressesTestJSON-900171913-network" status: 200 len: 93 microversion: 2.1 time: 0.081367 May 19 04:47:50.883049 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1893/3856] 10.222.0.58 () {58 vars in 1397 bytes} [Thu May 19 04:47:50 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892/ips/tempest-ServerAddressesTestJSON-900171913-network => generated 93 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:47:50.896939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1907e2fd-0854-4681-95e2-9ec7b6e38997 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:50.898249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1907e2fd-0854-4681-95e2-9ec7b6e38997 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:50.909186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1907e2fd-0854-4681-95e2-9ec7b6e38997 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.910176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1907e2fd-0854-4681-95e2-9ec7b6e38997 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.911587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1907e2fd-0854-4681-95e2-9ec7b6e38997 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:50.912491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1907e2fd-0854-4681-95e2-9ec7b6e38997 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:50.974392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1907e2fd-0854-4681-95e2-9ec7b6e38997 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:47:51.155654 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1907e2fd-0854-4681-95e2-9ec7b6e38997 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 204 len: 0 microversion: 2.1 time: 0.265188 May 19 04:47:51.156270 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1894/3857] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:47:50 2022] DELETE /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:47:51.161740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3ae1c9da-7617-471f-ab49-b15fef9e7c38 req-e609b090-d448-447d-b793-662c0b52dc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dda6fb1-ce7e-4825-9bb0-151d7d878664", "name": "network-vif-deleted", "tag": "5c46504b-06b1-49f4-afe0-02f78b2ba0d6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:51.184940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3ae1c9da-7617-471f-ab49-b15fef9e7c38 req-e609b090-d448-447d-b793-662c0b52dc0c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:51.185415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3ae1c9da-7617-471f-ab49-b15fef9e7c38 req-e609b090-d448-447d-b793-662c0b52dc0c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:51.209874 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3ae1c9da-7617-471f-ab49-b15fef9e7c38 req-e609b090-d448-447d-b793-662c0b52dc0c service nova] Creating event network-vif-deleted:5c46504b-06b1-49f4-afe0-02f78b2ba0d6 for instance 3dda6fb1-ce7e-4825-9bb0-151d7d878664 on n-h1-766726-30 May 19 04:47:51.224054 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3ae1c9da-7617-471f-ab49-b15fef9e7c38 req-e609b090-d448-447d-b793-662c0b52dc0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066308 May 19 04:47:51.225168 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1895/3858] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:51.230545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49ffc42e-493a-4f18-8246-6b95035143fc tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:51.231798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49ffc42e-493a-4f18-8246-6b95035143fc tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:51.245030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49ffc42e-493a-4f18-8246-6b95035143fc tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:51.245827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49ffc42e-493a-4f18-8246-6b95035143fc tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:51.250162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49ffc42e-493a-4f18-8246-6b95035143fc tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:51.253829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49ffc42e-493a-4f18-8246-6b95035143fc tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:51.403036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-db11a414-27b4-466a-b4b4-84634817bc81 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:51.431953 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-db11a414-27b4-466a-b4b4-84634817bc81 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 1.364801 May 19 04:47:51.435615 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1964/3859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:50 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:51.465432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf88b461-4ea3-44cf-8d25-7e05f9fa6f02 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:51.471894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cf88b461-4ea3-44cf-8d25-7e05f9fa6f02 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:51.508905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf88b461-4ea3-44cf-8d25-7e05f9fa6f02 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:51.510160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf88b461-4ea3-44cf-8d25-7e05f9fa6f02 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:51.515187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf88b461-4ea3-44cf-8d25-7e05f9fa6f02 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:51.515714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf88b461-4ea3-44cf-8d25-7e05f9fa6f02 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:52.050944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49ffc42e-493a-4f18-8246-6b95035143fc tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:52.061818 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49ffc42e-493a-4f18-8246-6b95035143fc tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.835368 May 19 04:47:52.079466 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1896/3860] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:51 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:52.082299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cf88b461-4ea3-44cf-8d25-7e05f9fa6f02 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:52.084741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2839cd66-c10a-442a-94d8-5e96a6f6af6b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:52.085397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2839cd66-c10a-442a-94d8-5e96a6f6af6b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:52.098937 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cf88b461-4ea3-44cf-8d25-7e05f9fa6f02 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1509 microversion: 2.1 time: 0.657101 May 19 04:47:52.103513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2839cd66-c10a-442a-94d8-5e96a6f6af6b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:52.103978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2839cd66-c10a-442a-94d8-5e96a6f6af6b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:52.104777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2839cd66-c10a-442a-94d8-5e96a6f6af6b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:52.105330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2839cd66-c10a-442a-94d8-5e96a6f6af6b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:52.115412 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1965/3861] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:51 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1509 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:52.252724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2839cd66-c10a-442a-94d8-5e96a6f6af6b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:52.272717 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2839cd66-c10a-442a-94d8-5e96a6f6af6b tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1275 microversion: 2.1 time: 0.187899 May 19 04:47:52.284156 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1897/3862] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:52 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:52.460076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d998a419-e07e-4f5d-b83f-e6c730de0534 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:52.461362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d998a419-e07e-4f5d-b83f-e6c730de0534 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:52.472124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d998a419-e07e-4f5d-b83f-e6c730de0534 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:52.476270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d998a419-e07e-4f5d-b83f-e6c730de0534 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:52.478490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d998a419-e07e-4f5d-b83f-e6c730de0534 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:52.479189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d998a419-e07e-4f5d-b83f-e6c730de0534 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:53.078779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9dd3e98b-905d-40bb-a94f-1da89edbd9a5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:53.079659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9dd3e98b-905d-40bb-a94f-1da89edbd9a5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:53.107476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9dd3e98b-905d-40bb-a94f-1da89edbd9a5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:53.108311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9dd3e98b-905d-40bb-a94f-1da89edbd9a5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:53.109375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9dd3e98b-905d-40bb-a94f-1da89edbd9a5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:53.110017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9dd3e98b-905d-40bb-a94f-1da89edbd9a5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:53.968799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d998a419-e07e-4f5d-b83f-e6c730de0534 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:54.003081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9dd3e98b-905d-40bb-a94f-1da89edbd9a5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:54.004599 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d998a419-e07e-4f5d-b83f-e6c730de0534 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 1.543550 May 19 04:47:54.011764 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9dd3e98b-905d-40bb-a94f-1da89edbd9a5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.936766 May 19 04:47:54.019535 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1966/3863] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:52 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:54.025614 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1898/3864] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:53 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:54.030046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:54.030675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:54.032672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8bcb9cf-97f8-40a5-b4c7-d3c7af921019 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:54.033605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8bcb9cf-97f8-40a5-b4c7-d3c7af921019 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:54.048848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8bcb9cf-97f8-40a5-b4c7-d3c7af921019 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.050401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8bcb9cf-97f8-40a5-b4c7-d3c7af921019 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.056307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.057097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.057701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8bcb9cf-97f8-40a5-b4c7-d3c7af921019 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.058282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8bcb9cf-97f8-40a5-b4c7-d3c7af921019 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.058513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.060662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.137658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.138262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.138918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lazy-loading 'fault' on Instance uuid bb046817-7e52-4f80-9158-8097be612892 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:47:54.242586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf4c99c319941c38a0d75d974869962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb0ddaaa4be4905805c063c2901ea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:54.252435 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-60b19079-d29a-491b-9a13-071c1ff1f6fc tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 200 len: 1305 microversion: 2.1 time: 0.231725 May 19 04:47:54.262181 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1967/3865] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:54 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 1305 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:54.274993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-958fae0e-2e38-42c4-a815-4891afc27cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1205021413", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "9cec0971-f13a-43c0-9d6c-c4c2488c3e91", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:54.426592 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-958fae0e-2e38-42c4-a815-4891afc27cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Block Device 9cec0971-f13a-43c0-9d6c-c4c2488c3e91 is not bootable. May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-958fae0e-2e38-42c4-a815-4891afc27cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 358 May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1205021413", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "9cec0971-f13a-43c0-9d6c-c4c2488c3e91", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: exception: Block Device 9cec0971-f13a-43c0-9d6c-c4c2488c3e91 is not bootable. May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1205021413', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '9cec0971-f13a-43c0-9d6c-c4c2488c3e91'}], 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 9cec0971-f13a-43c0-9d6c-c4c2488c3e91 is not bootable. May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:47:54.435835 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 9cec0971-f13a-43c0-9d6c-c4c2488c3e91 is not bootable. May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 9cec0971-f13a-43c0-9d6c-c4c2488c3e91 is not bootable. May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-958fae0e-2e38-42c4-a815-4891afc27cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Block Device 9cec0971-f13a-43c0-9d6c-c4c2488c3e91 is not bootable. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-958fae0e-2e38-42c4-a815-4891afc27cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.173963 May 19 04:47:54.439962 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1968/3866] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:47:54 2022] POST /compute/v2.1/servers => generated 110 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:47:54.443373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8850e12d-7ea8-4d55-a4f2-4fdb494c4176 req-1bcaee2f-3021-4d89-a2ab-9f4bd056e4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb046817-7e52-4f80-9158-8097be612892", "name": "network-vif-deleted", "tag": "f89cb6b4-303d-402d-b20e-fbf5fed092f4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:54.491385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8850e12d-7ea8-4d55-a4f2-4fdb494c4176 req-1bcaee2f-3021-4d89-a2ab-9f4bd056e4db service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.491844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8850e12d-7ea8-4d55-a4f2-4fdb494c4176 req-1bcaee2f-3021-4d89-a2ab-9f4bd056e4db service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.513456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8bcb9cf-97f8-40a5-b4c7-d3c7af921019 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:54.513900 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8850e12d-7ea8-4d55-a4f2-4fdb494c4176 req-1bcaee2f-3021-4d89-a2ab-9f4bd056e4db service nova] Creating event network-vif-deleted:f89cb6b4-303d-402d-b20e-fbf5fed092f4 for instance bb046817-7e52-4f80-9158-8097be612892 on n-h1-766726-30 May 19 04:47:54.522716 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8bcb9cf-97f8-40a5-b4c7-d3c7af921019 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1317 microversion: 2.1 time: 0.495587 May 19 04:47:54.526329 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8850e12d-7ea8-4d55-a4f2-4fdb494c4176 req-1bcaee2f-3021-4d89-a2ab-9f4bd056e4db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087081 May 19 04:47:54.527170 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1969/3867] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:54.533554 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1899/3868] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:54 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:54.539923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c740ba2-1c41-4ed9-a5ed-f7e682116d65 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:54.541856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6c740ba2-1c41-4ed9-a5ed-f7e682116d65 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:54.557679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c740ba2-1c41-4ed9-a5ed-f7e682116d65 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.559070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c740ba2-1c41-4ed9-a5ed-f7e682116d65 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.563308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c740ba2-1c41-4ed9-a5ed-f7e682116d65 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.563822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c740ba2-1c41-4ed9-a5ed-f7e682116d65 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.690353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d2a9cf5-1ed0-4c96-b1e2-718a46e23e14 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:54.691236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d2a9cf5-1ed0-4c96-b1e2-718a46e23e14 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:54.702137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cf5-1ed0-4c96-b1e2-718a46e23e14 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.704487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cf5-1ed0-4c96-b1e2-718a46e23e14 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.708331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cf5-1ed0-4c96-b1e2-718a46e23e14 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:54.709007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d2a9cf5-1ed0-4c96-b1e2-718a46e23e14 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:54.764073 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d2a9cf5-1ed0-4c96-b1e2-718a46e23e14 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/ips" status: 200 len: 149 microversion: 2.1 time: 0.077535 May 19 04:47:54.765714 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1900/3869] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:47:54 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/ips => generated 149 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:55.025508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd88dae4-2204-4abf-a1be-cf7e872f6492 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:55.026375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bd88dae4-2204-4abf-a1be-cf7e872f6492 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:55.036837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd88dae4-2204-4abf-a1be-cf7e872f6492 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:55.038959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd88dae4-2204-4abf-a1be-cf7e872f6492 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:55.040417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd88dae4-2204-4abf-a1be-cf7e872f6492 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:55.044072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd88dae4-2204-4abf-a1be-cf7e872f6492 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:55.712763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6c740ba2-1c41-4ed9-a5ed-f7e682116d65 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:55.723813 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6c740ba2-1c41-4ed9-a5ed-f7e682116d65 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 1.194407 May 19 04:47:55.724845 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1970/3870] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:54 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:55.756291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9adf187-caea-4c06-8f5b-6b18220a545d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:55.757042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a9adf187-caea-4c06-8f5b-6b18220a545d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:55.771036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bd88dae4-2204-4abf-a1be-cf7e872f6492 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:55.783543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9adf187-caea-4c06-8f5b-6b18220a545d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:55.784202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9adf187-caea-4c06-8f5b-6b18220a545d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:55.786394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9adf187-caea-4c06-8f5b-6b18220a545d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:55.787012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9adf187-caea-4c06-8f5b-6b18220a545d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:55.797778 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd88dae4-2204-4abf-a1be-cf7e872f6492 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 0.770091 May 19 04:47:55.798450 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1901/3871] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:55 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:47:55.813362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:55.831543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] [instance: bb046817-7e52-4f80-9158-8097be612892] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:55.861376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:55.861864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:55.862696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:55.863154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:55.970514 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] HTTP exception thrown: Instance bb046817-7e52-4f80-9158-8097be612892 could not be found. May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Request method failure captured: May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 HTTP/1.1 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcvVNUIuo6BargCXvr50ZfNMpzBs8EMDZCH19tgze-YPTZ1WPDiduiwqygiHDcxFVLISJdRsVlr4x-miyufSwbDffCAL4bzp_h1Jhfr0bb-ZW0uNFZYVXQ6WDzAdGm1nJSpYCf3KCRdn5LAgQ6IvU2ZZiNO7ZSTsSrI26subW_h5TlY May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 2bb0ddaaa4be4905805c063c2901ea69 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerAddressesTestJSON-970142601 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2bb0ddaaa4be4905805c063c2901ea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2bb0ddaaa4be4905805c063c2901ea69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2bb0ddaaa4be4905805c063c2901ea69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2bb0ddaaa4be4905805c063c2901ea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerAddressesTestJSON-970142601 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 2bb0ddaaa4be4905805c063c2901ea69 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerAddressesTestJSON-970142601 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerAddressesTestJSON-970142601-project May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: fdf4c99c319941c38a0d75d974869962 May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerAddressesTestJSON-970142601-project May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance bb046817-7e52-4f80-9158-8097be612892 could not be found. May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'bb046817-7e52-4f80-9158-8097be612892'} May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb046817-7e52-4f80-9158-8097be612892 could not be found. May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb046817-7e52-4f80-9158-8097be612892 could not be found. May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:47:56.004194 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:56.009179 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:47:56.009179 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:47:56.009179 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:47:56.009179 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:47:56.009179 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:47:56.009179 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb046817-7e52-4f80-9158-8097be612892 could not be found. May 19 04:47:56.009179 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:47:56.018072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] Returning 404 to user: Instance bb046817-7e52-4f80-9158-8097be612892 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:47:56.019363 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b3fb571-659e-4e95-9144-e8cf45138221 tempest-ServerAddressesTestJSON-970142601 tempest-ServerAddressesTestJSON-970142601-project] 10.222.0.58 "GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892" status: 404 len: 111 microversion: 2.1 time: 0.219957 May 19 04:47:56.020565 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1902/3872] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:55 2022] GET /compute/v2.1/servers/bb046817-7e52-4f80-9158-8097be612892 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:47:56.029250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0fc443f9-6e16-4429-b512-c00f20be08a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:56.031152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0fc443f9-6e16-4429-b512-c00f20be08a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:56.069833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc443f9-6e16-4429-b512-c00f20be08a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:56.070692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc443f9-6e16-4429-b512-c00f20be08a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:56.072026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc443f9-6e16-4429-b512-c00f20be08a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:56.072735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc443f9-6e16-4429-b512-c00f20be08a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:56.448692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a9adf187-caea-4c06-8f5b-6b18220a545d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:56.473513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a9adf187-caea-4c06-8f5b-6b18220a545d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.732726 May 19 04:47:56.474771 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1971/3873] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:55 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:56.480642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1213b2ba-586f-4069-a506-b9ba84ecb3d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:56.494011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1213b2ba-586f-4069-a506-b9ba84ecb3d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:56.501502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1213b2ba-586f-4069-a506-b9ba84ecb3d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:56.502276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1213b2ba-586f-4069-a506-b9ba84ecb3d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:56.503268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1213b2ba-586f-4069-a506-b9ba84ecb3d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:56.503937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1213b2ba-586f-4069-a506-b9ba84ecb3d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:56.626638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0fc443f9-6e16-4429-b512-c00f20be08a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:56.635418 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0fc443f9-6e16-4429-b512-c00f20be08a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1317 microversion: 2.1 time: 0.613508 May 19 04:47:56.645069 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1903/3874] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:56 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:56.817057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3bbd0cf6-f282-404d-9a9a-27a170189b23 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:56.819733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3bbd0cf6-f282-404d-9a9a-27a170189b23 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:56.831574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bbd0cf6-f282-404d-9a9a-27a170189b23 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:56.834035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bbd0cf6-f282-404d-9a9a-27a170189b23 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:56.836824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bbd0cf6-f282-404d-9a9a-27a170189b23 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:56.839078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bbd0cf6-f282-404d-9a9a-27a170189b23 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:56.990463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:57.073675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:57.274306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1213b2ba-586f-4069-a506-b9ba84ecb3d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:57.339101 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1213b2ba-586f-4069-a506-b9ba84ecb3d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.861416 May 19 04:47:57.340903 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1972/3875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:56 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:57.360480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-03adb3ad-529f-4ba0-8ba2-210a9a168e97 req-4a02dc4b-6c16-4750-818b-118f258cccb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7f7404-29e2-440c-9401-8140ee40b93c", "tag": "9f755bfd-7f80-4567-9482-70cd78b6f855"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:57.408656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-03adb3ad-529f-4ba0-8ba2-210a9a168e97 req-4a02dc4b-6c16-4750-818b-118f258cccb1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:57.410407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-03adb3ad-529f-4ba0-8ba2-210a9a168e97 req-4a02dc4b-6c16-4750-818b-118f258cccb1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:57.439995 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-03adb3ad-529f-4ba0-8ba2-210a9a168e97 req-4a02dc4b-6c16-4750-818b-118f258cccb1 service nova] Creating event network-changed:9f755bfd-7f80-4567-9482-70cd78b6f855 for instance 2e7f7404-29e2-440c-9401-8140ee40b93c on n-h1-766726-30 May 19 04:47:57.457959 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-03adb3ad-529f-4ba0-8ba2-210a9a168e97 req-4a02dc4b-6c16-4750-818b-118f258cccb1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112545 May 19 04:47:57.459408 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1973/3876] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:57.492921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-faf3df6b-44b4-40f1-a166-1bb4e15ce36a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:57.494078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-faf3df6b-44b4-40f1-a166-1bb4e15ce36a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:57.528206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-faf3df6b-44b4-40f1-a166-1bb4e15ce36a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:57.529047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-faf3df6b-44b4-40f1-a166-1bb4e15ce36a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:57.531913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-faf3df6b-44b4-40f1-a166-1bb4e15ce36a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:57.534102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-faf3df6b-44b4-40f1-a166-1bb4e15ce36a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:58.214000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:58.252483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3bbd0cf6-f282-404d-9a9a-27a170189b23 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:58.267686 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3bbd0cf6-f282-404d-9a9a-27a170189b23 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 1.454508 May 19 04:47:58.270172 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1904/3877] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:56 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:58.286678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9471991a-6679-48de-b479-69c3796bd980 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:58.290666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9471991a-6679-48de-b479-69c3796bd980 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:58.327808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9471991a-6679-48de-b479-69c3796bd980 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:58.335463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9471991a-6679-48de-b479-69c3796bd980 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:58.336913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9471991a-6679-48de-b479-69c3796bd980 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:58.338138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9471991a-6679-48de-b479-69c3796bd980 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:58.901922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-faf3df6b-44b4-40f1-a166-1bb4e15ce36a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:58.913367 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-faf3df6b-44b4-40f1-a166-1bb4e15ce36a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 1.425938 May 19 04:47:58.915786 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1974/3878] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:57 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:47:58.920878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33f8bb54-4648-4a2b-b2a1-261f919b911b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccf436bb-46e1-4fb0-b166-f086e564f291"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:47:58.932403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-33f8bb54-4648-4a2b-b2a1-261f919b911b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:58.997887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f8bb54-4648-4a2b-b2a1-261f919b911b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:58.998346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f8bb54-4648-4a2b-b2a1-261f919b911b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:58.999155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f8bb54-4648-4a2b-b2a1-261f919b911b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:58.999593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f8bb54-4648-4a2b-b2a1-261f919b911b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:59.516608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9471991a-6679-48de-b479-69c3796bd980 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:47:59.522475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:47:59.547668 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9471991a-6679-48de-b479-69c3796bd980 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1317 microversion: 2.1 time: 1.276209 May 19 04:47:59.552077 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1905/3879] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:58 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1317 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:47:59.583289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ce331cd-96e9-48ac-9832-e930c56bf623 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:59.587335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3ce331cd-96e9-48ac-9832-e930c56bf623 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:59.613708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ce331cd-96e9-48ac-9832-e930c56bf623 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:59.626117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ce331cd-96e9-48ac-9832-e930c56bf623 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:59.628668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ce331cd-96e9-48ac-9832-e930c56bf623 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:59.631336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ce331cd-96e9-48ac-9832-e930c56bf623 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:59.645326 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-33f8bb54-4648-4a2b-b2a1-261f919b911b tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "POST /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.727854 May 19 04:47:59.654971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1975/3880] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:47:58 2022] POST /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:47:59.932484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6851fd72-ba62-44f5-b9e9-9298ac52f13a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:47:59.933619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6851fd72-ba62-44f5-b9e9-9298ac52f13a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:47:59.953182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6851fd72-ba62-44f5-b9e9-9298ac52f13a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:59.953182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6851fd72-ba62-44f5-b9e9-9298ac52f13a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:47:59.962162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6851fd72-ba62-44f5-b9e9-9298ac52f13a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:47:59.963741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6851fd72-ba62-44f5-b9e9-9298ac52f13a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:00.371619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3ce331cd-96e9-48ac-9832-e930c56bf623 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:00.387560 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ce331cd-96e9-48ac-9832-e930c56bf623 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 0.825476 May 19 04:48:00.391592 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1906/3881] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:59 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:00.568926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a951006a-d8fa-4198-9511-ef062f8d403c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:00.570572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a951006a-d8fa-4198-9511-ef062f8d403c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:00.584663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a951006a-d8fa-4198-9511-ef062f8d403c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:00.586899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a951006a-d8fa-4198-9511-ef062f8d403c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:00.588114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a951006a-d8fa-4198-9511-ef062f8d403c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:00.590758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a951006a-d8fa-4198-9511-ef062f8d403c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:00.639189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6851fd72-ba62-44f5-b9e9-9298ac52f13a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:00.657023 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6851fd72-ba62-44f5-b9e9-9298ac52f13a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.725553 May 19 04:48:00.676279 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1976/3882] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:47:59 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:00.689774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ec2f0351-8f1e-4086-89ca-b32e1f5435b5 req-5ed6e4fa-3967-42ce-81ac-4bf8bc3dc01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65e1833-35ad-47bd-b9a2-5565e8ef7086", "tag": "2327a101-3cee-4de1-8100-8e9a526e85b5"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:00.713042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ec2f0351-8f1e-4086-89ca-b32e1f5435b5 req-5ed6e4fa-3967-42ce-81ac-4bf8bc3dc01a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:00.715938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ec2f0351-8f1e-4086-89ca-b32e1f5435b5 req-5ed6e4fa-3967-42ce-81ac-4bf8bc3dc01a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:00.772405 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ec2f0351-8f1e-4086-89ca-b32e1f5435b5 req-5ed6e4fa-3967-42ce-81ac-4bf8bc3dc01a service nova] Creating event network-changed:2327a101-3cee-4de1-8100-8e9a526e85b5 for instance d65e1833-35ad-47bd-b9a2-5565e8ef7086 on n-h2-766726-30 May 19 04:48:00.790626 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ec2f0351-8f1e-4086-89ca-b32e1f5435b5 req-5ed6e4fa-3967-42ce-81ac-4bf8bc3dc01a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099723 May 19 04:48:00.794911 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1977/3883] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 19 04:48:01.410604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51635aaf-4b68-4b19-bcee-79da0e964291 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:01.414467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-51635aaf-4b68-4b19-bcee-79da0e964291 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:01.447585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51635aaf-4b68-4b19-bcee-79da0e964291 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:01.449824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51635aaf-4b68-4b19-bcee-79da0e964291 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:01.453141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51635aaf-4b68-4b19-bcee-79da0e964291 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:01.453788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51635aaf-4b68-4b19-bcee-79da0e964291 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:01.536247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a951006a-d8fa-4198-9511-ef062f8d403c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:01.550156 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a951006a-d8fa-4198-9511-ef062f8d403c tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1317 microversion: 2.1 time: 0.981808 May 19 04:48:01.556926 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1907/3884] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:00 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1317 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:01.692196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cd5a89af-d3c2-46c4-b7b5-d9bc5c55151b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:01.693717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cd5a89af-d3c2-46c4-b7b5-d9bc5c55151b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:01.725891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd5a89af-d3c2-46c4-b7b5-d9bc5c55151b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:01.727572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd5a89af-d3c2-46c4-b7b5-d9bc5c55151b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:01.729248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd5a89af-d3c2-46c4-b7b5-d9bc5c55151b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:01.730804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd5a89af-d3c2-46c4-b7b5-d9bc5c55151b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:03.157311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-51635aaf-4b68-4b19-bcee-79da0e964291 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:03.171686 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51635aaf-4b68-4b19-bcee-79da0e964291 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 1.767284 May 19 04:48:03.181967 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1978/3885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:01 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:03.187190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55d3a346-3ba3-499f-8cca-93f30a9f8605 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:03.187818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-55d3a346-3ba3-499f-8cca-93f30a9f8605 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:03.195050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55d3a346-3ba3-499f-8cca-93f30a9f8605 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:03.195506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55d3a346-3ba3-499f-8cca-93f30a9f8605 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:03.196294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55d3a346-3ba3-499f-8cca-93f30a9f8605 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:03.196738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55d3a346-3ba3-499f-8cca-93f30a9f8605 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:03.356965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cd5a89af-d3c2-46c4-b7b5-d9bc5c55151b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:03.368359 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cd5a89af-d3c2-46c4-b7b5-d9bc5c55151b tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 1.680071 May 19 04:48:03.371407 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1908/3886] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:01 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:03.395819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30ce9062-ea04-4bd6-a5f8-dd3308dcc0c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-215514076", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a784e77f-4241-416d-b5b0-40834f7e24eb", "destination_type": "local"}, {"source_type": "volume", "uuid": "3327d380-c314-4dfe-a4e2-8c1f4f42bbc3", "destination_type": "invalid"}], "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30ce9062-ea04-4bd6-a5f8-dd3308dcc0c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 494 May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-215514076", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a784e77f-4241-416d-b5b0-40834f7e24eb", "destination_type": "local"}, {"source_type": "volume", "uuid": "3327d380-c314-4dfe-a4e2-8c1f4f42bbc3", "destination_type": "invalid"}], "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-215514076', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '3327d380-c314-4dfe-a4e2-8c1f4f42bbc3', 'destination_type': 'invalid'}], 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'invalid' May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:03.399058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30ce9062-ea04-4bd6-a5f8-dd3308dcc0c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-30ce9062-ea04-4bd6-a5f8-dd3308dcc0c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022234 May 19 04:48:03.403723 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1909/3887] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:03 2022] POST /compute/v2.1/servers => generated 155 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:03.435550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a29d4522-3167-4ff7-aabe-c596142513ff tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:03.436167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a29d4522-3167-4ff7-aabe-c596142513ff tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:03.482262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a29d4522-3167-4ff7-aabe-c596142513ff tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:03.482722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a29d4522-3167-4ff7-aabe-c596142513ff tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:03.495676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a29d4522-3167-4ff7-aabe-c596142513ff tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:03.498959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a29d4522-3167-4ff7-aabe-c596142513ff tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:04.019078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55d3a346-3ba3-499f-8cca-93f30a9f8605 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:04.037289 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-55d3a346-3ba3-499f-8cca-93f30a9f8605 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1317 microversion: 2.1 time: 0.848310 May 19 04:48:04.053428 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1979/3888] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:03 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:04.190935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b5ec0c02-39c0-42e2-9254-11a98d7ac1d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:04.192477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b5ec0c02-39c0-42e2-9254-11a98d7ac1d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:04.206126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5ec0c02-39c0-42e2-9254-11a98d7ac1d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:04.210361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5ec0c02-39c0-42e2-9254-11a98d7ac1d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:04.215754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5ec0c02-39c0-42e2-9254-11a98d7ac1d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:04.216932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5ec0c02-39c0-42e2-9254-11a98d7ac1d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:04.255668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a29d4522-3167-4ff7-aabe-c596142513ff tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:04.263639 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a29d4522-3167-4ff7-aabe-c596142513ff tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.831881 May 19 04:48:04.281839 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1910/3889] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:03 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:04.284591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:04.307662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a63a3b2d-8cd8-46bc-9e24-c1af2abc79bf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:04.308534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a63a3b2d-8cd8-46bc-9e24-c1af2abc79bf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:04.339322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a63a3b2d-8cd8-46bc-9e24-c1af2abc79bf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:04.343450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a63a3b2d-8cd8-46bc-9e24-c1af2abc79bf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:04.349912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a63a3b2d-8cd8-46bc-9e24-c1af2abc79bf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:04.352382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a63a3b2d-8cd8-46bc-9e24-c1af2abc79bf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:04.622291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5ec0c02-39c0-42e2-9254-11a98d7ac1d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:04.648113 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b5ec0c02-39c0-42e2-9254-11a98d7ac1d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 0.462611 May 19 04:48:04.648720 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1980/3890] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:04 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:04.695410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6025ee9b-e242-4fae-9254-ca671bc840bb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:04.698528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6025ee9b-e242-4fae-9254-ca671bc840bb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:04.718496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6025ee9b-e242-4fae-9254-ca671bc840bb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:04.719323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6025ee9b-e242-4fae-9254-ca671bc840bb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:04.720510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6025ee9b-e242-4fae-9254-ca671bc840bb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:04.721251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6025ee9b-e242-4fae-9254-ca671bc840bb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:05.013476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a63a3b2d-8cd8-46bc-9e24-c1af2abc79bf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:05.039201 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a63a3b2d-8cd8-46bc-9e24-c1af2abc79bf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.750117 May 19 04:48:05.044350 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1911/3891] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:04 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:05.132483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6025ee9b-e242-4fae-9254-ca671bc840bb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:05.138898 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6025ee9b-e242-4fae-9254-ca671bc840bb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.489005 May 19 04:48:05.139592 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1981/3892] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:04 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:05.151222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5fe096d-b46b-4379-941f-f61602c69ad7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:05.152321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5fe096d-b46b-4379-941f-f61602c69ad7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:05.167460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5fe096d-b46b-4379-941f-f61602c69ad7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:05.169307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5fe096d-b46b-4379-941f-f61602c69ad7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:05.170273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5fe096d-b46b-4379-941f-f61602c69ad7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:05.172015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5fe096d-b46b-4379-941f-f61602c69ad7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:05.409471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-190943279", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "3601b445-9f4c-4f51-9205-ea1bdc66f653"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:05.482287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5fe096d-b46b-4379-941f-f61602c69ad7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:05.495031 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5fe096d-b46b-4379-941f-f61602c69ad7 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1317 microversion: 2.1 time: 0.353859 May 19 04:48:05.495688 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1982/3893] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:05 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:05.507098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9636b6fe-5398-473d-b0b8-fbe1b29b0501 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1001077240", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9636b6fe-5398-473d-b0b8-fbe1b29b0501 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 492 May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1001077240", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1001077240', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: May 19 04:48:05.510290 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 19 04:48:05.514442 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:05.517529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9636b6fe-5398-473d-b0b8-fbe1b29b0501 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:05.518621 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9636b6fe-5398-473d-b0b8-fbe1b29b0501 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.021327 May 19 04:48:05.519594 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1983/3894] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:05 2022] POST /compute/v2.1/servers => generated 624 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:05.574506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] validate_networks() for [('3601b445-9f4c-4f51-9205-ea1bdc66f653', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:48:05.642076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1448756492", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "11e9c64f-ee67-4170-afaa-b3e9a9252ee8"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:05.738288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] validate_networks() for [('11e9c64f-ee67-4170-afaa-b3e9a9252ee8', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:48:06.679196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:48:06.679857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:48:06.680107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:48:06.680508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:48:06.680926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:48:06.708836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:06.709326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:06.710161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:06.710597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:06.731877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Getting quotas for project db63bb8dc64849a982520a0311708c8e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:48:06.737733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Getting quotas for user 4a7077ffd45e4709b9ad138ebd9a6ad5 and project db63bb8dc64849a982520a0311708c8e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:48:06.752660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:48:06.755327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:48:06.782551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:48:06.783932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:48:06.784831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:48:06.785540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:48:06.786206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:48:06.822292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:06.823247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:06.825006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:06.826147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:06.832552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7a11e71-5f0b-4dbf-a9d0-af25a5a5df25 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.311690 May 19 04:48:06.833898 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1984/3895] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:48:06.840373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f4ba1441-3439-49e9-8af6-7b93d7ba1e61 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:06.841000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f4ba1441-3439-49e9-8af6-7b93d7ba1e61 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:06.848211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4ba1441-3439-49e9-8af6-7b93d7ba1e61 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:06.848211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4ba1441-3439-49e9-8af6-7b93d7ba1e61 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:06.848887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4ba1441-3439-49e9-8af6-7b93d7ba1e61 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:06.849734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4ba1441-3439-49e9-8af6-7b93d7ba1e61 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:06.878334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Getting quotas for project 097bae0ccbdd475f9343ed9a6a701209. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:48:06.896028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Getting quotas for user e8c705c49e7943c8910805eed77c05b8 and project 097bae0ccbdd475f9343ed9a6a701209. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:48:06.932041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:48:06.936193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:48:06.992485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:07.032332 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d4e04864-7a1b-436e-858e-787f6fc3282e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.980081 May 19 04:48:07.035533 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1912/3896] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:48:07.046581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f659aa58-4802-436c-a2a1-51e5cd05a558 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:07.047642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f659aa58-4802-436c-a2a1-51e5cd05a558 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:07.061246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f659aa58-4802-436c-a2a1-51e5cd05a558 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.061977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f659aa58-4802-436c-a2a1-51e5cd05a558 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.077113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f659aa58-4802-436c-a2a1-51e5cd05a558 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.080932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f659aa58-4802-436c-a2a1-51e5cd05a558 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.149892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4ba1441-3439-49e9-8af6-7b93d7ba1e61 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:07.162856 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f4ba1441-3439-49e9-8af6-7b93d7ba1e61 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.327189 May 19 04:48:07.163775 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1985/3897] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:06 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:07.182567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6223b28d-8447-4163-84f3-fffdfcc27fe8 req-fd8f4fcb-4725-4fa0-965e-31248a8052e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7f7404-29e2-440c-9401-8140ee40b93c", "name": "network-vif-plugged", "status": "completed", "tag": "9f755bfd-7f80-4567-9482-70cd78b6f855"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:07.205216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6223b28d-8447-4163-84f3-fffdfcc27fe8 req-fd8f4fcb-4725-4fa0-965e-31248a8052e4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.205669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6223b28d-8447-4163-84f3-fffdfcc27fe8 req-fd8f4fcb-4725-4fa0-965e-31248a8052e4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.224658 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6223b28d-8447-4163-84f3-fffdfcc27fe8 req-fd8f4fcb-4725-4fa0-965e-31248a8052e4 service nova] Creating event network-vif-plugged:9f755bfd-7f80-4567-9482-70cd78b6f855 for instance 2e7f7404-29e2-440c-9401-8140ee40b93c on n-h1-766726-30 May 19 04:48:07.241686 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6223b28d-8447-4163-84f3-fffdfcc27fe8 req-fd8f4fcb-4725-4fa0-965e-31248a8052e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076365 May 19 04:48:07.242442 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1986/3898] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:07.250741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2151fc68-d503-438f-ba47-a92d007799df tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:07.251646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2151fc68-d503-438f-ba47-a92d007799df tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:07.264611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2151fc68-d503-438f-ba47-a92d007799df tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.265104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2151fc68-d503-438f-ba47-a92d007799df tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.265907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2151fc68-d503-438f-ba47-a92d007799df tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.278200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2151fc68-d503-438f-ba47-a92d007799df tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.453564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f659aa58-4802-436c-a2a1-51e5cd05a558 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:07.470038 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f659aa58-4802-436c-a2a1-51e5cd05a558 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1681 microversion: 2.1 time: 0.433318 May 19 04:48:07.471448 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1913/3899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:07 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1681 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:07.484285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-355b6341-9355-4dbf-a5a7-70ade32f0851 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:07.485016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-355b6341-9355-4dbf-a5a7-70ade32f0851 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:07.491711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-355b6341-9355-4dbf-a5a7-70ade32f0851 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.495273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-355b6341-9355-4dbf-a5a7-70ade32f0851 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.502156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-355b6341-9355-4dbf-a5a7-70ade32f0851 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.502770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-355b6341-9355-4dbf-a5a7-70ade32f0851 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.665093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2151fc68-d503-438f-ba47-a92d007799df tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:07.705425 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2151fc68-d503-438f-ba47-a92d007799df tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.460257 May 19 04:48:07.708069 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1987/3900] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:07 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:07.720119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:07.722212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:07.733458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.734174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.736511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.737264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.921136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:07.930426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-355b6341-9355-4dbf-a5a7-70ade32f0851 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:07.935685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:07.940772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:07.943085 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-355b6341-9355-4dbf-a5a7-70ade32f0851 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1317 microversion: 2.1 time: 0.470364 May 19 04:48:07.944064 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1914/3901] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:07 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:07.944859 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9ef2bbd7-dae0-440a-8449-7c951ca56bd7 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1266 microversion: 2.26 time: 0.234727 May 19 04:48:07.945544 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1988/3902] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:07 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:07.959494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b526153-c1b3-4c08-9e97-838cdee9ad3d tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:07.960486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b526153-c1b3-4c08-9e97-838cdee9ad3d tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:07.970402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b526153-c1b3-4c08-9e97-838cdee9ad3d tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.971196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b526153-c1b3-4c08-9e97-838cdee9ad3d tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.972382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b526153-c1b3-4c08-9e97-838cdee9ad3d tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:07.973031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b526153-c1b3-4c08-9e97-838cdee9ad3d tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:07.985532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-534b5735-8004-4aa1-ad0a-77af487db31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:07.988129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-534b5735-8004-4aa1-ad0a-77af487db31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:08.003396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-534b5735-8004-4aa1-ad0a-77af487db31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.004195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-534b5735-8004-4aa1-ad0a-77af487db31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.005417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-534b5735-8004-4aa1-ad0a-77af487db31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.006260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-534b5735-8004-4aa1-ad0a-77af487db31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.126257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b526153-c1b3-4c08-9e97-838cdee9ad3d tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:08.140732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b526153-c1b3-4c08-9e97-838cdee9ad3d tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1228 microversion: 2.1 time: 0.191074 May 19 04:48:08.146720 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1915/3903] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:07 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1228 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:08.192062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-534b5735-8004-4aa1-ad0a-77af487db31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:08.202319 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-534b5735-8004-4aa1-ad0a-77af487db31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.243694 May 19 04:48:08.217757 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1989/3904] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:07 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:08.270444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92a7bb94-a732-46f7-a3fc-3cfc9599cb3e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92a7bb94-a732-46f7-a3fc-3cfc9599cb3e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 416 May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:08.272899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92a7bb94-a732-46f7-a3fc-3cfc9599cb3e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:08.276271 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92a7bb94-a732-46f7-a3fc-3cfc9599cb3e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009796 May 19 04:48:08.288388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-58dd8128-d31c-4b44-9f7a-e13bc1e6a2a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:08.289100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-58dd8128-d31c-4b44-9f7a-e13bc1e6a2a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:08.289209 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1916/3905] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:08 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:08.297517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58dd8128-d31c-4b44-9f7a-e13bc1e6a2a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.297977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58dd8128-d31c-4b44-9f7a-e13bc1e6a2a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.298957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58dd8128-d31c-4b44-9f7a-e13bc1e6a2a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.299449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58dd8128-d31c-4b44-9f7a-e13bc1e6a2a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.346566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1937921138", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:08.429512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:48:08.585436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-58dd8128-d31c-4b44-9f7a-e13bc1e6a2a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:08.593659 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-58dd8128-d31c-4b44-9f7a-e13bc1e6a2a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.311090 May 19 04:48:08.594240 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1990/3906] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:08 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:08.602272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c6bc21af-ee34-40e8-a7fe-c9fc0bf6c7f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:08.605671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c6bc21af-ee34-40e8-a7fe-c9fc0bf6c7f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:08.614757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6bc21af-ee34-40e8-a7fe-c9fc0bf6c7f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.615460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6bc21af-ee34-40e8-a7fe-c9fc0bf6c7f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.616415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6bc21af-ee34-40e8-a7fe-c9fc0bf6c7f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.617028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6bc21af-ee34-40e8-a7fe-c9fc0bf6c7f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.772404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:48:08.773831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:48:08.774405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:48:08.774920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:48:08.775908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:48:08.786782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.787347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.788545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.789374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.806849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c6bc21af-ee34-40e8-a7fe-c9fc0bf6c7f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:08.809757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Getting quotas for project 8986f51da57b49a2b3cee0f0edc70c01. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:48:08.815942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Getting quotas for user 231a3d54326d4685a75c9c1cac8f0545 and project 8986f51da57b49a2b3cee0f0edc70c01. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:48:08.816389 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c6bc21af-ee34-40e8-a7fe-c9fc0bf6c7f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.217762 May 19 04:48:08.816989 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1991/3907] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:08 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:08.821944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0c516ccf-fdaa-4f41-9606-2029947cdbd5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:08.822554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0c516ccf-fdaa-4f41-9606-2029947cdbd5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:08.829514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c516ccf-fdaa-4f41-9606-2029947cdbd5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.829933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c516ccf-fdaa-4f41-9606-2029947cdbd5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.830708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c516ccf-fdaa-4f41-9606-2029947cdbd5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.831401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c516ccf-fdaa-4f41-9606-2029947cdbd5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.838898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:48:08.842196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:48:08.939098 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3abe5c10-64ce-40ac-b7c4-9aa1887a7e6e tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599551 May 19 04:48:08.943720 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1917/3908] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 04:48:08.953891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4f7c0664-e371-4d3c-9c93-798583d3c720 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:08.954837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4f7c0664-e371-4d3c-9c93-798583d3c720 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:08.964287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f7c0664-e371-4d3c-9c93-798583d3c720 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.965265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f7c0664-e371-4d3c-9c93-798583d3c720 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:08.966513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f7c0664-e371-4d3c-9c93-798583d3c720 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:08.967181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f7c0664-e371-4d3c-9c93-798583d3c720 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:09.028235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0c516ccf-fdaa-4f41-9606-2029947cdbd5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:09.036979 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0c516ccf-fdaa-4f41-9606-2029947cdbd5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.218808 May 19 04:48:09.044441 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1992/3909] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:08 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:09.054777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a3b1bd4-8414-44d4-bcc6-3443406e5371 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:09.058963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a3b1bd4-8414-44d4-bcc6-3443406e5371 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:09.063769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:09.070481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a3b1bd4-8414-44d4-bcc6-3443406e5371 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:09.071847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a3b1bd4-8414-44d4-bcc6-3443406e5371 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:09.072870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a3b1bd4-8414-44d4-bcc6-3443406e5371 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:09.074659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a3b1bd4-8414-44d4-bcc6-3443406e5371 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:09.142336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4f7c0664-e371-4d3c-9c93-798583d3c720 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:09.152827 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4f7c0664-e371-4d3c-9c93-798583d3c720 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.203365 May 19 04:48:09.155971 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1918/3910] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:08 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:09.173939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dce00477-dfa2-4775-b268-fba45f446f86 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:09.174579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dce00477-dfa2-4775-b268-fba45f446f86 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:09.290239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dce00477-dfa2-4775-b268-fba45f446f86 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:09.306163 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dce00477-dfa2-4775-b268-fba45f446f86 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1214 microversion: 2.1 time: 0.144131 May 19 04:48:09.306801 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1919/3911] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:09 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:09.321050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c0da6d8-fee0-4b81-908b-e75b5d6c37b4 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:09.321742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c0da6d8-fee0-4b81-908b-e75b5d6c37b4 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:09.343710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a3b1bd4-8414-44d4-bcc6-3443406e5371 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:09.354593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c0da6d8-fee0-4b81-908b-e75b5d6c37b4 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:09.357830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c0da6d8-fee0-4b81-908b-e75b5d6c37b4 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:09.360245 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a3b1bd4-8414-44d4-bcc6-3443406e5371 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.314143 May 19 04:48:09.362864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c0da6d8-fee0-4b81-908b-e75b5d6c37b4 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:09.365633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c0da6d8-fee0-4b81-908b-e75b5d6c37b4 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:09.366026 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1993/3912] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:09 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:09.397122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:09.398814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:09.415932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:09.419724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:09.423922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:09.426494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:09.783579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:09.799290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:09.801659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:09.807511 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cad91082-6977-4bb9-9253-d8345a5289cc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1322 microversion: 2.26 time: 0.439008 May 19 04:48:09.811670 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1994/3913] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:09 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:09.825847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d6791a09-f4a9-4ad5-a040-5f5945b73720 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-421552922", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": -1, "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:09.850941 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-d6791a09-f4a9-4ad5-a040-5f5945b73720 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Flavor -1 could not be found. May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d6791a09-f4a9-4ad5-a040-5f5945b73720 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 205 May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-421552922", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": -1, "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: exception: Flavor -1 could not be found. May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-421552922', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': -1, 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 780, in create May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:09.858528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. May 19 04:48:09.864307 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:09.866960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d6791a09-f4a9-4ad5-a040-5f5945b73720 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:09.867872 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d6791a09-f4a9-4ad5-a040-5f5945b73720 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.054984 May 19 04:48:09.869251 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1995/3914] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:09 2022] POST /compute/v2.1/servers => generated 73 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 04:48:09.882703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-886be27b-728b-4e85-bf3e-69e12d0324d3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:09.883430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-886be27b-728b-4e85-bf3e-69e12d0324d3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:09.906091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-886be27b-728b-4e85-bf3e-69e12d0324d3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:09.908112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-886be27b-728b-4e85-bf3e-69e12d0324d3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:09.911464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-886be27b-728b-4e85-bf3e-69e12d0324d3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:09.912512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-886be27b-728b-4e85-bf3e-69e12d0324d3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:10.086555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-886be27b-728b-4e85-bf3e-69e12d0324d3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:10.111376 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-886be27b-728b-4e85-bf3e-69e12d0324d3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1282 microversion: 2.1 time: 0.240297 May 19 04:48:10.112563 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1996/3915] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:09 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1282 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:10.137918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a57341fa-774d-4bc7-b6ab-b3fd8475f92b req-30cf7c69-280e-486e-a2b1-76e51e3a30f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65e1833-35ad-47bd-b9a2-5565e8ef7086", "name": "network-vif-plugged", "status": "completed", "tag": "2327a101-3cee-4de1-8100-8e9a526e85b5"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:10.163678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a57341fa-774d-4bc7-b6ab-b3fd8475f92b req-30cf7c69-280e-486e-a2b1-76e51e3a30f4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:10.164445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a57341fa-774d-4bc7-b6ab-b3fd8475f92b req-30cf7c69-280e-486e-a2b1-76e51e3a30f4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:10.208767 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a57341fa-774d-4bc7-b6ab-b3fd8475f92b req-30cf7c69-280e-486e-a2b1-76e51e3a30f4 service nova] Creating event network-vif-plugged:2327a101-3cee-4de1-8100-8e9a526e85b5 for instance d65e1833-35ad-47bd-b9a2-5565e8ef7086 on n-h2-766726-30 May 19 04:48:10.216918 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a57341fa-774d-4bc7-b6ab-b3fd8475f92b req-30cf7c69-280e-486e-a2b1-76e51e3a30f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091823 May 19 04:48:10.217912 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1997/3916] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:10.224973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cb325bcc-5097-4515-a84e-c4c7bb854278 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:10.226499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb325bcc-5097-4515-a84e-c4c7bb854278 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:10.233944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb325bcc-5097-4515-a84e-c4c7bb854278 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:10.234716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c0da6d8-fee0-4b81-908b-e75b5d6c37b4 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:10.235201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb325bcc-5097-4515-a84e-c4c7bb854278 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:10.236930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb325bcc-5097-4515-a84e-c4c7bb854278 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:10.237609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb325bcc-5097-4515-a84e-c4c7bb854278 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:10.248715 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c0da6d8-fee0-4b81-908b-e75b5d6c37b4 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1317 microversion: 2.1 time: 0.935938 May 19 04:48:10.249355 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1920/3917] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:09 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:10.263067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa6d6784-0ec2-4b30-9ea3-d0f6ebf51511 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:10.263984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa6d6784-0ec2-4b30-9ea3-d0f6ebf51511 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:10.281813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d6784-0ec2-4b30-9ea3-d0f6ebf51511 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:10.282395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d6784-0ec2-4b30-9ea3-d0f6ebf51511 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:10.285062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d6784-0ec2-4b30-9ea3-d0f6ebf51511 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:10.288035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d6784-0ec2-4b30-9ea3-d0f6ebf51511 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.145393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cb325bcc-5097-4515-a84e-c4c7bb854278 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:11.162163 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cb325bcc-5097-4515-a84e-c4c7bb854278 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.942684 May 19 04:48:11.169863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fa6d6784-0ec2-4b30-9ea3-d0f6ebf51511 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:11.182146 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1998/3918] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:10 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:11.187857 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fa6d6784-0ec2-4b30-9ea3-d0f6ebf51511 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.933948 May 19 04:48:11.192931 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1921/3919] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:10 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:11.199681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-76a87f8b-a5c1-4644-9dfd-c1ca48dcde2c tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:11.202573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-76a87f8b-a5c1-4644-9dfd-c1ca48dcde2c tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:11.207386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:11.210727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:11.223139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76a87f8b-a5c1-4644-9dfd-c1ca48dcde2c tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.226731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76a87f8b-a5c1-4644-9dfd-c1ca48dcde2c tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.229512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76a87f8b-a5c1-4644-9dfd-c1ca48dcde2c tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.231455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76a87f8b-a5c1-4644-9dfd-c1ca48dcde2c tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.233633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.234537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.236906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.238799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.372138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-76a87f8b-a5c1-4644-9dfd-c1ca48dcde2c tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:11.382379 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-76a87f8b-a5c1-4644-9dfd-c1ca48dcde2c tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1272 microversion: 2.1 time: 0.197700 May 19 04:48:11.384229 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 1999/3920] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:11 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:11.403907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7f74e2b2-bfe7-4b9b-a946-7a64aa4fb510 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:11.404852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7f74e2b2-bfe7-4b9b-a946-7a64aa4fb510 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:11.422707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f74e2b2-bfe7-4b9b-a946-7a64aa4fb510 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.423484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f74e2b2-bfe7-4b9b-a946-7a64aa4fb510 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.426084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f74e2b2-bfe7-4b9b-a946-7a64aa4fb510 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.426835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f74e2b2-bfe7-4b9b-a946-7a64aa4fb510 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.468279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:11.476447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:11.478382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:11.479767 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7b22c3e-7898-4aff-8b48-47e77b13ce3b tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1362 microversion: 2.26 time: 0.285589 May 19 04:48:11.480588 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1922/3921] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:11 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:11.485505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7e6d03e-63c1-4a61-a0cf-0c9c3504cc87 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:11.486423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e7e6d03e-63c1-4a61-a0cf-0c9c3504cc87 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:11.495647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e6d03e-63c1-4a61-a0cf-0c9c3504cc87 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.496396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e6d03e-63c1-4a61-a0cf-0c9c3504cc87 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.497457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e6d03e-63c1-4a61-a0cf-0c9c3504cc87 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.498155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e6d03e-63c1-4a61-a0cf-0c9c3504cc87 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.562868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7e6d03e-63c1-4a61-a0cf-0c9c3504cc87 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:11.589481 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7e6d03e-63c1-4a61-a0cf-0c9c3504cc87 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1282 microversion: 2.1 time: 0.099475 May 19 04:48:11.593703 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1923/3922] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:11 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:11.599323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1bad270-cc1e-429e-a9d5-021e0eee9d81 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:11.606329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1bad270-cc1e-429e-a9d5-021e0eee9d81 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:11.623637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1bad270-cc1e-429e-a9d5-021e0eee9d81 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.626483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1bad270-cc1e-429e-a9d5-021e0eee9d81 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.629516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1bad270-cc1e-429e-a9d5-021e0eee9d81 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.630969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1bad270-cc1e-429e-a9d5-021e0eee9d81 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.655972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7f74e2b2-bfe7-4b9b-a946-7a64aa4fb510 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:11.664164 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7f74e2b2-bfe7-4b9b-a946-7a64aa4fb510 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.265311 May 19 04:48:11.666076 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2000/3923] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:11 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:11.671383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3df69d3d-60f6-411e-8470-48624119c8b3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:11.672497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3df69d3d-60f6-411e-8470-48624119c8b3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:11.685941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3df69d3d-60f6-411e-8470-48624119c8b3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.696055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3df69d3d-60f6-411e-8470-48624119c8b3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.701282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3df69d3d-60f6-411e-8470-48624119c8b3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:11.702086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3df69d3d-60f6-411e-8470-48624119c8b3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:11.718728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:12.049909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3df69d3d-60f6-411e-8470-48624119c8b3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:12.068575 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3df69d3d-60f6-411e-8470-48624119c8b3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1317 microversion: 2.1 time: 0.399638 May 19 04:48:12.077604 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2001/3924] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:11 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:12.083674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6b089c18-56f4-45ce-98f0-32af4d8b111f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:12.084324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6b089c18-56f4-45ce-98f0-32af4d8b111f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:12.085257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1bad270-cc1e-429e-a9d5-021e0eee9d81 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:12.095029 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1bad270-cc1e-429e-a9d5-021e0eee9d81 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.499684 May 19 04:48:12.096108 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1924/3925] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:11 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:12.096736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b089c18-56f4-45ce-98f0-32af4d8b111f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.097387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b089c18-56f4-45ce-98f0-32af4d8b111f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.098189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b089c18-56f4-45ce-98f0-32af4d8b111f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.098637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b089c18-56f4-45ce-98f0-32af4d8b111f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.188140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-529ffa1d-e04c-4883-86e2-70a677ed2bc9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1673127705", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-529ffa1d-e04c-4883-86e2-70a677ed2bc9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 173 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1673127705", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1673127705', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi -1 May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:12.190875 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-529ffa1d-e04c-4883-86e2-70a677ed2bc9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:12.195489 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-529ffa1d-e04c-4883-86e2-70a677ed2bc9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.008222 May 19 04:48:12.204683 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1925/3926] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:12 2022] POST /compute/v2.1/servers => generated 145 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:12.208831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3451a060-46b3-404d-a831-7676f5e4a9e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:12.209463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3451a060-46b3-404d-a831-7676f5e4a9e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:12.220123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3451a060-46b3-404d-a831-7676f5e4a9e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.233635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3451a060-46b3-404d-a831-7676f5e4a9e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.234935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3451a060-46b3-404d-a831-7676f5e4a9e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.235560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3451a060-46b3-404d-a831-7676f5e4a9e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.407868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6b089c18-56f4-45ce-98f0-32af4d8b111f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:12.426362 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6b089c18-56f4-45ce-98f0-32af4d8b111f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.350497 May 19 04:48:12.438463 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2002/3927] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:12 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:12.444509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1c142f1-a179-4479-9171-b2add9c5ab1a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:12.445410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1c142f1-a179-4479-9171-b2add9c5ab1a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:12.456669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1c142f1-a179-4479-9171-b2add9c5ab1a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.460100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1c142f1-a179-4479-9171-b2add9c5ab1a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.461144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1c142f1-a179-4479-9171-b2add9c5ab1a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.462195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1c142f1-a179-4479-9171-b2add9c5ab1a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.570893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3451a060-46b3-404d-a831-7676f5e4a9e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:12.585268 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3451a060-46b3-404d-a831-7676f5e4a9e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.380445 May 19 04:48:12.586046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1926/3928] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:12 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:12.594699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e39a3fd2-a5a2-4494-bda5-42652fa301ba req-5ff6014e-d62b-4dc6-8f94-d475bab5c426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "name": "network-vif-unplugged", "status": "completed", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:12.622795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e39a3fd2-a5a2-4494-bda5-42652fa301ba req-5ff6014e-d62b-4dc6-8f94-d475bab5c426 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.623187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e39a3fd2-a5a2-4494-bda5-42652fa301ba req-5ff6014e-d62b-4dc6-8f94-d475bab5c426 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.644422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e39a3fd2-a5a2-4494-bda5-42652fa301ba req-5ff6014e-d62b-4dc6-8f94-d475bab5c426 service nova] Creating event network-vif-unplugged:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:48:12.653207 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e39a3fd2-a5a2-4494-bda5-42652fa301ba req-5ff6014e-d62b-4dc6-8f94-d475bab5c426 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063231 May 19 04:48:12.654171 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1927/3929] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:12.664155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f89cd42d-7a89-4190-96a7-21bb8e81db12 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:12.665244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f89cd42d-7a89-4190-96a7-21bb8e81db12 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:12.673335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f89cd42d-7a89-4190-96a7-21bb8e81db12 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.674058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f89cd42d-7a89-4190-96a7-21bb8e81db12 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.675016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f89cd42d-7a89-4190-96a7-21bb8e81db12 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.675612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f89cd42d-7a89-4190-96a7-21bb8e81db12 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.710293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:12.910261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1c142f1-a179-4479-9171-b2add9c5ab1a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:12.930092 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1c142f1-a179-4479-9171-b2add9c5ab1a tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1472 microversion: 2.1 time: 0.490226 May 19 04:48:12.930699 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2003/3930] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:12 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:12.953391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7f6bba3b-e2a9-4747-a324-a2b306b1465f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:12.954009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7f6bba3b-e2a9-4747-a324-a2b306b1465f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:12.965287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f6bba3b-e2a9-4747-a324-a2b306b1465f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.965741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f6bba3b-e2a9-4747-a324-a2b306b1465f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:12.974066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f6bba3b-e2a9-4747-a324-a2b306b1465f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:12.974988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f6bba3b-e2a9-4747-a324-a2b306b1465f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.029048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f89cd42d-7a89-4190-96a7-21bb8e81db12 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:13.042168 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f89cd42d-7a89-4190-96a7-21bb8e81db12 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1314 microversion: 2.1 time: 0.386370 May 19 04:48:13.048251 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1928/3931] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:12 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:13.061603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:13.074241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:13.104040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.109922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.112135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.114533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.393762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:13.404481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:13.407131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:13.409028 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-842e9e27-842b-4328-a5ca-94f6c71091ba tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1362 microversion: 2.26 time: 0.359015 May 19 04:48:13.410234 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1929/3932] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:13 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:13.429403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-72921d38-7265-4094-b482-10b71bbbf65d req-c769eeff-c037-49b1-9473-03627c9de3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77617f7-bae8-44a5-a97c-3a1193d6c640", "tag": "fc291ee9-1271-481c-af63-67410b81cb60"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:13.447046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-72921d38-7265-4094-b482-10b71bbbf65d req-c769eeff-c037-49b1-9473-03627c9de3d3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.447886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-72921d38-7265-4094-b482-10b71bbbf65d req-c769eeff-c037-49b1-9473-03627c9de3d3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.460157 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-72921d38-7265-4094-b482-10b71bbbf65d req-c769eeff-c037-49b1-9473-03627c9de3d3 service nova] Creating event network-changed:fc291ee9-1271-481c-af63-67410b81cb60 for instance f77617f7-bae8-44a5-a97c-3a1193d6c640 on n-h1-766726-30 May 19 04:48:13.466496 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-72921d38-7265-4094-b482-10b71bbbf65d req-c769eeff-c037-49b1-9473-03627c9de3d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047498 May 19 04:48:13.467401 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1930/3933] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:13.472787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b6220b4-8bb1-4aea-bba3-5bde15a60bab tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:13.473853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5b6220b4-8bb1-4aea-bba3-5bde15a60bab tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:13.476553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7f6bba3b-e2a9-4747-a324-a2b306b1465f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:13.484342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b6220b4-8bb1-4aea-bba3-5bde15a60bab tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.485262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b6220b4-8bb1-4aea-bba3-5bde15a60bab tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.486246 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7f6bba3b-e2a9-4747-a324-a2b306b1465f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.540013 May 19 04:48:13.486696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b6220b4-8bb1-4aea-bba3-5bde15a60bab tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.487836 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2004/3934] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:12 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:13.498529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82820808-1dd9-4eef-9fee-b4b3a991e6a0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:13.499151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82820808-1dd9-4eef-9fee-b4b3a991e6a0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:13.500049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b6220b4-8bb1-4aea-bba3-5bde15a60bab tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.515163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82820808-1dd9-4eef-9fee-b4b3a991e6a0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.526128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82820808-1dd9-4eef-9fee-b4b3a991e6a0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.527553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82820808-1dd9-4eef-9fee-b4b3a991e6a0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.528004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82820808-1dd9-4eef-9fee-b4b3a991e6a0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.701671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5b6220b4-8bb1-4aea-bba3-5bde15a60bab tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:13.713657 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5b6220b4-8bb1-4aea-bba3-5bde15a60bab tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.244801 May 19 04:48:13.715557 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1931/3935] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:13 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:13.722439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-82101b9c-7a74-4cdd-9d2c-78e59bcb8430 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:13.724635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-82101b9c-7a74-4cdd-9d2c-78e59bcb8430 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:13.743001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82101b9c-7a74-4cdd-9d2c-78e59bcb8430 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.744106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82101b9c-7a74-4cdd-9d2c-78e59bcb8430 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.745320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82101b9c-7a74-4cdd-9d2c-78e59bcb8430 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.745941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82101b9c-7a74-4cdd-9d2c-78e59bcb8430 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.870120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82820808-1dd9-4eef-9fee-b4b3a991e6a0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:13.883753 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82820808-1dd9-4eef-9fee-b4b3a991e6a0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1324 microversion: 2.1 time: 0.393415 May 19 04:48:13.901167 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2005/3936] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:13 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:13.930093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-01ffac6d-2aa0-4170-ba07-f93a74b4c610 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:13.932440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-01ffac6d-2aa0-4170-ba07-f93a74b4c610 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:13.954974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01ffac6d-2aa0-4170-ba07-f93a74b4c610 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.956043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01ffac6d-2aa0-4170-ba07-f93a74b4c610 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:13.957020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01ffac6d-2aa0-4170-ba07-f93a74b4c610 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:13.957682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01ffac6d-2aa0-4170-ba07-f93a74b4c610 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:14.012923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-82101b9c-7a74-4cdd-9d2c-78e59bcb8430 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:14.022298 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-82101b9c-7a74-4cdd-9d2c-78e59bcb8430 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 200 len: 1504 microversion: 2.1 time: 0.305091 May 19 04:48:14.031854 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1932/3937] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:13 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:14.046899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c2031a6-2b4f-4bc7-b621-add55b10dcae tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-191803301", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:14.050792 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-3c2031a6-2b4f-4bc7-b621-add55b10dcae tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c2031a6-2b4f-4bc7-b621-add55b10dcae tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 215 May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-191803301", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-191803301', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 775, in create May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 549, in _process_networks_for_create May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 449, in _get_requested_networks May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._validate_network_id( May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 398, in _validate_network_id May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:14.052756 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:14.057652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:14.057652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:14.057652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:14.057652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:14.057652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:14.057652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 19 04:48:14.057652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:14.058767 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-01ffac6d-2aa0-4170-ba07-f93a74b4c610 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.154523 May 19 04:48:14.059588 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2006/3938] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:13 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:48:14.062964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c2031a6-2b4f-4bc7-b621-add55b10dcae tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:14.065374 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3c2031a6-2b4f-4bc7-b621-add55b10dcae tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.029891 May 19 04:48:14.067547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e80788e6-3785-4d68-b3ca-ef4ed2087fcc req-4114b33c-164a-468c-bf13-1a5a24263163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9476278-d276-4cca-b1ab-85acb83fd3e9", "tag": "0cd55b87-442d-42d8-8722-02de0890a6ff"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:14.075251 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1933/3939] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:14 2022] POST /compute/v2.1/servers => generated 123 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:14.080680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e80788e6-3785-4d68-b3ca-ef4ed2087fcc req-4114b33c-164a-468c-bf13-1a5a24263163 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:14.081159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e80788e6-3785-4d68-b3ca-ef4ed2087fcc req-4114b33c-164a-468c-bf13-1a5a24263163 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:14.090231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d474f446-50c4-4485-a0ff-e9f08f4b1f78 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:14.091050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d474f446-50c4-4485-a0ff-e9f08f4b1f78 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:14.099182 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e80788e6-3785-4d68-b3ca-ef4ed2087fcc req-4114b33c-164a-468c-bf13-1a5a24263163 service nova] Creating event network-changed:0cd55b87-442d-42d8-8722-02de0890a6ff for instance d9476278-d276-4cca-b1ab-85acb83fd3e9 on n-h1-766726-30 May 19 04:48:14.100561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d474f446-50c4-4485-a0ff-e9f08f4b1f78 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:14.101677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d474f446-50c4-4485-a0ff-e9f08f4b1f78 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:14.103148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d474f446-50c4-4485-a0ff-e9f08f4b1f78 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:14.104106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d474f446-50c4-4485-a0ff-e9f08f4b1f78 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:14.106938 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e80788e6-3785-4d68-b3ca-ef4ed2087fcc req-4114b33c-164a-468c-bf13-1a5a24263163 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045736 May 19 04:48:14.107569 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2007/3940] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:14.118545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b40e7611-4de9-4248-b801-94bdcaa39c52 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:14.120260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b40e7611-4de9-4248-b801-94bdcaa39c52 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 2e7f7404-29e2-440c-9401-8140ee40b93c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:14.132151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b40e7611-4de9-4248-b801-94bdcaa39c52 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:14.132707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b40e7611-4de9-4248-b801-94bdcaa39c52 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:14.133742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b40e7611-4de9-4248-b801-94bdcaa39c52 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:14.134628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b40e7611-4de9-4248-b801-94bdcaa39c52 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:14.384329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d474f446-50c4-4485-a0ff-e9f08f4b1f78 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:14.399814 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d474f446-50c4-4485-a0ff-e9f08f4b1f78 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1478 microversion: 2.1 time: 0.318706 May 19 04:48:14.402807 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1934/3941] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:14 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1478 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:14.411426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8cb17d57-9dec-4185-b795-dd26633d3b99 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:14.418427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8cb17d57-9dec-4185-b795-dd26633d3b99 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:14.429850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cb17d57-9dec-4185-b795-dd26633d3b99 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:14.430592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cb17d57-9dec-4185-b795-dd26633d3b99 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:14.431562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cb17d57-9dec-4185-b795-dd26633d3b99 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:14.432171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cb17d57-9dec-4185-b795-dd26633d3b99 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:14.453135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b40e7611-4de9-4248-b801-94bdcaa39c52 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:14.462642 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b40e7611-4de9-4248-b801-94bdcaa39c52 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c" status: 200 len: 1504 microversion: 2.1 time: 0.350287 May 19 04:48:14.471099 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2008/3942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:14 2022] GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:14.476247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86ed5a0b-43e0-4a24-86d1-c989ee1dcf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:14.477421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86ed5a0b-43e0-4a24-86d1-c989ee1dcf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:14.506066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86ed5a0b-43e0-4a24-86d1-c989ee1dcf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:14.510492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86ed5a0b-43e0-4a24-86d1-c989ee1dcf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:14.512786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86ed5a0b-43e0-4a24-86d1-c989ee1dcf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:14.513664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86ed5a0b-43e0-4a24-86d1-c989ee1dcf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.008527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8cb17d57-9dec-4185-b795-dd26633d3b99 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:15.016923 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8cb17d57-9dec-4185-b795-dd26633d3b99 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1314 microversion: 2.1 time: 0.612832 May 19 04:48:15.026680 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1935/3943] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:14 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:15.032310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f75a26da-97e8-492a-b565-beab770169d5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:15.033185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f75a26da-97e8-492a-b565-beab770169d5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:15.041959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f75a26da-97e8-492a-b565-beab770169d5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.043003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f75a26da-97e8-492a-b565-beab770169d5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.045879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f75a26da-97e8-492a-b565-beab770169d5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.047551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f75a26da-97e8-492a-b565-beab770169d5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.049012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86ed5a0b-43e0-4a24-86d1-c989ee1dcf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:15.060243 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86ed5a0b-43e0-4a24-86d1-c989ee1dcf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1670 microversion: 2.1 time: 0.587887 May 19 04:48:15.061141 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2009/3944] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:14 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1670 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:15.066090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:15.066930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:15.073248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.073979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.074926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.075550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.649325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f75a26da-97e8-492a-b565-beab770169d5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:15.649847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:15.661438 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f75a26da-97e8-492a-b565-beab770169d5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.632815 May 19 04:48:15.662257 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1936/3945] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:15 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:15.669142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-385be825-7622-4199-95f8-5e26dafc8d66 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:15.669855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-385be825-7622-4199-95f8-5e26dafc8d66 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 2e7f7404-29e2-440c-9401-8140ee40b93c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:15.677850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-385be825-7622-4199-95f8-5e26dafc8d66 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.678132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:15.678909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-385be825-7622-4199-95f8-5e26dafc8d66 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.679657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:15.680315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-385be825-7622-4199-95f8-5e26dafc8d66 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.680821 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-126b90cd-44fe-401e-baa2-ddd89b3106df tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1362 microversion: 2.26 time: 0.618443 May 19 04:48:15.681220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-385be825-7622-4199-95f8-5e26dafc8d66 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.692639 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2010/3946] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:15 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1362 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:15.698557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43dff7d3-130b-4495-b3c8-5be0c4dd7506 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:15.699393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43dff7d3-130b-4495-b3c8-5be0c4dd7506 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:15.706786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43dff7d3-130b-4495-b3c8-5be0c4dd7506 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.707441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43dff7d3-130b-4495-b3c8-5be0c4dd7506 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.708389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43dff7d3-130b-4495-b3c8-5be0c4dd7506 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.709018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43dff7d3-130b-4495-b3c8-5be0c4dd7506 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.719583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-385be825-7622-4199-95f8-5e26dafc8d66 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 2e7f7404-29e2-440c-9401-8140ee40b93c] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:48:15.849649 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-385be825-7622-4199-95f8-5e26dafc8d66 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c" status: 204 len: 0 microversion: 2.1 time: 0.182392 May 19 04:48:15.858167 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1937/3947] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:15 2022] DELETE /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:48:15.870637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8cd9a5c6-24e1-4d33-86df-f696b14dc9ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:15.874917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8cd9a5c6-24e1-4d33-86df-f696b14dc9ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:15.889648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cd9a5c6-24e1-4d33-86df-f696b14dc9ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.889648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cd9a5c6-24e1-4d33-86df-f696b14dc9ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:15.890470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cd9a5c6-24e1-4d33-86df-f696b14dc9ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:15.890913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cd9a5c6-24e1-4d33-86df-f696b14dc9ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.095142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-43dff7d3-130b-4495-b3c8-5be0c4dd7506 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:16.103536 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43dff7d3-130b-4495-b3c8-5be0c4dd7506 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1324 microversion: 2.1 time: 0.409480 May 19 04:48:16.104122 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2011/3948] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:15 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:16.108830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-16f86895-8dfa-459f-9e0a-234d99ff9ea9 req-a5404568-a023-4b67-887d-917b25613725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5092d7a-519d-4692-bd60-04ff4991b809", "tag": "b5835901-ed16-4bb9-9171-42d2e4b22814"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:16.118387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-16f86895-8dfa-459f-9e0a-234d99ff9ea9 req-a5404568-a023-4b67-887d-917b25613725 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.118826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-16f86895-8dfa-459f-9e0a-234d99ff9ea9 req-a5404568-a023-4b67-887d-917b25613725 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.130892 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-16f86895-8dfa-459f-9e0a-234d99ff9ea9 req-a5404568-a023-4b67-887d-917b25613725 service nova] Creating event network-changed:b5835901-ed16-4bb9-9171-42d2e4b22814 for instance a5092d7a-519d-4692-bd60-04ff4991b809 on n-h2-766726-30 May 19 04:48:16.135966 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-16f86895-8dfa-459f-9e0a-234d99ff9ea9 req-a5404568-a023-4b67-887d-917b25613725 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030632 May 19 04:48:16.137062 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2012/3949] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:16.143753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c81fdf0b-9b81-478a-a7ab-d17f775e4d07 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:16.144460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c81fdf0b-9b81-478a-a7ab-d17f775e4d07 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:16.147602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8cd9a5c6-24e1-4d33-86df-f696b14dc9ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:16.150904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c81fdf0b-9b81-478a-a7ab-d17f775e4d07 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.151525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c81fdf0b-9b81-478a-a7ab-d17f775e4d07 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.153090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c81fdf0b-9b81-478a-a7ab-d17f775e4d07 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.153534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c81fdf0b-9b81-478a-a7ab-d17f775e4d07 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.156579 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8cd9a5c6-24e1-4d33-86df-f696b14dc9ab tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1478 microversion: 2.1 time: 0.299097 May 19 04:48:16.157966 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1938/3950] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:15 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1478 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:16.171958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8deaa718-cc2c-49cc-a66d-68c45381793c req-3de23289-69f5-4194-a05d-326e20dd1b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b11dd9-99d7-422e-9399-37f52d453bee", "name": "network-vif-unplugged", "status": "completed", "tag": "3f9d85c4-dcc4-422a-8896-34e1a8644e85"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:16.180662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8deaa718-cc2c-49cc-a66d-68c45381793c req-3de23289-69f5-4194-a05d-326e20dd1b71 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.181270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8deaa718-cc2c-49cc-a66d-68c45381793c req-3de23289-69f5-4194-a05d-326e20dd1b71 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.192895 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8deaa718-cc2c-49cc-a66d-68c45381793c req-3de23289-69f5-4194-a05d-326e20dd1b71 service nova] Creating event network-vif-unplugged:3f9d85c4-dcc4-422a-8896-34e1a8644e85 for instance 27b11dd9-99d7-422e-9399-37f52d453bee on n-h2-766726-30 May 19 04:48:16.197813 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8deaa718-cc2c-49cc-a66d-68c45381793c req-3de23289-69f5-4194-a05d-326e20dd1b71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029613 May 19 04:48:16.198590 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1939/3951] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:16.204045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70b52d3c-2bb6-448a-8a05-2dd7170403b2 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:16.204639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-70b52d3c-2bb6-448a-8a05-2dd7170403b2 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:16.211056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70b52d3c-2bb6-448a-8a05-2dd7170403b2 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.211515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70b52d3c-2bb6-448a-8a05-2dd7170403b2 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.212306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70b52d3c-2bb6-448a-8a05-2dd7170403b2 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.212764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70b52d3c-2bb6-448a-8a05-2dd7170403b2 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.242671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-70b52d3c-2bb6-448a-8a05-2dd7170403b2 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:48:16.368171 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-70b52d3c-2bb6-448a-8a05-2dd7170403b2 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 204 len: 0 microversion: 2.1 time: 0.167163 May 19 04:48:16.369120 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1940/3952] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:16 2022] DELETE /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:48:16.378801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7be1a4c9-e9ad-4a6a-a346-929e86ac7ba4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:16.379543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7be1a4c9-e9ad-4a6a-a346-929e86ac7ba4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:16.389266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7be1a4c9-e9ad-4a6a-a346-929e86ac7ba4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.389730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7be1a4c9-e9ad-4a6a-a346-929e86ac7ba4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.390730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7be1a4c9-e9ad-4a6a-a346-929e86ac7ba4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.391240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7be1a4c9-e9ad-4a6a-a346-929e86ac7ba4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.721843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:16.745343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:16.792230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c81fdf0b-9b81-478a-a7ab-d17f775e4d07 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:16.799525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7be1a4c9-e9ad-4a6a-a346-929e86ac7ba4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:16.801709 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c81fdf0b-9b81-478a-a7ab-d17f775e4d07 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.663265 May 19 04:48:16.802301 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2013/3953] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:16 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:16.806868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa658678-f01e-4c13-b5f4-36ad2570bc11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:16.807462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aa658678-f01e-4c13-b5f4-36ad2570bc11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:16.814053 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7be1a4c9-e9ad-4a6a-a346-929e86ac7ba4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1314 microversion: 2.1 time: 0.443433 May 19 04:48:16.815885 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1941/3954] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:16 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:16.816030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa658678-f01e-4c13-b5f4-36ad2570bc11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.816030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa658678-f01e-4c13-b5f4-36ad2570bc11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.816030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa658678-f01e-4c13-b5f4-36ad2570bc11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.817095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa658678-f01e-4c13-b5f4-36ad2570bc11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.820819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5bce17d2-8cc5-4ce1-96f0-a41b5abd1d40 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:16.821584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5bce17d2-8cc5-4ce1-96f0-a41b5abd1d40 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 2e7f7404-29e2-440c-9401-8140ee40b93c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:16.830127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bce17d2-8cc5-4ce1-96f0-a41b5abd1d40 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.830667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bce17d2-8cc5-4ce1-96f0-a41b5abd1d40 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:16.831536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bce17d2-8cc5-4ce1-96f0-a41b5abd1d40 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:16.832074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bce17d2-8cc5-4ce1-96f0-a41b5abd1d40 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.154000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aa658678-f01e-4c13-b5f4-36ad2570bc11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:17.166081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5bce17d2-8cc5-4ce1-96f0-a41b5abd1d40 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:17.180066 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5bce17d2-8cc5-4ce1-96f0-a41b5abd1d40 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c" status: 200 len: 1510 microversion: 2.1 time: 0.364283 May 19 04:48:17.180993 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1942/3955] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:16 2022] GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:17.191692 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa658678-f01e-4c13-b5f4-36ad2570bc11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1670 microversion: 2.1 time: 0.388313 May 19 04:48:17.192982 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2014/3956] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:16 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1670 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:17.195093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:17.195521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:17.207007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.207468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.208254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.208700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.212209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5c78b92-135d-49c3-a96d-5df28520d1d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1943798132", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "key_name": "tempest-key-1686827309", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:17.303847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-d5c78b92-135d-49c3-a96d-5df28520d1d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] validate_networks() for [('4f13e0de-8a49-429b-a6a1-196e5191a8c1', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:48:17.475882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:17.485766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:17.487497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:17.488840 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31368900-3f19-4a7c-9050-44a7b099ad7c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1362 microversion: 2.26 time: 0.304283 May 19 04:48:17.493343 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1943/3957] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:17 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:17.499026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac5dd168-c586-4100-9d68-1eecb27526f0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:17.499743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ac5dd168-c586-4100-9d68-1eecb27526f0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:17.506669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac5dd168-c586-4100-9d68-1eecb27526f0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.507203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac5dd168-c586-4100-9d68-1eecb27526f0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.508047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac5dd168-c586-4100-9d68-1eecb27526f0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.508566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac5dd168-c586-4100-9d68-1eecb27526f0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.513906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:17.575158 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-d5c78b92-135d-49c3-a96d-5df28520d1d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Invalid key_name provided. May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5c78b92-135d-49c3-a96d-5df28520d1d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 247 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1943798132", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "key_name": "tempest-key-1686827309", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid key_name provided. May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1943798132', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'key_name': 'tempest-key-1686827309', 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1686827309 not found for user 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:17.577450 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 809, in create May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. May 19 04:48:17.582330 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:17.585164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5c78b92-135d-49c3-a96d-5df28520d1d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid key_name provided. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:17.586339 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5c78b92-135d-49c3-a96d-5df28520d1d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.392086 May 19 04:48:17.588223 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2015/3958] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:17 2022] POST /compute/v2.1/servers => generated 70 bytes in 394 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 04:48:17.595334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-15417bcc-588d-4248-a751-825d0c3084f8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:17.596216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-15417bcc-588d-4248-a751-825d0c3084f8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:17.602761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15417bcc-588d-4248-a751-825d0c3084f8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.604399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15417bcc-588d-4248-a751-825d0c3084f8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.606518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15417bcc-588d-4248-a751-825d0c3084f8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.607347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15417bcc-588d-4248-a751-825d0c3084f8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.823376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ac5dd168-c586-4100-9d68-1eecb27526f0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:17.863326 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac5dd168-c586-4100-9d68-1eecb27526f0 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1324 microversion: 2.1 time: 0.349957 May 19 04:48:17.866218 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1944/3959] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:17 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:17.890468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-15417bcc-588d-4248-a751-825d0c3084f8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:17.901245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9e83319-559d-4cd6-9f1c-ff5ac26b0e47 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:17.901925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b9e83319-559d-4cd6-9f1c-ff5ac26b0e47 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:17.909619 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-15417bcc-588d-4248-a751-825d0c3084f8 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1478 microversion: 2.1 time: 0.319776 May 19 04:48:17.910780 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2016/3960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:17 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1478 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:17.920512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b732bd35-7014-4389-af26-ca6407a0f94b tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:17.922321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9e83319-559d-4cd6-9f1c-ff5ac26b0e47 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.923294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9e83319-559d-4cd6-9f1c-ff5ac26b0e47 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.923511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9e83319-559d-4cd6-9f1c-ff5ac26b0e47 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.923948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9e83319-559d-4cd6-9f1c-ff5ac26b0e47 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.930070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b732bd35-7014-4389-af26-ca6407a0f94b tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:17.941797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b732bd35-7014-4389-af26-ca6407a0f94b tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.942631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b732bd35-7014-4389-af26-ca6407a0f94b tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:17.943596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b732bd35-7014-4389-af26-ca6407a0f94b tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:17.944384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b732bd35-7014-4389-af26-ca6407a0f94b tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:18.347951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b732bd35-7014-4389-af26-ca6407a0f94b tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:18.358255 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b732bd35-7014-4389-af26-ca6407a0f94b tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1314 microversion: 2.1 time: 0.442183 May 19 04:48:18.360069 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2017/3961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:17 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:18.366025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fa2c5cc-eff4-4092-8674-54a089f0e8b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:18.366899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4fa2c5cc-eff4-4092-8674-54a089f0e8b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:18.375420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fa2c5cc-eff4-4092-8674-54a089f0e8b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:18.376159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fa2c5cc-eff4-4092-8674-54a089f0e8b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:18.377192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fa2c5cc-eff4-4092-8674-54a089f0e8b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:18.377992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fa2c5cc-eff4-4092-8674-54a089f0e8b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:18.509115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b9e83319-559d-4cd6-9f1c-ff5ac26b0e47 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:18.517762 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b9e83319-559d-4cd6-9f1c-ff5ac26b0e47 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.648125 May 19 04:48:18.518695 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1945/3962] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:17 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:18.541512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9215abe0-9905-4367-9a08-00a5b09db30a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:18.542971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9215abe0-9905-4367-9a08-00a5b09db30a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 2e7f7404-29e2-440c-9401-8140ee40b93c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:18.550888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9215abe0-9905-4367-9a08-00a5b09db30a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:18.551686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9215abe0-9905-4367-9a08-00a5b09db30a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:18.552657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9215abe0-9905-4367-9a08-00a5b09db30a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:18.553261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9215abe0-9905-4367-9a08-00a5b09db30a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:18.798381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:18.802463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fa2c5cc-eff4-4092-8674-54a089f0e8b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:18.812908 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4fa2c5cc-eff4-4092-8674-54a089f0e8b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1675 microversion: 2.1 time: 0.450861 May 19 04:48:18.823015 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2018/3963] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:18 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1675 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:18.827976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-19a91e0e-e511-429e-83ca-380eaec1f1f3 req-cd51ca0d-2501-425f-8f40-76ae497d5383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b11dd9-99d7-422e-9399-37f52d453bee", "name": "network-vif-plugged", "status": "completed", "tag": "3f9d85c4-dcc4-422a-8896-34e1a8644e85"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:18.837099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-19a91e0e-e511-429e-83ca-380eaec1f1f3 req-cd51ca0d-2501-425f-8f40-76ae497d5383 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:18.837835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-19a91e0e-e511-429e-83ca-380eaec1f1f3 req-cd51ca0d-2501-425f-8f40-76ae497d5383 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:18.842366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:18.851314 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-19a91e0e-e511-429e-83ca-380eaec1f1f3 req-cd51ca0d-2501-425f-8f40-76ae497d5383 service nova] Creating event network-vif-plugged:3f9d85c4-dcc4-422a-8896-34e1a8644e85 for instance 27b11dd9-99d7-422e-9399-37f52d453bee on n-h2-766726-30 May 19 04:48:18.872718 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-19a91e0e-e511-429e-83ca-380eaec1f1f3 req-cd51ca0d-2501-425f-8f40-76ae497d5383 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048124 May 19 04:48:18.874355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9215abe0-9905-4367-9a08-00a5b09db30a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:18.878047 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2019/3964] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:18.885490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9215abe0-9905-4367-9a08-00a5b09db30a tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c" status: 200 len: 1510 microversion: 2.1 time: 0.355142 May 19 04:48:18.888747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:18.891789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:18.895303 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1946/3965] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:18 2022] GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:18.904719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dfb39049-a883-4704-9432-9296224849c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:18.907053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:18.907257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dfb39049-a883-4704-9432-9296224849c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:18.914204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:18.915730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:18.916384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:18.927516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfb39049-a883-4704-9432-9296224849c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:18.927895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfb39049-a883-4704-9432-9296224849c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:18.928606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfb39049-a883-4704-9432-9296224849c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:18.929136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dfb39049-a883-4704-9432-9296224849c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:19.295746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=14 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:19.456094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:19.465179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:19.469377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dfb39049-a883-4704-9432-9296224849c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:19.471764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:19.474374 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1eb218ba-62c8-4fc5-af97-c84d8815b50c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1362 microversion: 2.26 time: 0.594948 May 19 04:48:19.474985 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2020/3966] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:18 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:19.480074 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dfb39049-a883-4704-9432-9296224849c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.583544 May 19 04:48:19.480658 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1947/3967] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:18 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:19.485407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-95cc8abd-bf1e-469b-b97d-acf4ba087ed6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:19.486193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-95cc8abd-bf1e-469b-b97d-acf4ba087ed6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:19.487536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9a28fff7-9804-423a-8a52-d6456eca2308 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:19.490511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9a28fff7-9804-423a-8a52-d6456eca2308 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:19.492973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95cc8abd-bf1e-469b-b97d-acf4ba087ed6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:19.493709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95cc8abd-bf1e-469b-b97d-acf4ba087ed6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:19.494986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95cc8abd-bf1e-469b-b97d-acf4ba087ed6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:19.496200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95cc8abd-bf1e-469b-b97d-acf4ba087ed6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:19.504475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9a28fff7-9804-423a-8a52-d6456eca2308 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:19.504802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9a28fff7-9804-423a-8a52-d6456eca2308 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:19.505808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9a28fff7-9804-423a-8a52-d6456eca2308 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:19.506407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9a28fff7-9804-423a-8a52-d6456eca2308 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.328324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-95cc8abd-bf1e-469b-b97d-acf4ba087ed6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:20.340186 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-95cc8abd-bf1e-469b-b97d-acf4ba087ed6 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1478 microversion: 2.1 time: 0.858264 May 19 04:48:20.342844 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1948/3968] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:19 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1478 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:20.348361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e209656d-0252-4c01-9205-f3bb03af27df tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:20.349474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e209656d-0252-4c01-9205-f3bb03af27df tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:20.364829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e209656d-0252-4c01-9205-f3bb03af27df tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.365260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e209656d-0252-4c01-9205-f3bb03af27df tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.367548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e209656d-0252-4c01-9205-f3bb03af27df tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.368437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e209656d-0252-4c01-9205-f3bb03af27df tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.396416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9a28fff7-9804-423a-8a52-d6456eca2308 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:20.407321 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9a28fff7-9804-423a-8a52-d6456eca2308 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1324 microversion: 2.1 time: 0.931316 May 19 04:48:20.409035 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2021/3969] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:19 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1324 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:20.415514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-755ec3c0-af48-4afd-a6d5-f7837a154abe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1945781155", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:20.569048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.security_group_api [None req-755ec3c0-af48-4afd-a6d5-f7837a154abe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Neutron security group does_not_exist not found {{(pid=124818) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} May 19 04:48:20.569703 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-755ec3c0-af48-4afd-a6d5-f7837a154abe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-755ec3c0-af48-4afd-a6d5-f7837a154abe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 258 May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1945781155", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: exception: Unable to find security_group with name or id 'does_not_exist' May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1945781155', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name May 19 04:48:20.575929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' May 19 04:48:20.580466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:20.586545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-755ec3c0-af48-4afd-a6d5-f7837a154abe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:20.587609 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-755ec3c0-af48-4afd-a6d5-f7837a154abe tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.177395 May 19 04:48:20.588226 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2022/3970] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:20 2022] POST /compute/v2.1/servers => generated 106 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:20.594152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2dfea821-7b84-425f-865d-747f97cf8c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:20.594774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2dfea821-7b84-425f-865d-747f97cf8c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:20.601029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dfea821-7b84-425f-865d-747f97cf8c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.601584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dfea821-7b84-425f-865d-747f97cf8c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.602361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dfea821-7b84-425f-865d-747f97cf8c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.602804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dfea821-7b84-425f-865d-747f97cf8c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.613811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e209656d-0252-4c01-9205-f3bb03af27df tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:20.622967 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e209656d-0252-4c01-9205-f3bb03af27df tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1314 microversion: 2.1 time: 0.278983 May 19 04:48:20.623472 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1949/3971] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:20 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:20.629682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:20.630291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 2e7f7404-29e2-440c-9401-8140ee40b93c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:20.638890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.639348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.640142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.640680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.675184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:20.677025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.677772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.678393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lazy-loading 'fault' on Instance uuid 2e7f7404-29e2-440c-9401-8140ee40b93c {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:20.734991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '582fe0e0beba4435b01b21db35d384af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a970b4e5cb4fbf83273d687ea30472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:20.742940 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c674b7d9-a153-470d-bc15-0acc0c06c152 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c" status: 200 len: 1307 microversion: 2.1 time: 0.117968 May 19 04:48:20.743616 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1950/3972] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:20 2022] GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:20.748521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-600c9950-642b-4939-90d0-ccceeb8b7e4a req-aedfec8d-8cde-49b7-88c3-6da18ff836cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7f7404-29e2-440c-9401-8140ee40b93c", "name": "network-vif-deleted", "tag": "9f755bfd-7f80-4567-9482-70cd78b6f855"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:20.756706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-600c9950-642b-4939-90d0-ccceeb8b7e4a req-aedfec8d-8cde-49b7-88c3-6da18ff836cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.757297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-600c9950-642b-4939-90d0-ccceeb8b7e4a req-aedfec8d-8cde-49b7-88c3-6da18ff836cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.764780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2dfea821-7b84-425f-865d-747f97cf8c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:20.768929 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-600c9950-642b-4939-90d0-ccceeb8b7e4a req-aedfec8d-8cde-49b7-88c3-6da18ff836cb service nova] Creating event network-vif-deleted:9f755bfd-7f80-4567-9482-70cd78b6f855 for instance 2e7f7404-29e2-440c-9401-8140ee40b93c on n-h1-766726-30 May 19 04:48:20.772398 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2dfea821-7b84-425f-865d-747f97cf8c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.182972 May 19 04:48:20.772981 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2023/3973] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:20 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:20.773807 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-600c9950-642b-4939-90d0-ccceeb8b7e4a req-aedfec8d-8cde-49b7-88c3-6da18ff836cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028963 May 19 04:48:20.774538 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1951/3974] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:20.778099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:20.778908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:20.780004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-189a99e6-ef6c-43f1-b138-c9f401e77c58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:20.780711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-189a99e6-ef6c-43f1-b138-c9f401e77c58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:20.784924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.785715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.786494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.786930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.787339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-189a99e6-ef6c-43f1-b138-c9f401e77c58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.787798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-189a99e6-ef6c-43f1-b138-c9f401e77c58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.788581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-189a99e6-ef6c-43f1-b138-c9f401e77c58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:20.789025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-189a99e6-ef6c-43f1-b138-c9f401e77c58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:20.992764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:20.997850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-189a99e6-ef6c-43f1-b138-c9f401e77c58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:21.002524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:21.004082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:21.005309 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e163deb-d8b5-420a-a6fa-ac1a0243c2f5 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1362 microversion: 2.26 time: 0.231346 May 19 04:48:21.005887 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2024/3975] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:20 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:21.007859 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-189a99e6-ef6c-43f1-b138-c9f401e77c58 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.232322 May 19 04:48:21.009149 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1952/3976] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:20 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:21.018322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-814434d4-7690-4998-b1d9-b5446edf3f9f req-0b7e9571-d171-4415-934e-fbb56d7cb27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77617f7-bae8-44a5-a97c-3a1193d6c640", "name": "network-vif-plugged", "status": "completed", "tag": "fc291ee9-1271-481c-af63-67410b81cb60"}, {"server_uuid": "a5092d7a-519d-4692-bd60-04ff4991b809", "name": "network-vif-plugged", "status": "completed", "tag": "b5835901-ed16-4bb9-9171-42d2e4b22814"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:21.018822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-92915d80-7fc1-4ce0-ad31-50f42f0b2faa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:21.021881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-92915d80-7fc1-4ce0-ad31-50f42f0b2faa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.028198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92915d80-7fc1-4ce0-ad31-50f42f0b2faa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.029097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92915d80-7fc1-4ce0-ad31-50f42f0b2faa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.029943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92915d80-7fc1-4ce0-ad31-50f42f0b2faa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.030115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-814434d4-7690-4998-b1d9-b5446edf3f9f req-0b7e9571-d171-4415-934e-fbb56d7cb27a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.030761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92915d80-7fc1-4ce0-ad31-50f42f0b2faa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.030898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-814434d4-7690-4998-b1d9-b5446edf3f9f req-0b7e9571-d171-4415-934e-fbb56d7cb27a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.045328 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-814434d4-7690-4998-b1d9-b5446edf3f9f req-0b7e9571-d171-4415-934e-fbb56d7cb27a service nova] Creating event network-vif-plugged:fc291ee9-1271-481c-af63-67410b81cb60 for instance f77617f7-bae8-44a5-a97c-3a1193d6c640 on n-h1-766726-30 May 19 04:48:21.045847 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-814434d4-7690-4998-b1d9-b5446edf3f9f req-0b7e9571-d171-4415-934e-fbb56d7cb27a service nova] Creating event network-vif-plugged:b5835901-ed16-4bb9-9171-42d2e4b22814 for instance a5092d7a-519d-4692-bd60-04ff4991b809 on n-h2-766726-30 May 19 04:48:21.054551 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-814434d4-7690-4998-b1d9-b5446edf3f9f req-0b7e9571-d171-4415-934e-fbb56d7cb27a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043981 May 19 04:48:21.058957 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1953/3977] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:21.064633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b94445c0-b0f8-40af-b577-172aa8d9c31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:21.065965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b94445c0-b0f8-40af-b577-172aa8d9c31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.072620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94445c0-b0f8-40af-b577-172aa8d9c31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.073098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94445c0-b0f8-40af-b577-172aa8d9c31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.074434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94445c0-b0f8-40af-b577-172aa8d9c31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.074877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94445c0-b0f8-40af-b577-172aa8d9c31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.086320 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-92915d80-7fc1-4ce0-ad31-50f42f0b2faa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 200 len: 322 microversion: 2.1 time: 0.079187 May 19 04:48:21.086974 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2025/3978] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:21 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 322 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:21.099255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a16c3612-d7aa-4e4b-a3b4-bc5588490dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:21.100117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a16c3612-d7aa-4e4b-a3b4-bc5588490dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.108390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a16c3612-d7aa-4e4b-a3b4-bc5588490dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.108847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a16c3612-d7aa-4e4b-a3b4-bc5588490dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.109663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a16c3612-d7aa-4e4b-a3b4-bc5588490dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.110100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a16c3612-d7aa-4e4b-a3b4-bc5588490dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.459087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b94445c0-b0f8-40af-b577-172aa8d9c31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:21.466707 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b94445c0-b0f8-40af-b577-172aa8d9c31c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.406540 May 19 04:48:21.467283 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1954/3979] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:21 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:21.471923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5323ecc2-fc09-4b89-ac82-1111b47e88c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:21.472532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5323ecc2-fc09-4b89-ac82-1111b47e88c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.478527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5323ecc2-fc09-4b89-ac82-1111b47e88c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.478974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5323ecc2-fc09-4b89-ac82-1111b47e88c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.480275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5323ecc2-fc09-4b89-ac82-1111b47e88c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.480710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5323ecc2-fc09-4b89-ac82-1111b47e88c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.489607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a16c3612-d7aa-4e4b-a3b4-bc5588490dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:21.499495 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a16c3612-d7aa-4e4b-a3b4-bc5588490dcb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.405054 May 19 04:48:21.500195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2026/3980] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:21 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:21.505098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bfe5a46-2561-491e-a82d-c81b6992e02e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:21.505722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4bfe5a46-2561-491e-a82d-c81b6992e02e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.511881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bfe5a46-2561-491e-a82d-c81b6992e02e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.512550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bfe5a46-2561-491e-a82d-c81b6992e02e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.513356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bfe5a46-2561-491e-a82d-c81b6992e02e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.513801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bfe5a46-2561-491e-a82d-c81b6992e02e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.686967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5323ecc2-fc09-4b89-ac82-1111b47e88c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:21.690276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4bfe5a46-2561-491e-a82d-c81b6992e02e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:21.696080 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5323ecc2-fc09-4b89-ac82-1111b47e88c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1463 microversion: 2.1 time: 0.227789 May 19 04:48:21.696919 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1955/3981] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:21 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1463 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:21.698085 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4bfe5a46-2561-491e-a82d-c81b6992e02e tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1324 microversion: 2.1 time: 0.196545 May 19 04:48:21.698714 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2027/3982] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:21 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1324 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:21.702580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2f38882d-c676-4937-9dea-889dff7e3011 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:21.703335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2ea5ef7-3c14-4d64-80f0-c77f332f44c6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:21.703547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2f38882d-c676-4937-9dea-889dff7e3011 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 6a332405-3a37-4527-8a4b-0e020ebdca59] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.703945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d2ea5ef7-3c14-4d64-80f0-c77f332f44c6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.710090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2ea5ef7-3c14-4d64-80f0-c77f332f44c6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.710548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2ea5ef7-3c14-4d64-80f0-c77f332f44c6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.711323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2ea5ef7-3c14-4d64-80f0-c77f332f44c6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.711764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2ea5ef7-3c14-4d64-80f0-c77f332f44c6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.719717 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-2f38882d-c676-4937-9dea-889dff7e3011 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 6a332405-3a37-4527-8a4b-0e020ebdca59 could not be found. May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2f38882d-c676-4937-9dea-889dff7e3011 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/6a332405-3a37-4527-8a4b-0e020ebdca59 HTTP/1.1 May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 6a332405-3a37-4527-8a4b-0e020ebdca59 could not be found. May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '6a332405-3a37-4527-8a4b-0e020ebdca59'} May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a332405-3a37-4527-8a4b-0e020ebdca59 could not be found. May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a332405-3a37-4527-8a4b-0e020ebdca59 could not be found. May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:21.721446 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a332405-3a37-4527-8a4b-0e020ebdca59 could not be found. May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2f38882d-c676-4937-9dea-889dff7e3011 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 6a332405-3a37-4527-8a4b-0e020ebdca59 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2f38882d-c676-4937-9dea-889dff7e3011 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a332405-3a37-4527-8a4b-0e020ebdca59" status: 404 len: 111 microversion: 2.1 time: 0.024791 May 19 04:48:21.727052 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1956/3983] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:21 2022] DELETE /compute/v2.1/servers/6a332405-3a37-4527-8a4b-0e020ebdca59 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:21.728250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-37f9f72a-fb21-4eca-a347-608fba2ceaa6 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:21.728450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-37f9f72a-fb21-4eca-a347-608fba2ceaa6 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.737791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37f9f72a-fb21-4eca-a347-608fba2ceaa6 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.738245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37f9f72a-fb21-4eca-a347-608fba2ceaa6 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.739024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37f9f72a-fb21-4eca-a347-608fba2ceaa6 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.739477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37f9f72a-fb21-4eca-a347-608fba2ceaa6 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.912636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d2ea5ef7-3c14-4d64-80f0-c77f332f44c6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:21.920986 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2ea5ef7-3c14-4d64-80f0-c77f332f44c6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.221129 May 19 04:48:21.921925 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2028/3984] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:21 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:21.924753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-37f9f72a-fb21-4eca-a347-608fba2ceaa6 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:21.926136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-42c0a820-d405-4298-944d-897a88a7e14e tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:21.927117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-42c0a820-d405-4298-944d-897a88a7e14e tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.932860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42c0a820-d405-4298-944d-897a88a7e14e tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.933034 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-37f9f72a-fb21-4eca-a347-608fba2ceaa6 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1314 microversion: 2.1 time: 0.208613 May 19 04:48:21.933340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42c0a820-d405-4298-944d-897a88a7e14e tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.933736 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1957/3985] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:21 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:21.934308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42c0a820-d405-4298-944d-897a88a7e14e tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.934695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42c0a820-d405-4298-944d-897a88a7e14e tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.938563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ee52f75-983e-42ed-ad99-a895d0c43c1b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:21.939284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2ee52f75-983e-42ed-ad99-a895d0c43c1b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:21.945083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ee52f75-983e-42ed-ad99-a895d0c43c1b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.945631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ee52f75-983e-42ed-ad99-a895d0c43c1b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:21.946464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ee52f75-983e-42ed-ad99-a895d0c43c1b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:21.946974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ee52f75-983e-42ed-ad99-a895d0c43c1b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.010219 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-42c0a820-d405-4298-944d-897a88a7e14e tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action" status: 202 len: 0 microversion: 2.1 time: 0.087561 May 19 04:48:22.011661 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2029/3986] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:21 2022] POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:48:22.016470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.017101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: 2e7f7404-29e2-440c-9401-8140ee40b93c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.022950 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.023526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.024304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.024749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.039066 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] HTTP exception thrown: Instance 2e7f7404-29e2-440c-9401-8140ee40b93c could not be found. May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Request method failure captured: May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c HTTP/1.1 May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcvL1vBmcpw7M0woSbhC8Ace2wTU1BZT50R74l4NbwdXxEDSlKNMG7aGdjzqyO2EPLzC-WjUMp2LwLDgtbLZjE1BHXboUTy984r2aIQrCAsjlzuX0987TaCTz1IdzTj6L18Youw8aoDm1aBaA02hKCw5WpQgn9-_iHmr5zh3Amr1zTc May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: d1a970b4e5cb4fbf83273d687ea30472 May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-MultipleCreateTestJSON-1175987303 May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1a970b4e5cb4fbf83273d687ea30472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1a970b4e5cb4fbf83273d687ea30472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1a970b4e5cb4fbf83273d687ea30472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1a970b4e5cb4fbf83273d687ea30472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-MultipleCreateTestJSON-1175987303 May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: d1a970b4e5cb4fbf83273d687ea30472 May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1175987303 May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-MultipleCreateTestJSON-1175987303-project May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 582fe0e0beba4435b01b21db35d384af May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-MultipleCreateTestJSON-1175987303-project May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2e7f7404-29e2-440c-9401-8140ee40b93c could not be found. May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2e7f7404-29e2-440c-9401-8140ee40b93c'} May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7f7404-29e2-440c-9401-8140ee40b93c could not be found. May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7f7404-29e2-440c-9401-8140ee40b93c could not be found. May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:22.040761 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7f7404-29e2-440c-9401-8140ee40b93c could not be found. May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Returning 404 to user: Instance 2e7f7404-29e2-440c-9401-8140ee40b93c could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bfd82d79-56b8-4a9d-8f87-018ef9bb3c63 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c" status: 404 len: 111 microversion: 2.1 time: 0.029623 May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2030/3987] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:22 2022] GET /compute/v2.1/servers/2e7f7404-29e2-440c-9401-8140ee40b93c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8e96297-3b1b-4b98-8ef6-8b54909ba99e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.048667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8e96297-3b1b-4b98-8ef6-8b54909ba99e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.053835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8e96297-3b1b-4b98-8ef6-8b54909ba99e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.054290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8e96297-3b1b-4b98-8ef6-8b54909ba99e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.055059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8e96297-3b1b-4b98-8ef6-8b54909ba99e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.055502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8e96297-3b1b-4b98-8ef6-8b54909ba99e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.084040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ee52f75-983e-42ed-ad99-a895d0c43c1b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:22.092318 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ee52f75-983e-42ed-ad99-a895d0c43c1b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.157495 May 19 04:48:22.092902 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1958/3988] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:21 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:22.097253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.098065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.105534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.105992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.106775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.107221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.138791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.139242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.139696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lazy-loading 'fault' on Instance uuid 27b11dd9-99d7-422e-9399-37f52d453bee {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:22.227503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8e96297-3b1b-4b98-8ef6-8b54909ba99e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:22.235303 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8e96297-3b1b-4b98-8ef6-8b54909ba99e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.191553 May 19 04:48:22.235892 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2031/3989] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:22 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:22.240348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.240961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.247397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.247851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.248623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.249062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.278372 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1a0032fb-23ce-4f2c-a1f9-dcbbb7f0d750 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1599 microversion: 2.1 time: 0.184396 May 19 04:48:22.278958 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1959/3990] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:22 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:22.283585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.284364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] [instance: d65e1833-35ad-47bd-b9a2-5565e8ef7086] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.290936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.291394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.292502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.292946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.309273 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] HTTP exception thrown: Instance d65e1833-35ad-47bd-b9a2-5565e8ef7086 could not be found. May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Request method failure captured: May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 HTTP/1.1 May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcvL1vBmcpw7M0woSbhC8Ace2wTU1BZT50R74l4NbwdXxEDSlKNMG7aGdjzqyO2EPLzC-WjUMp2LwLDgtbLZjE1BHXboUTy984r2aIQrCAsjlzuX0987TaCTz1IdzTj6L18Youw8aoDm1aBaA02hKCw5WpQgn9-_iHmr5zh3Amr1zTc May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: d1a970b4e5cb4fbf83273d687ea30472 May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-MultipleCreateTestJSON-1175987303 May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d1a970b4e5cb4fbf83273d687ea30472"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1a970b4e5cb4fbf83273d687ea30472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d1a970b4e5cb4fbf83273d687ea30472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d1a970b4e5cb4fbf83273d687ea30472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-MultipleCreateTestJSON-1175987303 May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: d1a970b4e5cb4fbf83273d687ea30472 May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1175987303 May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-MultipleCreateTestJSON-1175987303-project May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 582fe0e0beba4435b01b21db35d384af May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-MultipleCreateTestJSON-1175987303-project May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance d65e1833-35ad-47bd-b9a2-5565e8ef7086 could not be found. May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'd65e1833-35ad-47bd-b9a2-5565e8ef7086'} May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d65e1833-35ad-47bd-b9a2-5565e8ef7086 could not be found. May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d65e1833-35ad-47bd-b9a2-5565e8ef7086 could not be found. May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:22.310813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d65e1833-35ad-47bd-b9a2-5565e8ef7086 could not be found. May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] Returning 404 to user: Instance d65e1833-35ad-47bd-b9a2-5565e8ef7086 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-318968df-7069-472d-8bf0-f4c42f1e83a3 tempest-MultipleCreateTestJSON-1175987303 tempest-MultipleCreateTestJSON-1175987303-project] 10.222.0.58 "GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086" status: 404 len: 111 microversion: 2.1 time: 0.032153 May 19 04:48:22.317388 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1960/3991] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:22 2022] GET /compute/v2.1/servers/d65e1833-35ad-47bd-b9a2-5565e8ef7086 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:22.319509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66d8f0df-aec7-407e-aec0-d357e887f39c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.319509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-66d8f0df-aec7-407e-aec0-d357e887f39c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.331366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66d8f0df-aec7-407e-aec0-d357e887f39c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.332073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66d8f0df-aec7-407e-aec0-d357e887f39c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.333284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66d8f0df-aec7-407e-aec0-d357e887f39c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.333731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66d8f0df-aec7-407e-aec0-d357e887f39c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.542113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:22.550126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:22.551755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:22.552917 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f07af11-ecd3-492c-b8f0-7fc61cd83713 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1362 microversion: 2.26 time: 0.316118 May 19 04:48:22.553731 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2032/3992] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:22 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:22.568598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-760b36d2-cb9e-40d8-a188-43cee78d27a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.569254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-760b36d2-cb9e-40d8-a188-43cee78d27a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.575582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-66d8f0df-aec7-407e-aec0-d357e887f39c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:22.576085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-760b36d2-cb9e-40d8-a188-43cee78d27a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.576417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-760b36d2-cb9e-40d8-a188-43cee78d27a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.577261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-760b36d2-cb9e-40d8-a188-43cee78d27a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.577713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-760b36d2-cb9e-40d8-a188-43cee78d27a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.586436 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-66d8f0df-aec7-407e-aec0-d357e887f39c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.272639 May 19 04:48:22.587038 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1961/3993] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:22 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:22.592725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0889e45c-53e3-4582-b630-5d2f001d51fa tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:22.593800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0889e45c-53e3-4582-b630-5d2f001d51fa tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.602653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0889e45c-53e3-4582-b630-5d2f001d51fa tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.603110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0889e45c-53e3-4582-b630-5d2f001d51fa tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.603892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0889e45c-53e3-4582-b630-5d2f001d51fa tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.604341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0889e45c-53e3-4582-b630-5d2f001d51fa tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.640575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:22.695775 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0889e45c-53e3-4582-b630-5d2f001d51fa tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action" status: 202 len: 0 microversion: 2.1 time: 0.107431 May 19 04:48:22.697367 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1962/3994] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:22 2022] POST /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:48:22.705475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d64a442-5f0b-49ae-a763-f234dca017c6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.706337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1d64a442-5f0b-49ae-a763-f234dca017c6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Failed to fetch instance by id 9223372036854775808 {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 04:48:22.707148 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-1d64a442-5f0b-49ae-a763-f234dca017c6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d64a442-5f0b-49ae-a763-f234dca017c6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 9223372036854775808 could not be found. May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '9223372036854775808'} May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:22.709863 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:22.715498 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:22.715498 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:22.715498 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:22.715498 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. May 19 04:48:22.715498 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:22.715498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d64a442-5f0b-49ae-a763-f234dca017c6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:22.715498 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d64a442-5f0b-49ae-a763-f234dca017c6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014036 May 19 04:48:22.715498 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1963/3995] 10.222.0.58 () {58 vars in 1187 bytes} [Thu May 19 04:48:22 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:48:22.722278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf33fafb-13fa-4d86-b46a-3cdcb2b50424 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.723225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf33fafb-13fa-4d86-b46a-3cdcb2b50424 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.735169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf33fafb-13fa-4d86-b46a-3cdcb2b50424 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.736615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf33fafb-13fa-4d86-b46a-3cdcb2b50424 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.737981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf33fafb-13fa-4d86-b46a-3cdcb2b50424 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.738595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf33fafb-13fa-4d86-b46a-3cdcb2b50424 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.886929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-760b36d2-cb9e-40d8-a188-43cee78d27a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:22.897906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-760b36d2-cb9e-40d8-a188-43cee78d27a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.332406 May 19 04:48:22.898915 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2033/3996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:22 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:22.905235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2927bbf-96e2-4241-9021-ff8734837d3b tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:22.906137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d2927bbf-96e2-4241-9021-ff8734837d3b tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:22.913179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2927bbf-96e2-4241-9021-ff8734837d3b tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.913645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2927bbf-96e2-4241-9021-ff8734837d3b tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:22.921302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2927bbf-96e2-4241-9021-ff8734837d3b tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:22.922478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2927bbf-96e2-4241-9021-ff8734837d3b tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.099764 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf33fafb-13fa-4d86-b46a-3cdcb2b50424 tempest-ServersAdminTestJSON-1880704657 tempest-ServersAdminTestJSON-1880704657-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1616 microversion: 2.1 time: 0.384111 May 19 04:48:23.100336 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1964/3997] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:22 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1616 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:23.104909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99f3231f-f29e-4b26-9cd9-e8d26c647d0c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:23.105546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99f3231f-f29e-4b26-9cd9-e8d26c647d0c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:23.112963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99f3231f-f29e-4b26-9cd9-e8d26c647d0c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.113448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99f3231f-f29e-4b26-9cd9-e8d26c647d0c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.114318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99f3231f-f29e-4b26-9cd9-e8d26c647d0c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.114631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99f3231f-f29e-4b26-9cd9-e8d26c647d0c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.258944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d2927bbf-96e2-4241-9021-ff8734837d3b tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:23.267300 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2927bbf-96e2-4241-9021-ff8734837d3b tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1324 microversion: 2.1 time: 0.366940 May 19 04:48:23.276429 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2034/3998] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:22 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1324 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:23.280250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9c4cb90b-9555-4d24-9e8b-035a2536b0ed req-8db3b3f2-b913-4eeb-853c-dc90f6e18c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65e1833-35ad-47bd-b9a2-5565e8ef7086", "name": "network-vif-deleted", "tag": "2327a101-3cee-4de1-8100-8e9a526e85b5"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:23.289641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9c4cb90b-9555-4d24-9e8b-035a2536b0ed req-8db3b3f2-b913-4eeb-853c-dc90f6e18c4a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.290079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9c4cb90b-9555-4d24-9e8b-035a2536b0ed req-8db3b3f2-b913-4eeb-853c-dc90f6e18c4a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.302058 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9c4cb90b-9555-4d24-9e8b-035a2536b0ed req-8db3b3f2-b913-4eeb-853c-dc90f6e18c4a service nova] Creating event network-vif-deleted:2327a101-3cee-4de1-8100-8e9a526e85b5 for instance d65e1833-35ad-47bd-b9a2-5565e8ef7086 on n-h2-766726-30 May 19 04:48:23.306972 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9c4cb90b-9555-4d24-9e8b-035a2536b0ed req-8db3b3f2-b913-4eeb-853c-dc90f6e18c4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037865 May 19 04:48:23.307591 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2035/3999] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:23.313162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73d3298d-9b56-41e7-95ab-383333eef9c8 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:23.313867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73d3298d-9b56-41e7-95ab-383333eef9c8 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:23.320382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d3298d-9b56-41e7-95ab-383333eef9c8 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.321306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d3298d-9b56-41e7-95ab-383333eef9c8 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.321634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d3298d-9b56-41e7-95ab-383333eef9c8 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.322068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d3298d-9b56-41e7-95ab-383333eef9c8 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.353410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99f3231f-f29e-4b26-9cd9-e8d26c647d0c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:23.361175 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99f3231f-f29e-4b26-9cd9-e8d26c647d0c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.259798 May 19 04:48:23.362771 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1965/4000] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:23 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:23.379379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-275159713", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "81db7320-40b5-42ac-aa1c-5de5a86ce20d"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:23.445811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] validate_networks() for [('81db7320-40b5-42ac-aa1c-5de5a86ce20d', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:48:23.565522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73d3298d-9b56-41e7-95ab-383333eef9c8 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:23.575240 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73d3298d-9b56-41e7-95ab-383333eef9c8 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1463 microversion: 2.1 time: 0.265638 May 19 04:48:23.576826 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2036/4001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:23 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:23.581947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ec9ff8b3-7868-4815-8f2b-66d7536b0ec3 req-a85ad4aa-861c-4ca1-8c80-356a9d52c44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9476278-d276-4cca-b1ab-85acb83fd3e9", "name": "network-vif-plugged", "status": "completed", "tag": "0cd55b87-442d-42d8-8722-02de0890a6ff"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:23.592235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ec9ff8b3-7868-4815-8f2b-66d7536b0ec3 req-a85ad4aa-861c-4ca1-8c80-356a9d52c44c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.592687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ec9ff8b3-7868-4815-8f2b-66d7536b0ec3 req-a85ad4aa-861c-4ca1-8c80-356a9d52c44c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.604074 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ec9ff8b3-7868-4815-8f2b-66d7536b0ec3 req-a85ad4aa-861c-4ca1-8c80-356a9d52c44c service nova] Creating event network-vif-plugged:0cd55b87-442d-42d8-8722-02de0890a6ff for instance d9476278-d276-4cca-b1ab-85acb83fd3e9 on n-h1-766726-30 May 19 04:48:23.609819 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ec9ff8b3-7868-4815-8f2b-66d7536b0ec3 req-a85ad4aa-861c-4ca1-8c80-356a9d52c44c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031515 May 19 04:48:23.610428 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2037/4002] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:23.615532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4762bdec-1ee1-4ffc-a732-c3d96e3e0fba tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:23.616123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4762bdec-1ee1-4ffc-a732-c3d96e3e0fba tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:23.628794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4762bdec-1ee1-4ffc-a732-c3d96e3e0fba tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.629514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4762bdec-1ee1-4ffc-a732-c3d96e3e0fba tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.630827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4762bdec-1ee1-4ffc-a732-c3d96e3e0fba tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.632363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4762bdec-1ee1-4ffc-a732-c3d96e3e0fba tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.637980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:23.671577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4762bdec-1ee1-4ffc-a732-c3d96e3e0fba tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:48:23.775704 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4762bdec-1ee1-4ffc-a732-c3d96e3e0fba tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 204 len: 0 microversion: 2.1 time: 0.163742 May 19 04:48:23.777572 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2038/4003] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:23 2022] DELETE /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:48:23.784978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-67b7b0c7-16da-4778-944f-8cf6d09e22f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:23.785931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-67b7b0c7-16da-4778-944f-8cf6d09e22f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:23.789239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:23.798142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67b7b0c7-16da-4778-944f-8cf6d09e22f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.799463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67b7b0c7-16da-4778-944f-8cf6d09e22f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:23.800505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67b7b0c7-16da-4778-944f-8cf6d09e22f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:23.801192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67b7b0c7-16da-4778-944f-8cf6d09e22f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.021959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-67b7b0c7-16da-4778-944f-8cf6d09e22f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:24.030560 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-67b7b0c7-16da-4778-944f-8cf6d09e22f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.250699 May 19 04:48:24.031159 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2039/4004] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:23 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:24.039333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:48:24.039825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:48:24.040294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:48:24.040833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:48:24.041486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:48:24.047945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:24.048560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:24.051870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.052320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.053136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.053757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.057301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.057301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.057301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.057301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.074989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:48:24.080235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for user 87d19ae04b1d4f0e9e23872d9c2cd0a4 and project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:48:24.093443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:48:24.095942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:48:24.154609 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0583fc3b-506c-450e-bac4-29b4fa264ff9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790213 May 19 04:48:24.155608 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1966/4005] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:48:24.163884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-72bf674f-92ea-4381-97ce-644b561fdcde tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a3d98d7-6ea6-4d55-b468-b384ffe02a40", "device": "/dev/sdb"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:24.165604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72bf674f-92ea-4381-97ce-644b561fdcde tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:24.174231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72bf674f-92ea-4381-97ce-644b561fdcde tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.174697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72bf674f-92ea-4381-97ce-644b561fdcde tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.175474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72bf674f-92ea-4381-97ce-644b561fdcde tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.175908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72bf674f-92ea-4381-97ce-644b561fdcde tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.229820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:24.238160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:24.239807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:24.241210 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0e2f645f-2c50-43d4-918f-d06c8d14e56d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1546 microversion: 2.26 time: 0.197259 May 19 04:48:24.242200 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2040/4006] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:24 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1546 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:24.260777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aee8eff6-3944-4a7d-ac0e-19ef2dd37087 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:24.261869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aee8eff6-3944-4a7d-ac0e-19ef2dd37087 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:24.269177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aee8eff6-3944-4a7d-ac0e-19ef2dd37087 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.269656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aee8eff6-3944-4a7d-ac0e-19ef2dd37087 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.270418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aee8eff6-3944-4a7d-ac0e-19ef2dd37087 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.270858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aee8eff6-3944-4a7d-ac0e-19ef2dd37087 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.364830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-aee8eff6-3944-4a7d-ac0e-19ef2dd37087 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lazy-loading 'services' on Instance uuid b5ca519a-97b0-4dca-9d06-c04dc5b5a42b {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:24.449437 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aee8eff6-3944-4a7d-ac0e-19ef2dd37087 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments/ccf436bb-46e1-4fb0-b166-f086e564f291" status: 202 len: 0 microversion: 2.1 time: 0.201163 May 19 04:48:24.450199 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2041/4007] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 04:48:24 2022] DELETE /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments/ccf436bb-46e1-4fb0-b166-f086e564f291 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:48:24.456122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5fe140d8-8f82-427d-a043-d63537abc247 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:24.456683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5fe140d8-8f82-427d-a043-d63537abc247 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:24.463318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fe140d8-8f82-427d-a043-d63537abc247 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.465379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fe140d8-8f82-427d-a043-d63537abc247 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.466224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fe140d8-8f82-427d-a043-d63537abc247 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.467208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fe140d8-8f82-427d-a043-d63537abc247 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.612645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5fe140d8-8f82-427d-a043-d63537abc247 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:24.621351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5fe140d8-8f82-427d-a043-d63537abc247 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1470 microversion: 2.1 time: 0.169556 May 19 04:48:24.621924 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2042/4008] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:24 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:24.634907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-50668d40-04c2-476e-97d9-2031e8adab6f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:24.635618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-50668d40-04c2-476e-97d9-2031e8adab6f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Failed to fetch instance by id -1 {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 04:48:24.637887 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-50668d40-04c2-476e-97d9-2031e8adab6f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance -1 could not be found. May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-50668d40-04c2-476e-97d9-2031e8adab6f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance -1 could not be found. May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '-1'} May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:24.639938 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:24.645982 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:24.645982 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:24.645982 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. May 19 04:48:24.645982 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:24.645982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-50668d40-04c2-476e-97d9-2031e8adab6f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance -1 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:24.645982 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-50668d40-04c2-476e-97d9-2031e8adab6f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018333 May 19 04:48:24.645982 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2043/4009] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:48:24 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:48:24.650469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bdce727c-beb3-4cb9-885a-dda76babf565 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:24.651093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bdce727c-beb3-4cb9-885a-dda76babf565 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:24.658486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdce727c-beb3-4cb9-885a-dda76babf565 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.658953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdce727c-beb3-4cb9-885a-dda76babf565 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.659809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdce727c-beb3-4cb9-885a-dda76babf565 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.660253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdce727c-beb3-4cb9-885a-dda76babf565 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.723214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bdce727c-beb3-4cb9-885a-dda76babf565 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:24.730671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bdce727c-beb3-4cb9-885a-dda76babf565 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1218 microversion: 2.1 time: 0.084349 May 19 04:48:24.731438 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2044/4010] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:24 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:24.736307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315e7aca0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:24.744714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.745703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.746190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:24.752762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.753326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.754079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.754523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.794513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.794974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.810189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.810906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.854333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:24.875316 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f729cac0-97c1-4e62-934d-a888738f08ff tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1936844392" status: 201 len: 0 microversion: 2.26 time: 0.142920 May 19 04:48:24.876732 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2045/4011] 10.222.0.58 () {62 vars in 1379 bytes} [Thu May 19 04:48:24 2022] PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1936844392 => generated 0 bytes in 145 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 19 04:48:24.882248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e20c9b41-adac-4dbd-bb1f-5d2a9038ee80 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:24.882881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e20c9b41-adac-4dbd-bb1f-5d2a9038ee80 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:24.889868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e20c9b41-adac-4dbd-bb1f-5d2a9038ee80 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.890335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e20c9b41-adac-4dbd-bb1f-5d2a9038ee80 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:24.891122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e20c9b41-adac-4dbd-bb1f-5d2a9038ee80 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:24.891566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e20c9b41-adac-4dbd-bb1f-5d2a9038ee80 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.019381 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-72bf674f-92ea-4381-97ce-644b561fdcde tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "POST /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862401 May 19 04:48:25.020252 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1967/4012] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:48:24 2022] POST /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809/os-volume_attachments => generated 194 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:25.030392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6123c8f9-5973-408a-8385-2e3149f75cd8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.031490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6123c8f9-5973-408a-8385-2e3149f75cd8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:25.041249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6123c8f9-5973-408a-8385-2e3149f75cd8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.041882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6123c8f9-5973-408a-8385-2e3149f75cd8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.042495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6123c8f9-5973-408a-8385-2e3149f75cd8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.042929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6123c8f9-5973-408a-8385-2e3149f75cd8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.084674 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6123c8f9-5973-408a-8385-2e3149f75cd8 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062932 May 19 04:48:25.086054 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1968/4013] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:25 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:25.092844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-413e3265-6962-4043-b537-00fff27fb7ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.094088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-413e3265-6962-4043-b537-00fff27fb7ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:25.101530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-413e3265-6962-4043-b537-00fff27fb7ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.101931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e20c9b41-adac-4dbd-bb1f-5d2a9038ee80 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:25.102625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-413e3265-6962-4043-b537-00fff27fb7ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.103889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-413e3265-6962-4043-b537-00fff27fb7ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.104605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-413e3265-6962-4043-b537-00fff27fb7ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.111930 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e20c9b41-adac-4dbd-bb1f-5d2a9038ee80 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1324 microversion: 2.1 time: 0.234007 May 19 04:48:25.114094 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2046/4014] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:24 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1324 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:25.120102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-524949b6-1435-450e-84d7-e34c41497084 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315df2b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.128799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-524949b6-1435-450e-84d7-e34c41497084 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.129659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-524949b6-1435-450e-84d7-e34c41497084 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.156483 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-524949b6-1435-450e-84d7-e34c41497084 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1936844392" status: 204 len: 0 microversion: 2.26 time: 0.040632 May 19 04:48:25.157347 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2047/4015] 10.222.0.58 () {60 vars in 1360 bytes} [Thu May 19 04:48:25 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1936844392 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:48:25.170084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315e7ac10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.177951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.178396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.178875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:25.185357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.185806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.186571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.187008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.209587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.210030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.226598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:25.249971 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d7ee0e2-b76b-4e7e-9eb7-f43e25e87d6d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 204 len: 0 microversion: 2.26 time: 0.087413 May 19 04:48:25.251096 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2048/4016] 10.222.0.58 () {60 vars in 1294 bytes} [Thu May 19 04:48:25 2022] DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:48:25.260239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a3fe144-92ad-44c0-8ffc-bdc06d76fb24 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315c94940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.269281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a3fe144-92ad-44c0-8ffc-bdc06d76fb24 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.269732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a3fe144-92ad-44c0-8ffc-bdc06d76fb24 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.279244 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a3fe144-92ad-44c0-8ffc-bdc06d76fb24 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 200 len: 12 microversion: 2.26 time: 0.022860 May 19 04:48:25.284788 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2049/4017] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 19 04:48:25 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 12 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:25.296099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315df2700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.310180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.310762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.311326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:25.320883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.322492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.325126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.325126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.362298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.363009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.377853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.378608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.410884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:25.416977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:25.439764 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6667af77-b731-4d95-8e16-9699187ad192 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1307712437" status: 201 len: 0 microversion: 2.26 time: 0.148524 May 19 04:48:25.441848 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2050/4018] 10.222.0.58 () {62 vars in 1379 bytes} [Thu May 19 04:48:25 2022] PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1307712437 => generated 0 bytes in 151 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 19 04:48:25.453877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1ecba6e5-734e-4201-9039-fbb2d5e36f00 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315e92700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.463761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ecba6e5-734e-4201-9039-fbb2d5e36f00 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.464377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ecba6e5-734e-4201-9039-fbb2d5e36f00 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.475501 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1ecba6e5-734e-4201-9039-fbb2d5e36f00 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 200 len: 36 microversion: 2.26 time: 0.029101 May 19 04:48:25.476453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2051/4019] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 19 04:48:25 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 36 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:25.486469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315f38d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.490549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-413e3265-6962-4043-b537-00fff27fb7ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:25.497083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.497697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.498252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:25.499235 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-413e3265-6962-4043-b537-00fff27fb7ec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.411754 May 19 04:48:25.509454 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1969/4020] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:25 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:25.509562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.509562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.509562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.509562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.517274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b1df69cb-d7f4-424a-a05b-7e4a40c81937 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.518150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b1df69cb-d7f4-424a-a05b-7e4a40c81937 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:25.527483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1df69cb-d7f4-424a-a05b-7e4a40c81937 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.528726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1df69cb-d7f4-424a-a05b-7e4a40c81937 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.535254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1df69cb-d7f4-424a-a05b-7e4a40c81937 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.535905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1df69cb-d7f4-424a-a05b-7e4a40c81937 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.536355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.536957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.574248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:25.590576 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3e26be82-94c3-4f51-ac1f-57d0a34b252c tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1307712437" status: 204 len: 0 microversion: 2.26 time: 0.108338 May 19 04:48:25.594919 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2052/4021] 10.222.0.58 () {60 vars in 1363 bytes} [Thu May 19 04:48:25 2022] DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1307712437 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 04:48:25.600181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d647dc8d-d7c1-413f-9763-5970b6584799 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315c94940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.613024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d647dc8d-d7c1-413f-9763-5970b6584799 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.613692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d647dc8d-d7c1-413f-9763-5970b6584799 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.626287 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d647dc8d-d7c1-413f-9763-5970b6584799 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 200 len: 12 microversion: 2.26 time: 0.030186 May 19 04:48:25.638063 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2053/4022] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 19 04:48:25 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:25.645598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-80c84286-9ac8-4758-8f77-ae9de9ed580d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:25.648040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-80c84286-9ac8-4758-8f77-ae9de9ed580d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:25.657218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80c84286-9ac8-4758-8f77-ae9de9ed580d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.658557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80c84286-9ac8-4758-8f77-ae9de9ed580d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:25.659566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80c84286-9ac8-4758-8f77-ae9de9ed580d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:25.660183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80c84286-9ac8-4758-8f77-ae9de9ed580d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.094349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b1df69cb-d7f4-424a-a05b-7e4a40c81937 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:26.107633 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b1df69cb-d7f4-424a-a05b-7e4a40c81937 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.594274 May 19 04:48:26.108836 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1970/4023] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:25 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:26.125983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd3166130d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:26.134296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.134975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.135641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:26.141797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.142723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.143656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.144267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.169471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.170284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.186671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:26.204411 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1745a57a-1e8f-4d91-a691-f61e0afca6fb tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 204 len: 0 microversion: 2.26 time: 0.094038 May 19 04:48:26.210373 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1971/4024] 10.222.0.58 () {60 vars in 1294 bytes} [Thu May 19 04:48:26 2022] DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:48:26.216396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a5d9fbe-db94-4caa-8bc0-f612561a967b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:26.217293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2a5d9fbe-db94-4caa-8bc0-f612561a967b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:26.238224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a5d9fbe-db94-4caa-8bc0-f612561a967b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.238948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a5d9fbe-db94-4caa-8bc0-f612561a967b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.239912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a5d9fbe-db94-4caa-8bc0-f612561a967b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.240526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a5d9fbe-db94-4caa-8bc0-f612561a967b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.699669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2a5d9fbe-db94-4caa-8bc0-f612561a967b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:26.714922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-80c84286-9ac8-4758-8f77-ae9de9ed580d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:26.728206 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-80c84286-9ac8-4758-8f77-ae9de9ed580d tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 200 len: 1470 microversion: 2.1 time: 1.088533 May 19 04:48:26.734314 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a5d9fbe-db94-4caa-8bc0-f612561a967b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1272 microversion: 2.1 time: 0.519808 May 19 04:48:26.735465 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1972/4025] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:26 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1272 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:26.753699 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2054/4026] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:25 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 1470 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:26.766145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0793f8d7-460c-4ccf-8a84-02c6b124fc0c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:26.767477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0793f8d7-460c-4ccf-8a84-02c6b124fc0c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:26.769105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b699c8d-be9a-4227-8a26-e0ac007e45fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:26.770895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b699c8d-be9a-4227-8a26-e0ac007e45fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 46c74316-430e-4321-90ff-a72513a747c2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:26.787845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0793f8d7-460c-4ccf-8a84-02c6b124fc0c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.790555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0793f8d7-460c-4ccf-8a84-02c6b124fc0c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.792233 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1b699c8d-be9a-4227-8a26-e0ac007e45fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 46c74316-430e-4321-90ff-a72513a747c2 could not be found. May 19 04:48:26.793663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0793f8d7-460c-4ccf-8a84-02c6b124fc0c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.794748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0793f8d7-460c-4ccf-8a84-02c6b124fc0c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b699c8d-be9a-4227-8a26-e0ac007e45fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/46c74316-430e-4321-90ff-a72513a747c2/action HTTP/1.1 May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 19 May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: {"forceDelete": {}} May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 46c74316-430e-4321-90ff-a72513a747c2 could not be found. May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '46c74316-430e-4321-90ff-a72513a747c2', 'body': {'forceDelete': {}}} May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c74316-430e-4321-90ff-a72513a747c2 could not be found. May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c74316-430e-4321-90ff-a72513a747c2 could not be found. May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:26.804412 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:26.809889 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:26.809889 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:26.809889 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c74316-430e-4321-90ff-a72513a747c2 could not be found. May 19 04:48:26.809889 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:26.809889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b699c8d-be9a-4227-8a26-e0ac007e45fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 46c74316-430e-4321-90ff-a72513a747c2 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:26.809889 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b699c8d-be9a-4227-8a26-e0ac007e45fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/46c74316-430e-4321-90ff-a72513a747c2/action" status: 404 len: 111 microversion: 2.1 time: 0.052531 May 19 04:48:26.810371 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2055/4027] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:26 2022] POST /compute/v2.1/servers/46c74316-430e-4321-90ff-a72513a747c2/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:26.818744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-de9d3a92-d75f-4d6d-bc21-92c1bd50f3b3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:26.822748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-de9d3a92-d75f-4d6d-bc21-92c1bd50f3b3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:26.843038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de9d3a92-d75f-4d6d-bc21-92c1bd50f3b3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.843486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de9d3a92-d75f-4d6d-bc21-92c1bd50f3b3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.844272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de9d3a92-d75f-4d6d-bc21-92c1bd50f3b3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.844712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de9d3a92-d75f-4d6d-bc21-92c1bd50f3b3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.860515 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0793f8d7-460c-4ccf-8a84-02c6b124fc0c tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107649 May 19 04:48:26.861403 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1973/4028] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:26 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:26.871422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315bd9820>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:26.880453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.881770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.882448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:26.891108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.891736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.892825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.893454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.927249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.927972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.940259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:26.941166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:26.990717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:27.011881 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-079815a0-3de8-41ed-bc90-19810bf8fbe9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1510973884" status: 201 len: 0 microversion: 2.26 time: 0.145403 May 19 04:48:27.013229 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1974/4029] 10.222.0.58 () {62 vars in 1379 bytes} [Thu May 19 04:48:26 2022] PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1510973884 => generated 0 bytes in 147 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 19 04:48:27.018350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-54a68942-1770-471b-8d47-4cb13b7fcf05 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:27.019103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-54a68942-1770-471b-8d47-4cb13b7fcf05 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:27.026709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54a68942-1770-471b-8d47-4cb13b7fcf05 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.027306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54a68942-1770-471b-8d47-4cb13b7fcf05 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.028248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54a68942-1770-471b-8d47-4cb13b7fcf05 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.028888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54a68942-1770-471b-8d47-4cb13b7fcf05 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.348473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-de9d3a92-d75f-4d6d-bc21-92c1bd50f3b3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:27.358426 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-de9d3a92-d75f-4d6d-bc21-92c1bd50f3b3 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1521 microversion: 2.1 time: 0.546242 May 19 04:48:27.366079 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2056/4030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:26 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:27.382221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315df2b80>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:27.409816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.415823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.416427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:27.426955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.427782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.428762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.433796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.509279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.509747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.532303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.533502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.553828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-54a68942-1770-471b-8d47-4cb13b7fcf05 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:27.569907 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-54a68942-1770-471b-8d47-4cb13b7fcf05 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.555316 May 19 04:48:27.582046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1975/4031] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:27 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:27.587379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-802afcd6-9f3c-4792-a2aa-aa8634fb644c req-ebb58cbd-ac9d-423e-b535-0da4ff00418a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b4bcbe-7d32-413b-930b-07d50a120398", "name": "network-vif-deleted", "tag": "f79d1dee-e2d5-4826-9e04-92b13dc0d7c1"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:27.591179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:27.613329 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-411dc7e5-c3b3-454c-a2a9-1b85414e93da tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1500882704" status: 201 len: 0 microversion: 2.26 time: 0.243843 May 19 04:48:27.614512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-802afcd6-9f3c-4792-a2aa-aa8634fb644c req-ebb58cbd-ac9d-423e-b535-0da4ff00418a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.615144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-802afcd6-9f3c-4792-a2aa-aa8634fb644c req-ebb58cbd-ac9d-423e-b535-0da4ff00418a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.621234 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2057/4032] 10.222.0.58 () {62 vars in 1379 bytes} [Thu May 19 04:48:27 2022] PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1500882704 => generated 0 bytes in 248 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 19 04:48:27.627827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:27.628633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:27.630304 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-802afcd6-9f3c-4792-a2aa-aa8634fb644c req-ebb58cbd-ac9d-423e-b535-0da4ff00418a service nova] Creating event network-vif-deleted:f79d1dee-e2d5-4826-9e04-92b13dc0d7c1 for instance 64b4bcbe-7d32-413b-930b-07d50a120398 on n-h2-766726-30 May 19 04:48:27.638648 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-802afcd6-9f3c-4792-a2aa-aa8634fb644c req-ebb58cbd-ac9d-423e-b535-0da4ff00418a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055202 May 19 04:48:27.639597 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1976/4033] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:27.645757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.646431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.648292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.649057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0945dfa-85da-4cd7-9e2c-b935cd7deae0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:27.649965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b0945dfa-85da-4cd7-9e2c-b935cd7deae0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:27.650912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.659493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0945dfa-85da-4cd7-9e2c-b935cd7deae0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.666145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0945dfa-85da-4cd7-9e2c-b935cd7deae0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.668005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0945dfa-85da-4cd7-9e2c-b935cd7deae0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.668732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0945dfa-85da-4cd7-9e2c-b935cd7deae0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.695536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:27.732574 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] HTTP exception thrown: Instance is not a member of specified network May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Request method failure captured: May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9/ips/invalid HTTP/1.1 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwE7HIhoVdakukLUJj_SF49pA5CWJSdriLCke1ko7zR6TtfDQ4CXESqVRPu38K17ljRdEHDFmDtj9EKk08naoF_5JEBVX5THIqJcKXqxWOkvEKRXNb8lu7IiDADm1DCz-Awtb18pU0OQA6g7UnxLZch8bpdEM4dHkw3LbKev6nKga0 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 097bae0ccbdd475f9343ed9a6a701209 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1138301835 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1138301835 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 097bae0ccbdd475f9343ed9a6a701209 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1138301835 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerAddressesNegativeTestJSON-1138301835-project May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e8c705c49e7943c8910805eed77c05b8 May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1138301835-project May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance is not a member of specified network May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'server_id': 'd9476278-d276-4cca-b1ab-85acb83fd3e9', 'id': 'invalid'} May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network May 19 04:48:27.738036 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:27.745242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Returning 404 to user: Instance is not a member of specified network {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:27.746463 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bc60cf27-62af-483c-81e5-39531d2ec6c7 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.122828 May 19 04:48:27.748922 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2058/4034] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:48:27 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9/ips/invalid => generated 91 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:48:27.755616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd316033820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:27.764561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.765588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.766255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:27.774357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.775888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.777680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.778367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.812066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.812784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.831877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:27.852998 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a08d0a27-14f4-4d8f-9d51-db0797b0555d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 204 len: 0 microversion: 2.26 time: 0.102670 May 19 04:48:27.853967 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2059/4035] 10.222.0.58 () {60 vars in 1294 bytes} [Thu May 19 04:48:27 2022] DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:48:27.887366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b0945dfa-85da-4cd7-9e2c-b935cd7deae0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:27.899109 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0945dfa-85da-4cd7-9e2c-b935cd7deae0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.257035 May 19 04:48:27.900957 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1977/4036] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:27 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:27.906448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-817eaa2b-ac6c-4303-95a0-66cb7ebd7d11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:27.907290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-817eaa2b-ac6c-4303-95a0-66cb7ebd7d11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:27.914565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-817eaa2b-ac6c-4303-95a0-66cb7ebd7d11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.915260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-817eaa2b-ac6c-4303-95a0-66cb7ebd7d11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:27.916322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-817eaa2b-ac6c-4303-95a0-66cb7ebd7d11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:27.917906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-817eaa2b-ac6c-4303-95a0-66cb7ebd7d11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.022829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2085669992", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:28.088435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] validate_networks() for [('294b4c93-2c2c-421f-9c73-af1990192d7c', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:48:28.228506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-817eaa2b-ac6c-4303-95a0-66cb7ebd7d11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:28.236820 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-817eaa2b-ac6c-4303-95a0-66cb7ebd7d11 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1314 microversion: 2.1 time: 0.334105 May 19 04:48:28.247595 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1978/4037] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:27 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:28.252678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bdfdde2f-ab70-4988-b6bc-4c088b1626e2 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:28.253197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bdfdde2f-ab70-4988-b6bc-4c088b1626e2 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Failed to fetch instance by id 999 {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 04:48:28.253713 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-bdfdde2f-ab70-4988-b6bc-4c088b1626e2 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] HTTP exception thrown: Instance 999 could not be found. May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bdfdde2f-ab70-4988-b6bc-4c088b1626e2 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Request method failure captured: May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwE7HIhoVdakukLUJj_SF49pA5CWJSdriLCke1ko7zR6TtfDQ4CXESqVRPu38K17ljRdEHDFmDtj9EKk08naoF_5JEBVX5THIqJcKXqxWOkvEKRXNb8lu7IiDADm1DCz-Awtb18pU0OQA6g7UnxLZch8bpdEM4dHkw3LbKev6nKga0 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 097bae0ccbdd475f9343ed9a6a701209 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1138301835 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1138301835 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 097bae0ccbdd475f9343ed9a6a701209 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1138301835 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerAddressesNegativeTestJSON-1138301835-project May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: e8c705c49e7943c8910805eed77c05b8 May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1138301835-project May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 999 could not be found. May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'server_id': '999'} May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 19 04:48:28.255490 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.261667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bdfdde2f-ab70-4988-b6bc-4c088b1626e2 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Returning 404 to user: Instance 999 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:28.261667 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bdfdde2f-ab70-4988-b6bc-4c088b1626e2 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007939 May 19 04:48:28.262552 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1979/4038] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 19 04:48:28 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:48:28.267546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:28.268423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 64b4bcbe-7d32-413b-930b-07d50a120398] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:28.275804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.277123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.278154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.278818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.294736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] HTTP exception thrown: Instance 64b4bcbe-7d32-413b-930b-07d50a120398 could not be found. May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Request method failure captured: May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 HTTP/1.1 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcuV44SzztwhNnEvcpBZaUzckRcGSBLgNhrbztGhLjqRKSaqIHCMbqNYDGFqB8RvD8AYSMdrtKcNo5wLg66UENYZJgnppNrbgrx4_mULMyc9dhAmPrZ5VRlBMt7mL_mXd-cHLjCoraGG_Ao6Ls2bgeupEz9oef3s7vkX1uwMX5AlLAY May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bd1653e189894a0394e865ab24170be7 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersAdminTestJSON-203099896 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd1653e189894a0394e865ab24170be7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd1653e189894a0394e865ab24170be7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd1653e189894a0394e865ab24170be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd1653e189894a0394e865ab24170be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersAdminTestJSON-203099896 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bd1653e189894a0394e865ab24170be7 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersAdminTestJSON-203099896 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersAdminTestJSON-203099896-project May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c736259c32d4429383b6c8d7f57f33a5 May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersAdminTestJSON-203099896-project May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 64b4bcbe-7d32-413b-930b-07d50a120398 could not be found. May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '64b4bcbe-7d32-413b-930b-07d50a120398'} May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b4bcbe-7d32-413b-930b-07d50a120398 could not be found. May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b4bcbe-7d32-413b-930b-07d50a120398 could not be found. May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:28.296821 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.302409 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:28.302409 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:28.302409 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:28.302409 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:28.302409 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:28.302409 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b4bcbe-7d32-413b-930b-07d50a120398 could not be found. May 19 04:48:28.302409 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.305171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Returning 404 to user: Instance 64b4bcbe-7d32-413b-930b-07d50a120398 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:28.307329 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00c40dd6-b727-4f48-ae6f-823b67705236 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398" status: 404 len: 111 microversion: 2.1 time: 0.043488 May 19 04:48:28.313792 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1980/4039] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:28 2022] GET /compute/v2.1/servers/64b4bcbe-7d32-413b-930b-07d50a120398 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:28.324733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc6a0807-b2de-4fdc-9c95-0fe19178f48d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315fba5e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:28.332958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc6a0807-b2de-4fdc-9c95-0fe19178f48d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.333499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc6a0807-b2de-4fdc-9c95-0fe19178f48d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.347274 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc6a0807-b2de-4fdc-9c95-0fe19178f48d tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 200 len: 12 microversion: 2.26 time: 0.036366 May 19 04:48:28.352280 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1981/4040] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 19 04:48:28 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:28.354140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5b136ae8-f3ff-42ba-aac1-8347fc5e48cb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:28.355857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5b136ae8-f3ff-42ba-aac1-8347fc5e48cb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:28.363118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b136ae8-f3ff-42ba-aac1-8347fc5e48cb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.363578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b136ae8-f3ff-42ba-aac1-8347fc5e48cb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.364810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b136ae8-f3ff-42ba-aac1-8347fc5e48cb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.365456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5b136ae8-f3ff-42ba-aac1-8347fc5e48cb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.399135 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5b136ae8-f3ff-42ba-aac1-8347fc5e48cb tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049781 May 19 04:48:28.399955 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1982/4041] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:28 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:28.405969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fcb6aa3c-3cf2-4121-94aa-3ef3a5765145 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:28.407871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fcb6aa3c-3cf2-4121-94aa-3ef3a5765145 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 3c72dd3e-7119-49e6-964a-7d3e39b21740] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:28.415138 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-fcb6aa3c-3cf2-4121-94aa-3ef3a5765145 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 3c72dd3e-7119-49e6-964a-7d3e39b21740 could not be found. May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fcb6aa3c-3cf2-4121-94aa-3ef3a5765145 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/3c72dd3e-7119-49e6-964a-7d3e39b21740/action HTTP/1.1 May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 39 May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: {"os-getConsoleOutput": {"length": 10}} May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 3c72dd3e-7119-49e6-964a-7d3e39b21740 could not be found. May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '3c72dd3e-7119-49e6-964a-7d3e39b21740', 'body': {'os-getConsoleOutput': {'length': 10}}} May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c72dd3e-7119-49e6-964a-7d3e39b21740 could not be found. May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c72dd3e-7119-49e6-964a-7d3e39b21740 could not be found. May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.421223 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:28.429923 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:28.429923 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:28.429923 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:28.429923 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:28.429923 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c72dd3e-7119-49e6-964a-7d3e39b21740 could not be found. May 19 04:48:28.429923 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:28.429923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fcb6aa3c-3cf2-4121-94aa-3ef3a5765145 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 3c72dd3e-7119-49e6-964a-7d3e39b21740 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:28.429923 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fcb6aa3c-3cf2-4121-94aa-3ef3a5765145 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/3c72dd3e-7119-49e6-964a-7d3e39b21740/action" status: 404 len: 111 microversion: 2.1 time: 0.022014 May 19 04:48:28.429923 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1983/4042] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:28 2022] POST /compute/v2.1/servers/3c72dd3e-7119-49e6-964a-7d3e39b21740/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:28.431224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-156e898b-2d84-46fe-a22e-59ccd2cc3698 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:28.431224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-156e898b-2d84-46fe-a22e-59ccd2cc3698 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:28.439557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-156e898b-2d84-46fe-a22e-59ccd2cc3698 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.440143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-156e898b-2d84-46fe-a22e-59ccd2cc3698 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.441027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-156e898b-2d84-46fe-a22e-59ccd2cc3698 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.441883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-156e898b-2d84-46fe-a22e-59ccd2cc3698 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.471843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-156e898b-2d84-46fe-a22e-59ccd2cc3698 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:48:28.561952 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-156e898b-2d84-46fe-a22e-59ccd2cc3698 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 204 len: 0 microversion: 2.1 time: 0.136691 May 19 04:48:28.562777 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1984/4043] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:28 2022] DELETE /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:48:28.568468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bdfa77d4-a362-4400-b821-cd81be2cdfb5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:28.569244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bdfa77d4-a362-4400-b821-cd81be2cdfb5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:28.575912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdfa77d4-a362-4400-b821-cd81be2cdfb5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.576488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdfa77d4-a362-4400-b821-cd81be2cdfb5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.577409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdfa77d4-a362-4400-b821-cd81be2cdfb5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.577954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdfa77d4-a362-4400-b821-cd81be2cdfb5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.606197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bdfa77d4-a362-4400-b821-cd81be2cdfb5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:48:28.687498 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bdfa77d4-a362-4400-b821-cd81be2cdfb5 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 204 len: 0 microversion: 2.1 time: 0.123075 May 19 04:48:28.688443 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1985/4044] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:28 2022] DELETE /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:48:28.694017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd31b7d28b0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:28.696090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:28.705141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.705805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.706513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:28.713206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.713853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.715221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.715784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.738721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.739324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.751269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:28.766849 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c82b22a0-32ca-47f3-a75e-952bb8416652 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 204 len: 0 microversion: 2.26 time: 0.077397 May 19 04:48:28.768258 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1986/4045] 10.222.0.58 () {60 vars in 1294 bytes} [Thu May 19 04:48:28 2022] DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:48:28.772485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-deb72bc3-dc13-416a-bafe-bbf19ed899b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:28.773154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-deb72bc3-dc13-416a-bafe-bbf19ed899b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:28.780506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deb72bc3-dc13-416a-bafe-bbf19ed899b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.781215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deb72bc3-dc13-416a-bafe-bbf19ed899b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.781989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deb72bc3-dc13-416a-bafe-bbf19ed899b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.782542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deb72bc3-dc13-416a-bafe-bbf19ed899b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.894468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:48:28.895660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:48:28.896052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:48:28.896475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:48:28.896895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:48:28.909401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.909612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.910910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:28.911628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:28.930733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Getting quotas for project 50bd6dd336a3473db8f25bf44ac35f90. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:48:28.937030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Getting quotas for user 1430890cad6248aa83686d53a8f4acac and project 50bd6dd336a3473db8f25bf44ac35f90. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:48:28.956880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:48:28.959162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:48:29.017824 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cadf5f89-8f1e-4bda-a32a-ffb5e3dc8cb9 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161895 May 19 04:48:29.023532 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2060/4046] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:48:29.024477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-deb72bc3-dc13-416a-bafe-bbf19ed899b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:29.033961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea0b1850-59c9-49f3-9b98-2a0ddbab0c82 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:29.034262 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-deb72bc3-dc13-416a-bafe-bbf19ed899b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.265594 May 19 04:48:29.035087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ea0b1850-59c9-49f3-9b98-2a0ddbab0c82 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:29.045408 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1987/4047] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:28 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:29.050936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e42151e4-7c68-4580-9c4a-835a10727d67 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:29.051848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e42151e4-7c68-4580-9c4a-835a10727d67 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:29.054434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea0b1850-59c9-49f3-9b98-2a0ddbab0c82 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.058494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea0b1850-59c9-49f3-9b98-2a0ddbab0c82 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.059337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea0b1850-59c9-49f3-9b98-2a0ddbab0c82 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.059791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ea0b1850-59c9-49f3-9b98-2a0ddbab0c82 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.062229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e42151e4-7c68-4580-9c4a-835a10727d67 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.062775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e42151e4-7c68-4580-9c4a-835a10727d67 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.063659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e42151e4-7c68-4580-9c4a-835a10727d67 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.068359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e42151e4-7c68-4580-9c4a-835a10727d67 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.439470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ea0b1850-59c9-49f3-9b98-2a0ddbab0c82 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:29.444451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e42151e4-7c68-4580-9c4a-835a10727d67 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:29.452900 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ea0b1850-59c9-49f3-9b98-2a0ddbab0c82 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1527 microversion: 2.1 time: 0.428101 May 19 04:48:29.454335 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2061/4048] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:29 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1527 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:29.460171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315be8d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:29.464241 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e42151e4-7c68-4580-9c4a-835a10727d67 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 200 len: 1470 microversion: 2.1 time: 0.417331 May 19 04:48:29.473908 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1988/4049] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:29 2022] GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 1470 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:29.479019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-633e9082-e473-488f-ba9e-dc301304ff3e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:29.480431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-633e9082-e473-488f-ba9e-dc301304ff3e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:29.480642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.481548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.482182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:29.500830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.501336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.504386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.507151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.540428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.541440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.550747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-633e9082-e473-488f-ba9e-dc301304ff3e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:29.560959 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-633e9082-e473-488f-ba9e-dc301304ff3e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1224 microversion: 2.1 time: 0.085571 May 19 04:48:29.562578 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1989/4050] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:29 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:29.563163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.563273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.569388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40e1dcb3-bc95-484d-b241-e1980b672448 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:29.570591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-40e1dcb3-bc95-484d-b241-e1980b672448 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:29.584868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40e1dcb3-bc95-484d-b241-e1980b672448 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.585176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40e1dcb3-bc95-484d-b241-e1980b672448 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.587265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40e1dcb3-bc95-484d-b241-e1980b672448 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.587726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40e1dcb3-bc95-484d-b241-e1980b672448 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.599737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:29.634627 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1c91ace2-875b-4cd0-a570-65cd8fc3ff28 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1733444673" status: 201 len: 0 microversion: 2.26 time: 0.179037 May 19 04:48:29.637794 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2062/4051] 10.222.0.58 () {62 vars in 1379 bytes} [Thu May 19 04:48:29 2022] PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-1733444673 => generated 0 bytes in 183 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 19 04:48:29.648884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0fe6631e-e1e5-4686-a531-a30d15d47a04 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:29.649935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0fe6631e-e1e5-4686-a531-a30d15d47a04 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:29.672809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0fe6631e-e1e5-4686-a531-a30d15d47a04 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.673471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0fe6631e-e1e5-4686-a531-a30d15d47a04 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.674610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0fe6631e-e1e5-4686-a531-a30d15d47a04 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.675190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0fe6631e-e1e5-4686-a531-a30d15d47a04 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.932231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-40e1dcb3-bc95-484d-b241-e1980b672448 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:29.955419 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-40e1dcb3-bc95-484d-b241-e1980b672448 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.390425 May 19 04:48:29.959713 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1990/4052] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:29 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:29.973113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2017e0c4-48bf-49f0-a893-4e937ecc2b46 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:29.974393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2017e0c4-48bf-49f0-a893-4e937ecc2b46 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:29.982569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2017e0c4-48bf-49f0-a893-4e937ecc2b46 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.983554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2017e0c4-48bf-49f0-a893-4e937ecc2b46 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:29.985030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2017e0c4-48bf-49f0-a893-4e937ecc2b46 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:29.985506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2017e0c4-48bf-49f0-a893-4e937ecc2b46 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.000101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0fe6631e-e1e5-4686-a531-a30d15d47a04 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:30.010083 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0fe6631e-e1e5-4686-a531-a30d15d47a04 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1314 microversion: 2.1 time: 0.370992 May 19 04:48:30.011462 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2063/4053] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:29 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:30.023423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315f95f70>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.027551 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2017e0c4-48bf-49f0-a893-4e937ecc2b46 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065597 May 19 04:48:30.028345 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1991/4054] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:29 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:30.032575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.033331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.034032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.034981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-92e9771b-71b4-4b86-b3dd-3b267aa3e80b req-287a54fd-354b-490b-a927-3f1b4bb9a40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3e8348-e01c-4df9-84b1-b13607f495a2", "tag": "0e54c145-1ac9-45b7-9f2f-916911e6deab"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:30.040993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.041716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.043532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.044176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.045174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-92e9771b-71b4-4b86-b3dd-3b267aa3e80b req-287a54fd-354b-490b-a927-3f1b4bb9a40c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.045625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-92e9771b-71b4-4b86-b3dd-3b267aa3e80b req-287a54fd-354b-490b-a927-3f1b4bb9a40c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.060971 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-92e9771b-71b4-4b86-b3dd-3b267aa3e80b req-287a54fd-354b-490b-a927-3f1b4bb9a40c service nova] Creating event network-changed:0e54c145-1ac9-45b7-9f2f-916911e6deab for instance db3e8348-e01c-4df9-84b1-b13607f495a2 on n-h2-766726-30 May 19 04:48:30.066792 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-92e9771b-71b4-4b86-b3dd-3b267aa3e80b req-287a54fd-354b-490b-a927-3f1b4bb9a40c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036734 May 19 04:48:30.067892 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1992/4055] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:30.071618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.072255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.073218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a1aeae1-580d-4af2-b224-7aa158ff5a54 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.074013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3a1aeae1-580d-4af2-b224-7aa158ff5a54 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c48f6f44-892a-4f95-804c-8c45cf0c269a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.076002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:30.080887 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-3a1aeae1-580d-4af2-b224-7aa158ff5a54 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance c48f6f44-892a-4f95-804c-8c45cf0c269a could not be found. May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a1aeae1-580d-4af2-b224-7aa158ff5a54 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/c48f6f44-892a-4f95-804c-8c45cf0c269a HTTP/1.1 May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c48f6f44-892a-4f95-804c-8c45cf0c269a could not be found. May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c48f6f44-892a-4f95-804c-8c45cf0c269a'} May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48f6f44-892a-4f95-804c-8c45cf0c269a could not be found. May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48f6f44-892a-4f95-804c-8c45cf0c269a could not be found. May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:30.083043 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:30.088340 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:30.088340 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:30.088340 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:30.088340 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48f6f44-892a-4f95-804c-8c45cf0c269a could not be found. May 19 04:48:30.088340 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:30.088340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a1aeae1-580d-4af2-b224-7aa158ff5a54 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance c48f6f44-892a-4f95-804c-8c45cf0c269a could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:30.088340 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a1aeae1-580d-4af2-b224-7aa158ff5a54 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c48f6f44-892a-4f95-804c-8c45cf0c269a" status: 404 len: 111 microversion: 2.1 time: 0.016621 May 19 04:48:30.088340 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1993/4056] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:30 2022] GET /compute/v2.1/servers/c48f6f44-892a-4f95-804c-8c45cf0c269a => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:30.090668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.091277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.098121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e866885-e98f-4ffc-a99b-c2f8d7895b55 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.098872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e866885-e98f-4ffc-a99b-c2f8d7895b55 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.108105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e866885-e98f-4ffc-a99b-c2f8d7895b55 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.108700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e866885-e98f-4ffc-a99b-c2f8d7895b55 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.109579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e866885-e98f-4ffc-a99b-c2f8d7895b55 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.110243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e866885-e98f-4ffc-a99b-c2f8d7895b55 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.124168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:30.141408 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be0c0038-9d22-4fb2-931a-116a8bf1d2e0 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-670656535" status: 201 len: 0 microversion: 2.26 time: 0.128460 May 19 04:48:30.142081 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2064/4057] 10.222.0.58 () {62 vars in 1376 bytes} [Thu May 19 04:48:30 2022] PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags/tempest-tag-670656535 => generated 0 bytes in 130 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 19 04:48:30.153729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Action: 'update_all', calling method: .version_select at 0x7fd3150b09d0>, body: {"tags": ["tempest-tag-965533698", "tempest-tag-616575557"]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:30.163504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.163959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.164441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.170654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.171130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.172084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.172526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.195967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.196426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.220156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:30.236217 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-63d1a7b0-5cfd-4caf-8bb2-1cacebb74f44 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 200 len: 60 microversion: 2.26 time: 0.087623 May 19 04:48:30.241563 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2065/4058] 10.222.0.58 () {62 vars in 1311 bytes} [Thu May 19 04:48:30 2022] PUT /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 60 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:30.247177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ef2f5d6-cc2f-44c2-a400-e894635a19d9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315b8e940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.255313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ef2f5d6-cc2f-44c2-a400-e894635a19d9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.255894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ef2f5d6-cc2f-44c2-a400-e894635a19d9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.266376 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ef2f5d6-cc2f-44c2-a400-e894635a19d9 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 200 len: 60 microversion: 2.26 time: 0.023577 May 19 04:48:30.267448 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2066/4059] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 19 04:48:30 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 60 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:30.277408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '.version_select at 0x7fd315c45940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.285473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.286078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.286679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.292512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.293185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.294066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.294613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.319855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.320453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.325427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e866885-e98f-4ffc-a99b-c2f8d7895b55 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:30.334005 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e866885-e98f-4ffc-a99b-c2f8d7895b55 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.241485 May 19 04:48:30.341463 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1994/4060] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:30 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:30.352501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0f23ccab-35e7-4726-ab65-ed2df35ed4d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.353321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0f23ccab-35e7-4726-ab65-ed2df35ed4d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.353548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lazy-loading 'flavor' on Instance uuid f77617f7-bae8-44a5-a97c-3a1193d6c640 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:30.360245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f23ccab-35e7-4726-ab65-ed2df35ed4d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.361027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f23ccab-35e7-4726-ab65-ed2df35ed4d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.362876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f23ccab-35e7-4726-ab65-ed2df35ed4d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.362876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f23ccab-35e7-4726-ab65-ed2df35ed4d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.378503 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d9c94b1-dc3d-4136-bac8-cfa857f3e1d3 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags" status: 204 len: 0 microversion: 2.26 time: 0.105568 May 19 04:48:30.379372 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2067/4061] 10.222.0.58 () {60 vars in 1294 bytes} [Thu May 19 04:48:30 2022] DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640/tags => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 04:48:30.389523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5eff00a1-358a-432e-980f-fafa4d073a58 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.390119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5eff00a1-358a-432e-980f-fafa4d073a58 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.396449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5eff00a1-358a-432e-980f-fafa4d073a58 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.396991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5eff00a1-358a-432e-980f-fafa4d073a58 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.397866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5eff00a1-358a-432e-980f-fafa4d073a58 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.398532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5eff00a1-358a-432e-980f-fafa4d073a58 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.425257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5eff00a1-358a-432e-980f-fafa4d073a58 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:48:30.498189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0f23ccab-35e7-4726-ab65-ed2df35ed4d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:30.500760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:30.507661 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0f23ccab-35e7-4726-ab65-ed2df35ed4d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.159350 May 19 04:48:30.508264 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1995/4062] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:30 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:30.514517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9dbe35ec-4909-455b-adde-7b04815b3cfd tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.515438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9dbe35ec-4909-455b-adde-7b04815b3cfd tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.522921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9dbe35ec-4909-455b-adde-7b04815b3cfd tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.524280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9dbe35ec-4909-455b-adde-7b04815b3cfd tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.524593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9dbe35ec-4909-455b-adde-7b04815b3cfd tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.525228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9dbe35ec-4909-455b-adde-7b04815b3cfd tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.544116 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5eff00a1-358a-432e-980f-fafa4d073a58 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 204 len: 0 microversion: 2.26 time: 0.158683 May 19 04:48:30.545447 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2068/4063] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:48:30 2022] DELETE /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 04:48:30.551872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a0a30695-9adc-4532-99a9-f90466811c8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.552784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a0a30695-9adc-4532-99a9-f90466811c8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.561106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0a30695-9adc-4532-99a9-f90466811c8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.565262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0a30695-9adc-4532-99a9-f90466811c8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.566290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0a30695-9adc-4532-99a9-f90466811c8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.567049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0a30695-9adc-4532-99a9-f90466811c8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.736681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9dbe35ec-4909-455b-adde-7b04815b3cfd tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:30.746502 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9dbe35ec-4909-455b-adde-7b04815b3cfd tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1527 microversion: 2.1 time: 0.236737 May 19 04:48:30.747088 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1996/4064] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:30 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1527 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:30.759749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.761640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.769448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.770017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.771021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.771836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.778191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a0a30695-9adc-4532-99a9-f90466811c8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:30.786655 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a0a30695-9adc-4532-99a9-f90466811c8e tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 200 len: 1470 microversion: 2.1 time: 0.239870 May 19 04:48:30.787554 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2069/4065] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:30 2022] GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:30.798538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f388a4a7-e476-4aa1-9a7b-9d99c92fb0fe tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.799236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f388a4a7-e476-4aa1-9a7b-9d99c92fb0fe tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.802664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:30.809784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f388a4a7-e476-4aa1-9a7b-9d99c92fb0fe tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.810333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f388a4a7-e476-4aa1-9a7b-9d99c92fb0fe tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.811119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f388a4a7-e476-4aa1-9a7b-9d99c92fb0fe tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.811564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f388a4a7-e476-4aa1-9a7b-9d99c92fb0fe tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.894013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f388a4a7-e476-4aa1-9a7b-9d99c92fb0fe tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:30.902024 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f388a4a7-e476-4aa1-9a7b-9d99c92fb0fe tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1228 microversion: 2.1 time: 0.108318 May 19 04:48:30.902732 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2070/4066] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:30 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1228 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:30.907531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ffcb5105-e49d-47ba-beee-904826acf176 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-844549207", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ffcb5105-e49d-47ba-beee-904826acf176 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 237 May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-844549207", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-844549207', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:30.911041 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 19 04:48:30.917590 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:30.919457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ffcb5105-e49d-47ba-beee-904826acf176 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:30.922009 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ffcb5105-e49d-47ba-beee-904826acf176 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018092 May 19 04:48:30.926081 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2071/4067] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:30 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:30.931516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3c4076ba-3d00-4a97-b285-724202b215bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:30.932347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3c4076ba-3d00-4a97-b285-724202b215bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:30.940755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c4076ba-3d00-4a97-b285-724202b215bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.941459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c4076ba-3d00-4a97-b285-724202b215bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.942696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c4076ba-3d00-4a97-b285-724202b215bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:30.943309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3c4076ba-3d00-4a97-b285-724202b215bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:30.948346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:30.967162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:30.972445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:30.975455 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c2c2450-52c3-4955-a7be-3b8d7ff12842 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1552 microversion: 2.26 time: 0.226804 May 19 04:48:30.978723 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1997/4068] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:30 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:31.031209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d10a7698-6380-48c5-81b4-22cfe807737d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:31.032255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d10a7698-6380-48c5-81b4-22cfe807737d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:31.043386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d10a7698-6380-48c5-81b4-22cfe807737d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.044099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d10a7698-6380-48c5-81b4-22cfe807737d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.045364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d10a7698-6380-48c5-81b4-22cfe807737d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.045970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d10a7698-6380-48c5-81b4-22cfe807737d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.144560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3c4076ba-3d00-4a97-b285-724202b215bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:31.153813 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3c4076ba-3d00-4a97-b285-724202b215bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.226405 May 19 04:48:31.154406 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2072/4069] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:30 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:31.171155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-923e2615-6fad-4ebc-8990-22156f5eaf8d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:31.172750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-923e2615-6fad-4ebc-8990-22156f5eaf8d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:31.179735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-923e2615-6fad-4ebc-8990-22156f5eaf8d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.180183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-923e2615-6fad-4ebc-8990-22156f5eaf8d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.180952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-923e2615-6fad-4ebc-8990-22156f5eaf8d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.181483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-923e2615-6fad-4ebc-8990-22156f5eaf8d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.211738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d10a7698-6380-48c5-81b4-22cfe807737d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:31.215964 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-923e2615-6fad-4ebc-8990-22156f5eaf8d tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060506 May 19 04:48:31.219729 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2073/4070] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:31 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:31.222498 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d10a7698-6380-48c5-81b4-22cfe807737d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1314 microversion: 2.1 time: 0.198284 May 19 04:48:31.223391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba766b1b-3439-463b-aac2-ec89fd9e66f2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:31.224068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba766b1b-3439-463b-aac2-ec89fd9e66f2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:31.230694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba766b1b-3439-463b-aac2-ec89fd9e66f2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.231213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba766b1b-3439-463b-aac2-ec89fd9e66f2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.231971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba766b1b-3439-463b-aac2-ec89fd9e66f2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.232407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba766b1b-3439-463b-aac2-ec89fd9e66f2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.233706 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1998/4071] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:31 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:31.367600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba766b1b-3439-463b-aac2-ec89fd9e66f2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:31.376115 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba766b1b-3439-463b-aac2-ec89fd9e66f2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.158005 May 19 04:48:31.376922 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2074/4072] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:31 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:31.432787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-47d12c84-48f4-43ec-a1b0-8477d46358af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83712499", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-47d12c84-48f4-43ec-a1b0-8477d46358af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 233 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83712499", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-83712499', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = func(instance) May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'notvalid' May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:31.442055 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-47d12c84-48f4-43ec-a1b0-8477d46358af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:31.447932 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-47d12c84-48f4-43ec-a1b0-8477d46358af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.015037 May 19 04:48:31.452605 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 1999/4073] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:31 2022] POST /compute/v2.1/servers => generated 133 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:31.452889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-946d1314-20a8-43d1-9804-bdbd0fbe0710 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:31.453556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-946d1314-20a8-43d1-9804-bdbd0fbe0710 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:31.460112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-946d1314-20a8-43d1-9804-bdbd0fbe0710 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.460578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-946d1314-20a8-43d1-9804-bdbd0fbe0710 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.461393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-946d1314-20a8-43d1-9804-bdbd0fbe0710 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.461844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-946d1314-20a8-43d1-9804-bdbd0fbe0710 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.691977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-946d1314-20a8-43d1-9804-bdbd0fbe0710 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:31.701552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-946d1314-20a8-43d1-9804-bdbd0fbe0710 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.252728 May 19 04:48:31.702652 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2075/4074] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:31 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:31.724235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-665afb6c-8820-429a-b88c-d432cd056efd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:31.725143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-665afb6c-8820-429a-b88c-d432cd056efd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:31.735608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-665afb6c-8820-429a-b88c-d432cd056efd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.736390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-665afb6c-8820-429a-b88c-d432cd056efd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.737498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-665afb6c-8820-429a-b88c-d432cd056efd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.738631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-665afb6c-8820-429a-b88c-d432cd056efd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.770778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e4c6d04-6a66-4e37-9e23-4f78ea507c0a tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:31.771321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4e4c6d04-6a66-4e37-9e23-4f78ea507c0a tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:31.782036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e4c6d04-6a66-4e37-9e23-4f78ea507c0a tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.782488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e4c6d04-6a66-4e37-9e23-4f78ea507c0a tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:31.783493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e4c6d04-6a66-4e37-9e23-4f78ea507c0a tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:31.783954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e4c6d04-6a66-4e37-9e23-4f78ea507c0a tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:32.052559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-665afb6c-8820-429a-b88c-d432cd056efd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:32.059156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4e4c6d04-6a66-4e37-9e23-4f78ea507c0a tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:32.065278 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-665afb6c-8820-429a-b88c-d432cd056efd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.347258 May 19 04:48:32.068011 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2000/4075] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:31 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:32.072906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a82f5b76-533f-478c-a532-798b0e915ec4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:32.073721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a82f5b76-533f-478c-a532-798b0e915ec4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:32.082036 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4e4c6d04-6a66-4e37-9e23-4f78ea507c0a tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1527 microversion: 2.1 time: 0.315631 May 19 04:48:32.084205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a82f5b76-533f-478c-a532-798b0e915ec4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:32.092723 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2076/4076] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:31 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1527 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:32.092723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df8a0488-3799-4467-9b70-494b04361eb3 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:32.092723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df8a0488-3799-4467-9b70-494b04361eb3 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:32.093754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a82f5b76-533f-478c-a532-798b0e915ec4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:32.096205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a82f5b76-533f-478c-a532-798b0e915ec4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:32.096666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a82f5b76-533f-478c-a532-798b0e915ec4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:32.100577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df8a0488-3799-4467-9b70-494b04361eb3 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:32.101059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df8a0488-3799-4467-9b70-494b04361eb3 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:32.101868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df8a0488-3799-4467-9b70-494b04361eb3 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:32.102307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df8a0488-3799-4467-9b70-494b04361eb3 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:32.261089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-df8a0488-3799-4467-9b70-494b04361eb3 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:32.269287 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df8a0488-3799-4467-9b70-494b04361eb3 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1220 microversion: 2.1 time: 0.183404 May 19 04:48:32.279963 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2077/4077] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:32 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:32.282659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:32.283290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:32.289669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:32.290127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:32.290918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:32.291369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:32.297584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:32.913406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a82f5b76-533f-478c-a532-798b0e915ec4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:32.929649 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a82f5b76-533f-478c-a532-798b0e915ec4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 200 len: 1470 microversion: 2.1 time: 0.860295 May 19 04:48:32.930570 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2001/4078] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:32 2022] GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 1470 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:32.935968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c8f96157-37f0-4abf-88cc-83fc8cf60833 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:32.936736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c8f96157-37f0-4abf-88cc-83fc8cf60833 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:32.951964 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-c8f96157-37f0-4abf-88cc-83fc8cf60833 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9 could not be found. May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c8f96157-37f0-4abf-88cc-83fc8cf60833 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9/action HTTP/1.1 May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 13 May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: {"pause": {}} May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9 could not be found. May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9', 'body': {'pause': {}}} May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9 could not be found. May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9 could not be found. May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:32.957499 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:32.962754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:32.962754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:32.962754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9 could not be found. May 19 04:48:32.962754 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:32.963847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c8f96157-37f0-4abf-88cc-83fc8cf60833 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:32.964892 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c8f96157-37f0-4abf-88cc-83fc8cf60833 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9/action" status: 404 len: 111 microversion: 2.1 time: 0.033198 May 19 04:48:32.965693 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2002/4079] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:32 2022] POST /compute/v2.1/servers/85a6cde0-eb5d-4f07-bdcb-065f1c1a4ef9/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:32.970605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74b73ee0-1a3d-4cfa-81e0-87f2d55de55f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:32.979672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74b73ee0-1a3d-4cfa-81e0-87f2d55de55f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:32.995715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b73ee0-1a3d-4cfa-81e0-87f2d55de55f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:32.998140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b73ee0-1a3d-4cfa-81e0-87f2d55de55f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:32.999454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b73ee0-1a3d-4cfa-81e0-87f2d55de55f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.000066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b73ee0-1a3d-4cfa-81e0-87f2d55de55f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:33.052702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:33.073988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:33.074532 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74b73ee0-1a3d-4cfa-81e0-87f2d55de55f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106725 May 19 04:48:33.078285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:33.079971 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f64bc787-dcbf-469d-89e8-b3e44d306afc tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1552 microversion: 2.26 time: 0.805565 May 19 04:48:33.080808 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2078/4080] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:32 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1552 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:33.093300 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2003/4081] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:32 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:33.095236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf8d3f5b-92f9-40e0-9ab7-9301f3bf642a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:33.096461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cf8d3f5b-92f9-40e0-9ab7-9301f3bf642a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:33.100741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9fd08afc-da36-4132-9ad0-ced6bda8094e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:33.101673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9fd08afc-da36-4132-9ad0-ced6bda8094e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:33.115453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fd08afc-da36-4132-9ad0-ced6bda8094e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.115863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fd08afc-da36-4132-9ad0-ced6bda8094e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:33.116705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fd08afc-da36-4132-9ad0-ced6bda8094e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.117394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fd08afc-da36-4132-9ad0-ced6bda8094e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:33.118972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf8d3f5b-92f9-40e0-9ab7-9301f3bf642a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.120483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf8d3f5b-92f9-40e0-9ab7-9301f3bf642a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:33.121633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf8d3f5b-92f9-40e0-9ab7-9301f3bf642a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.126760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf8d3f5b-92f9-40e0-9ab7-9301f3bf642a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:33.645583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9fd08afc-da36-4132-9ad0-ced6bda8094e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:33.654853 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9fd08afc-da36-4132-9ad0-ced6bda8094e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.560297 May 19 04:48:33.655790 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2004/4082] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:33 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:33.660788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8f821528-a98d-4f88-b269-a26e94536666 req-8bd28cf1-699b-4d05-a58e-f6d8417ea714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31", "name": "network-vif-deleted", "tag": "31a4c6f4-b707-4bc5-bb17-5f1f5cb1e5cc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:33.673397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8f821528-a98d-4f88-b269-a26e94536666 req-8bd28cf1-699b-4d05-a58e-f6d8417ea714 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.674242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8f821528-a98d-4f88-b269-a26e94536666 req-8bd28cf1-699b-4d05-a58e-f6d8417ea714 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:33.687026 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8f821528-a98d-4f88-b269-a26e94536666 req-8bd28cf1-699b-4d05-a58e-f6d8417ea714 service nova] Creating event network-vif-deleted:31a4c6f4-b707-4bc5-bb17-5f1f5cb1e5cc for instance 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 on n-h1-766726-30 May 19 04:48:33.695620 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8f821528-a98d-4f88-b269-a26e94536666 req-8bd28cf1-699b-4d05-a58e-f6d8417ea714 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038335 May 19 04:48:33.699437 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2005/4083] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:33.707681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cf8d3f5b-92f9-40e0-9ab7-9301f3bf642a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:33.715951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cd548a1e-68b0-45cf-aefb-d9f6f891e9b1 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:33.717127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cd548a1e-68b0-45cf-aefb-d9f6f891e9b1 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:33.724216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd548a1e-68b0-45cf-aefb-d9f6f891e9b1 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.728528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd548a1e-68b0-45cf-aefb-d9f6f891e9b1 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:33.730905 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cf8d3f5b-92f9-40e0-9ab7-9301f3bf642a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1314 microversion: 2.1 time: 0.647362 May 19 04:48:33.732762 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2079/4084] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:33 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:33.734065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd548a1e-68b0-45cf-aefb-d9f6f891e9b1 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.737002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd548a1e-68b0-45cf-aefb-d9f6f891e9b1 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:33.760636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba1c41fb-d6f1-4230-bff4-a3442041628d tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:33.762162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba1c41fb-d6f1-4230-bff4-a3442041628d tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:33.788395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba1c41fb-d6f1-4230-bff4-a3442041628d tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.788862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba1c41fb-d6f1-4230-bff4-a3442041628d tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:33.795164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba1c41fb-d6f1-4230-bff4-a3442041628d tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:33.797110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba1c41fb-d6f1-4230-bff4-a3442041628d tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.061845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:34.156531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cd548a1e-68b0-45cf-aefb-d9f6f891e9b1 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c705c49e7943c8910805eed77c05b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097bae0ccbdd475f9343ed9a6a701209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:34.166775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba1c41fb-d6f1-4230-bff4-a3442041628d tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:34.174069 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cd548a1e-68b0-45cf-aefb-d9f6f891e9b1 tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 200 len: 1527 microversion: 2.1 time: 0.472198 May 19 04:48:34.188811 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2006/4085] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:33 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 1527 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:34.189095 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba1c41fb-d6f1-4230-bff4-a3442041628d tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1324 microversion: 2.1 time: 0.448894 May 19 04:48:34.189095 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2080/4086] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:33 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:34.193532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:34.194146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:34.197565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c4cf1e25-3df4-4655-8dce-885dabbd933f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:34.199332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c4cf1e25-3df4-4655-8dce-885dabbd933f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:34.202555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.203276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.204232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.204838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.215754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4cf1e25-3df4-4655-8dce-885dabbd933f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.217501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4cf1e25-3df4-4655-8dce-885dabbd933f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.219015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4cf1e25-3df4-4655-8dce-885dabbd933f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.221223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4cf1e25-3df4-4655-8dce-885dabbd933f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.223610 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] HTTP exception thrown: Instance 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 could not be found. May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Request method failure captured: May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 HTTP/1.1 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcuV44SzztwhNnEvcpBZaUzckRcGSBLgNhrbztGhLjqRKSaqIHCMbqNYDGFqB8RvD8AYSMdrtKcNo5wLg66UENYZJgnppNrbgrx4_mULMyc9dhAmPrZ5VRlBMt7mL_mXd-cHLjCoraGG_Ao6Ls2bgeupEz9oef3s7vkX1uwMX5AlLAY May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: bd1653e189894a0394e865ab24170be7 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersAdminTestJSON-203099896 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd1653e189894a0394e865ab24170be7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd1653e189894a0394e865ab24170be7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd1653e189894a0394e865ab24170be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd1653e189894a0394e865ab24170be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersAdminTestJSON-203099896 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: bd1653e189894a0394e865ab24170be7 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersAdminTestJSON-203099896 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersAdminTestJSON-203099896-project May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: c736259c32d4429383b6c8d7f57f33a5 May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersAdminTestJSON-203099896-project May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 could not be found. May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31'} May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 could not be found. May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 could not be found. May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:34.225420 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:34.230356 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:34.230356 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:34.230356 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:34.230356 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:34.230356 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:34.230356 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 could not be found. May 19 04:48:34.230356 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:34.231564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Returning 404 to user: Instance 3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:34.232569 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4823b937-1fc8-403b-a3ff-48422cf2f03c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31" status: 404 len: 111 microversion: 2.1 time: 0.042739 May 19 04:48:34.234483 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2081/4087] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:34 2022] GET /compute/v2.1/servers/3d291ad3-7da9-47fe-bb3e-d51d0e0a0a31 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:34.247810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c6c22caf-d79c-4cc0-8acf-cb34d67c35b0 req-bf38484a-ad4a-4f8f-9a5c-8beb4c8d774f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3e8348-e01c-4df9-84b1-b13607f495a2", "name": "network-vif-plugged", "status": "completed", "tag": "0e54c145-1ac9-45b7-9f2f-916911e6deab"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:34.266459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c6c22caf-d79c-4cc0-8acf-cb34d67c35b0 req-bf38484a-ad4a-4f8f-9a5c-8beb4c8d774f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.270667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c6c22caf-d79c-4cc0-8acf-cb34d67c35b0 req-bf38484a-ad4a-4f8f-9a5c-8beb4c8d774f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.296062 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c6c22caf-d79c-4cc0-8acf-cb34d67c35b0 req-bf38484a-ad4a-4f8f-9a5c-8beb4c8d774f service nova] Creating event network-vif-plugged:0e54c145-1ac9-45b7-9f2f-916911e6deab for instance db3e8348-e01c-4df9-84b1-b13607f495a2 on n-h2-766726-30 May 19 04:48:34.301515 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c6c22caf-d79c-4cc0-8acf-cb34d67c35b0 req-bf38484a-ad4a-4f8f-9a5c-8beb4c8d774f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065267 May 19 04:48:34.302474 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2082/4088] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:34.310494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3f03891b-9abf-40f8-9c21-182b88fb26ae tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:34.311896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3f03891b-9abf-40f8-9c21-182b88fb26ae tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:34.321293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f03891b-9abf-40f8-9c21-182b88fb26ae tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.321932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f03891b-9abf-40f8-9c21-182b88fb26ae tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.324455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f03891b-9abf-40f8-9c21-182b88fb26ae tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.325097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f03891b-9abf-40f8-9c21-182b88fb26ae tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.367106 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3f03891b-9abf-40f8-9c21-182b88fb26ae tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062912 May 19 04:48:34.367963 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2083/4089] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:34 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:34.373286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:34.374130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:34.380953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.381933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.383118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.384034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.619760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c4cf1e25-3df4-4655-8dce-885dabbd933f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:34.627522 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c4cf1e25-3df4-4655-8dce-885dabbd933f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.438977 May 19 04:48:34.638737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:34.640431 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2007/4090] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:34 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:34.645871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af0b58f2-6ee5-41e2-9df6-26cc9f672543 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:34.646550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af0b58f2-6ee5-41e2-9df6-26cc9f672543 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:34.654381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af0b58f2-6ee5-41e2-9df6-26cc9f672543 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.654997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af0b58f2-6ee5-41e2-9df6-26cc9f672543 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.655813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:34.655965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af0b58f2-6ee5-41e2-9df6-26cc9f672543 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.656260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af0b58f2-6ee5-41e2-9df6-26cc9f672543 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.658814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7077ffd45e4709b9ad138ebd9a6ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db63bb8dc64849a982520a0311708c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:34.660063 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e5495c88-c625-411e-9eec-bac2be52b4db tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 200 len: 1510 microversion: 2.26 time: 0.290964 May 19 04:48:34.660827 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2084/4091] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:34 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:34.680710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5cdb2dfb-7a8e-4dfb-954d-7b94723760ae req-19565772-eced-417b-b705-ca6f6457b7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9476278-d276-4cca-b1ab-85acb83fd3e9", "name": "network-vif-deleted", "tag": "0cd55b87-442d-42d8-8722-02de0890a6ff"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:34.702795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5cdb2dfb-7a8e-4dfb-954d-7b94723760ae req-19565772-eced-417b-b705-ca6f6457b7ca service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.706262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5cdb2dfb-7a8e-4dfb-954d-7b94723760ae req-19565772-eced-417b-b705-ca6f6457b7ca service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.722917 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5cdb2dfb-7a8e-4dfb-954d-7b94723760ae req-19565772-eced-417b-b705-ca6f6457b7ca service nova] Creating event network-vif-deleted:0cd55b87-442d-42d8-8722-02de0890a6ff for instance d9476278-d276-4cca-b1ab-85acb83fd3e9 on n-h1-766726-30 May 19 04:48:34.724368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af0b58f2-6ee5-41e2-9df6-26cc9f672543 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:48:34.729467 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5cdb2dfb-7a8e-4dfb-954d-7b94723760ae req-19565772-eced-417b-b705-ca6f6457b7ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057261 May 19 04:48:34.730665 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2085/4092] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:34.736996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-84c3ad87-1b41-4a06-a194-7b33f00ae6fb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:34.737951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-84c3ad87-1b41-4a06-a194-7b33f00ae6fb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:34.748607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84c3ad87-1b41-4a06-a194-7b33f00ae6fb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.749307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84c3ad87-1b41-4a06-a194-7b33f00ae6fb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.750310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84c3ad87-1b41-4a06-a194-7b33f00ae6fb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.751087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84c3ad87-1b41-4a06-a194-7b33f00ae6fb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.893847 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-84c3ad87-1b41-4a06-a194-7b33f00ae6fb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 202 len: 0 microversion: 2.1 time: 0.161483 May 19 04:48:34.897443 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af0b58f2-6ee5-41e2-9df6-26cc9f672543 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "DELETE /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 204 len: 0 microversion: 2.1 time: 0.255088 May 19 04:48:34.898252 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2086/4093] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:34 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:48:34.911240 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2008/4094] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:34 2022] DELETE /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:48:34.913927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-02f9a195-ffff-42fb-b5d3-1293f44a1ee6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:34.915923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-02f9a195-ffff-42fb-b5d3-1293f44a1ee6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:34.921038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d098688-cb32-4e38-9f41-ba001c0f84ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:34.927388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d098688-cb32-4e38-9f41-ba001c0f84ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:34.930202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02f9a195-ffff-42fb-b5d3-1293f44a1ee6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.932869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02f9a195-ffff-42fb-b5d3-1293f44a1ee6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.933736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02f9a195-ffff-42fb-b5d3-1293f44a1ee6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.935137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02f9a195-ffff-42fb-b5d3-1293f44a1ee6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.936882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d098688-cb32-4e38-9f41-ba001c0f84ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.937875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d098688-cb32-4e38-9f41-ba001c0f84ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:34.938927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d098688-cb32-4e38-9f41-ba001c0f84ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:34.939744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d098688-cb32-4e38-9f41-ba001c0f84ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.248641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6d098688-cb32-4e38-9f41-ba001c0f84ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:35.260467 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d098688-cb32-4e38-9f41-ba001c0f84ed tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1509 microversion: 2.1 time: 0.347487 May 19 04:48:35.260626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-02f9a195-ffff-42fb-b5d3-1293f44a1ee6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:35.270851 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2009/4095] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:34 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1509 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:35.275905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a909624-7952-44c9-96f4-291396d7ae87 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:35.276868 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-02f9a195-ffff-42fb-b5d3-1293f44a1ee6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1314 microversion: 2.1 time: 0.375103 May 19 04:48:35.277490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0a909624-7952-44c9-96f4-291396d7ae87 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:35.277622 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2087/4096] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:34 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:35.284165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a909624-7952-44c9-96f4-291396d7ae87 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.285130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a909624-7952-44c9-96f4-291396d7ae87 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.286073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a909624-7952-44c9-96f4-291396d7ae87 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.286772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0a909624-7952-44c9-96f4-291396d7ae87 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.297347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:35.299354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] [instance: d9476278-d276-4cca-b1ab-85acb83fd3e9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:35.312781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.314862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.316170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.316761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.351793 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] HTTP exception thrown: Instance d9476278-d276-4cca-b1ab-85acb83fd3e9 could not be found. May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Request method failure captured: May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 HTTP/1.1 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwE7HIhoVdakukLUJj_SF49pA5CWJSdriLCke1ko7zR6TtfDQ4CXESqVRPu38K17ljRdEHDFmDtj9EKk08naoF_5JEBVX5THIqJcKXqxWOkvEKRXNb8lu7IiDADm1DCz-Awtb18pU0OQA6g7UnxLZch8bpdEM4dHkw3LbKev6nKga0 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 097bae0ccbdd475f9343ed9a6a701209 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1138301835 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_097bae0ccbdd475f9343ed9a6a701209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1138301835 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 097bae0ccbdd475f9343ed9a6a701209 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1138301835 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerAddressesNegativeTestJSON-1138301835-project May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: e8c705c49e7943c8910805eed77c05b8 May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1138301835-project May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance d9476278-d276-4cca-b1ab-85acb83fd3e9 could not be found. May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'd9476278-d276-4cca-b1ab-85acb83fd3e9'} May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9476278-d276-4cca-b1ab-85acb83fd3e9 could not be found. May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9476278-d276-4cca-b1ab-85acb83fd3e9 could not be found. May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:35.353994 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:35.359427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:35.359427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:35.359427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:35.359427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:35.359427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:35.359427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:35.359427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9476278-d276-4cca-b1ab-85acb83fd3e9 could not be found. May 19 04:48:35.359427 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:35.360645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] Returning 404 to user: Instance d9476278-d276-4cca-b1ab-85acb83fd3e9 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:35.361143 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b103f45f-aaaf-4fb5-ba65-6514e0aa80cc tempest-ServerAddressesNegativeTestJSON-1138301835 tempest-ServerAddressesNegativeTestJSON-1138301835-project] 10.222.0.58 "GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9" status: 404 len: 111 microversion: 2.1 time: 0.072926 May 19 04:48:35.362009 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2088/4097] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:35 2022] GET /compute/v2.1/servers/d9476278-d276-4cca-b1ab-85acb83fd3e9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:35.367080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e1c84d66-45d0-4d51-ba99-8f0a0c17d0a2 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:35.368260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e1c84d66-45d0-4d51-ba99-8f0a0c17d0a2 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:35.375386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1c84d66-45d0-4d51-ba99-8f0a0c17d0a2 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.375386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1c84d66-45d0-4d51-ba99-8f0a0c17d0a2 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.375783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1c84d66-45d0-4d51-ba99-8f0a0c17d0a2 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.376267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1c84d66-45d0-4d51-ba99-8f0a0c17d0a2 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.525314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0a909624-7952-44c9-96f4-291396d7ae87 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:35.537456 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0a909624-7952-44c9-96f4-291396d7ae87 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1469 microversion: 2.1 time: 0.265016 May 19 04:48:35.540171 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2010/4098] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:35 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:35.549230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-103b6eb5-d639-4054-b98b-7a77e59c9e2a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:35.550967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-103b6eb5-d639-4054-b98b-7a77e59c9e2a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:35.563989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-103b6eb5-d639-4054-b98b-7a77e59c9e2a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.564856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-103b6eb5-d639-4054-b98b-7a77e59c9e2a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.566394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-103b6eb5-d639-4054-b98b-7a77e59c9e2a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.567662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-103b6eb5-d639-4054-b98b-7a77e59c9e2a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.610390 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-103b6eb5-d639-4054-b98b-7a77e59c9e2a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067533 May 19 04:48:35.615786 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2011/4099] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:35 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:35.638736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e1c84d66-45d0-4d51-ba99-8f0a0c17d0a2 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:35.652651 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e1c84d66-45d0-4d51-ba99-8f0a0c17d0a2 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1324 microversion: 2.1 time: 0.289565 May 19 04:48:35.659291 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2089/4100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:35 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:35.683844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:35.684462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] [instance: f77617f7-bae8-44a5-a97c-3a1193d6c640] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:35.690623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.691059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.691927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.692364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.709310 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] HTTP exception thrown: Instance f77617f7-bae8-44a5-a97c-3a1193d6c640 could not be found. May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Request method failure captured: May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 HTTP/1.1 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwEv7PWw_tb6Xj0kL3Bi90t92woVuabvUn0dw32MtPk_5CHbf_ed6Ag3hCq8aGxmQITCeNJ4yZwJQsWhvbCIN4O3U5phohYWd9zpqCKvVvo9uhH01_hzTaJYA1airSefIc_L1s5O_NOXQtQRuR3YSYINLRvbTxu8fX1huVRICTnoL8 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.26 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: db63bb8dc64849a982520a0311708c8e May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerTagsTestJSON-1852623640 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/db63bb8dc64849a982520a0311708c8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db63bb8dc64849a982520a0311708c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db63bb8dc64849a982520a0311708c8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_db63bb8dc64849a982520a0311708c8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerTagsTestJSON-1852623640 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: db63bb8dc64849a982520a0311708c8e May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerTagsTestJSON-1852623640 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerTagsTestJSON-1852623640-project May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 4a7077ffd45e4709b9ad138ebd9a6ad5 May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerTagsTestJSON-1852623640-project May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance f77617f7-bae8-44a5-a97c-3a1193d6c640 could not be found. May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'f77617f7-bae8-44a5-a97c-3a1193d6c640'} May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77617f7-bae8-44a5-a97c-3a1193d6c640 could not be found. May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77617f7-bae8-44a5-a97c-3a1193d6c640 could not be found. May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:35.711109 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:35.721316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:35.721316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:35.721316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:35.721316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:35.721316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:35.721316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77617f7-bae8-44a5-a97c-3a1193d6c640 could not be found. May 19 04:48:35.721316 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:35.721316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] Returning 404 to user: Instance f77617f7-bae8-44a5-a97c-3a1193d6c640 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:35.721316 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7504e2e2-1bb6-4c1b-b87c-1bbf00d119f2 tempest-ServerTagsTestJSON-1852623640 tempest-ServerTagsTestJSON-1852623640-project] 10.222.0.58 "GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640" status: 404 len: 111 microversion: 2.26 time: 0.033056 May 19 04:48:35.723142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fbe8dc2c-3d5a-41f7-af76-8da79175e948 req-d371f22c-3540-42ac-b114-cf75466348b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf022f1-4234-4cd1-b09f-b63519a58e0f", "tag": "f545e355-9847-4402-a698-55d2cba5ee3a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:35.727599 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2012/4101] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:35 2022] GET /compute/v2.1/servers/f77617f7-bae8-44a5-a97c-3a1193d6c640 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:35.731467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fbe8dc2c-3d5a-41f7-af76-8da79175e948 req-d371f22c-3540-42ac-b114-cf75466348b3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:35.731961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fbe8dc2c-3d5a-41f7-af76-8da79175e948 req-d371f22c-3540-42ac-b114-cf75466348b3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:35.743540 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fbe8dc2c-3d5a-41f7-af76-8da79175e948 req-d371f22c-3540-42ac-b114-cf75466348b3 service nova] Creating event network-changed:f545e355-9847-4402-a698-55d2cba5ee3a for instance 4cf022f1-4234-4cd1-b09f-b63519a58e0f on n-h1-766726-30 May 19 04:48:35.748855 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fbe8dc2c-3d5a-41f7-af76-8da79175e948 req-d371f22c-3540-42ac-b114-cf75466348b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030529 May 19 04:48:35.749969 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2090/4102] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:48:36.279601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fed0b1bc-544a-4288-bbdb-834109a52ec3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:36.280390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fed0b1bc-544a-4288-bbdb-834109a52ec3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:36.295794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b169068-2fab-4a73-b479-624393617650 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:36.296510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b169068-2fab-4a73-b479-624393617650 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:36.307087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fed0b1bc-544a-4288-bbdb-834109a52ec3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.307729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fed0b1bc-544a-4288-bbdb-834109a52ec3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.309548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b169068-2fab-4a73-b479-624393617650 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.310971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fed0b1bc-544a-4288-bbdb-834109a52ec3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.313731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b169068-2fab-4a73-b479-624393617650 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.314443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fed0b1bc-544a-4288-bbdb-834109a52ec3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.319579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b169068-2fab-4a73-b479-624393617650 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.329776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b169068-2fab-4a73-b479-624393617650 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.621433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0b169068-2fab-4a73-b479-624393617650 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:36.629669 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b169068-2fab-4a73-b479-624393617650 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1314 microversion: 2.1 time: 0.339622 May 19 04:48:36.641006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fed0b1bc-544a-4288-bbdb-834109a52ec3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:36.644553 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2091/4103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:36 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:36.650537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dc5a0280-56f4-488b-a045-0d12f0d5d3f2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:36.651597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dc5a0280-56f4-488b-a045-0d12f0d5d3f2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:36.658273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc5a0280-56f4-488b-a045-0d12f0d5d3f2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.658953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc5a0280-56f4-488b-a045-0d12f0d5d3f2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.659723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc5a0280-56f4-488b-a045-0d12f0d5d3f2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.660329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc5a0280-56f4-488b-a045-0d12f0d5d3f2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.661344 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fed0b1bc-544a-4288-bbdb-834109a52ec3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1489 microversion: 2.1 time: 0.384591 May 19 04:48:36.663458 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2013/4104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:36 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1489 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:36.677885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e665a86d-d7a2-449a-916f-63958c1b3f91 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:36.678936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e665a86d-d7a2-449a-916f-63958c1b3f91 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:36.686952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e665a86d-d7a2-449a-916f-63958c1b3f91 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.687992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e665a86d-d7a2-449a-916f-63958c1b3f91 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.689508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e665a86d-d7a2-449a-916f-63958c1b3f91 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.690058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e665a86d-d7a2-449a-916f-63958c1b3f91 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.702231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:36.750725 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e665a86d-d7a2-449a-916f-63958c1b3f91 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080101 May 19 04:48:36.755183 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2014/4105] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:36 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:36.770835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5961f7d8-3962-48dc-ba85-7bbbd2f004dc tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:36.773044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5961f7d8-3962-48dc-ba85-7bbbd2f004dc tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:36.780826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5961f7d8-3962-48dc-ba85-7bbbd2f004dc tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.807045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5961f7d8-3962-48dc-ba85-7bbbd2f004dc tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.810660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5961f7d8-3962-48dc-ba85-7bbbd2f004dc tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.812676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5961f7d8-3962-48dc-ba85-7bbbd2f004dc tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.876431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc5a0280-56f4-488b-a045-0d12f0d5d3f2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:36.887654 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dc5a0280-56f4-488b-a045-0d12f0d5d3f2 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1469 microversion: 2.1 time: 0.241700 May 19 04:48:36.888245 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2092/4106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:36 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1469 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:36.895074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:36.895826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:36.904311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.904940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.906483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.907816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.939043 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Cannot 'pause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state paused May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action HTTP/1.1 May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 13 May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: {"pause": {}} May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'pause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state paused May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6', 'body': {'pause': {}}} May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 in vm_state paused. Cannot pause while the instance is in this state. May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state paused May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:36.941138 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:36.946336 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:36.946336 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:36.946336 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:36.946336 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state paused May 19 04:48:36.946336 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:36.946336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 409 to user: Cannot 'pause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state paused {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:36.946336 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c2dc738-4615-4bb3-b79f-11ca5b5c6bf6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 409 len: 143 microversion: 2.1 time: 0.052774 May 19 04:48:36.946336 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2093/4107] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:36 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 143 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:48:36.951804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a465f425-275e-40fb-91f4-2a1312bf18f1 req-7ad943ce-e42b-49d0-aec8-48b9dcdbd455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77617f7-bae8-44a5-a97c-3a1193d6c640", "name": "network-vif-deleted", "tag": "fc291ee9-1271-481c-af63-67410b81cb60"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:36.963410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a465f425-275e-40fb-91f4-2a1312bf18f1 req-7ad943ce-e42b-49d0-aec8-48b9dcdbd455 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:36.964111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a465f425-275e-40fb-91f4-2a1312bf18f1 req-7ad943ce-e42b-49d0-aec8-48b9dcdbd455 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:36.979959 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a465f425-275e-40fb-91f4-2a1312bf18f1 req-7ad943ce-e42b-49d0-aec8-48b9dcdbd455 service nova] Creating event network-vif-deleted:fc291ee9-1271-481c-af63-67410b81cb60 for instance f77617f7-bae8-44a5-a97c-3a1193d6c640 on n-h1-766726-30 May 19 04:48:36.986463 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a465f425-275e-40fb-91f4-2a1312bf18f1 req-7ad943ce-e42b-49d0-aec8-48b9dcdbd455 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040566 May 19 04:48:36.987887 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2094/4108] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:37.000602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-718645ed-91e3-4dc3-b823-0b5790509603 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:37.002779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-718645ed-91e3-4dc3-b823-0b5790509603 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:37.012014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-718645ed-91e3-4dc3-b823-0b5790509603 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.015641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-718645ed-91e3-4dc3-b823-0b5790509603 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.019231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-718645ed-91e3-4dc3-b823-0b5790509603 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.019931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-718645ed-91e3-4dc3-b823-0b5790509603 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.120516 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-718645ed-91e3-4dc3-b823-0b5790509603 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 202 len: 0 microversion: 2.1 time: 0.130838 May 19 04:48:37.121190 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2095/4109] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:36 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:48:37.135190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d70d740d-f7dd-4363-b81b-f8c4c4bc19d6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:37.136495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d70d740d-f7dd-4363-b81b-f8c4c4bc19d6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:37.150215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d70d740d-f7dd-4363-b81b-f8c4c4bc19d6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.150939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d70d740d-f7dd-4363-b81b-f8c4c4bc19d6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.152592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d70d740d-f7dd-4363-b81b-f8c4c4bc19d6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.153223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d70d740d-f7dd-4363-b81b-f8c4c4bc19d6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.288736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5961f7d8-3962-48dc-ba85-7bbbd2f004dc tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:37.296920 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5961f7d8-3962-48dc-ba85-7bbbd2f004dc tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1324 microversion: 2.1 time: 0.540205 May 19 04:48:37.301802 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2015/4110] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:36 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1324 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:37.472553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d70d740d-f7dd-4363-b81b-f8c4c4bc19d6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:37.483185 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d70d740d-f7dd-4363-b81b-f8c4c4bc19d6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1496 microversion: 2.1 time: 0.352633 May 19 04:48:37.484463 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2096/4111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:37 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1496 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:37.650862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-57d04b4b-ab18-4a07-be2a-8af91859b3b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:37.652329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-57d04b4b-ab18-4a07-be2a-8af91859b3b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:37.687337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57d04b4b-ab18-4a07-be2a-8af91859b3b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.687860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57d04b4b-ab18-4a07-be2a-8af91859b3b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.688599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57d04b4b-ab18-4a07-be2a-8af91859b3b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.689043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-57d04b4b-ab18-4a07-be2a-8af91859b3b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.762932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-635149b7-410a-4cf7-8c8c-e5c5d9667be6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:37.763978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-635149b7-410a-4cf7-8c8c-e5c5d9667be6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:37.774763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-635149b7-410a-4cf7-8c8c-e5c5d9667be6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.775422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-635149b7-410a-4cf7-8c8c-e5c5d9667be6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.776408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-635149b7-410a-4cf7-8c8c-e5c5d9667be6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.777011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-635149b7-410a-4cf7-8c8c-e5c5d9667be6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.836059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:37.863505 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-635149b7-410a-4cf7-8c8c-e5c5d9667be6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104805 May 19 04:48:37.864444 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2097/4112] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:48:37 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:48:37.905599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8e9634d9-a61b-4ff5-b8b8-9d070957003c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:37.906974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e9634d9-a61b-4ff5-b8b8-9d070957003c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:37.933017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e9634d9-a61b-4ff5-b8b8-9d070957003c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.939313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e9634d9-a61b-4ff5-b8b8-9d070957003c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.940626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e9634d9-a61b-4ff5-b8b8-9d070957003c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.941511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e9634d9-a61b-4ff5-b8b8-9d070957003c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:37.942758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-57d04b4b-ab18-4a07-be2a-8af91859b3b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:37.958317 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-57d04b4b-ab18-4a07-be2a-8af91859b3b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1501 microversion: 2.1 time: 0.310046 May 19 04:48:37.959574 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2016/4113] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:37 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1501 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:37.975839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-72738207-9e54-414d-afd6-fad997ad6960 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:37.991519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72738207-9e54-414d-afd6-fad997ad6960 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:37.997355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72738207-9e54-414d-afd6-fad997ad6960 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.060751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72738207-9e54-414d-afd6-fad997ad6960 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Going to try to stop instance {{(pid=124819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 04:48:38.160091 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-72738207-9e54-414d-afd6-fad997ad6960 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2/action" status: 202 len: 0 microversion: 2.1 time: 0.188841 May 19 04:48:38.164142 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2017/4114] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:37 2022] POST /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:48:38.183085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4f9e8fc7-c18a-4b7b-b4f9-ac496f8ee828 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:38.184999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4f9e8fc7-c18a-4b7b-b4f9-ac496f8ee828 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:38.193024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f9e8fc7-c18a-4b7b-b4f9-ac496f8ee828 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.194453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f9e8fc7-c18a-4b7b-b4f9-ac496f8ee828 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.194690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f9e8fc7-c18a-4b7b-b4f9-ac496f8ee828 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.195108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f9e8fc7-c18a-4b7b-b4f9-ac496f8ee828 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.226753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4f9e8fc7-c18a-4b7b-b4f9-ac496f8ee828 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:48:38.308378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e9634d9-a61b-4ff5-b8b8-9d070957003c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:38.320259 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8e9634d9-a61b-4ff5-b8b8-9d070957003c tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1469 microversion: 2.1 time: 0.419291 May 19 04:48:38.322738 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2098/4115] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:37 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1469 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:38.340718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-23ec3fe5-a155-4bce-918a-32b0b0104605 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:38.346662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-23ec3fe5-a155-4bce-918a-32b0b0104605 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:38.368996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23ec3fe5-a155-4bce-918a-32b0b0104605 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.371203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23ec3fe5-a155-4bce-918a-32b0b0104605 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.374187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23ec3fe5-a155-4bce-918a-32b0b0104605 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.374824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23ec3fe5-a155-4bce-918a-32b0b0104605 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.394861 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4f9e8fc7-c18a-4b7b-b4f9-ac496f8ee828 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 204 len: 0 microversion: 2.1 time: 0.218989 May 19 04:48:38.396343 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2018/4116] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:38 2022] DELETE /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:48:38.407198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8206af8a-4c68-45af-a07e-12e68504741c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:38.409163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8206af8a-4c68-45af-a07e-12e68504741c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:38.426249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8206af8a-4c68-45af-a07e-12e68504741c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.428113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8206af8a-4c68-45af-a07e-12e68504741c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.428919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8206af8a-4c68-45af-a07e-12e68504741c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.429382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8206af8a-4c68-45af-a07e-12e68504741c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.721450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23ec3fe5-a155-4bce-918a-32b0b0104605 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:38.730133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8206af8a-4c68-45af-a07e-12e68504741c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:38.734302 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-23ec3fe5-a155-4bce-918a-32b0b0104605 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.409837 May 19 04:48:38.736399 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2099/4117] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:38 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:38.738855 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8206af8a-4c68-45af-a07e-12e68504741c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1324 microversion: 2.1 time: 0.340917 May 19 04:48:38.748838 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2019/4118] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:38 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1324 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:38.749248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b8cb96ba-14c3-4292-a1b3-119d8fffa206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:38.751407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b8cb96ba-14c3-4292-a1b3-119d8fffa206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:38.754816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-09820cec-cfd4-49cd-ba4d-9103f8aa09e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:38.755435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-09820cec-cfd4-49cd-ba4d-9103f8aa09e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:38.762173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09820cec-cfd4-49cd-ba4d-9103f8aa09e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.762615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09820cec-cfd4-49cd-ba4d-9103f8aa09e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.763383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09820cec-cfd4-49cd-ba4d-9103f8aa09e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.764010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09820cec-cfd4-49cd-ba4d-9103f8aa09e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.764813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8cb96ba-14c3-4292-a1b3-119d8fffa206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.766112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8cb96ba-14c3-4292-a1b3-119d8fffa206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.766919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8cb96ba-14c3-4292-a1b3-119d8fffa206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:38.767382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8cb96ba-14c3-4292-a1b3-119d8fffa206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:38.922128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:38.945894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:39.062895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-09820cec-cfd4-49cd-ba4d-9103f8aa09e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:39.071800 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-09820cec-cfd4-49cd-ba4d-9103f8aa09e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.321239 May 19 04:48:39.072641 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2020/4119] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:38 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:39.093943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7a921304-8332-4519-9699-334cdfbed9c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:39.095285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7a921304-8332-4519-9699-334cdfbed9c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:39.102889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a921304-8332-4519-9699-334cdfbed9c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.103876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a921304-8332-4519-9699-334cdfbed9c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.105915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a921304-8332-4519-9699-334cdfbed9c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.106553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a921304-8332-4519-9699-334cdfbed9c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.165124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b8cb96ba-14c3-4292-a1b3-119d8fffa206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:39.175091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b8cb96ba-14c3-4292-a1b3-119d8fffa206 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1680 microversion: 2.1 time: 0.435761 May 19 04:48:39.176896 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2100/4120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:38 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1680 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:39.184725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-dc8206aa-eaec-4404-a8a4-36f2964886e7 req-0a74fa52-f45d-444c-b114-0cc87c6fc756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b11dd9-99d7-422e-9399-37f52d453bee", "name": "network-vif-deleted", "tag": "3f9d85c4-dcc4-422a-8896-34e1a8644e85"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:39.193526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dc8206aa-eaec-4404-a8a4-36f2964886e7 req-0a74fa52-f45d-444c-b114-0cc87c6fc756 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.194317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dc8206aa-eaec-4404-a8a4-36f2964886e7 req-0a74fa52-f45d-444c-b114-0cc87c6fc756 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.212577 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-dc8206aa-eaec-4404-a8a4-36f2964886e7 req-0a74fa52-f45d-444c-b114-0cc87c6fc756 service nova] Creating event network-vif-deleted:3f9d85c4-dcc4-422a-8896-34e1a8644e85 for instance 27b11dd9-99d7-422e-9399-37f52d453bee on n-h2-766726-30 May 19 04:48:39.220185 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-dc8206aa-eaec-4404-a8a4-36f2964886e7 req-0a74fa52-f45d-444c-b114-0cc87c6fc756 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041101 May 19 04:48:39.221747 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2101/4121] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:39.341580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b18f3b28-7828-47d4-9f39-2df483a7a2eb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:39.342506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b18f3b28-7828-47d4-9f39-2df483a7a2eb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:39.360581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b18f3b28-7828-47d4-9f39-2df483a7a2eb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.361210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b18f3b28-7828-47d4-9f39-2df483a7a2eb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.362288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b18f3b28-7828-47d4-9f39-2df483a7a2eb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.362978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b18f3b28-7828-47d4-9f39-2df483a7a2eb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.385851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7a921304-8332-4519-9699-334cdfbed9c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:39.398424 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7a921304-8332-4519-9699-334cdfbed9c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.308413 May 19 04:48:39.401409 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2021/4122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:39 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:39.420026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:39.421371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:39.428689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.429416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.430430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.431077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.450814 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2/action HTTP/1.1 May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 28 May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: {"reboot": {"type": "SOFT"}} May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c5ba435c-005c-4eff-beba-73270faa88e2', 'body': {'reboot': {'type': 'SOFT'}}} May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1033, in _action_reboot May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:39.456444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:39.462653 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:39.465536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:39.466420 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0cae9700-17d0-44f7-8ac1-9169f0fb5bb6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2/action" status: 404 len: 111 microversion: 2.1 time: 0.050900 May 19 04:48:39.470222 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2022/4123] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:39 2022] POST /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:39.475359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-58657702-68e6-4483-a4a8-1898730611c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:39.475978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-58657702-68e6-4483-a4a8-1898730611c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:39.482616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58657702-68e6-4483-a4a8-1898730611c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.483076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58657702-68e6-4483-a4a8-1898730611c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.483843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58657702-68e6-4483-a4a8-1898730611c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.484469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58657702-68e6-4483-a4a8-1898730611c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.531808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b18f3b28-7828-47d4-9f39-2df483a7a2eb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c736259c32d4429383b6c8d7f57f33a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1653e189894a0394e865ab24170be7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:39.545189 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b18f3b28-7828-47d4-9f39-2df483a7a2eb tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 200 len: 1427 microversion: 2.1 time: 0.209695 May 19 04:48:39.546339 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2102/4124] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:39 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 1427 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:39.556151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:39.755198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-49f8ca2c-3c0c-4fcb-bb8f-06ef8e040fcd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:39.756140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-49f8ca2c-3c0c-4fcb-bb8f-06ef8e040fcd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:39.774997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49f8ca2c-3c0c-4fcb-bb8f-06ef8e040fcd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.776478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49f8ca2c-3c0c-4fcb-bb8f-06ef8e040fcd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.777594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49f8ca2c-3c0c-4fcb-bb8f-06ef8e040fcd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.779568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49f8ca2c-3c0c-4fcb-bb8f-06ef8e040fcd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.793189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58657702-68e6-4483-a4a8-1898730611c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:39.810229 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-58657702-68e6-4483-a4a8-1898730611c9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.338667 May 19 04:48:39.810826 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2023/4125] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:39 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:39.821878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac5eb3c0-b4fe-4177-9926-ac333e782563 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:39.821878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ac5eb3c0-b4fe-4177-9926-ac333e782563 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:39.840787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac5eb3c0-b4fe-4177-9926-ac333e782563 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.841538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac5eb3c0-b4fe-4177-9926-ac333e782563 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:39.842496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac5eb3c0-b4fe-4177-9926-ac333e782563 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:39.843138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac5eb3c0-b4fe-4177-9926-ac333e782563 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:40.136277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ac5eb3c0-b4fe-4177-9926-ac333e782563 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:40.147035 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac5eb3c0-b4fe-4177-9926-ac333e782563 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1324 microversion: 2.1 time: 0.335126 May 19 04:48:40.176371 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2024/4126] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:39 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:40.185691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e9a45d6e-bb1a-43ea-91be-1bd2e679e7dc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:40.188308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e9a45d6e-bb1a-43ea-91be-1bd2e679e7dc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:40.200812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9a45d6e-bb1a-43ea-91be-1bd2e679e7dc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:40.206751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9a45d6e-bb1a-43ea-91be-1bd2e679e7dc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:40.209317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9a45d6e-bb1a-43ea-91be-1bd2e679e7dc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:40.209807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9a45d6e-bb1a-43ea-91be-1bd2e679e7dc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:40.376427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-49f8ca2c-3c0c-4fcb-bb8f-06ef8e040fcd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:40.391681 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-49f8ca2c-3c0c-4fcb-bb8f-06ef8e040fcd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.640452 May 19 04:48:40.393391 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2103/4127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:39 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:40.511367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e9a45d6e-bb1a-43ea-91be-1bd2e679e7dc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:40.525585 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e9a45d6e-bb1a-43ea-91be-1bd2e679e7dc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.345352 May 19 04:48:40.527075 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2025/4128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:40 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:40.544903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f0b73f67-8e01-4748-8f40-809a95584877 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:40.545565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f0b73f67-8e01-4748-8f40-809a95584877 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:40.571740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b73f67-8e01-4748-8f40-809a95584877 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:40.574434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b73f67-8e01-4748-8f40-809a95584877 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:40.579850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b73f67-8e01-4748-8f40-809a95584877 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:40.581887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b73f67-8e01-4748-8f40-809a95584877 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:40.642829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-795134359", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "052caafb-8ed5-4e69-9571-889a3f129929"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:40.738449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] validate_networks() for [('052caafb-8ed5-4e69-9571-889a3f129929', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:48:41.323918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f0b73f67-8e01-4748-8f40-809a95584877 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:41.340211 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f0b73f67-8e01-4748-8f40-809a95584877 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1680 microversion: 2.1 time: 0.810075 May 19 04:48:41.341124 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2026/4129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:40 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1680 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:41.349655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc0512e3-4c9e-4b11-bc4b-d3bd57719261 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:41.350962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fc0512e3-4c9e-4b11-bc4b-d3bd57719261 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:41.367348 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-fc0512e3-4c9e-4b11-bc4b-d3bd57719261 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca could not be found. May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc0512e3-4c9e-4b11-bc4b-d3bd57719261 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca/action HTTP/1.1 May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 28 May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: {"reboot": {"type": "SOFT"}} May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca could not be found. May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca', 'body': {'reboot': {'type': 'SOFT'}}} May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca could not be found. May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1033, in _action_reboot May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca could not be found. May 19 04:48:41.369669 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.374676 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:41.374676 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.374676 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:41.374676 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:41.374676 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:41.374676 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:41.374676 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:41.374676 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca could not be found. May 19 04:48:41.374676 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.386034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc0512e3-4c9e-4b11-bc4b-d3bd57719261 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:41.390110 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc0512e3-4c9e-4b11-bc4b-d3bd57719261 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca/action" status: 404 len: 111 microversion: 2.1 time: 0.047658 May 19 04:48:41.390884 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2027/4130] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:41 2022] POST /compute/v2.1/servers/2f5ae23b-f5e3-4b4a-98e7-bff69cdc0aca/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:41.397893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:41.398519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] [instance: 27b11dd9-99d7-422e-9399-37f52d453bee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:41.419592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:41.422390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:41.429901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:41.430617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:41.453340 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] HTTP exception thrown: Instance 27b11dd9-99d7-422e-9399-37f52d453bee could not be found. May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Request method failure captured: May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee HTTP/1.1 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcuV44SzztwhNnEvcpBZaUzckRcGSBLgNhrbztGhLjqRKSaqIHCMbqNYDGFqB8RvD8AYSMdrtKcNo5wLg66UENYZJgnppNrbgrx4_mULMyc9dhAmPrZ5VRlBMt7mL_mXd-cHLjCoraGG_Ao6Ls2bgeupEz9oef3s7vkX1uwMX5AlLAY May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bd1653e189894a0394e865ab24170be7 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersAdminTestJSON-203099896 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd1653e189894a0394e865ab24170be7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd1653e189894a0394e865ab24170be7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd1653e189894a0394e865ab24170be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd1653e189894a0394e865ab24170be7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersAdminTestJSON-203099896 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bd1653e189894a0394e865ab24170be7 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersAdminTestJSON-203099896 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersAdminTestJSON-203099896-project May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c736259c32d4429383b6c8d7f57f33a5 May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersAdminTestJSON-203099896-project May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 27b11dd9-99d7-422e-9399-37f52d453bee could not be found. May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '27b11dd9-99d7-422e-9399-37f52d453bee'} May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b11dd9-99d7-422e-9399-37f52d453bee could not be found. May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b11dd9-99d7-422e-9399-37f52d453bee could not be found. May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:41.467073 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.472379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:41.472379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:41.472379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:41.472379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:41.472379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:41.472379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b11dd9-99d7-422e-9399-37f52d453bee could not be found. May 19 04:48:41.472379 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:41.474123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] Returning 404 to user: Instance 27b11dd9-99d7-422e-9399-37f52d453bee could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:41.475274 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17211d75-ef73-4436-ac18-a68c7c0c17c4 tempest-ServersAdminTestJSON-203099896 tempest-ServersAdminTestJSON-203099896-project] 10.222.0.58 "GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee" status: 404 len: 111 microversion: 2.1 time: 0.081209 May 19 04:48:41.476096 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2028/4131] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:41 2022] GET /compute/v2.1/servers/27b11dd9-99d7-422e-9399-37f52d453bee => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:41.485304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-125c68b3-7bde-438c-ab0c-bdd55f317939 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:41.486202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-125c68b3-7bde-438c-ab0c-bdd55f317939 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:41.491860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:41.493926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-125c68b3-7bde-438c-ab0c-bdd55f317939 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:41.494977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-125c68b3-7bde-438c-ab0c-bdd55f317939 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:41.495998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-125c68b3-7bde-438c-ab0c-bdd55f317939 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:41.496698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-125c68b3-7bde-438c-ab0c-bdd55f317939 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:41.871753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-125c68b3-7bde-438c-ab0c-bdd55f317939 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:41.894379 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-125c68b3-7bde-438c-ab0c-bdd55f317939 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1324 microversion: 2.1 time: 0.404785 May 19 04:48:41.897709 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2029/4132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:41 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:41.909820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd362c2e-90a5-4a38-81cd-13fcc0ef604f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:41.910797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bd362c2e-90a5-4a38-81cd-13fcc0ef604f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:41.921650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd362c2e-90a5-4a38-81cd-13fcc0ef604f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:41.922945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd362c2e-90a5-4a38-81cd-13fcc0ef604f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:41.924003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd362c2e-90a5-4a38-81cd-13fcc0ef604f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:41.924608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd362c2e-90a5-4a38-81cd-13fcc0ef604f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:41.970064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:42.230730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:48:42.231316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:48:42.232134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:48:42.232559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:48:42.233742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:48:42.249579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:42.249970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:42.250785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:42.255605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:42.270658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bd362c2e-90a5-4a38-81cd-13fcc0ef604f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:42.281664 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd362c2e-90a5-4a38-81cd-13fcc0ef604f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.382606 May 19 04:48:42.282261 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2030/4133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:41 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:42.286780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3901f7e-1234-4e1b-9606-082e97e7a868 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:42.287396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3901f7e-1234-4e1b-9606-082e97e7a868 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:42.295445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3901f7e-1234-4e1b-9606-082e97e7a868 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:42.303587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3901f7e-1234-4e1b-9606-082e97e7a868 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:42.305329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Getting quotas for project 7a2ef054d17240bba2890ad4d2844110. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:48:42.306802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3901f7e-1234-4e1b-9606-082e97e7a868 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:42.308981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3901f7e-1234-4e1b-9606-082e97e7a868 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:42.323085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Getting quotas for user eed8bd607cfa4de4acf7a83d4f156302 and project 7a2ef054d17240bba2890ad4d2844110. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:48:42.365690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:48:42.368070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:48:42.449778 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-85ef2722-4ffa-4e76-9b6c-1bd824b20fb6 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.053965 May 19 04:48:42.463036 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2104/4134] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:48:42.468754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8f7f7add-6077-4392-ac5f-e28d1c190649 req-3d49771f-def3-4f19-b434-5ba2cd2b0499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf022f1-4234-4cd1-b09f-b63519a58e0f", "name": "network-vif-plugged", "status": "completed", "tag": "f545e355-9847-4402-a698-55d2cba5ee3a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:42.482273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8f7f7add-6077-4392-ac5f-e28d1c190649 req-3d49771f-def3-4f19-b434-5ba2cd2b0499 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:42.484707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8f7f7add-6077-4392-ac5f-e28d1c190649 req-3d49771f-def3-4f19-b434-5ba2cd2b0499 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:42.500759 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8f7f7add-6077-4392-ac5f-e28d1c190649 req-3d49771f-def3-4f19-b434-5ba2cd2b0499 service nova] Creating event network-vif-plugged:f545e355-9847-4402-a698-55d2cba5ee3a for instance 4cf022f1-4234-4cd1-b09f-b63519a58e0f on n-h1-766726-30 May 19 04:48:42.517961 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8f7f7add-6077-4392-ac5f-e28d1c190649 req-3d49771f-def3-4f19-b434-5ba2cd2b0499 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052917 May 19 04:48:42.520838 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2105/4135] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:42.539917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86cec7c4-3b2c-4bd4-95a7-e5885c52badc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:42.540939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86cec7c4-3b2c-4bd4-95a7-e5885c52badc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:42.571195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86cec7c4-3b2c-4bd4-95a7-e5885c52badc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:42.571649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86cec7c4-3b2c-4bd4-95a7-e5885c52badc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:42.572437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86cec7c4-3b2c-4bd4-95a7-e5885c52badc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:42.573181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86cec7c4-3b2c-4bd4-95a7-e5885c52badc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.053625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3901f7e-1234-4e1b-9606-082e97e7a868 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:43.063457 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3901f7e-1234-4e1b-9606-082e97e7a868 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.780132 May 19 04:48:43.091586 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2031/4136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:42 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:43.111422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eec26c7d-ace9-478c-9590-baea1373db6f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:43.112062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eec26c7d-ace9-478c-9590-baea1373db6f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:43.143339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eec26c7d-ace9-478c-9590-baea1373db6f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.143809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eec26c7d-ace9-478c-9590-baea1373db6f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.153117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eec26c7d-ace9-478c-9590-baea1373db6f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.157736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eec26c7d-ace9-478c-9590-baea1373db6f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.194042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86cec7c4-3b2c-4bd4-95a7-e5885c52badc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:43.214420 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86cec7c4-3b2c-4bd4-95a7-e5885c52badc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.683995 May 19 04:48:43.217354 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2106/4137] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:42 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:43.243867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-759e2cd5-18fd-4678-8316-75d1f2860e50 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:43.253014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-759e2cd5-18fd-4678-8316-75d1f2860e50 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:43.276909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759e2cd5-18fd-4678-8316-75d1f2860e50 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.278273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759e2cd5-18fd-4678-8316-75d1f2860e50 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.280005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759e2cd5-18fd-4678-8316-75d1f2860e50 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.281195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-759e2cd5-18fd-4678-8316-75d1f2860e50 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.382017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eec26c7d-ace9-478c-9590-baea1373db6f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a651109c72e84cab9e712ad5fbd002b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db6b7171e3b4a2db160855939246a40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:43.398627 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eec26c7d-ace9-478c-9590-baea1373db6f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 200 len: 1612 microversion: 2.1 time: 0.304735 May 19 04:48:43.399980 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2032/4138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:43 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 1612 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:43.413392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-830bd256-1611-4ee5-9bad-7c0eb64cf12e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:43.414425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-830bd256-1611-4ee5-9bad-7c0eb64cf12e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:43.433667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-830bd256-1611-4ee5-9bad-7c0eb64cf12e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.435576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-830bd256-1611-4ee5-9bad-7c0eb64cf12e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.440326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-830bd256-1611-4ee5-9bad-7c0eb64cf12e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.441193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-830bd256-1611-4ee5-9bad-7c0eb64cf12e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.576388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-759e2cd5-18fd-4678-8316-75d1f2860e50 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:43.589317 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-759e2cd5-18fd-4678-8316-75d1f2860e50 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1219 microversion: 2.1 time: 0.369516 May 19 04:48:43.592775 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2107/4139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:43 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1219 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:43.602634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:43.606635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:43.624761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.625421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.627154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.627875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.661269 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2/action HTTP/1.1 May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 65 May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c5ba435c-005c-4eff-beba-73270faa88e2', 'body': {'rebuild': {'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb'}}} May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 19 04:48:43.663727 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_rebuild May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:48:43.669790 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:43.674819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:43.674819 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27f2e5ad-b140-46a2-902c-e3d820a3dc8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2/action" status: 404 len: 111 microversion: 2.1 time: 0.075800 May 19 04:48:43.675474 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2108/4140] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:43 2022] POST /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:43.687464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d50bbc5a-7f52-4754-b719-728495758c8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:43.698178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d50bbc5a-7f52-4754-b719-728495758c8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:43.706036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d50bbc5a-7f52-4754-b719-728495758c8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.706844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d50bbc5a-7f52-4754-b719-728495758c8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:43.707919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d50bbc5a-7f52-4754-b719-728495758c8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:43.708565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d50bbc5a-7f52-4754-b719-728495758c8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:44.189665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-830bd256-1611-4ee5-9bad-7c0eb64cf12e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:44.206516 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-830bd256-1611-4ee5-9bad-7c0eb64cf12e tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1324 microversion: 2.1 time: 0.802835 May 19 04:48:44.223222 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2033/4141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:43 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1324 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:44.236803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9f3db7a9-fd47-4bbe-a708-1b6565494068 req-3ad0ed9e-f829-464f-85dc-75e4d3b69793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ca519a-97b0-4dca-9d06-c04dc5b5a42b", "name": "network-vif-deleted", "tag": "202be358-9adf-447e-9372-327b229c28d5"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:44.267044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9f3db7a9-fd47-4bbe-a708-1b6565494068 req-3ad0ed9e-f829-464f-85dc-75e4d3b69793 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:44.267787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9f3db7a9-fd47-4bbe-a708-1b6565494068 req-3ad0ed9e-f829-464f-85dc-75e4d3b69793 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:44.299464 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9f3db7a9-fd47-4bbe-a708-1b6565494068 req-3ad0ed9e-f829-464f-85dc-75e4d3b69793 service nova] Creating event network-vif-deleted:202be358-9adf-447e-9372-327b229c28d5 for instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b on n-h2-766726-30 May 19 04:48:44.306822 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9f3db7a9-fd47-4bbe-a708-1b6565494068 req-3ad0ed9e-f829-464f-85dc-75e4d3b69793 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080985 May 19 04:48:44.307921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d50bbc5a-7f52-4754-b719-728495758c8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:44.310306 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2034/4142] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:44.319645 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d50bbc5a-7f52-4754-b719-728495758c8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.637244 May 19 04:48:44.320259 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2109/4143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:43 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:44.340261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9aa8cf04-5238-41df-8caa-ca5b7c9ddf72 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:44.342040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9aa8cf04-5238-41df-8caa-ca5b7c9ddf72 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:44.347783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a11e3953-7482-4db3-a87e-29e493eec5b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:44.353860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a11e3953-7482-4db3-a87e-29e493eec5b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:44.366217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a11e3953-7482-4db3-a87e-29e493eec5b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:44.368704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a11e3953-7482-4db3-a87e-29e493eec5b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:44.370235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a11e3953-7482-4db3-a87e-29e493eec5b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:44.373899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a11e3953-7482-4db3-a87e-29e493eec5b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:44.376215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9aa8cf04-5238-41df-8caa-ca5b7c9ddf72 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:44.376745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9aa8cf04-5238-41df-8caa-ca5b7c9ddf72 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:44.377603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9aa8cf04-5238-41df-8caa-ca5b7c9ddf72 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:44.380277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9aa8cf04-5238-41df-8caa-ca5b7c9ddf72 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:44.964837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a11e3953-7482-4db3-a87e-29e493eec5b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:44.976067 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a11e3953-7482-4db3-a87e-29e493eec5b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.636268 May 19 04:48:44.980368 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2110/4144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:44 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:44.993824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:44.995761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:45.011505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9aa8cf04-5238-41df-8caa-ca5b7c9ddf72 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:45.012503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.013298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:45.014359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.015072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:45.019988 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9aa8cf04-5238-41df-8caa-ca5b7c9ddf72 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.707846 May 19 04:48:45.024442 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2035/4145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:44 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:45.032860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd33625c-fffb-457b-be06-7ef39d4cc254 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:45.038077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fd33625c-fffb-457b-be06-7ef39d4cc254 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:45.068615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd33625c-fffb-457b-be06-7ef39d4cc254 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.072820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd33625c-fffb-457b-be06-7ef39d4cc254 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:45.073828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd33625c-fffb-457b-be06-7ef39d4cc254 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.075936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd33625c-fffb-457b-be06-7ef39d4cc254 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:45.086049 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b HTTP/1.1 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'b5ca519a-97b0-4dca-9d06-c04dc5b5a42b'} May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:45.087619 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.097449 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:45.097449 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:45.097449 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:45.097449 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:45.097449 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:45.097449 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:45.097449 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.097449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:45.097449 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b7b11a1-f762-4299-a9f1-e2dd4e2ea039 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 404 len: 111 microversion: 2.1 time: 0.107546 May 19 04:48:45.113156 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2111/4146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:44 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:45.130578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1d47aed2-a217-4b04-83df-8ade1a96c3aa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:45.132773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1d47aed2-a217-4b04-83df-8ade1a96c3aa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:45.154670 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1d47aed2-a217-4b04-83df-8ade1a96c3aa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e could not be found. May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1d47aed2-a217-4b04-83df-8ade1a96c3aa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e/action HTTP/1.1 May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 65 May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e could not be found. May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e', 'body': {'rebuild': {'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb'}}} May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e could not be found. May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_rebuild May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 04:48:45.156347 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e could not be found. May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e could not be found. May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1d47aed2-a217-4b04-83df-8ade1a96c3aa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:45.164558 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1d47aed2-a217-4b04-83df-8ade1a96c3aa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e/action" status: 404 len: 111 microversion: 2.1 time: 0.043795 May 19 04:48:45.171242 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2112/4147] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:45 2022] POST /compute/v2.1/servers/80ab7cd1-c055-4c9d-a27d-bdaf5e4dc14e/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:45.186588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ef767ee-46a7-42aa-a3af-64bc5014d3f6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '.version_select at 0x7fd31502fe50>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:45.219388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:45.246919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd33625c-fffb-457b-be06-7ef39d4cc254 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:45.259672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd33625c-fffb-457b-be06-7ef39d4cc254 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1273 microversion: 2.1 time: 0.233672 May 19 04:48:45.262393 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2036/4148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:45 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:45.269331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ef767ee-46a7-42aa-a3af-64bc5014d3f6 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-213532087" status: 202 len: 0 microversion: 2.1 time: 0.096784 May 19 04:48:45.271458 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2113/4149] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:48:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-213532087 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:48:45.274374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0fc68871-f87b-4f26-81b4-08d02d0f22e9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:45.287726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0fc68871-f87b-4f26-81b4-08d02d0f22e9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:45.291808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1a7ba43-a8cb-47d1-bcf4-74c0864d63f8 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:45.293779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1a7ba43-a8cb-47d1-bcf4-74c0864d63f8 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:45.314002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc68871-f87b-4f26-81b4-08d02d0f22e9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.316736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc68871-f87b-4f26-81b4-08d02d0f22e9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:45.317613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1a7ba43-a8cb-47d1-bcf4-74c0864d63f8 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.318214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc68871-f87b-4f26-81b4-08d02d0f22e9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.318430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fc68871-f87b-4f26-81b4-08d02d0f22e9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:45.318658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1a7ba43-a8cb-47d1-bcf4-74c0864d63f8 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:45.321650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1a7ba43-a8cb-47d1-bcf4-74c0864d63f8 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.322253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1a7ba43-a8cb-47d1-bcf4-74c0864d63f8 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:45.836000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1a7ba43-a8cb-47d1-bcf4-74c0864d63f8 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:45.846357 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1a7ba43-a8cb-47d1-bcf4-74c0864d63f8 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1520 microversion: 2.1 time: 0.573537 May 19 04:48:45.852581 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2114/4150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:45 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1520 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:45.900280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0fc68871-f87b-4f26-81b4-08d02d0f22e9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:45.920707 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0fc68871-f87b-4f26-81b4-08d02d0f22e9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.657112 May 19 04:48:45.948300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1d4b2ca-e99d-4cd2-aafd-bb6e7bcbe637 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:45.949031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1d4b2ca-e99d-4cd2-aafd-bb6e7bcbe637 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:45.954723 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2037/4151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:45 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:45.955979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d4b2ca-e99d-4cd2-aafd-bb6e7bcbe637 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.956504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d4b2ca-e99d-4cd2-aafd-bb6e7bcbe637 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:45.957401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d4b2ca-e99d-4cd2-aafd-bb6e7bcbe637 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:45.957916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d4b2ca-e99d-4cd2-aafd-bb6e7bcbe637 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:46.027193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fe6e9f60-1ea8-4bcf-8a0e-a09de838aeda tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2057138644", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fe6e9f60-1ea8-4bcf-8a0e-a09de838aeda tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Request method failure captured: May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 243 May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwbl0WGcLkgbrZhwRE0GjBxcGKtjpaAqN5rfiMVRhwCsOm4rxAE12WQT9c2IRo-k_9uqlFZCgwhn0D_6VRif8H7J5iMFmwarnXqQ2-ITyoFQBV--U9V9boRezQ-ytKEiTdEPQGrTS-8GTvI2XjcfKiWOGowMIO50wyQZEOCazZFf2M May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1430890cad6248aa83686d53a8f4acac May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2057138644", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2057138644', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '294b4c93-2c2c-421f-9c73-af1990192d7c'}]}}} May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'': 'data1'} May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:46.030181 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fe6e9f60-1ea8-4bcf-8a0e-a09de838aeda tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fe6e9f60-1ea8-4bcf-8a0e-a09de838aeda tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.008350 May 19 04:48:46.046442 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2038/4152] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:46 2022] POST /compute/v2.1/servers => generated 175 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 04:48:46.048326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da040187-f0ea-4773-bff4-9159450f00e3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:46.048326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da040187-f0ea-4773-bff4-9159450f00e3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:46.066189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da040187-f0ea-4773-bff4-9159450f00e3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:46.066648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da040187-f0ea-4773-bff4-9159450f00e3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:46.067507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da040187-f0ea-4773-bff4-9159450f00e3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:46.067960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da040187-f0ea-4773-bff4-9159450f00e3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:46.755731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1d4b2ca-e99d-4cd2-aafd-bb6e7bcbe637 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:46.771650 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1d4b2ca-e99d-4cd2-aafd-bb6e7bcbe637 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.827226 May 19 04:48:46.776385 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2115/4153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:45 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:46.790560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4e1b88d-9cba-4215-9871-b9abcad18de0 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:46.791932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c4e1b88d-9cba-4215-9871-b9abcad18de0 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4523bfe9-04d9-4d46-87a3-ba8559931b6c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:46.807370 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c4e1b88d-9cba-4215-9871-b9abcad18de0 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] HTTP exception thrown: Instance 4523bfe9-04d9-4d46-87a3-ba8559931b6c could not be found. May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4e1b88d-9cba-4215-9871-b9abcad18de0 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Request method failure captured: May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/4523bfe9-04d9-4d46-87a3-ba8559931b6c/metadata HTTP/1.1 May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwbl0WGcLkgbrZhwRE0GjBxcGKtjpaAqN5rfiMVRhwCsOm4rxAE12WQT9c2IRo-k_9uqlFZCgwhn0D_6VRif8H7J5iMFmwarnXqQ2-ITyoFQBV--U9V9boRezQ-ytKEiTdEPQGrTS-8GTvI2XjcfKiWOGowMIO50wyQZEOCazZFf2M May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1430890cad6248aa83686d53a8f4acac May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 4523bfe9-04d9-4d46-87a3-ba8559931b6c could not be found. May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'server_id': '4523bfe9-04d9-4d46-87a3-ba8559931b6c'} May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4523bfe9-04d9-4d46-87a3-ba8559931b6c could not be found. May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4523bfe9-04d9-4d46-87a3-ba8559931b6c could not be found. May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:46.817446 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:46.822381 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:46.822381 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:46.822381 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4523bfe9-04d9-4d46-87a3-ba8559931b6c could not be found. May 19 04:48:46.822381 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:46.824409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4e1b88d-9cba-4215-9871-b9abcad18de0 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Returning 404 to user: Instance 4523bfe9-04d9-4d46-87a3-ba8559931b6c could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:46.826460 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c4e1b88d-9cba-4215-9871-b9abcad18de0 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4523bfe9-04d9-4d46-87a3-ba8559931b6c/metadata" status: 404 len: 111 microversion: 2.1 time: 0.048394 May 19 04:48:46.828315 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2116/4154] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:48:46 2022] GET /compute/v2.1/servers/4523bfe9-04d9-4d46-87a3-ba8559931b6c/metadata => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:46.862038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c06a9883-d8e3-4488-945b-8ca98d98b8de tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:46.862702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c06a9883-d8e3-4488-945b-8ca98d98b8de tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:46.881799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c06a9883-d8e3-4488-945b-8ca98d98b8de tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:46.882267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c06a9883-d8e3-4488-945b-8ca98d98b8de tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:46.883044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c06a9883-d8e3-4488-945b-8ca98d98b8de tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:46.883489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c06a9883-d8e3-4488-945b-8ca98d98b8de tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:47.154878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c06a9883-d8e3-4488-945b-8ca98d98b8de tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:47.167908 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c06a9883-d8e3-4488-945b-8ca98d98b8de tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1273 microversion: 2.1 time: 0.337962 May 19 04:48:47.169503 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2117/4155] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:46 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:47.195224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e576006-c681-43d4-90b1-1152fd942c4d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:47.196160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3e576006-c681-43d4-90b1-1152fd942c4d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 6b52daab-b0a5-4fc7-abba-0e018e13842e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:47.219901 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-3e576006-c681-43d4-90b1-1152fd942c4d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 6b52daab-b0a5-4fc7-abba-0e018e13842e could not be found. May 19 04:48:47.233877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da040187-f0ea-4773-bff4-9159450f00e3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e576006-c681-43d4-90b1-1152fd942c4d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/6b52daab-b0a5-4fc7-abba-0e018e13842e/action HTTP/1.1 May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 15 May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: {"restore": {}} May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 6b52daab-b0a5-4fc7-abba-0e018e13842e could not be found. May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '6b52daab-b0a5-4fc7-abba-0e018e13842e', 'body': {'restore': {}}} May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b52daab-b0a5-4fc7-abba-0e018e13842e could not be found. May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b52daab-b0a5-4fc7-abba-0e018e13842e could not be found. May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:47.241117 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:47.249532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:47.249532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:47.249532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b52daab-b0a5-4fc7-abba-0e018e13842e could not be found. May 19 04:48:47.249532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.250397 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da040187-f0ea-4773-bff4-9159450f00e3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 1.205773 May 19 04:48:47.250397 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2039/4156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:46 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:47.250820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd73c4da-b8d4-49b9-bf18-c328187d8f22 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-45391287", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:47.255543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e576006-c681-43d4-90b1-1152fd942c4d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 6b52daab-b0a5-4fc7-abba-0e018e13842e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:47.259218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3e576006-c681-43d4-90b1-1152fd942c4d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/6b52daab-b0a5-4fc7-abba-0e018e13842e/action" status: 404 len: 111 microversion: 2.1 time: 0.087835 May 19 04:48:47.263340 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2118/4157] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:47 2022] POST /compute/v2.1/servers/6b52daab-b0a5-4fc7-abba-0e018e13842e/action => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd73c4da-b8d4-49b9-bf18-c328187d8f22 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Request method failure captured: May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 497 May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwbl0WGcLkgbrZhwRE0GjBxcGKtjpaAqN5rfiMVRhwCsOm4rxAE12WQT9c2IRo-k_9uqlFZCgwhn0D_6VRif8H7J5iMFmwarnXqQ2-ITyoFQBV--U9V9boRezQ-ytKEiTdEPQGrTS-8GTvI2XjcfKiWOGowMIO50wyQZEOCazZFf2M May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1430890cad6248aa83686d53a8f4acac May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-45391287", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-45391287', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '294b4c93-2c2c-421f-9c73-af1990192d7c'}]}}} May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 04:48:47.273349 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd73c4da-b8d4-49b9-bf18-c328187d8f22 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd73c4da-b8d4-49b9-bf18-c328187d8f22 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.026806 May 19 04:48:47.276652 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2040/4158] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:47 2022] POST /compute/v2.1/servers => generated 687 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:48:47.289000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4d05b3c9-c797-408b-955a-35418ddbfe48 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:47.289727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4d05b3c9-c797-408b-955a-35418ddbfe48 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:47.314033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d05b3c9-c797-408b-955a-35418ddbfe48 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:47.316133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d05b3c9-c797-408b-955a-35418ddbfe48 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:47.320350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d05b3c9-c797-408b-955a-35418ddbfe48 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:47.355644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d05b3c9-c797-408b-955a-35418ddbfe48 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:47.454579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a610cda9-f79d-4d4f-8a24-0f950a99db99 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-891804460", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a610cda9-f79d-4d4f-8a24-0f950a99db99 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Request method failure captured: May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 499 May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwbl0WGcLkgbrZhwRE0GjBxcGKtjpaAqN5rfiMVRhwCsOm4rxAE12WQT9c2IRo-k_9uqlFZCgwhn0D_6VRif8H7J5iMFmwarnXqQ2-ITyoFQBV--U9V9boRezQ-ytKEiTdEPQGrTS-8GTvI2XjcfKiWOGowMIO50wyQZEOCazZFf2M May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1430890cad6248aa83686d53a8f4acac May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-891804460", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-891804460', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '294b4c93-2c2c-421f-9c73-af1990192d7c'}]}}} May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 04:48:47.458006 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.461980 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:47.465717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a610cda9-f79d-4d4f-8a24-0f950a99db99 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:47.466760 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a610cda9-f79d-4d4f-8a24-0f950a99db99 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016383 May 19 04:48:47.474588 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2041/4159] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:47 2022] POST /compute/v2.1/servers => generated 689 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 04:48:47.702620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4d05b3c9-c797-408b-955a-35418ddbfe48 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:47.716458 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4d05b3c9-c797-408b-955a-35418ddbfe48 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.450412 May 19 04:48:47.717644 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2119/4160] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:47 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:47.725037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33d87dc1-5306-40de-b43d-668853bb333b tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-659180719", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33d87dc1-5306-40de-b43d-668853bb333b tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Request method failure captured: May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 753 May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwbl0WGcLkgbrZhwRE0GjBxcGKtjpaAqN5rfiMVRhwCsOm4rxAE12WQT9c2IRo-k_9uqlFZCgwhn0D_6VRif8H7J5iMFmwarnXqQ2-ITyoFQBV--U9V9boRezQ-ytKEiTdEPQGrTS-8GTvI2XjcfKiWOGowMIO50wyQZEOCazZFf2M May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1430890cad6248aa83686d53a8f4acac May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-659180719", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-659180719', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '294b4c93-2c2c-421f-9c73-af1990192d7c'}]}}} May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:47.731353 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:47.734426 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:47.737647 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:47.737647 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:47.737647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33d87dc1-5306-40de-b43d-668853bb333b tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:47.737647 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-33d87dc1-5306-40de-b43d-668853bb333b tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.015281 May 19 04:48:47.746296 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2120/4161] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:47 2022] POST /compute/v2.1/servers => generated 1197 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 19 04:48:47.747111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-487265026", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:47.755999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c11e5f4a-b7f9-48a1-8ae6-74ec7754167a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:47.756620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c11e5f4a-b7f9-48a1-8ae6-74ec7754167a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:47.789172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c11e5f4a-b7f9-48a1-8ae6-74ec7754167a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:47.791324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c11e5f4a-b7f9-48a1-8ae6-74ec7754167a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:47.792908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c11e5f4a-b7f9-48a1-8ae6-74ec7754167a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:47.795691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c11e5f4a-b7f9-48a1-8ae6-74ec7754167a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:47.802552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:48:48.039405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c11e5f4a-b7f9-48a1-8ae6-74ec7754167a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:48.051051 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c11e5f4a-b7f9-48a1-8ae6-74ec7754167a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.311390 May 19 04:48:48.051682 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2121/4162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:47 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:48.071947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-248053cd-267d-4648-acbe-33ac9494857b tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1183835113", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-248053cd-267d-4648-acbe-33ac9494857b tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Request method failure captured: May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 1266 May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwbl0WGcLkgbrZhwRE0GjBxcGKtjpaAqN5rfiMVRhwCsOm4rxAE12WQT9c2IRo-k_9uqlFZCgwhn0D_6VRif8H7J5iMFmwarnXqQ2-ITyoFQBV--U9V9boRezQ-ytKEiTdEPQGrTS-8GTvI2XjcfKiWOGowMIO50wyQZEOCazZFf2M May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1430890cad6248aa83686d53a8f4acac May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1183835113", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "294b4c93-2c2c-421f-9c73-af1990192d7c"}]}} May 19 04:48:48.080132 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1183835113', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '294b4c93-2c2c-421f-9c73-af1990192d7c'}]}}} May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.082961 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:48.084415 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:48.086462 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 04:48:48.086462 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.093128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-248053cd-267d-4648-acbe-33ac9494857b tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:48.095062 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-248053cd-267d-4648-acbe-33ac9494857b tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.042342 May 19 04:48:48.096695 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2122/4163] 10.222.0.58 () {60 vars in 1147 bytes} [Thu May 19 04:48:48 2022] POST /compute/v2.1/servers => generated 2221 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 19 04:48:48.104611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:48.106261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:48.128803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.129982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.138275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.143831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.147123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:48.180348 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Cannot 'restore' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action HTTP/1.1 May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 15 May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: {"restore": {}} May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'restore' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6', 'body': {'restore': {}}} May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 in vm_state active. Cannot restore while the instance is in this state. May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:48.189115 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:48.194322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:48.194322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:48.194322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:48.194322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:48:48.194322 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.196685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 409 to user: Cannot 'restore' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:48.198991 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7c120a1-58f6-4512-8a81-8143fca76ee1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 409 len: 145 microversion: 2.1 time: 0.101100 May 19 04:48:48.202646 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2123/4164] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:48 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 145 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:48:48.204006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:48:48.204434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:48:48.205014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:48:48.205332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:48:48.205800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:48:48.213475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82cc4673-482b-411f-8dd5-8fc25069b6ee tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:48.219856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82cc4673-482b-411f-8dd5-8fc25069b6ee tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 274678bb-f66d-4d7d-9006-36494a173a31] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:48.221009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.221482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.222275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.224205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.226475 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-82cc4673-482b-411f-8dd5-8fc25069b6ee tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] HTTP exception thrown: Instance 274678bb-f66d-4d7d-9006-36494a173a31 could not be found. May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82cc4673-482b-411f-8dd5-8fc25069b6ee tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Request method failure captured: May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/274678bb-f66d-4d7d-9006-36494a173a31/metadata/test2 HTTP/1.1 May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwbl0WGcLkgbrZhwRE0GjBxcGKtjpaAqN5rfiMVRhwCsOm4rxAE12WQT9c2IRo-k_9uqlFZCgwhn0D_6VRif8H7J5iMFmwarnXqQ2-ITyoFQBV--U9V9boRezQ-ytKEiTdEPQGrTS-8GTvI2XjcfKiWOGowMIO50wyQZEOCazZFf2M May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1430890cad6248aa83686d53a8f4acac May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 274678bb-f66d-4d7d-9006-36494a173a31 could not be found. May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'server_id': '274678bb-f66d-4d7d-9006-36494a173a31', 'id': 'test2'} May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274678bb-f66d-4d7d-9006-36494a173a31 could not be found. May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274678bb-f66d-4d7d-9006-36494a173a31 could not be found. May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:48.228086 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:48.234670 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:48.234670 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:48.234670 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274678bb-f66d-4d7d-9006-36494a173a31 could not be found. May 19 04:48:48.234670 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:48.234670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82cc4673-482b-411f-8dd5-8fc25069b6ee tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Returning 404 to user: Instance 274678bb-f66d-4d7d-9006-36494a173a31 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:48.234670 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82cc4673-482b-411f-8dd5-8fc25069b6ee tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/274678bb-f66d-4d7d-9006-36494a173a31/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.027018 May 19 04:48:48.234670 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2124/4165] 10.222.0.58 () {58 vars in 1280 bytes} [Thu May 19 04:48:48 2022] GET /compute/v2.1/servers/274678bb-f66d-4d7d-9006-36494a173a31/metadata/test2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:48.236365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3f931ad5-2489-4a8c-b6b9-65faa3e79cb9 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:48.241609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3f931ad5-2489-4a8c-b6b9-65faa3e79cb9 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:48.254082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f931ad5-2489-4a8c-b6b9-65faa3e79cb9 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.255899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f931ad5-2489-4a8c-b6b9-65faa3e79cb9 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.256065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f931ad5-2489-4a8c-b6b9-65faa3e79cb9 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.256417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3f931ad5-2489-4a8c-b6b9-65faa3e79cb9 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.268439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Getting quotas for project 2820289ee7114dedab8f6019584bf920. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:48:48.274935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Getting quotas for user d5a98ed076094cc7ba41347094d56750 and project 2820289ee7114dedab8f6019584bf920. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:48:48.299171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:48:48.302296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:48:48.419981 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ebb4ac5d-2a83-4e37-bedf-f427cd1f4394 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927299 May 19 04:48:48.426159 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2042/4166] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:48:48.433507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-34509722-cba8-4c89-a036-61c235119339 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:48.436877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-34509722-cba8-4c89-a036-61c235119339 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:48.450995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34509722-cba8-4c89-a036-61c235119339 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.451770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34509722-cba8-4c89-a036-61c235119339 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.452683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34509722-cba8-4c89-a036-61c235119339 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.453272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34509722-cba8-4c89-a036-61c235119339 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.714300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3f931ad5-2489-4a8c-b6b9-65faa3e79cb9 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:48.727251 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3f931ad5-2489-4a8c-b6b9-65faa3e79cb9 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1315 microversion: 2.1 time: 0.490920 May 19 04:48:48.728651 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2125/4167] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:48 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:48.738176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-92606ce2-ba34-438c-a8d9-afcf5be6b31c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:48.738701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-92606ce2-ba34-438c-a8d9-afcf5be6b31c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:48.768414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92606ce2-ba34-438c-a8d9-afcf5be6b31c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.768991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92606ce2-ba34-438c-a8d9-afcf5be6b31c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.769800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92606ce2-ba34-438c-a8d9-afcf5be6b31c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.770402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92606ce2-ba34-438c-a8d9-afcf5be6b31c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.856706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-34509722-cba8-4c89-a036-61c235119339 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:48.872777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-92606ce2-ba34-438c-a8d9-afcf5be6b31c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:48:48.874039 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-34509722-cba8-4c89-a036-61c235119339 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.444528 May 19 04:48:48.875988 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2043/4168] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:48 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:48.901439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6776ce28-eca2-4ae6-a746-692e47a37d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:48.903634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6776ce28-eca2-4ae6-a746-692e47a37d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:48.915523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6776ce28-eca2-4ae6-a746-692e47a37d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.915936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6776ce28-eca2-4ae6-a746-692e47a37d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:48.934505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6776ce28-eca2-4ae6-a746-692e47a37d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:48.935294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6776ce28-eca2-4ae6-a746-692e47a37d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.127719 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-92606ce2-ba34-438c-a8d9-afcf5be6b31c tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 204 len: 0 microversion: 2.1 time: 0.394659 May 19 04:48:49.128534 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2126/4169] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:48 2022] DELETE /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:48:49.140301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-15cbeab4-79cc-467c-876d-e5a8d6cc52b2 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:49.141419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-15cbeab4-79cc-467c-876d-e5a8d6cc52b2 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:49.252206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-15cbeab4-79cc-467c-876d-e5a8d6cc52b2 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:49.265147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6776ce28-eca2-4ae6-a746-692e47a37d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:49.273944 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-15cbeab4-79cc-467c-876d-e5a8d6cc52b2 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1213 microversion: 2.1 time: 0.143223 May 19 04:48:49.274548 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2127/4170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:49 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1213 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:49.279578 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6776ce28-eca2-4ae6-a746-692e47a37d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.400449 May 19 04:48:49.280168 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2044/4171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:48 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:49.297169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-971cd4d4-f3db-46f3-8831-8c50785a7146 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:49.299358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-971cd4d4-f3db-46f3-8831-8c50785a7146 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:49.304985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-344b3105-7521-43eb-b7f4-d75ea0e10355 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:49.306449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-344b3105-7521-43eb-b7f4-d75ea0e10355 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:49.313537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-971cd4d4-f3db-46f3-8831-8c50785a7146 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:49.314021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-971cd4d4-f3db-46f3-8831-8c50785a7146 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.314809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-971cd4d4-f3db-46f3-8831-8c50785a7146 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:49.315332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-971cd4d4-f3db-46f3-8831-8c50785a7146 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.319342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-344b3105-7521-43eb-b7f4-d75ea0e10355 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:49.320424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-344b3105-7521-43eb-b7f4-d75ea0e10355 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.336317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-344b3105-7521-43eb-b7f4-d75ea0e10355 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:49.338661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-344b3105-7521-43eb-b7f4-d75ea0e10355 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.654085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-971cd4d4-f3db-46f3-8831-8c50785a7146 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:49.657535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-344b3105-7521-43eb-b7f4-d75ea0e10355 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:49.669443 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-344b3105-7521-43eb-b7f4-d75ea0e10355 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.378683 May 19 04:48:49.670637 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2128/4172] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:49 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:49.672378 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-971cd4d4-f3db-46f3-8831-8c50785a7146 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1526 microversion: 2.1 time: 0.382483 May 19 04:48:49.683038 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2045/4173] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:49 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1526 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:49.693231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4176e455-5e1e-4145-9ab0-5441512968eb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:49.693844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4176e455-5e1e-4145-9ab0-5441512968eb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 8d2526e7-92f7-4656-b49c-6409ec3b353c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:49.702161 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-4176e455-5e1e-4145-9ab0-5441512968eb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 8d2526e7-92f7-4656-b49c-6409ec3b353c could not be found. May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4176e455-5e1e-4145-9ab0-5441512968eb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/8d2526e7-92f7-4656-b49c-6409ec3b353c/action HTTP/1.1 May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 14 May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: {"resume": {}} May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 8d2526e7-92f7-4656-b49c-6409ec3b353c could not be found. May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '8d2526e7-92f7-4656-b49c-6409ec3b353c', 'body': {'resume': {}}} May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2526e7-92f7-4656-b49c-6409ec3b353c could not be found. May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2526e7-92f7-4656-b49c-6409ec3b353c could not be found. May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:49.705056 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:49.709884 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:49.709884 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:49.709884 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2526e7-92f7-4656-b49c-6409ec3b353c could not be found. May 19 04:48:49.709884 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:49.711661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4176e455-5e1e-4145-9ab0-5441512968eb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 8d2526e7-92f7-4656-b49c-6409ec3b353c could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:49.713029 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4176e455-5e1e-4145-9ab0-5441512968eb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/8d2526e7-92f7-4656-b49c-6409ec3b353c/action" status: 404 len: 111 microversion: 2.1 time: 0.028501 May 19 04:48:49.715288 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2046/4174] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:49 2022] POST /compute/v2.1/servers/8d2526e7-92f7-4656-b49c-6409ec3b353c/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:49.727841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0807019b-789f-4ab5-b028-7f31468665be req-deead8a5-ec23-4c95-a672-aa390fca4773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316e7c36-d184-4452-8d06-37ee6d7de06f", "tag": "2a673094-8432-478a-9a44-283897a80c42"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:49.754600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0807019b-789f-4ab5-b028-7f31468665be req-deead8a5-ec23-4c95-a672-aa390fca4773 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:49.755054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0807019b-789f-4ab5-b028-7f31468665be req-deead8a5-ec23-4c95-a672-aa390fca4773 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.766690 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0807019b-789f-4ab5-b028-7f31468665be req-deead8a5-ec23-4c95-a672-aa390fca4773 service nova] Creating event network-changed:2a673094-8432-478a-9a44-283897a80c42 for instance 316e7c36-d184-4452-8d06-37ee6d7de06f on n-h1-766726-30 May 19 04:48:49.771484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-347d78ab-9340-4030-9db2-103dde0835d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'create', calling method: .version_select at 0x7fd3153b2160>, body: {"keypair": {"name": "tempest-keypair-1843273444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLT21Ew5znQdeVXpHGob9TVZcKJdRIDL53yorK6yiS/dsAcLNfiL0ndYgv6WOnocl3EkQQnaaBo7LC/DJprCQfO338PFf4OYPuPPaVnQVA3gwfa2D29i8Yrduc1TCbe2Yg=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:49.772116 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0807019b-789f-4ab5-b028-7f31468665be req-deead8a5-ec23-4c95-a672-aa390fca4773 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054930 May 19 04:48:49.772243 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2047/4175] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:49.777648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-09b24770-4757-471a-bea8-6e672781b839 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:49.779246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-09b24770-4757-471a-bea8-6e672781b839 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:49.786414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09b24770-4757-471a-bea8-6e672781b839 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:49.786873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09b24770-4757-471a-bea8-6e672781b839 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.787653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09b24770-4757-471a-bea8-6e672781b839 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:49.788316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09b24770-4757-471a-bea8-6e672781b839 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.795697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-347d78ab-9340-4030-9db2-103dde0835d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Getting quotas for project bd03a0c9b0e64169a903e07e1f2c97b6. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:48:49.801647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-347d78ab-9340-4030-9db2-103dde0835d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Getting quotas for user 69228739a9134460960e474b3ef7bebf and project bd03a0c9b0e64169a903e07e1f2c97b6. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:48:49.831276 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-347d78ab-9340-4030-9db2-103dde0835d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.157931 May 19 04:48:49.837226 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2129/4176] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 19 04:48:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 04:48:49.851502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-061773be-1f02-4993-932e-ae47861dd0ed tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:49.852436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-061773be-1f02-4993-932e-ae47861dd0ed tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:49.870493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-061773be-1f02-4993-932e-ae47861dd0ed tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:49.871201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-061773be-1f02-4993-932e-ae47861dd0ed tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.872185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-061773be-1f02-4993-932e-ae47861dd0ed tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:49.874303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-061773be-1f02-4993-932e-ae47861dd0ed tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:49.990098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-09b24770-4757-471a-bea8-6e672781b839 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:49.999808 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-09b24770-4757-471a-bea8-6e672781b839 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.226405 May 19 04:48:50.003630 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2048/4177] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:49 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:50.021198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-84a2d655-329b-4f3e-88ca-898deb443edf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:50.022103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-84a2d655-329b-4f3e-88ca-898deb443edf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:50.035371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84a2d655-329b-4f3e-88ca-898deb443edf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.036062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84a2d655-329b-4f3e-88ca-898deb443edf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:50.037145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84a2d655-329b-4f3e-88ca-898deb443edf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.037610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84a2d655-329b-4f3e-88ca-898deb443edf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:50.080990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-061773be-1f02-4993-932e-ae47861dd0ed tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:50.093595 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-061773be-1f02-4993-932e-ae47861dd0ed tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1315 microversion: 2.1 time: 0.259409 May 19 04:48:50.097167 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2130/4178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:49 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:50.211487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-84a2d655-329b-4f3e-88ca-898deb443edf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:50.219807 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-84a2d655-329b-4f3e-88ca-898deb443edf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.203068 May 19 04:48:50.220940 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2049/4179] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:50 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:50.240099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:50.240643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:50.248448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.248904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:50.253537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.254369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:50.293098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ddf0620d-c3c2-4640-896a-96bb130b35e8 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:50.293906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ddf0620d-c3c2-4640-896a-96bb130b35e8 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:50.314073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ddf0620d-c3c2-4640-896a-96bb130b35e8 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.314993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ddf0620d-c3c2-4640-896a-96bb130b35e8 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:50.316414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ddf0620d-c3c2-4640-896a-96bb130b35e8 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.317841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ddf0620d-c3c2-4640-896a-96bb130b35e8 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:50.327536 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Cannot 'resume' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action HTTP/1.1 May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 14 May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: {"resume": {}} May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'resume' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6', 'body': {'resume': {}}} May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 in vm_state active. Cannot resume while the instance is in this state. May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:50.332169 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:50.337175 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:50.337175 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:50.337175 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:50.337175 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:48:50.337175 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:50.340688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 409 to user: Cannot 'resume' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:50.342021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-194b056f-545d-4711-aab8-df71f01c811b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 409 len: 144 microversion: 2.1 time: 0.107114 May 19 04:48:50.349175 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2131/4180] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:50 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 144 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:48:50.356793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a97f7f2-6db4-43d2-9a25-5a8b23e8d4a2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:50.359672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2a97f7f2-6db4-43d2-9a25-5a8b23e8d4a2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:50.378118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a97f7f2-6db4-43d2-9a25-5a8b23e8d4a2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.380075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a97f7f2-6db4-43d2-9a25-5a8b23e8d4a2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:50.382625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a97f7f2-6db4-43d2-9a25-5a8b23e8d4a2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.383943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a97f7f2-6db4-43d2-9a25-5a8b23e8d4a2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:50.488234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ddf0620d-c3c2-4640-896a-96bb130b35e8 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:50.499195 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ddf0620d-c3c2-4640-896a-96bb130b35e8 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1217 microversion: 2.1 time: 0.211711 May 19 04:48:50.511164 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2050/4181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:50 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1217 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:50.516902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6daf236f-e698-44a7-9a8d-609280c419fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:50.517910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6daf236f-e698-44a7-9a8d-609280c419fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:50.527309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6daf236f-e698-44a7-9a8d-609280c419fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.528056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6daf236f-e698-44a7-9a8d-609280c419fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:50.529300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6daf236f-e698-44a7-9a8d-609280c419fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:50.531203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6daf236f-e698-44a7-9a8d-609280c419fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:51.271865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2a97f7f2-6db4-43d2-9a25-5a8b23e8d4a2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:51.282893 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2a97f7f2-6db4-43d2-9a25-5a8b23e8d4a2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.932318 May 19 04:48:51.301318 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2132/4182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:50 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:51.315972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a752d958-0795-44eb-a32c-d7c1eaca44bb tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:51.317979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a752d958-0795-44eb-a32c-d7c1eaca44bb tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:51.333667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a752d958-0795-44eb-a32c-d7c1eaca44bb tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:51.334400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a752d958-0795-44eb-a32c-d7c1eaca44bb tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:51.336087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a752d958-0795-44eb-a32c-d7c1eaca44bb tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:51.336812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a752d958-0795-44eb-a32c-d7c1eaca44bb tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:51.356648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6daf236f-e698-44a7-9a8d-609280c419fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:51.371103 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6daf236f-e698-44a7-9a8d-609280c419fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.857860 May 19 04:48:51.373163 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2051/4183] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:50 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:51.383180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99ab1cf1-6310-47fb-af10-cb74a0101ff3 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:51.387124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99ab1cf1-6310-47fb-af10-cb74a0101ff3 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:51.401161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99ab1cf1-6310-47fb-af10-cb74a0101ff3 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:51.401600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99ab1cf1-6310-47fb-af10-cb74a0101ff3 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:51.402379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99ab1cf1-6310-47fb-af10-cb74a0101ff3 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:51.402975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99ab1cf1-6310-47fb-af10-cb74a0101ff3 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:51.889667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99ab1cf1-6310-47fb-af10-cb74a0101ff3 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:51.901732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99ab1cf1-6310-47fb-af10-cb74a0101ff3 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1315 microversion: 2.1 time: 0.527111 May 19 04:48:51.902869 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2052/4184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:51 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:51.915269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f92e9f77-24b9-4e65-87ae-779466c239c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:51.916793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f92e9f77-24b9-4e65-87ae-779466c239c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:51.928332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f92e9f77-24b9-4e65-87ae-779466c239c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:51.932397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f92e9f77-24b9-4e65-87ae-779466c239c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:51.933713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f92e9f77-24b9-4e65-87ae-779466c239c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:51.935518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f92e9f77-24b9-4e65-87ae-779466c239c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:51.938969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:52.196121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a752d958-0795-44eb-a32c-d7c1eaca44bb tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:52.205871 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a752d958-0795-44eb-a32c-d7c1eaca44bb tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1526 microversion: 2.1 time: 0.903190 May 19 04:48:52.222330 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2133/4185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:51 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1526 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:52.230008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2d915683-1e4f-4c2d-b173-10a0de378665 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:52.232494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2d915683-1e4f-4c2d-b173-10a0de378665 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:52.245608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d915683-1e4f-4c2d-b173-10a0de378665 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:52.246339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d915683-1e4f-4c2d-b173-10a0de378665 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:52.247303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d915683-1e4f-4c2d-b173-10a0de378665 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:52.247904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d915683-1e4f-4c2d-b173-10a0de378665 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:52.278434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:52.507353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2d915683-1e4f-4c2d-b173-10a0de378665 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:52.530021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2d915683-1e4f-4c2d-b173-10a0de378665 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1271 microversion: 2.1 time: 0.313628 May 19 04:48:52.530871 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2134/4186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:52 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1271 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:52.542108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3ccec30a-9cd9-4fa9-9d5e-6cd80185e0a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:52.543955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3ccec30a-9cd9-4fa9-9d5e-6cd80185e0a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:52.568931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ccec30a-9cd9-4fa9-9d5e-6cd80185e0a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:52.580299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ccec30a-9cd9-4fa9-9d5e-6cd80185e0a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:52.581250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ccec30a-9cd9-4fa9-9d5e-6cd80185e0a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:52.581710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ccec30a-9cd9-4fa9-9d5e-6cd80185e0a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:52.629173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f92e9f77-24b9-4e65-87ae-779466c239c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:52.642568 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f92e9f77-24b9-4e65-87ae-779466c239c8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.738344 May 19 04:48:52.650607 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2053/4187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:51 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:52.858580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d4084e2-8801-4961-8ef1-1609b0535adf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d4084e2-8801-4961-8ef1-1609b0535adf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 160 May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "4f13e0de-8a49-429b-a6a1-196e5191a8c1"}]}} May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute name. Value: . '' is too short May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb', 'flavorRef': '452', 'networks': [{'uuid': '4f13e0de-8a49-429b-a6a1-196e5191a8c1'}]}}} May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi '' May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:48:52.861679 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 19 04:48:52.866957 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:52.870566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d4084e2-8801-4961-8ef1-1609b0535adf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:52.875468 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9d4084e2-8801-4961-8ef1-1609b0535adf tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.018731 May 19 04:48:52.876783 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2054/4188] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:48:52 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 04:48:52.891223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-557e1f75-444f-4b0c-88a5-c6534cc9a550 req-c390856b-5c78-41a1-b8f6-309b9245b347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf022f1-4234-4cd1-b09f-b63519a58e0f", "name": "network-vif-deleted", "tag": "f545e355-9847-4402-a698-55d2cba5ee3a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:52.923981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-557e1f75-444f-4b0c-88a5-c6534cc9a550 req-c390856b-5c78-41a1-b8f6-309b9245b347 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:52.924633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-557e1f75-444f-4b0c-88a5-c6534cc9a550 req-c390856b-5c78-41a1-b8f6-309b9245b347 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:52.943838 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-557e1f75-444f-4b0c-88a5-c6534cc9a550 req-c390856b-5c78-41a1-b8f6-309b9245b347 service nova] Creating event network-vif-deleted:f545e355-9847-4402-a698-55d2cba5ee3a for instance 4cf022f1-4234-4cd1-b09f-b63519a58e0f on n-h1-766726-30 May 19 04:48:52.954688 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-557e1f75-444f-4b0c-88a5-c6534cc9a550 req-c390856b-5c78-41a1-b8f6-309b9245b347 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076437 May 19 04:48:52.955295 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2055/4189] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:52.971520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74b1edcb-15f3-46df-a541-7a42b2a51500 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:52.972836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74b1edcb-15f3-46df-a541-7a42b2a51500 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:52.985498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b1edcb-15f3-46df-a541-7a42b2a51500 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:52.986239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b1edcb-15f3-46df-a541-7a42b2a51500 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:52.987226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b1edcb-15f3-46df-a541-7a42b2a51500 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:52.991204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b1edcb-15f3-46df-a541-7a42b2a51500 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:53.022065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3ccec30a-9cd9-4fa9-9d5e-6cd80185e0a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:53.037288 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3ccec30a-9cd9-4fa9-9d5e-6cd80185e0a1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.503551 May 19 04:48:53.045627 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2135/4190] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:52 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:53.051877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-efefee14-ba91-4f6e-b5e5-642e09c4b91c tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:53.062475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-efefee14-ba91-4f6e-b5e5-642e09c4b91c tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:53.101693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efefee14-ba91-4f6e-b5e5-642e09c4b91c tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:53.107284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efefee14-ba91-4f6e-b5e5-642e09c4b91c tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:53.108359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efefee14-ba91-4f6e-b5e5-642e09c4b91c tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:53.108952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efefee14-ba91-4f6e-b5e5-642e09c4b91c tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:53.498162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74b1edcb-15f3-46df-a541-7a42b2a51500 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:53.514107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-efefee14-ba91-4f6e-b5e5-642e09c4b91c tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:53.533653 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74b1edcb-15f3-46df-a541-7a42b2a51500 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.573746 May 19 04:48:53.534157 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2056/4191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:52 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:53.536408 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-efefee14-ba91-4f6e-b5e5-642e09c4b91c tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1315 microversion: 2.1 time: 0.477373 May 19 04:48:53.540907 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2136/4192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:53 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:53.554319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:53.561222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-72116535", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33d3d376-76a4-4d9f-8eb8-1a8298b802f8"}], "security_groups": [{"name": "tempest-securitygroup--273389402"}], "key_name": "tempest-keypair-1843273444", "user_data": "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:53.562779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:53.579322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:53.580156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:53.581226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:53.581893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:53.690412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:53.691255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:53.691934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lazy-loading 'fault' on Instance uuid 4cf022f1-4234-4cd1-b09f-b63519a58e0f {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:53.802415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1430890cad6248aa83686d53a8f4acac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bd6dd336a3473db8f25bf44ac35f90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:53.818333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] validate_networks() for [('33d3d376-76a4-4d9f-8eb8-1a8298b802f8', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:48:53.833933 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72825c36-3436-42c8-bd2a-61173a3d33ae tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 200 len: 1314 microversion: 2.1 time: 0.283764 May 19 04:48:53.841562 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2137/4193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:53 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:53.856603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0a85270-f5c9-4348-8828-d15955d385d3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:53.857862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f0a85270-f5c9-4348-8828-d15955d385d3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:53.868042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a85270-f5c9-4348-8828-d15955d385d3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:53.868814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a85270-f5c9-4348-8828-d15955d385d3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:53.871212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a85270-f5c9-4348-8828-d15955d385d3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:53.871999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a85270-f5c9-4348-8828-d15955d385d3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:53.979605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f0a85270-f5c9-4348-8828-d15955d385d3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:53.992372 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0a85270-f5c9-4348-8828-d15955d385d3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1271 microversion: 2.1 time: 0.147529 May 19 04:48:53.993424 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2138/4194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:53 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:54.000361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4cdc0ef5-5bd3-49c1-92b2-7531cfc4105e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:54.001700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4cdc0ef5-5bd3-49c1-92b2-7531cfc4105e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:54.012626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cdc0ef5-5bd3-49c1-92b2-7531cfc4105e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.013292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cdc0ef5-5bd3-49c1-92b2-7531cfc4105e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:54.014872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cdc0ef5-5bd3-49c1-92b2-7531cfc4105e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.015474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cdc0ef5-5bd3-49c1-92b2-7531cfc4105e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:54.389422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4cdc0ef5-5bd3-49c1-92b2-7531cfc4105e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:54.402962 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4cdc0ef5-5bd3-49c1-92b2-7531cfc4105e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.402021 May 19 04:48:54.403563 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2139/4195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:53 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:54.408327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ab672cbd-ace3-4f1c-88f3-71371131d309 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:54.415700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ab672cbd-ace3-4f1c-88f3-71371131d309 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:54.422513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab672cbd-ace3-4f1c-88f3-71371131d309 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.423129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab672cbd-ace3-4f1c-88f3-71371131d309 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:54.423897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab672cbd-ace3-4f1c-88f3-71371131d309 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.424488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab672cbd-ace3-4f1c-88f3-71371131d309 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:54.746872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:48:54.747556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:48:54.748229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:48:54.748818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:48:54.749448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:48:54.759710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.760517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:54.761547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.768803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:54.769876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab672cbd-ace3-4f1c-88f3-71371131d309 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:54.778905 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ab672cbd-ace3-4f1c-88f3-71371131d309 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.374187 May 19 04:48:54.783251 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2140/4196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:54 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:54.790534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aed540ac-99ee-4a0b-8b24-514758a109e8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:54.792183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aed540ac-99ee-4a0b-8b24-514758a109e8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 01faf82c-850c-4f8c-b2be-f691950aff07] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:54.807332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Getting quotas for project bd03a0c9b0e64169a903e07e1f2c97b6. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:48:54.818030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Getting quotas for user 69228739a9134460960e474b3ef7bebf and project bd03a0c9b0e64169a903e07e1f2c97b6. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:48:54.828432 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-aed540ac-99ee-4a0b-8b24-514758a109e8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 01faf82c-850c-4f8c-b2be-f691950aff07 could not be found. May 19 04:48:54.835832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aed540ac-99ee-4a0b-8b24-514758a109e8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/01faf82c-850c-4f8c-b2be-f691950aff07/action HTTP/1.1 May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 14 May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: {"shelve": {}} May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 01faf82c-850c-4f8c-b2be-f691950aff07 could not be found. May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '01faf82c-850c-4f8c-b2be-f691950aff07', 'body': {'shelve': {}}} May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01faf82c-850c-4f8c-b2be-f691950aff07 could not be found. May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01faf82c-850c-4f8c-b2be-f691950aff07 could not be found. May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:54.838598 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:54.845909 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:54.845909 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:54.845909 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01faf82c-850c-4f8c-b2be-f691950aff07 could not be found. May 19 04:48:54.845909 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:54.846193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:48:54.846308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aed540ac-99ee-4a0b-8b24-514758a109e8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 01faf82c-850c-4f8c-b2be-f691950aff07 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:54.846308 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aed540ac-99ee-4a0b-8b24-514758a109e8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/01faf82c-850c-4f8c-b2be-f691950aff07/action" status: 404 len: 111 microversion: 2.1 time: 0.055823 May 19 04:48:54.846308 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2141/4197] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:54 2022] POST /compute/v2.1/servers/01faf82c-850c-4f8c-b2be-f691950aff07/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:54.852669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f447b132-3593-4dbd-bf98-584338c98605 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:54.853359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f447b132-3593-4dbd-bf98-584338c98605 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:54.866211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f447b132-3593-4dbd-bf98-584338c98605 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.871278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f447b132-3593-4dbd-bf98-584338c98605 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:54.873558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f447b132-3593-4dbd-bf98-584338c98605 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.876144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f447b132-3593-4dbd-bf98-584338c98605 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:54.921190 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-11b9549a-c277-49da-93ac-15502642ac27 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.364952 May 19 04:48:54.923684 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2057/4198] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:48:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:48:54.943640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:54.952237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-52ce1c19-7bc5-46d5-b0ea-73bfef0b16fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:54.953382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-52ce1c19-7bc5-46d5-b0ea-73bfef0b16fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:54.964362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52ce1c19-7bc5-46d5-b0ea-73bfef0b16fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.965289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52ce1c19-7bc5-46d5-b0ea-73bfef0b16fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:54.966544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52ce1c19-7bc5-46d5-b0ea-73bfef0b16fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:54.967196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52ce1c19-7bc5-46d5-b0ea-73bfef0b16fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:55.394937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f447b132-3593-4dbd-bf98-584338c98605 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:55.402571 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f447b132-3593-4dbd-bf98-584338c98605 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1315 microversion: 2.1 time: 0.560804 May 19 04:48:55.403148 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2142/4199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:54 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:55.416457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:55.417302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] [instance: 4cf022f1-4234-4cd1-b09f-b63519a58e0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:55.429238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:55.429697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:55.430946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:55.430946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:55.444607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-52ce1c19-7bc5-46d5-b0ea-73bfef0b16fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:55.460093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-52ce1c19-7bc5-46d5-b0ea-73bfef0b16fa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.534059 May 19 04:48:55.463170 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2058/4200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:54 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:55.467415 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] HTTP exception thrown: Instance 4cf022f1-4234-4cd1-b09f-b63519a58e0f could not be found. May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Request method failure captured: May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f HTTP/1.1 May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwbl0WGcLkgbrZhwRE0GjBxcGKtjpaAqN5rfiMVRhwCsOm4rxAE12WQT9c2IRo-k_9uqlFZCgwhn0D_6VRif8H7J5iMFmwarnXqQ2-ITyoFQBV--U9V9boRezQ-ytKEiTdEPQGrTS-8GTvI2XjcfKiWOGowMIO50wyQZEOCazZFf2M May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_50bd6dd336a3473db8f25bf44ac35f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 50bd6dd336a3473db8f25bf44ac35f90 May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-765980738 May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 1430890cad6248aa83686d53a8f4acac May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-765980738-project May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 4cf022f1-4234-4cd1-b09f-b63519a58e0f could not be found. May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '4cf022f1-4234-4cd1-b09f-b63519a58e0f'} May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf022f1-4234-4cd1-b09f-b63519a58e0f could not be found. May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf022f1-4234-4cd1-b09f-b63519a58e0f could not be found. May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:55.469631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf022f1-4234-4cd1-b09f-b63519a58e0f could not be found. May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] Returning 404 to user: Instance 4cf022f1-4234-4cd1-b09f-b63519a58e0f could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ad839bb-079f-4861-ae63-de895a912e80 tempest-ServerMetadataNegativeTestJSON-765980738 tempest-ServerMetadataNegativeTestJSON-765980738-project] 10.222.0.58 "GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f" status: 404 len: 111 microversion: 2.1 time: 0.067042 May 19 04:48:55.475348 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2143/4201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:55 2022] GET /compute/v2.1/servers/4cf022f1-4234-4cd1-b09f-b63519a58e0f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:55.482071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f12b3515-db87-4bee-bd88-417a2b20710e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:55.482711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f12b3515-db87-4bee-bd88-417a2b20710e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:55.487416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-db24199a-fbb7-403e-af5f-0e62543bd830 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:55.488173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-db24199a-fbb7-403e-af5f-0e62543bd830 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:55.489332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f12b3515-db87-4bee-bd88-417a2b20710e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:55.489977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f12b3515-db87-4bee-bd88-417a2b20710e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:55.490781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f12b3515-db87-4bee-bd88-417a2b20710e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:55.491229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f12b3515-db87-4bee-bd88-417a2b20710e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:55.636055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-db24199a-fbb7-403e-af5f-0e62543bd830 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:55.651810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-db24199a-fbb7-403e-af5f-0e62543bd830 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:55.658223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-db24199a-fbb7-403e-af5f-0e62543bd830 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:55.660484 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-db24199a-fbb7-403e-af5f-0e62543bd830 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1280 microversion: 2.20 time: 0.194929 May 19 04:48:55.664040 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2059/4202] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:55 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:55.672481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a53f3d52-57fd-4745-8a51-b131c187bc75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:55.673295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a53f3d52-57fd-4745-8a51-b131c187bc75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:55.693630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a53f3d52-57fd-4745-8a51-b131c187bc75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:55.694448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a53f3d52-57fd-4745-8a51-b131c187bc75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:55.696576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a53f3d52-57fd-4745-8a51-b131c187bc75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:55.698398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a53f3d52-57fd-4745-8a51-b131c187bc75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:55.952572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f12b3515-db87-4bee-bd88-417a2b20710e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:55.965214 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f12b3515-db87-4bee-bd88-417a2b20710e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1313 microversion: 2.1 time: 0.488687 May 19 04:48:55.968146 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2144/4203] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:55 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:55.974199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bc0ef7c-3ec6-4d25-a5bb-3f51415a98f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:55.976107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4bc0ef7c-3ec6-4d25-a5bb-3f51415a98f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:55.992276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bc0ef7c-3ec6-4d25-a5bb-3f51415a98f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:55.993148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bc0ef7c-3ec6-4d25-a5bb-3f51415a98f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:55.996118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bc0ef7c-3ec6-4d25-a5bb-3f51415a98f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:55.997131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bc0ef7c-3ec6-4d25-a5bb-3f51415a98f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:56.038328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a53f3d52-57fd-4745-8a51-b131c187bc75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:56.046970 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a53f3d52-57fd-4745-8a51-b131c187bc75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.381612 May 19 04:48:56.047556 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2060/4204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:55 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:56.068151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4fb663fe-04b5-4577-995f-d8dbbfa83d13 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:56.073846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4fb663fe-04b5-4577-995f-d8dbbfa83d13 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:56.090941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fb663fe-04b5-4577-995f-d8dbbfa83d13 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:56.091785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fb663fe-04b5-4577-995f-d8dbbfa83d13 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:56.092819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fb663fe-04b5-4577-995f-d8dbbfa83d13 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:56.093508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4fb663fe-04b5-4577-995f-d8dbbfa83d13 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:56.128480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-4fb663fe-04b5-4577-995f-d8dbbfa83d13 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lazy-loading 'flavor' on Instance uuid 878aa03f-a366-4d71-b678-1c749fc143c6 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:48:56.473604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4bc0ef7c-3ec6-4d25-a5bb-3f51415a98f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:56.487187 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4bc0ef7c-3ec6-4d25-a5bb-3f51415a98f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.517720 May 19 04:48:56.488187 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2145/4205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:55 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:56.501580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-735132e4-42ac-480c-ae97-f0233dd8c9c8 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:56.502556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-735132e4-42ac-480c-ae97-f0233dd8c9c8 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:56.530279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-735132e4-42ac-480c-ae97-f0233dd8c9c8 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:56.531161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-735132e4-42ac-480c-ae97-f0233dd8c9c8 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:56.532274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-735132e4-42ac-480c-ae97-f0233dd8c9c8 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:56.532881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-735132e4-42ac-480c-ae97-f0233dd8c9c8 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:56.861745 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4fb663fe-04b5-4577-995f-d8dbbfa83d13 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 202 len: 0 microversion: 2.1 time: 0.801598 May 19 04:48:56.865616 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2061/4206] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:48:56 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:48:56.886580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:56.891439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:56.908327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:56.911189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:56.912579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:56.914108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:57.368184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:57.382332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:57.384847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:57.387848 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-141328a9-a00e-4904-bcd5-dada65ca3660 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1350 microversion: 2.20 time: 0.519134 May 19 04:48:57.389046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2062/4207] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:56 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1350 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:57.407085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-dd052f61-d63c-430b-a329-9ad8a869b020 req-7e1d1351-a590-4748-976c-ab6141c36c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d448c0-def8-4eaa-8319-83c9df1fc5f0", "tag": "076ea3d1-dce2-4280-8f54-55ab02ea70de"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:57.426813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dd052f61-d63c-430b-a329-9ad8a869b020 req-7e1d1351-a590-4748-976c-ab6141c36c9a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:57.427270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dd052f61-d63c-430b-a329-9ad8a869b020 req-7e1d1351-a590-4748-976c-ab6141c36c9a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:57.472155 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-dd052f61-d63c-430b-a329-9ad8a869b020 req-7e1d1351-a590-4748-976c-ab6141c36c9a service nova] Creating event network-changed:076ea3d1-dce2-4280-8f54-55ab02ea70de for instance 20d448c0-def8-4eaa-8319-83c9df1fc5f0 on n-h1-766726-30 May 19 04:48:57.484099 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-dd052f61-d63c-430b-a329-9ad8a869b020 req-7e1d1351-a590-4748-976c-ab6141c36c9a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085319 May 19 04:48:57.487954 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2063/4208] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:57.507208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31a8f042-4ea5-4cc3-9d65-64bcedba0d19 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:57.507929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31a8f042-4ea5-4cc3-9d65-64bcedba0d19 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:57.537394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31a8f042-4ea5-4cc3-9d65-64bcedba0d19 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:57.537866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31a8f042-4ea5-4cc3-9d65-64bcedba0d19 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:57.538669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31a8f042-4ea5-4cc3-9d65-64bcedba0d19 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:57.539111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31a8f042-4ea5-4cc3-9d65-64bcedba0d19 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:57.590097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-735132e4-42ac-480c-ae97-f0233dd8c9c8 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:57.604964 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-735132e4-42ac-480c-ae97-f0233dd8c9c8 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1315 microversion: 2.1 time: 1.115399 May 19 04:48:57.607291 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2146/4209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:56 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:57.615069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e18f3313-2797-41ff-ad19-b180d3218de3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:57.616176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e18f3313-2797-41ff-ad19-b180d3218de3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:57.638572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e18f3313-2797-41ff-ad19-b180d3218de3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:57.639561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e18f3313-2797-41ff-ad19-b180d3218de3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:57.643084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e18f3313-2797-41ff-ad19-b180d3218de3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:57.646284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e18f3313-2797-41ff-ad19-b180d3218de3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:57.931695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31a8f042-4ea5-4cc3-9d65-64bcedba0d19 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:57.940369 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31a8f042-4ea5-4cc3-9d65-64bcedba0d19 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1510 microversion: 2.1 time: 0.442189 May 19 04:48:57.942801 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2064/4210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:57 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:57.955505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-50678363-fac2-451d-9fc2-ddd6faa7d1f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:57.956354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-50678363-fac2-451d-9fc2-ddd6faa7d1f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:57.976038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50678363-fac2-451d-9fc2-ddd6faa7d1f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:57.976719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50678363-fac2-451d-9fc2-ddd6faa7d1f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:57.977727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50678363-fac2-451d-9fc2-ddd6faa7d1f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:57.978552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50678363-fac2-451d-9fc2-ddd6faa7d1f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:58.234294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e18f3313-2797-41ff-ad19-b180d3218de3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:58.250866 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e18f3313-2797-41ff-ad19-b180d3218de3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1313 microversion: 2.1 time: 0.642194 May 19 04:48:58.261198 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2147/4211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:57 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:58.267000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-7efdfbd1-74f8-4208-b13f-fabc846138d0 req-7dec6bb4-5063-439d-b9ae-5ab9f93cca09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316e7c36-d184-4452-8d06-37ee6d7de06f", "name": "network-vif-plugged", "status": "completed", "tag": "2a673094-8432-478a-9a44-283897a80c42"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:48:58.297593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7efdfbd1-74f8-4208-b13f-fabc846138d0 req-7dec6bb4-5063-439d-b9ae-5ab9f93cca09 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:58.298317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7efdfbd1-74f8-4208-b13f-fabc846138d0 req-7dec6bb4-5063-439d-b9ae-5ab9f93cca09 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:58.343225 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7efdfbd1-74f8-4208-b13f-fabc846138d0 req-7dec6bb4-5063-439d-b9ae-5ab9f93cca09 service nova] Creating event network-vif-plugged:2a673094-8432-478a-9a44-283897a80c42 for instance 316e7c36-d184-4452-8d06-37ee6d7de06f on n-h1-766726-30 May 19 04:48:58.392097 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-7efdfbd1-74f8-4208-b13f-fabc846138d0 req-7dec6bb4-5063-439d-b9ae-5ab9f93cca09 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130291 May 19 04:48:58.397764 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2148/4212] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:48:58.433999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:58.439020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:58.459425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:58.460479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-50678363-fac2-451d-9fc2-ddd6faa7d1f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:58.466293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:58.469026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:58.469298 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-50678363-fac2-451d-9fc2-ddd6faa7d1f8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.519483 May 19 04:48:58.469995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:58.472215 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2065/4213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:57 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:58.584324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:58.608084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:58.615626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:58.622615 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f4d31674-656f-41f1-9c7b-ebca1bb1ae20 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1338 microversion: 2.20 time: 0.218082 May 19 04:48:58.623665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9a668813-59fd-4dab-b6d5-b6b1330eda36 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:58.625349 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2149/4214] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:58 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1338 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:48:58.633317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9a668813-59fd-4dab-b6d5-b6b1330eda36 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:58.655413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a668813-59fd-4dab-b6d5-b6b1330eda36 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:58.657599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a668813-59fd-4dab-b6d5-b6b1330eda36 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:58.660070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a668813-59fd-4dab-b6d5-b6b1330eda36 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:58.661319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a668813-59fd-4dab-b6d5-b6b1330eda36 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:58.924834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9a668813-59fd-4dab-b6d5-b6b1330eda36 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:58.938687 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9a668813-59fd-4dab-b6d5-b6b1330eda36 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1315 microversion: 2.1 time: 0.318039 May 19 04:48:58.939353 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2066/4215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:58 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:58.965136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-305875f6-4d77-4104-9f27-e0a60101a8ea tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:58.966060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-305875f6-4d77-4104-9f27-e0a60101a8ea tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:58.986913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-305875f6-4d77-4104-9f27-e0a60101a8ea tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:58.987450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-305875f6-4d77-4104-9f27-e0a60101a8ea tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:58.991540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-305875f6-4d77-4104-9f27-e0a60101a8ea tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:58.992030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-305875f6-4d77-4104-9f27-e0a60101a8ea tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.269694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa3e1d34-5b84-4053-b001-31c6182440a7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:59.272211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aa3e1d34-5b84-4053-b001-31c6182440a7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:59.294316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:59.312775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa3e1d34-5b84-4053-b001-31c6182440a7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.314372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa3e1d34-5b84-4053-b001-31c6182440a7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.316296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa3e1d34-5b84-4053-b001-31c6182440a7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.317017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa3e1d34-5b84-4053-b001-31c6182440a7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.370251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-305875f6-4d77-4104-9f27-e0a60101a8ea tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:59.382886 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-305875f6-4d77-4104-9f27-e0a60101a8ea tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1510 microversion: 2.1 time: 0.425531 May 19 04:48:59.384360 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2150/4216] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:58 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:59.487795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b016f67-3f96-4285-b092-2e87f2952a0d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:59.488503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b016f67-3f96-4285-b092-2e87f2952a0d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:59.506677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b016f67-3f96-4285-b092-2e87f2952a0d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.507137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b016f67-3f96-4285-b092-2e87f2952a0d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.507939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b016f67-3f96-4285-b092-2e87f2952a0d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.508387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b016f67-3f96-4285-b092-2e87f2952a0d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.660327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aa3e1d34-5b84-4053-b001-31c6182440a7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:59.674688 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aa3e1d34-5b84-4053-b001-31c6182440a7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1313 microversion: 2.1 time: 0.410231 May 19 04:48:59.676662 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2067/4217] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:59 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:48:59.682995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:59.683780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:59.693321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.694053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.695071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.695691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.714787 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b HTTP/1.1 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b5ca519a-97b0-4dca-9d06-c04dc5b5a42b'} May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:59.718302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.723988 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:48:59.727066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:59.729117 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-308db8ba-9f9e-427d-bcda-8979feffc9d7 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 404 len: 111 microversion: 2.1 time: 0.050161 May 19 04:48:59.730176 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2068/4218] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:48:59 2022] DELETE /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:59.738677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:59.739342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:59.748435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.748887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.750195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.750810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.810106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:48:59.883005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b016f67-3f96-4285-b092-2e87f2952a0d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:48:59.893480 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b016f67-3f96-4285-b092-2e87f2952a0d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.409414 May 19 04:48:59.894788 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2151/4219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:59 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:48:59.903439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:59.904849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: b5ca519a-97b0-4dca-9d06-c04dc5b5a42b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:59.913973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.914706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.915899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.916799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.941806 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b HTTP/1.1 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'b5ca519a-97b0-4dca-9d06-c04dc5b5a42b'} May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:48:59.944951 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:59.950839 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:48:59.950839 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:48:59.950839 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:48:59.950839 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:48:59.950839 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:48:59.950839 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. May 19 04:48:59.950839 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:48:59.953697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance b5ca519a-97b0-4dca-9d06-c04dc5b5a42b could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:48:59.955852 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-33120b97-654d-446e-b4e9-1461520bb140 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b" status: 404 len: 111 microversion: 2.1 time: 0.059518 May 19 04:48:59.957675 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2152/4220] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:59 2022] GET /compute/v2.1/servers/b5ca519a-97b0-4dca-9d06-c04dc5b5a42b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:48:59.965685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b73bc09b-fa04-4d72-a3e7-0f72c346f819 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:48:59.967076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b73bc09b-fa04-4d72-a3e7-0f72c346f819 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:48:59.979601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b73bc09b-fa04-4d72-a3e7-0f72c346f819 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.980366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b73bc09b-fa04-4d72-a3e7-0f72c346f819 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:48:59.982493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b73bc09b-fa04-4d72-a3e7-0f72c346f819 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:48:59.983160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b73bc09b-fa04-4d72-a3e7-0f72c346f819 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:00.287007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:00.296814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:00.302871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:00.304254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a2980538-f217-45ae-b963-9d9c88a29880 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1405 microversion: 2.20 time: 0.572966 May 19 04:49:00.317904 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2069/4221] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:48:59 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1405 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:00.381341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b73bc09b-fa04-4d72-a3e7-0f72c346f819 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:00.393793 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b73bc09b-fa04-4d72-a3e7-0f72c346f819 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1315 microversion: 2.1 time: 0.434697 May 19 04:49:00.399562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-07c5104b-a694-4f33-8eb1-b5682d5d7781 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:00.400533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-07c5104b-a694-4f33-8eb1-b5682d5d7781 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:00.406885 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2153/4222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:48:59 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:00.409394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07c5104b-a694-4f33-8eb1-b5682d5d7781 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:00.416782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07c5104b-a694-4f33-8eb1-b5682d5d7781 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:00.417933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07c5104b-a694-4f33-8eb1-b5682d5d7781 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:00.418559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07c5104b-a694-4f33-8eb1-b5682d5d7781 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:00.694630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-664a50b7-1ded-47a9-a639-3c92491bbf22 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:00.695270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-664a50b7-1ded-47a9-a639-3c92491bbf22 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:00.707327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-664a50b7-1ded-47a9-a639-3c92491bbf22 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:00.707784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-664a50b7-1ded-47a9-a639-3c92491bbf22 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:00.716696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-664a50b7-1ded-47a9-a639-3c92491bbf22 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:00.717180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-664a50b7-1ded-47a9-a639-3c92491bbf22 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:00.946345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-07c5104b-a694-4f33-8eb1-b5682d5d7781 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:00.961654 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-07c5104b-a694-4f33-8eb1-b5682d5d7781 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1510 microversion: 2.1 time: 0.565739 May 19 04:49:00.964118 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2070/4223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:00 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1510 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:01.034256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-664a50b7-1ded-47a9-a639-3c92491bbf22 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:01.045637 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-664a50b7-1ded-47a9-a639-3c92491bbf22 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1313 microversion: 2.1 time: 0.355028 May 19 04:49:01.048226 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2154/4224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:00 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:01.064190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b5ca137-1e40-4d96-8a84-0cbc0479dcb8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:01.064825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8b5ca137-1e40-4d96-8a84-0cbc0479dcb8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:01.072686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:01.076374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b5ca137-1e40-4d96-8a84-0cbc0479dcb8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:01.082316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b5ca137-1e40-4d96-8a84-0cbc0479dcb8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:01.083376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b5ca137-1e40-4d96-8a84-0cbc0479dcb8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:01.085795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b5ca137-1e40-4d96-8a84-0cbc0479dcb8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:01.289883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2020849101", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:01.420495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] validate_networks() for [('3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:49:01.951012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8b5ca137-1e40-4d96-8a84-0cbc0479dcb8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:01.959775 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b5ca137-1e40-4d96-8a84-0cbc0479dcb8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.910279 May 19 04:49:01.960376 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2155/4225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:01 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:01.974515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:01.975396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:01.983029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:01.983750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:01.984693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:01.985378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:02.283550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:02.300584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:02.303390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:02.305854 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-19623b3d-e1b0-44cf-a608-a138e3bc9eea tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1405 microversion: 2.20 time: 0.344530 May 19 04:49:02.306470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2156/4226] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:01 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1405 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:02.320589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-65ac96f7-79de-4978-979d-a9b43d79eea7 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:02.321194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-65ac96f7-79de-4978-979d-a9b43d79eea7 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:02.339034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65ac96f7-79de-4978-979d-a9b43d79eea7 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:02.340047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65ac96f7-79de-4978-979d-a9b43d79eea7 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:02.341195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65ac96f7-79de-4978-979d-a9b43d79eea7 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:02.342269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65ac96f7-79de-4978-979d-a9b43d79eea7 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:02.585845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:49:02.586345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:49:02.586730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:49:02.587139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:49:02.587597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:49:02.603843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:02.604995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:02.605999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:02.606725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:02.628871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:49:02.637361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for user a75cb8e84f674ef0814a39d2a4887933 and project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:49:02.656268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:49:02.659316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:49:02.760133 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d2905a0a-2ae5-435a-80a9-ce39e0bc2bee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.794599 May 19 04:49:02.761540 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2071/4227] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:49:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:49:02.770172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7651768a-f084-40be-b7c0-50666dbf545b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:02.771243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7651768a-f084-40be-b7c0-50666dbf545b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:02.779287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7651768a-f084-40be-b7c0-50666dbf545b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:02.779747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7651768a-f084-40be-b7c0-50666dbf545b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:02.781502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7651768a-f084-40be-b7c0-50666dbf545b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:02.781956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7651768a-f084-40be-b7c0-50666dbf545b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:03.232223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65ac96f7-79de-4978-979d-a9b43d79eea7 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:03.248722 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-65ac96f7-79de-4978-979d-a9b43d79eea7 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1502 microversion: 2.1 time: 0.930330 May 19 04:49:03.261166 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2157/4228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:02 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1502 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:03.271465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e64b824f-2cda-4279-a80f-c30a7273ff8e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:03.273040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e64b824f-2cda-4279-a80f-c30a7273ff8e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:03.294888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e64b824f-2cda-4279-a80f-c30a7273ff8e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:03.295572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e64b824f-2cda-4279-a80f-c30a7273ff8e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:03.296528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e64b824f-2cda-4279-a80f-c30a7273ff8e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:03.296986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e64b824f-2cda-4279-a80f-c30a7273ff8e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:03.361031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7651768a-f084-40be-b7c0-50666dbf545b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:03.370879 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7651768a-f084-40be-b7c0-50666dbf545b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1510 microversion: 2.1 time: 0.607526 May 19 04:49:03.381273 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2072/4229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:02 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1510 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:03.392530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-4e0bfdd3-b216-46dd-b9d4-7af54c8356ea req-09d856ee-a956-4445-908d-57d530dcfc3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "894769ad-4295-4aff-8ba0-30957e6ec8da", "tag": "738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:03.403407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4e0bfdd3-b216-46dd-b9d4-7af54c8356ea req-09d856ee-a956-4445-908d-57d530dcfc3c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:03.403860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4e0bfdd3-b216-46dd-b9d4-7af54c8356ea req-09d856ee-a956-4445-908d-57d530dcfc3c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:03.417256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:03.436611 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-4e0bfdd3-b216-46dd-b9d4-7af54c8356ea req-09d856ee-a956-4445-908d-57d530dcfc3c service nova] Creating event network-changed:738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4 for instance 894769ad-4295-4aff-8ba0-30957e6ec8da on n-h1-766726-30 May 19 04:49:03.451677 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-4e0bfdd3-b216-46dd-b9d4-7af54c8356ea req-09d856ee-a956-4445-908d-57d530dcfc3c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078882 May 19 04:49:03.452473 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2073/4230] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:03.457531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b86e02e-7bed-440f-bee6-4199fa8aca5f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:03.458257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b86e02e-7bed-440f-bee6-4199fa8aca5f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:03.477240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b86e02e-7bed-440f-bee6-4199fa8aca5f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:03.477697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b86e02e-7bed-440f-bee6-4199fa8aca5f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:03.483996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b86e02e-7bed-440f-bee6-4199fa8aca5f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:03.484556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b86e02e-7bed-440f-bee6-4199fa8aca5f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:03.578421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b86e02e-7bed-440f-bee6-4199fa8aca5f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:03.588679 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b86e02e-7bed-440f-bee6-4199fa8aca5f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1197 microversion: 2.1 time: 0.134429 May 19 04:49:03.589578 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2074/4231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:03 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:03.603094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-95b59f1f-1588-46a2-8ecf-f2ff4d365fa0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:03.605546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-95b59f1f-1588-46a2-8ecf-f2ff4d365fa0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:03.624763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95b59f1f-1588-46a2-8ecf-f2ff4d365fa0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:03.625255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95b59f1f-1588-46a2-8ecf-f2ff4d365fa0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:03.627371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95b59f1f-1588-46a2-8ecf-f2ff4d365fa0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:03.629611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95b59f1f-1588-46a2-8ecf-f2ff4d365fa0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:03.976197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e64b824f-2cda-4279-a80f-c30a7273ff8e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:03.983888 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e64b824f-2cda-4279-a80f-c30a7273ff8e tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1313 microversion: 2.1 time: 0.721159 May 19 04:49:03.984877 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2158/4232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:03 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:03.999128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-117d4f63-69e9-405d-b666-f9919c5a9337 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:03.999889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-117d4f63-69e9-405d-b666-f9919c5a9337 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:04.007523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-117d4f63-69e9-405d-b666-f9919c5a9337 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.008315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-117d4f63-69e9-405d-b666-f9919c5a9337 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.010048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-117d4f63-69e9-405d-b666-f9919c5a9337 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.010719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-117d4f63-69e9-405d-b666-f9919c5a9337 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.015155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-95b59f1f-1588-46a2-8ecf-f2ff4d365fa0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:04.025866 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-95b59f1f-1588-46a2-8ecf-f2ff4d365fa0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.434570 May 19 04:49:04.026720 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2075/4233] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:03 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:04.041727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:04.042912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:04.051319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.052166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.053402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.054072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.104051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:04.123817 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-117d4f63-69e9-405d-b666-f9919c5a9337 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "DELETE /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.128445 May 19 04:49:04.125260 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2159/4234] 10.222.0.58 () {58 vars in 1295 bytes} [Thu May 19 04:49:03 2022] DELETE /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f/os-server-password => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:49:04.132693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c28fd096-d7cc-4e6f-b04a-c5d7ff1f5e93 req-3bbc77e7-60aa-422c-b514-4be5d45b9b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d448c0-def8-4eaa-8319-83c9df1fc5f0", "name": "network-vif-plugged", "status": "completed", "tag": "076ea3d1-dce2-4280-8f54-55ab02ea70de"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:04.158914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c28fd096-d7cc-4e6f-b04a-c5d7ff1f5e93 req-3bbc77e7-60aa-422c-b514-4be5d45b9b6a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.159370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c28fd096-d7cc-4e6f-b04a-c5d7ff1f5e93 req-3bbc77e7-60aa-422c-b514-4be5d45b9b6a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.174931 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c28fd096-d7cc-4e6f-b04a-c5d7ff1f5e93 req-3bbc77e7-60aa-422c-b514-4be5d45b9b6a service nova] Creating event network-vif-plugged:076ea3d1-dce2-4280-8f54-55ab02ea70de for instance 20d448c0-def8-4eaa-8319-83c9df1fc5f0 on n-h1-766726-30 May 19 04:49:04.185957 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c28fd096-d7cc-4e6f-b04a-c5d7ff1f5e93 req-3bbc77e7-60aa-422c-b514-4be5d45b9b6a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059210 May 19 04:49:04.186895 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2160/4235] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:04.192912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef187874-c149-4e6b-9cbe-a4f9619a234d tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:04.193534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef187874-c149-4e6b-9cbe-a4f9619a234d tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:04.201741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef187874-c149-4e6b-9cbe-a4f9619a234d tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.202207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef187874-c149-4e6b-9cbe-a4f9619a234d tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.204057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef187874-c149-4e6b-9cbe-a4f9619a234d tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.204790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef187874-c149-4e6b-9cbe-a4f9619a234d tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.240419 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef187874-c149-4e6b-9cbe-a4f9619a234d tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.052070 May 19 04:49:04.241036 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2161/4236] 10.222.0.58 () {58 vars in 1292 bytes} [Thu May 19 04:49:04 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f/os-server-password => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:49:04.262844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a656c462-a4ad-4551-84dd-e208fbb48c0a tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:04.264055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a656c462-a4ad-4551-84dd-e208fbb48c0a tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:04.272737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a656c462-a4ad-4551-84dd-e208fbb48c0a tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.273599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a656c462-a4ad-4551-84dd-e208fbb48c0a tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.274729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a656c462-a4ad-4551-84dd-e208fbb48c0a tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.276196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a656c462-a4ad-4551-84dd-e208fbb48c0a tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.312105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a656c462-a4ad-4551-84dd-e208fbb48c0a tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:49:04.320162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:04.332364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:04.342586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:04.349006 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a40b2dea-85fc-4e0d-a666-644f38fb8fb2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1405 microversion: 2.20 time: 0.308177 May 19 04:49:04.349662 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2076/4237] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:04 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:04.389580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-26ca666d-ceae-4547-8af0-37767f39a2d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:04.390476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-26ca666d-ceae-4547-8af0-37767f39a2d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:04.401769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26ca666d-ceae-4547-8af0-37767f39a2d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.402224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26ca666d-ceae-4547-8af0-37767f39a2d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.405792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26ca666d-ceae-4547-8af0-37767f39a2d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.406365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-26ca666d-ceae-4547-8af0-37767f39a2d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.499713 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a656c462-a4ad-4551-84dd-e208fbb48c0a tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "DELETE /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 204 len: 0 microversion: 2.1 time: 0.241757 May 19 04:49:04.501051 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2162/4238] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:49:04 2022] DELETE /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:49:04.532950 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0965fd7a-af82-4e7a-a2ce-75bae0db9889 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:04.535875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0965fd7a-af82-4e7a-a2ce-75bae0db9889 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:04.551247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0965fd7a-af82-4e7a-a2ce-75bae0db9889 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.552317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0965fd7a-af82-4e7a-a2ce-75bae0db9889 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.553894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0965fd7a-af82-4e7a-a2ce-75bae0db9889 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.557229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0965fd7a-af82-4e7a-a2ce-75bae0db9889 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.866512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-26ca666d-ceae-4547-8af0-37767f39a2d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:04.874791 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-26ca666d-ceae-4547-8af0-37767f39a2d7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1510 microversion: 2.1 time: 0.490847 May 19 04:49:04.875704 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2077/4239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:04 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1510 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:49:04.878965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0965fd7a-af82-4e7a-a2ce-75bae0db9889 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:04.880283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-07f2b62d-48e1-4e6e-aefe-50e89f8111ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:04.880897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-07f2b62d-48e1-4e6e-aefe-50e89f8111ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:04.894148 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0965fd7a-af82-4e7a-a2ce-75bae0db9889 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1508 microversion: 2.1 time: 0.388990 May 19 04:49:04.895137 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2163/4240] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:04 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1508 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:04.896931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07f2b62d-48e1-4e6e-aefe-50e89f8111ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.897661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07f2b62d-48e1-4e6e-aefe-50e89f8111ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.898291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07f2b62d-48e1-4e6e-aefe-50e89f8111ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:04.898741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07f2b62d-48e1-4e6e-aefe-50e89f8111ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:04.979189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-07f2b62d-48e1-4e6e-aefe-50e89f8111ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:04.989913 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-07f2b62d-48e1-4e6e-aefe-50e89f8111ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1251 microversion: 2.1 time: 0.112283 May 19 04:49:04.990941 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2078/4241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:04 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1251 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:05.000784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d44a69c-e8aa-4198-b3b9-89a8782425bc tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:05.001441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d44a69c-e8aa-4198-b3b9-89a8782425bc tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:05.008192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d44a69c-e8aa-4198-b3b9-89a8782425bc tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.008639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d44a69c-e8aa-4198-b3b9-89a8782425bc tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:05.010173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d44a69c-e8aa-4198-b3b9-89a8782425bc tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.010847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d44a69c-e8aa-4198-b3b9-89a8782425bc tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:05.043294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-52001898-202e-4630-9ed8-eff48312ca07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:05.043857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-52001898-202e-4630-9ed8-eff48312ca07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:05.053498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52001898-202e-4630-9ed8-eff48312ca07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.053957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52001898-202e-4630-9ed8-eff48312ca07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:05.054748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52001898-202e-4630-9ed8-eff48312ca07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.055197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52001898-202e-4630-9ed8-eff48312ca07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:05.308838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d44a69c-e8aa-4198-b3b9-89a8782425bc tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:05.324858 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d44a69c-e8aa-4198-b3b9-89a8782425bc tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1313 microversion: 2.1 time: 0.326886 May 19 04:49:05.327585 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2164/4242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:04 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:49:05.340840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-52001898-202e-4630-9ed8-eff48312ca07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:05.348741 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-52001898-202e-4630-9ed8-eff48312ca07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.309442 May 19 04:49:05.358230 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2079/4243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:05 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:05.367419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:05.369422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:05.377190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.377715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:05.378547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.379050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:05.580303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:05.615840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:05.618427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:05.622392 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f1d1c18-317e-4bd3-9383-ef36c0f5ad64 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1405 microversion: 2.20 time: 0.259133 May 19 04:49:05.623490 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2165/4244] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:05 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:05.904589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f79da069-d0d2-4b03-9aeb-f3170918eb1a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:05.906108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f79da069-d0d2-4b03-9aeb-f3170918eb1a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:05.912006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-afcade26-1c26-4371-a0d9-bcad3738dfcd tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:05.913192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-afcade26-1c26-4371-a0d9-bcad3738dfcd tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:05.919701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f79da069-d0d2-4b03-9aeb-f3170918eb1a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.921013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f79da069-d0d2-4b03-9aeb-f3170918eb1a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:05.922111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f79da069-d0d2-4b03-9aeb-f3170918eb1a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.922800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f79da069-d0d2-4b03-9aeb-f3170918eb1a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:05.924758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afcade26-1c26-4371-a0d9-bcad3738dfcd tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.925263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afcade26-1c26-4371-a0d9-bcad3738dfcd tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:05.930701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afcade26-1c26-4371-a0d9-bcad3738dfcd tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:05.931315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afcade26-1c26-4371-a0d9-bcad3738dfcd tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:06.417834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f79da069-d0d2-4b03-9aeb-f3170918eb1a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:06.427929 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f79da069-d0d2-4b03-9aeb-f3170918eb1a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1510 microversion: 2.1 time: 0.537127 May 19 04:49:06.430321 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2080/4245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:05 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1510 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:06.436935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-afcade26-1c26-4371-a0d9-bcad3738dfcd tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:06.450589 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-afcade26-1c26-4371-a0d9-bcad3738dfcd tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1508 microversion: 2.1 time: 0.541133 May 19 04:49:06.453373 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2166/4246] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:05 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1508 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:49:06.457597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e3b41842-b7a1-49a0-a0ec-9241ecc9a811 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:06.458486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e3b41842-b7a1-49a0-a0ec-9241ecc9a811 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:06.467159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-096cfeae-953b-4c15-a19d-f7ea6260de9b tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:06.469750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-096cfeae-953b-4c15-a19d-f7ea6260de9b tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:06.486879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3b41842-b7a1-49a0-a0ec-9241ecc9a811 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:06.494780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3b41842-b7a1-49a0-a0ec-9241ecc9a811 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:06.496762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3b41842-b7a1-49a0-a0ec-9241ecc9a811 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:06.498666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3b41842-b7a1-49a0-a0ec-9241ecc9a811 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:06.507686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-096cfeae-953b-4c15-a19d-f7ea6260de9b tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:06.508454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-096cfeae-953b-4c15-a19d-f7ea6260de9b tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:06.509830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-096cfeae-953b-4c15-a19d-f7ea6260de9b tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:06.512186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-096cfeae-953b-4c15-a19d-f7ea6260de9b tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:07.355140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e3b41842-b7a1-49a0-a0ec-9241ecc9a811 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:07.370419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-096cfeae-953b-4c15-a19d-f7ea6260de9b tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:07.379598 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-096cfeae-953b-4c15-a19d-f7ea6260de9b tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1313 microversion: 2.1 time: 0.924624 May 19 04:49:07.385010 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e3b41842-b7a1-49a0-a0ec-9241ecc9a811 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1293 microversion: 2.1 time: 0.950777 May 19 04:49:07.385858 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2081/4247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:06 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1293 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:07.389764 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2167/4248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:06 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1313 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:07.394757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e441d4c-4630-4131-883b-e816695ac707 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:07.394996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:07.396204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:07.405633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:07.406336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:07.407276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:07.407876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:07.416665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e441d4c-4630-4131-883b-e816695ac707 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:07.441559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e441d4c-4630-4131-883b-e816695ac707 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:07.444491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e441d4c-4630-4131-883b-e816695ac707 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:07.445476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e441d4c-4630-4131-883b-e816695ac707 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:07.445925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e441d4c-4630-4131-883b-e816695ac707 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:07.980923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:07.994842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:07.997121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:07.998810 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7b2d4d46-f9ff-4c4f-813d-6c4a59ff1b56 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1405 microversion: 2.20 time: 0.607776 May 19 04:49:08.000816 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2168/4249] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:07 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1405 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:08.014466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-02a85a38-0422-4726-b9f4-f9cdb471695e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:08.015461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-02a85a38-0422-4726-b9f4-f9cdb471695e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:08.023980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02a85a38-0422-4726-b9f4-f9cdb471695e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.025648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02a85a38-0422-4726-b9f4-f9cdb471695e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:08.027129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02a85a38-0422-4726-b9f4-f9cdb471695e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.028081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02a85a38-0422-4726-b9f4-f9cdb471695e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:08.030175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e441d4c-4630-4131-883b-e816695ac707 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:08.044720 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e441d4c-4630-4131-883b-e816695ac707 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1511 microversion: 2.1 time: 0.656651 May 19 04:49:08.045355 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2082/4250] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:07 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1511 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:08.050055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c24015f-c365-4d1d-b0c5-871de90dbc49 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:08.050666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c24015f-c365-4d1d-b0c5-871de90dbc49 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:08.070190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c24015f-c365-4d1d-b0c5-871de90dbc49 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.070642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c24015f-c365-4d1d-b0c5-871de90dbc49 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:08.071426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c24015f-c365-4d1d-b0c5-871de90dbc49 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.072430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c24015f-c365-4d1d-b0c5-871de90dbc49 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:08.486440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-02a85a38-0422-4726-b9f4-f9cdb471695e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:08.507593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c24015f-c365-4d1d-b0c5-871de90dbc49 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed8bd607cfa4de4acf7a83d4f156302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2ef054d17240bba2890ad4d2844110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:08.508065 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-02a85a38-0422-4726-b9f4-f9cdb471695e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1531 microversion: 2.1 time: 0.503950 May 19 04:49:08.508614 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2169/4251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:08 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1531 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:08.518865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:08.520689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:08.528662 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c24015f-c365-4d1d-b0c5-871de90dbc49 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 200 len: 1508 microversion: 2.1 time: 0.481963 May 19 04:49:08.538864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.538864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:08.538864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.538864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:08.540166 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2083/4252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:08 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:08.546130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da51e5ed-9d5c-4527-a5a4-3098ac9ae093 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:08.547267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da51e5ed-9d5c-4527-a5a4-3098ac9ae093 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:08.557779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da51e5ed-9d5c-4527-a5a4-3098ac9ae093 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.558586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da51e5ed-9d5c-4527-a5a4-3098ac9ae093 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:08.559533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da51e5ed-9d5c-4527-a5a4-3098ac9ae093 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.560691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da51e5ed-9d5c-4527-a5a4-3098ac9ae093 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:08.622644 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 HTTP/1.1 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '23673e55-0886-4f7e-bbf3-57c29b063597'} May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:08.630890 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:08.636025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:08.637020 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-576ad9a6-9f33-48ab-941c-3c2002ed403f tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 404 len: 111 microversion: 2.1 time: 0.124453 May 19 04:49:08.640011 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2170/4253] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:49:08 2022] DELETE /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:49:08.650800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-77dd0933-6b1f-4143-acb6-1882f244b59c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:08.653043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-77dd0933-6b1f-4143-acb6-1882f244b59c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:08.670875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77dd0933-6b1f-4143-acb6-1882f244b59c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.671772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77dd0933-6b1f-4143-acb6-1882f244b59c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:08.673011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77dd0933-6b1f-4143-acb6-1882f244b59c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:08.674228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77dd0933-6b1f-4143-acb6-1882f244b59c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.021262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da51e5ed-9d5c-4527-a5a4-3098ac9ae093 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:09.044139 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da51e5ed-9d5c-4527-a5a4-3098ac9ae093 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1462 microversion: 2.1 time: 0.501972 May 19 04:49:09.049133 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2084/4254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:08 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1462 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:09.068326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0de19e2e-f9bc-4738-a96e-61c22006f3f0 req-c387fa50-22d8-4b11-8927-ea26798444e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316e7c36-d184-4452-8d06-37ee6d7de06f", "name": "network-vif-deleted", "tag": "2a673094-8432-478a-9a44-283897a80c42"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:09.079700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-77dd0933-6b1f-4143-acb6-1882f244b59c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:09.088743 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-77dd0933-6b1f-4143-acb6-1882f244b59c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1293 microversion: 2.1 time: 0.447330 May 19 04:49:09.093262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0de19e2e-f9bc-4738-a96e-61c22006f3f0 req-c387fa50-22d8-4b11-8927-ea26798444e3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.094700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0de19e2e-f9bc-4738-a96e-61c22006f3f0 req-c387fa50-22d8-4b11-8927-ea26798444e3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.102011 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2171/4255] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:08 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1293 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:09.109947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:09.110576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 23673e55-0886-4f7e-bbf3-57c29b063597] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:09.119655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0de19e2e-f9bc-4738-a96e-61c22006f3f0 req-c387fa50-22d8-4b11-8927-ea26798444e3 service nova] Creating event network-vif-deleted:2a673094-8432-478a-9a44-283897a80c42 for instance 316e7c36-d184-4452-8d06-37ee6d7de06f on n-h1-766726-30 May 19 04:49:09.127215 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0de19e2e-f9bc-4738-a96e-61c22006f3f0 req-c387fa50-22d8-4b11-8927-ea26798444e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073014 May 19 04:49:09.128758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.130715 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2085/4256] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:09.134621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.135461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.135914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.143338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:09.147498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:09.158502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.159408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.160377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.162719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.174318 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 HTTP/1.1 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '23673e55-0886-4f7e-bbf3-57c29b063597'} May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:09.175837 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.181728 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:09.181728 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:09.181728 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:09.181728 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:09.181728 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:09.181728 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. May 19 04:49:09.181728 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.183423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance 23673e55-0886-4f7e-bbf3-57c29b063597 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:09.184308 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2b73b4a-93b5-4f47-894e-07f9442882f5 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597" status: 404 len: 111 microversion: 2.1 time: 0.081019 May 19 04:49:09.185565 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2172/4257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:09 2022] GET /compute/v2.1/servers/23673e55-0886-4f7e-bbf3-57c29b063597 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:49:09.193839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e430094-6695-41d0-b149-4bf3bbf07742 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:09.194666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9e430094-6695-41d0-b149-4bf3bbf07742 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:09.222650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e430094-6695-41d0-b149-4bf3bbf07742 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.227355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e430094-6695-41d0-b149-4bf3bbf07742 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.228192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e430094-6695-41d0-b149-4bf3bbf07742 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.228824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e430094-6695-41d0-b149-4bf3bbf07742 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.589055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:09.619669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:09.624010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:09.627648 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e69ead6-c0c3-4e3a-9c70-894ce8f666d1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1405 microversion: 2.20 time: 0.494860 May 19 04:49:09.642476 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2086/4258] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:09 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1405 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:09.729818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9e430094-6695-41d0-b149-4bf3bbf07742 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:09.739133 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e430094-6695-41d0-b149-4bf3bbf07742 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1488 microversion: 2.1 time: 0.552373 May 19 04:49:09.754263 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2173/4259] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:09 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1488 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:09.767440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:09.773968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:09.792687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.795721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.798322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.801422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.833178 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 HTTP/1.1 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '71c25126-57dc-4b2f-b1d8-93980536a256'} May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:09.839189 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:09.843918 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:09.850771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:09.855666 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bd8aa70c-5c10-4615-90d3-d87aa8c6688a tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 404 len: 111 microversion: 2.1 time: 0.099841 May 19 04:49:09.861373 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2174/4260] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:49:09 2022] DELETE /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:49:09.871699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-849979eb-652f-4ea3-b134-75e2e977ce26 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:09.875211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-849979eb-652f-4ea3-b134-75e2e977ce26 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:09.900621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849979eb-652f-4ea3-b134-75e2e977ce26 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.905313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849979eb-652f-4ea3-b134-75e2e977ce26 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.907976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849979eb-652f-4ea3-b134-75e2e977ce26 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:09.911292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-849979eb-652f-4ea3-b134-75e2e977ce26 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:09.994850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-abbda592-a88b-4448-a5e2-a37cc596fefe tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Calling method '.version_select at 0x7fd314664c10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:10.016458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abbda592-a88b-4448-a5e2-a37cc596fefe tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.016932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abbda592-a88b-4448-a5e2-a37cc596fefe tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.076905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abbda592-a88b-4448-a5e2-a37cc596fefe tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.077402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abbda592-a88b-4448-a5e2-a37cc596fefe tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.127458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-abbda592-a88b-4448-a5e2-a37cc596fefe tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/2820289ee7114dedab8f6019584bf920?start=2022-05-18T04%3A49%3A09.055106&end=2022-05-20T04%3A49%3A09.055106" status: 200 len: 694 microversion: 2.1 time: 0.482157 May 19 04:49:10.131025 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2087/4261] 10.222.0.58 () {58 vars in 1411 bytes} [Thu May 19 04:49:09 2022] GET /compute/v2.1/os-simple-tenant-usage/2820289ee7114dedab8f6019584bf920?start=2022-05-18T04%3A49%3A09.055106&end=2022-05-20T04%3A49%3A09.055106 => generated 694 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:10.150566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:10.153963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] [instance: 316e7c36-d184-4452-8d06-37ee6d7de06f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:10.167275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.167981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.168936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.178558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.213069 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] HTTP exception thrown: Instance 316e7c36-d184-4452-8d06-37ee6d7de06f could not be found. May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Request method failure captured: May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f HTTP/1.1 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwoJUEIImnMtAtbx8eZR9ZKngFnAS7FGt8oKLunO1af-yN4XENB9JswWY_QVn6U8WEg2H1ZY7MogJgllJjLz6yi8zGmSCInyodpV5-cNmx4ussDCz-Z-vdwZNOu6s9KHnCsu6gpAHb5iQ6QZbZ8h5jpndaRURWrGQ5pPicXa9ndhGo May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 7a2ef054d17240bba2890ad4d2844110 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerPasswordTestJSON-443141711 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7a2ef054d17240bba2890ad4d2844110"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a2ef054d17240bba2890ad4d2844110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a2ef054d17240bba2890ad4d2844110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7a2ef054d17240bba2890ad4d2844110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerPasswordTestJSON-443141711 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 7a2ef054d17240bba2890ad4d2844110 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerPasswordTestJSON-443141711 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerPasswordTestJSON-443141711-project May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: eed8bd607cfa4de4acf7a83d4f156302 May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerPasswordTestJSON-443141711-project May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 316e7c36-d184-4452-8d06-37ee6d7de06f could not be found. May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '316e7c36-d184-4452-8d06-37ee6d7de06f'} May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316e7c36-d184-4452-8d06-37ee6d7de06f could not be found. May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316e7c36-d184-4452-8d06-37ee6d7de06f could not be found. May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:10.222509 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:10.227688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:10.227688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:10.227688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:10.227688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:10.227688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:10.227688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316e7c36-d184-4452-8d06-37ee6d7de06f could not be found. May 19 04:49:10.227688 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:10.232694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] Returning 404 to user: Instance 316e7c36-d184-4452-8d06-37ee6d7de06f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:10.234679 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a73f7a77-51cc-4c3a-bb3f-fcea13bdc5a4 tempest-ServerPasswordTestJSON-443141711 tempest-ServerPasswordTestJSON-443141711-project] 10.222.0.58 "GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f" status: 404 len: 111 microversion: 2.1 time: 0.102017 May 19 04:49:10.239465 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2088/4262] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:10 2022] GET /compute/v2.1/servers/316e7c36-d184-4452-8d06-37ee6d7de06f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:49:10.283431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-52dc2e87-a4a2-4622-bbb9-4c55d6e92e48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:10.293744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-52dc2e87-a4a2-4622-bbb9-4c55d6e92e48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:10.336757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52dc2e87-a4a2-4622-bbb9-4c55d6e92e48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.349136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52dc2e87-a4a2-4622-bbb9-4c55d6e92e48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.350855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52dc2e87-a4a2-4622-bbb9-4c55d6e92e48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.351528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52dc2e87-a4a2-4622-bbb9-4c55d6e92e48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.356191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-849979eb-652f-4ea3-b134-75e2e977ce26 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:10.368059 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-849979eb-652f-4ea3-b134-75e2e977ce26 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 0.502555 May 19 04:49:10.369745 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2175/4263] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:09 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:10.402911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:10.408120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 71c25126-57dc-4b2f-b1d8-93980536a256] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:10.429563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.432505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.433826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.436790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.470766 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 HTTP/1.1 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '71c25126-57dc-4b2f-b1d8-93980536a256'} May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:10.475780 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:10.481379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:10.481379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:10.481379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:10.481379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:10.481379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:10.481379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. May 19 04:49:10.481379 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:10.481379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance 71c25126-57dc-4b2f-b1d8-93980536a256 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:10.482073 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-770205bd-0ac9-4460-97d6-70bd3f32ee81 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256" status: 404 len: 111 microversion: 2.1 time: 0.109022 May 19 04:49:10.484492 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2176/4264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:10 2022] GET /compute/v2.1/servers/71c25126-57dc-4b2f-b1d8-93980536a256 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:49:10.497819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3fe93822-3222-4584-91a3-37b3273f90bc req-4f5b350e-5b2f-4f99-ba6c-728cdec82610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894769ad-4295-4aff-8ba0-30957e6ec8da", "name": "network-vif-plugged", "status": "completed", "tag": "738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:10.515283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3fe93822-3222-4584-91a3-37b3273f90bc req-4f5b350e-5b2f-4f99-ba6c-728cdec82610 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.516702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3fe93822-3222-4584-91a3-37b3273f90bc req-4f5b350e-5b2f-4f99-ba6c-728cdec82610 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.537896 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3fe93822-3222-4584-91a3-37b3273f90bc req-4f5b350e-5b2f-4f99-ba6c-728cdec82610 service nova] Creating event network-vif-plugged:738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4 for instance 894769ad-4295-4aff-8ba0-30957e6ec8da on n-h1-766726-30 May 19 04:49:10.546880 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3fe93822-3222-4584-91a3-37b3273f90bc req-4f5b350e-5b2f-4f99-ba6c-728cdec82610 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061394 May 19 04:49:10.553777 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2177/4265] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:10.562615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cad2944b-54b9-4663-9999-1a333ad16855 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:10.563709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cad2944b-54b9-4663-9999-1a333ad16855 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:10.580995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad2944b-54b9-4663-9999-1a333ad16855 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.582849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad2944b-54b9-4663-9999-1a333ad16855 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.584397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad2944b-54b9-4663-9999-1a333ad16855 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.585932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad2944b-54b9-4663-9999-1a333ad16855 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.807370 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-52dc2e87-a4a2-4622-bbb9-4c55d6e92e48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 200 len: 169 microversion: 2.1 time: 0.565577 May 19 04:49:10.809196 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2089/4266] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:10 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 169 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:10.816789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afcc562b-8ad5-404c-876b-ed2a52057662 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '.version_select at 0x7fd314664160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:10.846021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcc562b-8ad5-404c-876b-ed2a52057662 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.847082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcc562b-8ad5-404c-876b-ed2a52057662 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.876432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcc562b-8ad5-404c-876b-ed2a52057662 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.878613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcc562b-8ad5-404c-876b-ed2a52057662 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.916742 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afcc562b-8ad5-404c-876b-ed2a52057662 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/2820289ee7114dedab8f6019584bf920?start=2022-05-18T04%3A49%3A09.055106&end=2022-05-20T04%3A49%3A09.055106" status: 200 len: 650 microversion: 2.1 time: 0.105962 May 19 04:49:10.917451 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2090/4267] 10.222.0.58 () {58 vars in 1411 bytes} [Thu May 19 04:49:10 2022] GET /compute/v2.1/os-simple-tenant-usage/2820289ee7114dedab8f6019584bf920?start=2022-05-18T04%3A49%3A09.055106&end=2022-05-20T04%3A49%3A09.055106 => generated 650 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:10.926702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:10.930148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:10.944678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.946978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cad2944b-54b9-4663-9999-1a333ad16855 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:10.948047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.951362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.953245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.958046 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cad2944b-54b9-4663-9999-1a333ad16855 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1293 microversion: 2.1 time: 0.402477 May 19 04:49:10.959382 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2178/4268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:10 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1293 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:10.965903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0320d59e-484e-4945-b04e-922ecc62b09b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:10.966829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0320d59e-484e-4945-b04e-922ecc62b09b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:10.974735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0320d59e-484e-4945-b04e-922ecc62b09b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.975574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0320d59e-484e-4945-b04e-922ecc62b09b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.976600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0320d59e-484e-4945-b04e-922ecc62b09b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:10.977302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0320d59e-484e-4945-b04e-922ecc62b09b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:10.983194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:11.235814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:11.245757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:11.247686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:11.249368 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fe0e63bc-4946-4291-be86-222f862d7b17 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1405 microversion: 2.20 time: 0.330583 May 19 04:49:11.260545 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2091/4269] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:10 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1405 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:11.262648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0320d59e-484e-4945-b04e-922ecc62b09b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:11.265979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8f458828-4c33-4082-b931-da3525100ee0 tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Calling method '.version_select at 0x7fd3145ff3a0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:11.275462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f458828-4c33-4082-b931-da3525100ee0 tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:11.276566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f458828-4c33-4082-b931-da3525100ee0 tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:11.296395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f458828-4c33-4082-b931-da3525100ee0 tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:11.297274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f458828-4c33-4082-b931-da3525100ee0 tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:11.324014 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0320d59e-484e-4945-b04e-922ecc62b09b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.363115 May 19 04:49:11.324737 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2179/4270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:10 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:11.335453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1d6d0782-f1e3-48b4-a845-53d56b1dad6b req-d16a541c-94a8-4bc4-a26c-ea002c3206a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b5a7a27-6877-43f8-ba74-86a11b5716d9", "tag": "f9cb6a4c-03c3-4e21-87b1-a1be46107fe4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:11.356525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1d6d0782-f1e3-48b4-a845-53d56b1dad6b req-d16a541c-94a8-4bc4-a26c-ea002c3206a5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:11.358119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1d6d0782-f1e3-48b4-a845-53d56b1dad6b req-d16a541c-94a8-4bc4-a26c-ea002c3206a5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:11.385993 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1d6d0782-f1e3-48b4-a845-53d56b1dad6b req-d16a541c-94a8-4bc4-a26c-ea002c3206a5 service nova] Creating event network-changed:f9cb6a4c-03c3-4e21-87b1-a1be46107fe4 for instance 9b5a7a27-6877-43f8-ba74-86a11b5716d9 on n-h2-766726-30 May 19 04:49:11.393046 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1d6d0782-f1e3-48b4-a845-53d56b1dad6b req-d16a541c-94a8-4bc4-a26c-ea002c3206a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061549 May 19 04:49:11.406165 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2180/4271] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:11.412112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-56b5c9f7-974d-435a-8ee8-05f7f77f8bab tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:11.413062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-56b5c9f7-974d-435a-8ee8-05f7f77f8bab tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:11.424730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56b5c9f7-974d-435a-8ee8-05f7f77f8bab tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:11.427267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56b5c9f7-974d-435a-8ee8-05f7f77f8bab tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:11.435764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56b5c9f7-974d-435a-8ee8-05f7f77f8bab tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:11.436239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56b5c9f7-974d-435a-8ee8-05f7f77f8bab tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:11.715383 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8f458828-4c33-4082-b931-da3525100ee0 tempest-TenantUsagesTestJSON-1298826872 tempest-TenantUsagesTestJSON-1298826872-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T04%3A49%3A09.055106&end=2022-05-20T04%3A49%3A09.055106&detailed=1" status: 200 len: 55282 microversion: 2.1 time: 0.451990 May 19 04:49:11.717569 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2092/4272] 10.222.0.58 () {58 vars in 1334 bytes} [Thu May 19 04:49:11 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T04%3A49%3A09.055106&end=2022-05-20T04%3A49%3A09.055106&detailed=1 => generated 55282 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:49:11.722944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-855a0202-5e6e-443d-840d-6a747f7819bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:11.723855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-855a0202-5e6e-443d-840d-6a747f7819bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:11.730646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-855a0202-5e6e-443d-840d-6a747f7819bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:11.731372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-855a0202-5e6e-443d-840d-6a747f7819bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:11.732473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-855a0202-5e6e-443d-840d-6a747f7819bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:11.733521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-855a0202-5e6e-443d-840d-6a747f7819bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:12.649226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=20 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:12.958517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-855a0202-5e6e-443d-840d-6a747f7819bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:12.969520 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-855a0202-5e6e-443d-840d-6a747f7819bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 1.250579 May 19 04:49:12.974308 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2093/4273] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:11 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:12.992507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59d5d111-947a-4463-904f-0450dac1da32 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:13.004033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-59d5d111-947a-4463-904f-0450dac1da32 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:13.029365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59d5d111-947a-4463-904f-0450dac1da32 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:13.031562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59d5d111-947a-4463-904f-0450dac1da32 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:13.033996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59d5d111-947a-4463-904f-0450dac1da32 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:13.036996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59d5d111-947a-4463-904f-0450dac1da32 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:13.043329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:13.048023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-56b5c9f7-974d-435a-8ee8-05f7f77f8bab tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:13.066234 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-56b5c9f7-974d-435a-8ee8-05f7f77f8bab tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 1.658074 May 19 04:49:13.066535 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2181/4274] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:11 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:13.080545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-50ad9a4f-211c-460c-9433-5f23518dd26e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:13.097280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-50ad9a4f-211c-460c-9433-5f23518dd26e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:13.111688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50ad9a4f-211c-460c-9433-5f23518dd26e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:13.119847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50ad9a4f-211c-460c-9433-5f23518dd26e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:13.120902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50ad9a4f-211c-460c-9433-5f23518dd26e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:13.122721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50ad9a4f-211c-460c-9433-5f23518dd26e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:13.151222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-59d5d111-947a-4463-904f-0450dac1da32 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:49:13.360088 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59d5d111-947a-4463-904f-0450dac1da32 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 204 len: 0 microversion: 2.1 time: 0.371190 May 19 04:49:13.361655 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2094/4275] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:49:12 2022] DELETE /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:49:13.377318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:13.378482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:13.394439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:13.395084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:13.396064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:13.396665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:14.478550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-50ad9a4f-211c-460c-9433-5f23518dd26e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:14.494494 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-50ad9a4f-211c-460c-9433-5f23518dd26e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1293 microversion: 2.1 time: 1.426904 May 19 04:49:14.495600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:14.506267 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2182/4276] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:13 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1293 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:14.510691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:14.512222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:14.518484 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c2f90125-9085-4922-9a4c-255ad6b49857 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1598 microversion: 2.20 time: 1.155311 May 19 04:49:14.520824 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2095/4277] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:13 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1598 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:14.551088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7c088165-73b4-4c48-9189-47543ecb2d33 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:14.557029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7c088165-73b4-4c48-9189-47543ecb2d33 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:14.562239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-7c59684d-6dfb-4a6f-bc92-a6fc0a38ac63 req-4c9c332e-c5a8-41c0-9796-63bfe9ceff35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878aa03f-a366-4d71-b678-1c749fc143c6", "name": "network-vif-plugged", "status": "completed", "tag": "ba6e6c22-0bce-4292-b1fd-46293b3f4ad6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:14.591328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c088165-73b4-4c48-9189-47543ecb2d33 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:14.596757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c088165-73b4-4c48-9189-47543ecb2d33 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:14.599066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7c59684d-6dfb-4a6f-bc92-a6fc0a38ac63 req-4c9c332e-c5a8-41c0-9796-63bfe9ceff35 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:14.603281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c088165-73b4-4c48-9189-47543ecb2d33 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:14.603662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7c59684d-6dfb-4a6f-bc92-a6fc0a38ac63 req-4c9c332e-c5a8-41c0-9796-63bfe9ceff35 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:14.603802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c088165-73b4-4c48-9189-47543ecb2d33 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:14.647918 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7c59684d-6dfb-4a6f-bc92-a6fc0a38ac63 req-4c9c332e-c5a8-41c0-9796-63bfe9ceff35 service nova] Creating event network-vif-plugged:ba6e6c22-0bce-4292-b1fd-46293b3f4ad6 for instance 878aa03f-a366-4d71-b678-1c749fc143c6 on n-h1-766726-30 May 19 04:49:14.678839 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-7c59684d-6dfb-4a6f-bc92-a6fc0a38ac63 req-4c9c332e-c5a8-41c0-9796-63bfe9ceff35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170233 May 19 04:49:14.680095 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2183/4278] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:14.688935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c47f895-0e95-4a36-a626-87e0c5874cc7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:14.692408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c47f895-0e95-4a36-a626-87e0c5874cc7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:14.714484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c47f895-0e95-4a36-a626-87e0c5874cc7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:14.715140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c47f895-0e95-4a36-a626-87e0c5874cc7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:14.716112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c47f895-0e95-4a36-a626-87e0c5874cc7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:14.716733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c47f895-0e95-4a36-a626-87e0c5874cc7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:15.169559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7c088165-73b4-4c48-9189-47543ecb2d33 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:15.183090 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7c088165-73b4-4c48-9189-47543ecb2d33 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.654864 May 19 04:49:15.183762 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2096/4279] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:14 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:15.205945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e6144ce5-30b0-46af-896f-d420e3fe326c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:15.206575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e6144ce5-30b0-46af-896f-d420e3fe326c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:15.243140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c47f895-0e95-4a36-a626-87e0c5874cc7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:15.261567 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c47f895-0e95-4a36-a626-87e0c5874cc7 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1468 microversion: 2.1 time: 0.578875 May 19 04:49:15.267625 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2184/4280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:14 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1468 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:15.271560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6144ce5-30b0-46af-896f-d420e3fe326c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:15.272195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6144ce5-30b0-46af-896f-d420e3fe326c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:15.275787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6144ce5-30b0-46af-896f-d420e3fe326c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:15.279842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6144ce5-30b0-46af-896f-d420e3fe326c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:15.282465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd1e172f-7250-4b1b-aa9c-195e9199d36e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:15.286211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cd1e172f-7250-4b1b-aa9c-195e9199d36e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:15.310800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd1e172f-7250-4b1b-aa9c-195e9199d36e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:15.313310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd1e172f-7250-4b1b-aa9c-195e9199d36e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:15.316368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd1e172f-7250-4b1b-aa9c-195e9199d36e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:15.322074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd1e172f-7250-4b1b-aa9c-195e9199d36e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:15.609423 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd1e172f-7250-4b1b-aa9c-195e9199d36e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.339153 May 19 04:49:15.610140 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2185/4281] 10.222.0.58 () {60 vars in 1315 bytes} [Thu May 19 04:49:15 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-interface => generated 285 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:49:15.795086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e6144ce5-30b0-46af-896f-d420e3fe326c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:15.804651 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e6144ce5-30b0-46af-896f-d420e3fe326c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 0.619767 May 19 04:49:15.812036 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2097/4282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:15 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:15.821735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-899085f7-4eba-4dcf-b57e-dd75c4b09b85 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:15.832741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-899085f7-4eba-4dcf-b57e-dd75c4b09b85 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:15.854989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-899085f7-4eba-4dcf-b57e-dd75c4b09b85 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:15.855849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-899085f7-4eba-4dcf-b57e-dd75c4b09b85 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:15.856915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-899085f7-4eba-4dcf-b57e-dd75c4b09b85 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:15.857618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-899085f7-4eba-4dcf-b57e-dd75c4b09b85 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:15.954422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-642983287", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": "none"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:16.096978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:49:16.097428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:49:16.097904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:49:16.098518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:49:16.099118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:49:16.119751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:16.127601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:16.128671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:16.129349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:16.174395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Getting quotas for project b7e29769f77f42fabcb6056a07149ba0. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:49:16.181604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Getting quotas for user 269367cad82c4fe2a3b7591933002b97 and project b7e29769f77f42fabcb6056a07149ba0. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:49:16.213724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:49:16.216326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: d71b6372-bc4a-4ef7-8d48-13552970f9cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:49:16.297757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-899085f7-4eba-4dcf-b57e-dd75c4b09b85 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:16.320117 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-899085f7-4eba-4dcf-b57e-dd75c4b09b85 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.503509 May 19 04:49:16.343254 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a13fc84-b302-4ae4-8d3e-d1bb1e3f68ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.732011 May 19 04:49:16.347775 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2098/4283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:15 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:16.352927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-37602ee7-733a-48fb-8281-49df1a30f666 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:16.357631 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2186/4284] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:49:16.370775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ded65094-8cfd-4a2e-9093-5a90fe48f30e req-4c31e242-36a1-4114-a87f-8861e7de9423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d448c0-def8-4eaa-8319-83c9df1fc5f0", "name": "network-vif-deleted", "tag": "076ea3d1-dce2-4280-8f54-55ab02ea70de"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:16.371914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-37602ee7-733a-48fb-8281-49df1a30f666 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:16.386980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ded65094-8cfd-4a2e-9093-5a90fe48f30e req-4c31e242-36a1-4114-a87f-8861e7de9423 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:16.389753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ded65094-8cfd-4a2e-9093-5a90fe48f30e req-4c31e242-36a1-4114-a87f-8861e7de9423 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:16.391746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37602ee7-733a-48fb-8281-49df1a30f666 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:16.398701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37602ee7-733a-48fb-8281-49df1a30f666 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:16.402439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37602ee7-733a-48fb-8281-49df1a30f666 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:16.405811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-37602ee7-733a-48fb-8281-49df1a30f666 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:16.412014 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ded65094-8cfd-4a2e-9093-5a90fe48f30e req-4c31e242-36a1-4114-a87f-8861e7de9423 service nova] Creating event network-vif-deleted:076ea3d1-dce2-4280-8f54-55ab02ea70de for instance 20d448c0-def8-4eaa-8319-83c9df1fc5f0 on n-h1-766726-30 May 19 04:49:16.423825 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ded65094-8cfd-4a2e-9093-5a90fe48f30e req-4c31e242-36a1-4114-a87f-8861e7de9423 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064844 May 19 04:49:16.432573 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2187/4285] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:16.440609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:16.448150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:16.459568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:16.460022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:16.465302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:16.465849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:16.538202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:16.538894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:16.539575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lazy-loading 'fault' on Instance uuid 20d448c0-def8-4eaa-8319-83c9df1fc5f0 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:49:16.694261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a98ed076094cc7ba41347094d56750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2820289ee7114dedab8f6019584bf920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:16.707024 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d87a36da-6d9b-46cc-b807-35df3bad5174 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 200 len: 1303 microversion: 2.1 time: 0.272583 May 19 04:49:16.720740 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2188/4286] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:16 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 1303 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:16.740412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-65d26132-ee38-4913-b2a8-cacac3e7d521 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:16.742601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-65d26132-ee38-4913-b2a8-cacac3e7d521 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: d71b6372-bc4a-4ef7-8d48-13552970f9cf] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:16.945223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-37602ee7-733a-48fb-8281-49df1a30f666 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:16.964840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65d26132-ee38-4913-b2a8-cacac3e7d521 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:16.980900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65d26132-ee38-4913-b2a8-cacac3e7d521 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:16.981545 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-37602ee7-733a-48fb-8281-49df1a30f666 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1293 microversion: 2.1 time: 0.608793 May 19 04:49:16.982274 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2099/4287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:16 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1293 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:16.986699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65d26132-ee38-4913-b2a8-cacac3e7d521 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:16.990939 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-65d26132-ee38-4913-b2a8-cacac3e7d521 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf" status: 200 len: 1277 microversion: 2.47 time: 0.266272 May 19 04:49:16.992022 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2189/4288] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:16 2022] GET /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf => generated 1277 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:17.011290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1948003887", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "81db7320-40b5-42ac-aa1c-5de5a86ce20d"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:17.043060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-185d53f3-8bab-45e0-9886-0cdc86322402 req-ea164403-59bf-48f0-ba8d-e86d1fc2ec18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b5a7a27-6877-43f8-ba74-86a11b5716d9", "name": "network-vif-plugged", "status": "completed", "tag": "f9cb6a4c-03c3-4e21-87b1-a1be46107fe4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:17.115416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-185d53f3-8bab-45e0-9886-0cdc86322402 req-ea164403-59bf-48f0-ba8d-e86d1fc2ec18 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:17.120567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-185d53f3-8bab-45e0-9886-0cdc86322402 req-ea164403-59bf-48f0-ba8d-e86d1fc2ec18 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:17.185261 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-185d53f3-8bab-45e0-9886-0cdc86322402 req-ea164403-59bf-48f0-ba8d-e86d1fc2ec18 service nova] Creating event network-vif-plugged:f9cb6a4c-03c3-4e21-87b1-a1be46107fe4 for instance 9b5a7a27-6877-43f8-ba74-86a11b5716d9 on n-h2-766726-30 May 19 04:49:17.217770 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-185d53f3-8bab-45e0-9886-0cdc86322402 req-ea164403-59bf-48f0-ba8d-e86d1fc2ec18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195954 May 19 04:49:17.234582 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2190/4289] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:17.258550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-78525848-ee84-4f77-b44d-29dacabc789e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:17.276442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] validate_networks() for [('81db7320-40b5-42ac-aa1c-5de5a86ce20d', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:49:17.286496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-78525848-ee84-4f77-b44d-29dacabc789e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:17.319583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78525848-ee84-4f77-b44d-29dacabc789e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:17.320359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78525848-ee84-4f77-b44d-29dacabc789e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:17.321481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78525848-ee84-4f77-b44d-29dacabc789e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:17.336263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78525848-ee84-4f77-b44d-29dacabc789e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:18.562251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-78525848-ee84-4f77-b44d-29dacabc789e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:18.575331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-78525848-ee84-4f77-b44d-29dacabc789e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 1.335746 May 19 04:49:18.576228 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2191/4290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:17 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:18.581107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1477659624", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": "none"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:18.716022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:49:18.716460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:49:18.716945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:49:18.717385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:49:18.717860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:49:18.725790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:18.742607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:18.742980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:18.746297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:18.746667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:18.798988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Getting quotas for project b7e29769f77f42fabcb6056a07149ba0. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:49:18.813624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:49:18.814166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:49:18.814528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:49:18.814950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:49:18.815383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:49:18.819902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Getting quotas for user 269367cad82c4fe2a3b7591933002b97 and project b7e29769f77f42fabcb6056a07149ba0. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:49:18.851990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:18.852450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:18.853369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:18.853811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:18.885414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=13 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:18.888159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:49:18.890533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:49:18.939334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:49:18.959871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for user 87d19ae04b1d4f0e9e23872d9c2cd0a4 and project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:49:18.986248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:49:18.995509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:49:19.011463 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dba5b604-ee1d-4d43-8419-e2f567115aaf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.433900 May 19 04:49:19.017815 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2192/4291] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:49:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 04:49:19.028742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:19.031539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] [instance: 20d448c0-def8-4eaa-8319-83c9df1fc5f0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:19.046855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:19.074419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:19.075331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:19.076383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:19.077013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:19.151850 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] HTTP exception thrown: Instance 20d448c0-def8-4eaa-8319-83c9df1fc5f0 could not be found. May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Request method failure captured: May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 HTTP/1.1 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwt0WvuqFf_F1Z43JljWQ75_LeXQSfKBI2iYqk6If4VTOUDTo8pPJROwZDwQQTu-01ZZRld9i-QxdK_xq-qHwDGmSAHyZDTAL_dYHy7vUeYIp2jMuSs6BVhGmg8hxyLvZ6KIL9xcuLzvPajeYXBwGWam1ohE07lKziKr1Pn71P-Hic May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 2820289ee7114dedab8f6019584bf920 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TenantUsagesTestJSON-1177811102 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2820289ee7114dedab8f6019584bf920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2820289ee7114dedab8f6019584bf920"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2820289ee7114dedab8f6019584bf920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2820289ee7114dedab8f6019584bf920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TenantUsagesTestJSON-1177811102 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 2820289ee7114dedab8f6019584bf920 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1177811102 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TenantUsagesTestJSON-1177811102-project May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d5a98ed076094cc7ba41347094d56750 May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TenantUsagesTestJSON-1177811102-project May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 20d448c0-def8-4eaa-8319-83c9df1fc5f0 could not be found. May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '20d448c0-def8-4eaa-8319-83c9df1fc5f0'} May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d448c0-def8-4eaa-8319-83c9df1fc5f0 could not be found. May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d448c0-def8-4eaa-8319-83c9df1fc5f0 could not be found. May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:19.169642 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:19.175614 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:19.175614 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:19.175614 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:19.175614 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:19.175614 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:19.175614 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d448c0-def8-4eaa-8319-83c9df1fc5f0 could not be found. May 19 04:49:19.175614 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:19.175614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] Returning 404 to user: Instance 20d448c0-def8-4eaa-8319-83c9df1fc5f0 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:19.175614 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-625d95d5-7c76-475c-8238-c0f17e52cab3 tempest-TenantUsagesTestJSON-1177811102 tempest-TenantUsagesTestJSON-1177811102-project] 10.222.0.58 "GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0" status: 404 len: 111 microversion: 2.1 time: 0.146585 May 19 04:49:19.184928 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2193/4292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:19 2022] GET /compute/v2.1/servers/20d448c0-def8-4eaa-8319-83c9df1fc5f0 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:49:19.192678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03fa1e3b-96dd-46fa-9c54-1740ddfade24 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:19.253909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-03fa1e3b-96dd-46fa-9c54-1740ddfade24 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:19.273790 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f9a82bdb-c02d-4b6d-b6f5-0c39a0680a91 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.277033 May 19 04:49:19.278620 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2100/4293] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:49:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:49:19.335280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03fa1e3b-96dd-46fa-9c54-1740ddfade24 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:19.335781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03fa1e3b-96dd-46fa-9c54-1740ddfade24 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:19.336595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03fa1e3b-96dd-46fa-9c54-1740ddfade24 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:19.343581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03fa1e3b-96dd-46fa-9c54-1740ddfade24 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:19.368808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0bda7b4e-56b3-424d-8700-f35eb82839e7 req-dc7d6651-095c-46bb-8945-5a0fd132a4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "894769ad-4295-4aff-8ba0-30957e6ec8da", "tag": "738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:19.410965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0bda7b4e-56b3-424d-8700-f35eb82839e7 req-dc7d6651-095c-46bb-8945-5a0fd132a4c9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:19.417151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0bda7b4e-56b3-424d-8700-f35eb82839e7 req-dc7d6651-095c-46bb-8945-5a0fd132a4c9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:19.453418 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0bda7b4e-56b3-424d-8700-f35eb82839e7 req-dc7d6651-095c-46bb-8945-5a0fd132a4c9 service nova] Creating event network-changed:738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4 for instance 894769ad-4295-4aff-8ba0-30957e6ec8da on n-h1-766726-30 May 19 04:49:19.512093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0bda7b4e-56b3-424d-8700-f35eb82839e7 req-dc7d6651-095c-46bb-8945-5a0fd132a4c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173691 May 19 04:49:19.516160 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2101/4294] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:19.555375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66829120-1d45-4e22-bc9f-98f60bcaf2db tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:19.559274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-66829120-1d45-4e22-bc9f-98f60bcaf2db tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:19.773578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03fa1e3b-96dd-46fa-9c54-1740ddfade24 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:19.788450 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-03fa1e3b-96dd-46fa-9c54-1740ddfade24 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1293 microversion: 2.1 time: 0.601909 May 19 04:49:19.794953 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2194/4295] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:19 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1293 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:19.797063 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-66829120-1d45-4e22-bc9f-98f60bcaf2db tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "PUT /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 992 microversion: 2.47 time: 0.272570 May 19 04:49:19.802025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc83cf5c-6acc-4751-a0c2-52a6cc71adc0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:19.802773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bc83cf5c-6acc-4751-a0c2-52a6cc71adc0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:19.806978 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2102/4296] 10.222.0.58 () {62 vars in 1296 bytes} [Thu May 19 04:49:19 2022] PUT /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 992 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:49:19.824582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c53a580a-ca70-4009-9d06-2ea53dc46bc2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:19.847453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c53a580a-ca70-4009-9d06-2ea53dc46bc2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:19.893796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c53a580a-ca70-4009-9d06-2ea53dc46bc2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:19.915138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c53a580a-ca70-4009-9d06-2ea53dc46bc2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:19.916481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c53a580a-ca70-4009-9d06-2ea53dc46bc2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:19.923169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c53a580a-ca70-4009-9d06-2ea53dc46bc2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:19.968781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bc83cf5c-6acc-4751-a0c2-52a6cc71adc0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:19.977679 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bc83cf5c-6acc-4751-a0c2-52a6cc71adc0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1215 microversion: 2.1 time: 0.180615 May 19 04:49:19.986112 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2195/4297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:19 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:20.014193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-97b64d3e-ae6b-49be-ab60-1a64fabd2999 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:20.014734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-97b64d3e-ae6b-49be-ab60-1a64fabd2999 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:21.245027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-97b64d3e-ae6b-49be-ab60-1a64fabd2999 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:21.277100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-97b64d3e-ae6b-49be-ab60-1a64fabd2999 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:21.278634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-97b64d3e-ae6b-49be-ab60-1a64fabd2999 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:21.279820 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-97b64d3e-ae6b-49be-ab60-1a64fabd2999 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1278 microversion: 2.47 time: 1.292462 May 19 04:49:21.297723 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2196/4298] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:19 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1278 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:21.312797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e7ff6bae-1529-4e1f-bfad-3a738412f3f0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:21.313465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e7ff6bae-1529-4e1f-bfad-3a738412f3f0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:21.335028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7ff6bae-1529-4e1f-bfad-3a738412f3f0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:21.335028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7ff6bae-1529-4e1f-bfad-3a738412f3f0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:21.335741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7ff6bae-1529-4e1f-bfad-3a738412f3f0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:21.336192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7ff6bae-1529-4e1f-bfad-3a738412f3f0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:21.472657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c53a580a-ca70-4009-9d06-2ea53dc46bc2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:21.485796 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c53a580a-ca70-4009-9d06-2ea53dc46bc2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 1.673735 May 19 04:49:21.490202 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2103/4299] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:19 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:21.521857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8369d012-f900-40cf-85fb-f91798529e40 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:21.531197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8369d012-f900-40cf-85fb-f91798529e40 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:21.562465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8369d012-f900-40cf-85fb-f91798529e40 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:21.566191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8369d012-f900-40cf-85fb-f91798529e40 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:21.569204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8369d012-f900-40cf-85fb-f91798529e40 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:21.569873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8369d012-f900-40cf-85fb-f91798529e40 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:21.804814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8369d012-f900-40cf-85fb-f91798529e40 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:21.828187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8369d012-f900-40cf-85fb-f91798529e40 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1211 microversion: 2.1 time: 0.318860 May 19 04:49:21.829875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e7ff6bae-1529-4e1f-bfad-3a738412f3f0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:21.836177 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2104/4300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:21 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1211 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:21.843977 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e7ff6bae-1529-4e1f-bfad-3a738412f3f0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1474 microversion: 2.1 time: 0.551461 May 19 04:49:21.857112 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2197/4301] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:21 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1474 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:22.145295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-855907713", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:22.300454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] validate_networks() for [('3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:49:22.310634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:22.311468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:22.346880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:22.356534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:22.358826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:22.362636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:22.607784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:22.622415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:22.624667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:22.626633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-701bac81-227a-4204-ba73-d13a0458360b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1330 microversion: 2.47 time: 0.321647 May 19 04:49:22.627753 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2198/4302] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:22 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1330 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:49:22.632755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef81120a-e648-4d62-8571-dcf47ea0b5ce tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:22.633709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef81120a-e648-4d62-8571-dcf47ea0b5ce tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:22.641499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef81120a-e648-4d62-8571-dcf47ea0b5ce tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:22.642349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef81120a-e648-4d62-8571-dcf47ea0b5ce tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:22.643466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef81120a-e648-4d62-8571-dcf47ea0b5ce tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:22.644157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef81120a-e648-4d62-8571-dcf47ea0b5ce tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:23.615977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ef81120a-e648-4d62-8571-dcf47ea0b5ce tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:23.626970 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef81120a-e648-4d62-8571-dcf47ea0b5ce tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 0.997378 May 19 04:49:23.627579 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2199/4303] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:22 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:23.643956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a0e6e4ce-4a75-41db-8fe4-a87f68fb10cd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:23.645146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a0e6e4ce-4a75-41db-8fe4-a87f68fb10cd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:23.657725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0e6e4ce-4a75-41db-8fe4-a87f68fb10cd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:23.659510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0e6e4ce-4a75-41db-8fe4-a87f68fb10cd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:23.661983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0e6e4ce-4a75-41db-8fe4-a87f68fb10cd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:23.662616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a0e6e4ce-4a75-41db-8fe4-a87f68fb10cd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.174460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:49:24.175554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:49:24.176380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:49:24.176966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:49:24.177579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:49:24.178449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a0e6e4ce-4a75-41db-8fe4-a87f68fb10cd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:24.195139 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a0e6e4ce-4a75-41db-8fe4-a87f68fb10cd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1267 microversion: 2.1 time: 0.563053 May 19 04:49:24.195763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.197388 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2200/4304] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:23 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1267 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:24.204716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:24.205656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:24.205840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.208410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.214285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.215598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.216598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.216990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.217502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.262917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:49:24.273535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for user a75cb8e84f674ef0814a39d2a4887933 and project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:49:24.300274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:49:24.303542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 0926a84c-907d-415f-af1d-ae2ac52f6778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:49:24.361027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:24.378357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:24.383414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:24.389630 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-55eddd18-fa5f-4517-bccf-0990d01c95ff tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1336 microversion: 2.47 time: 0.189197 May 19 04:49:24.391598 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2201/4305] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:24 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1336 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:24.456586 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3419b17c-b4b6-421a-aeb3-6d5d35aa6afd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.318622 May 19 04:49:24.457575 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2105/4306] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:49:24.474637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-07ab793c-8ffa-4adb-9fef-dc40654e5e3b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:24.475302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-07ab793c-8ffa-4adb-9fef-dc40654e5e3b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 0926a84c-907d-415f-af1d-ae2ac52f6778] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:24.513652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-07ab793c-8ffa-4adb-9fef-dc40654e5e3b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 0926a84c-907d-415f-af1d-ae2ac52f6778] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:49:24.540798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:24.541567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:24.551750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.552524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.557993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.558669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.597854 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 HTTP/1.1 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '7e865dff-7659-43e8-8069-81e6760080d7'} May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:24.599727 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.604309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:24.614076 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4258e42-9319-48e5-8894-e2e03fa2ec05 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 404 len: 111 microversion: 2.1 time: 0.064563 May 19 04:49:24.614740 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2106/4307] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:49:24 2022] DELETE /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:49:24.632077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:24.632548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] [instance: 7e865dff-7659-43e8-8069-81e6760080d7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:24.660850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.661345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.662140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.662587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.729395 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] HTTP exception thrown: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Request method failure captured: May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 HTTP/1.1 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcpud7OaerUvtBlrimQMnXksWQIbqzwGZUNt61EtCbZzTs79q4pLAntaIjGhSd8O44kE4opkSNef78GAJY1D00OmwZ6SqE8kgIg3Y6ARz4My-buK-uUeyEn-dhaF7TgClpvEmIwlNCvD5kHIxjBCJOf0rdVRyUUqXVHxwdr5U3NDxX4 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0db6b7171e3b4a2db160855939246a40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0db6b7171e3b4a2db160855939246a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 0db6b7171e3b4a2db160855939246a40 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358320234 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a651109c72e84cab9e712ad5fbd002b6 May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeNegativeTest-1358320234-project May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '7e865dff-7659-43e8-8069-81e6760080d7'} May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:24.735786 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.740683 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:24.740683 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:24.740683 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:24.740683 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:24.740683 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:24.740683 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. May 19 04:49:24.740683 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:24.740683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] Returning 404 to user: Instance 7e865dff-7659-43e8-8069-81e6760080d7 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:24.740683 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d0408033-83be-4b2e-b2da-4c6be6f9d518 tempest-AttachVolumeNegativeTest-1358320234 tempest-AttachVolumeNegativeTest-1358320234-project] 10.222.0.58 "GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7" status: 404 len: 111 microversion: 2.1 time: 0.112777 May 19 04:49:24.751521 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2107/4308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:24 2022] GET /compute/v2.1/servers/7e865dff-7659-43e8-8069-81e6760080d7 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:49:24.756864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2a709d8-ccb4-4835-a9d1-7b6234eed6e7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:24.773437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e2a709d8-ccb4-4835-a9d1-7b6234eed6e7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:24.803734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2a709d8-ccb4-4835-a9d1-7b6234eed6e7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.804255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2a709d8-ccb4-4835-a9d1-7b6234eed6e7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:24.805126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2a709d8-ccb4-4835-a9d1-7b6234eed6e7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:24.806126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2a709d8-ccb4-4835-a9d1-7b6234eed6e7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:25.269724 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.scheduler.client.report [None req-07ab793c-8ffa-4adb-9fef-dc40654e5e3b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Deleted allocations for instance 0926a84c-907d-415f-af1d-ae2ac52f6778 May 19 04:49:25.278157 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-07ab793c-8ffa-4adb-9fef-dc40654e5e3b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 0926a84c-907d-415f-af1d-ae2ac52f6778] Instance Mapping does not exist while attempting local delete cleanup. May 19 04:49:25.281658 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-07ab793c-8ffa-4adb-9fef-dc40654e5e3b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778" status: 204 len: 0 microversion: 2.1 time: 0.817550 May 19 04:49:25.287865 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2202/4309] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:49:24 2022] DELETE /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:49:25.312200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e1ba9f6-60ac-4809-ae7f-364866fc56bd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:25.312888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9e1ba9f6-60ac-4809-ae7f-364866fc56bd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:25.347082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e1ba9f6-60ac-4809-ae7f-364866fc56bd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:25.347542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e1ba9f6-60ac-4809-ae7f-364866fc56bd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:25.353313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e1ba9f6-60ac-4809-ae7f-364866fc56bd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:25.354777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e1ba9f6-60ac-4809-ae7f-364866fc56bd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:25.674438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9e1ba9f6-60ac-4809-ae7f-364866fc56bd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:25.693479 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e1ba9f6-60ac-4809-ae7f-364866fc56bd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1273 microversion: 2.1 time: 0.398730 May 19 04:49:25.695808 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2203/4310] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:25 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1273 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:25.709663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5fa44f41-a753-4bb0-aea3-5eb3404901b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:25.716857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5fa44f41-a753-4bb0-aea3-5eb3404901b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 0926a84c-907d-415f-af1d-ae2ac52f6778] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:25.738160 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-5fa44f41-a753-4bb0-aea3-5eb3404901b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5fa44f41-a753-4bb0-aea3-5eb3404901b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778 HTTP/1.1 May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '0926a84c-907d-415f-af1d-ae2ac52f6778'} May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:25.744551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:25.751286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:25.751286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:25.751286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:49:25.751286 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:25.754803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5fa44f41-a753-4bb0-aea3-5eb3404901b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:25.760917 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5fa44f41-a753-4bb0-aea3-5eb3404901b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778" status: 404 len: 111 microversion: 2.1 time: 0.060458 May 19 04:49:25.764230 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2204/4311] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:25 2022] GET /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:49:25.797560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:25.800882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:25.828243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:25.839735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:25.847836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:25.848752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:25.849357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e2a709d8-ccb4-4835-a9d1-7b6234eed6e7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:25.879700 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2a709d8-ccb4-4835-a9d1-7b6234eed6e7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 1.120807 May 19 04:49:25.880384 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2108/4312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:24 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:25.900125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:26.013385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-878794056", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:26.078778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:26.091629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:26.095160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:26.110527 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82293067-bcdb-4d91-a844-6ba088bf9afb tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1336 microversion: 2.47 time: 0.328893 May 19 04:49:26.111406 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2205/4313] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:25 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1336 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:26.131690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] validate_networks() for [('3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:49:26.718959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d862567-b988-4b63-9d8b-95c603585297 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:26.719571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d862567-b988-4b63-9d8b-95c603585297 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:26.746677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d862567-b988-4b63-9d8b-95c603585297 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:26.747138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d862567-b988-4b63-9d8b-95c603585297 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:26.747940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d862567-b988-4b63-9d8b-95c603585297 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:26.748393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d862567-b988-4b63-9d8b-95c603585297 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:27.521740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:49:27.522882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:49:27.523622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:49:27.524764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:49:27.530189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:49:27.566128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:27.568423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:27.574424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:27.577345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:27.614311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0d862567-b988-4b63-9d8b-95c603585297 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:27.624987 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d862567-b988-4b63-9d8b-95c603585297 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1315 microversion: 2.1 time: 0.917194 May 19 04:49:27.629418 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2206/4314] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:26 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:27.643129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da8f5ca4-0fb6-461a-88fe-ecc243ba5bb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:27.645052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da8f5ca4-0fb6-461a-88fe-ecc243ba5bb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:27.655721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:49:27.671109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for user a75cb8e84f674ef0814a39d2a4887933 and project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:49:27.674798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da8f5ca4-0fb6-461a-88fe-ecc243ba5bb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:27.677853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da8f5ca4-0fb6-461a-88fe-ecc243ba5bb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:27.680265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da8f5ca4-0fb6-461a-88fe-ecc243ba5bb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:27.683020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da8f5ca4-0fb6-461a-88fe-ecc243ba5bb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:27.698846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:49:27.704578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:49:27.834204 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ba8897d3-24bc-4805-8a8e-22b98cdb871a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824548 May 19 04:49:27.843106 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2109/4315] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:49:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:49:27.869984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:27.871025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:27.896900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:27.897778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:27.898785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:27.901583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:28.077692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-da8f5ca4-0fb6-461a-88fe-ecc243ba5bb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:28.094055 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da8f5ca4-0fb6-461a-88fe-ecc243ba5bb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 0.461772 May 19 04:49:28.095836 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2207/4316] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:27 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:28.109403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-32d421c7-26a3-4463-8cb6-6133a55165bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:28.110861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-32d421c7-26a3-4463-8cb6-6133a55165bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:28.170806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:28.201423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:28.203047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:28.207203 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed72f30b-1587-4088-abdf-4d4aa6dfcb73 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1357 microversion: 2.47 time: 0.362595 May 19 04:49:28.209868 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2110/4317] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:27 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1357 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:28.230119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:28.241458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:28.269998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:28.284358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:28.285926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:28.294080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:28.306616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32d421c7-26a3-4463-8cb6-6133a55165bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:28.316070 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-32d421c7-26a3-4463-8cb6-6133a55165bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1220 microversion: 2.1 time: 0.217244 May 19 04:49:28.319406 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2208/4318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:28 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1220 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:28.501777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:49:28.504936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:49:28.505737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:49:28.506355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:49:28.507147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:49:28.638398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:28.644380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fd156847-b28b-4860-8c15-b6e50396065b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:28.645274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fd156847-b28b-4860-8c15-b6e50396065b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:28.654368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:28.654765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:28.655600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:28.656043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:28.661583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd156847-b28b-4860-8c15-b6e50396065b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:28.666213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd156847-b28b-4860-8c15-b6e50396065b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:28.667199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd156847-b28b-4860-8c15-b6e50396065b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:28.668028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd156847-b28b-4860-8c15-b6e50396065b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:28.721213 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-36dd441a-81c7-48ad-a238-87cf78efc2bd tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "POST /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964/action" status: 202 len: 1079 microversion: 2.47 time: 0.495011 May 19 04:49:28.723646 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2111/4319] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:49:28 2022] POST /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964/action => generated 1079 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 19 04:49:28.738865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:28.739802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:28.749875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:28.752952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:28.754181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:28.754906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:28.798258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:28.819515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:28.986002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:29.000354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:29.004269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:29.008039 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-000e3b34-ff4c-483f-8c02-02160173301d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.273439 May 19 04:49:29.010905 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2112/4320] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:28 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:49:29.112729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da0301f6-85b8-47ce-8a00-4bd6b7663034 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:29.113394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da0301f6-85b8-47ce-8a00-4bd6b7663034 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:29.126149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da0301f6-85b8-47ce-8a00-4bd6b7663034 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:29.126149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da0301f6-85b8-47ce-8a00-4bd6b7663034 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:29.126829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da0301f6-85b8-47ce-8a00-4bd6b7663034 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:29.127386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da0301f6-85b8-47ce-8a00-4bd6b7663034 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:29.227986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fd156847-b28b-4860-8c15-b6e50396065b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:29.251386 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fd156847-b28b-4860-8c15-b6e50396065b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1315 microversion: 2.1 time: 0.610968 May 19 04:49:29.252302 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2209/4321] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:28 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:29.376740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ccb2d944-dc04-44f6-bfee-cba669cc5633 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:29.377662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ccb2d944-dc04-44f6-bfee-cba669cc5633 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:29.400359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ccb2d944-dc04-44f6-bfee-cba669cc5633 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:29.403136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ccb2d944-dc04-44f6-bfee-cba669cc5633 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:29.404194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ccb2d944-dc04-44f6-bfee-cba669cc5633 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:29.404758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ccb2d944-dc04-44f6-bfee-cba669cc5633 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:29.441529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da0301f6-85b8-47ce-8a00-4bd6b7663034 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:29.451738 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da0301f6-85b8-47ce-8a00-4bd6b7663034 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 0.344749 May 19 04:49:29.452976 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2113/4322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:29 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:29.600026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ccb2d944-dc04-44f6-bfee-cba669cc5633 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:29.609774 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ccb2d944-dc04-44f6-bfee-cba669cc5633 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1224 microversion: 2.1 time: 0.276203 May 19 04:49:29.620379 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2210/4323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:29 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1224 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:30.029430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:30.030579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:30.042546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:30.043732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:30.046641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:30.049890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:30.240748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:30.271586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:30.277823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:30.282036 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-50939956-a3c9-48fa-966f-45b4b0559543 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.258343 May 19 04:49:30.283805 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2114/4324] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:30 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:30.339104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db15c100-6c3f-46cd-b627-247d7fd087b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:30.339889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-db15c100-6c3f-46cd-b627-247d7fd087b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:30.361636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db15c100-6c3f-46cd-b627-247d7fd087b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:30.362858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db15c100-6c3f-46cd-b627-247d7fd087b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:30.367028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db15c100-6c3f-46cd-b627-247d7fd087b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:30.371188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db15c100-6c3f-46cd-b627-247d7fd087b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:30.474720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-633f5c52-f17d-45d8-8506-ef442cf749b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:30.475831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-633f5c52-f17d-45d8-8506-ef442cf749b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:30.489409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-633f5c52-f17d-45d8-8506-ef442cf749b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:30.506090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-633f5c52-f17d-45d8-8506-ef442cf749b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:30.510266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-633f5c52-f17d-45d8-8506-ef442cf749b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:30.513490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-633f5c52-f17d-45d8-8506-ef442cf749b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:32.044299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-633f5c52-f17d-45d8-8506-ef442cf749b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:32.054252 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-633f5c52-f17d-45d8-8506-ef442cf749b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 1.584490 May 19 04:49:32.057778 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2115/4325] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:30 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:32.070418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c333465-3e2d-4ef8-8992-a1e2f4a1168d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:32.074888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c333465-3e2d-4ef8-8992-a1e2f4a1168d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:32.090555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c333465-3e2d-4ef8-8992-a1e2f4a1168d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:32.091305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c333465-3e2d-4ef8-8992-a1e2f4a1168d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:32.092444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c333465-3e2d-4ef8-8992-a1e2f4a1168d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:32.093173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c333465-3e2d-4ef8-8992-a1e2f4a1168d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:32.355337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-db15c100-6c3f-46cd-b627-247d7fd087b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:32.372404 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-db15c100-6c3f-46cd-b627-247d7fd087b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1315 microversion: 2.1 time: 2.039023 May 19 04:49:32.373303 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2211/4326] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:30 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1315 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:32.387171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2b076ba1-fec8-453e-9375-7e7b2705d797 req-9701bfa5-0d02-419f-b032-ee83af327361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bd7ce2-12b8-4198-a5c2-9b68fe7c9732", "tag": "58124628-f4db-49df-91e7-d61322a39a88"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:32.400693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2b076ba1-fec8-453e-9375-7e7b2705d797 req-9701bfa5-0d02-419f-b032-ee83af327361 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:32.402100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2b076ba1-fec8-453e-9375-7e7b2705d797 req-9701bfa5-0d02-419f-b032-ee83af327361 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:32.428976 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2b076ba1-fec8-453e-9375-7e7b2705d797 req-9701bfa5-0d02-419f-b032-ee83af327361 service nova] Creating event network-changed:58124628-f4db-49df-91e7-d61322a39a88 for instance 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 on n-h1-766726-30 May 19 04:49:32.444623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1c333465-3e2d-4ef8-8992-a1e2f4a1168d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:32.451120 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2b076ba1-fec8-453e-9375-7e7b2705d797 req-9701bfa5-0d02-419f-b032-ee83af327361 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067650 May 19 04:49:32.459057 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2212/4327] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:32.460559 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c333465-3e2d-4ef8-8992-a1e2f4a1168d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1278 microversion: 2.1 time: 0.396809 May 19 04:49:32.464116 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2116/4328] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:32 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1278 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:32.480825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:32.481944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:32.492258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:32.493336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:32.494657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:32.496170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:32.654472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:32.670782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:32.672587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:32.676904 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa06e847-bf75-4d24-a85d-96d754de81f1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.214960 May 19 04:49:32.682119 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2213/4329] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:32 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:33.075024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-15b04151-87d0-4224-a220-101cd31486e1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:33.076481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-15b04151-87d0-4224-a220-101cd31486e1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:33.088347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15b04151-87d0-4224-a220-101cd31486e1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:33.097164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15b04151-87d0-4224-a220-101cd31486e1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:33.101032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15b04151-87d0-4224-a220-101cd31486e1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:33.104431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15b04151-87d0-4224-a220-101cd31486e1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:33.391057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-87bc6ddb-454f-4f5c-914f-5ed5e25065d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:33.398146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-87bc6ddb-454f-4f5c-914f-5ed5e25065d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:33.420487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87bc6ddb-454f-4f5c-914f-5ed5e25065d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:33.421339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87bc6ddb-454f-4f5c-914f-5ed5e25065d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:33.424030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87bc6ddb-454f-4f5c-914f-5ed5e25065d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:33.426918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87bc6ddb-454f-4f5c-914f-5ed5e25065d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:33.494035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-15b04151-87d0-4224-a220-101cd31486e1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:33.513658 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-15b04151-87d0-4224-a220-101cd31486e1 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 0.437480 May 19 04:49:33.514303 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2117/4330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:33 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:33.519308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4147c57b-bca0-43c6-914b-1abc6dbafb7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:33.519915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4147c57b-bca0-43c6-914b-1abc6dbafb7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:33.543393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4147c57b-bca0-43c6-914b-1abc6dbafb7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:33.547076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4147c57b-bca0-43c6-914b-1abc6dbafb7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:33.548276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4147c57b-bca0-43c6-914b-1abc6dbafb7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:33.552243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4147c57b-bca0-43c6-914b-1abc6dbafb7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:33.845345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4147c57b-bca0-43c6-914b-1abc6dbafb7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:33.857962 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4147c57b-bca0-43c6-914b-1abc6dbafb7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1278 microversion: 2.1 time: 0.342299 May 19 04:49:33.867396 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2118/4331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:33 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1278 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:33.871002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:33.881251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:33.897998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:33.898597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:33.900040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:33.907412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:34.132088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:34.147418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:34.149754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:34.155768 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-83ccbe6a-e22c-4810-be80-7bac17fbb18e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.294713 May 19 04:49:34.157721 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2119/4332] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:33 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:34.531312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e9a3997e-3b59-4198-afde-9f9f2a636ac4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:34.532421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e9a3997e-3b59-4198-afde-9f9f2a636ac4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:34.552061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9a3997e-3b59-4198-afde-9f9f2a636ac4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:34.552695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9a3997e-3b59-4198-afde-9f9f2a636ac4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:34.554028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9a3997e-3b59-4198-afde-9f9f2a636ac4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:34.554579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9a3997e-3b59-4198-afde-9f9f2a636ac4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:34.571944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87bc6ddb-454f-4f5c-914f-5ed5e25065d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:34.585659 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-87bc6ddb-454f-4f5c-914f-5ed5e25065d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1315 microversion: 2.1 time: 1.197592 May 19 04:49:34.590306 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2214/4333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:33 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1315 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:34.882132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dd21a558-b371-47a3-89ef-d25b00d21380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:34.883465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dd21a558-b371-47a3-89ef-d25b00d21380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:34.914448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd21a558-b371-47a3-89ef-d25b00d21380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:34.918022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd21a558-b371-47a3-89ef-d25b00d21380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:34.921107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd21a558-b371-47a3-89ef-d25b00d21380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:34.924460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd21a558-b371-47a3-89ef-d25b00d21380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:35.419590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e9a3997e-3b59-4198-afde-9f9f2a636ac4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:35.437195 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e9a3997e-3b59-4198-afde-9f9f2a636ac4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 0.905899 May 19 04:49:35.438351 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2120/4334] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:34 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:35.447589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:35.452539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:35.459356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:35.464045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:35.466669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:35.470461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:35.632606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:35.645709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:35.650307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:35.654537 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-68493aa8-03fc-450f-a3f9-7a497916e142 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.215031 May 19 04:49:35.658617 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2121/4335] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:35 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:35.668043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8e6e3b1-3510-41d7-953d-6f809652c903 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:35.674101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f8e6e3b1-3510-41d7-953d-6f809652c903 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:35.685104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8e6e3b1-3510-41d7-953d-6f809652c903 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:35.686118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8e6e3b1-3510-41d7-953d-6f809652c903 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:35.687163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8e6e3b1-3510-41d7-953d-6f809652c903 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:35.687849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8e6e3b1-3510-41d7-953d-6f809652c903 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:36.181839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dd21a558-b371-47a3-89ef-d25b00d21380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:36.191623 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dd21a558-b371-47a3-89ef-d25b00d21380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1320 microversion: 2.1 time: 1.320166 May 19 04:49:36.198454 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2215/4336] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:34 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1320 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:36.454927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48f5d729-983b-4550-9c24-21b69e5e2c44 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:36.455930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48f5d729-983b-4550-9c24-21b69e5e2c44 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:36.472446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48f5d729-983b-4550-9c24-21b69e5e2c44 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:36.480873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48f5d729-983b-4550-9c24-21b69e5e2c44 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:36.485874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48f5d729-983b-4550-9c24-21b69e5e2c44 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:36.487382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48f5d729-983b-4550-9c24-21b69e5e2c44 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:37.058657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f8e6e3b1-3510-41d7-953d-6f809652c903 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:37.076104 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f8e6e3b1-3510-41d7-953d-6f809652c903 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1315 microversion: 2.1 time: 1.415051 May 19 04:49:37.079234 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2122/4337] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:35 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1315 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:37.092507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:37.107191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:37.167723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:37.168615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:37.183048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:37.183760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:37.215878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-48f5d729-983b-4550-9c24-21b69e5e2c44 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:37.235464 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48f5d729-983b-4550-9c24-21b69e5e2c44 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 0.784168 May 19 04:49:37.251107 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2216/4338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:36 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:37.264269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-545ad910-e98f-46c0-9211-dcfb39f1db02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:37.279375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-545ad910-e98f-46c0-9211-dcfb39f1db02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:37.297867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-545ad910-e98f-46c0-9211-dcfb39f1db02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:37.298339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-545ad910-e98f-46c0-9211-dcfb39f1db02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:37.308223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-545ad910-e98f-46c0-9211-dcfb39f1db02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:37.308676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-545ad910-e98f-46c0-9211-dcfb39f1db02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:37.461817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:37.474681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:37.480119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:37.483128 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-84854ff3-9db1-4da8-ba0e-a00c5c0d0e9a tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.400811 May 19 04:49:37.483727 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2123/4339] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:37 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:37.851414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-545ad910-e98f-46c0-9211-dcfb39f1db02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:37.884725 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-545ad910-e98f-46c0-9211-dcfb39f1db02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1320 microversion: 2.1 time: 0.630743 May 19 04:49:37.889341 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2217/4340] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:37 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1320 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:37.999735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2d592f99-716f-4027-abf6-5a4b806e8729 req-64336dc8-7c6f-4197-bbb6-11f38f7521bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f1f1aff-9f46-4298-b952-fe6295c42f17", "tag": "d2a6f2c2-78d2-4ad6-a869-afa4ea61b43f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:38.014223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=5 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:38.015726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=18 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:38.018969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2d592f99-716f-4027-abf6-5a4b806e8729 req-64336dc8-7c6f-4197-bbb6-11f38f7521bf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:38.020047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2d592f99-716f-4027-abf6-5a4b806e8729 req-64336dc8-7c6f-4197-bbb6-11f38f7521bf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:38.039366 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2d592f99-716f-4027-abf6-5a4b806e8729 req-64336dc8-7c6f-4197-bbb6-11f38f7521bf service nova] Creating event network-changed:d2a6f2c2-78d2-4ad6-a869-afa4ea61b43f for instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 on n-h2-766726-30 May 19 04:49:38.045763 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2d592f99-716f-4027-abf6-5a4b806e8729 req-64336dc8-7c6f-4197-bbb6-11f38f7521bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056001 May 19 04:49:38.047744 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2124/4341] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:38.093980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ff1144d0-bcd0-4a09-a40d-6906bc0a6775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:38.094612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ff1144d0-bcd0-4a09-a40d-6906bc0a6775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:38.103476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff1144d0-bcd0-4a09-a40d-6906bc0a6775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:38.103936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff1144d0-bcd0-4a09-a40d-6906bc0a6775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:38.106690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff1144d0-bcd0-4a09-a40d-6906bc0a6775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:38.111976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff1144d0-bcd0-4a09-a40d-6906bc0a6775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:38.255305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb6f9c37-c011-43af-84b3-7e9dd9caa1e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:38.256753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fb6f9c37-c011-43af-84b3-7e9dd9caa1e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:38.282055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb6f9c37-c011-43af-84b3-7e9dd9caa1e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:38.282991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb6f9c37-c011-43af-84b3-7e9dd9caa1e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:38.285491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb6f9c37-c011-43af-84b3-7e9dd9caa1e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:38.287443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb6f9c37-c011-43af-84b3-7e9dd9caa1e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:38.316743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=22 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:39.277787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fb6f9c37-c011-43af-84b3-7e9dd9caa1e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:39.300676 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fb6f9c37-c011-43af-84b3-7e9dd9caa1e3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1526 microversion: 2.1 time: 1.050051 May 19 04:49:39.308470 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2125/4342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:38 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1526 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:39.321267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6ba1e36b-7f51-47f0-a193-a9cdbde416f9 req-2abd80c5-324a-4ba1-b847-ee98bfe6e82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd7ce2-12b8-4198-a5c2-9b68fe7c9732", "name": "network-vif-plugged", "status": "completed", "tag": "58124628-f4db-49df-91e7-d61322a39a88"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:39.329444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ff1144d0-bcd0-4a09-a40d-6906bc0a6775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:39.345550 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ff1144d0-bcd0-4a09-a40d-6906bc0a6775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1315 microversion: 2.1 time: 1.255296 May 19 04:49:39.347799 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2218/4343] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:38 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1315 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:39.361745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6ba1e36b-7f51-47f0-a193-a9cdbde416f9 req-2abd80c5-324a-4ba1-b847-ee98bfe6e82f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:39.366636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:39.367413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:39.371319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6ba1e36b-7f51-47f0-a193-a9cdbde416f9 req-2abd80c5-324a-4ba1-b847-ee98bfe6e82f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:39.380649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:39.381152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:39.382079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:39.386195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:39.406672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6ba1e36b-7f51-47f0-a193-a9cdbde416f9 req-2abd80c5-324a-4ba1-b847-ee98bfe6e82f service nova] Creating event network-vif-plugged:58124628-f4db-49df-91e7-d61322a39a88 for instance 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 on n-h1-766726-30 May 19 04:49:39.417034 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6ba1e36b-7f51-47f0-a193-a9cdbde416f9 req-2abd80c5-324a-4ba1-b847-ee98bfe6e82f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106864 May 19 04:49:39.421289 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2126/4344] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:39.433844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a2b7825e-2a6a-4ae4-bdaf-5bf8fb064380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:39.435019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a2b7825e-2a6a-4ae4-bdaf-5bf8fb064380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:39.446538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2b7825e-2a6a-4ae4-bdaf-5bf8fb064380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:39.447810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2b7825e-2a6a-4ae4-bdaf-5bf8fb064380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:39.450578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2b7825e-2a6a-4ae4-bdaf-5bf8fb064380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:39.451311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a2b7825e-2a6a-4ae4-bdaf-5bf8fb064380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:39.552024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:39.574487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:39.576749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:39.579970 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9207c979-838f-456f-b412-57984f707e54 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.228119 May 19 04:49:39.593382 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2219/4345] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:39 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:39.791940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a2b7825e-2a6a-4ae4-bdaf-5bf8fb064380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:39.803200 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a2b7825e-2a6a-4ae4-bdaf-5bf8fb064380 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1320 microversion: 2.1 time: 0.380240 May 19 04:49:39.813049 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2127/4346] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:39 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1320 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:40.325557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b197762e-a345-42a1-8773-cc4569157431 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:40.326612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b197762e-a345-42a1-8773-cc4569157431 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:40.337578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b197762e-a345-42a1-8773-cc4569157431 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:40.341987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b197762e-a345-42a1-8773-cc4569157431 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:40.343059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b197762e-a345-42a1-8773-cc4569157431 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:40.347222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b197762e-a345-42a1-8773-cc4569157431 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:40.364535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9805b33e-9565-4af6-85ac-beb52c146b32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:40.365231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9805b33e-9565-4af6-85ac-beb52c146b32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:40.381514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9805b33e-9565-4af6-85ac-beb52c146b32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:40.384050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9805b33e-9565-4af6-85ac-beb52c146b32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:40.386803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9805b33e-9565-4af6-85ac-beb52c146b32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:40.389428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9805b33e-9565-4af6-85ac-beb52c146b32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:40.675579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b197762e-a345-42a1-8773-cc4569157431 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:40.688937 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b197762e-a345-42a1-8773-cc4569157431 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1508 microversion: 2.1 time: 0.366390 May 19 04:49:40.689614 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2220/4347] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:40 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:40.697341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:40.707288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:40.722402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:40.726434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:40.729055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:40.732151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:40.746354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9805b33e-9565-4af6-85ac-beb52c146b32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:40.762127 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9805b33e-9565-4af6-85ac-beb52c146b32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1315 microversion: 2.1 time: 0.402114 May 19 04:49:40.763955 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2128/4348] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:40 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:40.819836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c644a69-0253-4a08-bd67-db6c9742e148 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:40.820859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3c644a69-0253-4a08-bd67-db6c9742e148 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:40.835661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c644a69-0253-4a08-bd67-db6c9742e148 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:40.838551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c644a69-0253-4a08-bd67-db6c9742e148 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:40.840733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c644a69-0253-4a08-bd67-db6c9742e148 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:40.841472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c644a69-0253-4a08-bd67-db6c9742e148 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:40.885946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:40.895493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:40.907215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:40.908617 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a376d424-25ed-4fa6-8efc-79fded4ca480 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.216197 May 19 04:49:40.909638 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2221/4349] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:40 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:41.219611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c644a69-0253-4a08-bd67-db6c9742e148 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:41.236188 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3c644a69-0253-4a08-bd67-db6c9742e148 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1320 microversion: 2.1 time: 0.420145 May 19 04:49:41.237055 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2129/4350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:40 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:49:41.331123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-853195de-c035-4dd9-bc94-ffbf3ec84a68 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Action: 'create', calling method: .version_select at 0x7fd314dca940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-88698698"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:41.708133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cd4d4f73-4b5e-4705-8996-1342153e6c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:41.709670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cd4d4f73-4b5e-4705-8996-1342153e6c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:41.724127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd4d4f73-4b5e-4705-8996-1342153e6c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:41.725171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd4d4f73-4b5e-4705-8996-1342153e6c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:41.734502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd4d4f73-4b5e-4705-8996-1342153e6c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:41.735178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd4d4f73-4b5e-4705-8996-1342153e6c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:41.786888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:41.866500 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-853195de-c035-4dd9-bc94-ffbf3ec84a68 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.878600 May 19 04:49:41.867132 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2222/4351] 10.222.0.58 () {60 vars in 1154 bytes} [Thu May 19 04:49:40 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 880 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 19 04:49:41.877814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8af0d4ad-3f74-4ce8-9591-7c10eab97cfd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:41.878852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8af0d4ad-3f74-4ce8-9591-7c10eab97cfd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:41.900166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8af0d4ad-3f74-4ce8-9591-7c10eab97cfd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:41.900826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8af0d4ad-3f74-4ce8-9591-7c10eab97cfd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:41.903674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8af0d4ad-3f74-4ce8-9591-7c10eab97cfd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:41.904879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8af0d4ad-3f74-4ce8-9591-7c10eab97cfd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:42.194873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cd4d4f73-4b5e-4705-8996-1342153e6c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:42.207769 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cd4d4f73-4b5e-4705-8996-1342153e6c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1508 microversion: 2.1 time: 0.502641 May 19 04:49:42.212538 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2130/4352] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:41 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:42.226028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-819df6d2-f340-413c-91fa-f1495d80e337 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314655160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:42.267858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8af0d4ad-3f74-4ce8-9591-7c10eab97cfd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:42.293232 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8af0d4ad-3f74-4ce8-9591-7c10eab97cfd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1502 microversion: 2.1 time: 0.424203 May 19 04:49:42.293947 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2223/4353] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:41 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1502 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:42.305340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:42.310847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:42.322224 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-819df6d2-f340-413c-91fa-f1495d80e337 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 200 len: 343 microversion: 2.1 time: 0.108309 May 19 04:49:42.322812 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2131/4354] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:49:42 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 343 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:42.323559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:42.324241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:42.325339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:42.326000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:42.332451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92e5beb4-c088-4214-b740-d39289188c62 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:42.333114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-92e5beb4-c088-4214-b740-d39289188c62 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:42.334992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:42.354356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92e5beb4-c088-4214-b740-d39289188c62 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:42.354818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92e5beb4-c088-4214-b740-d39289188c62 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:42.355614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92e5beb4-c088-4214-b740-d39289188c62 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:42.356057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92e5beb4-c088-4214-b740-d39289188c62 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:42.476069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:42.478685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:42.491200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:42.499443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:42.502444 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c8a4248-dcd2-4f1f-b815-16941609baf3 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.206726 May 19 04:49:42.509392 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2224/4355] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:42 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:42.517265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ec9fde5-fa0b-4501-bb79-e63470926737 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:42.518932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2ec9fde5-fa0b-4501-bb79-e63470926737 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:42.542065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ec9fde5-fa0b-4501-bb79-e63470926737 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:42.542685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ec9fde5-fa0b-4501-bb79-e63470926737 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:42.543592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ec9fde5-fa0b-4501-bb79-e63470926737 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:42.544128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ec9fde5-fa0b-4501-bb79-e63470926737 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:42.708205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-92e5beb4-c088-4214-b740-d39289188c62 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:42.734907 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92e5beb4-c088-4214-b740-d39289188c62 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1320 microversion: 2.1 time: 0.406275 May 19 04:49:42.735553 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2132/4356] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:42 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1320 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:43.228886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3f53c97-8aec-484f-842b-18dafef68df4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:43.229852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3f53c97-8aec-484f-842b-18dafef68df4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:43.242391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3f53c97-8aec-484f-842b-18dafef68df4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:43.243540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3f53c97-8aec-484f-842b-18dafef68df4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:43.250930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3f53c97-8aec-484f-842b-18dafef68df4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:43.251523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3f53c97-8aec-484f-842b-18dafef68df4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:43.470206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d3f53c97-8aec-484f-842b-18dafef68df4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:43.484479 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d3f53c97-8aec-484f-842b-18dafef68df4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1508 microversion: 2.1 time: 0.260546 May 19 04:49:43.498295 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2133/4357] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:43 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:43.503500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ec5946f4-4522-4d92-9186-3b435b973237 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd3145a69d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:43.580711 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ec5946f4-4522-4d92-9186-3b435b973237 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 200 len: 343 microversion: 2.1 time: 0.080965 May 19 04:49:43.582088 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2134/4358] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:49:43 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 343 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:43.588753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:43.589775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:43.598698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:43.599517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:43.600999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:43.602514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:43.624963 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ec9fde5-fa0b-4501-bb79-e63470926737 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 14 microversion: 2.1 time: 1.113914 May 19 04:49:43.625659 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2225/4359] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:42 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 14 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:49:43.706018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:43.722024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:43.726469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:43.730960 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c7077a8d-2c30-4e65-966d-087c8bfa8e08 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.147042 May 19 04:49:43.755195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0be5a14b-97e8-4d02-be2e-76dd782d200a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:43.755868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0be5a14b-97e8-4d02-be2e-76dd782d200a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:43.764423 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2135/4360] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:43 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:43.768096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0be5a14b-97e8-4d02-be2e-76dd782d200a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:43.768555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0be5a14b-97e8-4d02-be2e-76dd782d200a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:43.769413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0be5a14b-97e8-4d02-be2e-76dd782d200a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:43.769857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0be5a14b-97e8-4d02-be2e-76dd782d200a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:44.110343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9051a49a-fb1c-4ead-919c-80c79dc8b1c1 req-fd5a80c2-89af-4bb4-8864-1f1e4c7cd862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878aa03f-a366-4d71-b678-1c749fc143c6", "name": "network-vif-unplugged", "status": "completed", "tag": "ba6e6c22-0bce-4292-b1fd-46293b3f4ad6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:44.127634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9051a49a-fb1c-4ead-919c-80c79dc8b1c1 req-fd5a80c2-89af-4bb4-8864-1f1e4c7cd862 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:44.130797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9051a49a-fb1c-4ead-919c-80c79dc8b1c1 req-fd5a80c2-89af-4bb4-8864-1f1e4c7cd862 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:44.167790 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9051a49a-fb1c-4ead-919c-80c79dc8b1c1 req-fd5a80c2-89af-4bb4-8864-1f1e4c7cd862 service nova] Creating event network-vif-unplugged:ba6e6c22-0bce-4292-b1fd-46293b3f4ad6 for instance 878aa03f-a366-4d71-b678-1c749fc143c6 on n-h1-766726-30 May 19 04:49:44.168953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0be5a14b-97e8-4d02-be2e-76dd782d200a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:44.177056 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9051a49a-fb1c-4ead-919c-80c79dc8b1c1 req-fd5a80c2-89af-4bb4-8864-1f1e4c7cd862 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070188 May 19 04:49:44.179021 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2136/4361] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:49:44.186674 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0be5a14b-97e8-4d02-be2e-76dd782d200a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1320 microversion: 2.1 time: 0.435882 May 19 04:49:44.192431 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2226/4362] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:43 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1320 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:44.502388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b28ae0ae-5bb9-4de6-a102-9a52c700575c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:44.503108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b28ae0ae-5bb9-4de6-a102-9a52c700575c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:44.521101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b28ae0ae-5bb9-4de6-a102-9a52c700575c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:44.521556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b28ae0ae-5bb9-4de6-a102-9a52c700575c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:44.522564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b28ae0ae-5bb9-4de6-a102-9a52c700575c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:44.523183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b28ae0ae-5bb9-4de6-a102-9a52c700575c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:44.594023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e43b41bd-cda0-4958-9a7d-f64a092da081 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd31b671dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:44.678311 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e43b41bd-cda0-4958-9a7d-f64a092da081 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 200 len: 344 microversion: 2.1 time: 0.088552 May 19 04:49:44.685246 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2227/4363] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:49:44 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:49:44.697125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-07c4a3ea-6fcf-49dc-b81e-da772434060e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:44.701316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-07c4a3ea-6fcf-49dc-b81e-da772434060e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:44.726464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07c4a3ea-6fcf-49dc-b81e-da772434060e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:44.727114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07c4a3ea-6fcf-49dc-b81e-da772434060e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:44.727927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07c4a3ea-6fcf-49dc-b81e-da772434060e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:44.728373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07c4a3ea-6fcf-49dc-b81e-da772434060e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:44.781888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b28ae0ae-5bb9-4de6-a102-9a52c700575c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:44.801292 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-07c4a3ea-6fcf-49dc-b81e-da772434060e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 14 microversion: 2.1 time: 0.114652 May 19 04:49:44.802104 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2228/4364] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:44 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:49:44.807837 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b28ae0ae-5bb9-4de6-a102-9a52c700575c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1451 microversion: 2.1 time: 0.309799 May 19 04:49:44.808379 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2137/4365] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:44 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1451 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:44.827337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c81f647-72e4-4ed2-abf2-04d3fc7a97bc tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Action: 'create', calling method: .version_select at 0x7fd314e0faf0>, body: {"snapshot": {"volume_id": "2db9684d-910c-40c3-8b97-9430bce081f2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-184597528"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:44.828671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:44.829343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:44.847118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:44.847488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:44.848476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:44.849111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.028504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:45.041372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:45.043350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:45.046511 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5babf5e6-8dbf-4085-9fc2-bb5b7e450a8b tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.228162 May 19 04:49:45.049905 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2138/4366] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:44 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:45.063227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bfed74a1-384f-4036-8311-15396098ea36 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:45.065198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bfed74a1-384f-4036-8311-15396098ea36 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:45.078657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bfed74a1-384f-4036-8311-15396098ea36 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.081065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bfed74a1-384f-4036-8311-15396098ea36 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.084440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bfed74a1-384f-4036-8311-15396098ea36 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.085709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bfed74a1-384f-4036-8311-15396098ea36 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.219535 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c81f647-72e4-4ed2-abf2-04d3fc7a97bc tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.416355 May 19 04:49:45.220339 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2229/4367] 10.222.0.58 () {60 vars in 1161 bytes} [Thu May 19 04:49:44 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:45.230591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0691e318-3c36-4972-a1c9-ec71e17a8e72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:45.231997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0691e318-3c36-4972-a1c9-ec71e17a8e72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:45.241022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0691e318-3c36-4972-a1c9-ec71e17a8e72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.246300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0691e318-3c36-4972-a1c9-ec71e17a8e72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.249205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0691e318-3c36-4972-a1c9-ec71e17a8e72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.249944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0691e318-3c36-4972-a1c9-ec71e17a8e72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.361500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bfed74a1-384f-4036-8311-15396098ea36 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:45.375741 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bfed74a1-384f-4036-8311-15396098ea36 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1451 microversion: 2.1 time: 0.324480 May 19 04:49:45.379671 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2139/4368] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:45 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1451 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:45.403018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-96f7016a-cd30-42fd-943b-08141eb01bef tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd31460a3a0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:45.495616 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-96f7016a-cd30-42fd-943b-08141eb01bef tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.113735 May 19 04:49:45.496622 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2140/4369] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:45 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:45.511298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa796e3f-db95-483f-ab9f-6dcb3534c637 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd31461bb80>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:45.594553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0691e318-3c36-4972-a1c9-ec71e17a8e72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:45.615183 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0691e318-3c36-4972-a1c9-ec71e17a8e72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1320 microversion: 2.1 time: 0.393224 May 19 04:49:45.616541 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2230/4370] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:45 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1320 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:45.621931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:45.636905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:45.643561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:45.644802 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aa796e3f-db95-483f-ab9f-6dcb3534c637 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.137413 May 19 04:49:45.645703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.646901 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2141/4371] 10.222.0.58 () {58 vars in 1139 bytes} [Thu May 19 04:49:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:45.647838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.655562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.656023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.657320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d5ca6434-87b0-4577-803a-f0986ae690c2 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd3145bc1f0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:45.719661 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d5ca6434-87b0-4577-803a-f0986ae690c2 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.067034 May 19 04:49:45.720789 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2142/4372] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:45 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:45.727728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lazy-loading 'flavor' on Instance uuid 878aa03f-a366-4d71-b678-1c749fc143c6 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:49:45.756726 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Cannot 'shelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state shelved_offloaded May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action HTTP/1.1 May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 14 May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: {"shelve": {}} May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'shelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state shelved_offloaded May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6', 'body': {'shelve': {}}} May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve May 19 04:49:45.758682 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state shelved_offloaded May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state shelved_offloaded May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 409 to user: Cannot 'shelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state shelved_offloaded {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:45.763693 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b30d574-36ab-4bd0-a9b9-5c7c3d6dd0f4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 409 len: 155 microversion: 2.1 time: 0.142348 May 19 04:49:45.765424 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2231/4373] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:45 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 155 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:49:45.771783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ebf6c8c8-4776-45c7-930c-532cfbe39ea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:45.772409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ebf6c8c8-4776-45c7-930c-532cfbe39ea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:45.786668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebf6c8c8-4776-45c7-930c-532cfbe39ea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.795052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebf6c8c8-4776-45c7-930c-532cfbe39ea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.798450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebf6c8c8-4776-45c7-930c-532cfbe39ea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.799102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebf6c8c8-4776-45c7-930c-532cfbe39ea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.814230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ec18519-95c2-41f1-943d-e24d36de53f0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:45.815583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6ec18519-95c2-41f1-943d-e24d36de53f0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:45.828023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ec18519-95c2-41f1-943d-e24d36de53f0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.832124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ec18519-95c2-41f1-943d-e24d36de53f0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.834745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ec18519-95c2-41f1-943d-e24d36de53f0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:45.835434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ec18519-95c2-41f1-943d-e24d36de53f0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:45.941008 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ec18519-95c2-41f1-943d-e24d36de53f0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 14 microversion: 2.1 time: 0.132570 May 19 04:49:45.944327 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2232/4374] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:45 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:49:46.066554 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ebf6c8c8-4776-45c7-930c-532cfbe39ea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 202 len: 0 microversion: 2.1 time: 0.300884 May 19 04:49:46.069121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:46.070047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:46.072734 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2143/4375] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:45 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:49:46.090447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:46.090911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:46.091707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:46.092144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:46.095284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d4154fb1-7a49-41fa-8150-32142ab4e758 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:46.096513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d4154fb1-7a49-41fa-8150-32142ab4e758 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:46.114162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4154fb1-7a49-41fa-8150-32142ab4e758 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:46.120154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4154fb1-7a49-41fa-8150-32142ab4e758 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:46.122380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4154fb1-7a49-41fa-8150-32142ab4e758 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:46.126256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4154fb1-7a49-41fa-8150-32142ab4e758 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:46.312058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:46.323659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:46.339107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:46.340449 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-61bb52a0-c742-4188-9abc-2b0180cfe5ad tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.276203 May 19 04:49:46.341692 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2233/4376] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:46 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:49:46.398080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-05e6a16e-274d-4978-9ea9-5bf551ef8647 req-a4564292-bcc6-466c-b3c3-13790e879f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1f1aff-9f46-4298-b952-fe6295c42f17", "name": "network-vif-plugged", "status": "completed", "tag": "d2a6f2c2-78d2-4ad6-a869-afa4ea61b43f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:46.443194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-05e6a16e-274d-4978-9ea9-5bf551ef8647 req-a4564292-bcc6-466c-b3c3-13790e879f90 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:46.443642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-05e6a16e-274d-4978-9ea9-5bf551ef8647 req-a4564292-bcc6-466c-b3c3-13790e879f90 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:46.487169 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-05e6a16e-274d-4978-9ea9-5bf551ef8647 req-a4564292-bcc6-466c-b3c3-13790e879f90 service nova] Creating event network-vif-plugged:d2a6f2c2-78d2-4ad6-a869-afa4ea61b43f for instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 on n-h2-766726-30 May 19 04:49:46.524716 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-05e6a16e-274d-4978-9ea9-5bf551ef8647 req-a4564292-bcc6-466c-b3c3-13790e879f90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130350 May 19 04:49:46.528956 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2234/4377] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:46.576377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d4154fb1-7a49-41fa-8150-32142ab4e758 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:46.588157 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d4154fb1-7a49-41fa-8150-32142ab4e758 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1459 microversion: 2.1 time: 0.503921 May 19 04:49:46.589005 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2144/4378] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:46 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1459 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:46.636114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e314940f-81a6-4767-b343-40569d977f01 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:46.637385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e314940f-81a6-4767-b343-40569d977f01 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:46.653365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e314940f-81a6-4767-b343-40569d977f01 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:46.654094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e314940f-81a6-4767-b343-40569d977f01 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:46.655500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e314940f-81a6-4767-b343-40569d977f01 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:46.659098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e314940f-81a6-4767-b343-40569d977f01 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:46.732092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae19a609-9493-48ff-bd0a-623ce6c96e20 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd31464e8b0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:46.814120 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae19a609-9493-48ff-bd0a-623ce6c96e20 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.085584 May 19 04:49:46.819175 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2145/4379] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:46 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:49:46.953692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1f94e569-57c9-4974-851f-61ac55d07775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:46.954771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1f94e569-57c9-4974-851f-61ac55d07775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:46.974228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f94e569-57c9-4974-851f-61ac55d07775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:46.974701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f94e569-57c9-4974-851f-61ac55d07775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:46.975507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f94e569-57c9-4974-851f-61ac55d07775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:46.979121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f94e569-57c9-4974-851f-61ac55d07775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:47.058211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e314940f-81a6-4767-b343-40569d977f01 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:47.068562 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e314940f-81a6-4767-b343-40569d977f01 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1320 microversion: 2.1 time: 0.438329 May 19 04:49:47.071075 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2235/4380] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:46 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:47.092721 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1f94e569-57c9-4974-851f-61ac55d07775 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 14 microversion: 2.1 time: 0.143578 May 19 04:49:47.094080 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2146/4381] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:46 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:49:47.360473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:47.363226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:47.385343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:47.399406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:47.401885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:47.402527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:47.494067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:47.508923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:47.512962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:47.516667 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-56575148-5037-466a-a79e-7b14dc0d4f04 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.158971 May 19 04:49:47.518285 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2236/4382] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:47 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:47.607148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2f8bafa-ec85-49ce-a5db-9e5d110e102d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:47.607784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b2f8bafa-ec85-49ce-a5db-9e5d110e102d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:47.621459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2f8bafa-ec85-49ce-a5db-9e5d110e102d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:47.622272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2f8bafa-ec85-49ce-a5db-9e5d110e102d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:47.624386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2f8bafa-ec85-49ce-a5db-9e5d110e102d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:47.625029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2f8bafa-ec85-49ce-a5db-9e5d110e102d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:47.828829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6fbb587a-d6f8-4e50-81bc-0dcf80369220 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314dca1f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:47.936027 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6fbb587a-d6f8-4e50-81bc-0dcf80369220 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.111931 May 19 04:49:47.937575 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2237/4383] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:47 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:48.089496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-57da33fc-01e6-4b41-a9e1-b435590ee265 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:48.090276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-57da33fc-01e6-4b41-a9e1-b435590ee265 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:48.130970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57da33fc-01e6-4b41-a9e1-b435590ee265 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.131426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57da33fc-01e6-4b41-a9e1-b435590ee265 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:48.132219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57da33fc-01e6-4b41-a9e1-b435590ee265 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.132788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57da33fc-01e6-4b41-a9e1-b435590ee265 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:48.183520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b2f8bafa-ec85-49ce-a5db-9e5d110e102d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:48.196531 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b2f8bafa-ec85-49ce-a5db-9e5d110e102d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1459 microversion: 2.1 time: 0.592349 May 19 04:49:48.203554 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2147/4384] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:47 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1459 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:48.209615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8116519-cd26-4977-b7b6-bf7a56f1a9c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:48.211617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e8116519-cd26-4977-b7b6-bf7a56f1a9c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:48.238611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8116519-cd26-4977-b7b6-bf7a56f1a9c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.239488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8116519-cd26-4977-b7b6-bf7a56f1a9c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:48.240917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8116519-cd26-4977-b7b6-bf7a56f1a9c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.247346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8116519-cd26-4977-b7b6-bf7a56f1a9c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:48.370141 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e8116519-cd26-4977-b7b6-bf7a56f1a9c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 14 microversion: 2.1 time: 0.164830 May 19 04:49:48.371220 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2148/4385] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:48 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:49:48.498091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-57da33fc-01e6-4b41-a9e1-b435590ee265 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:48.516599 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-57da33fc-01e6-4b41-a9e1-b435590ee265 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1500 microversion: 2.1 time: 0.432643 May 19 04:49:48.521431 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2238/4386] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:48 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1500 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:49:48.544840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7c248e7f-2abf-4f38-8752-012d6547221e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:48.547176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:48.548832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7c248e7f-2abf-4f38-8752-012d6547221e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:48.550613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:48.575968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.577405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c248e7f-2abf-4f38-8752-012d6547221e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.577857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c248e7f-2abf-4f38-8752-012d6547221e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:48.578635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c248e7f-2abf-4f38-8752-012d6547221e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.579072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c248e7f-2abf-4f38-8752-012d6547221e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:48.579497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:48.581782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.582465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:48.845624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:48.857770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:48.863410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:48.864941 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-221d5148-8541-4b89-9afb-2e3f08659cb1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.329466 May 19 04:49:48.866066 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2239/4387] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:48 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:48.885187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7c248e7f-2abf-4f38-8752-012d6547221e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:48.893532 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7c248e7f-2abf-4f38-8752-012d6547221e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1500 microversion: 2.1 time: 0.358796 May 19 04:49:48.898998 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2149/4388] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:48 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1500 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:48.933637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f71b626-79c5-4a7d-b525-5b8ababddefb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:48.935156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f71b626-79c5-4a7d-b525-5b8ababddefb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:48.949115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-38fe98af-be0e-417a-9136-353d5c16a595 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd3146ab160>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:48.952449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f71b626-79c5-4a7d-b525-5b8ababddefb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.956940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f71b626-79c5-4a7d-b525-5b8ababddefb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:48.959033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f71b626-79c5-4a7d-b525-5b8ababddefb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:48.963661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f71b626-79c5-4a7d-b525-5b8ababddefb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:49.003338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-38fe98af-be0e-417a-9136-353d5c16a595 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.058919 May 19 04:49:49.004609 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2150/4389] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:48 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:49:49.043063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f71b626-79c5-4a7d-b525-5b8ababddefb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:49:49.214527 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f71b626-79c5-4a7d-b525-5b8ababddefb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 204 len: 0 microversion: 2.1 time: 0.297971 May 19 04:49:49.222487 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2240/4390] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:49:48 2022] DELETE /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:49:49.222703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-563ee435-cac1-443b-8a4e-e2a9bf68fad8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:49.222703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-563ee435-cac1-443b-8a4e-e2a9bf68fad8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:49.232758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a4c0210b-74b4-4a37-9d64-3511bc9b7a02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:49.237772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a4c0210b-74b4-4a37-9d64-3511bc9b7a02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:49.244638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-563ee435-cac1-443b-8a4e-e2a9bf68fad8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:49.248297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-563ee435-cac1-443b-8a4e-e2a9bf68fad8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:49.249669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-563ee435-cac1-443b-8a4e-e2a9bf68fad8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:49.253615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-563ee435-cac1-443b-8a4e-e2a9bf68fad8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:49.259388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4c0210b-74b4-4a37-9d64-3511bc9b7a02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:49.261602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4c0210b-74b4-4a37-9d64-3511bc9b7a02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:49.262547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4c0210b-74b4-4a37-9d64-3511bc9b7a02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:49.267762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4c0210b-74b4-4a37-9d64-3511bc9b7a02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:49.717677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-563ee435-cac1-443b-8a4e-e2a9bf68fad8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:49.729317 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-563ee435-cac1-443b-8a4e-e2a9bf68fad8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.512776 May 19 04:49:49.730241 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2151/4391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:49 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:49.744615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d2679689-2b1c-4302-81a8-f45266dde526 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:49.746437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d2679689-2b1c-4302-81a8-f45266dde526 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:49.763447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2679689-2b1c-4302-81a8-f45266dde526 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:49.765958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2679689-2b1c-4302-81a8-f45266dde526 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:49.767070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2679689-2b1c-4302-81a8-f45266dde526 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:49.769349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2679689-2b1c-4302-81a8-f45266dde526 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:49.808824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a4c0210b-74b4-4a37-9d64-3511bc9b7a02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:49.819939 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a4c0210b-74b4-4a37-9d64-3511bc9b7a02 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1506 microversion: 2.1 time: 0.595762 May 19 04:49:49.832380 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2241/4392] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:49 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:49.863042 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d2679689-2b1c-4302-81a8-f45266dde526 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 14 microversion: 2.1 time: 0.128312 May 19 04:49:49.864068 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2152/4393] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:49 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:49:49.885381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:49.886016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:49.892585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:49.905116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:49.906769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:49.908858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:50.016770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3777c24-bd95-4a23-9732-e0fcd73163a4 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd31453d430>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:50.070983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:50.088103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:50.093195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:50.095953 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba0ca6d6-d863-41f7-8241-362d93c4a8d1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.215202 May 19 04:49:50.096150 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3777c24-bd95-4a23-9732-e0fcd73163a4 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.084307 May 19 04:49:50.096905 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2242/4394] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:49 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:50.108618 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2153/4395] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:50 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:50.749118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2e9a791e-0283-4999-bb85-91bcca52a8b7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:50.749991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2e9a791e-0283-4999-bb85-91bcca52a8b7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:50.763509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e9a791e-0283-4999-bb85-91bcca52a8b7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:50.767147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e9a791e-0283-4999-bb85-91bcca52a8b7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:50.767995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e9a791e-0283-4999-bb85-91bcca52a8b7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:50.768421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e9a791e-0283-4999-bb85-91bcca52a8b7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:50.840621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-02c8845e-08cb-4d9e-bf64-5f2cbce5bc92 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:50.842253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-02c8845e-08cb-4d9e-bf64-5f2cbce5bc92 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:50.865517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02c8845e-08cb-4d9e-bf64-5f2cbce5bc92 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:50.866415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02c8845e-08cb-4d9e-bf64-5f2cbce5bc92 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:50.867420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02c8845e-08cb-4d9e-bf64-5f2cbce5bc92 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:50.868289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02c8845e-08cb-4d9e-bf64-5f2cbce5bc92 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:51.334351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2e9a791e-0283-4999-bb85-91bcca52a8b7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:51.350849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02c8845e-08cb-4d9e-bf64-5f2cbce5bc92 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:51.366997 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2e9a791e-0283-4999-bb85-91bcca52a8b7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.622256 May 19 04:49:51.367919 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-02c8845e-08cb-4d9e-bf64-5f2cbce5bc92 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1506 microversion: 2.1 time: 0.526439 May 19 04:49:51.378940 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2154/4396] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:50 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:49:51.390890 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2243/4397] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:50 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:51.400485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2107c6e0-fb94-41b4-beee-18951e5102ea tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:51.402810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:51.403605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2107c6e0-fb94-41b4-beee-18951e5102ea tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:51.405723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:51.417179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2107c6e0-fb94-41b4-beee-18951e5102ea tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:51.419195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:51.420021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2107c6e0-fb94-41b4-beee-18951e5102ea tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:51.421045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2107c6e0-fb94-41b4-beee-18951e5102ea tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:51.422431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2107c6e0-fb94-41b4-beee-18951e5102ea tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:51.422720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:51.426681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:51.427483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:51.458678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:51.476658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:49:51.507178 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2107c6e0-fb94-41b4-beee-18951e5102ea tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 14 microversion: 2.1 time: 0.126451 May 19 04:49:51.509854 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2155/4398] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:51 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:49:51.518235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0461578b-bfdd-46ab-a67a-1708503f4b4e tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314557e50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:51.572287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:51.582170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:51.590442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:51.591782 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aefd9c7a-42a8-4d1a-85a1-04c8865366f7 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.204094 May 19 04:49:51.593470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2244/4399] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:51 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:51.638605 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0461578b-bfdd-46ab-a67a-1708503f4b4e tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 287 microversion: 2.1 time: 0.127195 May 19 04:49:51.644977 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2156/4400] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:51 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:51.653852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43a04636-7a47-4ffd-b413-7ac0287a27a9 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314df8820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:51.816092 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43a04636-7a47-4ffd-b413-7ac0287a27a9 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 202 len: 0 microversion: 2.1 time: 0.169772 May 19 04:49:51.817690 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2245/4401] 10.222.0.58 () {58 vars in 1253 bytes} [Thu May 19 04:49:51 2022] DELETE /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:49:51.826861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f35441da-afa1-446c-80d5-7d2e25a418f0 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314557f70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:51.984105 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f35441da-afa1-446c-80d5-7d2e25a418f0 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.160832 May 19 04:49:51.984729 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2157/4402] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:51 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:52.077548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fbdef8fb-ec17-48e4-840a-428768d823ba req-0f957ac5-6d7a-46bb-847b-21a7a66ee02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1f1aff-9f46-4298-b952-fe6295c42f17", "name": "network-vif-deleted", "tag": "d2a6f2c2-78d2-4ad6-a869-afa4ea61b43f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:52.168475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fbdef8fb-ec17-48e4-840a-428768d823ba req-0f957ac5-6d7a-46bb-847b-21a7a66ee02f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:52.174706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fbdef8fb-ec17-48e4-840a-428768d823ba req-0f957ac5-6d7a-46bb-847b-21a7a66ee02f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:52.223377 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fbdef8fb-ec17-48e4-840a-428768d823ba req-0f957ac5-6d7a-46bb-847b-21a7a66ee02f service nova] Creating event network-vif-deleted:d2a6f2c2-78d2-4ad6-a869-afa4ea61b43f for instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 on n-h2-766726-30 May 19 04:49:52.245755 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fbdef8fb-ec17-48e4-840a-428768d823ba req-0f957ac5-6d7a-46bb-847b-21a7a66ee02f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159128 May 19 04:49:52.248112 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2246/4403] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:52.407467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18586337-3fed-4b9e-bdf0-3378ea59e774 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:52.409048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-18586337-3fed-4b9e-bdf0-3378ea59e774 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:52.409519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:52.414684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:52.448660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18586337-3fed-4b9e-bdf0-3378ea59e774 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:52.471821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18586337-3fed-4b9e-bdf0-3378ea59e774 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:52.473382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18586337-3fed-4b9e-bdf0-3378ea59e774 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:52.478586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:52.480902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:52.482743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18586337-3fed-4b9e-bdf0-3378ea59e774 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:52.487733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:52.490673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:52.714910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:52.718126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:52.718788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lazy-loading 'fault' on Instance uuid 5f1f1aff-9f46-4298-b952-fe6295c42f17 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:49:52.850287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:52.866433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-23d4e4ed-4355-447f-b4bb-1a72fe78011a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 200 len: 1310 microversion: 2.1 time: 0.481634 May 19 04:49:52.879424 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2158/4404] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:52 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 1310 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:52.888483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be8122fc-229f-438d-ad65-b346b8c9cb24 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:52.894469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be8122fc-229f-438d-ad65-b346b8c9cb24 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:52.908676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be8122fc-229f-438d-ad65-b346b8c9cb24 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:52.912840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be8122fc-229f-438d-ad65-b346b8c9cb24 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:52.915200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be8122fc-229f-438d-ad65-b346b8c9cb24 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:52.916818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be8122fc-229f-438d-ad65-b346b8c9cb24 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:53.033998 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be8122fc-229f-438d-ad65-b346b8c9cb24 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 14 microversion: 2.1 time: 0.152347 May 19 04:49:53.042765 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2159/4405] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:52 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:49:53.061005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:53.062118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:53.082862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:53.086340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:53.088416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:53.093472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:53.715103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-18586337-3fed-4b9e-bdf0-3378ea59e774 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:53.747725 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18586337-3fed-4b9e-bdf0-3378ea59e774 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 1.353045 May 19 04:49:53.755046 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2247/4406] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:52 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:53.768711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3017da58-82d1-45ed-8dcb-8bb661b1c5e3 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314e0f310>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:53.829232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:53.842275 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3017da58-82d1-45ed-8dcb-8bb661b1c5e3 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.086074 May 19 04:49:53.844317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:53.846450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:53.848333 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2248/4407] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:53 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:53.848759 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc0ba75f-c809-4714-b870-9515f2cc0275 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.803426 May 19 04:49:53.853463 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2160/4408] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:53 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:53.856380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-80b62e6a-4056-4362-a876-12d88bd8cda9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:53.857818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-80b62e6a-4056-4362-a876-12d88bd8cda9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:53.880503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80b62e6a-4056-4362-a876-12d88bd8cda9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:53.881249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80b62e6a-4056-4362-a876-12d88bd8cda9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:53.881809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80b62e6a-4056-4362-a876-12d88bd8cda9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:53.884097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80b62e6a-4056-4362-a876-12d88bd8cda9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:53.889546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:53.890746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:53.903228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:53.904716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:53.908745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:53.909441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:53.956292 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 HTTP/1.1 May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '5f1f1aff-9f46-4298-b952-fe6295c42f17'} May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:53.963873 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:49:53.969548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:49:53.969548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:49:53.969548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:49:53.969548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:49:53.969548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:49:53.969548 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:49:53.971442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:49:53.972987 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3cd2146-d073-464b-b240-d835e1edd928 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 404 len: 111 microversion: 2.1 time: 0.090505 May 19 04:49:53.986363 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2161/4409] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:53 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:49:54.006446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae33f6bf-1f9f-44c1-b49c-98e6b0cd93a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'create', calling method: .version_select at 0x7fd3145a6700>, body: {"keypair": {"name": "tempest-key-1401585655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxljIRPohnYRQ0Qf2mSOvtQcqSD+uM62xeCh/mdw2CN0wtFGUPIHv1EwUXTbimJ6Z6hGVUdDi1KDvMly34OqBEfDAFr6iucy4FGsHpBYgXPGkTWHX/O3jWaX8Pnf06Cqw=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:54.014741 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-80b62e6a-4056-4362-a876-12d88bd8cda9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/ips" status: 200 len: 153 microversion: 2.20 time: 0.164777 May 19 04:49:54.024145 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2249/4410] 10.222.0.58 () {60 vars in 1288 bytes} [Thu May 19 04:49:53 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/ips => generated 153 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:49:54.050387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1d75ed9e-7c54-4fdb-807d-8f22206e970c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:54.051164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ae33f6bf-1f9f-44c1-b49c-98e6b0cd93a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:49:54.052180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1d75ed9e-7c54-4fdb-807d-8f22206e970c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:54.064538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d75ed9e-7c54-4fdb-807d-8f22206e970c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:54.068262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d75ed9e-7c54-4fdb-807d-8f22206e970c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:54.069935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d75ed9e-7c54-4fdb-807d-8f22206e970c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:54.071138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1d75ed9e-7c54-4fdb-807d-8f22206e970c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:54.081332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ae33f6bf-1f9f-44c1-b49c-98e6b0cd93a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for user a75cb8e84f674ef0814a39d2a4887933 and project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:49:54.185026 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1d75ed9e-7c54-4fdb-807d-8f22206e970c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 14 microversion: 2.1 time: 0.133095 May 19 04:49:54.189802 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2250/4411] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:54 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 04:49:54.223632 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae33f6bf-1f9f-44c1-b49c-98e6b0cd93a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.235766 May 19 04:49:54.230834 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2162/4412] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:49:53 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:54.250816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b26ea1d-ee19-4998-b6de-5bbf594bc86b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '.version_select at 0x7fd314df8820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:54.262108 n-d-766726-30 devstack@n-api.service[124818]: WARNING oslo_db.sqlalchemy.utils [None req-8b26ea1d-ee19-4998-b6de-5bbf594bc86b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 04:49:54.276997 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b26ea1d-ee19-4998-b6de-5bbf594bc86b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.046306 May 19 04:49:54.279318 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2251/4413] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:49:54 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:49:54.355685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ea1737aa-ad08-4a70-954a-3d7da14d1125 req-b94df96d-b05e-46e2-9771-f08b3526b129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878aa03f-a366-4d71-b678-1c749fc143c6", "tag": "ba6e6c22-0bce-4292-b1fd-46293b3f4ad6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:54.381092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ea1737aa-ad08-4a70-954a-3d7da14d1125 req-b94df96d-b05e-46e2-9771-f08b3526b129 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:54.384611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ea1737aa-ad08-4a70-954a-3d7da14d1125 req-b94df96d-b05e-46e2-9771-f08b3526b129 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:54.445912 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ea1737aa-ad08-4a70-954a-3d7da14d1125 req-b94df96d-b05e-46e2-9771-f08b3526b129 service nova] Creating event network-changed:ba6e6c22-0bce-4292-b1fd-46293b3f4ad6 for instance 878aa03f-a366-4d71-b678-1c749fc143c6 on n-h2-766726-30 May 19 04:49:54.464414 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ea1737aa-ad08-4a70-954a-3d7da14d1125 req-b94df96d-b05e-46e2-9771-f08b3526b129 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113226 May 19 04:49:54.469166 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2163/4414] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:54.637521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1661984054", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "key_name": "tempest-key-1401585655", "networks": [{"uuid": "3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:54.773324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8ca3a57f-e2c4-411b-93a7-fa0fea646c2c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:54.774432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8ca3a57f-e2c4-411b-93a7-fa0fea646c2c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:54.784124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ca3a57f-e2c4-411b-93a7-fa0fea646c2c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:54.794799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ca3a57f-e2c4-411b-93a7-fa0fea646c2c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:54.796489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ca3a57f-e2c4-411b-93a7-fa0fea646c2c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:54.803131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ca3a57f-e2c4-411b-93a7-fa0fea646c2c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:54.846223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] validate_networks() for [('3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:49:55.565593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8ca3a57f-e2c4-411b-93a7-fa0fea646c2c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:55.574919 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8ca3a57f-e2c4-411b-93a7-fa0fea646c2c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.806786 May 19 04:49:55.582252 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2164/4415] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:54 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:55.595609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c91503b3-a8d2-4748-a2e8-79de205dd2b4 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314557c10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:55.715041 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c91503b3-a8d2-4748-a2e8-79de205dd2b4 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.131419 May 19 04:49:55.715624 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2165/4416] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:55 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:55.722826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:55.723824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:55.735048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:55.737625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:55.740466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:55.753575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:56.293908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:56.303112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:56.310773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:56.319051 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee8de277-7451-455d-9313-15e04ce4268e tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.602306 May 19 04:49:56.319682 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2166/4417] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:55 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:56.361821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4dcccc74-9a6a-44c3-8028-b9ce70eb5eb2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:49:56.368693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4dcccc74-9a6a-44c3-8028-b9ce70eb5eb2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:56.420411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4dcccc74-9a6a-44c3-8028-b9ce70eb5eb2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:56.426107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4dcccc74-9a6a-44c3-8028-b9ce70eb5eb2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:56.427158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4dcccc74-9a6a-44c3-8028-b9ce70eb5eb2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:56.427785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4dcccc74-9a6a-44c3-8028-b9ce70eb5eb2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:56.523630 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4dcccc74-9a6a-44c3-8028-b9ce70eb5eb2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action" status: 200 len: 8207 microversion: 2.1 time: 0.190247 May 19 04:49:56.525497 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2167/4418] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:49:56 2022] POST /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732/action => generated 8207 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:56.536951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f6b957a-a29e-4e5e-91b9-5f0783c3148b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:56.538030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3f6b957a-a29e-4e5e-91b9-5f0783c3148b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:56.559180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f6b957a-a29e-4e5e-91b9-5f0783c3148b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:56.559908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f6b957a-a29e-4e5e-91b9-5f0783c3148b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:56.560995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f6b957a-a29e-4e5e-91b9-5f0783c3148b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:56.561990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f6b957a-a29e-4e5e-91b9-5f0783c3148b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:57.486271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:49:57.486895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:49:57.487169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:49:57.487579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:49:57.487991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:49:57.521733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:57.522205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:57.530144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:57.530746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:57.623104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:49:57.641199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for user a75cb8e84f674ef0814a39d2a4887933 and project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:49:57.702586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:49:57.714817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:49:57.895746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3f6b957a-a29e-4e5e-91b9-5f0783c3148b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:57.907400 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3f6b957a-a29e-4e5e-91b9-5f0783c3148b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 1.376350 May 19 04:49:57.918012 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2168/4419] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:56 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:57.923691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7fa41cbe-15af-4001-8185-bad090b92cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:57.924313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7fa41cbe-15af-4001-8185-bad090b92cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:57.976638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fa41cbe-15af-4001-8185-bad090b92cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:57.977382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fa41cbe-15af-4001-8185-bad090b92cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:57.978370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fa41cbe-15af-4001-8185-bad090b92cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:57.979572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fa41cbe-15af-4001-8185-bad090b92cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:58.005556 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14e7a22a-2cbd-4fe2-bbd8-644ecb2e7ba8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.372110 May 19 04:49:58.008970 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2252/4420] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:49:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:49:58.048644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b595416-127e-4817-9df9-0773c7098ec7 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314e0f160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:58.219839 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b595416-127e-4817-9df9-0773c7098ec7 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.206550 May 19 04:49:58.220447 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2253/4421] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:58 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:58.225919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:58.227763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:58.287474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:58.296687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:58.307059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:58.307999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:58.807766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:58.827792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:58.832103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:58.834537 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-32a8c746-dcbe-470f-927f-516e96c3aa10 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.612304 May 19 04:49:58.845872 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2254/4422] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:58 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:49:58.859559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5ff6433a-b4bd-4e70-a50b-2eed1138a1c0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:58.860556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5ff6433a-b4bd-4e70-a50b-2eed1138a1c0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:58.877420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ff6433a-b4bd-4e70-a50b-2eed1138a1c0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:58.878441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ff6433a-b4bd-4e70-a50b-2eed1138a1c0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:58.879655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ff6433a-b4bd-4e70-a50b-2eed1138a1c0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:58.880461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ff6433a-b4bd-4e70-a50b-2eed1138a1c0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:58.896814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7fa41cbe-15af-4001-8185-bad090b92cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:58.912468 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7fa41cbe-15af-4001-8185-bad090b92cb8 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.988287 May 19 04:49:58.925961 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2169/4423] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:57 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:58.931081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-545f3e20-df8e-4236-9799-99d94c039751 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:58.936546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-545f3e20-df8e-4236-9799-99d94c039751 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:59.101675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-545f3e20-df8e-4236-9799-99d94c039751 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:59.112512 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-545f3e20-df8e-4236-9799-99d94c039751 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1229 microversion: 2.1 time: 0.185154 May 19 04:49:59.115887 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2170/4424] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:58 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1229 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:59.233664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c75f5be-a5cc-4e36-be33-c148b2e4edc3 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd31457a5e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:59.330997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c75f5be-a5cc-4e36-be33-c148b2e4edc3 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 200 len: 286 microversion: 2.1 time: 0.102273 May 19 04:49:59.338131 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2171/4425] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:49:59 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:49:59.394624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5ff6433a-b4bd-4e70-a50b-2eed1138a1c0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:49:59.408585 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5ff6433a-b4bd-4e70-a50b-2eed1138a1c0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.561102 May 19 04:49:59.410815 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2255/4426] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:58 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:49:59.436613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6fa68171-35be-4616-a702-eefb44d77654 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:59.437558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6fa68171-35be-4616-a702-eefb44d77654 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:59.458229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa68171-35be-4616-a702-eefb44d77654 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:59.459786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa68171-35be-4616-a702-eefb44d77654 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:59.462839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa68171-35be-4616-a702-eefb44d77654 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:59.463564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa68171-35be-4616-a702-eefb44d77654 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:59.861431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:49:59.862046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:49:59.882245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:59.885952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:49:59.887064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:49:59.888617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:00.089805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:00.100561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:00.102444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:00.103718 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d9cfabfb-67d8-4e6d-8e68-71758e1330a1 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1366 microversion: 2.47 time: 0.246400 May 19 04:50:00.104279 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2256/4427] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:49:59 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:00.155366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-91ae82d1-2c70-44d7-a872-d1c3e40ac703 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:00.155999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-91ae82d1-2c70-44d7-a872-d1c3e40ac703 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:00.187796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91ae82d1-2c70-44d7-a872-d1c3e40ac703 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:00.188313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91ae82d1-2c70-44d7-a872-d1c3e40ac703 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:00.189100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91ae82d1-2c70-44d7-a872-d1c3e40ac703 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:00.189551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91ae82d1-2c70-44d7-a872-d1c3e40ac703 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:00.233853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6fa68171-35be-4616-a702-eefb44d77654 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:00.248736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6fa68171-35be-4616-a702-eefb44d77654 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.817794 May 19 04:50:00.258180 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2172/4428] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:49:59 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:00.268866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3b986136-08ae-4e57-a56a-ef79d444d194 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:00.272044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3b986136-08ae-4e57-a56a-ef79d444d194 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:00.301480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b986136-08ae-4e57-a56a-ef79d444d194 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:00.302284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b986136-08ae-4e57-a56a-ef79d444d194 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:00.303310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b986136-08ae-4e57-a56a-ef79d444d194 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:00.303949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b986136-08ae-4e57-a56a-ef79d444d194 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:00.920256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-91ae82d1-2c70-44d7-a872-d1c3e40ac703 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:00.943023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3b986136-08ae-4e57-a56a-ef79d444d194 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:00.954234 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-91ae82d1-2c70-44d7-a872-d1c3e40ac703 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.847599 May 19 04:50:00.971266 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2257/4429] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:00 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:00.974702 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3b986136-08ae-4e57-a56a-ef79d444d194 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1281 microversion: 2.1 time: 0.715195 May 19 04:50:00.980348 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2173/4430] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:00 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1281 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:00.988256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e8562bf-f68d-4e18-b2ab-89a0703c2551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:01.005566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6e8562bf-f68d-4e18-b2ab-89a0703c2551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:01.013328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b320c1da-5f6c-4038-9964-3181f5ad66e6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:01.014805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b320c1da-5f6c-4038-9964-3181f5ad66e6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:01.045768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8562bf-f68d-4e18-b2ab-89a0703c2551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:01.049603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8562bf-f68d-4e18-b2ab-89a0703c2551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:01.055116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8562bf-f68d-4e18-b2ab-89a0703c2551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:01.055708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b320c1da-5f6c-4038-9964-3181f5ad66e6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:01.056554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8562bf-f68d-4e18-b2ab-89a0703c2551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:01.057463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b320c1da-5f6c-4038-9964-3181f5ad66e6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:01.066983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b320c1da-5f6c-4038-9964-3181f5ad66e6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:01.072106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b320c1da-5f6c-4038-9964-3181f5ad66e6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:01.176866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-b320c1da-5f6c-4038-9964-3181f5ad66e6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lazy-loading 'flavor' on Instance uuid 894769ad-4295-4aff-8ba0-30957e6ec8da {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:50:02.222062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6e8562bf-f68d-4e18-b2ab-89a0703c2551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:02.247585 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b320c1da-5f6c-4038-9964-3181f5ad66e6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/action" status: 202 len: 0 microversion: 2.20 time: 1.264361 May 19 04:50:02.255439 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2174/4431] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:50:00 2022] POST /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/action => generated 0 bytes in 1274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:50:02.255658 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e8562bf-f68d-4e18-b2ab-89a0703c2551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 1.282617 May 19 04:50:02.256596 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2258/4432] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:00 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:02.274101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:02.286185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-726e85f6-f994-44e4-9c73-6a4e83ae6523 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd3145468b0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:02.294369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:02.327576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:02.342512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:02.347327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:02.348000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:02.370028 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-726e85f6-f994-44e4-9c73-6a4e83ae6523 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] HTTP exception thrown: Snapshot 718820f6-4f2e-4b26-b0ed-a72c0c8172c3 could not be found. May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-726e85f6-f994-44e4-9c73-6a4e83ae6523 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Request method failure captured: May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 HTTP/1.1 May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcxkMk5vWoJUjbJ7WLebAbWizYcsOL8gAY_ZYgD07yMuCK-HoGb_GODQf34Q0bEfLbhxQGFLiaeIA3679Wu0P6-W60tDlc22CcpwvXcvUUMz__4LerJy3NKApR6dGRztwDbyyVOvjU0RJGhXi7RM8twg9qf5IJfMoscPV3KU2lduxUo May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ef52a9199e1a45bd82a8f1f53cfcb521 May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ef52a9199e1a45bd82a8f1f53cfcb521 May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-VolumesSnapshotsTestJSON-195322595-project May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 2607b455b3a64477b3742a9ed454b32c May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195322595-project May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: exception: Snapshot 718820f6-4f2e-4b26-b0ed-a72c0c8172c3 could not be found. May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '718820f6-4f2e-4b26-b0ed-a72c0c8172c3'} May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 718820f6-4f2e-4b26-b0ed-a72c0c8172c3 could not be found. (HTTP 404) (Request-ID: req-defdb334-0156-4bdf-908c-887991525fd5) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:50:02.391155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 718820f6-4f2e-4b26-b0ed-a72c0c8172c3 could not be found. May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 718820f6-4f2e-4b26-b0ed-a72c0c8172c3 could not be found. May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 718820f6-4f2e-4b26-b0ed-a72c0c8172c3 could not be found. May 19 04:50:02.402953 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:02.408171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-726e85f6-f994-44e4-9c73-6a4e83ae6523 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Returning 404 to user: Snapshot 718820f6-4f2e-4b26-b0ed-a72c0c8172c3 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:02.409187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-726e85f6-f994-44e4-9c73-6a4e83ae6523 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3" status: 404 len: 111 microversion: 2.1 time: 0.151013 May 19 04:50:02.411041 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2175/4433] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 04:50:02 2022] GET /compute/v2.1/os-snapshots/718820f6-4f2e-4b26-b0ed-a72c0c8172c3 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:02.418430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-60ab1bd4-ba39-40cd-aa04-57be600dec75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:02.452914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60ab1bd4-ba39-40cd-aa04-57be600dec75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:02.472816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60ab1bd4-ba39-40cd-aa04-57be600dec75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:02.473723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60ab1bd4-ba39-40cd-aa04-57be600dec75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:02.475744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60ab1bd4-ba39-40cd-aa04-57be600dec75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:02.476231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60ab1bd4-ba39-40cd-aa04-57be600dec75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:02.738828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:02.747742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:02.749261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:02.786008 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a8e3d29b-a487-41bc-b10d-1665339657c9 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1372 microversion: 2.47 time: 0.523849 May 19 04:50:02.814633 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2259/4434] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:02 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1372 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:02.823177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ae7f5487-3a05-4ad8-a9dd-40f9b5feec26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:02.836884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ae7f5487-3a05-4ad8-a9dd-40f9b5feec26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:02.865611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae7f5487-3a05-4ad8-a9dd-40f9b5feec26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:02.871002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae7f5487-3a05-4ad8-a9dd-40f9b5feec26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:02.873394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae7f5487-3a05-4ad8-a9dd-40f9b5feec26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:02.875194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae7f5487-3a05-4ad8-a9dd-40f9b5feec26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:03.165856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ae7f5487-3a05-4ad8-a9dd-40f9b5feec26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:03.192473 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ae7f5487-3a05-4ad8-a9dd-40f9b5feec26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1287 microversion: 2.1 time: 0.372625 May 19 04:50:03.194024 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2260/4435] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:02 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1287 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:03.214485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:03.216516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:03.236575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:03.239128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:03.240167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:03.245286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:03.609530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60ab1bd4-ba39-40cd-aa04-57be600dec75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:03.621996 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-60ab1bd4-ba39-40cd-aa04-57be600dec75 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 1.208864 May 19 04:50:03.624932 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2176/4436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:02 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:03.629833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13f60c71-033c-4063-b591-4d31082e6000 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:03.645297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13f60c71-033c-4063-b591-4d31082e6000 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:03.671499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13f60c71-033c-4063-b591-4d31082e6000 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:03.671499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13f60c71-033c-4063-b591-4d31082e6000 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:03.671874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13f60c71-033c-4063-b591-4d31082e6000 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:03.689534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13f60c71-033c-4063-b591-4d31082e6000 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:03.779089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:03.796264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:03.806261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:03.816045 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f072444b-9eac-4dd1-b834-55577f53dd59 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1723 microversion: 2.20 time: 0.616121 May 19 04:50:03.822653 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2261/4437] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:03 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1723 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:03.845993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d83bd6cf-2659-45f8-85a8-a757e72a045c tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314d30af0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:03.847215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13f60c71-033c-4063-b591-4d31082e6000 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Locking {{(pid=124819) lock /opt/stack/nova/nova/compute/api.py:4700}} May 19 04:50:03.928746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:04.029336 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13f60c71-033c-4063-b591-4d31082e6000 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.402674 May 19 04:50:04.031112 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2177/4438] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:03 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:04.045443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:04.047338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:04.058979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:04.062632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:04.066720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:04.068858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:04.097744 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d83bd6cf-2659-45f8-85a8-a757e72a045c tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 202 len: 0 microversion: 2.1 time: 0.273026 May 19 04:50:04.101742 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2262/4439] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:50:03 2022] DELETE /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:04.107260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad0c3573-5264-4e24-b609-92ba9c0f4d34 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:04.107882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ad0c3573-5264-4e24-b609-92ba9c0f4d34 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:04.139273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad0c3573-5264-4e24-b609-92ba9c0f4d34 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:04.139738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad0c3573-5264-4e24-b609-92ba9c0f4d34 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:04.140532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad0c3573-5264-4e24-b609-92ba9c0f4d34 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:04.147005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad0c3573-5264-4e24-b609-92ba9c0f4d34 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:04.328811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:04.353825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:04.358532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:04.363223 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-93434bff-e6a2-4bd9-a039-c255b56dfecc tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1372 microversion: 2.47 time: 0.330505 May 19 04:50:04.368143 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2178/4440] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:04 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1372 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:04.412001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c4bacb91-40b3-42a2-91cf-adb58f9536d9 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd31460e5e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:04.621920 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c4bacb91-40b3-42a2-91cf-adb58f9536d9 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 200 len: 343 microversion: 2.1 time: 0.251557 May 19 04:50:04.623260 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2179/4441] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:04 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 343 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:04.647360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59bb0e4e-500f-4ade-8b0d-2a20ac8e71d6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:04.651753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-59bb0e4e-500f-4ade-8b0d-2a20ac8e71d6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:04.713303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bb0e4e-500f-4ade-8b0d-2a20ac8e71d6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:04.713994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bb0e4e-500f-4ade-8b0d-2a20ac8e71d6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:04.714952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bb0e4e-500f-4ade-8b0d-2a20ac8e71d6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:04.715762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bb0e4e-500f-4ade-8b0d-2a20ac8e71d6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:04.950005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-59bb0e4e-500f-4ade-8b0d-2a20ac8e71d6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:04.977565 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59bb0e4e-500f-4ade-8b0d-2a20ac8e71d6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1287 microversion: 2.1 time: 0.343638 May 19 04:50:04.980606 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2180/4442] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:04 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1287 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:04.996642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e3062216-df5c-4c2f-a023-5fc46d2d9f27 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:05.007838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e3062216-df5c-4c2f-a023-5fc46d2d9f27 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:05.031879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3062216-df5c-4c2f-a023-5fc46d2d9f27 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:05.034706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3062216-df5c-4c2f-a023-5fc46d2d9f27 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:05.035496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3062216-df5c-4c2f-a023-5fc46d2d9f27 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:05.035927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3062216-df5c-4c2f-a023-5fc46d2d9f27 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:05.134731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ad0c3573-5264-4e24-b609-92ba9c0f4d34 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:05.156969 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad0c3573-5264-4e24-b609-92ba9c0f4d34 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 1.054078 May 19 04:50:05.178603 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2263/4443] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:04 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:05.198430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:05.211758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:05.235048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:05.235506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:05.236302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:05.236754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:05.822656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e3062216-df5c-4c2f-a023-5fc46d2d9f27 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:05.846899 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e3062216-df5c-4c2f-a023-5fc46d2d9f27 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.864107 May 19 04:50:05.847494 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2181/4444] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:04 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:05.865145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59bfab32-f446-41ac-99f2-86ef3e0807b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:05.927932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bfab32-f446-41ac-99f2-86ef3e0807b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:05.929490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bfab32-f446-41ac-99f2-86ef3e0807b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:05.962438 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-59bfab32-f446-41ac-99f2-86ef3e0807b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] HTTP exception thrown: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 is locked May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59bfab32-f446-41ac-99f2-86ef3e0807b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Request method failure captured: May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action HTTP/1.1 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 15 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihct_APeUUwkAsVEog4z30SCbl9EKENFOQfyl2xYhzj2YzWvEJuSbvkD-kjHz-5gtgTKd4EsFcX0Ewg3jgqjv4EmUMAaGVJN8tkPahLj7YMKDzPyfkl4GxQlphj1eAZvJmhuijajE3_0rUgjLx7D0P3HLID6pkPXrkGJqKZnjxxAFg1g May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 346e3945e25c4638bef347149d914e61 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/346e3945e25c4638bef347149d914e61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_346e3945e25c4638bef347149d914e61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-642791081 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 346e3945e25c4638bef347149d914e61 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-642791081-project May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 87d19ae04b1d4f0e9e23872d9c2cd0a4 May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-642791081-project May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: {"os-stop": {}} May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 is locked May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '073cbfef-d688-44eb-b0f7-5bc688c5f888', 'body': {'os-stop': {}}} May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 is locked May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1450, in _stop_server May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 is locked May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 is locked May 19 04:50:05.964851 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:05.974154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59bfab32-f446-41ac-99f2-86ef3e0807b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Returning 409 to user: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 is locked {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:05.975215 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59bfab32-f446-41ac-99f2-86ef3e0807b7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 409 len: 107 microversion: 2.1 time: 0.121039 May 19 04:50:05.976039 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2182/4445] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:05 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 107 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:50:05.981411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:05.982267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:05.990821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:05.992120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:05.994030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:05.994674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:06.034702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.051677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.053904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.056290 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c0596f1d-d916-4f2e-92ec-d5c867074465 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1723 microversion: 2.20 time: 0.876146 May 19 04:50:06.063008 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2264/4446] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:05 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1723 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:06.073783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dbb0d467-0052-4f50-ab7a-d46ece6771af tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314dca040>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:06.151733 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dbb0d467-0052-4f50-ab7a-d46ece6771af tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 200 len: 343 microversion: 2.1 time: 0.087232 May 19 04:50:06.153294 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2265/4447] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:06 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:06.158390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c08a4a9f-f80c-44b8-8cd8-59e9c7aba252 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:06.159261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c08a4a9f-f80c-44b8-8cd8-59e9c7aba252 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:06.171944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c08a4a9f-f80c-44b8-8cd8-59e9c7aba252 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:06.172751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c08a4a9f-f80c-44b8-8cd8-59e9c7aba252 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:06.173836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c08a4a9f-f80c-44b8-8cd8-59e9c7aba252 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:06.174664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c08a4a9f-f80c-44b8-8cd8-59e9c7aba252 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:06.277330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c08a4a9f-f80c-44b8-8cd8-59e9c7aba252 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Unlocking {{(pid=124818) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 19 04:50:06.310233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.321532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.339979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.341323 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-41bb95d4-b4ed-4979-88a7-4ca35ee3e7b6 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1357 microversion: 2.47 time: 0.363946 May 19 04:50:06.341917 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2183/4448] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:05 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:06.363005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7d655de0-cb2b-4c8f-927f-e91eba2c282c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:06.363627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7d655de0-cb2b-4c8f-927f-e91eba2c282c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:06.381605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d655de0-cb2b-4c8f-927f-e91eba2c282c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:06.388131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d655de0-cb2b-4c8f-927f-e91eba2c282c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:06.389670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d655de0-cb2b-4c8f-927f-e91eba2c282c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:06.393925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d655de0-cb2b-4c8f-927f-e91eba2c282c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:06.430475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:06.434643 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c08a4a9f-f80c-44b8-8cd8-59e9c7aba252 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.279590 May 19 04:50:06.439917 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2266/4449] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:06 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:06.449018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:06.453435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.454545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Searching by: {'deleted': False, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:50:06.462509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:06.463246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:06.464258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:06.464883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:06.728089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:50:06.878374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7d655de0-cb2b-4c8f-927f-e91eba2c282c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.894732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7d655de0-cb2b-4c8f-927f-e91eba2c282c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1329 microversion: 2.1 time: 0.538869 May 19 04:50:06.900571 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2184/4450] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:06 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1329 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:06.915335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e86a8ce1-bd32-474f-9a6a-893622e3fd6e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:06.931725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e86a8ce1-bd32-474f-9a6a-893622e3fd6e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:06.935883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e86a8ce1-bd32-474f-9a6a-893622e3fd6e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:06.947143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.967197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:06.967986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:06.992990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.995582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:06.996518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e86a8ce1-bd32-474f-9a6a-893622e3fd6e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Going to try to stop instance {{(pid=124819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 04:50:07.089519 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e86a8ce1-bd32-474f-9a6a-893622e3fd6e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.187216 May 19 04:50:07.092391 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2185/4451] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:06 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:07.103612 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-81d9962d-2d17-4312-8771-bfa483d34f71 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.662253 May 19 04:50:07.117264 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2267/4452] 10.222.0.58 () {60 vars in 1186 bytes} [Thu May 19 04:50:06 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:07.117264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:07.117264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:07.118810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6391b708-49e6-49f6-b8bc-c5fa50d6063c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:07.120195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6391b708-49e6-49f6-b8bc-c5fa50d6063c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:07.124511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:07.125852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:07.128298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:07.128850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:07.141300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6391b708-49e6-49f6-b8bc-c5fa50d6063c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:07.142335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6391b708-49e6-49f6-b8bc-c5fa50d6063c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:07.143954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6391b708-49e6-49f6-b8bc-c5fa50d6063c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:07.147664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6391b708-49e6-49f6-b8bc-c5fa50d6063c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:07.618987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6391b708-49e6-49f6-b8bc-c5fa50d6063c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:07.628530 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6391b708-49e6-49f6-b8bc-c5fa50d6063c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.531674 May 19 04:50:07.643440 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2186/4453] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:07 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:07.649695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce8a088a-5fe2-44bc-9802-ac89e0389819 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:07.650665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ce8a088a-5fe2-44bc-9802-ac89e0389819 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:07.659017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:07.671283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:07.676209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce8a088a-5fe2-44bc-9802-ac89e0389819 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:07.686666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce8a088a-5fe2-44bc-9802-ac89e0389819 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:07.687496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:07.687746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce8a088a-5fe2-44bc-9802-ac89e0389819 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:07.688321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce8a088a-5fe2-44bc-9802-ac89e0389819 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:07.689011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:07.696957 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2f9b03e3-81e9-42ff-b55a-7d7bb1e20333 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1723 microversion: 2.20 time: 0.590979 May 19 04:50:07.716382 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2268/4454] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:07 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1723 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:07.721816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c1e3cb6-646a-4e8d-b2f0-110e490cd2ba tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:07.722317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c1e3cb6-646a-4e8d-b2f0-110e490cd2ba tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:07.764870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c1e3cb6-646a-4e8d-b2f0-110e490cd2ba tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:07.765806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c1e3cb6-646a-4e8d-b2f0-110e490cd2ba tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:07.766858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c1e3cb6-646a-4e8d-b2f0-110e490cd2ba tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:07.767551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c1e3cb6-646a-4e8d-b2f0-110e490cd2ba tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:07.844892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c1e3cb6-646a-4e8d-b2f0-110e490cd2ba tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:50:07.967376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ce8a088a-5fe2-44bc-9802-ac89e0389819 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:07.991144 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c1e3cb6-646a-4e8d-b2f0-110e490cd2ba tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 204 len: 0 microversion: 2.47 time: 0.273307 May 19 04:50:07.992161 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2269/4455] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:50:07 2022] DELETE /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:50:07.996333 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce8a088a-5fe2-44bc-9802-ac89e0389819 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.350159 May 19 04:50:08.003494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5fadb9fd-77fa-4879-b014-90012be3e1f1 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314d531f0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:08.012476 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2187/4456] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:07 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:08.034827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-68984874-70ce-4d7d-9107-bac5c294c175 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:08.035734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-68984874-70ce-4d7d-9107-bac5c294c175 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:08.060650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68984874-70ce-4d7d-9107-bac5c294c175 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:08.062460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68984874-70ce-4d7d-9107-bac5c294c175 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:08.066579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68984874-70ce-4d7d-9107-bac5c294c175 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:08.067509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68984874-70ce-4d7d-9107-bac5c294c175 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:08.117121 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5fadb9fd-77fa-4879-b014-90012be3e1f1 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 200 len: 343 microversion: 2.1 time: 0.122558 May 19 04:50:08.117969 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2270/4457] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:07 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 343 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:08.122874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:08.124482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:08.155519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:08.156208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:08.158454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:08.160603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:08.517236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:08.526996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:08.533495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:08.537951 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5b01ef94-48a6-4aff-84fc-32da6103fd58 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1363 microversion: 2.47 time: 0.418847 May 19 04:50:08.538801 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2271/4458] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:08 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1363 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:08.554461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6d0f4ab5-0569-46e2-bec5-218b3d094b10 req-8c713f67-6dea-4f8d-a9a3-61af6e9c2c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db67f870-0190-4caa-b75c-b46d68452a48", "tag": "f8e68ad4-f663-432e-a6b2-2edf0b57bdac"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:08.570878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6d0f4ab5-0569-46e2-bec5-218b3d094b10 req-8c713f67-6dea-4f8d-a9a3-61af6e9c2c50 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:08.573027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6d0f4ab5-0569-46e2-bec5-218b3d094b10 req-8c713f67-6dea-4f8d-a9a3-61af6e9c2c50 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:08.599198 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6d0f4ab5-0569-46e2-bec5-218b3d094b10 req-8c713f67-6dea-4f8d-a9a3-61af6e9c2c50 service nova] Creating event network-changed:f8e68ad4-f663-432e-a6b2-2edf0b57bdac for instance db67f870-0190-4caa-b75c-b46d68452a48 on n-h2-766726-30 May 19 04:50:08.609154 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6d0f4ab5-0569-46e2-bec5-218b3d094b10 req-8c713f67-6dea-4f8d-a9a3-61af6e9c2c50 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068380 May 19 04:50:08.609983 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2272/4459] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:08.651827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8850b995-d3ab-44a6-a369-9f71b9f37ad7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:08.652797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8850b995-d3ab-44a6-a369-9f71b9f37ad7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:08.659367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:08.661835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8850b995-d3ab-44a6-a369-9f71b9f37ad7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:08.662684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8850b995-d3ab-44a6-a369-9f71b9f37ad7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:08.663669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8850b995-d3ab-44a6-a369-9f71b9f37ad7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:08.664272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8850b995-d3ab-44a6-a369-9f71b9f37ad7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:08.763216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-68984874-70ce-4d7d-9107-bac5c294c175 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:08.781359 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-68984874-70ce-4d7d-9107-bac5c294c175 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1329 microversion: 2.1 time: 0.766726 May 19 04:50:08.781976 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2188/4460] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:08 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1329 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:08.795218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:08.795851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:08.826067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:08.826619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:08.833459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:08.834252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:09.107742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:09.183095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8850b995-d3ab-44a6-a369-9f71b9f37ad7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:09.199698 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8850b995-d3ab-44a6-a369-9f71b9f37ad7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.552609 May 19 04:50:09.200297 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2273/4461] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:08 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:50:09.209301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:09.211294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-00e82b8f-2346-4758-b974-21419bad0e26 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:09.216405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:09.222050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-00e82b8f-2346-4758-b974-21419bad0e26 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:09.224518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:09.226415 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ec026a25-b44d-4a4f-9f47-5c3f13b08cba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1723 microversion: 2.20 time: 0.442274 May 19 04:50:09.243137 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2189/4462] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:08 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1723 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:09.247966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d190f812-9c1d-4cdf-9db4-a2e5b81c135f tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd3145ffc10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:09.264257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00e82b8f-2346-4758-b974-21419bad0e26 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:09.264727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00e82b8f-2346-4758-b974-21419bad0e26 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:09.265543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00e82b8f-2346-4758-b974-21419bad0e26 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:09.265992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00e82b8f-2346-4758-b974-21419bad0e26 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:09.370613 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d190f812-9c1d-4cdf-9db4-a2e5b81c135f tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 200 len: 343 microversion: 2.1 time: 0.126372 May 19 04:50:09.371194 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2190/4463] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:09 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 343 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:09.565783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:09.566783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:09.577713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:09.584170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:09.585837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:09.586489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:09.781412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-00e82b8f-2346-4758-b974-21419bad0e26 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:09.825623 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-00e82b8f-2346-4758-b974-21419bad0e26 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.624121 May 19 04:50:09.826343 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2274/4464] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:09 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:09.827141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:09.845597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-875e64fd-89ae-469f-bfc9-b0596bc42759 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:09.846243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-875e64fd-89ae-469f-bfc9-b0596bc42759 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:09.855050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-875e64fd-89ae-469f-bfc9-b0596bc42759 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:09.855501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-875e64fd-89ae-469f-bfc9-b0596bc42759 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:09.856284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-875e64fd-89ae-469f-bfc9-b0596bc42759 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:09.856733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-875e64fd-89ae-469f-bfc9-b0596bc42759 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:09.863418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:09.864961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:09.868724 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afcc2f70-e59c-419f-82f5-d9f7188be4aa tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 200 len: 1363 microversion: 2.47 time: 0.315320 May 19 04:50:09.889560 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2191/4465] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:09 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:50:10.219129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da29ef9f-9ffa-4cd5-9fad-03b45e335124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:10.219932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da29ef9f-9ffa-4cd5-9fad-03b45e335124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:10.232785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da29ef9f-9ffa-4cd5-9fad-03b45e335124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:10.232785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da29ef9f-9ffa-4cd5-9fad-03b45e335124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:10.232785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da29ef9f-9ffa-4cd5-9fad-03b45e335124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:10.232785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da29ef9f-9ffa-4cd5-9fad-03b45e335124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:11.111576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-875e64fd-89ae-469f-bfc9-b0596bc42759 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:11.124867 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-875e64fd-89ae-469f-bfc9-b0596bc42759 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1329 microversion: 2.1 time: 1.283864 May 19 04:50:11.129189 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2275/4466] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:09 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1329 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:11.136722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da29ef9f-9ffa-4cd5-9fad-03b45e335124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:11.155277 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da29ef9f-9ffa-4cd5-9fad-03b45e335124 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.940062 May 19 04:50:11.158250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:11.171473 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2192/4467] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:10 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:11.172467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:11.181020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:11.181461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:11.182118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:11.182681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:11.191269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da54fa37-574b-46fd-88b5-125b851b8d71 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd3145460d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:11.347055 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da54fa37-574b-46fd-88b5-125b851b8d71 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 200 len: 343 microversion: 2.1 time: 0.175544 May 19 04:50:11.348845 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2193/4468] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:11 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 343 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:11.355235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eb1a5b54-ca30-44a3-959d-f363aaf48983 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:11.357707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eb1a5b54-ca30-44a3-959d-f363aaf48983 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:11.383240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb1a5b54-ca30-44a3-959d-f363aaf48983 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:11.384155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb1a5b54-ca30-44a3-959d-f363aaf48983 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:11.386139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb1a5b54-ca30-44a3-959d-f363aaf48983 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:11.388352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb1a5b54-ca30-44a3-959d-f363aaf48983 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:11.659745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:11.668848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:11.672365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:11.685245 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-23c1e68a-f659-4e98-bd4a-f07884c6c933 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1723 microversion: 2.20 time: 0.554849 May 19 04:50:11.688842 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2276/4469] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:11 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1723 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:11.703357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:11.704325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: aae3bc48-3c3f-42e4-ad7b-8e6085234964] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:11.716097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:11.716828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:11.718026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:11.718640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:11.761906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] HTTP exception thrown: Instance aae3bc48-3c3f-42e4-ad7b-8e6085234964 could not be found. May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Request method failure captured: May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 HTTP/1.1 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcxKQMwhB6r2Ui1XYxpu9XJ8hCtgiw3Do9s9XB2X31rdScHb2JrQ0Bt34yolQ-YYD3W4VDOP-qqE2vkZyKa6KH-R3YksqUAdO1b-c3IGipUmIIKuvW58Gx77hEfTBqnWVZtv-B8cYzMBTlu7XYyiDxXWMChrBVVAiUzNhvwRTwsZCcM May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.47 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: b7e29769f77f42fabcb6056a07149ba0 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerShowV247Test-1290598115 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b7e29769f77f42fabcb6056a07149ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b7e29769f77f42fabcb6056a07149ba0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b7e29769f77f42fabcb6056a07149ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b7e29769f77f42fabcb6056a07149ba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerShowV247Test-1290598115 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: b7e29769f77f42fabcb6056a07149ba0 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerShowV247Test-1290598115 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerShowV247Test-1290598115-project May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 269367cad82c4fe2a3b7591933002b97 May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerShowV247Test-1290598115-project May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance aae3bc48-3c3f-42e4-ad7b-8e6085234964 could not be found. May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'aae3bc48-3c3f-42e4-ad7b-8e6085234964'} May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae3bc48-3c3f-42e4-ad7b-8e6085234964 could not be found. May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae3bc48-3c3f-42e4-ad7b-8e6085234964 could not be found. May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:11.766972 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:11.773908 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:11.773908 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:11.773908 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:11.773908 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:11.773908 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:11.773908 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae3bc48-3c3f-42e4-ad7b-8e6085234964 could not be found. May 19 04:50:11.773908 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:11.774825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Returning 404 to user: Instance aae3bc48-3c3f-42e4-ad7b-8e6085234964 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:11.776021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0868fbd1-5047-464f-a553-a4a5736bc09d tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964" status: 404 len: 111 microversion: 2.47 time: 0.084270 May 19 04:50:11.777327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eb1a5b54-ca30-44a3-959d-f363aaf48983 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:11.780154 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2277/4470] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:11 2022] GET /compute/v2.1/servers/aae3bc48-3c3f-42e4-ad7b-8e6085234964 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:50:11.788317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c85d4c26-607d-4cac-b6c5-c6c527540854 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:11.789240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c85d4c26-607d-4cac-b6c5-c6c527540854 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: d71b6372-bc4a-4ef7-8d48-13552970f9cf] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:11.793594 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eb1a5b54-ca30-44a3-959d-f363aaf48983 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.443206 May 19 04:50:11.794673 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2194/4471] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:11 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:11.798058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c85d4c26-607d-4cac-b6c5-c6c527540854 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:11.798899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c85d4c26-607d-4cac-b6c5-c6c527540854 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:11.799942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c85d4c26-607d-4cac-b6c5-c6c527540854 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:11.800621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c85d4c26-607d-4cac-b6c5-c6c527540854 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:11.831744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c85d4c26-607d-4cac-b6c5-c6c527540854 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: d71b6372-bc4a-4ef7-8d48-13552970f9cf] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:50:11.991056 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c85d4c26-607d-4cac-b6c5-c6c527540854 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf" status: 204 len: 0 microversion: 2.47 time: 0.206724 May 19 04:50:11.992901 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2278/4472] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:50:11 2022] DELETE /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:50:12.001963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:12.003657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: d71b6372-bc4a-4ef7-8d48-13552970f9cf] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:12.016558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:12.018675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:12.019596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:12.020050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:12.091857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:12.183336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2858f563-68d2-4afd-ad94-d1a998df0875 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:12.186276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2858f563-68d2-4afd-ad94-d1a998df0875 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:12.215320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2858f563-68d2-4afd-ad94-d1a998df0875 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:12.215942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2858f563-68d2-4afd-ad94-d1a998df0875 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:12.222376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2858f563-68d2-4afd-ad94-d1a998df0875 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:12.223525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2858f563-68d2-4afd-ad94-d1a998df0875 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:12.278947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:12.296779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:12.303831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:12.308252 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fb7d1c5f-8001-4bc0-a57f-0ba1e449b515 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf" status: 200 len: 1362 microversion: 2.47 time: 0.311234 May 19 04:50:12.317542 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2195/4473] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:11 2022] GET /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:12.332042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8b427f5-09b5-4178-8832-057c298e8b5a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:12.349268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e8b427f5-09b5-4178-8832-057c298e8b5a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:12.381446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8b427f5-09b5-4178-8832-057c298e8b5a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:12.384039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8b427f5-09b5-4178-8832-057c298e8b5a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:12.388345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8b427f5-09b5-4178-8832-057c298e8b5a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:12.392111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8b427f5-09b5-4178-8832-057c298e8b5a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:12.771785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2858f563-68d2-4afd-ad94-d1a998df0875 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:12.779983 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2858f563-68d2-4afd-ad94-d1a998df0875 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.603702 May 19 04:50:12.780922 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2279/4474] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:12 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:50:12.793751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-68e61be4-574c-4ff9-9289-099309b0253b tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd315d80700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:12.863560 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-68e61be4-574c-4ff9-9289-099309b0253b tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] HTTP exception thrown: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-68e61be4-574c-4ff9-9289-099309b0253b tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Request method failure captured: May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 HTTP/1.1 May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcxkMk5vWoJUjbJ7WLebAbWizYcsOL8gAY_ZYgD07yMuCK-HoGb_GODQf34Q0bEfLbhxQGFLiaeIA3679Wu0P6-W60tDlc22CcpwvXcvUUMz__4LerJy3NKApR6dGRztwDbyyVOvjU0RJGhXi7RM8twg9qf5IJfMoscPV3KU2lduxUo May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ef52a9199e1a45bd82a8f1f53cfcb521 May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ef52a9199e1a45bd82a8f1f53cfcb521 May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesSnapshotsTestJSON-195322595-project May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 2607b455b3a64477b3742a9ed454b32c May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195322595-project May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: exception: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2db9684d-910c-40c3-8b97-9430bce081f2'} May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. (HTTP 404) (Request-ID: req-6dad7955-8269-45fe-80a2-5ea4154bbb26) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:50:12.888819 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:12.896229 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:12.902222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-68e61be4-574c-4ff9-9289-099309b0253b tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Returning 404 to user: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:12.902222 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-68e61be4-574c-4ff9-9289-099309b0253b tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 404 len: 109 microversion: 2.1 time: 0.119333 May 19 04:50:12.902865 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2280/4475] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:12 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:12.914178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:12.915043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:12.928662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:12.932968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:12.934375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:12.935038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:13.072521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e8b427f5-09b5-4178-8832-057c298e8b5a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:13.083669 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e8b427f5-09b5-4178-8832-057c298e8b5a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1329 microversion: 2.1 time: 0.764607 May 19 04:50:13.089431 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2196/4476] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:12 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1329 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:13.097753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ebdac758-c328-4f9d-9d34-d0914272e6f4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:13.109870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ebdac758-c328-4f9d-9d34-d0914272e6f4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:13.117809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebdac758-c328-4f9d-9d34-d0914272e6f4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:13.118599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebdac758-c328-4f9d-9d34-d0914272e6f4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:13.119641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebdac758-c328-4f9d-9d34-d0914272e6f4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:13.120354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ebdac758-c328-4f9d-9d34-d0914272e6f4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:13.623688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:13.634708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:13.642016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:13.643747 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a05e44a0-e286-4570-a53c-0b21faafc193 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1723 microversion: 2.20 time: 0.739758 May 19 04:50:13.646199 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2281/4477] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:12 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1723 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:13.656974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1afb05b-811f-4435-bad3-d4f974068a77 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd314caad30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:13.735819 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-f1afb05b-811f-4435-bad3-d4f974068a77 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] HTTP exception thrown: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1afb05b-811f-4435-bad3-d4f974068a77 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Request method failure captured: May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 HTTP/1.1 May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcxkMk5vWoJUjbJ7WLebAbWizYcsOL8gAY_ZYgD07yMuCK-HoGb_GODQf34Q0bEfLbhxQGFLiaeIA3679Wu0P6-W60tDlc22CcpwvXcvUUMz__4LerJy3NKApR6dGRztwDbyyVOvjU0RJGhXi7RM8twg9qf5IJfMoscPV3KU2lduxUo May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ef52a9199e1a45bd82a8f1f53cfcb521 May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ef52a9199e1a45bd82a8f1f53cfcb521 May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesSnapshotsTestJSON-195322595-project May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 2607b455b3a64477b3742a9ed454b32c May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195322595-project May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: exception: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2db9684d-910c-40c3-8b97-9430bce081f2'} May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. (HTTP 404) (Request-ID: req-99f177a4-eacf-46e0-bf1e-7c5d5af898c3) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:50:13.738005 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:13.743494 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:13.749395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1afb05b-811f-4435-bad3-d4f974068a77 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Returning 404 to user: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:13.750154 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1afb05b-811f-4435-bad3-d4f974068a77 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 404 len: 109 microversion: 2.1 time: 0.102675 May 19 04:50:13.750958 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2282/4478] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:50:13 2022] DELETE /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:13.755920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:13.764813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: d71b6372-bc4a-4ef7-8d48-13552970f9cf] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:13.785258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:13.785718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:13.786502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:13.786941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:13.850445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:13.996947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ebdac758-c328-4f9d-9d34-d0914272e6f4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:14.005528 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ebdac758-c328-4f9d-9d34-d0914272e6f4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.913974 May 19 04:50:14.009839 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2197/4479] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:13 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:14.019081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-588ba73d-b66e-4f73-9361-2fdd81a88a94 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Calling method '.version_select at 0x7fd31454a040>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:14.089599 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-588ba73d-b66e-4f73-9361-2fdd81a88a94 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] HTTP exception thrown: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-588ba73d-b66e-4f73-9361-2fdd81a88a94 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Request method failure captured: May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 HTTP/1.1 May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcxkMk5vWoJUjbJ7WLebAbWizYcsOL8gAY_ZYgD07yMuCK-HoGb_GODQf34Q0bEfLbhxQGFLiaeIA3679Wu0P6-W60tDlc22CcpwvXcvUUMz__4LerJy3NKApR6dGRztwDbyyVOvjU0RJGhXi7RM8twg9qf5IJfMoscPV3KU2lduxUo May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ef52a9199e1a45bd82a8f1f53cfcb521 May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ef52a9199e1a45bd82a8f1f53cfcb521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ef52a9199e1a45bd82a8f1f53cfcb521 May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195322595 May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-VolumesSnapshotsTestJSON-195322595-project May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 2607b455b3a64477b3742a9ed454b32c May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195322595-project May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: exception: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2db9684d-910c-40c3-8b97-9430bce081f2'} May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. (HTTP 404) (Request-ID: req-4917e837-d441-4263-9135-1c3717348cf0) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:50:14.091666 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-588ba73d-b66e-4f73-9361-2fdd81a88a94 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] Returning 404 to user: Volume 2db9684d-910c-40c3-8b97-9430bce081f2 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:14.097222 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-588ba73d-b66e-4f73-9361-2fdd81a88a94 tempest-VolumesSnapshotsTestJSON-195322595 tempest-VolumesSnapshotsTestJSON-195322595-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2" status: 404 len: 109 microversion: 2.1 time: 0.082174 May 19 04:50:14.109602 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2198/4480] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:14 2022] GET /compute/v2.1/os-volumes/2db9684d-910c-40c3-8b97-9430bce081f2 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:14.116046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9563b0f8-28fc-4e51-9769-4f2a9d717e70 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:14.117527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9563b0f8-28fc-4e51-9769-4f2a9d717e70 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:14.151542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9563b0f8-28fc-4e51-9769-4f2a9d717e70 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:14.151994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9563b0f8-28fc-4e51-9769-4f2a9d717e70 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:14.152788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9563b0f8-28fc-4e51-9769-4f2a9d717e70 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:14.153258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9563b0f8-28fc-4e51-9769-4f2a9d717e70 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:14.172972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:14.193286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:14.212192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '269367cad82c4fe2a3b7591933002b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e29769f77f42fabcb6056a07149ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:14.220688 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a33c23cc-c102-4266-8cf0-2147251ef283 tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf" status: 200 len: 1362 microversion: 2.47 time: 0.461219 May 19 04:50:14.224271 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2283/4481] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:13 2022] GET /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:14.259969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6093961e-3db5-469b-a066-048a018010e0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:14.260602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6093961e-3db5-469b-a066-048a018010e0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:14.287545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6093961e-3db5-469b-a066-048a018010e0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:14.288046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6093961e-3db5-469b-a066-048a018010e0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:14.288858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6093961e-3db5-469b-a066-048a018010e0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:14.289337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6093961e-3db5-469b-a066-048a018010e0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:15.131436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9563b0f8-28fc-4e51-9769-4f2a9d717e70 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:15.140621 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9563b0f8-28fc-4e51-9769-4f2a9d717e70 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 1.040462 May 19 04:50:15.153160 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2199/4482] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:14 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:15.167411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bfeee6f6-cdbe-4391-8127-9ba7c5eb71c9 req-785f6ad1-3112-4baf-87ce-392ad75e0cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db67f870-0190-4caa-b75c-b46d68452a48", "name": "network-vif-plugged", "status": "completed", "tag": "f8e68ad4-f663-432e-a6b2-2edf0b57bdac"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:15.186074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bfeee6f6-cdbe-4391-8127-9ba7c5eb71c9 req-785f6ad1-3112-4baf-87ce-392ad75e0cbb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:15.186819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bfeee6f6-cdbe-4391-8127-9ba7c5eb71c9 req-785f6ad1-3112-4baf-87ce-392ad75e0cbb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:15.196252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6093961e-3db5-469b-a066-048a018010e0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:15.206549 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6093961e-3db5-469b-a066-048a018010e0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1329 microversion: 2.1 time: 0.979349 May 19 04:50:15.209879 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2284/4483] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:14 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1329 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:15.222277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:15.229192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:15.234845 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bfeee6f6-cdbe-4391-8127-9ba7c5eb71c9 req-785f6ad1-3112-4baf-87ce-392ad75e0cbb service nova] Creating event network-vif-plugged:f8e68ad4-f663-432e-a6b2-2edf0b57bdac for instance db67f870-0190-4caa-b75c-b46d68452a48 on n-h2-766726-30 May 19 04:50:15.250119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:15.254299 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bfeee6f6-cdbe-4391-8127-9ba7c5eb71c9 req-785f6ad1-3112-4baf-87ce-392ad75e0cbb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099461 May 19 04:50:15.255154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:15.256203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:15.257301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:15.266611 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2200/4484] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:15.297570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9c96fbe-7a67-40c1-9bec-dc8ffd31603a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:15.298832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b9c96fbe-7a67-40c1-9bec-dc8ffd31603a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:15.324626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9c96fbe-7a67-40c1-9bec-dc8ffd31603a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:15.325100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9c96fbe-7a67-40c1-9bec-dc8ffd31603a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:15.325930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9c96fbe-7a67-40c1-9bec-dc8ffd31603a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:15.326372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9c96fbe-7a67-40c1-9bec-dc8ffd31603a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:16.216765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:16.224472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b9c96fbe-7a67-40c1-9bec-dc8ffd31603a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:16.239304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:16.240441 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b9c96fbe-7a67-40c1-9bec-dc8ffd31603a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.970999 May 19 04:50:16.243328 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2201/4485] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:15 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:16.244995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:16.246411 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6477e0af-20b6-4f21-bdec-f78c5bd7e2d5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1744 microversion: 2.20 time: 1.035146 May 19 04:50:16.260309 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2285/4486] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:15 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1744 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:16.262905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:16.264021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] [instance: d71b6372-bc4a-4ef7-8d48-13552970f9cf] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:16.265104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-314e12a5-9e11-433e-bdaa-5369b30abfd6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:16.275839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-314e12a5-9e11-433e-bdaa-5369b30abfd6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:16.283168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:16.284993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:16.288352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:16.292646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:16.299366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-314e12a5-9e11-433e-bdaa-5369b30abfd6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:16.299814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-314e12a5-9e11-433e-bdaa-5369b30abfd6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:16.300594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-314e12a5-9e11-433e-bdaa-5369b30abfd6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:16.301029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-314e12a5-9e11-433e-bdaa-5369b30abfd6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:16.350812 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] HTTP exception thrown: Instance d71b6372-bc4a-4ef7-8d48-13552970f9cf could not be found. May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Request method failure captured: May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf HTTP/1.1 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcxKQMwhB6r2Ui1XYxpu9XJ8hCtgiw3Do9s9XB2X31rdScHb2JrQ0Bt34yolQ-YYD3W4VDOP-qqE2vkZyKa6KH-R3YksqUAdO1b-c3IGipUmIIKuvW58Gx77hEfTBqnWVZtv-B8cYzMBTlu7XYyiDxXWMChrBVVAiUzNhvwRTwsZCcM May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.47 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: b7e29769f77f42fabcb6056a07149ba0 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerShowV247Test-1290598115 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b7e29769f77f42fabcb6056a07149ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b7e29769f77f42fabcb6056a07149ba0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b7e29769f77f42fabcb6056a07149ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b7e29769f77f42fabcb6056a07149ba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerShowV247Test-1290598115 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: b7e29769f77f42fabcb6056a07149ba0 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerShowV247Test-1290598115 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerShowV247Test-1290598115-project May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 269367cad82c4fe2a3b7591933002b97 May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerShowV247Test-1290598115-project May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance d71b6372-bc4a-4ef7-8d48-13552970f9cf could not be found. May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'd71b6372-bc4a-4ef7-8d48-13552970f9cf'} May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d71b6372-bc4a-4ef7-8d48-13552970f9cf could not be found. May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d71b6372-bc4a-4ef7-8d48-13552970f9cf could not be found. May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:16.355842 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:16.361279 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:16.361279 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:16.361279 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:16.361279 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:16.361279 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:16.361279 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d71b6372-bc4a-4ef7-8d48-13552970f9cf could not be found. May 19 04:50:16.361279 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:16.365207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] Returning 404 to user: Instance d71b6372-bc4a-4ef7-8d48-13552970f9cf could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:16.367756 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d3dab99a-c56a-4433-8427-d075ab167cbf tempest-ServerShowV247Test-1290598115 tempest-ServerShowV247Test-1290598115-project] 10.222.0.58 "GET /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf" status: 404 len: 111 microversion: 2.47 time: 0.121241 May 19 04:50:16.375458 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2202/4487] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:16 2022] GET /compute/v2.1/servers/d71b6372-bc4a-4ef7-8d48-13552970f9cf => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:50:16.390436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70a32e23-815e-46a4-a36a-352ba0e8a7df tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:16.391484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-70a32e23-815e-46a4-a36a-352ba0e8a7df tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:16.408505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70a32e23-815e-46a4-a36a-352ba0e8a7df tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:16.432694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70a32e23-815e-46a4-a36a-352ba0e8a7df tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:16.439938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70a32e23-815e-46a4-a36a-352ba0e8a7df tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:16.441684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70a32e23-815e-46a4-a36a-352ba0e8a7df tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:16.604438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:16.937645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:17.029360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-314e12a5-9e11-433e-bdaa-5369b30abfd6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:17.038996 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-314e12a5-9e11-433e-bdaa-5369b30abfd6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.777014 May 19 04:50:17.047250 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2286/4488] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:16 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:17.083836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-70a32e23-815e-46a4-a36a-352ba0e8a7df tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:17.166530 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-70a32e23-815e-46a4-a36a-352ba0e8a7df tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1329 microversion: 2.1 time: 0.789398 May 19 04:50:17.168888 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2203/4489] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:16 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1329 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:17.263194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-11b06e90-a463-4562-8391-33b8680da72a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:17.264439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-11b06e90-a463-4562-8391-33b8680da72a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:17.284810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:17.287045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:17.326231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11b06e90-a463-4562-8391-33b8680da72a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:17.330428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11b06e90-a463-4562-8391-33b8680da72a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:17.336495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:17.339651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11b06e90-a463-4562-8391-33b8680da72a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:17.340569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11b06e90-a463-4562-8391-33b8680da72a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:17.341448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:17.344340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:17.348201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:17.890808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:17.914554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:17.920336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:17.924422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0d938142-4f7d-4cca-8f8d-299fa111e1f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 0.646691 May 19 04:50:17.937865 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2204/4490] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:17 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:18.102478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-11b06e90-a463-4562-8391-33b8680da72a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:18.118644 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-11b06e90-a463-4562-8391-33b8680da72a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.862483 May 19 04:50:18.121670 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2287/4491] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:17 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:18.143373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-49bdcce1-2bab-47e7-821b-9ce8ff355567 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:18.144541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-49bdcce1-2bab-47e7-821b-9ce8ff355567 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:18.162739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49bdcce1-2bab-47e7-821b-9ce8ff355567 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:18.164022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49bdcce1-2bab-47e7-821b-9ce8ff355567 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:18.164976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49bdcce1-2bab-47e7-821b-9ce8ff355567 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:18.165672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-49bdcce1-2bab-47e7-821b-9ce8ff355567 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:18.357015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-746df19e-738f-43de-aaab-4f57f9e97239 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Action: 'create', calling method: .version_select at 0x7fd3145c0310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-930998083", "metadata": {"Type": "work"}}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:18.749047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-49bdcce1-2bab-47e7-821b-9ce8ff355567 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:18.759003 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-49bdcce1-2bab-47e7-821b-9ce8ff355567 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.635861 May 19 04:50:18.771130 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2288/4492] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:18 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:18.777953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e99059af-5afe-4f30-872e-7aed6884ce26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:18.778970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e99059af-5afe-4f30-872e-7aed6884ce26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:18.786390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e99059af-5afe-4f30-872e-7aed6884ce26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:18.787816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e99059af-5afe-4f30-872e-7aed6884ce26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:18.789243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e99059af-5afe-4f30-872e-7aed6884ce26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:18.790562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e99059af-5afe-4f30-872e-7aed6884ce26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:19.094499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e99059af-5afe-4f30-872e-7aed6884ce26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:19.101885 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-746df19e-738f-43de-aaab-4f57f9e97239 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.162842 May 19 04:50:19.103074 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2205/4493] 10.222.0.58 () {60 vars in 1155 bytes} [Thu May 19 04:50:17 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1165 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 04:50:19.107875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-790b249f-9c71-45e9-8da8-41192f57320c req-0cdc44dd-1fe9-4852-8a75-f548038513a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894769ad-4295-4aff-8ba0-30957e6ec8da", "name": "network-vif-plugged", "status": "completed", "tag": "738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:19.111893 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e99059af-5afe-4f30-872e-7aed6884ce26 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1509 microversion: 2.1 time: 0.339088 May 19 04:50:19.112248 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2289/4494] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:18 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:19.125743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-790b249f-9c71-45e9-8da8-41192f57320c req-0cdc44dd-1fe9-4852-8a75-f548038513a4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:19.126492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-790b249f-9c71-45e9-8da8-41192f57320c req-0cdc44dd-1fe9-4852-8a75-f548038513a4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:19.140235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:19.140864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:19.162744 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-790b249f-9c71-45e9-8da8-41192f57320c req-0cdc44dd-1fe9-4852-8a75-f548038513a4 service nova] Creating event network-vif-plugged:738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4 for instance 894769ad-4295-4aff-8ba0-30957e6ec8da on n-h1-766726-30 May 19 04:50:19.164069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:19.164522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:19.165333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:19.165769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:19.169866 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-790b249f-9c71-45e9-8da8-41192f57320c req-0cdc44dd-1fe9-4852-8a75-f548038513a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065347 May 19 04:50:19.171711 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2206/4495] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:19.199117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4aeb985-95f0-4fab-9185-1941f1527805 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd3144f8f70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:19.380741 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4aeb985-95f0-4fab-9185-1941f1527805 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 352 microversion: 2.1 time: 0.205586 May 19 04:50:19.381494 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2207/4496] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:19 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:19.388471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0edbaf7f-6e04-4021-916b-f94c087ba432 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:19.389918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0edbaf7f-6e04-4021-916b-f94c087ba432 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:19.408225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0edbaf7f-6e04-4021-916b-f94c087ba432 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:19.408673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0edbaf7f-6e04-4021-916b-f94c087ba432 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:19.420501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0edbaf7f-6e04-4021-916b-f94c087ba432 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:19.420975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0edbaf7f-6e04-4021-916b-f94c087ba432 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:19.582814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:19.596767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:19.606712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:19.611470 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39973f2f-702d-4be6-be67-c06597af7b28 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 0.483635 May 19 04:50:19.625858 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2290/4497] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:19 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:19.649925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4ff5058b-e97c-45d4-ba3f-374ef0c7c437 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:19.650938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4ff5058b-e97c-45d4-ba3f-374ef0c7c437 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:19.658582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ff5058b-e97c-45d4-ba3f-374ef0c7c437 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:19.659464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ff5058b-e97c-45d4-ba3f-374ef0c7c437 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:19.660594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ff5058b-e97c-45d4-ba3f-374ef0c7c437 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:19.661356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ff5058b-e97c-45d4-ba3f-374ef0c7c437 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:19.849123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0edbaf7f-6e04-4021-916b-f94c087ba432 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:19.868933 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0edbaf7f-6e04-4021-916b-f94c087ba432 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1509 microversion: 2.1 time: 0.486485 May 19 04:50:19.883953 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2208/4498] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:19 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1509 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:19.891900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-261874aa-5776-447b-b1f6-073687d02af7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:19.896301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-261874aa-5776-447b-b1f6-073687d02af7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:19.916539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-261874aa-5776-447b-b1f6-073687d02af7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:19.917512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-261874aa-5776-447b-b1f6-073687d02af7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:19.921872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-261874aa-5776-447b-b1f6-073687d02af7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:19.923493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-261874aa-5776-447b-b1f6-073687d02af7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:20.342493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4ff5058b-e97c-45d4-ba3f-374ef0c7c437 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:20.364642 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4ff5058b-e97c-45d4-ba3f-374ef0c7c437 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1655 microversion: 2.1 time: 0.727844 May 19 04:50:20.364642 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2291/4499] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:19 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1655 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:20.393943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef003112-5a29-4863-92f4-579417e004ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:20.397551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef003112-5a29-4863-92f4-579417e004ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:20.431151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef003112-5a29-4863-92f4-579417e004ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:20.431653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef003112-5a29-4863-92f4-579417e004ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:20.432478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef003112-5a29-4863-92f4-579417e004ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:20.432923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef003112-5a29-4863-92f4-579417e004ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:20.486018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-261874aa-5776-447b-b1f6-073687d02af7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:20.503147 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-261874aa-5776-447b-b1f6-073687d02af7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.617853 May 19 04:50:20.503748 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2209/4500] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:19 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:20.531046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f60dde7-9ecf-4a6a-895f-d7181e42ae9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:20.549982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f60dde7-9ecf-4a6a-895f-d7181e42ae9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:20.554957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f60dde7-9ecf-4a6a-895f-d7181e42ae9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:20.567169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef003112-5a29-4863-92f4-579417e004ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:50:20.647425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7f60dde7-9ecf-4a6a-895f-d7181e42ae9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Going to try to start instance {{(pid=124819) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 04:50:20.787146 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7f60dde7-9ecf-4a6a-895f-d7181e42ae9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.278081 May 19 04:50:20.792922 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2210/4501] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:20 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:20.816100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-51b623f5-7f32-41a8-909f-1e819eb9bcbf tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd31451d4c0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:20.868775 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef003112-5a29-4863-92f4-579417e004ef tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 204 len: 0 microversion: 2.1 time: 0.506186 May 19 04:50:20.881393 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2292/4502] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:50:20 2022] DELETE /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:50:20.934280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:20.935508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:20.970988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:20.976239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:20.980348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:20.980804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:21.051482 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-51b623f5-7f32-41a8-909f-1e819eb9bcbf tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 352 microversion: 2.1 time: 0.254329 May 19 04:50:21.052279 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2211/4503] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:20 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 352 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:21.056946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc00c788-f18d-4873-bda1-7aca8a1ab47f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:21.057721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fc00c788-f18d-4873-bda1-7aca8a1ab47f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:21.094494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc00c788-f18d-4873-bda1-7aca8a1ab47f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:21.094955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc00c788-f18d-4873-bda1-7aca8a1ab47f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:21.095756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc00c788-f18d-4873-bda1-7aca8a1ab47f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:21.096193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc00c788-f18d-4873-bda1-7aca8a1ab47f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:21.372120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:21.396740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:21.399970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:21.402514 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-880778ea-6c72-4161-a980-2cf1ed487eb0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 0.515981 May 19 04:50:21.431628 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2293/4504] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:20 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:21.446176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7f720ab-5c8b-4dab-8963-2fdee8ea5d19 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:21.463716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7f720ab-5c8b-4dab-8963-2fdee8ea5d19 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:21.485616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7f720ab-5c8b-4dab-8963-2fdee8ea5d19 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:21.486296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7f720ab-5c8b-4dab-8963-2fdee8ea5d19 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:21.487789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7f720ab-5c8b-4dab-8963-2fdee8ea5d19 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:21.488545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7f720ab-5c8b-4dab-8963-2fdee8ea5d19 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:21.907465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fc00c788-f18d-4873-bda1-7aca8a1ab47f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:21.922884 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc00c788-f18d-4873-bda1-7aca8a1ab47f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1664 microversion: 2.1 time: 0.867689 May 19 04:50:21.938756 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2212/4505] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:21 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1664 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:21.953024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a7f720ab-5c8b-4dab-8963-2fdee8ea5d19 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:21.958182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-479d1731-4851-4403-a399-26e147c7bea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:21.959109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-479d1731-4851-4403-a399-26e147c7bea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:21.963721 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7f720ab-5c8b-4dab-8963-2fdee8ea5d19 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1515 microversion: 2.1 time: 0.529238 May 19 04:50:21.977436 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2294/4506] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:21 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1515 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:21.980493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-479d1731-4851-4403-a399-26e147c7bea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:21.981698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-479d1731-4851-4403-a399-26e147c7bea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:21.987284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-479d1731-4851-4403-a399-26e147c7bea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:21.992340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-479d1731-4851-4403-a399-26e147c7bea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:22.063803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-10a904ec-2c96-4f36-ba36-a800ffded9ad tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd314c18820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:22.215869 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-10a904ec-2c96-4f36-ba36-a800ffded9ad tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 352 microversion: 2.1 time: 0.155906 May 19 04:50:22.216892 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2295/4507] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:22 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:22.429824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:22.430598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:22.460524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:22.461021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:22.466334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:22.466797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:22.487136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-479d1731-4851-4403-a399-26e147c7bea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:22.496632 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-479d1731-4851-4403-a399-26e147c7bea9 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.555010 May 19 04:50:22.510224 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2213/4508] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:21 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:22.945052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9c68f13c-1344-48f0-b056-89022d907d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:22.945899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9c68f13c-1344-48f0-b056-89022d907d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:22.964701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c68f13c-1344-48f0-b056-89022d907d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:22.965372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c68f13c-1344-48f0-b056-89022d907d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:22.966289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c68f13c-1344-48f0-b056-89022d907d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:22.966861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c68f13c-1344-48f0-b056-89022d907d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:24.596805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:24.611185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:24.627573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:24.627766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9c68f13c-1344-48f0-b056-89022d907d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:24.636937 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9c68f13c-1344-48f0-b056-89022d907d1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1664 microversion: 2.1 time: 1.696909 May 19 04:50:24.640130 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82a0b5bc-db12-4cb2-a6a6-ec968b4987bd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 2.216463 May 19 04:50:24.640717 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2214/4509] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:22 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1664 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:24.642090 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2296/4510] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:22 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:50:24.656936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c09733ab-18a8-46b5-aeb2-d061c06eac84 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd314c44ee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:24.698087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ef371d8-854d-40b4-a69e-68e936cdfe4d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:24.698713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4ef371d8-854d-40b4-a69e-68e936cdfe4d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:24.717054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ef371d8-854d-40b4-a69e-68e936cdfe4d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:24.717526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ef371d8-854d-40b4-a69e-68e936cdfe4d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:24.718307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ef371d8-854d-40b4-a69e-68e936cdfe4d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:24.718741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ef371d8-854d-40b4-a69e-68e936cdfe4d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:24.763473 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c09733ab-18a8-46b5-aeb2-d061c06eac84 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 353 microversion: 2.1 time: 0.118653 May 19 04:50:24.764314 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2297/4511] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:24 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:24.779447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4feab23d-3ca6-4378-b594-99a8e0614f77 req-c43daa01-5f41-4258-8bf0-cec29814e88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878aa03f-a366-4d71-b678-1c749fc143c6", "name": "network-vif-plugged", "status": "completed", "tag": "ba6e6c22-0bce-4292-b1fd-46293b3f4ad6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:24.824150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4feab23d-3ca6-4378-b594-99a8e0614f77 req-c43daa01-5f41-4258-8bf0-cec29814e88b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:24.824888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4feab23d-3ca6-4378-b594-99a8e0614f77 req-c43daa01-5f41-4258-8bf0-cec29814e88b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:24.850410 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4feab23d-3ca6-4378-b594-99a8e0614f77 req-c43daa01-5f41-4258-8bf0-cec29814e88b service nova] Creating event network-vif-plugged:ba6e6c22-0bce-4292-b1fd-46293b3f4ad6 for instance 878aa03f-a366-4d71-b678-1c749fc143c6 on n-h2-766726-30 May 19 04:50:24.870256 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4feab23d-3ca6-4378-b594-99a8e0614f77 req-c43daa01-5f41-4258-8bf0-cec29814e88b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104415 May 19 04:50:24.870917 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2298/4512] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:24.879381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba3a0973-760c-47f3-88be-3e8777f08f62 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:24.880379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba3a0973-760c-47f3-88be-3e8777f08f62 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:24.889905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba3a0973-760c-47f3-88be-3e8777f08f62 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:24.890648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba3a0973-760c-47f3-88be-3e8777f08f62 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:24.892022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba3a0973-760c-47f3-88be-3e8777f08f62 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:24.892642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba3a0973-760c-47f3-88be-3e8777f08f62 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:25.701232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4ef371d8-854d-40b4-a69e-68e936cdfe4d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:25.714732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4ef371d8-854d-40b4-a69e-68e936cdfe4d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1515 microversion: 2.1 time: 1.051355 May 19 04:50:25.717809 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2215/4513] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:24 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1515 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:25.726636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-11b4cb29-2d42-4406-9e2a-ac83ee20716c tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd314564ee0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:25.759263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba3a0973-760c-47f3-88be-3e8777f08f62 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:25.779598 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba3a0973-760c-47f3-88be-3e8777f08f62 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.906962 May 19 04:50:25.784120 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2299/4514] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:24 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:25.796209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-638db912-2038-4292-babf-1d4a3b11eaf3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:25.797268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-638db912-2038-4292-babf-1d4a3b11eaf3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:25.808737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638db912-2038-4292-babf-1d4a3b11eaf3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:25.809323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638db912-2038-4292-babf-1d4a3b11eaf3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:25.811156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638db912-2038-4292-babf-1d4a3b11eaf3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:25.811657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638db912-2038-4292-babf-1d4a3b11eaf3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:25.856061 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-11b4cb29-2d42-4406-9e2a-ac83ee20716c tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 353 microversion: 2.1 time: 0.136849 May 19 04:50:25.856954 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2216/4515] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:25 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:25.861751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:25.862671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:25.888400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:25.890159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:25.891238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:25.898496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:26.382745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:26.384967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-638db912-2038-4292-babf-1d4a3b11eaf3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:26.393892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:26.401218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-638db912-2038-4292-babf-1d4a3b11eaf3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1664 microversion: 2.1 time: 0.610720 May 19 04:50:26.408605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:26.411212 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2300/4516] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:25 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1664 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:26.411385 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6abb0c9b-b48d-4d1b-817e-eb0eefc3a881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 0.553011 May 19 04:50:26.417877 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2217/4517] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:25 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:26.423311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8363ab20-872c-4b2a-94a3-284746f45906 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd314d53dc0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:26.431071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9c510980-492a-45e1-89f5-3acecaf7b154 req-66b58c76-e9eb-44c0-87db-1d2ae48f8287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db67f870-0190-4caa-b75c-b46d68452a48", "name": "network-vif-deleted", "tag": "f8e68ad4-f663-432e-a6b2-2edf0b57bdac"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:26.478875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9c510980-492a-45e1-89f5-3acecaf7b154 req-66b58c76-e9eb-44c0-87db-1d2ae48f8287 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:26.490146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9c510980-492a-45e1-89f5-3acecaf7b154 req-66b58c76-e9eb-44c0-87db-1d2ae48f8287 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:26.510570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:26.530290 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9c510980-492a-45e1-89f5-3acecaf7b154 req-66b58c76-e9eb-44c0-87db-1d2ae48f8287 service nova] Creating event network-vif-deleted:f8e68ad4-f663-432e-a6b2-2edf0b57bdac for instance db67f870-0190-4caa-b75c-b46d68452a48 on n-h2-766726-30 May 19 04:50:26.541065 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9c510980-492a-45e1-89f5-3acecaf7b154 req-66b58c76-e9eb-44c0-87db-1d2ae48f8287 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117652 May 19 04:50:26.542474 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2218/4518] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:26.587142 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8363ab20-872c-4b2a-94a3-284746f45906 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 202 len: 0 microversion: 2.1 time: 0.171530 May 19 04:50:26.587468 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2301/4519] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:50:26 2022] DELETE /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:26.589054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8363ab20-872c-4b2a-94a3-284746f45906 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:26.590257 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8363ab20-872c-4b2a-94a3-284746f45906 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001498 May 19 04:50:26.591088 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2302/4520] 10.222.0.58 () {56 vars in 885 bytes} [Thu May 19 04:50:26 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 04:50:26.612051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd714010-3ebc-4770-9a3f-8d4c43dda819 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd314c18040>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:26.770213 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd714010-3ebc-4770-9a3f-8d4c43dda819 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 352 microversion: 2.1 time: 0.177839 May 19 04:50:26.775893 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2303/4521] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:26 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:26.781333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:26.782037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:26.822886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:26.825006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:26.828058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:26.828977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:26.846405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:26.907714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:26.909313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:26.911305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lazy-loading 'fault' on Instance uuid db67f870-0190-4caa-b75c-b46d68452a48 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:50:27.056807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:27.068605 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c5fdeb5-b22c-40e8-a3b2-9ea99c451e6f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 200 len: 1319 microversion: 2.1 time: 0.288956 May 19 04:50:27.069835 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2304/4522] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:26 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:27.095428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b42253e-9869-470e-bc9e-196b2f7f9ec5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:27.096315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8b42253e-9869-470e-bc9e-196b2f7f9ec5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:27.104734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b42253e-9869-470e-bc9e-196b2f7f9ec5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:27.104985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6e594e5d-a0fd-47f8-87c0-4e8331cf3024 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Action: 'create', calling method: .version_select at 0x7fd3145f21f0>, body: {"keypair": {"name": "tempest-keypair-87607397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0O7sexMOZgkhO/+QpnHgMYL17zlqOzdkUNlchY5NMkmSnze93DnzP3OWhwvniA6KJ182FQiHeJ6Qm3JED39DkTQ7Buw06ynQ68bJQTT02hPkO199BcSmue3xTKofvM/g=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:27.107042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b42253e-9869-470e-bc9e-196b2f7f9ec5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:27.107042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b42253e-9869-470e-bc9e-196b2f7f9ec5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:27.108463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b42253e-9869-470e-bc9e-196b2f7f9ec5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:27.176849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6e594e5d-a0fd-47f8-87c0-4e8331cf3024 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Getting quotas for project 4dabcb42b8fd408cbeddbac6b5c90ba5. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:50:27.207183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6e594e5d-a0fd-47f8-87c0-4e8331cf3024 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Getting quotas for user 2900a0416a1245d09eddd97c329c9fca and project 4dabcb42b8fd408cbeddbac6b5c90ba5. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:50:27.292228 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6e594e5d-a0fd-47f8-87c0-4e8331cf3024 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.748257 May 19 04:50:27.293320 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2219/4523] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:50:26 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:27.418123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e4017cb9-3518-4ded-9180-e51227ad8573 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:27.425757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e4017cb9-3518-4ded-9180-e51227ad8573 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:27.438379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4017cb9-3518-4ded-9180-e51227ad8573 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:27.447282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4017cb9-3518-4ded-9180-e51227ad8573 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:27.448364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4017cb9-3518-4ded-9180-e51227ad8573 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:27.448983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4017cb9-3518-4ded-9180-e51227ad8573 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:27.529165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8b42253e-9869-470e-bc9e-196b2f7f9ec5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:27.542130 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b42253e-9869-470e-bc9e-196b2f7f9ec5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.454336 May 19 04:50:27.546037 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2305/4524] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:27 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:27.568014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:27.578121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:27.586213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:27.586879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:27.593682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:27.594360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:27.904985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4017cb9-3518-4ded-9180-e51227ad8573 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:27.925520 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e4017cb9-3518-4ded-9180-e51227ad8573 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.511180 May 19 04:50:27.940035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:27.948097 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2220/4525] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:27 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:27.954974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:27.959884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e1f3087-3c1f-4042-9840-3b5c935006d2 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd31453d040>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:27.962243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:27.971363 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ebac159b-480e-4ce9-b002-392ad4016e94 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 0.417160 May 19 04:50:27.974304 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2306/4526] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:27 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:27.990915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-301db912-73e2-44b0-a1b7-378ddb0ee27b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:27.992152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-301db912-73e2-44b0-a1b7-378ddb0ee27b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:28.038640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-301db912-73e2-44b0-a1b7-378ddb0ee27b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:28.039500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-301db912-73e2-44b0-a1b7-378ddb0ee27b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:28.041430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-301db912-73e2-44b0-a1b7-378ddb0ee27b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:28.043392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-301db912-73e2-44b0-a1b7-378ddb0ee27b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:28.105941 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e1f3087-3c1f-4042-9840-3b5c935006d2 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 352 microversion: 2.1 time: 0.157200 May 19 04:50:28.106712 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2221/4527] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:27 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:28.117294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:28.117927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:28.137340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:28.138246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:28.139106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:28.139837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:28.175685 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 HTTP/1.1 May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'db67f870-0190-4caa-b75c-b46d68452a48'} May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:28.187538 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:28.192724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:28.192724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:28.192724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:28.192724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:28.192724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:50:28.192724 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:28.196956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:28.196956 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e1005393-1fb1-40d7-8a43-3e9e414b884a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 404 len: 111 microversion: 2.1 time: 0.088047 May 19 04:50:28.200821 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2222/4528] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:28 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:28.216911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2fe1ce87-2810-4a5d-9157-335596bed7ed tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '.version_select at 0x7fd31450ca60>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:28.250973 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2fe1ce87-2810-4a5d-9157-335596bed7ed tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-key-1401585655" status: 202 len: 0 microversion: 2.1 time: 0.048073 May 19 04:50:28.252237 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2223/4529] 10.222.0.58 () {58 vars in 1208 bytes} [Thu May 19 04:50:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1401585655 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:28.442694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2088122075", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:28.557466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] validate_networks() for [('3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:50:28.567805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-301db912-73e2-44b0-a1b7-378ddb0ee27b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:28.576937 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-301db912-73e2-44b0-a1b7-378ddb0ee27b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.601101 May 19 04:50:28.578277 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2307/4530] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:27 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:28.583760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ce8f671-a0ca-45d2-8bc2-48b0e8198742 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:28.584679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8ce8f671-a0ca-45d2-8bc2-48b0e8198742 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:28.595266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ce8f671-a0ca-45d2-8bc2-48b0e8198742 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:28.597545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ce8f671-a0ca-45d2-8bc2-48b0e8198742 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:28.598659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ce8f671-a0ca-45d2-8bc2-48b0e8198742 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:28.601500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ce8f671-a0ca-45d2-8bc2-48b0e8198742 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:29.118741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8ce8f671-a0ca-45d2-8bc2-48b0e8198742 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:29.135691 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ce8f671-a0ca-45d2-8bc2-48b0e8198742 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1517 microversion: 2.1 time: 0.555639 May 19 04:50:29.146657 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2308/4531] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:28 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1517 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:29.160536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b4f416b9-837d-4e7f-9946-d31df468ea1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:29.161152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4f416b9-837d-4e7f-9946-d31df468ea1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:29.174253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f416b9-837d-4e7f-9946-d31df468ea1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:29.188598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f416b9-837d-4e7f-9946-d31df468ea1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:29.193381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f416b9-837d-4e7f-9946-d31df468ea1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:29.194651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4f416b9-837d-4e7f-9946-d31df468ea1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:29.303159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4f416b9-837d-4e7f-9946-d31df468ea1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Unlocking {{(pid=124818) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 19 04:50:29.447782 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b4f416b9-837d-4e7f-9946-d31df468ea1c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.292578 May 19 04:50:29.453126 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2309/4532] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:29 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:29.475424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:29.475424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:29.477754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:29.478412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:29.481347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:29.481977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:30.077094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:30.128627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:30.131158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:30.133748 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f407e53f-447d-4ade-a4fe-e5b027ef26b8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 0.684129 May 19 04:50:30.134572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:50:30.135054 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2310/4533] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:29 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:30.135640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:50:30.136283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:50:30.136853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:50:30.137568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:50:30.141420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db5bd401-392d-4d24-b33a-48ea6bda7981 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd314c18a60>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:30.164507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:30.164973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:30.165819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:30.166267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:30.206681 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-db5bd401-392d-4d24-b33a-48ea6bda7981 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 352 microversion: 2.1 time: 0.070668 May 19 04:50:30.207789 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2311/4534] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:30 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:30.214477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-efcd1e21-b9f0-4716-8cbd-e9c5b12d7df4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:30.215337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-efcd1e21-b9f0-4716-8cbd-e9c5b12d7df4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:30.223756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:50:30.229825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for user a75cb8e84f674ef0814a39d2a4887933 and project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:50:30.251706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:50:30.255249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:50:30.265019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efcd1e21-b9f0-4716-8cbd-e9c5b12d7df4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:30.266244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efcd1e21-b9f0-4716-8cbd-e9c5b12d7df4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:30.268220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efcd1e21-b9f0-4716-8cbd-e9c5b12d7df4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:30.271418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efcd1e21-b9f0-4716-8cbd-e9c5b12d7df4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:30.331017 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3e8a708-8782-4fce-abd6-325dd5ac203e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.892607 May 19 04:50:30.336723 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2224/4535] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:50:30.347494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a5dbf355-eed7-4fd3-a752-a944bd66f28b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:30.367954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a5dbf355-eed7-4fd3-a752-a944bd66f28b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:30.378908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5dbf355-eed7-4fd3-a752-a944bd66f28b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:30.379363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5dbf355-eed7-4fd3-a752-a944bd66f28b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:30.384443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5dbf355-eed7-4fd3-a752-a944bd66f28b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:30.385016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5dbf355-eed7-4fd3-a752-a944bd66f28b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:30.741482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-efcd1e21-b9f0-4716-8cbd-e9c5b12d7df4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:30.756980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-efcd1e21-b9f0-4716-8cbd-e9c5b12d7df4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.546917 May 19 04:50:30.760942 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2312/4536] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:30 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:30.774266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-106a0d62-e9ba-4569-9b45-cda3b8f2411b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:30.775349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-106a0d62-e9ba-4569-9b45-cda3b8f2411b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:30.919606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a5dbf355-eed7-4fd3-a752-a944bd66f28b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:30.929631 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a5dbf355-eed7-4fd3-a752-a944bd66f28b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.590826 May 19 04:50:30.930231 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2225/4537] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:30 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:30.959738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5cfeef64-cd41-4bad-8d29-e05759cfdd37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:30.961942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5cfeef64-cd41-4bad-8d29-e05759cfdd37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:30.978099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cfeef64-cd41-4bad-8d29-e05759cfdd37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:30.997194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cfeef64-cd41-4bad-8d29-e05759cfdd37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:31.003621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cfeef64-cd41-4bad-8d29-e05759cfdd37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:31.004336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cfeef64-cd41-4bad-8d29-e05759cfdd37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:31.041964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-106a0d62-e9ba-4569-9b45-cda3b8f2411b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:31.056696 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-106a0d62-e9ba-4569-9b45-cda3b8f2411b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1209 microversion: 2.1 time: 0.290577 May 19 04:50:31.057394 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2313/4538] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:30 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1209 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:31.066783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e9e323f2-0dde-4f7e-ae0a-84dfd8086bd7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:31.066783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e9e323f2-0dde-4f7e-ae0a-84dfd8086bd7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:31.100989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9e323f2-0dde-4f7e-ae0a-84dfd8086bd7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:31.104158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9e323f2-0dde-4f7e-ae0a-84dfd8086bd7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:31.107836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9e323f2-0dde-4f7e-ae0a-84dfd8086bd7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:31.122720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e9e323f2-0dde-4f7e-ae0a-84dfd8086bd7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:31.369862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5cfeef64-cd41-4bad-8d29-e05759cfdd37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:31.384024 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5cfeef64-cd41-4bad-8d29-e05759cfdd37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.452667 May 19 04:50:31.397464 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2226/4539] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:30 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:31.403469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:31.404043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:31.434072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:31.434531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:31.435324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:31.435781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:31.585176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e9e323f2-0dde-4f7e-ae0a-84dfd8086bd7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:31.609608 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e9e323f2-0dde-4f7e-ae0a-84dfd8086bd7 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.551064 May 19 04:50:31.610347 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2314/4540] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:31 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:31.628183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0df5df74-444a-46bb-8737-50d78e490809 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd314bcd430>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:31.738485 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0df5df74-444a-46bb-8737-50d78e490809 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 352 microversion: 2.1 time: 0.115367 May 19 04:50:31.745287 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2315/4541] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:31 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:31.751125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:31.752087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:31.760668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:31.761521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:31.762841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:31.763541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:31.782442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:31.794422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:31.797467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:31.799026 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b509c18-9316-4332-a95f-f81484d363dd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 0.399904 May 19 04:50:31.799800 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2227/4542] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:31 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:31.838597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-882894505", "imageRef": "1f3283d4-83d3-4375-b4cd-51b51ff1a42c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6267df56-5547-45f6-8fc2-3a749b2a65c3"}], "security_groups": [{"name": "tempest-securitygroup--672503498"}], "key_name": "tempest-keypair-87607397", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:32.141689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:32.152685 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.405870 May 19 04:50:32.169790 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2316/4543] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:31 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:32.175191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:32.175191 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eca52cd1-25b5-46da-8c3d-0769ab065c46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001418 May 19 04:50:32.175191 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2317/4544] 10.222.0.58 () {56 vars in 885 bytes} [Thu May 19 04:50:32 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 04:50:32.182705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-add2669b-1159-4ebd-a90d-5ebabe000e37 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:32.187103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-add2669b-1159-4ebd-a90d-5ebabe000e37 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:32.209056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-add2669b-1159-4ebd-a90d-5ebabe000e37 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:32.212661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-add2669b-1159-4ebd-a90d-5ebabe000e37 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:32.214401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-add2669b-1159-4ebd-a90d-5ebabe000e37 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:32.217338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-add2669b-1159-4ebd-a90d-5ebabe000e37 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:32.221777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] validate_networks() for [('6267df56-5547-45f6-8fc2-3a749b2a65c3', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:50:32.586663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-add2669b-1159-4ebd-a90d-5ebabe000e37 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:32.601277 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-add2669b-1159-4ebd-a90d-5ebabe000e37 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.428099 May 19 04:50:32.616500 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2318/4545] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:32 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:32.637102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bafc08e1-734a-481f-ab2a-d8106bd2a251 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:32.643500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bafc08e1-734a-481f-ab2a-d8106bd2a251 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:32.665963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bafc08e1-734a-481f-ab2a-d8106bd2a251 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:32.670513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bafc08e1-734a-481f-ab2a-d8106bd2a251 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:32.671553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bafc08e1-734a-481f-ab2a-d8106bd2a251 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:32.672164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bafc08e1-734a-481f-ab2a-d8106bd2a251 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:32.926891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bafc08e1-734a-481f-ab2a-d8106bd2a251 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:32.935493 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bafc08e1-734a-481f-ab2a-d8106bd2a251 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1269 microversion: 2.1 time: 0.317519 May 19 04:50:32.947083 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2319/4546] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:32 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1269 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:32.975792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8bda5d34-450e-4897-98e5-f538541e3709 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:32.976378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8bda5d34-450e-4897-98e5-f538541e3709 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:33.005137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bda5d34-450e-4897-98e5-f538541e3709 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:33.005601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bda5d34-450e-4897-98e5-f538541e3709 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:33.006432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bda5d34-450e-4897-98e5-f538541e3709 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:33.006877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bda5d34-450e-4897-98e5-f538541e3709 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:33.555586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:50:33.556153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:50:33.556486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:50:33.556904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:50:33.560320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:50:33.571498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:33.572261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:33.573319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:33.573939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:33.611926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Getting quotas for project 4dabcb42b8fd408cbeddbac6b5c90ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:50:33.613830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:33.643047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Getting quotas for user 2900a0416a1245d09eddd97c329c9fca and project 4dabcb42b8fd408cbeddbac6b5c90ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:50:33.677427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:50:33.681731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3283d4-83d3-4375-b4cd-51b51ff1a42c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:50:33.758573 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1aa1493f-69d1-4594-ae7b-f1b62720ef91 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.956608 May 19 04:50:33.771986 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2228/4547] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:50:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:50:33.780492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f215abf1-367a-4318-8482-402e21531508 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:33.789120 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-f215abf1-367a-4318-8482-402e21531508 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 05062e09-e3cf-4e98-8f26-8e5289c7894b has no mapping to a cell. May 19 04:50:33.801882 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8bda5d34-450e-4897-98e5-f538541e3709 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.853155 May 19 04:50:33.804117 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2320/4548] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:32 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 856 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f215abf1-367a-4318-8482-402e21531508 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/05062e09-e3cf-4e98-8f26-8e5289c7894b/action HTTP/1.1 May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 15 May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: {"os-stop": {}} May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 05062e09-e3cf-4e98-8f26-8e5289c7894b has no mapping to a cell. May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '05062e09-e3cf-4e98-8f26-8e5289c7894b', 'body': {'os-stop': {}}} May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1410, in _get_instance May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 05062e09-e3cf-4e98-8f26-8e5289c7894b has no mapping to a cell. May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1443, in _stop_server May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1417, in _get_instance May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:33.840576 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05062e09-e3cf-4e98-8f26-8e5289c7894b has no mapping to a cell. May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05062e09-e3cf-4e98-8f26-8e5289c7894b has no mapping to a cell. May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:33.846675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f215abf1-367a-4318-8482-402e21531508 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 05062e09-e3cf-4e98-8f26-8e5289c7894b has no mapping to a cell. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:33.848202 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f215abf1-367a-4318-8482-402e21531508 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/05062e09-e3cf-4e98-8f26-8e5289c7894b/action" status: 404 len: 117 microversion: 2.1 time: 0.073828 May 19 04:50:33.848991 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2229/4549] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:33 2022] POST /compute/v2.1/servers/05062e09-e3cf-4e98-8f26-8e5289c7894b/action => generated 117 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:33.859913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:33.861410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ce43429e-7af4-4891-be82-ec9c2b77d771 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd314c44e50>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:33.866197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:33.891663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:33.892257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:33.893678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:33.894362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:34.011025 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ce43429e-7af4-4891-be82-ec9c2b77d771 tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 200 len: 352 microversion: 2.1 time: 0.205468 May 19 04:50:34.012122 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2321/4550] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:33 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 352 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:34.020725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-58cd6716-ba33-4390-8cc9-cea743e9f173 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:34.024323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-58cd6716-ba33-4390-8cc9-cea743e9f173 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:34.329708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-58cd6716-ba33-4390-8cc9-cea743e9f173 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:34.338331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-58cd6716-ba33-4390-8cc9-cea743e9f173 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1243 microversion: 2.1 time: 0.324449 May 19 04:50:34.345780 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2322/4551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:34 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1243 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:34.352821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82eafc2a-c30e-461c-b35d-3313a1eb062a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:34.366379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82eafc2a-c30e-461c-b35d-3313a1eb062a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:34.382272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82eafc2a-c30e-461c-b35d-3313a1eb062a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:34.399314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82eafc2a-c30e-461c-b35d-3313a1eb062a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:34.406572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82eafc2a-c30e-461c-b35d-3313a1eb062a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:34.416458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82eafc2a-c30e-461c-b35d-3313a1eb062a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:34.419813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:34.463541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:34.479599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:34.481490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:34.482725 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-440b8a3f-311d-4861-966a-430e69dad793 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 0.627721 May 19 04:50:34.485766 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2230/4552] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:33 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:34.502619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-67050485-07a4-44ba-9f24-1c810b4a4ca6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:34.505519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-67050485-07a4-44ba-9f24-1c810b4a4ca6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:34.519253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67050485-07a4-44ba-9f24-1c810b4a4ca6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:34.522802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67050485-07a4-44ba-9f24-1c810b4a4ca6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:34.523854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67050485-07a4-44ba-9f24-1c810b4a4ca6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:34.524481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67050485-07a4-44ba-9f24-1c810b4a4ca6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:34.999130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82eafc2a-c30e-461c-b35d-3313a1eb062a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:35.012614 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82eafc2a-c30e-461c-b35d-3313a1eb062a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1653 microversion: 2.1 time: 0.665435 May 19 04:50:35.015698 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2323/4553] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:34 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1653 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:35.027904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a93a9221-dcaa-4838-bba1-4a83f248d8ac tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:35.028530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a93a9221-dcaa-4838-bba1-4a83f248d8ac tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:35.051002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a93a9221-dcaa-4838-bba1-4a83f248d8ac tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.051460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a93a9221-dcaa-4838-bba1-4a83f248d8ac tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:35.053743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a93a9221-dcaa-4838-bba1-4a83f248d8ac tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.056120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a93a9221-dcaa-4838-bba1-4a83f248d8ac tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:35.116521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-67050485-07a4-44ba-9f24-1c810b4a4ca6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:35.124793 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-67050485-07a4-44ba-9f24-1c810b4a4ca6 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.634290 May 19 04:50:35.128169 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2231/4554] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:34 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:35.147430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-847c6317-6b63-4dbf-a70b-80e3eefc2c7a tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Calling method '.version_select at 0x7fd3145c0b80>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:35.213294 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-847c6317-6b63-4dbf-a70b-80e3eefc2c7a tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] HTTP exception thrown: Volume 1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 could not be found. May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-847c6317-6b63-4dbf-a70b-80e3eefc2c7a tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Request method failure captured: May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 HTTP/1.1 May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcyJEB-Q5QhGB9NYOqrIvL_8MP1PrKo6HdJWpNDP_6ROf6jTm0cq6jO2lOr0qvY3n9agTe7bvlnI8FMVgyprv2By9ylxppJMFsXxAZsLuRGgXLBrtXOL7rla6ANOulAUXvJBRjek0vbAie0PBMHVN3I9pqE47w3mg3dXWsbyPlQ2nYU May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 06e66105de2b44f5a7bc38acfc1af44e May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-VolumesGetTestJSON-668257568 May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/06e66105de2b44f5a7bc38acfc1af44e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/06e66105de2b44f5a7bc38acfc1af44e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/06e66105de2b44f5a7bc38acfc1af44e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_06e66105de2b44f5a7bc38acfc1af44e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-VolumesGetTestJSON-668257568 May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 06e66105de2b44f5a7bc38acfc1af44e May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-VolumesGetTestJSON-668257568 May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-VolumesGetTestJSON-668257568-project May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5a6967d14dad433d9cc0dcae486c0ecb May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-VolumesGetTestJSON-668257568-project May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: exception: Volume 1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 could not be found. May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '1a8e3369-41f2-4f81-b4f9-bf9de8d395d2'} May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 could not be found. (HTTP 404) (Request-ID: req-ba66b8a9-2a5a-434f-afc2-2f3b071ddab8) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:50:35.215417 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 could not be found. May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 could not be found. May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 could not be found. May 19 04:50:35.220641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:35.224640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-847c6317-6b63-4dbf-a70b-80e3eefc2c7a tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] Returning 404 to user: Volume 1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:35.226071 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-847c6317-6b63-4dbf-a70b-80e3eefc2c7a tempest-VolumesGetTestJSON-668257568 tempest-VolumesGetTestJSON-668257568-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2" status: 404 len: 109 microversion: 2.1 time: 0.092118 May 19 04:50:35.226841 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2232/4555] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:35 2022] GET /compute/v2.1/os-volumes/1a8e3369-41f2-4f81-b4f9-bf9de8d395d2 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:35.243666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-747c04c9-13f7-497f-93ef-46feae54f090 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:35.250346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-747c04c9-13f7-497f-93ef-46feae54f090 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:35.264676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-747c04c9-13f7-497f-93ef-46feae54f090 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.266098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-747c04c9-13f7-497f-93ef-46feae54f090 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:35.267920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-747c04c9-13f7-497f-93ef-46feae54f090 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.268937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-747c04c9-13f7-497f-93ef-46feae54f090 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:35.512378 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-747c04c9-13f7-497f-93ef-46feae54f090 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.283982 May 19 04:50:35.518494 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2233/4556] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:35 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:35.556495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-681d5bb1-1a8d-46b7-8990-51496e239f77 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:35.557651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-681d5bb1-1a8d-46b7-8990-51496e239f77 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:35.587348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-681d5bb1-1a8d-46b7-8990-51496e239f77 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.606004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-681d5bb1-1a8d-46b7-8990-51496e239f77 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:35.606859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-681d5bb1-1a8d-46b7-8990-51496e239f77 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.607308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-681d5bb1-1a8d-46b7-8990-51496e239f77 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:35.625474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a93a9221-dcaa-4838-bba1-4a83f248d8ac tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:35.634196 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a93a9221-dcaa-4838-bba1-4a83f248d8ac tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1309 microversion: 2.1 time: 0.617414 May 19 04:50:35.634769 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2324/4557] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:35 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1309 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:35.644157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48d707dd-a7e1-4525-b626-aea9cf98a9b7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:35.648244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48d707dd-a7e1-4525-b626-aea9cf98a9b7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:35.657243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:35.679253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d707dd-a7e1-4525-b626-aea9cf98a9b7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.679253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d707dd-a7e1-4525-b626-aea9cf98a9b7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:35.680009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d707dd-a7e1-4525-b626-aea9cf98a9b7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.680009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d707dd-a7e1-4525-b626-aea9cf98a9b7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:35.900406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-48d707dd-a7e1-4525-b626-aea9cf98a9b7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:35.933028 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48d707dd-a7e1-4525-b626-aea9cf98a9b7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1295 microversion: 2.1 time: 0.292107 May 19 04:50:35.933684 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2325/4558] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:35 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1295 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:35.959619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:35.966043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:35.985608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.986325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:35.989238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:35.991599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:36.246423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-681d5bb1-1a8d-46b7-8990-51496e239f77 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:36.258394 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-681d5bb1-1a8d-46b7-8990-51496e239f77 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.734608 May 19 04:50:36.262053 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2234/4559] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:35 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:36.266948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dd18fca5-f706-40d0-81b0-f87a484330dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:36.278175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dd18fca5-f706-40d0-81b0-f87a484330dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:36.318947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd18fca5-f706-40d0-81b0-f87a484330dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:36.319400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd18fca5-f706-40d0-81b0-f87a484330dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:36.320193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd18fca5-f706-40d0-81b0-f87a484330dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:36.320626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd18fca5-f706-40d0-81b0-f87a484330dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:36.866069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dd18fca5-f706-40d0-81b0-f87a484330dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:36.878539 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dd18fca5-f706-40d0-81b0-f87a484330dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.611350 May 19 04:50:36.881160 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2235/4560] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:36 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:36.892686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1054ee45-d7bb-4f0c-a8b9-03fcb507aafc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:36.893281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1054ee45-d7bb-4f0c-a8b9-03fcb507aafc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: bc7addef-3c9d-4dfa-8940-0e25fddd9245] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:36.916254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-1054ee45-d7bb-4f0c-a8b9-03fcb507aafc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance bc7addef-3c9d-4dfa-8940-0e25fddd9245 could not be found. May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1054ee45-d7bb-4f0c-a8b9-03fcb507aafc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/bc7addef-3c9d-4dfa-8940-0e25fddd9245/action HTTP/1.1 May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 15 May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: {"suspend": {}} May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance bc7addef-3c9d-4dfa-8940-0e25fddd9245 could not be found. May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'bc7addef-3c9d-4dfa-8940-0e25fddd9245', 'body': {'suspend': {}}} May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc7addef-3c9d-4dfa-8940-0e25fddd9245 could not be found. May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc7addef-3c9d-4dfa-8940-0e25fddd9245 could not be found. May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:36.921321 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:36.926673 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:36.926673 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:36.926673 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc7addef-3c9d-4dfa-8940-0e25fddd9245 could not be found. May 19 04:50:36.926673 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:36.941213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1054ee45-d7bb-4f0c-a8b9-03fcb507aafc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance bc7addef-3c9d-4dfa-8940-0e25fddd9245 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:36.942429 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1054ee45-d7bb-4f0c-a8b9-03fcb507aafc tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/bc7addef-3c9d-4dfa-8940-0e25fddd9245/action" status: 404 len: 111 microversion: 2.1 time: 0.060198 May 19 04:50:36.947627 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2236/4561] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:36 2022] POST /compute/v2.1/servers/bc7addef-3c9d-4dfa-8940-0e25fddd9245/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:36.955152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a18e757-6770-4453-a294-12a76dc08e95 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:36.963921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3a18e757-6770-4453-a294-12a76dc08e95 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:36.990560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a18e757-6770-4453-a294-12a76dc08e95 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:36.991020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a18e757-6770-4453-a294-12a76dc08e95 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:36.992952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a18e757-6770-4453-a294-12a76dc08e95 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:36.995749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a18e757-6770-4453-a294-12a76dc08e95 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:37.107970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:37.130458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:37.132413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:37.142003 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-87595aae-8caa-4b23-9f2a-093441ff164a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 1.201902 May 19 04:50:37.143083 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2326/4562] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:35 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:37.157666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7ca61e4d-3927-4e97-acb3-891f5150478a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:37.158709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7ca61e4d-3927-4e97-acb3-891f5150478a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:37.175720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ca61e4d-3927-4e97-acb3-891f5150478a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:37.176459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ca61e4d-3927-4e97-acb3-891f5150478a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:37.177540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ca61e4d-3927-4e97-acb3-891f5150478a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:37.178766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ca61e4d-3927-4e97-acb3-891f5150478a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:37.632961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3a18e757-6770-4453-a294-12a76dc08e95 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:37.654712 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a18e757-6770-4453-a294-12a76dc08e95 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1309 microversion: 2.1 time: 0.705622 May 19 04:50:37.671933 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2237/4563] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:36 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1309 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:37.678721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4e49414-793e-463d-b4ef-c8a5e4ba8b59 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:37.679571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4e49414-793e-463d-b4ef-c8a5e4ba8b59 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:37.725179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e49414-793e-463d-b4ef-c8a5e4ba8b59 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:37.728733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e49414-793e-463d-b4ef-c8a5e4ba8b59 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:37.730710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e49414-793e-463d-b4ef-c8a5e4ba8b59 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:37.731639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e49414-793e-463d-b4ef-c8a5e4ba8b59 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:37.792932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7ca61e4d-3927-4e97-acb3-891f5150478a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:37.800745 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7ca61e4d-3927-4e97-acb3-891f5150478a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.652691 May 19 04:50:37.804742 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2327/4564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:37 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:37.823060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d54a9c7-4718-4ff8-9e87-7957f5f43d0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:37.843598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d54a9c7-4718-4ff8-9e87-7957f5f43d0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:37.864216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d54a9c7-4718-4ff8-9e87-7957f5f43d0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:37.866185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d54a9c7-4718-4ff8-9e87-7957f5f43d0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:37.868409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d54a9c7-4718-4ff8-9e87-7957f5f43d0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:37.873730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d54a9c7-4718-4ff8-9e87-7957f5f43d0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:37.931073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a4e49414-793e-463d-b4ef-c8a5e4ba8b59 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:37.938723 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4e49414-793e-463d-b4ef-c8a5e4ba8b59 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1301 microversion: 2.1 time: 0.265772 May 19 04:50:37.939307 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2238/4565] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:37 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1301 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:37.973284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ae793ad9-b37b-487d-a602-d0238d5b8ec1 req-a1e86f26-5fdf-4a24-8c22-3782202bd3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13fda296-1b39-442f-9602-e20099131e85", "tag": "81881db8-d56a-466d-bb0f-1fccff5c8a98"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:38.010048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ae793ad9-b37b-487d-a602-d0238d5b8ec1 req-a1e86f26-5fdf-4a24-8c22-3782202bd3b6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:38.010645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ae793ad9-b37b-487d-a602-d0238d5b8ec1 req-a1e86f26-5fdf-4a24-8c22-3782202bd3b6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:38.051148 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ae793ad9-b37b-487d-a602-d0238d5b8ec1 req-a1e86f26-5fdf-4a24-8c22-3782202bd3b6 service nova] Creating event network-changed:81881db8-d56a-466d-bb0f-1fccff5c8a98 for instance 13fda296-1b39-442f-9602-e20099131e85 on n-h1-766726-30 May 19 04:50:38.080895 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ae793ad9-b37b-487d-a602-d0238d5b8ec1 req-a1e86f26-5fdf-4a24-8c22-3782202bd3b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127439 May 19 04:50:38.081543 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2239/4566] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:38.103894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d9112fe5-3136-426c-b97b-53162b6d520f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:38.110545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d9112fe5-3136-426c-b97b-53162b6d520f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:38.121850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9112fe5-3136-426c-b97b-53162b6d520f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:38.122654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9112fe5-3136-426c-b97b-53162b6d520f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:38.123629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9112fe5-3136-426c-b97b-53162b6d520f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:38.124659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9112fe5-3136-426c-b97b-53162b6d520f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:38.522245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0d54a9c7-4718-4ff8-9e87-7957f5f43d0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:38.535660 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d54a9c7-4718-4ff8-9e87-7957f5f43d0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.728847 May 19 04:50:38.554778 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2328/4567] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:37 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:38.564458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:38.571042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:38.587791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:38.589436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:38.592959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:38.593769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:39.065674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d9112fe5-3136-426c-b97b-53162b6d520f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:39.105370 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d9112fe5-3136-426c-b97b-53162b6d520f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 1.015209 May 19 04:50:39.117124 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2240/4568] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:38 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:39.125896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0fbd1d5e-929f-4a9d-bf6e-982e6ec8a614 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:39.129958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0fbd1d5e-929f-4a9d-bf6e-982e6ec8a614 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:39.151489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fbd1d5e-929f-4a9d-bf6e-982e6ec8a614 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:39.151971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fbd1d5e-929f-4a9d-bf6e-982e6ec8a614 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:39.159243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fbd1d5e-929f-4a9d-bf6e-982e6ec8a614 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:39.159243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fbd1d5e-929f-4a9d-bf6e-982e6ec8a614 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:39.508257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:39.538345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:39.540617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:39.557254 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1e93073-4aca-4ffc-975b-25b729f80c61 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 1.001318 May 19 04:50:39.569833 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2329/4569] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:38 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:39.576576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-093b944c-e39a-400c-a1aa-0a91c2d7b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:39.584488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-093b944c-e39a-400c-a1aa-0a91c2d7b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:39.608388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-093b944c-e39a-400c-a1aa-0a91c2d7b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:39.617814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-093b944c-e39a-400c-a1aa-0a91c2d7b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:39.618947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-093b944c-e39a-400c-a1aa-0a91c2d7b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:39.623738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-093b944c-e39a-400c-a1aa-0a91c2d7b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:40.557655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0fbd1d5e-929f-4a9d-bf6e-982e6ec8a614 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:40.570138 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0fbd1d5e-929f-4a9d-bf6e-982e6ec8a614 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 1.460571 May 19 04:50:40.573406 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2241/4570] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:39 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:40.586007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bb9d6068-3696-4867-a3d4-6f920a694368 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:40.587014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bb9d6068-3696-4867-a3d4-6f920a694368 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:40.605263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb9d6068-3696-4867-a3d4-6f920a694368 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:40.606050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb9d6068-3696-4867-a3d4-6f920a694368 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:40.607110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb9d6068-3696-4867-a3d4-6f920a694368 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:40.609488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb9d6068-3696-4867-a3d4-6f920a694368 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:40.698960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-093b944c-e39a-400c-a1aa-0a91c2d7b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:40.721347 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-093b944c-e39a-400c-a1aa-0a91c2d7b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1309 microversion: 2.1 time: 1.149366 May 19 04:50:40.748659 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2330/4571] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:39 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1309 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:40.759504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-620ff484-acbb-4b15-89a9-773e0ddd8e9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:40.760593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-620ff484-acbb-4b15-89a9-773e0ddd8e9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:40.778225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb9d6068-3696-4867-a3d4-6f920a694368 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:40.789511 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bb9d6068-3696-4867-a3d4-6f920a694368 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1301 microversion: 2.1 time: 0.208254 May 19 04:50:40.790376 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2242/4572] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:40 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1301 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:40.811648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-620ff484-acbb-4b15-89a9-773e0ddd8e9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:40.812187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-620ff484-acbb-4b15-89a9-773e0ddd8e9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:40.819114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-620ff484-acbb-4b15-89a9-773e0ddd8e9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:40.822460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-620ff484-acbb-4b15-89a9-773e0ddd8e9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:41.418646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bbcf212b-c618-44a4-95ce-1386e8c809c1 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Action: 'create', calling method: .version_select at 0x7fd31450caf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-877859696", "metadata": {"Type": "work"}}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bbcf212b-c618-44a4-95ce-1386e8c809c1 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Request method failure captured: May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 121 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcyfG5N83T4-kVbI1xkElmU6UItGvMXJEXeD-SRCJl2cQLrtWaQ0wELdSA8ON8lyBr6ZJTN6D3Q2OY4lW3DW2_h0WKdK3HcT5XZoYcdb8Jzx-pGLCVFDDciloU1FCRa6J09Q1mMBP99fV3zRHUGsJwOHl9aGNI-bvaOH_747AR_byLA May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-VolumesNegativeTest-2072778335 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: b8b5ec6eb7c948649670b2a45d27db87 May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-877859696", "metadata": {"Type": "work"}}} May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-877859696', 'metadata': {'Type': 'work'}}}} May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi '#$%' May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:50:41.428126 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bbcf212b-c618-44a4-95ce-1386e8c809c1 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bbcf212b-c618-44a4-95ce-1386e8c809c1 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.625641 May 19 04:50:41.433457 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2243/4573] 10.222.0.58 () {60 vars in 1155 bytes} [Thu May 19 04:50:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 640 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:50:41.436065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:41.436837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:41.447163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-620ff484-acbb-4b15-89a9-773e0ddd8e9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:41.453876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:41.456498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:41.457534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:41.458886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:41.461393 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-620ff484-acbb-4b15-89a9-773e0ddd8e9d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.707458 May 19 04:50:41.465404 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2331/4574] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:40 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:41.476883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-93fd6bc5-1030-41bd-b992-f4ace89fd3ee tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:41.480079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-93fd6bc5-1030-41bd-b992-f4ace89fd3ee tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:41.482906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:41.501474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93fd6bc5-1030-41bd-b992-f4ace89fd3ee tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:41.504005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93fd6bc5-1030-41bd-b992-f4ace89fd3ee tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:41.507313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93fd6bc5-1030-41bd-b992-f4ace89fd3ee tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:41.507963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93fd6bc5-1030-41bd-b992-f4ace89fd3ee tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:41.620376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-93fd6bc5-1030-41bd-b992-f4ace89fd3ee tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lazy-loading 'flavor' on Instance uuid 878aa03f-a366-4d71-b678-1c749fc143c6 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:50:41.791971 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-93fd6bc5-1030-41bd-b992-f4ace89fd3ee tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 202 len: 0 microversion: 2.1 time: 0.325227 May 19 04:50:41.798004 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2332/4575] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:41 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:50:41.811915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:41.825211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:41.830452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:41.834669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bb05f76-1636-4c0a-af0d-4a277afe14cd tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Action: 'create', calling method: .version_select at 0x7fd314e2a040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-118970115", "metadata": {"Type": "work"}}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bb05f76-1636-4c0a-af0d-4a277afe14cd tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Request method failure captured: May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 119 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcyfG5N83T4-kVbI1xkElmU6UItGvMXJEXeD-SRCJl2cQLrtWaQ0wELdSA8ON8lyBr6ZJTN6D3Q2OY4lW3DW2_h0WKdK3HcT5XZoYcdb8Jzx-pGLCVFDDciloU1FCRa6J09Q1mMBP99fV3zRHUGsJwOHl9aGNI-bvaOH_747AR_byLA May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesNegativeTest-2072778335 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b8b5ec6eb7c948649670b2a45d27db87 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-118970115", "metadata": {"Type": "work"}}} May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-118970115', 'metadata': {'Type': 'work'}}}} May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi '0' May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:50:41.842849 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 04:50:41.864223 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:41.868817 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-71d980c2-2138-462e-bc98-677a97da80a2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1739 microversion: 2.20 time: 0.408047 May 19 04:50:41.868817 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2244/4576] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:41 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1739 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:41.868817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8b9ceb10-217c-4dbd-b7e2-79b1af8f2f48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:41.869333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8b9ceb10-217c-4dbd-b7e2-79b1af8f2f48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:41.871461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bb05f76-1636-4c0a-af0d-4a277afe14cd tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:41.874370 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4bb05f76-1636-4c0a-af0d-4a277afe14cd tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.073275 May 19 04:50:41.875373 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2333/4577] 10.222.0.58 () {60 vars in 1155 bytes} [Thu May 19 04:50:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:50:41.882055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f7251d10-2c49-4cdd-9261-5bba1f42a311 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:41.883076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f7251d10-2c49-4cdd-9261-5bba1f42a311 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:41.891841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8b9ceb10-217c-4dbd-b7e2-79b1af8f2f48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:41.892203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7251d10-2c49-4cdd-9261-5bba1f42a311 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:41.892834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7251d10-2c49-4cdd-9261-5bba1f42a311 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:41.893945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7251d10-2c49-4cdd-9261-5bba1f42a311 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:41.894641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7251d10-2c49-4cdd-9261-5bba1f42a311 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:41.898780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8b9ceb10-217c-4dbd-b7e2-79b1af8f2f48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:41.899561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8b9ceb10-217c-4dbd-b7e2-79b1af8f2f48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:41.900001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8b9ceb10-217c-4dbd-b7e2-79b1af8f2f48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:42.512437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8b9ceb10-217c-4dbd-b7e2-79b1af8f2f48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:42.535958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f7251d10-2c49-4cdd-9261-5bba1f42a311 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:42.539613 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8b9ceb10-217c-4dbd-b7e2-79b1af8f2f48 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.671632 May 19 04:50:42.555939 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2245/4578] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:41 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:42.562157 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f7251d10-2c49-4cdd-9261-5bba1f42a311 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1309 microversion: 2.1 time: 0.684458 May 19 04:50:42.567407 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2334/4579] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:41 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1309 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:42.571128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-78d4a14c-35ff-4d8a-a28e-8f83a7272bac tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:42.574967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-78d4a14c-35ff-4d8a-a28e-8f83a7272bac tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:42.581964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-792855fd-f743-4584-8c2a-d9d3359bf45f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:42.586730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-792855fd-f743-4584-8c2a-d9d3359bf45f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:42.599208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78d4a14c-35ff-4d8a-a28e-8f83a7272bac tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:42.601806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78d4a14c-35ff-4d8a-a28e-8f83a7272bac tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:42.602818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78d4a14c-35ff-4d8a-a28e-8f83a7272bac tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:42.605292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78d4a14c-35ff-4d8a-a28e-8f83a7272bac tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:42.613542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-792855fd-f743-4584-8c2a-d9d3359bf45f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:42.614026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-792855fd-f743-4584-8c2a-d9d3359bf45f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:42.616000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-792855fd-f743-4584-8c2a-d9d3359bf45f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:42.616457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-792855fd-f743-4584-8c2a-d9d3359bf45f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:42.999137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-78d4a14c-35ff-4d8a-a28e-8f83a7272bac tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:43.011152 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-78d4a14c-35ff-4d8a-a28e-8f83a7272bac tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1512 microversion: 2.1 time: 0.448201 May 19 04:50:43.021128 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2246/4580] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:42 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1512 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:43.026875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3cb4f13-7fe1-4d19-a3eb-189f9dc65fff tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Action: 'create', calling method: .version_select at 0x7fd31447dd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1376062559", "metadata": {"Type": "work"}}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:43.033539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-792855fd-f743-4584-8c2a-d9d3359bf45f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3cb4f13-7fe1-4d19-a3eb-189f9dc65fff tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Request method failure captured: May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 119 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcyfG5N83T4-kVbI1xkElmU6UItGvMXJEXeD-SRCJl2cQLrtWaQ0wELdSA8ON8lyBr6ZJTN6D3Q2OY4lW3DW2_h0WKdK3HcT5XZoYcdb8Jzx-pGLCVFDDciloU1FCRa6J09Q1mMBP99fV3zRHUGsJwOHl9aGNI-bvaOH_747AR_byLA May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-VolumesNegativeTest-2072778335 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: b8b5ec6eb7c948649670b2a45d27db87 May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1376062559", "metadata": {"Type": "work"}}} May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1376062559', 'metadata': {'Type': 'work'}}}} May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi '' May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:50:43.036775 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 04:50:43.042120 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:43.046169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3cb4f13-7fe1-4d19-a3eb-189f9dc65fff tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:43.047207 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3cb4f13-7fe1-4d19-a3eb-189f9dc65fff tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024242 May 19 04:50:43.053212 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-792855fd-f743-4584-8c2a-d9d3359bf45f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.480578 May 19 04:50:43.054055 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2335/4581] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:42 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:43.061136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e03fde12-94ad-41fe-9605-037d4c32f6e5 req-7d85eec8-10e2-4114-ac08-2e552338ba80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13fda296-1b39-442f-9602-e20099131e85", "name": "network-vif-plugged", "status": "completed", "tag": "81881db8-d56a-466d-bb0f-1fccff5c8a98"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:43.062795 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2247/4582] 10.222.0.58 () {60 vars in 1155 bytes} [Thu May 19 04:50:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:50:43.068722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-77663446-1d84-4f32-b294-1a2ba683046a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:43.073975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-77663446-1d84-4f32-b294-1a2ba683046a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:43.077807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e03fde12-94ad-41fe-9605-037d4c32f6e5 req-7d85eec8-10e2-4114-ac08-2e552338ba80 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:43.078603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e03fde12-94ad-41fe-9605-037d4c32f6e5 req-7d85eec8-10e2-4114-ac08-2e552338ba80 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:43.091551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77663446-1d84-4f32-b294-1a2ba683046a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:43.094048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77663446-1d84-4f32-b294-1a2ba683046a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:43.094048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77663446-1d84-4f32-b294-1a2ba683046a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:43.094048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77663446-1d84-4f32-b294-1a2ba683046a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:43.099730 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e03fde12-94ad-41fe-9605-037d4c32f6e5 req-7d85eec8-10e2-4114-ac08-2e552338ba80 service nova] Creating event network-vif-plugged:81881db8-d56a-466d-bb0f-1fccff5c8a98 for instance 13fda296-1b39-442f-9602-e20099131e85 on n-h1-766726-30 May 19 04:50:43.108902 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e03fde12-94ad-41fe-9605-037d4c32f6e5 req-7d85eec8-10e2-4114-ac08-2e552338ba80 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052631 May 19 04:50:43.115508 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2336/4583] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:43.139107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:43.140885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:43.152163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:43.153564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:43.155769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:43.174043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:43.588968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:43.676468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=16 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:43.780611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:43.799753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:43.809211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:43.815040 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cb634b96-7a5a-4aed-902d-637b3ffafaae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1721 microversion: 2.20 time: 0.695704 May 19 04:50:43.818002 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2337/4584] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:43 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1721 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:43.830861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c2c9114-ad36-4405-bdf5-ce8b6d25bd7a tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Calling method '.version_select at 0x7fd314e0f0d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:43.849115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-77663446-1d84-4f32-b294-1a2ba683046a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:43.859105 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-77663446-1d84-4f32-b294-1a2ba683046a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.794976 May 19 04:50:43.864904 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2248/4585] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:43 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:43.878537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af248b07-fb51-4b98-a697-2a1b38e0668b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:43.881701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af248b07-fb51-4b98-a697-2a1b38e0668b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:43.899442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af248b07-fb51-4b98-a697-2a1b38e0668b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:43.900823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af248b07-fb51-4b98-a697-2a1b38e0668b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:43.902804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af248b07-fb51-4b98-a697-2a1b38e0668b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:43.906024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af248b07-fb51-4b98-a697-2a1b38e0668b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:43.926878 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-2c2c9114-ad36-4405-bdf5-ce8b6d25bd7a tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] HTTP exception thrown: Volume tempest-invalid-1811904998 could not be found. May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c2c9114-ad36-4405-bdf5-ce8b6d25bd7a tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Request method failure captured: May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1811904998 HTTP/1.1 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcyfG5N83T4-kVbI1xkElmU6UItGvMXJEXeD-SRCJl2cQLrtWaQ0wELdSA8ON8lyBr6ZJTN6D3Q2OY4lW3DW2_h0WKdK3HcT5XZoYcdb8Jzx-pGLCVFDDciloU1FCRa6J09Q1mMBP99fV3zRHUGsJwOHl9aGNI-bvaOH_747AR_byLA May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesNegativeTest-2072778335 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b8b5ec6eb7c948649670b2a45d27db87 May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: exception: Volume tempest-invalid-1811904998 could not be found. May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'tempest-invalid-1811904998'} May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1811904998 could not be found. (HTTP 404) (Request-ID: req-b6e14e57-967c-4f97-93ad-27d2bc90b25b) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:43.930014 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1811904998 could not be found. May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1811904998 could not be found. May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1811904998 could not be found. May 19 04:50:43.935021 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:43.939436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c2c9114-ad36-4405-bdf5-ce8b6d25bd7a tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Returning 404 to user: Volume tempest-invalid-1811904998 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:43.940448 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c2c9114-ad36-4405-bdf5-ce8b6d25bd7a tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1811904998" status: 404 len: 99 microversion: 2.1 time: 0.120397 May 19 04:50:43.941556 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2338/4586] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:50:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1811904998 => generated 99 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:50:43.955913 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b43b7986-8472-4792-afe8-a2117e7c473a tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004046 May 19 04:50:43.958006 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2339/4587] 10.222.0.58 () {58 vars in 1139 bytes} [Thu May 19 04:50:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 19 04:50:43.970262 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-54e2e66d-87e1-4adf-85dc-04851aca1787 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006031 May 19 04:50:43.972793 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2340/4588] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:50:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 04:50:43.984317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-63ec76c6-aea1-49d1-9d0b-ce9d97a635c7 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Calling method '.version_select at 0x7fd314d99f70>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:44.087328 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-63ec76c6-aea1-49d1-9d0b-ce9d97a635c7 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] HTTP exception thrown: Volume 0cbf12eb-bffe-4c4e-bc30-8f488c5e433a could not be found. May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-63ec76c6-aea1-49d1-9d0b-ce9d97a635c7 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Request method failure captured: May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/os-volumes/0cbf12eb-bffe-4c4e-bc30-8f488c5e433a HTTP/1.1 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcyfG5N83T4-kVbI1xkElmU6UItGvMXJEXeD-SRCJl2cQLrtWaQ0wELdSA8ON8lyBr6ZJTN6D3Q2OY4lW3DW2_h0WKdK3HcT5XZoYcdb8Jzx-pGLCVFDDciloU1FCRa6J09Q1mMBP99fV3zRHUGsJwOHl9aGNI-bvaOH_747AR_byLA May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesNegativeTest-2072778335 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b8b5ec6eb7c948649670b2a45d27db87 May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: exception: Volume 0cbf12eb-bffe-4c4e-bc30-8f488c5e433a could not be found. May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '0cbf12eb-bffe-4c4e-bc30-8f488c5e433a'} May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cbf12eb-bffe-4c4e-bc30-8f488c5e433a could not be found. (HTTP 404) (Request-ID: req-61fb5fa3-d66c-4a3a-9ce3-56f5b7a2af18) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:50:44.089595 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cbf12eb-bffe-4c4e-bc30-8f488c5e433a could not be found. May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cbf12eb-bffe-4c4e-bc30-8f488c5e433a could not be found. May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cbf12eb-bffe-4c4e-bc30-8f488c5e433a could not be found. May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-63ec76c6-aea1-49d1-9d0b-ce9d97a635c7 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Returning 404 to user: Volume 0cbf12eb-bffe-4c4e-bc30-8f488c5e433a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:44.094314 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-63ec76c6-aea1-49d1-9d0b-ce9d97a635c7 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/0cbf12eb-bffe-4c4e-bc30-8f488c5e433a" status: 404 len: 109 microversion: 2.1 time: 0.112940 May 19 04:50:44.101955 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2341/4589] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:50:43 2022] DELETE /compute/v2.1/os-volumes/0cbf12eb-bffe-4c4e-bc30-8f488c5e433a => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:44.114902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14378cad-723a-45c7-99c2-caebcf9ffdec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:44.116193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14378cad-723a-45c7-99c2-caebcf9ffdec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:44.135135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14378cad-723a-45c7-99c2-caebcf9ffdec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:44.136178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14378cad-723a-45c7-99c2-caebcf9ffdec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:44.140966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14378cad-723a-45c7-99c2-caebcf9ffdec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:44.143041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14378cad-723a-45c7-99c2-caebcf9ffdec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:44.334651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:44.360326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-af248b07-fb51-4b98-a697-2a1b38e0668b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:44.370838 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af248b07-fb51-4b98-a697-2a1b38e0668b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1309 microversion: 2.1 time: 0.503790 May 19 04:50:44.371428 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2249/4590] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:43 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1309 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:44.387289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b7086ec5-75ff-42bd-8df6-051a3a68be8e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:44.390343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b7086ec5-75ff-42bd-8df6-051a3a68be8e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:44.403787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7086ec5-75ff-42bd-8df6-051a3a68be8e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:44.404250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7086ec5-75ff-42bd-8df6-051a3a68be8e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:44.407162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7086ec5-75ff-42bd-8df6-051a3a68be8e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:44.407622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7086ec5-75ff-42bd-8df6-051a3a68be8e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:44.658309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14378cad-723a-45c7-99c2-caebcf9ffdec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:44.668037 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14378cad-723a-45c7-99c2-caebcf9ffdec tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1495 microversion: 2.1 time: 0.564889 May 19 04:50:44.673285 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2342/4591] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:44 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1495 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:44.692445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c93f80b3-80f9-4b60-8ee8-968f57c20e60 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Calling method '.version_select at 0x7fd314c44ca0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:44.760217 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c93f80b3-80f9-4b60-8ee8-968f57c20e60 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] HTTP exception thrown: Volume 639a4ed2-7655-4e5f-8979-d8b3419f39bc could not be found. May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c93f80b3-80f9-4b60-8ee8-968f57c20e60 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Request method failure captured: May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-volumes/639a4ed2-7655-4e5f-8979-d8b3419f39bc HTTP/1.1 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcyfG5N83T4-kVbI1xkElmU6UItGvMXJEXeD-SRCJl2cQLrtWaQ0wELdSA8ON8lyBr6ZJTN6D3Q2OY4lW3DW2_h0WKdK3HcT5XZoYcdb8Jzx-pGLCVFDDciloU1FCRa6J09Q1mMBP99fV3zRHUGsJwOHl9aGNI-bvaOH_747AR_byLA May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3008dd27fd1b4cdcb69f9e951c50df66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesNegativeTest-2072778335 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 3008dd27fd1b4cdcb69f9e951c50df66 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesNegativeTest-2072778335 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: b8b5ec6eb7c948649670b2a45d27db87 May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesNegativeTest-2072778335-project May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: exception: Volume 639a4ed2-7655-4e5f-8979-d8b3419f39bc could not be found. May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '639a4ed2-7655-4e5f-8979-d8b3419f39bc'} May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 639a4ed2-7655-4e5f-8979-d8b3419f39bc could not be found. (HTTP 404) (Request-ID: req-c9b41b74-8b5f-4002-b469-9eff933941d3) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 04:50:44.762212 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 639a4ed2-7655-4e5f-8979-d8b3419f39bc could not be found. May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 639a4ed2-7655-4e5f-8979-d8b3419f39bc could not be found. May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 639a4ed2-7655-4e5f-8979-d8b3419f39bc could not be found. May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c93f80b3-80f9-4b60-8ee8-968f57c20e60 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] Returning 404 to user: Volume 639a4ed2-7655-4e5f-8979-d8b3419f39bc could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c93f80b3-80f9-4b60-8ee8-968f57c20e60 tempest-VolumesNegativeTest-2072778335 tempest-VolumesNegativeTest-2072778335-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/639a4ed2-7655-4e5f-8979-d8b3419f39bc" status: 404 len: 109 microversion: 2.1 time: 0.087165 May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2343/4592] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 19 04:50:44 2022] GET /compute/v2.1/os-volumes/639a4ed2-7655-4e5f-8979-d8b3419f39bc => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:44.770477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6f125054-028f-455d-bd21-364d96b6e316 req-37d8f8cd-5996-4bf8-accf-7626218dd974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87f7ed9-b42a-4cb5-9a13-935e4469527f", "tag": "015489ba-74b3-4018-ac39-fe4f05102749"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:44.781283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6f125054-028f-455d-bd21-364d96b6e316 req-37d8f8cd-5996-4bf8-accf-7626218dd974 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:44.799039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6f125054-028f-455d-bd21-364d96b6e316 req-37d8f8cd-5996-4bf8-accf-7626218dd974 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:44.815599 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6f125054-028f-455d-bd21-364d96b6e316 req-37d8f8cd-5996-4bf8-accf-7626218dd974 service nova] Creating event network-changed:015489ba-74b3-4018-ac39-fe4f05102749 for instance c87f7ed9-b42a-4cb5-9a13-935e4469527f on n-h2-766726-30 May 19 04:50:44.824868 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6f125054-028f-455d-bd21-364d96b6e316 req-37d8f8cd-5996-4bf8-accf-7626218dd974 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059121 May 19 04:50:44.825549 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2344/4593] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:44.831630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b7086ec5-75ff-42bd-8df6-051a3a68be8e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:44.836009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:44.841989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:44.850266 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b7086ec5-75ff-42bd-8df6-051a3a68be8e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.469346 May 19 04:50:44.853256 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2250/4594] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:44 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:44.855909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:44.856566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:44.857547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:44.860490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:44.867612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:44.870989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:44.890488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:44.892513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:44.893880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:44.895910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:44.896665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:44.917018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lazy-loading 'flavor' on Instance uuid 878aa03f-a366-4d71-b678-1c749fc143c6 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:50:45.035147 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Cannot 'suspend' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state suspended May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action HTTP/1.1 May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 15 May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: {"suspend": {}} May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'suspend' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state suspended May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6', 'body': {'suspend': {}}} May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 in vm_state suspended. Cannot suspend while the instance is in this state. May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend May 19 04:50:45.038209 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state suspended May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state suspended May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 409 to user: Cannot 'suspend' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state suspended {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c135a8ec-bb79-4e34-b55a-b42cc8c9cb2e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 409 len: 148 microversion: 2.1 time: 0.213405 May 19 04:50:45.045702 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2345/4595] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:44 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 148 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:50:45.056131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3247e5e0-b3c5-4100-9837-085eefbda255 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:45.056780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3247e5e0-b3c5-4100-9837-085eefbda255 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:45.115883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3247e5e0-b3c5-4100-9837-085eefbda255 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:45.116877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3247e5e0-b3c5-4100-9837-085eefbda255 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:45.117674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3247e5e0-b3c5-4100-9837-085eefbda255 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:45.118022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3247e5e0-b3c5-4100-9837-085eefbda255 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:45.356102 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3247e5e0-b3c5-4100-9837-085eefbda255 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 202 len: 0 microversion: 2.1 time: 0.308116 May 19 04:50:45.362549 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2346/4596] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:45 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:50:45.386182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4701df94-1b01-4247-bf5c-123445d557af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:45.387144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4701df94-1b01-4247-bf5c-123445d557af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:45.402706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4701df94-1b01-4247-bf5c-123445d557af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:45.404348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4701df94-1b01-4247-bf5c-123445d557af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:45.409851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4701df94-1b01-4247-bf5c-123445d557af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:45.410163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4701df94-1b01-4247-bf5c-123445d557af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:45.496077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:45.508569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:45.516513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:45.518748 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-945990f9-6dee-4c74-adea-8643e93b94f5 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1721 microversion: 2.20 time: 0.664083 May 19 04:50:45.532254 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2251/4597] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:44 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1721 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:45.537944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5517565a-bb58-487e-b958-1860e1cb7e22 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:45.538788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5517565a-bb58-487e-b958-1860e1cb7e22 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:45.545772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5517565a-bb58-487e-b958-1860e1cb7e22 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:45.546587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5517565a-bb58-487e-b958-1860e1cb7e22 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:45.547610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5517565a-bb58-487e-b958-1860e1cb7e22 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:45.548218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5517565a-bb58-487e-b958-1860e1cb7e22 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:46.448546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4701df94-1b01-4247-bf5c-123445d557af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:46.453634 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4701df94-1b01-4247-bf5c-123445d557af tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1501 microversion: 2.1 time: 1.089399 May 19 04:50:46.454541 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2347/4598] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:45 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1501 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:46.468646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b24af69-fd44-4bc1-ac7e-131a1be76d69 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:46.477752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8b24af69-fd44-4bc1-ac7e-131a1be76d69 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:46.503165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b24af69-fd44-4bc1-ac7e-131a1be76d69 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:46.503623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b24af69-fd44-4bc1-ac7e-131a1be76d69 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:46.505129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b24af69-fd44-4bc1-ac7e-131a1be76d69 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:46.506023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b24af69-fd44-4bc1-ac7e-131a1be76d69 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:46.689884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5517565a-bb58-487e-b958-1860e1cb7e22 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:46.703742 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5517565a-bb58-487e-b958-1860e1cb7e22 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1309 microversion: 2.1 time: 1.169788 May 19 04:50:46.704436 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2252/4599] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:45 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1309 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:46.755334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-dce45773-5ea7-40f3-ba66-57734750359e req-2c39a809-dec2-43fe-afb6-910dd241372b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894769ad-4295-4aff-8ba0-30957e6ec8da", "name": "network-vif-unplugged", "status": "completed", "tag": "738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:46.768704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dce45773-5ea7-40f3-ba66-57734750359e req-2c39a809-dec2-43fe-afb6-910dd241372b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:46.769181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dce45773-5ea7-40f3-ba66-57734750359e req-2c39a809-dec2-43fe-afb6-910dd241372b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:46.809347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.compute.server_external_events [req-dce45773-5ea7-40f3-ba66-57734750359e req-2c39a809-dec2-43fe-afb6-910dd241372b service nova] Unable to find a host for instance 894769ad-4295-4aff-8ba0-30957e6ec8da. Dropping event network-vif-unplugged {{(pid=124819) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 04:50:46.812114 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-dce45773-5ea7-40f3-ba66-57734750359e req-2c39a809-dec2-43fe-afb6-910dd241372b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.079876 May 19 04:50:46.825770 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2253/4600] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 120 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 04:50:46.832282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:46.833802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:46.901364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:46.902403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:46.903817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:46.917352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:47.253678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8b24af69-fd44-4bc1-ac7e-131a1be76d69 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:47.263430 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b24af69-fd44-4bc1-ac7e-131a1be76d69 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.807444 May 19 04:50:47.264026 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2348/4601] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:46 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:47.355026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:47.378495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:47.384123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:47.386956 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afa909bf-8ae6-465d-b711-2cce96d4efba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1664 microversion: 2.20 time: 0.559663 May 19 04:50:47.389711 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2254/4602] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:46 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1664 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:47.415814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b5faacf4-7cfa-43dd-be85-d8abd52992f7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "805f1960-005f-48c3-9f88-9d6c5ab2e2f2"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:47.420114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b5faacf4-7cfa-43dd-be85-d8abd52992f7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:47.435947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5faacf4-7cfa-43dd-be85-d8abd52992f7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:47.442350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5faacf4-7cfa-43dd-be85-d8abd52992f7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:47.446397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5faacf4-7cfa-43dd-be85-d8abd52992f7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:47.448026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5faacf4-7cfa-43dd-be85-d8abd52992f7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:47.471188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-25ee6cb0-515d-4bd5-8bed-9d79668c5d8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:47.471796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-25ee6cb0-515d-4bd5-8bed-9d79668c5d8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:47.482180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25ee6cb0-515d-4bd5-8bed-9d79668c5d8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:47.482639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25ee6cb0-515d-4bd5-8bed-9d79668c5d8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:47.483419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25ee6cb0-515d-4bd5-8bed-9d79668c5d8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:47.483858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25ee6cb0-515d-4bd5-8bed-9d79668c5d8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:47.775181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-25ee6cb0-515d-4bd5-8bed-9d79668c5d8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:47.784858 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-25ee6cb0-515d-4bd5-8bed-9d79668c5d8e tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1501 microversion: 2.1 time: 0.317381 May 19 04:50:47.801335 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2255/4603] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:47 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1501 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:50:47.813331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21aae6d4-e42a-4f9d-a052-61fc3e7156a8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:47.814264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-21aae6d4-e42a-4f9d-a052-61fc3e7156a8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:47.827141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21aae6d4-e42a-4f9d-a052-61fc3e7156a8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:47.829480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21aae6d4-e42a-4f9d-a052-61fc3e7156a8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:47.831725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21aae6d4-e42a-4f9d-a052-61fc3e7156a8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:47.832356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21aae6d4-e42a-4f9d-a052-61fc3e7156a8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:48.168429 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b5faacf4-7cfa-43dd-be85-d8abd52992f7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.757194 May 19 04:50:48.182574 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2349/4604] 10.222.0.58 () {62 vars in 1363 bytes} [Thu May 19 04:50:47 2022] POST /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 188 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:50:48.208814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-21aae6d4-e42a-4f9d-a052-61fc3e7156a8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:48.218940 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21aae6d4-e42a-4f9d-a052-61fc3e7156a8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1490 microversion: 2.1 time: 0.416220 May 19 04:50:48.231104 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2256/4605] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:47 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1490 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:48.281512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2f2a8922-bd5b-4616-aafc-a23b33e4022d tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:48.282442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2f2a8922-bd5b-4616-aafc-a23b33e4022d tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:48.303529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f2a8922-bd5b-4616-aafc-a23b33e4022d tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:48.303911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f2a8922-bd5b-4616-aafc-a23b33e4022d tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:48.304921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f2a8922-bd5b-4616-aafc-a23b33e4022d tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:48.305962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f2a8922-bd5b-4616-aafc-a23b33e4022d tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:48.458160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7c3e428b-23d8-41ff-b061-b5931a2e1dd1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:48.459701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7c3e428b-23d8-41ff-b061-b5931a2e1dd1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:48.484897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c3e428b-23d8-41ff-b061-b5931a2e1dd1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:48.487806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c3e428b-23d8-41ff-b061-b5931a2e1dd1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:48.488661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c3e428b-23d8-41ff-b061-b5931a2e1dd1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:48.489138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7c3e428b-23d8-41ff-b061-b5931a2e1dd1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:48.576015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f2a8922-bd5b-4616-aafc-a23b33e4022d tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:48.585694 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2f2a8922-bd5b-4616-aafc-a23b33e4022d tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.309166 May 19 04:50:48.589428 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2350/4606] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:48 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:48.597570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2088122075", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:48.707961 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7c3e428b-23d8-41ff-b061-b5931a2e1dd1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/action" status: 202 len: 0 microversion: 2.20 time: 0.254786 May 19 04:50:48.708615 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2257/4607] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:50:48 2022] POST /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:50:48.721018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:48.721944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:48.731728 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:48.732618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:48.734090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:48.736126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:48.754764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] validate_networks() for [('3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:50:49.559545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:49.571726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:49.572966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:49.583372 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9872ec30-50bf-4f2a-9d69-a7efd6407d9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1750 microversion: 2.20 time: 0.869846 May 19 04:50:49.585035 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2258/4608] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:48 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1750 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:49.616169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b1e6540a-ec79-45a7-bd9c-f3fce14a336b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:49.618017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b1e6540a-ec79-45a7-bd9c-f3fce14a336b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:49.650400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1e6540a-ec79-45a7-bd9c-f3fce14a336b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:49.651609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1e6540a-ec79-45a7-bd9c-f3fce14a336b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:49.652662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1e6540a-ec79-45a7-bd9c-f3fce14a336b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:49.653612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1e6540a-ec79-45a7-bd9c-f3fce14a336b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:51.563010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b1e6540a-ec79-45a7-bd9c-f3fce14a336b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:51.575377 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b1e6540a-ec79-45a7-bd9c-f3fce14a336b tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1501 microversion: 2.1 time: 1.973430 May 19 04:50:51.578173 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2259/4609] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:49 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1501 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:51.592882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c710214a-6e4f-40cd-9285-539db28437c7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:51.595076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c710214a-6e4f-40cd-9285-539db28437c7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:51.629061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c710214a-6e4f-40cd-9285-539db28437c7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:51.630456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c710214a-6e4f-40cd-9285-539db28437c7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:51.634578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c710214a-6e4f-40cd-9285-539db28437c7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:51.636542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c710214a-6e4f-40cd-9285-539db28437c7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:51.814762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:50:51.815803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:50:51.816467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:50:51.817058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:50:51.818732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:50:51.838231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:51.852925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:51.855246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:51.855900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:51.957844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:50:51.972481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for user a75cb8e84f674ef0814a39d2a4887933 and project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:50:51.981299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c710214a-6e4f-40cd-9285-539db28437c7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:52.003707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:50:52.007609 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c710214a-6e4f-40cd-9285-539db28437c7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.427763 May 19 04:50:52.008908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:50:52.011325 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2260/4610] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:51 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:52.026975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:52.029632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:52.048216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:52.057010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:52.058584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:52.059278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:52.111895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:52.172734 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-064c60d4-2205-4158-8a1a-552ea34635f8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.581717 May 19 04:50:52.181216 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2351/4611] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:50:52.204538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-033a8afc-7ef2-4c2e-a190-391d717ba6dc tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:52.212287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-033a8afc-7ef2-4c2e-a190-391d717ba6dc tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:52.389508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-033a8afc-7ef2-4c2e-a190-391d717ba6dc tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:52.402103 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-033a8afc-7ef2-4c2e-a190-391d717ba6dc tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1209 microversion: 2.1 time: 0.217860 May 19 04:50:52.403111 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2352/4612] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:52 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1209 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:52.485916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:52.516996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:52.519657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:52.522862 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-541adabf-562b-456e-af9c-27e5b3cd657b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.507587 May 19 04:50:52.523999 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2261/4613] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:52 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:52.597839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-027accde-84bd-46ba-b3dc-6750ee0ba6a5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:52.598479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-027accde-84bd-46ba-b3dc-6750ee0ba6a5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:52.620927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-027accde-84bd-46ba-b3dc-6750ee0ba6a5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:52.623782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-027accde-84bd-46ba-b3dc-6750ee0ba6a5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:52.624657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-027accde-84bd-46ba-b3dc-6750ee0ba6a5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:52.625152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-027accde-84bd-46ba-b3dc-6750ee0ba6a5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.030324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7e2c402-d3b4-4244-8323-d3eae85e48e8 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:53.031359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7e2c402-d3b4-4244-8323-d3eae85e48e8 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:53.044517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7e2c402-d3b4-4244-8323-d3eae85e48e8 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.045323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7e2c402-d3b4-4244-8323-d3eae85e48e8 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.046429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7e2c402-d3b4-4244-8323-d3eae85e48e8 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.047917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7e2c402-d3b4-4244-8323-d3eae85e48e8 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.051985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-027accde-84bd-46ba-b3dc-6750ee0ba6a5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:53.069224 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-027accde-84bd-46ba-b3dc-6750ee0ba6a5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.477977 May 19 04:50:53.073820 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2353/4614] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:52 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:50:53.091399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-44f128eb-3847-48e2-8abc-b1b20dcb39cb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:53.094817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-44f128eb-3847-48e2-8abc-b1b20dcb39cb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:53.120309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44f128eb-3847-48e2-8abc-b1b20dcb39cb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.121348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44f128eb-3847-48e2-8abc-b1b20dcb39cb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.123840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44f128eb-3847-48e2-8abc-b1b20dcb39cb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.128140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44f128eb-3847-48e2-8abc-b1b20dcb39cb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.605182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-44f128eb-3847-48e2-8abc-b1b20dcb39cb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:53.606572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7e2c402-d3b4-4244-8323-d3eae85e48e8 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:53.614496 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7e2c402-d3b4-4244-8323-d3eae85e48e8 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.590636 May 19 04:50:53.619106 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2262/4615] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:53 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:53.625338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49a800c3-ab85-41fe-b86a-a518ef8ac56f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:53.626261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49a800c3-ab85-41fe-b86a-a518ef8ac56f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:53.626961 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-44f128eb-3847-48e2-8abc-b1b20dcb39cb tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.531348 May 19 04:50:53.630532 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2354/4616] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:53 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:50:53.643527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:53.644195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49a800c3-ab85-41fe-b86a-a518ef8ac56f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.644838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49a800c3-ab85-41fe-b86a-a518ef8ac56f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.645696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:53.649511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49a800c3-ab85-41fe-b86a-a518ef8ac56f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.649991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49a800c3-ab85-41fe-b86a-a518ef8ac56f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.664438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.664899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.665783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.667289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.802822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49a800c3-ab85-41fe-b86a-a518ef8ac56f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:53.816666 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49a800c3-ab85-41fe-b86a-a518ef8ac56f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1261 microversion: 2.1 time: 0.194493 May 19 04:50:53.818567 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2263/4617] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:53 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:53.855439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b224e1da-5a4c-40b1-a850-1411e8ec1c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:53.856235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b224e1da-5a4c-40b1-a850-1411e8ec1c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:53.873063 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b224e1da-5a4c-40b1-a850-1411e8ec1c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee could not be found. May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b224e1da-5a4c-40b1-a850-1411e8ec1c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee/action HTTP/1.1 May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 15 May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: {"unpause": {}} May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee could not be found. May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee', 'body': {'unpause': {}}} May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee could not be found. May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee could not be found. May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:53.875443 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:53.881663 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:53.881663 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:53.881663 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee could not be found. May 19 04:50:53.881663 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:53.882738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b224e1da-5a4c-40b1-a850-1411e8ec1c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:53.883911 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b224e1da-5a4c-40b1-a850-1411e8ec1c5f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee/action" status: 404 len: 111 microversion: 2.1 time: 0.063805 May 19 04:50:53.885171 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2264/4618] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:53 2022] POST /compute/v2.1/servers/7a8dcd4b-9483-4b40-b7fc-fa9aa8c4bcee/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:53.894574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1a37ff0a-9b2c-4a51-a73c-8ebaaca1e4ad tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:53.895752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1a37ff0a-9b2c-4a51-a73c-8ebaaca1e4ad tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:53.897770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:53.904085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a37ff0a-9b2c-4a51-a73c-8ebaaca1e4ad tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.905065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a37ff0a-9b2c-4a51-a73c-8ebaaca1e4ad tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.906217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a37ff0a-9b2c-4a51-a73c-8ebaaca1e4ad tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:53.906934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a37ff0a-9b2c-4a51-a73c-8ebaaca1e4ad tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:53.922298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:53.926464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:53.929066 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-869913ac-be21-4f24-aea2-89f4ce485643 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.296414 May 19 04:50:53.933098 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2355/4619] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:53 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:54.279356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1a37ff0a-9b2c-4a51-a73c-8ebaaca1e4ad tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:54.289751 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1a37ff0a-9b2c-4a51-a73c-8ebaaca1e4ad tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.400295 May 19 04:50:54.290778 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2265/4620] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:53 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:54.310969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9560e2b9-6d77-46f3-a75f-be465ab9a8ef tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:54.311599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9560e2b9-6d77-46f3-a75f-be465ab9a8ef tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:54.321125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9560e2b9-6d77-46f3-a75f-be465ab9a8ef tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:54.321853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9560e2b9-6d77-46f3-a75f-be465ab9a8ef tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:54.323411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9560e2b9-6d77-46f3-a75f-be465ab9a8ef tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:54.323860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9560e2b9-6d77-46f3-a75f-be465ab9a8ef tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:54.611453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9560e2b9-6d77-46f3-a75f-be465ab9a8ef tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:54.627619 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9560e2b9-6d77-46f3-a75f-be465ab9a8ef tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.318196 May 19 04:50:54.641811 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2356/4621] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:54 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:54.643154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2cc83f7e-9bad-42a3-a876-85eee1033adb tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:54.643887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2cc83f7e-9bad-42a3-a876-85eee1033adb tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:54.649326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:54.651703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:54.654787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2cc83f7e-9bad-42a3-a876-85eee1033adb tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:54.657617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2cc83f7e-9bad-42a3-a876-85eee1033adb tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:54.658648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2cc83f7e-9bad-42a3-a876-85eee1033adb tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:54.659210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:54.659854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:54.660272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2cc83f7e-9bad-42a3-a876-85eee1033adb tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:54.662452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:54.663165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:54.693707 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Cannot 'unpause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action HTTP/1.1 May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 15 May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: {"unpause": {}} May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'unpause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6', 'body': {'unpause': {}}} May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 in vm_state active. Cannot unpause while the instance is in this state. May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:54.695659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:54.701403 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:54.701403 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:54.701403 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:54.701403 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:50:54.701403 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:54.703238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 409 to user: Cannot 'unpause' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:54.704480 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4b338a14-cff6-468e-85c3-4aa7bed3398a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 409 len: 145 microversion: 2.1 time: 0.060346 May 19 04:50:54.705327 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2357/4622] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:54 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 145 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:50:54.715419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6743d33-5742-42ae-9f91-de1edc972b46 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:54.716360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6743d33-5742-42ae-9f91-de1edc972b46 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:54.728583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6743d33-5742-42ae-9f91-de1edc972b46 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:54.731784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6743d33-5742-42ae-9f91-de1edc972b46 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:54.736576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6743d33-5742-42ae-9f91-de1edc972b46 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:54.737486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6743d33-5742-42ae-9f91-de1edc972b46 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:55.089569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e6743d33-5742-42ae-9f91-de1edc972b46 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:55.109483 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6743d33-5742-42ae-9f91-de1edc972b46 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.398857 May 19 04:50:55.111013 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2358/4623] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:54 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:55.143617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7248ad5-4761-47f3-8278-bcc4a40c0ef1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:55.144717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b7248ad5-4761-47f3-8278-bcc4a40c0ef1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:55.166278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7248ad5-4761-47f3-8278-bcc4a40c0ef1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:55.168032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7248ad5-4761-47f3-8278-bcc4a40c0ef1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:55.169829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7248ad5-4761-47f3-8278-bcc4a40c0ef1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:55.170957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7248ad5-4761-47f3-8278-bcc4a40c0ef1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:55.177683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2cc83f7e-9bad-42a3-a876-85eee1033adb tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:55.186737 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2cc83f7e-9bad-42a3-a876-85eee1033adb tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.548183 May 19 04:50:55.189159 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2266/4624] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:54 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:50:55.211570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:55.215261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:55.241872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:55.263017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:55.270193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:55.271439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:55.344702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b7248ad5-4761-47f3-8278-bcc4a40c0ef1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:55.357992 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b7248ad5-4761-47f3-8278-bcc4a40c0ef1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1267 microversion: 2.1 time: 0.229764 May 19 04:50:55.369495 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2359/4625] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:55 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:55.375603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-67900217-ebf0-47cd-9fa5-2504ac231a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:55.376442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-67900217-ebf0-47cd-9fa5-2504ac231a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:55.385579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67900217-ebf0-47cd-9fa5-2504ac231a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:55.386193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67900217-ebf0-47cd-9fa5-2504ac231a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:55.387085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67900217-ebf0-47cd-9fa5-2504ac231a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:55.387663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67900217-ebf0-47cd-9fa5-2504ac231a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:55.424144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:55.752069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-67900217-ebf0-47cd-9fa5-2504ac231a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:55.768189 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-67900217-ebf0-47cd-9fa5-2504ac231a99 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.397316 May 19 04:50:55.768801 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2360/4626] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:55 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:55.785664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0712bf5f-5212-475c-99d4-d9f723ca0126 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:55.787049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0712bf5f-5212-475c-99d4-d9f723ca0126 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 6f09b6f8-904c-4e88-874a-7478cff75265] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:55.800088 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-0712bf5f-5212-475c-99d4-d9f723ca0126 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 6f09b6f8-904c-4e88-874a-7478cff75265 could not be found. May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0712bf5f-5212-475c-99d4-d9f723ca0126 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/6f09b6f8-904c-4e88-874a-7478cff75265/action HTTP/1.1 May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 18 May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: {"unshelve": null} May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 6f09b6f8-904c-4e88-874a-7478cff75265 could not be found. May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '6f09b6f8-904c-4e88-874a-7478cff75265', 'body': {'unshelve': None}} May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f09b6f8-904c-4e88-874a-7478cff75265 could not be found. May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f09b6f8-904c-4e88-874a-7478cff75265 could not be found. May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:55.804251 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:55.817331 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:55.817331 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:55.817331 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:55.817331 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f09b6f8-904c-4e88-874a-7478cff75265 could not be found. May 19 04:50:55.817331 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:50:55.817331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0712bf5f-5212-475c-99d4-d9f723ca0126 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 6f09b6f8-904c-4e88-874a-7478cff75265 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:55.817331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0712bf5f-5212-475c-99d4-d9f723ca0126 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/6f09b6f8-904c-4e88-874a-7478cff75265/action" status: 404 len: 111 microversion: 2.1 time: 0.030540 May 19 04:50:55.819502 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2361/4627] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:55 2022] POST /compute/v2.1/servers/6f09b6f8-904c-4e88-874a-7478cff75265/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:55.828844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-686c7e56-9aba-4885-bfaf-5d7f946a2c31 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:55.831971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-686c7e56-9aba-4885-bfaf-5d7f946a2c31 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:55.848439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-686c7e56-9aba-4885-bfaf-5d7f946a2c31 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:55.849674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-686c7e56-9aba-4885-bfaf-5d7f946a2c31 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:55.854597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-686c7e56-9aba-4885-bfaf-5d7f946a2c31 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:55.855258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-686c7e56-9aba-4885-bfaf-5d7f946a2c31 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:55.894870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:55.904715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:55.915100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:55.923065 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-93dbefb1-180b-481c-9514-e8626cdcd15a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.717643 May 19 04:50:55.923835 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2267/4628] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:55 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:56.167004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-686c7e56-9aba-4885-bfaf-5d7f946a2c31 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:56.175659 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-686c7e56-9aba-4885-bfaf-5d7f946a2c31 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.354896 May 19 04:50:56.193888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86312049-aebb-4f23-827a-7ce139636c6c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:56.194815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-86312049-aebb-4f23-827a-7ce139636c6c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:56.205617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86312049-aebb-4f23-827a-7ce139636c6c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.206185 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2362/4629] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:55 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:56.211363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-67a7a712-b347-4243-9dbd-88795c82bdfa tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:56.216242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86312049-aebb-4f23-827a-7ce139636c6c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:56.218214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86312049-aebb-4f23-827a-7ce139636c6c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.221042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86312049-aebb-4f23-827a-7ce139636c6c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:56.222114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-67a7a712-b347-4243-9dbd-88795c82bdfa tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:56.247518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67a7a712-b347-4243-9dbd-88795c82bdfa tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.248022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67a7a712-b347-4243-9dbd-88795c82bdfa tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:56.249132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67a7a712-b347-4243-9dbd-88795c82bdfa tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.257613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67a7a712-b347-4243-9dbd-88795c82bdfa tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:56.725774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-67a7a712-b347-4243-9dbd-88795c82bdfa tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:56.735699 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-67a7a712-b347-4243-9dbd-88795c82bdfa tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.528154 May 19 04:50:56.739192 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2363/4630] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:56 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:56.742727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-86312049-aebb-4f23-827a-7ce139636c6c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:56.750191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aba47580-0791-4c1e-87ee-17a23b69d880 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:56.754581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aba47580-0791-4c1e-87ee-17a23b69d880 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:56.755220 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-86312049-aebb-4f23-827a-7ce139636c6c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.565538 May 19 04:50:56.756060 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2268/4631] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:56 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:50:56.772723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aba47580-0791-4c1e-87ee-17a23b69d880 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.773524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aba47580-0791-4c1e-87ee-17a23b69d880 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:56.774547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aba47580-0791-4c1e-87ee-17a23b69d880 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.775199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aba47580-0791-4c1e-87ee-17a23b69d880 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:56.780770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:56.791629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:56.800864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.801656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:56.802769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.804004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:56.839099 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Cannot 'unshelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action HTTP/1.1 May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 18 May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: {"unshelve": null} May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: exception: Cannot 'unshelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6', 'body': {'unshelve': None}} May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 in vm_state active. Cannot unshelve while the instance is in this state. May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:50:56.841584 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:56.854798 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:56.854798 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:56.854798 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:56.854798 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:56.854798 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:56.854798 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:56.854798 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:56.854798 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active May 19 04:50:56.854798 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:56.860693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 409 to user: Cannot 'unshelve' instance 878aa03f-a366-4d71-b678-1c749fc143c6 while it is in vm_state active {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:56.862537 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bcc91824-9bef-4a15-bcf2-b7412d2c9e1c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action" status: 409 len: 146 microversion: 2.1 time: 0.093066 May 19 04:50:56.864273 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2269/4632] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:50:56 2022] POST /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6/action => generated 146 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:50:56.889912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2b7e8b4-162b-4dac-a5d4-4acf599c2e68 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:56.890995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e2b7e8b4-162b-4dac-a5d4-4acf599c2e68 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:56.908709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2b7e8b4-162b-4dac-a5d4-4acf599c2e68 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.909395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2b7e8b4-162b-4dac-a5d4-4acf599c2e68 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:56.924083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2b7e8b4-162b-4dac-a5d4-4acf599c2e68 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:56.924885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2b7e8b4-162b-4dac-a5d4-4acf599c2e68 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:57.271436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aba47580-0791-4c1e-87ee-17a23b69d880 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:57.286181 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aba47580-0791-4c1e-87ee-17a23b69d880 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1309 microversion: 2.1 time: 0.545044 May 19 04:50:57.287135 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2364/4633] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:56 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1309 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:57.291827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:57.292443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:57.316173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:57.316638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:57.317468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:57.318513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:57.549503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e2b7e8b4-162b-4dac-a5d4-4acf599c2e68 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:57.562733 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2b7e8b4-162b-4dac-a5d4-4acf599c2e68 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.691862 May 19 04:50:57.564798 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2270/4634] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:56 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:57.585141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dad7d11b-dc65-4470-9774-62e9ac73a4bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:57.585141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dad7d11b-dc65-4470-9774-62e9ac73a4bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:57.591456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dad7d11b-dc65-4470-9774-62e9ac73a4bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:57.592219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dad7d11b-dc65-4470-9774-62e9ac73a4bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:57.595413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dad7d11b-dc65-4470-9774-62e9ac73a4bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:57.597009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dad7d11b-dc65-4470-9774-62e9ac73a4bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:57.672178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:57.689763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:57.697420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:57.706872 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-036cec7b-6d1e-4304-aae0-5e6274fda075 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.418334 May 19 04:50:57.708024 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2365/4635] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:57 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:57.757523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88a6528c-66ba-44b0-bb39-517769dc7c35 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:57.760515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-88a6528c-66ba-44b0-bb39-517769dc7c35 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:57.789374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88a6528c-66ba-44b0-bb39-517769dc7c35 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:57.790223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88a6528c-66ba-44b0-bb39-517769dc7c35 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:57.791232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88a6528c-66ba-44b0-bb39-517769dc7c35 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:57.791672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88a6528c-66ba-44b0-bb39-517769dc7c35 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:58.114398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dad7d11b-dc65-4470-9774-62e9ac73a4bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:58.127473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dad7d11b-dc65-4470-9774-62e9ac73a4bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.549028 May 19 04:50:58.128072 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2271/4636] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:57 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:58.153980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ba13999-83e6-42df-80f0-7f7b1dcf2aaa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1134596694_updated"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:58.155241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3ba13999-83e6-42df-80f0-7f7b1dcf2aaa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 044622f4-9ec7-4d12-9e9a-b08b6da5a53d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:58.176027 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-3ba13999-83e6-42df-80f0-7f7b1dcf2aaa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 044622f4-9ec7-4d12-9e9a-b08b6da5a53d could not be found. May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ba13999-83e6-42df-80f0-7f7b1dcf2aaa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/servers/044622f4-9ec7-4d12-9e9a-b08b6da5a53d HTTP/1.1 May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 81 May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1134596694_updated"}} May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 044622f4-9ec7-4d12-9e9a-b08b6da5a53d could not be found. May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '044622f4-9ec7-4d12-9e9a-b08b6da5a53d', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1134596694_updated'}}} May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044622f4-9ec7-4d12-9e9a-b08b6da5a53d could not be found. May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 917, in update May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 19 04:50:58.178301 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044622f4-9ec7-4d12-9e9a-b08b6da5a53d could not be found. May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044622f4-9ec7-4d12-9e9a-b08b6da5a53d could not be found. May 19 04:50:58.183709 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:58.186840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ba13999-83e6-42df-80f0-7f7b1dcf2aaa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 044622f4-9ec7-4d12-9e9a-b08b6da5a53d could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:58.187981 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ba13999-83e6-42df-80f0-7f7b1dcf2aaa tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "PUT /compute/v2.1/servers/044622f4-9ec7-4d12-9e9a-b08b6da5a53d" status: 404 len: 111 microversion: 2.1 time: 0.039674 May 19 04:50:58.193051 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2272/4637] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 04:50:58 2022] PUT /compute/v2.1/servers/044622f4-9ec7-4d12-9e9a-b08b6da5a53d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:50:58.200929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-102f0d61-d620-48a9-8142-fe6068cd5a0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:58.204641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-102f0d61-d620-48a9-8142-fe6068cd5a0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:58.227910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-102f0d61-d620-48a9-8142-fe6068cd5a0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:58.229173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-102f0d61-d620-48a9-8142-fe6068cd5a0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:58.230648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-102f0d61-d620-48a9-8142-fe6068cd5a0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:58.231734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-102f0d61-d620-48a9-8142-fe6068cd5a0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:58.466329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-88a6528c-66ba-44b0-bb39-517769dc7c35 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:58.476956 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88a6528c-66ba-44b0-bb39-517769dc7c35 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.724318 May 19 04:50:58.478973 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2366/4638] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:57 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:58.497819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fdf5f091-901c-4687-87e8-2dacda9673eb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:58.498670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fdf5f091-901c-4687-87e8-2dacda9673eb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:58.521743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdf5f091-901c-4687-87e8-2dacda9673eb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:58.545508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdf5f091-901c-4687-87e8-2dacda9673eb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:58.546388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdf5f091-901c-4687-87e8-2dacda9673eb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:58.548110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fdf5f091-901c-4687-87e8-2dacda9673eb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:58.593929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-102f0d61-d620-48a9-8142-fe6068cd5a0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:58.604451 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-102f0d61-d620-48a9-8142-fe6068cd5a0f tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.408128 May 19 04:50:58.618195 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2273/4639] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:58 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:58.624162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69812c78-dc48-48e9-b03e-9339bc16e9d2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:58.625498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-69812c78-dc48-48e9-b03e-9339bc16e9d2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:58.638279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69812c78-dc48-48e9-b03e-9339bc16e9d2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:58.642143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69812c78-dc48-48e9-b03e-9339bc16e9d2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:58.643196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69812c78-dc48-48e9-b03e-9339bc16e9d2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:58.645675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69812c78-dc48-48e9-b03e-9339bc16e9d2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:58.897619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fdf5f091-901c-4687-87e8-2dacda9673eb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:58.908678 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fdf5f091-901c-4687-87e8-2dacda9673eb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1309 microversion: 2.1 time: 0.427606 May 19 04:50:58.915573 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2367/4640] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:58 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1309 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:58.928820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:58.929631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:58.939030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:58.942880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:58.944382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:58.945117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:59.125602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69812c78-dc48-48e9-b03e-9339bc16e9d2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:59.137656 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69812c78-dc48-48e9-b03e-9339bc16e9d2 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.517702 May 19 04:50:59.138433 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2274/4641] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:58 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:50:59.154510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-fc33fd13-0729-4cdb-8113-0ffe8c03424a req-e54934ac-1924-42e1-9b3e-5478890aa4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87f7ed9-b42a-4cb5-9a13-935e4469527f", "name": "network-vif-plugged", "status": "completed", "tag": "015489ba-74b3-4018-ac39-fe4f05102749"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:59.195170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fc33fd13-0729-4cdb-8113-0ffe8c03424a req-e54934ac-1924-42e1-9b3e-5478890aa4d5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:59.195599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fc33fd13-0729-4cdb-8113-0ffe8c03424a req-e54934ac-1924-42e1-9b3e-5478890aa4d5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:59.254841 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-fc33fd13-0729-4cdb-8113-0ffe8c03424a req-e54934ac-1924-42e1-9b3e-5478890aa4d5 service nova] Creating event network-vif-plugged:015489ba-74b3-4018-ac39-fe4f05102749 for instance c87f7ed9-b42a-4cb5-9a13-935e4469527f on n-h2-766726-30 May 19 04:50:59.273479 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-fc33fd13-0729-4cdb-8113-0ffe8c03424a req-e54934ac-1924-42e1-9b3e-5478890aa4d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132390 May 19 04:50:59.276584 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2275/4642] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:59.298175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3bb04c82-b216-4396-8d0b-2025bc9df02b req-c63570ad-8f94-471d-aac5-4ae38f66330d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2ed4d7-0433-49e0-9b9a-8b69892c352a", "tag": "20e8ea57-d063-4e4b-8f31-035093b3da5e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:59.318856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:50:59.325968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3bb04c82-b216-4396-8d0b-2025bc9df02b req-c63570ad-8f94-471d-aac5-4ae38f66330d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:59.326619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3bb04c82-b216-4396-8d0b-2025bc9df02b req-c63570ad-8f94-471d-aac5-4ae38f66330d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:59.365170 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3bb04c82-b216-4396-8d0b-2025bc9df02b req-c63570ad-8f94-471d-aac5-4ae38f66330d service nova] Creating event network-changed:20e8ea57-d063-4e4b-8f31-035093b3da5e for instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a on n-h1-766726-30 May 19 04:50:59.371695 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3bb04c82-b216-4396-8d0b-2025bc9df02b req-c63570ad-8f94-471d-aac5-4ae38f66330d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089249 May 19 04:50:59.373538 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2276/4643] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:50:59.382650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc125e26-dc20-45fa-9bbb-0331500599f3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc125e26-dc20-45fa-9bbb-0331500599f3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 HTTP/1.1 May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 280 May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:59.385408 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 04:50:59.389948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:50:59.393203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc125e26-dc20-45fa-9bbb-0331500599f3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:50:59.394445 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc125e26-dc20-45fa-9bbb-0331500599f3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "PUT /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 400 len: 619 microversion: 2.1 time: 0.019442 May 19 04:50:59.396301 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2277/4644] 10.222.0.58 () {60 vars in 1256 bytes} [Thu May 19 04:50:59 2022] PUT /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:50:59.407546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24a2d67f-4a18-42a9-ae97-eb53067f3801 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:59.408976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-24a2d67f-4a18-42a9-ae97-eb53067f3801 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:59.420312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24a2d67f-4a18-42a9-ae97-eb53067f3801 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:59.422076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24a2d67f-4a18-42a9-ae97-eb53067f3801 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:59.423029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24a2d67f-4a18-42a9-ae97-eb53067f3801 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:59.423704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24a2d67f-4a18-42a9-ae97-eb53067f3801 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:59.531186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:59.560877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:59.575509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:59.577251 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-89bfdd3a-2cb4-4584-88b7-e46a29a51397 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.660566 May 19 04:50:59.589895 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2368/4645] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:50:58 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:50:59.595971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7098d46d-52dc-4c64-b172-238f2390359a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:59.597811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7098d46d-52dc-4c64-b172-238f2390359a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:59.610262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7098d46d-52dc-4c64-b172-238f2390359a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:59.619644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7098d46d-52dc-4c64-b172-238f2390359a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:59.620928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7098d46d-52dc-4c64-b172-238f2390359a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:59.623127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7098d46d-52dc-4c64-b172-238f2390359a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:59.719142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-24a2d67f-4a18-42a9-ae97-eb53067f3801 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:50:59.727489 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-24a2d67f-4a18-42a9-ae97-eb53067f3801 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.326288 May 19 04:50:59.728083 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2278/4646] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:59 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:50:59.750013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-53d962ff-9d77-421f-8f94-9811ca9eb01a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:50:59.750643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-53d962ff-9d77-421f-8f94-9811ca9eb01a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:50:59.769673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53d962ff-9d77-421f-8f94-9811ca9eb01a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:59.775481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53d962ff-9d77-421f-8f94-9811ca9eb01a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:50:59.778845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53d962ff-9d77-421f-8f94-9811ca9eb01a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:50:59.779513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53d962ff-9d77-421f-8f94-9811ca9eb01a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:00.451068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7098d46d-52dc-4c64-b172-238f2390359a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:00.468954 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7098d46d-52dc-4c64-b172-238f2390359a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1368 microversion: 2.1 time: 0.876101 May 19 04:51:00.474960 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2369/4647] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:59 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1368 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:00.490928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5635229d-38de-4932-a2d9-18e5d34c268b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:00.493682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5635229d-38de-4932-a2d9-18e5d34c268b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:00.511089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5635229d-38de-4932-a2d9-18e5d34c268b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:00.512315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5635229d-38de-4932-a2d9-18e5d34c268b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:00.516421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5635229d-38de-4932-a2d9-18e5d34c268b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:00.516991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5635229d-38de-4932-a2d9-18e5d34c268b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:00.602706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-53d962ff-9d77-421f-8f94-9811ca9eb01a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:00.615756 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-53d962ff-9d77-421f-8f94-9811ca9eb01a tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.869669 May 19 04:51:00.617570 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2279/4648] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:50:59 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:00.628777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:00.629358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:00.646146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:00.646627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:00.662988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:00.667098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:00.870286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5635229d-38de-4932-a2d9-18e5d34c268b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:00.887688 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5635229d-38de-4932-a2d9-18e5d34c268b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1309 microversion: 2.1 time: 0.409236 May 19 04:51:00.898362 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2370/4649] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:00 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:00.904644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c8f637f-81b2-40b8-99e3-9cda47403492 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c8f637f-81b2-40b8-99e3-9cda47403492 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: request: PUT /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 HTTP/1.1 May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 24 May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: {"server": {"name": ""}} May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute name. Value: . '' is too short May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6', 'body': {'server': {'name': ''}}} May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi '' May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:51:00.907838 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 19 04:51:00.913459 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:00.916337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c8f637f-81b2-40b8-99e3-9cda47403492 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:51:00.917670 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6c8f637f-81b2-40b8-99e3-9cda47403492 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "PUT /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 400 len: 108 microversion: 2.1 time: 0.017927 May 19 04:51:00.921725 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2371/4650] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 04:51:00 2022] PUT /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:51:00.928590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8636b79-aafb-41c4-a942-7a6fba5eb52c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:00.930178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8636b79-aafb-41c4-a942-7a6fba5eb52c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:00.939562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8636b79-aafb-41c4-a942-7a6fba5eb52c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:00.940385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8636b79-aafb-41c4-a942-7a6fba5eb52c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:00.941580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8636b79-aafb-41c4-a942-7a6fba5eb52c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:00.942262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8636b79-aafb-41c4-a942-7a6fba5eb52c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:01.010145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:01.024524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:01.026082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:01.030148 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a98f29e-444b-41e2-a880-818e81b6c4e2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.411558 May 19 04:51:01.030733 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2280/4651] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:00 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:01.191935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8636b79-aafb-41c4-a942-7a6fba5eb52c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:01.208517 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8636b79-aafb-41c4-a942-7a6fba5eb52c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1504 microversion: 2.1 time: 0.280954 May 19 04:51:01.209859 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2372/4652] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:00 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:01.490464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e13fa93-1165-4106-b857-965fe2ed2d4a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:01.491472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e13fa93-1165-4106-b857-965fe2ed2d4a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:01.504848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e13fa93-1165-4106-b857-965fe2ed2d4a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:01.518898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e13fa93-1165-4106-b857-965fe2ed2d4a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:01.521391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e13fa93-1165-4106-b857-965fe2ed2d4a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:01.522025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e13fa93-1165-4106-b857-965fe2ed2d4a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:01.906327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b3e304f-b233-4c26-bf88-63f1c266d2bb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:01.907246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b3e304f-b233-4c26-bf88-63f1c266d2bb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:01.922328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:01.927684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b3e304f-b233-4c26-bf88-63f1c266d2bb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:01.932657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b3e304f-b233-4c26-bf88-63f1c266d2bb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:01.933675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b3e304f-b233-4c26-bf88-63f1c266d2bb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:01.934148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b3e304f-b233-4c26-bf88-63f1c266d2bb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:01.968676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8e13fa93-1165-4106-b857-965fe2ed2d4a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:01.983807 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e13fa93-1165-4106-b857-965fe2ed2d4a tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1553 microversion: 2.1 time: 0.497938 May 19 04:51:01.999179 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2281/4653] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:01 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1553 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:02.012399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb46ebea-85c2-4abe-a443-5f2705020fb6 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:02.013341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fb46ebea-85c2-4abe-a443-5f2705020fb6 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:02.026457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb46ebea-85c2-4abe-a443-5f2705020fb6 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:02.028802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb46ebea-85c2-4abe-a443-5f2705020fb6 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:02.033315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb46ebea-85c2-4abe-a443-5f2705020fb6 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:02.034131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb46ebea-85c2-4abe-a443-5f2705020fb6 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:02.197504 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fb46ebea-85c2-4abe-a443-5f2705020fb6 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196740 May 19 04:51:02.204066 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2282/4654] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:51:01 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:02.211321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:02.212629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:02.242559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:02.246734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:02.247874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:02.248844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:02.323274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:02.398252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:03.071202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:03.093376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:03.097309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:03.103205 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-df49ae7f-ae21-4b63-9a0b-2204faab542c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.896451 May 19 04:51:03.109236 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2283/4655] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:02 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:03.139449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b3e304f-b233-4c26-bf88-63f1c266d2bb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:03.152697 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b3e304f-b233-4c26-bf88-63f1c266d2bb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1309 microversion: 2.1 time: 1.249352 May 19 04:51:03.153481 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2373/4656] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:01 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1309 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:04.128213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:04.129007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:04.145843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:04.146407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:04.147360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:04.148062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:04.170590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-54836104-a652-4108-99e3-5641df123475 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:04.171930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-54836104-a652-4108-99e3-5641df123475 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:04.186710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:04.196236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54836104-a652-4108-99e3-5641df123475 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:04.197112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54836104-a652-4108-99e3-5641df123475 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:04.200988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54836104-a652-4108-99e3-5641df123475 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:04.201735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54836104-a652-4108-99e3-5641df123475 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:04.663778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:04.684048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:04.693173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:04.699610 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-833da773-ab8a-490e-b070-13e94ba5c0cb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.575655 May 19 04:51:04.703870 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2284/4657] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:04 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:04.737854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9a650b22-c2df-4888-a0fd-577fa6a25d2c req-a628de20-f5ed-4b80-a490-9aa20da6ef22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2ed4d7-0433-49e0-9b9a-8b69892c352a", "name": "network-vif-plugged", "status": "completed", "tag": "20e8ea57-d063-4e4b-8f31-035093b3da5e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:04.752049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-54836104-a652-4108-99e3-5641df123475 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:04.767670 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-54836104-a652-4108-99e3-5641df123475 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1309 microversion: 2.1 time: 0.598855 May 19 04:51:04.781965 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2374/4658] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:04 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1309 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:04.795027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9a650b22-c2df-4888-a0fd-577fa6a25d2c req-a628de20-f5ed-4b80-a490-9aa20da6ef22 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:04.798252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9a650b22-c2df-4888-a0fd-577fa6a25d2c req-a628de20-f5ed-4b80-a490-9aa20da6ef22 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:04.845991 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9a650b22-c2df-4888-a0fd-577fa6a25d2c req-a628de20-f5ed-4b80-a490-9aa20da6ef22 service nova] Creating event network-vif-plugged:20e8ea57-d063-4e4b-8f31-035093b3da5e for instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a on n-h1-766726-30 May 19 04:51:04.862320 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9a650b22-c2df-4888-a0fd-577fa6a25d2c req-a628de20-f5ed-4b80-a490-9aa20da6ef22 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143056 May 19 04:51:04.868816 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2285/4659] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:05.074953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-72456cfe-b0c2-436e-b77e-99681bcc7172 req-90a84a2b-aa4c-4c9e-aceb-be759606080d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87f7ed9-b42a-4cb5-9a13-935e4469527f", "tag": "015489ba-74b3-4018-ac39-fe4f05102749"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:05.093028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-72456cfe-b0c2-436e-b77e-99681bcc7172 req-90a84a2b-aa4c-4c9e-aceb-be759606080d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:05.093939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-72456cfe-b0c2-436e-b77e-99681bcc7172 req-90a84a2b-aa4c-4c9e-aceb-be759606080d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:05.133003 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-72456cfe-b0c2-436e-b77e-99681bcc7172 req-90a84a2b-aa4c-4c9e-aceb-be759606080d service nova] Creating event network-changed:015489ba-74b3-4018-ac39-fe4f05102749 for instance c87f7ed9-b42a-4cb5-9a13-935e4469527f on n-h2-766726-30 May 19 04:51:05.156037 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-72456cfe-b0c2-436e-b77e-99681bcc7172 req-90a84a2b-aa4c-4c9e-aceb-be759606080d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086300 May 19 04:51:05.158642 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2375/4660] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:05.723065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:05.724069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:05.734024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:05.740774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:05.742232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:05.742914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:05.787759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ab2e7db8-42a1-4c63-806a-73d21cb96420 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:05.789328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ab2e7db8-42a1-4c63-806a-73d21cb96420 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:05.806959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab2e7db8-42a1-4c63-806a-73d21cb96420 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:05.809053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab2e7db8-42a1-4c63-806a-73d21cb96420 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:05.813959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab2e7db8-42a1-4c63-806a-73d21cb96420 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:05.815095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab2e7db8-42a1-4c63-806a-73d21cb96420 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:06.703150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:06.715867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:06.717464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:06.718896 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31b09aad-cb9e-4681-b523-5d5003a1e510 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 1.000683 May 19 04:51:06.728238 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2286/4661] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:05 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:06.806692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab2e7db8-42a1-4c63-806a-73d21cb96420 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:06.826513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ab2e7db8-42a1-4c63-806a-73d21cb96420 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1309 microversion: 2.1 time: 1.043046 May 19 04:51:06.840428 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2376/4662] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:05 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1309 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:07.425343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af391637-7375-4f07-b512-8f6ffc8296dc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:07.427715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af391637-7375-4f07-b512-8f6ffc8296dc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:07.439780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af391637-7375-4f07-b512-8f6ffc8296dc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:07.440932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af391637-7375-4f07-b512-8f6ffc8296dc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:07.441652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af391637-7375-4f07-b512-8f6ffc8296dc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:07.442924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af391637-7375-4f07-b512-8f6ffc8296dc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:07.619882 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af391637-7375-4f07-b512-8f6ffc8296dc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.888421 May 19 04:51:07.623020 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2287/4663] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:51:06 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:51:07.632035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c0485a2-a513-4a86-a5a9-fd0800b1a7fd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:07.632943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1c0485a2-a513-4a86-a5a9-fd0800b1a7fd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:07.646126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c0485a2-a513-4a86-a5a9-fd0800b1a7fd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:07.647840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c0485a2-a513-4a86-a5a9-fd0800b1a7fd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:07.648651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c0485a2-a513-4a86-a5a9-fd0800b1a7fd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:07.649131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c0485a2-a513-4a86-a5a9-fd0800b1a7fd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:07.737275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:07.738626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:07.760441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:07.769508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:07.770408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:07.770879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:08.281979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:08.285687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1c0485a2-a513-4a86-a5a9-fd0800b1a7fd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:08.294747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:08.298209 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1c0485a2-a513-4a86-a5a9-fd0800b1a7fd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1670 microversion: 2.1 time: 0.671268 May 19 04:51:08.300392 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2377/4664] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:07 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1670 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:08.301936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:08.303461 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fbed2c06-c0dd-4983-8fe0-c1e1b474dff9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.570596 May 19 04:51:08.310624 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2288/4665] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:07 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:51:08.314704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4f468b68-1fe0-4bc9-b67c-2b9b067589d1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:08.315333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4f468b68-1fe0-4bc9-b67c-2b9b067589d1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:08.332332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f468b68-1fe0-4bc9-b67c-2b9b067589d1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:08.333854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f468b68-1fe0-4bc9-b67c-2b9b067589d1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:08.334943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f468b68-1fe0-4bc9-b67c-2b9b067589d1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:08.335633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f468b68-1fe0-4bc9-b67c-2b9b067589d1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:08.615202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4f468b68-1fe0-4bc9-b67c-2b9b067589d1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:08.632712 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4f468b68-1fe0-4bc9-b67c-2b9b067589d1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1490 microversion: 2.1 time: 0.331198 May 19 04:51:08.633942 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2378/4666] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:08 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1490 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:08.652339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1f695ebc-259f-49b9-a88f-ecfd78fd743b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:08.653217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1f695ebc-259f-49b9-a88f-ecfd78fd743b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:08.665868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f695ebc-259f-49b9-a88f-ecfd78fd743b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:08.666976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f695ebc-259f-49b9-a88f-ecfd78fd743b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:08.668854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f695ebc-259f-49b9-a88f-ecfd78fd743b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:08.670279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f695ebc-259f-49b9-a88f-ecfd78fd743b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:08.927212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1f695ebc-259f-49b9-a88f-ecfd78fd743b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:08.941894 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1f695ebc-259f-49b9-a88f-ecfd78fd743b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1490 microversion: 2.1 time: 0.294190 May 19 04:51:08.944394 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2289/4667] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:08 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1490 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:08.963010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-17b58a0f-bc90-4121-bb3c-c452e153d80d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:08.964187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-17b58a0f-bc90-4121-bb3c-c452e153d80d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:08.973149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17b58a0f-bc90-4121-bb3c-c452e153d80d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:08.974617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17b58a0f-bc90-4121-bb3c-c452e153d80d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:08.975876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17b58a0f-bc90-4121-bb3c-c452e153d80d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:08.976664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17b58a0f-bc90-4121-bb3c-c452e153d80d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:09.205712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-17b58a0f-bc90-4121-bb3c-c452e153d80d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:09.208981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:09.216214 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-17b58a0f-bc90-4121-bb3c-c452e153d80d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1490 microversion: 2.1 time: 0.258756 May 19 04:51:09.217394 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2379/4668] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:08 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1490 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:09.233892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6fd5bd4e-c228-42fe-a635-807adf32d39f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:09.234185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6fd5bd4e-c228-42fe-a635-807adf32d39f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:09.242758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fd5bd4e-c228-42fe-a635-807adf32d39f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:09.245620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fd5bd4e-c228-42fe-a635-807adf32d39f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:09.246414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fd5bd4e-c228-42fe-a635-807adf32d39f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:09.246866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fd5bd4e-c228-42fe-a635-807adf32d39f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:09.307726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6fd5bd4e-c228-42fe-a635-807adf32d39f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:51:09.320445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-731d3406-6ef6-4afc-8650-9d9b3d972bbd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:09.323378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-731d3406-6ef6-4afc-8650-9d9b3d972bbd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:09.333436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-731d3406-6ef6-4afc-8650-9d9b3d972bbd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:09.334104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-731d3406-6ef6-4afc-8650-9d9b3d972bbd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:09.336158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-731d3406-6ef6-4afc-8650-9d9b3d972bbd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:09.336783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-731d3406-6ef6-4afc-8650-9d9b3d972bbd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:09.462167 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6fd5bd4e-c228-42fe-a635-807adf32d39f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 204 len: 0 microversion: 2.1 time: 0.232232 May 19 04:51:09.463391 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2290/4669] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:51:09 2022] DELETE /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 04:51:09.472102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:09.474465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:09.484804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:09.485742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:09.486724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:09.487481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:09.662782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-731d3406-6ef6-4afc-8650-9d9b3d972bbd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:09.672362 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-731d3406-6ef6-4afc-8650-9d9b3d972bbd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1675 microversion: 2.1 time: 0.359003 May 19 04:51:09.686979 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2380/4670] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:09 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1675 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:09.708583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64245cd5-77a7-475f-bab7-72bae677dbf5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:09.715902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64245cd5-77a7-475f-bab7-72bae677dbf5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:09.737722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64245cd5-77a7-475f-bab7-72bae677dbf5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:09.738967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64245cd5-77a7-475f-bab7-72bae677dbf5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:09.745013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64245cd5-77a7-475f-bab7-72bae677dbf5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:09.745726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64245cd5-77a7-475f-bab7-72bae677dbf5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:09.791065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:09.805198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:09.813847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:09.815102 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64083ad0-864e-44ee-8564-1e984d6e9ce9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.350286 May 19 04:51:09.815669 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2291/4671] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:09 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:10.001142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-64245cd5-77a7-475f-bab7-72bae677dbf5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:10.011609 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64245cd5-77a7-475f-bab7-72bae677dbf5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1496 microversion: 2.1 time: 0.318880 May 19 04:51:10.021813 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2381/4672] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:09 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1496 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:10.704464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c7413294-3d68-4cc2-a096-0eca824d87ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:10.705595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c7413294-3d68-4cc2-a096-0eca824d87ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:10.716279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7413294-3d68-4cc2-a096-0eca824d87ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:10.719501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7413294-3d68-4cc2-a096-0eca824d87ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:10.720442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7413294-3d68-4cc2-a096-0eca824d87ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:10.723164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7413294-3d68-4cc2-a096-0eca824d87ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:10.834286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:10.835085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:10.850989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:10.851364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:10.852346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:10.852982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:11.204356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c7413294-3d68-4cc2-a096-0eca824d87ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:11.215397 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c7413294-3d68-4cc2-a096-0eca824d87ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.515478 May 19 04:51:11.218149 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2292/4673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:10 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:11.235153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8ca94b9a-8766-420a-ad1c-8b9cce9cbbea tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:11.240114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8ca94b9a-8766-420a-ad1c-8b9cce9cbbea tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:11.258798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ca94b9a-8766-420a-ad1c-8b9cce9cbbea tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:11.259724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ca94b9a-8766-420a-ad1c-8b9cce9cbbea tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:11.261312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ca94b9a-8766-420a-ad1c-8b9cce9cbbea tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:11.263672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ca94b9a-8766-420a-ad1c-8b9cce9cbbea tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:11.346873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:11.374399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:11.376040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:11.377568 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3d279318-7e6b-408e-a994-5e91a1e18fd4 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1752 microversion: 2.20 time: 0.547961 May 19 04:51:11.378649 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2382/4674] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:10 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1752 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:51:11.630927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8ca94b9a-8766-420a-ad1c-8b9cce9cbbea tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:11.646562 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8ca94b9a-8766-420a-ad1c-8b9cce9cbbea tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1496 microversion: 2.1 time: 0.425651 May 19 04:51:11.658338 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2293/4675] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:11 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1496 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:12.397924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:12.398918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:12.404507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-700c53f8-132d-4b5a-9647-353740548c5c req-5f656a33-b808-4500-8022-bfeb3d9dce12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2ed4d7-0433-49e0-9b9a-8b69892c352a", "name": "network-vif-deleted", "tag": "20e8ea57-d063-4e4b-8f31-035093b3da5e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:12.415176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:12.415652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:12.421020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:12.421685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:12.434627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-700c53f8-132d-4b5a-9647-353740548c5c req-5f656a33-b808-4500-8022-bfeb3d9dce12 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:12.436127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-700c53f8-132d-4b5a-9647-353740548c5c req-5f656a33-b808-4500-8022-bfeb3d9dce12 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:12.472944 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-700c53f8-132d-4b5a-9647-353740548c5c req-5f656a33-b808-4500-8022-bfeb3d9dce12 service nova] Creating event network-vif-deleted:20e8ea57-d063-4e4b-8f31-035093b3da5e for instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a on n-h1-766726-30 May 19 04:51:12.487736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-700c53f8-132d-4b5a-9647-353740548c5c req-5f656a33-b808-4500-8022-bfeb3d9dce12 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086812 May 19 04:51:12.488356 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2294/4676] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:51:12.666720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:12.667432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:12.687110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:12.692045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:12.695778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:12.697322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:12.802798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:12.816496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:12.819649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:12.821260 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a29e971b-3fc8-4bae-9f6d-aefb5a0d2862 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.429253 May 19 04:51:12.822436 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2383/4677] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:12 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:12.828656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:12.829975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:12.837012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lazy-loading 'fault' on Instance uuid 1a2ed4d7-0433-49e0-9b9a-8b69892c352a {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:51:12.917486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:12.934555 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-888b0763-4f97-449d-bc9c-9f6a18df1892 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 200 len: 1299 microversion: 2.1 time: 0.270133 May 19 04:51:12.945433 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2295/4678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:12 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 1299 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:13.841530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:13.843027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:13.861270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:13.862662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:13.863549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:13.864148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:13.957156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:13.958289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:13.976855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:13.977349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:13.978146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:13.978597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:14.062361 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a HTTP/1.1 May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '1a2ed4d7-0433-49e0-9b9a-8b69892c352a'} May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:14.069444 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:14.076960 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:14.076960 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:14.076960 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:51:14.076960 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:51:14.076960 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:51:14.076960 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:14.076960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:51:14.078421 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b9f748de-c54a-4663-abe8-86610fb2a9bf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 404 len: 111 microversion: 2.1 time: 0.125609 May 19 04:51:14.078421 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2296/4679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:13 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:51:14.104827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-abf6e882-3788-469f-af4d-8199e2c188d3 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:14.106018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-abf6e882-3788-469f-af4d-8199e2c188d3 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:14.132032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf6e882-3788-469f-af4d-8199e2c188d3 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:14.133261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf6e882-3788-469f-af4d-8199e2c188d3 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:14.134732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf6e882-3788-469f-af4d-8199e2c188d3 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:14.136354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf6e882-3788-469f-af4d-8199e2c188d3 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:14.274599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:14.297005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:14.310952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:14.319031 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-40a36983-a3c8-40e4-ac43-d96825f16fd2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.480211 May 19 04:51:14.348213 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2384/4680] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:13 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:14.842320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-abf6e882-3788-469f-af4d-8199e2c188d3 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:51:14.890192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:15.004452 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-abf6e882-3788-469f-af4d-8199e2c188d3 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 204 len: 0 microversion: 2.1 time: 0.912802 May 19 04:51:15.006317 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2297/4681] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:51:14 2022] DELETE /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:51:15.016788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba8d5435-ff52-4e55-a83b-5a08c4b551b2 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:15.018362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba8d5435-ff52-4e55-a83b-5a08c4b551b2 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:15.026053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba8d5435-ff52-4e55-a83b-5a08c4b551b2 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:15.026888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba8d5435-ff52-4e55-a83b-5a08c4b551b2 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:15.028045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba8d5435-ff52-4e55-a83b-5a08c4b551b2 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:15.028775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba8d5435-ff52-4e55-a83b-5a08c4b551b2 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:15.340661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:15.341786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:15.355104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:15.357978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:15.359249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:15.360687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:15.419299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba8d5435-ff52-4e55-a83b-5a08c4b551b2 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:15.434003 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba8d5435-ff52-4e55-a83b-5a08c4b551b2 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1496 microversion: 2.1 time: 0.422585 May 19 04:51:15.435055 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2385/4682] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:15 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1496 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:15.726781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:15.747284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:15.748791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:15.768111 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-762accd7-8299-4b7c-b3fa-08069dbd3c6f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.432678 May 19 04:51:15.769940 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2298/4683] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:15 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:16.452574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8a64b96-1a85-4327-a89f-0c646ebd4035 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:16.453256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8a64b96-1a85-4327-a89f-0c646ebd4035 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:16.463421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8a64b96-1a85-4327-a89f-0c646ebd4035 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:16.463870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8a64b96-1a85-4327-a89f-0c646ebd4035 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:16.495007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8a64b96-1a85-4327-a89f-0c646ebd4035 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:16.495974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8a64b96-1a85-4327-a89f-0c646ebd4035 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:16.786965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:16.787734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:16.809351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:16.816024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:16.817214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:16.819104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:16.934323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8a64b96-1a85-4327-a89f-0c646ebd4035 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:16.943508 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8a64b96-1a85-4327-a89f-0c646ebd4035 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1496 microversion: 2.1 time: 0.495582 May 19 04:51:16.950423 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2386/4684] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:16 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1496 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:17.212682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:17.237498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:17.238266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:17.240536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:17.246766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:17.248208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:17.250551 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8310c9b4-410a-489f-b619-53c9b930cbbc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.466078 May 19 04:51:17.251265 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2299/4685] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:16 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:17.251404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:17.252381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:17.252997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:17.293225 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 HTTP/1.1 May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c5ba435c-005c-4eff-beba-73270faa88e2'} May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:51:17.295228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.300167 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:17.307076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:51:17.308304 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b10a3177-f8f0-4e3e-a4e1-e476ea9631b3 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 404 len: 111 microversion: 2.1 time: 0.074929 May 19 04:51:17.313491 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2387/4686] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:51:17 2022] DELETE /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:51:17.328826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:17.330020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: c5ba435c-005c-4eff-beba-73270faa88e2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:17.343448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:17.345362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:17.350751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:17.352057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:17.440713 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 HTTP/1.1 May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c5ba435c-005c-4eff-beba-73270faa88e2'} May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:17.444439 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:17.449396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:17.449396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:17.449396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:17.449396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:51:17.449396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:51:17.449396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. May 19 04:51:17.449396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:17.463996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance c5ba435c-005c-4eff-beba-73270faa88e2 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:51:17.466765 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f0b38d4f-8bb3-4b94-80aa-fc4e79af959c tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2" status: 404 len: 111 microversion: 2.1 time: 0.147169 May 19 04:51:17.477584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1aaa9543-e2da-47b5-b1a8-f16a8c9210bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:17.478213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1aaa9543-e2da-47b5-b1a8-f16a8c9210bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:17.478632 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2300/4687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:17 2022] GET /compute/v2.1/servers/c5ba435c-005c-4eff-beba-73270faa88e2 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:51:17.489992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1aaa9543-e2da-47b5-b1a8-f16a8c9210bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:17.490432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1aaa9543-e2da-47b5-b1a8-f16a8c9210bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:17.491530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1aaa9543-e2da-47b5-b1a8-f16a8c9210bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:17.491962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1aaa9543-e2da-47b5-b1a8-f16a8c9210bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:17.586548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1aaa9543-e2da-47b5-b1a8-f16a8c9210bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:51:17.822385 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1aaa9543-e2da-47b5-b1a8-f16a8c9210bd tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "DELETE /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 204 len: 0 microversion: 2.1 time: 0.348348 May 19 04:51:17.823328 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2388/4688] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:51:17 2022] DELETE /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:51:17.832051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1de33870-6208-440d-9178-3cde093b9a6d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:17.833379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1de33870-6208-440d-9178-3cde093b9a6d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:17.867719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1de33870-6208-440d-9178-3cde093b9a6d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:17.876560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1de33870-6208-440d-9178-3cde093b9a6d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:17.885293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1de33870-6208-440d-9178-3cde093b9a6d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:17.888086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1de33870-6208-440d-9178-3cde093b9a6d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:17.967838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac11e351-289f-4755-9b05-c76840249cbb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:17.968870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac11e351-289f-4755-9b05-c76840249cbb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:17.984250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac11e351-289f-4755-9b05-c76840249cbb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:17.999369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac11e351-289f-4755-9b05-c76840249cbb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:18.002699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac11e351-289f-4755-9b05-c76840249cbb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:18.006620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac11e351-289f-4755-9b05-c76840249cbb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:18.203002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac11e351-289f-4755-9b05-c76840249cbb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:18.215168 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac11e351-289f-4755-9b05-c76840249cbb tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1454 microversion: 2.1 time: 0.252192 May 19 04:51:18.228541 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2389/4689] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:17 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1454 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:18.239788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-7b43d618-ee6b-470a-a1a2-972a0a6f682d req-aa231f41-66fc-485e-8e4e-c37ffc21b82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13fda296-1b39-442f-9602-e20099131e85", "name": "network-vif-deleted", "tag": "81881db8-d56a-466d-bb0f-1fccff5c8a98"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:18.257279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7b43d618-ee6b-470a-a1a2-972a0a6f682d req-aa231f41-66fc-485e-8e4e-c37ffc21b82b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:18.261044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7b43d618-ee6b-470a-a1a2-972a0a6f682d req-aa231f41-66fc-485e-8e4e-c37ffc21b82b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:18.286896 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7b43d618-ee6b-470a-a1a2-972a0a6f682d req-aa231f41-66fc-485e-8e4e-c37ffc21b82b service nova] Creating event network-vif-deleted:81881db8-d56a-466d-bb0f-1fccff5c8a98 for instance 13fda296-1b39-442f-9602-e20099131e85 on n-h1-766726-30 May 19 04:51:18.297949 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-7b43d618-ee6b-470a-a1a2-972a0a6f682d req-aa231f41-66fc-485e-8e4e-c37ffc21b82b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066657 May 19 04:51:18.300703 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2390/4690] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:18.313881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:18.314888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:18.321318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1de33870-6208-440d-9178-3cde093b9a6d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:18.350030 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1de33870-6208-440d-9178-3cde093b9a6d tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1510 microversion: 2.1 time: 0.522448 May 19 04:51:18.351216 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2301/4691] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:17 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:18.364419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:18.365240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:18.366448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:18.367101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:18.692668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:18.707949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:18.711773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:18.713831 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-150a3630-93b1-4af9-b4d3-198387e0a886 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.410954 May 19 04:51:18.714952 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2391/4692] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:18 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:19.237458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:19.241878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:19.259059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:19.262120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:19.270809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:19.273010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:19.367824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f6d9cfb0-dd41-40ce-a704-472a18da59b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:19.368675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f6d9cfb0-dd41-40ce-a704-472a18da59b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:19.378475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6d9cfb0-dd41-40ce-a704-472a18da59b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:19.394335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6d9cfb0-dd41-40ce-a704-472a18da59b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:19.397736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6d9cfb0-dd41-40ce-a704-472a18da59b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:19.401832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6d9cfb0-dd41-40ce-a704-472a18da59b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:19.468495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:19.469200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:19.469806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lazy-loading 'fault' on Instance uuid 13fda296-1b39-442f-9602-e20099131e85 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:51:19.598880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:19.608567 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3f38876b-a45d-4172-9e97-1fdc5afa5b4c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 200 len: 1299 microversion: 2.1 time: 0.378383 May 19 04:51:19.621181 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2302/4693] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:19 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 1299 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:19.736610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:19.737599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:19.757704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:19.759391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:19.765875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:19.768892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:19.874459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f6d9cfb0-dd41-40ce-a704-472a18da59b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:19.885698 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f6d9cfb0-dd41-40ce-a704-472a18da59b0 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1510 microversion: 2.1 time: 0.522133 May 19 04:51:19.890713 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2392/4694] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:19 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1510 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:20.201646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:20.234390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:20.243328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:20.249242 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4126749d-d333-4db9-8095-ac490608bb1f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.515262 May 19 04:51:20.252603 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2303/4695] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:19 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:51:20.627905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:20.628483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:20.644457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:20.645756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:20.650097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:20.650729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:20.698430 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 HTTP/1.1 May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '13fda296-1b39-442f-9602-e20099131e85'} May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:20.700891 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:20.704228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:20.704228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:20.704228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:51:20.704228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:51:20.704228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:51:20.704228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:20.711901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:51:20.713984 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f704ccd-75cb-4788-87ba-27045339b52e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 404 len: 111 microversion: 2.1 time: 0.090134 May 19 04:51:20.716400 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2393/4696] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:20 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:51:20.907711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6dea7f18-68a1-4db9-be24-29a1383439a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:20.908614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6dea7f18-68a1-4db9-be24-29a1383439a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:20.924646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dea7f18-68a1-4db9-be24-29a1383439a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:20.932737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dea7f18-68a1-4db9-be24-29a1383439a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:20.937445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dea7f18-68a1-4db9-be24-29a1383439a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:20.938129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dea7f18-68a1-4db9-be24-29a1383439a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:21.099179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-779234972", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:21.222450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] validate_networks() for [('3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:51:22.374834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6dea7f18-68a1-4db9-be24-29a1383439a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:22.384105 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6dea7f18-68a1-4db9-be24-29a1383439a4 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1468 microversion: 2.1 time: 1.480864 May 19 04:51:22.391017 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2304/4697] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:20 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1468 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:22.408947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:22.409725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:22.443625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:22.444088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:22.444942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:22.450265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:22.960245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:22.978632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:22.987729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:22.990002 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-68758b46-6df1-4985-80a2-8cbd8bdd3983 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.597731 May 19 04:51:22.991890 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2305/4698] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:22 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:22.998967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bbfa7ba1-6c1f-4a0d-bb7e-be154e7ea497 req-ee9f8a62-6dd1-4706-94e8-11848517be96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878aa03f-a366-4d71-b678-1c749fc143c6", "name": "network-vif-deleted", "tag": "ba6e6c22-0bce-4292-b1fd-46293b3f4ad6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:23.031168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bbfa7ba1-6c1f-4a0d-bb7e-be154e7ea497 req-ee9f8a62-6dd1-4706-94e8-11848517be96 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:23.031935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bbfa7ba1-6c1f-4a0d-bb7e-be154e7ea497 req-ee9f8a62-6dd1-4706-94e8-11848517be96 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:23.078535 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bbfa7ba1-6c1f-4a0d-bb7e-be154e7ea497 req-ee9f8a62-6dd1-4706-94e8-11848517be96 service nova] Creating event network-vif-deleted:ba6e6c22-0bce-4292-b1fd-46293b3f4ad6 for instance 878aa03f-a366-4d71-b678-1c749fc143c6 on n-h2-766726-30 May 19 04:51:23.097637 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bbfa7ba1-6c1f-4a0d-bb7e-be154e7ea497 req-ee9f8a62-6dd1-4706-94e8-11848517be96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104292 May 19 04:51:23.104890 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2306/4699] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:23.402852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:23.404519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:23.426115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:23.427465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:23.430618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:23.432655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:23.551780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:23.559397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:23.562632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lazy-loading 'fault' on Instance uuid 878aa03f-a366-4d71-b678-1c749fc143c6 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:51:23.832951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:51:23.834203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:51:23.835444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:51:23.836539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:51:23.837589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:51:23.853008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee053217f394bf9a08913b7615d3bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34f414629e3407b8bf0b90a6e2938ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:23.855833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:23.856739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:23.858452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:23.859348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:23.870162 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f1a2b932-6174-42c8-a7bf-543ecfb33ca5 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 200 len: 1306 microversion: 2.1 time: 0.472370 May 19 04:51:23.872310 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2307/4700] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:23 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 1306 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:23.892006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:51:23.905654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for user a75cb8e84f674ef0814a39d2a4887933 and project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:51:23.936202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:51:23.939287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:51:24.010119 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5525e27a-cfc0-40b4-82a8-e2a921fbad54 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.916559 May 19 04:51:24.011283 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2394/4701] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:51:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:51:24.013163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:24.014037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:24.022891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0324f433-74b2-47f1-8cff-6e6fe6477aae tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:24.023833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0324f433-74b2-47f1-8cff-6e6fe6477aae tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:24.032222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:24.037813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:24.041537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:24.042267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:24.118239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0324f433-74b2-47f1-8cff-6e6fe6477aae tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:24.130378 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0324f433-74b2-47f1-8cff-6e6fe6477aae tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1208 microversion: 2.1 time: 0.113281 May 19 04:51:24.132104 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2395/4702] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:24 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1208 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:24.539793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:24.560651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:24.565817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:24.567490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-73013388-889e-4d78-a691-326c4974c742 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.560685 May 19 04:51:24.585195 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2308/4703] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:24 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:51:24.898302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:24.898302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] [instance: 878aa03f-a366-4d71-b678-1c749fc143c6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:24.911178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:24.915127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:24.915127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:24.915127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:24.973868 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] HTTP exception thrown: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 could not be found. May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Request method failure captured: May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 HTTP/1.1 May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcu1wtPoiOgU57SaQ6HzfxwOL_RvP7Ief1IOVths4yW02dOn3Wtf54ZVHu6k4JB7m649dKfD9Bq3TmLRgPJPcg6Hy07r9qlcTQmlxWAGLgF0eiy-3DztsM9Ai4lB2qxynP7qKt89RsIUN-khg3_ozFFPJHBMxKISMP98aB_OyFzEtL4 May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a34f414629e3407b8bf0b90a6e2938ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: a34f414629e3407b8bf0b90a6e2938ca May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-403265779 May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-403265779-project May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 7ee053217f394bf9a08913b7615d3bc9 May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-403265779-project May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 could not be found. May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '878aa03f-a366-4d71-b678-1c749fc143c6'} May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 could not be found. May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 could not be found. May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:24.988425 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:24.991913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:24.991913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:24.991913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:24.991913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:51:24.991913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:51:24.991913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 could not be found. May 19 04:51:24.991913 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:24.991913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] Returning 404 to user: Instance 878aa03f-a366-4d71-b678-1c749fc143c6 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:51:24.994300 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-89a11f25-0376-405a-b66d-5766e6038811 tempest-ServersNegativeTestJSON-403265779 tempest-ServersNegativeTestJSON-403265779-project] 10.222.0.58 "GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6" status: 404 len: 111 microversion: 2.1 time: 0.108582 May 19 04:51:25.014223 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2396/4704] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:24 2022] GET /compute/v2.1/servers/878aa03f-a366-4d71-b678-1c749fc143c6 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:51:25.151145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-862bb866-c6e0-42c9-9be2-6ceba9b023f9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:25.151762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-862bb866-c6e0-42c9-9be2-6ceba9b023f9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:25.185626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-862bb866-c6e0-42c9-9be2-6ceba9b023f9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:25.186992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-862bb866-c6e0-42c9-9be2-6ceba9b023f9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:25.187818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-862bb866-c6e0-42c9-9be2-6ceba9b023f9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:25.195418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-862bb866-c6e0-42c9-9be2-6ceba9b023f9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:25.546699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-862bb866-c6e0-42c9-9be2-6ceba9b023f9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:25.567291 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-862bb866-c6e0-42c9-9be2-6ceba9b023f9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1212 microversion: 2.1 time: 0.412047 May 19 04:51:25.569971 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2309/4705] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:25 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1212 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:25.587743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:25.588882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:25.604016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:25.618798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:25.624991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:25.626994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:25.913347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:25.928421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:25.930646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:25.935276 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2e7351d-a0e6-4927-8b1b-d3eda77cc9f6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.351495 May 19 04:51:25.935878 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2397/4706] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:25 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:26.586511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d5bc906e-5fad-4254-9bad-7efe39a492f1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:26.587742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d5bc906e-5fad-4254-9bad-7efe39a492f1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:26.595399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5bc906e-5fad-4254-9bad-7efe39a492f1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:26.596018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5bc906e-5fad-4254-9bad-7efe39a492f1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:26.596954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5bc906e-5fad-4254-9bad-7efe39a492f1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:26.597628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5bc906e-5fad-4254-9bad-7efe39a492f1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:26.739115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d5bc906e-5fad-4254-9bad-7efe39a492f1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:26.749979 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d5bc906e-5fad-4254-9bad-7efe39a492f1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1260 microversion: 2.1 time: 0.167387 May 19 04:51:26.767286 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2310/4707] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:26 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:26.956532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:26.957795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:26.967661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:26.968123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:26.968922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:26.976726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:27.330459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:27.347833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:27.354984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:27.360852 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-08134ad1-5998-4a33-ae88-a4e9a505a6e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.407956 May 19 04:51:27.363642 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2398/4708] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:26 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:27.768810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-457fd240-04b3-44bb-97d5-07b94105c0db tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:27.771009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-457fd240-04b3-44bb-97d5-07b94105c0db tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:27.824809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-457fd240-04b3-44bb-97d5-07b94105c0db tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:27.826716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-457fd240-04b3-44bb-97d5-07b94105c0db tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:27.829511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-457fd240-04b3-44bb-97d5-07b94105c0db tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:27.830305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-457fd240-04b3-44bb-97d5-07b94105c0db tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:28.043581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-457fd240-04b3-44bb-97d5-07b94105c0db tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:28.052529 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-457fd240-04b3-44bb-97d5-07b94105c0db tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1266 microversion: 2.1 time: 0.288907 May 19 04:51:28.062219 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2311/4709] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:27 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:28.386176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:28.387572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:28.454333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:28.455154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:28.456473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:28.460348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:28.475318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:28.954746 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 04:51:28.954935 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 04:51:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da (ip 10.222.0.58) !!! May 19 04:51:29.072399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:29.073839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:29.093960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:29.096929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:29.101310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:29.102158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:29.214564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:29.239839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:29.245493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:29.250338 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.871998 May 19 04:51:29.253065 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2399/4710] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:28 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:29.437881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:29.454922 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1308 microversion: 2.1 time: 0.387356 May 19 04:51:29.458420 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2312/4711] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:29 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:29.878245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:29.880465 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002704 May 19 04:51:29.881243 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2400/4712] 10.222.0.58 () {56 vars in 885 bytes} [Thu May 19 04:51:29 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 04:51:29.888541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:29.890215 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002479 May 19 04:51:29.890992 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2313/4713] 10.222.0.58 () {54 vars in 1034 bytes} [Thu May 19 04:51:29 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) May 19 04:51:29.897935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:29.900085 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88e14659-1796-4ea2-b80c-9176bdc95c31 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002355 May 19 04:51:29.901122 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2401/4714] 10.222.0.58 () {54 vars in 1040 bytes} [Thu May 19 04:51:29 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:29.909368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:29.911433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2408239-397a-443f-a3d1-d48cb2d8adb9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001854 May 19 04:51:29.919610 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2314/4715] 10.222.0.58 () {56 vars in 885 bytes} [Thu May 19 04:51:29 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 04:51:30.273460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:30.274285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:30.282960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:30.283836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:30.284908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:30.286165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:30.479004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b94308aa-9be3-48bf-a4bc-6e1bff342596 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:30.480685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b94308aa-9be3-48bf-a4bc-6e1bff342596 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:30.489535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:30.508366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94308aa-9be3-48bf-a4bc-6e1bff342596 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:30.511089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94308aa-9be3-48bf-a4bc-6e1bff342596 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:30.514837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94308aa-9be3-48bf-a4bc-6e1bff342596 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:30.518537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b94308aa-9be3-48bf-a4bc-6e1bff342596 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:30.588194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:30.602997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:30.604662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:30.628229 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4961624a-887d-4fc3-af21-371376bfcfed tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.357125 May 19 04:51:30.630791 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2402/4716] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:30 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:31.092268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b94308aa-9be3-48bf-a4bc-6e1bff342596 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:31.103785 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b94308aa-9be3-48bf-a4bc-6e1bff342596 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1308 microversion: 2.1 time: 0.628914 May 19 04:51:31.104404 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2315/4717] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:30 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:31.371681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-012623d7-b89f-4f39-9fea-fffe1bcca838 req-390ea7ad-99c0-4ce0-917c-16478dcc2bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ad340e-7fc0-43e0-8a45-8227ae528225", "tag": "d687cc22-1506-4c71-a468-bcd341ef9fa1"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:31.400855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-012623d7-b89f-4f39-9fea-fffe1bcca838 req-390ea7ad-99c0-4ce0-917c-16478dcc2bb7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:31.405521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-012623d7-b89f-4f39-9fea-fffe1bcca838 req-390ea7ad-99c0-4ce0-917c-16478dcc2bb7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:31.424928 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-012623d7-b89f-4f39-9fea-fffe1bcca838 req-390ea7ad-99c0-4ce0-917c-16478dcc2bb7 service nova] Creating event network-changed:d687cc22-1506-4c71-a468-bcd341ef9fa1 for instance c7ad340e-7fc0-43e0-8a45-8227ae528225 on n-h1-766726-30 May 19 04:51:31.431384 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-012623d7-b89f-4f39-9fea-fffe1bcca838 req-390ea7ad-99c0-4ce0-917c-16478dcc2bb7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063958 May 19 04:51:31.432493 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2403/4718] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:31.647628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:31.648335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:31.660745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:31.662978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:31.664176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:31.664819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:31.694669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:32.122143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4aee697e-9da9-43dc-8012-89e54068235f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:32.123148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4aee697e-9da9-43dc-8012-89e54068235f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:32.144031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aee697e-9da9-43dc-8012-89e54068235f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:32.145710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aee697e-9da9-43dc-8012-89e54068235f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:32.147048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aee697e-9da9-43dc-8012-89e54068235f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:32.147962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aee697e-9da9-43dc-8012-89e54068235f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:32.603560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:32.614292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:32.624019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:32.625794 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-60c9a959-6d01-4898-a0c8-014adf9dde44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.982736 May 19 04:51:32.628561 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2316/4719] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:31 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:32.887186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4aee697e-9da9-43dc-8012-89e54068235f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:32.895405 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4aee697e-9da9-43dc-8012-89e54068235f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1308 microversion: 2.1 time: 0.778230 May 19 04:51:32.902000 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2404/4720] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:32 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1308 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:33.647907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:33.648582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:33.672726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:33.673444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:33.674309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:33.682705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:33.912246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dc23bd57-b80f-453f-80cb-1028b7ba715c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:33.915971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dc23bd57-b80f-453f-80cb-1028b7ba715c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:33.945284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:33.951018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc23bd57-b80f-453f-80cb-1028b7ba715c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:33.952160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc23bd57-b80f-453f-80cb-1028b7ba715c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:33.954503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc23bd57-b80f-453f-80cb-1028b7ba715c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:33.955172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc23bd57-b80f-453f-80cb-1028b7ba715c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:34.125390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:34.381479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:34.405549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:34.413184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:34.416309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3d760220-81e8-409c-b225-a4b1c6ecec4d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.772555 May 19 04:51:34.434701 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2317/4721] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:33 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:51:34.633590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc23bd57-b80f-453f-80cb-1028b7ba715c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:34.651668 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dc23bd57-b80f-453f-80cb-1028b7ba715c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1308 microversion: 2.1 time: 0.740991 May 19 04:51:34.654331 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2405/4722] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:33 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1308 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:35.443642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:35.444265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:35.466175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:35.466636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:35.470761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:35.471400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:35.670613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c6d0987-2cf7-4670-871e-44842f623c96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:35.671898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1c6d0987-2cf7-4670-871e-44842f623c96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:35.679056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:35.708220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c6d0987-2cf7-4670-871e-44842f623c96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:35.708696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c6d0987-2cf7-4670-871e-44842f623c96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:35.709570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c6d0987-2cf7-4670-871e-44842f623c96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:35.710022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c6d0987-2cf7-4670-871e-44842f623c96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:36.501465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:36.529319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:36.537216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:36.546186 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1b2977bd-a06f-489c-b009-14078a13db5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 1.107171 May 19 04:51:36.557008 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2318/4723] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:35 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:36.588400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1c6d0987-2cf7-4670-871e-44842f623c96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:36.596464 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1c6d0987-2cf7-4670-871e-44842f623c96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1308 microversion: 2.1 time: 0.931018 May 19 04:51:36.600958 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2406/4724] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:35 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1308 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:36.819708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d2322e21-a2a1-4d97-8a57-3636d5844dfa tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:36.820681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d2322e21-a2a1-4d97-8a57-3636d5844dfa tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:36.831203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2322e21-a2a1-4d97-8a57-3636d5844dfa tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:36.832368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2322e21-a2a1-4d97-8a57-3636d5844dfa tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:36.833846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2322e21-a2a1-4d97-8a57-3636d5844dfa tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:36.842455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2322e21-a2a1-4d97-8a57-3636d5844dfa tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:36.996034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-d2322e21-a2a1-4d97-8a57-3636d5844dfa tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lazy-loading 'services' on Instance uuid a5092d7a-519d-4692-bd60-04ff4991b809 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:51:37.119580 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d2322e21-a2a1-4d97-8a57-3636d5844dfa tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809/os-volume_attachments/2a3d98d7-6ea6-4d55-b468-b384ffe02a40" status: 202 len: 0 microversion: 2.1 time: 0.303756 May 19 04:51:37.120659 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2319/4725] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 04:51:36 2022] DELETE /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809/os-volume_attachments/2a3d98d7-6ea6-4d55-b468-b384ffe02a40 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:51:37.566895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:37.567685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:37.584746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:37.585277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:37.587936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:37.588498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:37.615242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-744023ff-92cd-492f-8dd8-239794e1346d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:37.616192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-744023ff-92cd-492f-8dd8-239794e1346d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:37.633800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-744023ff-92cd-492f-8dd8-239794e1346d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:37.634274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-744023ff-92cd-492f-8dd8-239794e1346d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:37.635089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-744023ff-92cd-492f-8dd8-239794e1346d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:37.635583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-744023ff-92cd-492f-8dd8-239794e1346d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:38.362963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:38.374387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:38.375833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:38.385773 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d362c780-29bd-40d2-8c40-0fdaa037469f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.823483 May 19 04:51:38.386408 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2407/4726] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:37 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:38.402670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-744023ff-92cd-492f-8dd8-239794e1346d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:38.414732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-744023ff-92cd-492f-8dd8-239794e1346d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1308 microversion: 2.1 time: 0.804466 May 19 04:51:38.416057 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2320/4727] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:37 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1308 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:38.959984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e32fc290-ddba-4e33-a9b2-5f13f3bcc23b req-12dd4307-8c2f-494a-aee6-8469edaa1cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894769ad-4295-4aff-8ba0-30957e6ec8da", "name": "network-vif-plugged", "status": "completed", "tag": "738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:38.974263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e32fc290-ddba-4e33-a9b2-5f13f3bcc23b req-12dd4307-8c2f-494a-aee6-8469edaa1cf3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:38.974718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e32fc290-ddba-4e33-a9b2-5f13f3bcc23b req-12dd4307-8c2f-494a-aee6-8469edaa1cf3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:39.001192 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e32fc290-ddba-4e33-a9b2-5f13f3bcc23b req-12dd4307-8c2f-494a-aee6-8469edaa1cf3 service nova] Creating event network-vif-plugged:738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4 for instance 894769ad-4295-4aff-8ba0-30957e6ec8da on n-h1-766726-30 May 19 04:51:39.014305 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e32fc290-ddba-4e33-a9b2-5f13f3bcc23b req-12dd4307-8c2f-494a-aee6-8469edaa1cf3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058340 May 19 04:51:39.014939 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2408/4728] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:39.404906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:39.406252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:39.421552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:39.427994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:39.429649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:39.430328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:39.433220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7792282a-6694-4108-84ef-8f086a0995b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:39.433952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7792282a-6694-4108-84ef-8f086a0995b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:39.441378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7792282a-6694-4108-84ef-8f086a0995b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:39.441831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7792282a-6694-4108-84ef-8f086a0995b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:39.442633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7792282a-6694-4108-84ef-8f086a0995b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:39.443090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7792282a-6694-4108-84ef-8f086a0995b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:40.056984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7792282a-6694-4108-84ef-8f086a0995b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:40.062085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:40.067168 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7792282a-6694-4108-84ef-8f086a0995b0 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1308 microversion: 2.1 time: 0.638339 May 19 04:51:40.082272 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2409/4729] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:39 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1308 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:40.086193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:40.090048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:40.093629 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2beefe4e-a3f3-42d1-90e9-44e775377fb1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.690661 May 19 04:51:40.094572 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2321/4730] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:39 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:41.091392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3f5e0b2-aab2-4d18-aadd-93a33e7c5341 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:41.093783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3f5e0b2-aab2-4d18-aadd-93a33e7c5341 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:41.093928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-817aec6a-a4ae-4f21-8fb6-1bbfaa1147f5 req-0be3f304-5f5e-4e77-8498-0101647e8c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ad340e-7fc0-43e0-8a45-8227ae528225", "name": "network-vif-plugged", "status": "completed", "tag": "d687cc22-1506-4c71-a468-bcd341ef9fa1"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:41.110559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-817aec6a-a4ae-4f21-8fb6-1bbfaa1147f5 req-0be3f304-5f5e-4e77-8498-0101647e8c44 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:41.111272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-817aec6a-a4ae-4f21-8fb6-1bbfaa1147f5 req-0be3f304-5f5e-4e77-8498-0101647e8c44 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:41.121015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3f5e0b2-aab2-4d18-aadd-93a33e7c5341 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:41.122608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3f5e0b2-aab2-4d18-aadd-93a33e7c5341 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:41.123605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3f5e0b2-aab2-4d18-aadd-93a33e7c5341 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:41.124715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3f5e0b2-aab2-4d18-aadd-93a33e7c5341 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:41.155247 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-817aec6a-a4ae-4f21-8fb6-1bbfaa1147f5 req-0be3f304-5f5e-4e77-8498-0101647e8c44 service nova] Creating event network-vif-plugged:d687cc22-1506-4c71-a468-bcd341ef9fa1 for instance c7ad340e-7fc0-43e0-8a45-8227ae528225 on n-h1-766726-30 May 19 04:51:41.164111 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-817aec6a-a4ae-4f21-8fb6-1bbfaa1147f5 req-0be3f304-5f5e-4e77-8498-0101647e8c44 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085650 May 19 04:51:41.165385 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2410/4731] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:41.197251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:41.198114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:41.211162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:41.211853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:41.216379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:41.217029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:41.847870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3f5e0b2-aab2-4d18-aadd-93a33e7c5341 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:41.857550 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3f5e0b2-aab2-4d18-aadd-93a33e7c5341 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1308 microversion: 2.1 time: 0.769935 May 19 04:51:41.858142 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2322/4732] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:41 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1308 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:41.903559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:41.926169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:41.928764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:41.930177 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-77e0593e-612d-4749-befa-d9c46364b1ce tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.763531 May 19 04:51:41.931249 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2411/4733] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:41 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:42.875292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61f95e98-3067-43c0-8bb4-8caa3f55ef7c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:42.876139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-61f95e98-3067-43c0-8bb4-8caa3f55ef7c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:42.898305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61f95e98-3067-43c0-8bb4-8caa3f55ef7c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:42.899501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61f95e98-3067-43c0-8bb4-8caa3f55ef7c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:42.902420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61f95e98-3067-43c0-8bb4-8caa3f55ef7c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:42.903017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61f95e98-3067-43c0-8bb4-8caa3f55ef7c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:42.948760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:42.950149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:42.959815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:42.967525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:42.968563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:42.973337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:43.431427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-61f95e98-3067-43c0-8bb4-8caa3f55ef7c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:43.439355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:43.446804 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-61f95e98-3067-43c0-8bb4-8caa3f55ef7c tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1489 microversion: 2.1 time: 0.575860 May 19 04:51:43.449021 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2323/4734] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:42 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1489 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:43.451154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:43.453816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:43.456077 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c3feacf-573f-46ad-854f-94fc9adcad12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1808 microversion: 2.20 time: 0.511031 May 19 04:51:43.457766 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2412/4735] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:42 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1808 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:43.476269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ee63dc3-22e3-419b-82a3-e4255bd4a870 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:43.477593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3ee63dc3-22e3-419b-82a3-e4255bd4a870 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:43.496950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ee63dc3-22e3-419b-82a3-e4255bd4a870 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:43.496950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ee63dc3-22e3-419b-82a3-e4255bd4a870 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:43.496950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ee63dc3-22e3-419b-82a3-e4255bd4a870 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:43.496950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ee63dc3-22e3-419b-82a3-e4255bd4a870 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:43.648460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c582688-a65c-4dd1-9c42-cd2bfff89f63 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:43.649321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9c582688-a65c-4dd1-9c42-cd2bfff89f63 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:43.655532 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ee63dc3-22e3-419b-82a3-e4255bd4a870 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "PUT /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1084 microversion: 2.1 time: 0.184682 May 19 04:51:43.656177 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2324/4736] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 04:51:43 2022] PUT /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1084 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:43.661497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c582688-a65c-4dd1-9c42-cd2bfff89f63 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:43.662073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c582688-a65c-4dd1-9c42-cd2bfff89f63 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:43.662955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c582688-a65c-4dd1-9c42-cd2bfff89f63 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:43.663508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c582688-a65c-4dd1-9c42-cd2bfff89f63 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:43.671254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4d3031b-c663-493f-96ac-e5177c305dfe tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:43.672100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f4d3031b-c663-493f-96ac-e5177c305dfe tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:43.680493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d3031b-c663-493f-96ac-e5177c305dfe tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:43.681337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d3031b-c663-493f-96ac-e5177c305dfe tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:43.682292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d3031b-c663-493f-96ac-e5177c305dfe tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:43.682874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d3031b-c663-493f-96ac-e5177c305dfe tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:44.372105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4d3031b-c663-493f-96ac-e5177c305dfe tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:44.382962 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4d3031b-c663-493f-96ac-e5177c305dfe tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1510 microversion: 2.1 time: 0.715930 May 19 04:51:44.396958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c582688-a65c-4dd1-9c42-cd2bfff89f63 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:44.398164 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2325/4737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:43 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1510 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:44.407788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-708ffaa3-1f6f-42ca-bc8f-366246d43a5e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37785d08-5a44-40e4-b7ed-008c593c58d7"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:44.410082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-708ffaa3-1f6f-42ca-bc8f-366246d43a5e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:44.410320 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c582688-a65c-4dd1-9c42-cd2bfff89f63 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.766077 May 19 04:51:44.411234 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2413/4738] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:43 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:44.416058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f4e62035-1b00-487a-9e49-99dbe13c5a0d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:44.416676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f4e62035-1b00-487a-9e49-99dbe13c5a0d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:44.432186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-708ffaa3-1f6f-42ca-bc8f-366246d43a5e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:44.433203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-708ffaa3-1f6f-42ca-bc8f-366246d43a5e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:44.434929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-708ffaa3-1f6f-42ca-bc8f-366246d43a5e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:44.435654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-708ffaa3-1f6f-42ca-bc8f-366246d43a5e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:44.448026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4e62035-1b00-487a-9e49-99dbe13c5a0d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:44.448498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4e62035-1b00-487a-9e49-99dbe13c5a0d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:44.454956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4e62035-1b00-487a-9e49-99dbe13c5a0d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:44.457786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4e62035-1b00-487a-9e49-99dbe13c5a0d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:44.694835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4e62035-1b00-487a-9e49-99dbe13c5a0d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:44.706763 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f4e62035-1b00-487a-9e49-99dbe13c5a0d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1510 microversion: 2.1 time: 0.294306 May 19 04:51:44.707565 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2414/4739] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:44 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:44.724679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0ad01bb0-6753-4926-9c6b-52f87d2f7084 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:44.725968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0ad01bb0-6753-4926-9c6b-52f87d2f7084 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:44.737359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ad01bb0-6753-4926-9c6b-52f87d2f7084 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:44.738598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ad01bb0-6753-4926-9c6b-52f87d2f7084 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:44.739772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ad01bb0-6753-4926-9c6b-52f87d2f7084 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:44.740700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ad01bb0-6753-4926-9c6b-52f87d2f7084 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:44.852590 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-708ffaa3-1f6f-42ca-bc8f-366246d43a5e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "POST /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451738 May 19 04:51:44.853623 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2326/4740] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:51:44 2022] POST /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:44.875972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:44.877383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:44.890043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:44.890801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:44.891817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:44.892499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:45.203598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0ad01bb0-6753-4926-9c6b-52f87d2f7084 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:45.214547 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0ad01bb0-6753-4926-9c6b-52f87d2f7084 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.505203 May 19 04:51:45.227898 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2415/4741] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:44 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:45.235423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d04c776-a190-4595-9868-9d7dfc662312 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:45.236143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d04c776-a190-4595-9868-9d7dfc662312 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:45.245056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:45.245340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d04c776-a190-4595-9868-9d7dfc662312 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:45.246100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d04c776-a190-4595-9868-9d7dfc662312 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:45.247028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d04c776-a190-4595-9868-9d7dfc662312 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:45.247614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d04c776-a190-4595-9868-9d7dfc662312 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:45.273434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:45.275743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:45.279259 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fb67cff7-415d-4a7b-9215-e80d578d06bb tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1795 microversion: 2.20 time: 0.424128 May 19 04:51:45.297452 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2327/4742] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:51:44 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1795 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:51:45.308762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d04c776-a190-4595-9868-9d7dfc662312 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:51:45.310994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40f940b2-84c4-48b0-acac-28bb23d7521b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:45.317253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-40f940b2-84c4-48b0-acac-28bb23d7521b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:45.344168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40f940b2-84c4-48b0-acac-28bb23d7521b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:45.350934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40f940b2-84c4-48b0-acac-28bb23d7521b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:45.352082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40f940b2-84c4-48b0-acac-28bb23d7521b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:45.352736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40f940b2-84c4-48b0-acac-28bb23d7521b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:45.513630 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d04c776-a190-4595-9868-9d7dfc662312 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 204 len: 0 microversion: 2.1 time: 0.283302 May 19 04:51:45.518757 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2416/4743] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:51:45 2022] DELETE /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:51:45.526703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99abd853-0d43-4f0a-b091-ef44ddb36407 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:45.527736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-99abd853-0d43-4f0a-b091-ef44ddb36407 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:45.536766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99abd853-0d43-4f0a-b091-ef44ddb36407 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:45.537870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99abd853-0d43-4f0a-b091-ef44ddb36407 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:45.538878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99abd853-0d43-4f0a-b091-ef44ddb36407 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:45.540041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99abd853-0d43-4f0a-b091-ef44ddb36407 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:45.880650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-40f940b2-84c4-48b0-acac-28bb23d7521b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:45.892251 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-40f940b2-84c4-48b0-acac-28bb23d7521b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.593297 May 19 04:51:45.892849 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2328/4744] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:45 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:45.912276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-695edd1a-7fe2-46db-8528-18cd2ae67276 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:45.912907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-695edd1a-7fe2-46db-8528-18cd2ae67276 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:45.923455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-695edd1a-7fe2-46db-8528-18cd2ae67276 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:45.923915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-695edd1a-7fe2-46db-8528-18cd2ae67276 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:45.924877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-695edd1a-7fe2-46db-8528-18cd2ae67276 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:45.928969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-695edd1a-7fe2-46db-8528-18cd2ae67276 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:46.141258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99abd853-0d43-4f0a-b091-ef44ddb36407 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:46.153200 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99abd853-0d43-4f0a-b091-ef44ddb36407 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1516 microversion: 2.1 time: 0.631825 May 19 04:51:46.154636 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2417/4745] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:45 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1516 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:46.258811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-695edd1a-7fe2-46db-8528-18cd2ae67276 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:46.268172 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-695edd1a-7fe2-46db-8528-18cd2ae67276 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.361074 May 19 04:51:46.287561 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2329/4746] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:45 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:46.512784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1786530508", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "81db7320-40b5-42ac-aa1c-5de5a86ce20d"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:46.614038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] validate_networks() for [('81db7320-40b5-42ac-aa1c-5de5a86ce20d', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:51:47.171497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-98edb9aa-72a4-4505-b609-7f676feb963b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:47.172846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-98edb9aa-72a4-4505-b609-7f676feb963b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:47.184645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98edb9aa-72a4-4505-b609-7f676feb963b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:47.186440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98edb9aa-72a4-4505-b609-7f676feb963b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:47.189595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98edb9aa-72a4-4505-b609-7f676feb963b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:47.190303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98edb9aa-72a4-4505-b609-7f676feb963b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:47.234663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:47.522695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:51:47.523125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:51:47.523647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:51:47.524007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:51:47.524413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:51:47.542754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:47.543198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:47.544034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:47.544480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:47.557160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:47.587864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:51:47.606649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for user 87d19ae04b1d4f0e9e23872d9c2cd0a4 and project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:51:47.629302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:51:47.631626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:51:47.643170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-98edb9aa-72a4-4505-b609-7f676feb963b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:47.655582 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-98edb9aa-72a4-4505-b609-7f676feb963b tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1516 microversion: 2.1 time: 0.486953 May 19 04:51:47.670912 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2330/4747] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:47 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1516 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:47.734818 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4570228d-a8e3-4ad9-8547-6b1279ecbd60 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226078 May 19 04:51:47.745750 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2418/4748] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:51:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:51:47.761921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d434322b-9b2c-4665-8e99-f585d93b3a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:47.762895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d434322b-9b2c-4665-8e99-f585d93b3a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:47.938018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d434322b-9b2c-4665-8e99-f585d93b3a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:47.974995 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d434322b-9b2c-4665-8e99-f585d93b3a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1215 microversion: 2.1 time: 0.227788 May 19 04:51:47.984149 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2331/4749] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:47 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:48.192433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-965b2759-9d9d-4309-91b2-72c293090ff6 req-5fc002bc-05a2-4f5f-ad7f-c0e01e218010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ad340e-7fc0-43e0-8a45-8227ae528225", "name": "network-vif-deleted", "tag": "d687cc22-1506-4c71-a468-bcd341ef9fa1"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:48.218759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-965b2759-9d9d-4309-91b2-72c293090ff6 req-5fc002bc-05a2-4f5f-ad7f-c0e01e218010 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:48.219269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-965b2759-9d9d-4309-91b2-72c293090ff6 req-5fc002bc-05a2-4f5f-ad7f-c0e01e218010 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:48.238815 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-965b2759-9d9d-4309-91b2-72c293090ff6 req-5fc002bc-05a2-4f5f-ad7f-c0e01e218010 service nova] Creating event network-vif-deleted:d687cc22-1506-4c71-a468-bcd341ef9fa1 for instance c7ad340e-7fc0-43e0-8a45-8227ae528225 on n-h1-766726-30 May 19 04:51:48.251886 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-965b2759-9d9d-4309-91b2-72c293090ff6 req-5fc002bc-05a2-4f5f-ad7f-c0e01e218010 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063832 May 19 04:51:48.252784 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2419/4750] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:51:48.678034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:48.679437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:48.693769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:48.700389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:48.702796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:48.704579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:48.787070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:48.791238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:48.793301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lazy-loading 'fault' on Instance uuid c7ad340e-7fc0-43e0-8a45-8227ae528225 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:51:48.901928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:48.910870 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1ca1064-a89c-47bd-90c6-8eaf87e89f68 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 200 len: 1319 microversion: 2.1 time: 0.238622 May 19 04:51:48.911466 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2332/4751] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:48 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:48.995335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b00309f-b236-45a3-9dac-197d850cbd94 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:48.996054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b00309f-b236-45a3-9dac-197d850cbd94 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:49.010627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b00309f-b236-45a3-9dac-197d850cbd94 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:49.017016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b00309f-b236-45a3-9dac-197d850cbd94 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:49.018119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b00309f-b236-45a3-9dac-197d850cbd94 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:49.018780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b00309f-b236-45a3-9dac-197d850cbd94 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:49.210970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b00309f-b236-45a3-9dac-197d850cbd94 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:49.228816 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b00309f-b236-45a3-9dac-197d850cbd94 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1267 microversion: 2.1 time: 0.239362 May 19 04:51:49.229738 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2420/4752] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:48 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:49.928342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:49.928959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:49.941969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:49.943456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:49.945519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:49.945988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:49.982340 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 HTTP/1.1 May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c7ad340e-7fc0-43e0-8a45-8227ae528225'} May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:49.987031 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:49.991002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:49.991002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:49.991002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:51:49.991002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:51:49.991002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:51:49.991002 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:51:49.994872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:51:49.997313 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e8f77c19-5eb1-4e30-83fd-7d879df543c5 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 404 len: 111 microversion: 2.1 time: 0.073416 May 19 04:51:50.009247 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2333/4753] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:49 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:51:50.122758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2085577404", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:50.225335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] validate_networks() for [('3aa4e7a5-c60e-49db-b6c6-a8ef9f22c514', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:51:50.246824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-03c6aef5-d1e7-4900-9c64-04f5810d3926 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:50.247439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-03c6aef5-d1e7-4900-9c64-04f5810d3926 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:50.262908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03c6aef5-d1e7-4900-9c64-04f5810d3926 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:50.263282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03c6aef5-d1e7-4900-9c64-04f5810d3926 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:50.264076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03c6aef5-d1e7-4900-9c64-04f5810d3926 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:50.264522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03c6aef5-d1e7-4900-9c64-04f5810d3926 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:50.439329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-03c6aef5-d1e7-4900-9c64-04f5810d3926 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:50.448655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-03c6aef5-d1e7-4900-9c64-04f5810d3926 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1273 microversion: 2.1 time: 0.205643 May 19 04:51:50.453843 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2334/4754] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:50 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:51.263268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:51:51.263837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:51:51.264163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:51:51.264582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:51:51.264999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:51:51.280337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:51.284156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:51.288156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:51.288817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:51.342022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:51:51.358711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Getting quotas for user a75cb8e84f674ef0814a39d2a4887933 and project 360e70c9ce9d477e860a2ba10d8b993a. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:51:51.395707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:51:51.402218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:51:51.466392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aea3b1ed-ad82-4b6f-921f-c0267a0f7814 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:51.467181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aea3b1ed-ad82-4b6f-921f-c0267a0f7814 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:51.490310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aea3b1ed-ad82-4b6f-921f-c0267a0f7814 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:51.491154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aea3b1ed-ad82-4b6f-921f-c0267a0f7814 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:51.492169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aea3b1ed-ad82-4b6f-921f-c0267a0f7814 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:51.492822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aea3b1ed-ad82-4b6f-921f-c0267a0f7814 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:51.519965 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f13218db-0da3-4ac3-9359-b640b58ba5c8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.401743 May 19 04:51:51.535826 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2421/4755] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:51:51.541108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d690417a-d003-4d0a-a2ba-aa780aa18b2f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:51.566230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d690417a-d003-4d0a-a2ba-aa780aa18b2f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:51.719837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d690417a-d003-4d0a-a2ba-aa780aa18b2f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:51.731897 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d690417a-d003-4d0a-a2ba-aa780aa18b2f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1209 microversion: 2.1 time: 0.193455 May 19 04:51:51.743691 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2422/4756] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:51 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:51.861114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aea3b1ed-ad82-4b6f-921f-c0267a0f7814 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:51.871638 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aea3b1ed-ad82-4b6f-921f-c0267a0f7814 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1315 microversion: 2.1 time: 0.409578 May 19 04:51:51.879360 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2335/4757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:51 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:52.749752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5cd828e-d9dc-4aec-bc08-3b587795571d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:52.750976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5cd828e-d9dc-4aec-bc08-3b587795571d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:52.763575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5cd828e-d9dc-4aec-bc08-3b587795571d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:52.768302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5cd828e-d9dc-4aec-bc08-3b587795571d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:52.770096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5cd828e-d9dc-4aec-bc08-3b587795571d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:52.770705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5cd828e-d9dc-4aec-bc08-3b587795571d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:52.891039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99d01b7a-2ad2-43a1-ae62-3ceb9d93eea5 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:52.891639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99d01b7a-2ad2-43a1-ae62-3ceb9d93eea5 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:52.913825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99d01b7a-2ad2-43a1-ae62-3ceb9d93eea5 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:52.914287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99d01b7a-2ad2-43a1-ae62-3ceb9d93eea5 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:52.926571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99d01b7a-2ad2-43a1-ae62-3ceb9d93eea5 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:52.927052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99d01b7a-2ad2-43a1-ae62-3ceb9d93eea5 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:52.947476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5cd828e-d9dc-4aec-bc08-3b587795571d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:52.962580 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5cd828e-d9dc-4aec-bc08-3b587795571d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1213 microversion: 2.1 time: 0.214242 May 19 04:51:52.963208 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2423/4758] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:52 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1213 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:53.040997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c944e2d-efe8-4c30-be78-9e9f97df17b1 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:53.041777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2c944e2d-efe8-4c30-be78-9e9f97df17b1 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:53.051799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c944e2d-efe8-4c30-be78-9e9f97df17b1 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:53.058186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c944e2d-efe8-4c30-be78-9e9f97df17b1 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:53.059217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c944e2d-efe8-4c30-be78-9e9f97df17b1 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:53.060346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c944e2d-efe8-4c30-be78-9e9f97df17b1 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:53.140052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2c944e2d-efe8-4c30-be78-9e9f97df17b1 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:51:53.343679 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c944e2d-efe8-4c30-be78-9e9f97df17b1 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 204 len: 0 microversion: 2.1 time: 0.306792 May 19 04:51:53.344821 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2424/4759] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:51:53 2022] DELETE /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:51:53.355715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d44e065a-00c8-4689-be78-db9f91c19271 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:53.357137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d44e065a-00c8-4689-be78-db9f91c19271 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:53.368309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d44e065a-00c8-4689-be78-db9f91c19271 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:53.369027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d44e065a-00c8-4689-be78-db9f91c19271 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:53.370263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d44e065a-00c8-4689-be78-db9f91c19271 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:53.370862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d44e065a-00c8-4689-be78-db9f91c19271 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:53.665445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d44e065a-00c8-4689-be78-db9f91c19271 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:53.675884 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d44e065a-00c8-4689-be78-db9f91c19271 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1469 microversion: 2.1 time: 0.324957 May 19 04:51:53.678785 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2425/4760] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:53 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1469 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:53.749913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99d01b7a-2ad2-43a1-ae62-3ceb9d93eea5 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:53.767932 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99d01b7a-2ad2-43a1-ae62-3ceb9d93eea5 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1315 microversion: 2.1 time: 0.882409 May 19 04:51:53.770009 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2336/4761] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:52 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:53.984203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7258d2cb-8f7e-4a76-a766-b6c3d286b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:53.984841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7258d2cb-8f7e-4a76-a766-b6c3d286b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:54.002586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7258d2cb-8f7e-4a76-a766-b6c3d286b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:54.004552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7258d2cb-8f7e-4a76-a766-b6c3d286b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:54.005959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7258d2cb-8f7e-4a76-a766-b6c3d286b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:54.008031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7258d2cb-8f7e-4a76-a766-b6c3d286b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:54.286398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7258d2cb-8f7e-4a76-a766-b6c3d286b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:54.295878 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7258d2cb-8f7e-4a76-a766-b6c3d286b2bd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1267 microversion: 2.1 time: 0.317012 May 19 04:51:54.300864 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2426/4762] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:53 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1267 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:54.399058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-118ea77b-ae99-406a-92f2-c472d3a99cc9 req-b278312e-acc5-4fe3-b76b-86a2260c3d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b7780f-d310-45b9-b8f0-626c0433bb1b", "tag": "36afb44e-1ea7-422f-9da7-e21ed8f55f6e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:54.418036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-118ea77b-ae99-406a-92f2-c472d3a99cc9 req-b278312e-acc5-4fe3-b76b-86a2260c3d2a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:54.418511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-118ea77b-ae99-406a-92f2-c472d3a99cc9 req-b278312e-acc5-4fe3-b76b-86a2260c3d2a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:54.447632 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-118ea77b-ae99-406a-92f2-c472d3a99cc9 req-b278312e-acc5-4fe3-b76b-86a2260c3d2a service nova] Creating event network-changed:36afb44e-1ea7-422f-9da7-e21ed8f55f6e for instance 20b7780f-d310-45b9-b8f0-626c0433bb1b on n-h2-766726-30 May 19 04:51:54.464503 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-118ea77b-ae99-406a-92f2-c472d3a99cc9 req-b278312e-acc5-4fe3-b76b-86a2260c3d2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.403682 May 19 04:51:54.468199 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2337/4763] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:54.695882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-58b90b5b-ce60-4527-b785-57fef833dbbb tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:54.696976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-58b90b5b-ce60-4527-b785-57fef833dbbb tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:54.714809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58b90b5b-ce60-4527-b785-57fef833dbbb tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:54.715352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58b90b5b-ce60-4527-b785-57fef833dbbb tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:54.716384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58b90b5b-ce60-4527-b785-57fef833dbbb tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:54.719069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58b90b5b-ce60-4527-b785-57fef833dbbb tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:54.787768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74242bf9-7396-4432-9013-1a73fa666646 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:54.788547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74242bf9-7396-4432-9013-1a73fa666646 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:54.799141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74242bf9-7396-4432-9013-1a73fa666646 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:54.799586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74242bf9-7396-4432-9013-1a73fa666646 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:54.810211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74242bf9-7396-4432-9013-1a73fa666646 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:54.810978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74242bf9-7396-4432-9013-1a73fa666646 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:55.383790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-58b90b5b-ce60-4527-b785-57fef833dbbb tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:55.404434 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-58b90b5b-ce60-4527-b785-57fef833dbbb tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1469 microversion: 2.1 time: 0.713205 May 19 04:51:55.406935 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2427/4764] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:54 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1469 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:55.423048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-200d2e1f-b4d8-48cc-872d-e3bf7a263f49 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:55.428943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74242bf9-7396-4432-9013-1a73fa666646 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:55.440510 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74242bf9-7396-4432-9013-1a73fa666646 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1315 microversion: 2.1 time: 0.657867 May 19 04:51:55.441824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-200d2e1f-b4d8-48cc-872d-e3bf7a263f49 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:55.450678 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2338/4765] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:54 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:55.460491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-200d2e1f-b4d8-48cc-872d-e3bf7a263f49 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:55.464349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-200d2e1f-b4d8-48cc-872d-e3bf7a263f49 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:55.465576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-200d2e1f-b4d8-48cc-872d-e3bf7a263f49 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:55.468537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-200d2e1f-b4d8-48cc-872d-e3bf7a263f49 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:55.655361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-200d2e1f-b4d8-48cc-872d-e3bf7a263f49 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:55.691515 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-200d2e1f-b4d8-48cc-872d-e3bf7a263f49 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1267 microversion: 2.1 time: 0.276720 May 19 04:51:55.705466 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2428/4766] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:55 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1267 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:56.423242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-636843f3-5082-459b-8e43-c5ca933d30c4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:56.424406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-636843f3-5082-459b-8e43-c5ca933d30c4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:56.433538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-636843f3-5082-459b-8e43-c5ca933d30c4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:56.434417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-636843f3-5082-459b-8e43-c5ca933d30c4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:56.435181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-636843f3-5082-459b-8e43-c5ca933d30c4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:56.435653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-636843f3-5082-459b-8e43-c5ca933d30c4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:56.467178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b00b54ae-37ad-4d05-a9d8-6d0933e93711 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:56.467805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b00b54ae-37ad-4d05-a9d8-6d0933e93711 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:56.476044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b00b54ae-37ad-4d05-a9d8-6d0933e93711 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:56.476724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b00b54ae-37ad-4d05-a9d8-6d0933e93711 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:56.477653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b00b54ae-37ad-4d05-a9d8-6d0933e93711 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:56.478099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b00b54ae-37ad-4d05-a9d8-6d0933e93711 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:57.101172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-636843f3-5082-459b-8e43-c5ca933d30c4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231a3d54326d4685a75c9c1cac8f0545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986f51da57b49a2b3cee0f0edc70c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:57.110232 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-636843f3-5082-459b-8e43-c5ca933d30c4 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 200 len: 1469 microversion: 2.1 time: 0.690641 May 19 04:51:57.115540 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2339/4767] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:56 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 1469 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:57.125694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0aeb9cfa-623b-4124-a42a-ed4cbaa5816d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:57.126319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0aeb9cfa-623b-4124-a42a-ed4cbaa5816d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:57.161450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aeb9cfa-623b-4124-a42a-ed4cbaa5816d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:57.162403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aeb9cfa-623b-4124-a42a-ed4cbaa5816d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:57.163221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aeb9cfa-623b-4124-a42a-ed4cbaa5816d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:57.163664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0aeb9cfa-623b-4124-a42a-ed4cbaa5816d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:57.302299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b00b54ae-37ad-4d05-a9d8-6d0933e93711 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:57.342574 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b00b54ae-37ad-4d05-a9d8-6d0933e93711 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1315 microversion: 2.1 time: 0.878221 May 19 04:51:57.350491 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2429/4768] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:56 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:51:57.467522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-16027d54-e2f9-4ed1-a48c-1e7daa0ee666 req-d3d62284-6709-44b2-aab3-ae2d5e2b8a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5092d7a-519d-4692-bd60-04ff4991b809", "name": "network-vif-deleted", "tag": "b5835901-ed16-4bb9-9171-42d2e4b22814"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:51:57.487970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-16027d54-e2f9-4ed1-a48c-1e7daa0ee666 req-d3d62284-6709-44b2-aab3-ae2d5e2b8a62 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:57.488910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-16027d54-e2f9-4ed1-a48c-1e7daa0ee666 req-d3d62284-6709-44b2-aab3-ae2d5e2b8a62 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:57.545777 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-16027d54-e2f9-4ed1-a48c-1e7daa0ee666 req-d3d62284-6709-44b2-aab3-ae2d5e2b8a62 service nova] Creating event network-vif-deleted:b5835901-ed16-4bb9-9171-42d2e4b22814 for instance a5092d7a-519d-4692-bd60-04ff4991b809 on n-h2-766726-30 May 19 04:51:57.561118 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-16027d54-e2f9-4ed1-a48c-1e7daa0ee666 req-d3d62284-6709-44b2-aab3-ae2d5e2b8a62 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096884 May 19 04:51:57.562953 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2430/4769] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:51:57.678637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0aeb9cfa-623b-4124-a42a-ed4cbaa5816d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:57.688072 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0aeb9cfa-623b-4124-a42a-ed4cbaa5816d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1309 microversion: 2.1 time: 0.571383 May 19 04:51:57.688705 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2340/4770] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:57 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1309 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:58.133842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:58.135029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] [instance: a5092d7a-519d-4692-bd60-04ff4991b809] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:58.150522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:58.157936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:58.160235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:58.161129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:58.195708 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] HTTP exception thrown: Instance a5092d7a-519d-4692-bd60-04ff4991b809 could not be found. May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Request method failure captured: May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 HTTP/1.1 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwD1zghEWsk5WJTf7Tjg6QZp2FY6a9dgpCjtQQ9Fqh95qerlrULtj78HmG1PPhWwQIxkTemB-3VTHt67tB4VH3k7UJHvVe1GIexsyMf--36cgN-AUPF6m5U_aS37xVyYHEmRi_6obGU6zO1y6hvRFRdRoT7VQCO-SlLhVEwb-mtzZc May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 8986f51da57b49a2b3cee0f0edc70c01 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesBackupsTest-938923041 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8986f51da57b49a2b3cee0f0edc70c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8986f51da57b49a2b3cee0f0edc70c01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8986f51da57b49a2b3cee0f0edc70c01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8986f51da57b49a2b3cee0f0edc70c01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesBackupsTest-938923041 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 8986f51da57b49a2b3cee0f0edc70c01 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesBackupsTest-938923041 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesBackupsTest-938923041-project May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 231a3d54326d4685a75c9c1cac8f0545 May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesBackupsTest-938923041-project May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance a5092d7a-519d-4692-bd60-04ff4991b809 could not be found. May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'a5092d7a-519d-4692-bd60-04ff4991b809'} May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5092d7a-519d-4692-bd60-04ff4991b809 could not be found. May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5092d7a-519d-4692-bd60-04ff4991b809 could not be found. May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:51:58.197660 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:58.200910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:51:58.200910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:51:58.200910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:51:58.200910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:51:58.200910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:51:58.200910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5092d7a-519d-4692-bd60-04ff4991b809 could not be found. May 19 04:51:58.200910 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:51:58.202665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] Returning 404 to user: Instance a5092d7a-519d-4692-bd60-04ff4991b809 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:51:58.203717 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-04344ace-475a-41aa-ad5c-bb71e7f89d33 tempest-VolumesBackupsTest-938923041 tempest-VolumesBackupsTest-938923041-project] 10.222.0.58 "GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809" status: 404 len: 111 microversion: 2.1 time: 0.078348 May 19 04:51:58.205319 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2431/4771] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:58 2022] GET /compute/v2.1/servers/a5092d7a-519d-4692-bd60-04ff4991b809 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:51:58.359950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b07ae504-bad7-4762-9c4c-acaba9dd4efa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:58.360835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b07ae504-bad7-4762-9c4c-acaba9dd4efa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:58.363690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:51:58.376741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b07ae504-bad7-4762-9c4c-acaba9dd4efa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:58.377505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b07ae504-bad7-4762-9c4c-acaba9dd4efa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:58.380922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b07ae504-bad7-4762-9c4c-acaba9dd4efa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:58.383922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b07ae504-bad7-4762-9c4c-acaba9dd4efa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:58.707004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-76b03535-4626-49e0-8b66-3eff95bffc23 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:51:58.708369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-76b03535-4626-49e0-8b66-3eff95bffc23 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:51:58.716519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76b03535-4626-49e0-8b66-3eff95bffc23 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:58.722246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76b03535-4626-49e0-8b66-3eff95bffc23 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:58.728208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76b03535-4626-49e0-8b66-3eff95bffc23 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:51:58.728667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76b03535-4626-49e0-8b66-3eff95bffc23 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:51:59.097693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b07ae504-bad7-4762-9c4c-acaba9dd4efa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:59.116545 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b07ae504-bad7-4762-9c4c-acaba9dd4efa tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1315 microversion: 2.1 time: 0.754220 May 19 04:51:59.117563 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2341/4772] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:58 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:51:59.196821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-76b03535-4626-49e0-8b66-3eff95bffc23 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:51:59.217379 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-76b03535-4626-49e0-8b66-3eff95bffc23 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1309 microversion: 2.1 time: 0.514931 May 19 04:51:59.227489 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2432/4773] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:51:58 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:00.135623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ca922d0-3290-4d96-aad3-daf9f1233490 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:00.136894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2ca922d0-3290-4d96-aad3-daf9f1233490 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:00.148505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ca922d0-3290-4d96-aad3-daf9f1233490 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:00.149228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ca922d0-3290-4d96-aad3-daf9f1233490 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:00.150264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ca922d0-3290-4d96-aad3-daf9f1233490 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:00.151009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-13097c2b-80a1-41d8-ad16-8bde0a3fbfe6 req-9c9d4fd0-b4c5-471c-aa7e-f20b1c5c58f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c23cbb-b744-4110-bd02-c6d2be32230d", "tag": "f8ed2080-9b38-45c6-9d8a-687fbf9d9514"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:00.151735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ca922d0-3290-4d96-aad3-daf9f1233490 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:00.179748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-13097c2b-80a1-41d8-ad16-8bde0a3fbfe6 req-9c9d4fd0-b4c5-471c-aa7e-f20b1c5c58f0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:00.180395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-13097c2b-80a1-41d8-ad16-8bde0a3fbfe6 req-9c9d4fd0-b4c5-471c-aa7e-f20b1c5c58f0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:00.221413 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-13097c2b-80a1-41d8-ad16-8bde0a3fbfe6 req-9c9d4fd0-b4c5-471c-aa7e-f20b1c5c58f0 service nova] Creating event network-changed:f8ed2080-9b38-45c6-9d8a-687fbf9d9514 for instance 12c23cbb-b744-4110-bd02-c6d2be32230d on n-h1-766726-30 May 19 04:52:00.241015 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-13097c2b-80a1-41d8-ad16-8bde0a3fbfe6 req-9c9d4fd0-b4c5-471c-aa7e-f20b1c5c58f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093411 May 19 04:52:00.241966 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2433/4774] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:52:00.250813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-11581bbe-acca-48e9-bac3-8508b897c519 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:00.251992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-11581bbe-acca-48e9-bac3-8508b897c519 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:00.262582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11581bbe-acca-48e9-bac3-8508b897c519 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:00.263064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11581bbe-acca-48e9-bac3-8508b897c519 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:00.265412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11581bbe-acca-48e9-bac3-8508b897c519 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:00.266017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-11581bbe-acca-48e9-bac3-8508b897c519 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:00.665634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ca922d0-3290-4d96-aad3-daf9f1233490 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:00.680617 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ca922d0-3290-4d96-aad3-daf9f1233490 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1315 microversion: 2.1 time: 0.548096 May 19 04:52:00.682001 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2342/4775] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:00 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:00.808620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-11581bbe-acca-48e9-bac3-8508b897c519 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:00.823017 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-11581bbe-acca-48e9-bac3-8508b897c519 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1309 microversion: 2.1 time: 0.579720 May 19 04:52:00.824560 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2434/4776] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:00 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1309 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:01.199246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9b18ba3d-1f71-4d0a-a686-fd5af495a5f0 req-cb67934e-bbdc-485a-b69a-cbdfa0c8f32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b7780f-d310-45b9-b8f0-626c0433bb1b", "name": "network-vif-plugged", "status": "completed", "tag": "36afb44e-1ea7-422f-9da7-e21ed8f55f6e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:01.210606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=60 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:01.226634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9b18ba3d-1f71-4d0a-a686-fd5af495a5f0 req-cb67934e-bbdc-485a-b69a-cbdfa0c8f32b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:01.227393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9b18ba3d-1f71-4d0a-a686-fd5af495a5f0 req-cb67934e-bbdc-485a-b69a-cbdfa0c8f32b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:01.262025 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9b18ba3d-1f71-4d0a-a686-fd5af495a5f0 req-cb67934e-bbdc-485a-b69a-cbdfa0c8f32b service nova] Creating event network-vif-plugged:36afb44e-1ea7-422f-9da7-e21ed8f55f6e for instance 20b7780f-d310-45b9-b8f0-626c0433bb1b on n-h2-766726-30 May 19 04:52:01.277278 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9b18ba3d-1f71-4d0a-a686-fd5af495a5f0 req-cb67934e-bbdc-485a-b69a-cbdfa0c8f32b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080360 May 19 04:52:01.280716 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2343/4777] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:52:01.699211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c9bc2bad-a5b8-47ba-a217-901b4c0b8034 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:01.699802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c9bc2bad-a5b8-47ba-a217-901b4c0b8034 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:01.703360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:01.713788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:01.721160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9bc2bad-a5b8-47ba-a217-901b4c0b8034 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:01.722409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9bc2bad-a5b8-47ba-a217-901b4c0b8034 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:01.723367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9bc2bad-a5b8-47ba-a217-901b4c0b8034 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:01.723962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9bc2bad-a5b8-47ba-a217-901b4c0b8034 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:01.733741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=14 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:01.851208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17732827-5b4a-49fd-9047-9111a60fbbee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:01.853382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17732827-5b4a-49fd-9047-9111a60fbbee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:01.870916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17732827-5b4a-49fd-9047-9111a60fbbee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:01.871311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17732827-5b4a-49fd-9047-9111a60fbbee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:01.872111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17732827-5b4a-49fd-9047-9111a60fbbee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:01.872554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17732827-5b4a-49fd-9047-9111a60fbbee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:02.306824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c9bc2bad-a5b8-47ba-a217-901b4c0b8034 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:02.314412 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c9bc2bad-a5b8-47ba-a217-901b4c0b8034 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1315 microversion: 2.1 time: 0.619424 May 19 04:52:02.327653 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2435/4778] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:01 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:02.342309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-17732827-5b4a-49fd-9047-9111a60fbbee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:02.352977 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17732827-5b4a-49fd-9047-9111a60fbbee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1309 microversion: 2.1 time: 0.514206 May 19 04:52:02.353749 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2344/4779] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:01 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1309 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:03.335960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-359e6209-9714-44d8-97ef-b7c2c210029c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:03.337185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-359e6209-9714-44d8-97ef-b7c2c210029c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:03.356081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-359e6209-9714-44d8-97ef-b7c2c210029c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:03.361778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-359e6209-9714-44d8-97ef-b7c2c210029c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:03.362667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-359e6209-9714-44d8-97ef-b7c2c210029c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:03.363125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-359e6209-9714-44d8-97ef-b7c2c210029c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:03.370218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-efeda8b0-0183-4b7d-b7cc-3649a1821843 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:03.371511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-efeda8b0-0183-4b7d-b7cc-3649a1821843 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:03.386080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efeda8b0-0183-4b7d-b7cc-3649a1821843 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:03.386537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efeda8b0-0183-4b7d-b7cc-3649a1821843 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:03.397717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efeda8b0-0183-4b7d-b7cc-3649a1821843 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:03.398178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efeda8b0-0183-4b7d-b7cc-3649a1821843 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:04.395931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-359e6209-9714-44d8-97ef-b7c2c210029c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:04.401684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-efeda8b0-0183-4b7d-b7cc-3649a1821843 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:04.424300 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-efeda8b0-0183-4b7d-b7cc-3649a1821843 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1309 microversion: 2.1 time: 1.057839 May 19 04:52:04.426732 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-359e6209-9714-44d8-97ef-b7c2c210029c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1502 microversion: 2.1 time: 1.091208 May 19 04:52:04.427168 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2345/4780] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:03 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1309 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:04.435517 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2436/4781] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:03 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1502 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:04.443477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31fd87a9-93ce-4d46-9ae9-c8ce99b8ec1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:04.444443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31fd87a9-93ce-4d46-9ae9-c8ce99b8ec1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:04.452734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31fd87a9-93ce-4d46-9ae9-c8ce99b8ec1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:04.456230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31fd87a9-93ce-4d46-9ae9-c8ce99b8ec1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:04.464343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31fd87a9-93ce-4d46-9ae9-c8ce99b8ec1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:04.465054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31fd87a9-93ce-4d46-9ae9-c8ce99b8ec1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:04.862123 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.network.security_group_api [None req-31fd87a9-93ce-4d46-9ae9-c8ce99b8ec1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Removing security group 616d1c9f-1211-445a-982c-e87be10fad39 from port 36afb44e-1ea7-422f-9da7-e21ed8f55f6e May 19 04:52:05.779315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ca07a5d9-44cb-4f3f-983d-86e378e4db01 req-51fd0793-6c32-4134-98d0-0fc223217230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c23cbb-b744-4110-bd02-c6d2be32230d", "name": "network-vif-plugged", "status": "completed", "tag": "f8ed2080-9b38-45c6-9d8a-687fbf9d9514"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:05.786065 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31fd87a9-93ce-4d46-9ae9-c8ce99b8ec1d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b/action" status: 202 len: 0 microversion: 2.1 time: 1.346396 May 19 04:52:05.788034 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2346/4782] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:52:04 2022] POST /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b/action => generated 0 bytes in 1349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:52:05.804322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2e3d62f-3c92-46de-9361-3f841050cc72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:05.809646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ca07a5d9-44cb-4f3f-983d-86e378e4db01 req-51fd0793-6c32-4134-98d0-0fc223217230 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:05.810162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ca07a5d9-44cb-4f3f-983d-86e378e4db01 req-51fd0793-6c32-4134-98d0-0fc223217230 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:05.810563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e2e3d62f-3c92-46de-9361-3f841050cc72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:05.824690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2e3d62f-3c92-46de-9361-3f841050cc72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:05.825547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2e3d62f-3c92-46de-9361-3f841050cc72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:05.826907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2e3d62f-3c92-46de-9361-3f841050cc72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:05.827765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2e3d62f-3c92-46de-9361-3f841050cc72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:05.863829 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ca07a5d9-44cb-4f3f-983d-86e378e4db01 req-51fd0793-6c32-4134-98d0-0fc223217230 service nova] Creating event network-vif-plugged:f8ed2080-9b38-45c6-9d8a-687fbf9d9514 for instance 12c23cbb-b744-4110-bd02-c6d2be32230d on n-h1-766726-30 May 19 04:52:05.882659 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ca07a5d9-44cb-4f3f-983d-86e378e4db01 req-51fd0793-6c32-4134-98d0-0fc223217230 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.658034 May 19 04:52:05.884420 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2437/4783] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:52:05.893587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef8ca6c9-9b52-469e-8894-63414313158c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:05.894499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef8ca6c9-9b52-469e-8894-63414313158c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:05.901725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef8ca6c9-9b52-469e-8894-63414313158c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:05.902389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef8ca6c9-9b52-469e-8894-63414313158c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:05.903317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef8ca6c9-9b52-469e-8894-63414313158c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:05.903919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef8ca6c9-9b52-469e-8894-63414313158c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:06.211701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ef8ca6c9-9b52-469e-8894-63414313158c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:06.219879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:06.223380 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef8ca6c9-9b52-469e-8894-63414313158c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1460 microversion: 2.1 time: 0.337210 May 19 04:52:06.223971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2438/4784] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:05 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1460 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:06.266719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5529eea1-1abb-4bb0-bb76-ce6a5e8aa27d req-f2c156bd-dbf1-4648-b0d8-62e845f4fd7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b7780f-d310-45b9-b8f0-626c0433bb1b", "tag": "36afb44e-1ea7-422f-9da7-e21ed8f55f6e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:06.283373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5529eea1-1abb-4bb0-bb76-ce6a5e8aa27d req-f2c156bd-dbf1-4648-b0d8-62e845f4fd7c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:06.289719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5529eea1-1abb-4bb0-bb76-ce6a5e8aa27d req-f2c156bd-dbf1-4648-b0d8-62e845f4fd7c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:06.322731 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5529eea1-1abb-4bb0-bb76-ce6a5e8aa27d req-f2c156bd-dbf1-4648-b0d8-62e845f4fd7c service nova] Creating event network-changed:36afb44e-1ea7-422f-9da7-e21ed8f55f6e for instance 20b7780f-d310-45b9-b8f0-626c0433bb1b on n-h2-766726-30 May 19 04:52:06.335385 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5529eea1-1abb-4bb0-bb76-ce6a5e8aa27d req-f2c156bd-dbf1-4648-b0d8-62e845f4fd7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089057 May 19 04:52:06.336814 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2439/4785] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:52:06.359433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6a1f07e6-b2fd-4477-91e0-52dc09689525 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:06.362511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6a1f07e6-b2fd-4477-91e0-52dc09689525 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:06.386676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a1f07e6-b2fd-4477-91e0-52dc09689525 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:06.387636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a1f07e6-b2fd-4477-91e0-52dc09689525 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:06.396420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a1f07e6-b2fd-4477-91e0-52dc09689525 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:06.397406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a1f07e6-b2fd-4477-91e0-52dc09689525 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:06.984680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e2e3d62f-3c92-46de-9361-3f841050cc72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:06.993695 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2e3d62f-3c92-46de-9361-3f841050cc72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1309 microversion: 2.1 time: 1.204212 May 19 04:52:06.999099 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2347/4786] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:05 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1309 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:07.099518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6a1f07e6-b2fd-4477-91e0-52dc09689525 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:07.113806 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6a1f07e6-b2fd-4477-91e0-52dc09689525 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.767943 May 19 04:52:07.122216 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2440/4787] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:06 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:07.140286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a8596fe1-19d6-4569-90d5-2fde50ecb978 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:07.141149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a8596fe1-19d6-4569-90d5-2fde50ecb978 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:07.154540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8596fe1-19d6-4569-90d5-2fde50ecb978 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:07.154880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8596fe1-19d6-4569-90d5-2fde50ecb978 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:07.155868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8596fe1-19d6-4569-90d5-2fde50ecb978 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:07.156330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8596fe1-19d6-4569-90d5-2fde50ecb978 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:07.726154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a8596fe1-19d6-4569-90d5-2fde50ecb978 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:07.745334 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a8596fe1-19d6-4569-90d5-2fde50ecb978 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.609387 May 19 04:52:07.758218 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2348/4788] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:07 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:07.761928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5aadd38-f4a0-4976-8edd-b2659c56f2e0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:07.762558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5aadd38-f4a0-4976-8edd-b2659c56f2e0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:07.776599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5aadd38-f4a0-4976-8edd-b2659c56f2e0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:07.777057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5aadd38-f4a0-4976-8edd-b2659c56f2e0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:07.777869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5aadd38-f4a0-4976-8edd-b2659c56f2e0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:07.778313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5aadd38-f4a0-4976-8edd-b2659c56f2e0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:08.016037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-83cbd465-2a15-495b-a890-9925467cf09d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:08.017206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-83cbd465-2a15-495b-a890-9925467cf09d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:08.028860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83cbd465-2a15-495b-a890-9925467cf09d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:08.029590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83cbd465-2a15-495b-a890-9925467cf09d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:08.032477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83cbd465-2a15-495b-a890-9925467cf09d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:08.033143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83cbd465-2a15-495b-a890-9925467cf09d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:08.336157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5aadd38-f4a0-4976-8edd-b2659c56f2e0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:08.365042 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5aadd38-f4a0-4976-8edd-b2659c56f2e0 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.603490 May 19 04:52:08.371230 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2441/4789] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:07 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:08.385686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51be4b12-c6e0-474e-b3bb-082bfdd6fee9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:08.386496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-51be4b12-c6e0-474e-b3bb-082bfdd6fee9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:08.393680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51be4b12-c6e0-474e-b3bb-082bfdd6fee9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:08.394411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51be4b12-c6e0-474e-b3bb-082bfdd6fee9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:08.395341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51be4b12-c6e0-474e-b3bb-082bfdd6fee9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:08.395928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51be4b12-c6e0-474e-b3bb-082bfdd6fee9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:09.073033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-51be4b12-c6e0-474e-b3bb-082bfdd6fee9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:09.087467 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51be4b12-c6e0-474e-b3bb-082bfdd6fee9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.706582 May 19 04:52:09.088683 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2442/4790] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:08 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:09.109200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-83cbd465-2a15-495b-a890-9925467cf09d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:09.124810 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-83cbd465-2a15-495b-a890-9925467cf09d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1490 microversion: 2.1 time: 1.112463 May 19 04:52:09.137455 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2349/4791] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:08 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1490 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:09.147760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0489b4ca-4f1b-42be-bfba-f70e992643a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-666474111"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:09.149021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0489b4ca-4f1b-42be-bfba-f70e992643a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:09.158475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0489b4ca-4f1b-42be-bfba-f70e992643a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:09.160349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0489b4ca-4f1b-42be-bfba-f70e992643a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:09.161350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0489b4ca-4f1b-42be-bfba-f70e992643a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:09.161951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0489b4ca-4f1b-42be-bfba-f70e992643a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:09.252827 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0489b4ca-4f1b-42be-bfba-f70e992643a6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "PUT /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1074 microversion: 2.1 time: 0.108801 May 19 04:52:09.254342 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2443/4792] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 04:52:09 2022] PUT /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1074 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:09.269216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c3cc7dc-a878-4732-95b3-a6d484600635 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:09.270132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c3cc7dc-a878-4732-95b3-a6d484600635 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:09.280528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c3cc7dc-a878-4732-95b3-a6d484600635 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:09.282366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c3cc7dc-a878-4732-95b3-a6d484600635 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:09.285957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c3cc7dc-a878-4732-95b3-a6d484600635 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:09.287849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c3cc7dc-a878-4732-95b3-a6d484600635 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:09.303556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:09.365882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1801046859", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "81db7320-40b5-42ac-aa1c-5de5a86ce20d"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:09.480144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] validate_networks() for [('81db7320-40b5-42ac-aa1c-5de5a86ce20d', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:52:09.966409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c3cc7dc-a878-4732-95b3-a6d484600635 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:09.990467 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c3cc7dc-a878-4732-95b3-a6d484600635 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1500 microversion: 2.1 time: 0.720649 May 19 04:52:09.993383 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2350/4793] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:09 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1500 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:10.010846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a38e10a8-2087-40e2-8a67-e1c08911bd73 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:10.015091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a38e10a8-2087-40e2-8a67-e1c08911bd73 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:10.035385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a38e10a8-2087-40e2-8a67-e1c08911bd73 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:10.036050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a38e10a8-2087-40e2-8a67-e1c08911bd73 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:10.037177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a38e10a8-2087-40e2-8a67-e1c08911bd73 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:10.037626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a38e10a8-2087-40e2-8a67-e1c08911bd73 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:10.525495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a38e10a8-2087-40e2-8a67-e1c08911bd73 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:10.545793 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a38e10a8-2087-40e2-8a67-e1c08911bd73 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1500 microversion: 2.1 time: 0.532251 May 19 04:52:10.546417 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2351/4794] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:10 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1500 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:10.563220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ccbe87d5-c249-4939-a8aa-6bbb5607f042 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:10.579045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccbe87d5-c249-4939-a8aa-6bbb5607f042 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:10.579506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccbe87d5-c249-4939-a8aa-6bbb5607f042 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:10.647901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ccbe87d5-c249-4939-a8aa-6bbb5607f042 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Going to try to stop instance {{(pid=124819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 04:52:10.717542 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ccbe87d5-c249-4939-a8aa-6bbb5607f042 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "POST /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d/action" status: 202 len: 0 microversion: 2.1 time: 0.158973 May 19 04:52:10.718840 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2352/4795] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:52:10 2022] POST /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:52:10.729330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6dfc6d06-74dd-4348-8828-36aae9924303 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:10.730572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6dfc6d06-74dd-4348-8828-36aae9924303 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:10.739257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d06-74dd-4348-8828-36aae9924303 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:10.740505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d06-74dd-4348-8828-36aae9924303 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:10.741763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d06-74dd-4348-8828-36aae9924303 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:10.743318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d06-74dd-4348-8828-36aae9924303 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:11.169296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:52:11.169861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:52:11.170573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:52:11.170993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:52:11.171452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:52:11.195714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:11.196511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:11.197360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:11.197810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:11.240508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:52:11.258616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Getting quotas for user 87d19ae04b1d4f0e9e23872d9c2cd0a4 and project 346e3945e25c4638bef347149d914e61. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:52:11.281840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:52:11.284887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:52:11.386773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6dfc6d06-74dd-4348-8828-36aae9924303 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:11.387004 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ee43ea30-eca9-4d79-be0f-289e48e51f4d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.026030 May 19 04:52:11.387837 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2444/4796] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:52:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:52:11.398423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a6d7c6a-d986-44ef-8074-fab4bf690839 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:11.399342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a6d7c6a-d986-44ef-8074-fab4bf690839 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:11.403187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6dfc6d06-74dd-4348-8828-36aae9924303 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.679191 May 19 04:52:11.403907 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2353/4797] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:10 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:11.518999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a6d7c6a-d986-44ef-8074-fab4bf690839 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:11.529827 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a6d7c6a-d986-44ef-8074-fab4bf690839 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1215 microversion: 2.1 time: 0.135698 May 19 04:52:11.535428 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2445/4798] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:11 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:12.434090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-93ebd684-8b6b-4ba1-9596-55e6fa318d96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:12.435495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-93ebd684-8b6b-4ba1-9596-55e6fa318d96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:12.470265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93ebd684-8b6b-4ba1-9596-55e6fa318d96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:12.472396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93ebd684-8b6b-4ba1-9596-55e6fa318d96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:12.475042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93ebd684-8b6b-4ba1-9596-55e6fa318d96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:12.486546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-93ebd684-8b6b-4ba1-9596-55e6fa318d96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:12.549757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f0209d9-9310-41a4-98be-fb42f6ff31ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:12.550391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5f0209d9-9310-41a4-98be-fb42f6ff31ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:12.579956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f0209d9-9310-41a4-98be-fb42f6ff31ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:12.582264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f0209d9-9310-41a4-98be-fb42f6ff31ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:12.585991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f0209d9-9310-41a4-98be-fb42f6ff31ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:12.586459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f0209d9-9310-41a4-98be-fb42f6ff31ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:12.851215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-93ebd684-8b6b-4ba1-9596-55e6fa318d96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:12.860705 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-93ebd684-8b6b-4ba1-9596-55e6fa318d96 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.441731 May 19 04:52:12.873280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5f0209d9-9310-41a4-98be-fb42f6ff31ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:12.873789 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2354/4799] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:12 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:12.884894 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5f0209d9-9310-41a4-98be-fb42f6ff31ef tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1211 microversion: 2.1 time: 0.339818 May 19 04:52:12.901243 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2446/4800] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:12 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1211 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:13.879956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-074371c9-1b61-4ca9-870e-333aae33c25f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:13.881868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-074371c9-1b61-4ca9-870e-333aae33c25f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:13.905465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0508d80d-96ac-4617-beea-58a73ad8c417 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:13.906194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0508d80d-96ac-4617-beea-58a73ad8c417 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:13.923388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0508d80d-96ac-4617-beea-58a73ad8c417 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:13.923878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-074371c9-1b61-4ca9-870e-333aae33c25f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:13.924365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-074371c9-1b61-4ca9-870e-333aae33c25f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:13.925188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-074371c9-1b61-4ca9-870e-333aae33c25f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:13.925627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-074371c9-1b61-4ca9-870e-333aae33c25f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:13.926263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0508d80d-96ac-4617-beea-58a73ad8c417 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:13.927964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0508d80d-96ac-4617-beea-58a73ad8c417 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:13.929687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0508d80d-96ac-4617-beea-58a73ad8c417 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:14.132492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0508d80d-96ac-4617-beea-58a73ad8c417 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:14.140700 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0508d80d-96ac-4617-beea-58a73ad8c417 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1273 microversion: 2.1 time: 0.239429 May 19 04:52:14.143827 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2447/4801] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:13 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:14.274469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-074371c9-1b61-4ca9-870e-333aae33c25f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:14.290150 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-074371c9-1b61-4ca9-870e-333aae33c25f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.414402 May 19 04:52:14.291100 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2355/4802] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:13 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:15.160465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-91e9af0b-9a80-40d7-bb9f-1429d3812e42 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:15.162140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-91e9af0b-9a80-40d7-bb9f-1429d3812e42 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:15.184739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91e9af0b-9a80-40d7-bb9f-1429d3812e42 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:15.192197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91e9af0b-9a80-40d7-bb9f-1429d3812e42 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:15.194513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91e9af0b-9a80-40d7-bb9f-1429d3812e42 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:15.196272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-91e9af0b-9a80-40d7-bb9f-1429d3812e42 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:15.307881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d68b5e64-c2c0-4366-add5-35639e66a293 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:15.309213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d68b5e64-c2c0-4366-add5-35639e66a293 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:15.348840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d68b5e64-c2c0-4366-add5-35639e66a293 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:15.351145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d68b5e64-c2c0-4366-add5-35639e66a293 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:15.352207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d68b5e64-c2c0-4366-add5-35639e66a293 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:15.356241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d68b5e64-c2c0-4366-add5-35639e66a293 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:15.720285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-91e9af0b-9a80-40d7-bb9f-1429d3812e42 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:15.728809 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-91e9af0b-9a80-40d7-bb9f-1429d3812e42 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1315 microversion: 2.1 time: 0.572902 May 19 04:52:15.734400 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2448/4803] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:15 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:15.959538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d68b5e64-c2c0-4366-add5-35639e66a293 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:15.972319 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d68b5e64-c2c0-4366-add5-35639e66a293 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.664534 May 19 04:52:15.973660 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2356/4804] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:15 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:16.364267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-059e0954-99ae-44f6-95a7-685874306671 req-412581d6-e517-4b35-b455-d4621629d667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78aba7da-ae55-4e89-aa6c-e226c570f780", "tag": "5632caf9-3896-4359-aa1f-68f1db858be0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:16.382134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-059e0954-99ae-44f6-95a7-685874306671 req-412581d6-e517-4b35-b455-d4621629d667 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:16.382589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-059e0954-99ae-44f6-95a7-685874306671 req-412581d6-e517-4b35-b455-d4621629d667 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:16.429278 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-059e0954-99ae-44f6-95a7-685874306671 req-412581d6-e517-4b35-b455-d4621629d667 service nova] Creating event network-changed:5632caf9-3896-4359-aa1f-68f1db858be0 for instance 78aba7da-ae55-4e89-aa6c-e226c570f780 on n-h1-766726-30 May 19 04:52:16.441638 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-059e0954-99ae-44f6-95a7-685874306671 req-412581d6-e517-4b35-b455-d4621629d667 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082340 May 19 04:52:16.443005 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2449/4805] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:52:16.752865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69e2d566-67c2-470e-ba10-e5642a20b421 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:16.753862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-69e2d566-67c2-470e-ba10-e5642a20b421 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:16.766225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69e2d566-67c2-470e-ba10-e5642a20b421 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:16.766699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69e2d566-67c2-470e-ba10-e5642a20b421 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:16.769401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69e2d566-67c2-470e-ba10-e5642a20b421 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:16.770169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69e2d566-67c2-470e-ba10-e5642a20b421 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:16.990530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8659ca9f-5c09-480d-818b-a0fc35843199 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:16.991265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8659ca9f-5c09-480d-818b-a0fc35843199 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:17.009557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8659ca9f-5c09-480d-818b-a0fc35843199 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.010046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8659ca9f-5c09-480d-818b-a0fc35843199 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:17.010851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8659ca9f-5c09-480d-818b-a0fc35843199 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.011302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8659ca9f-5c09-480d-818b-a0fc35843199 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:17.419273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69e2d566-67c2-470e-ba10-e5642a20b421 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:17.449398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8659ca9f-5c09-480d-818b-a0fc35843199 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:17.459958 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69e2d566-67c2-470e-ba10-e5642a20b421 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1315 microversion: 2.1 time: 0.697668 May 19 04:52:17.469280 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8659ca9f-5c09-480d-818b-a0fc35843199 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.482346 May 19 04:52:17.469280 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2450/4807] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:16 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:17.469465 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2357/4807] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:16 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:17.487450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-497806b9-9d78-43d1-92cd-b9b0abea7e2f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:17.487985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-497806b9-9d78-43d1-92cd-b9b0abea7e2f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:17.498889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-23d2ca46-9d2d-4536-8682-1ffe3e72d155 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:17.501248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-23d2ca46-9d2d-4536-8682-1ffe3e72d155 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:17.511383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23d2ca46-9d2d-4536-8682-1ffe3e72d155 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.512667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23d2ca46-9d2d-4536-8682-1ffe3e72d155 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:17.513810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23d2ca46-9d2d-4536-8682-1ffe3e72d155 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.514546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23d2ca46-9d2d-4536-8682-1ffe3e72d155 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:17.523792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-497806b9-9d78-43d1-92cd-b9b0abea7e2f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.524265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-497806b9-9d78-43d1-92cd-b9b0abea7e2f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:17.528596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-497806b9-9d78-43d1-92cd-b9b0abea7e2f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.529061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-497806b9-9d78-43d1-92cd-b9b0abea7e2f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:17.574799 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-23d2ca46-9d2d-4536-8682-1ffe3e72d155 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091394 May 19 04:52:17.581234 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2451/4808] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:52:17 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:52:17.588945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14b1b03f-a3b0-4972-9024-a920b4e17aa0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:17.590331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14b1b03f-a3b0-4972-9024-a920b4e17aa0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:17.600553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14b1b03f-a3b0-4972-9024-a920b4e17aa0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.601461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14b1b03f-a3b0-4972-9024-a920b4e17aa0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:17.602491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14b1b03f-a3b0-4972-9024-a920b4e17aa0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.604225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14b1b03f-a3b0-4972-9024-a920b4e17aa0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:17.648815 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-497806b9-9d78-43d1-92cd-b9b0abea7e2f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments/805f1960-005f-48c3-9f88-9d6c5ab2e2f2" status: 200 len: 194 microversion: 2.20 time: 0.178621 May 19 04:52:17.652037 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2358/4809] 10.222.0.58 () {60 vars in 1453 bytes} [Thu May 19 04:52:17 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments/805f1960-005f-48c3-9f88-9d6c5ab2e2f2 => generated 194 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:17.821103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-72a50cb0-709c-4a79-b88a-f46055518f80 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:17.821746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72a50cb0-709c-4a79-b88a-f46055518f80 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:17.841925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72a50cb0-709c-4a79-b88a-f46055518f80 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.843326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72a50cb0-709c-4a79-b88a-f46055518f80 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:17.844398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72a50cb0-709c-4a79-b88a-f46055518f80 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:17.844972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-14b1b03f-a3b0-4972-9024-a920b4e17aa0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lazy-loading 'services' on Instance uuid c87f7ed9-b42a-4cb5-9a13-935e4469527f {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:52:17.845437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72a50cb0-709c-4a79-b88a-f46055518f80 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:18.009702 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14b1b03f-a3b0-4972-9024-a920b4e17aa0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments/37785d08-5a44-40e4-b7ed-008c593c58d7" status: 202 len: 0 microversion: 2.1 time: 0.423937 May 19 04:52:18.010408 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2452/4810] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 04:52:17 2022] DELETE /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments/37785d08-5a44-40e4-b7ed-008c593c58d7 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:52:18.037371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-72a50cb0-709c-4a79-b88a-f46055518f80 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lazy-loading 'services' on Instance uuid 894769ad-4295-4aff-8ba0-30957e6ec8da {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:52:18.304478 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-72a50cb0-709c-4a79-b88a-f46055518f80 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "DELETE /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments/805f1960-005f-48c3-9f88-9d6c5ab2e2f2" status: 202 len: 0 microversion: 2.20 time: 0.487784 May 19 04:52:18.305724 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2359/4811] 10.222.0.58 () {60 vars in 1456 bytes} [Thu May 19 04:52:17 2022] DELETE /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments/805f1960-005f-48c3-9f88-9d6c5ab2e2f2 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 04:52:18.316232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ff592b07-cf52-497b-bd8a-e6b42eded2a1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:18.317767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ff592b07-cf52-497b-bd8a-e6b42eded2a1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:18.332290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff592b07-cf52-497b-bd8a-e6b42eded2a1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:18.334390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff592b07-cf52-497b-bd8a-e6b42eded2a1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:18.335991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff592b07-cf52-497b-bd8a-e6b42eded2a1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:18.337357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff592b07-cf52-497b-bd8a-e6b42eded2a1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:18.421791 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ff592b07-cf52-497b-bd8a-e6b42eded2a1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111039 May 19 04:52:18.429733 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2453/4812] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:18 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:18.482234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e44f285-190a-4e32-8b3d-a8a55bce74d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:18.487059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-de146681-22b2-445d-ac8b-8b2a652ecfff tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:18.487846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e44f285-190a-4e32-8b3d-a8a55bce74d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:18.488398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-de146681-22b2-445d-ac8b-8b2a652ecfff tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:18.502242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de146681-22b2-445d-ac8b-8b2a652ecfff tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:18.503001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de146681-22b2-445d-ac8b-8b2a652ecfff tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:18.503986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de146681-22b2-445d-ac8b-8b2a652ecfff tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:18.506727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de146681-22b2-445d-ac8b-8b2a652ecfff tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:18.511648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e44f285-190a-4e32-8b3d-a8a55bce74d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:18.514761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e44f285-190a-4e32-8b3d-a8a55bce74d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:18.520951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e44f285-190a-4e32-8b3d-a8a55bce74d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:18.522639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e44f285-190a-4e32-8b3d-a8a55bce74d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:19.056436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-de146681-22b2-445d-ac8b-8b2a652ecfff tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:19.067075 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-de146681-22b2-445d-ac8b-8b2a652ecfff tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.585462 May 19 04:52:19.077785 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2454/4813] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:18 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:19.740912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-daf249d0-2cbb-4d5a-b264-7cf8872a58a2 tempest-PortsAdminExtendedAttrsTestJSON-717711211 tempest-PortsAdminExtendedAttrsTestJSON-717711211-project-admin] Calling method '.version_select at 0x7fd314d58790>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:19.744994 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 04:52:19.744994 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 04:52:19.752573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daf249d0-2cbb-4d5a-b264-7cf8872a58a2 tempest-PortsAdminExtendedAttrsTestJSON-717711211 tempest-PortsAdminExtendedAttrsTestJSON-717711211-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:19.754482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daf249d0-2cbb-4d5a-b264-7cf8872a58a2 tempest-PortsAdminExtendedAttrsTestJSON-717711211 tempest-PortsAdminExtendedAttrsTestJSON-717711211-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:19.817693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daf249d0-2cbb-4d5a-b264-7cf8872a58a2 tempest-PortsAdminExtendedAttrsTestJSON-717711211 tempest-PortsAdminExtendedAttrsTestJSON-717711211-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:19.818949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daf249d0-2cbb-4d5a-b264-7cf8872a58a2 tempest-PortsAdminExtendedAttrsTestJSON-717711211 tempest-PortsAdminExtendedAttrsTestJSON-717711211-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:19.875341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daf249d0-2cbb-4d5a-b264-7cf8872a58a2 tempest-PortsAdminExtendedAttrsTestJSON-717711211 tempest-PortsAdminExtendedAttrsTestJSON-717711211-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:19.876016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daf249d0-2cbb-4d5a-b264-7cf8872a58a2 tempest-PortsAdminExtendedAttrsTestJSON-717711211 tempest-PortsAdminExtendedAttrsTestJSON-717711211-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:19.888270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e44f285-190a-4e32-8b3d-a8a55bce74d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:19.898934 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-daf249d0-2cbb-4d5a-b264-7cf8872a58a2 tempest-PortsAdminExtendedAttrsTestJSON-717711211 tempest-PortsAdminExtendedAttrsTestJSON-717711211-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.797963 May 19 04:52:19.901197 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2455/4814] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:52:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:52:19.920208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fee6b5da-014a-49de-9482-5e2a8a189e6c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:19.925903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fee6b5da-014a-49de-9482-5e2a8a189e6c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:19.945393 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e44f285-190a-4e32-8b3d-a8a55bce74d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1315 microversion: 2.1 time: 1.471963 May 19 04:52:19.948621 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2360/4815] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:18 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1315 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:19.956922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fee6b5da-014a-49de-9482-5e2a8a189e6c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:19.958177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fee6b5da-014a-49de-9482-5e2a8a189e6c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:19.962091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fee6b5da-014a-49de-9482-5e2a8a189e6c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:19.964014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fee6b5da-014a-49de-9482-5e2a8a189e6c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:20.095221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1ffeb56a-dd98-4033-924d-88e6e1d3ade8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:20.096444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1ffeb56a-dd98-4033-924d-88e6e1d3ade8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:20.107991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ffeb56a-dd98-4033-924d-88e6e1d3ade8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:20.112964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ffeb56a-dd98-4033-924d-88e6e1d3ade8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:20.116669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ffeb56a-dd98-4033-924d-88e6e1d3ade8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:20.117436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1ffeb56a-dd98-4033-924d-88e6e1d3ade8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:20.134106 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fee6b5da-014a-49de-9482-5e2a8a189e6c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.227991 May 19 04:52:20.135151 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2456/4816] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:19 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:20.967709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35ef23fa-1df7-4a72-aed3-d8f24be5f89b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:20.968668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-35ef23fa-1df7-4a72-aed3-d8f24be5f89b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:20.991637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35ef23fa-1df7-4a72-aed3-d8f24be5f89b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:20.995510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35ef23fa-1df7-4a72-aed3-d8f24be5f89b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:20.998026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35ef23fa-1df7-4a72-aed3-d8f24be5f89b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:21.000647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35ef23fa-1df7-4a72-aed3-d8f24be5f89b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:21.082856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:21.158648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1ffeb56a-dd98-4033-924d-88e6e1d3ade8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:21.172298 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1ffeb56a-dd98-4033-924d-88e6e1d3ade8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 1.081593 May 19 04:52:21.173443 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2361/4817] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:20 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:21.187323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ca1a34d-65bd-44a8-b606-b093460edfca tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:21.188584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ca1a34d-65bd-44a8-b606-b093460edfca tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:21.204831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ca1a34d-65bd-44a8-b606-b093460edfca tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:21.205588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ca1a34d-65bd-44a8-b606-b093460edfca tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:21.206525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ca1a34d-65bd-44a8-b606-b093460edfca tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:21.207139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ca1a34d-65bd-44a8-b606-b093460edfca tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:21.217462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:21.308864 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ca1a34d-65bd-44a8-b606-b093460edfca tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125933 May 19 04:52:21.326828 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2362/4818] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:21 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:21.523896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-35ef23fa-1df7-4a72-aed3-d8f24be5f89b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:21.530739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:21.548277 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-35ef23fa-1df7-4a72-aed3-d8f24be5f89b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1315 microversion: 2.1 time: 0.589463 May 19 04:52:21.549251 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2457/4819] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:20 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:22.190901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2737fddb-97b0-4fee-8dca-ed6858b4a325 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:22.191524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2737fddb-97b0-4fee-8dca-ed6858b4a325 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:22.201313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2737fddb-97b0-4fee-8dca-ed6858b4a325 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:22.205880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2737fddb-97b0-4fee-8dca-ed6858b4a325 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:22.206775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2737fddb-97b0-4fee-8dca-ed6858b4a325 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:22.207227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2737fddb-97b0-4fee-8dca-ed6858b4a325 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:22.336685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-79c2d0b8-97fb-4799-a96b-f9a8e6cf2f0a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:22.341109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-79c2d0b8-97fb-4799-a96b-f9a8e6cf2f0a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:22.354967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79c2d0b8-97fb-4799-a96b-f9a8e6cf2f0a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:22.362778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79c2d0b8-97fb-4799-a96b-f9a8e6cf2f0a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:22.363543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79c2d0b8-97fb-4799-a96b-f9a8e6cf2f0a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:22.364602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79c2d0b8-97fb-4799-a96b-f9a8e6cf2f0a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:22.448176 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-79c2d0b8-97fb-4799-a96b-f9a8e6cf2f0a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121789 May 19 04:52:22.455956 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2458/4820] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:22 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:22.548338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2737fddb-97b0-4fee-8dca-ed6858b4a325 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:22.565239 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2737fddb-97b0-4fee-8dca-ed6858b4a325 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.377342 May 19 04:52:22.566320 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2363/4821] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:22 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:22.567947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9df681ab-cec0-44f8-8371-059d5f73df71 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:22.569195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9df681ab-cec0-44f8-8371-059d5f73df71 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:22.578941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9df681ab-cec0-44f8-8371-059d5f73df71 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:22.581186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9df681ab-cec0-44f8-8371-059d5f73df71 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:22.582439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9df681ab-cec0-44f8-8371-059d5f73df71 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:22.584085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9df681ab-cec0-44f8-8371-059d5f73df71 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:22.804140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9df681ab-cec0-44f8-8371-059d5f73df71 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:22.829318 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9df681ab-cec0-44f8-8371-059d5f73df71 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1315 microversion: 2.1 time: 0.262377 May 19 04:52:22.830521 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2459/4822] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:22 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:23.086599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1b5585de-ef34-4c69-b0cb-496528e648b6 req-5786d9ea-aa63-49a1-82ca-bfa8fda21b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78aba7da-ae55-4e89-aa6c-e226c570f780", "name": "network-vif-plugged", "status": "completed", "tag": "5632caf9-3896-4359-aa1f-68f1db858be0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:23.103413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1b5585de-ef34-4c69-b0cb-496528e648b6 req-5786d9ea-aa63-49a1-82ca-bfa8fda21b66 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:23.104126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1b5585de-ef34-4c69-b0cb-496528e648b6 req-5786d9ea-aa63-49a1-82ca-bfa8fda21b66 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:23.129582 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1b5585de-ef34-4c69-b0cb-496528e648b6 req-5786d9ea-aa63-49a1-82ca-bfa8fda21b66 service nova] Creating event network-vif-plugged:5632caf9-3896-4359-aa1f-68f1db858be0 for instance 78aba7da-ae55-4e89-aa6c-e226c570f780 on n-h1-766726-30 May 19 04:52:23.145544 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1b5585de-ef34-4c69-b0cb-496528e648b6 req-5786d9ea-aa63-49a1-82ca-bfa8fda21b66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065471 May 19 04:52:23.146730 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2364/4823] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:52:23.462769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-63a2623d-243d-4c2a-9de9-972b025a5e95 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:23.464324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-63a2623d-243d-4c2a-9de9-972b025a5e95 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:23.476701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63a2623d-243d-4c2a-9de9-972b025a5e95 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:23.477191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63a2623d-243d-4c2a-9de9-972b025a5e95 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:23.477982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63a2623d-243d-4c2a-9de9-972b025a5e95 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:23.478424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63a2623d-243d-4c2a-9de9-972b025a5e95 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:23.527121 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-63a2623d-243d-4c2a-9de9-972b025a5e95 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068758 May 19 04:52:23.539210 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2460/4824] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:23 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:23.584698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75852005-604b-4de4-8ac8-56f067d8deaa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:23.585980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-75852005-604b-4de4-8ac8-56f067d8deaa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:23.592572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75852005-604b-4de4-8ac8-56f067d8deaa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:23.593340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75852005-604b-4de4-8ac8-56f067d8deaa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:23.594365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75852005-604b-4de4-8ac8-56f067d8deaa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:23.595025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75852005-604b-4de4-8ac8-56f067d8deaa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:23.846912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f85f106-9f1e-441b-ac15-7513c8db784a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:23.848128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f85f106-9f1e-441b-ac15-7513c8db784a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:23.860990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f85f106-9f1e-441b-ac15-7513c8db784a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:23.870082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f85f106-9f1e-441b-ac15-7513c8db784a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:23.871712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f85f106-9f1e-441b-ac15-7513c8db784a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:23.873853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f85f106-9f1e-441b-ac15-7513c8db784a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:24.049869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-75852005-604b-4de4-8ac8-56f067d8deaa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:24.059132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:24.069225 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-75852005-604b-4de4-8ac8-56f067d8deaa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.490160 May 19 04:52:24.074100 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2365/4825] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:23 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:24.231197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0f85f106-9f1e-441b-ac15-7513c8db784a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:24.249439 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f85f106-9f1e-441b-ac15-7513c8db784a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1315 microversion: 2.1 time: 0.402705 May 19 04:52:24.250319 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2461/4826] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:23 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:24.546073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61ac1524-671d-4190-9706-3f7f84574ec7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:24.547945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-61ac1524-671d-4190-9706-3f7f84574ec7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:24.558149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61ac1524-671d-4190-9706-3f7f84574ec7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:24.559167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61ac1524-671d-4190-9706-3f7f84574ec7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:24.561173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61ac1524-671d-4190-9706-3f7f84574ec7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:24.562364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61ac1524-671d-4190-9706-3f7f84574ec7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:24.635236 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-61ac1524-671d-4190-9706-3f7f84574ec7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095587 May 19 04:52:24.641327 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2366/4827] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:24 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:25.091446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c93094c3-2535-49cf-bc07-cbcc86dafbf8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:25.092212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c93094c3-2535-49cf-bc07-cbcc86dafbf8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:25.101606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c93094c3-2535-49cf-bc07-cbcc86dafbf8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:25.102591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c93094c3-2535-49cf-bc07-cbcc86dafbf8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:25.104549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c93094c3-2535-49cf-bc07-cbcc86dafbf8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:25.104993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c93094c3-2535-49cf-bc07-cbcc86dafbf8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:25.268808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-467d6e66-f19c-4f94-b1d3-73161b1151f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:25.269488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-467d6e66-f19c-4f94-b1d3-73161b1151f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:25.280066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-467d6e66-f19c-4f94-b1d3-73161b1151f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:25.280540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-467d6e66-f19c-4f94-b1d3-73161b1151f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:25.281368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-467d6e66-f19c-4f94-b1d3-73161b1151f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:25.283935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-467d6e66-f19c-4f94-b1d3-73161b1151f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:25.460320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c93094c3-2535-49cf-bc07-cbcc86dafbf8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:25.479203 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c93094c3-2535-49cf-bc07-cbcc86dafbf8 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.392458 May 19 04:52:25.484152 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2462/4828] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:25 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:25.648298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-589969f6-9864-4995-9228-ed0d6742f1ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:25.651318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-589969f6-9864-4995-9228-ed0d6742f1ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:25.674781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-589969f6-9864-4995-9228-ed0d6742f1ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:25.675249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-589969f6-9864-4995-9228-ed0d6742f1ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:25.676055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-589969f6-9864-4995-9228-ed0d6742f1ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:25.676498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-589969f6-9864-4995-9228-ed0d6742f1ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:25.747601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-467d6e66-f19c-4f94-b1d3-73161b1151f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:25.754902 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-589969f6-9864-4995-9228-ed0d6742f1ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109775 May 19 04:52:25.755607 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-467d6e66-f19c-4f94-b1d3-73161b1151f2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1502 microversion: 2.1 time: 0.492937 May 19 04:52:25.761806 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2463/4829] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:25 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:25.770515 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2367/4830] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:25 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1502 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:25.781219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5aad0afb-1c63-4e94-9bfc-44bf152e5e68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:25.785745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5aad0afb-1c63-4e94-9bfc-44bf152e5e68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:25.830819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5aad0afb-1c63-4e94-9bfc-44bf152e5e68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:25.831638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5aad0afb-1c63-4e94-9bfc-44bf152e5e68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:25.833886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5aad0afb-1c63-4e94-9bfc-44bf152e5e68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:25.834685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5aad0afb-1c63-4e94-9bfc-44bf152e5e68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:25.975199 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5aad0afb-1c63-4e94-9bfc-44bf152e5e68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780/action" status: 202 len: 0 microversion: 2.1 time: 0.206469 May 19 04:52:25.978430 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2464/4831] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:52:25 2022] POST /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:52:25.987290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3e14162c-c77a-478e-90da-4462610224cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:25.988172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3e14162c-c77a-478e-90da-4462610224cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:26.008591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e14162c-c77a-478e-90da-4462610224cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:26.009326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e14162c-c77a-478e-90da-4462610224cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:26.010289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e14162c-c77a-478e-90da-4462610224cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:26.010935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e14162c-c77a-478e-90da-4462610224cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:26.433801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3e14162c-c77a-478e-90da-4462610224cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:26.447376 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3e14162c-c77a-478e-90da-4462610224cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1507 microversion: 2.1 time: 0.465020 May 19 04:52:26.459318 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2368/4832] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:25 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:26.506851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bdcc088-8c5c-4c40-85a7-1ecc34efdffd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:26.508143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4bdcc088-8c5c-4c40-85a7-1ecc34efdffd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:26.522597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdcc088-8c5c-4c40-85a7-1ecc34efdffd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:26.523325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdcc088-8c5c-4c40-85a7-1ecc34efdffd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:26.526160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdcc088-8c5c-4c40-85a7-1ecc34efdffd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:26.526834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdcc088-8c5c-4c40-85a7-1ecc34efdffd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:26.769556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-63c31736-e665-4aad-92cc-84798b194885 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:26.770494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-63c31736-e665-4aad-92cc-84798b194885 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:26.786284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63c31736-e665-4aad-92cc-84798b194885 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:26.786745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63c31736-e665-4aad-92cc-84798b194885 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:26.787530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63c31736-e665-4aad-92cc-84798b194885 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:26.787977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63c31736-e665-4aad-92cc-84798b194885 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:26.856201 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-63c31736-e665-4aad-92cc-84798b194885 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091168 May 19 04:52:26.859689 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2369/4833] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:26 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:27.040312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4bdcc088-8c5c-4c40-85a7-1ecc34efdffd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:27.049014 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4bdcc088-8c5c-4c40-85a7-1ecc34efdffd tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.548102 May 19 04:52:27.054073 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2465/4834] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:26 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:27.468098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c7e6dec9-a007-4c48-93bd-fefa954ec479 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:27.468440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c7e6dec9-a007-4c48-93bd-fefa954ec479 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:27.480046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7e6dec9-a007-4c48-93bd-fefa954ec479 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:27.480299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7e6dec9-a007-4c48-93bd-fefa954ec479 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:27.481132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7e6dec9-a007-4c48-93bd-fefa954ec479 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:27.484939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7e6dec9-a007-4c48-93bd-fefa954ec479 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:27.828813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c7e6dec9-a007-4c48-93bd-fefa954ec479 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:27.854415 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c7e6dec9-a007-4c48-93bd-fefa954ec479 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1487 microversion: 2.1 time: 0.380806 May 19 04:52:27.868646 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2370/4835] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:27 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1487 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:27.871079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-097a5b6a-0852-4479-ac3a-597a77a68bac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:27.872346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-097a5b6a-0852-4479-ac3a-597a77a68bac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:27.878318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-432fab8c-63ed-4fcb-904c-856eaf9c51ed tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:27.879213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-432fab8c-63ed-4fcb-904c-856eaf9c51ed tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:27.891617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432fab8c-63ed-4fcb-904c-856eaf9c51ed tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:27.892878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432fab8c-63ed-4fcb-904c-856eaf9c51ed tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:27.894187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432fab8c-63ed-4fcb-904c-856eaf9c51ed tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:27.894779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432fab8c-63ed-4fcb-904c-856eaf9c51ed tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:27.898002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-097a5b6a-0852-4479-ac3a-597a77a68bac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:27.898701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-097a5b6a-0852-4479-ac3a-597a77a68bac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:27.900411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-097a5b6a-0852-4479-ac3a-597a77a68bac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:27.903179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-097a5b6a-0852-4479-ac3a-597a77a68bac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:27.932858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-432fab8c-63ed-4fcb-904c-856eaf9c51ed tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lazy-loading 'flavor' on Instance uuid 78aba7da-ae55-4e89-aa6c-e226c570f780 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:52:27.986415 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-097a5b6a-0852-4479-ac3a-597a77a68bac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121839 May 19 04:52:27.987203 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2466/4836] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:27 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:52:28.070835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0c828b7d-e45f-4262-8f15-7dbef35d2e51 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:28.072373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0c828b7d-e45f-4262-8f15-7dbef35d2e51 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:28.083236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c828b7d-e45f-4262-8f15-7dbef35d2e51 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:28.083902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c828b7d-e45f-4262-8f15-7dbef35d2e51 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:28.090047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c828b7d-e45f-4262-8f15-7dbef35d2e51 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:28.090722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c828b7d-e45f-4262-8f15-7dbef35d2e51 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:28.358786 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-432fab8c-63ed-4fcb-904c-856eaf9c51ed tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780/action" status: 202 len: 0 microversion: 2.1 time: 0.488047 May 19 04:52:28.361601 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2371/4837] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:52:27 2022] POST /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:52:28.370757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d906567-15c7-4bda-b40e-0b6c6c8f5e43 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:28.371642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1d906567-15c7-4bda-b40e-0b6c6c8f5e43 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:28.379669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d906567-15c7-4bda-b40e-0b6c6c8f5e43 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:28.380599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d906567-15c7-4bda-b40e-0b6c6c8f5e43 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:28.382082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d906567-15c7-4bda-b40e-0b6c6c8f5e43 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:28.382716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d906567-15c7-4bda-b40e-0b6c6c8f5e43 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:28.589645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0c828b7d-e45f-4262-8f15-7dbef35d2e51 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:28.601409 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0c828b7d-e45f-4262-8f15-7dbef35d2e51 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.534518 May 19 04:52:28.605692 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2467/4838] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:28 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:28.751542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1d906567-15c7-4bda-b40e-0b6c6c8f5e43 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:28.765197 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d906567-15c7-4bda-b40e-0b6c6c8f5e43 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1493 microversion: 2.1 time: 0.398991 May 19 04:52:28.769212 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2372/4839] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:28 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1493 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:29.004678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-384652fc-9767-41c8-9be8-dcd27fee176b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:29.008254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-384652fc-9767-41c8-9be8-dcd27fee176b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:29.032228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-384652fc-9767-41c8-9be8-dcd27fee176b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:29.033244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-384652fc-9767-41c8-9be8-dcd27fee176b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:29.035803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-384652fc-9767-41c8-9be8-dcd27fee176b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:29.037500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-384652fc-9767-41c8-9be8-dcd27fee176b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:29.091681 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-384652fc-9767-41c8-9be8-dcd27fee176b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095012 May 19 04:52:29.093063 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2468/4840] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:28 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:29.621561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c54d413d-e860-4945-a0f6-b3d7a8058068 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:29.623090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c54d413d-e860-4945-a0f6-b3d7a8058068 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:29.640162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c54d413d-e860-4945-a0f6-b3d7a8058068 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:29.641126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c54d413d-e860-4945-a0f6-b3d7a8058068 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:29.650520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c54d413d-e860-4945-a0f6-b3d7a8058068 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:29.650520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c54d413d-e860-4945-a0f6-b3d7a8058068 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:29.785287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-252881d4-ac82-4fa3-8ed8-e4aba968dd16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:29.785965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-252881d4-ac82-4fa3-8ed8-e4aba968dd16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:29.797739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-252881d4-ac82-4fa3-8ed8-e4aba968dd16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:29.799997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-252881d4-ac82-4fa3-8ed8-e4aba968dd16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:29.800839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-252881d4-ac82-4fa3-8ed8-e4aba968dd16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:29.801347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-252881d4-ac82-4fa3-8ed8-e4aba968dd16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:30.202759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c54d413d-e860-4945-a0f6-b3d7a8058068 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:30.216936 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c54d413d-e860-4945-a0f6-b3d7a8058068 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.599815 May 19 04:52:30.218347 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2373/4841] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:29 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:30.232263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b7cffed9-f09d-4ebc-a16b-78f49594f5c6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:30.233543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b7cffed9-f09d-4ebc-a16b-78f49594f5c6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:30.248910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7cffed9-f09d-4ebc-a16b-78f49594f5c6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:30.249839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7cffed9-f09d-4ebc-a16b-78f49594f5c6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:30.251157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7cffed9-f09d-4ebc-a16b-78f49594f5c6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:30.253150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7cffed9-f09d-4ebc-a16b-78f49594f5c6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:30.295278 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b7cffed9-f09d-4ebc-a16b-78f49594f5c6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075685 May 19 04:52:30.296128 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2374/4842] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:30 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:30.335233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-252881d4-ac82-4fa3-8ed8-e4aba968dd16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:30.347352 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-252881d4-ac82-4fa3-8ed8-e4aba968dd16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1514 microversion: 2.1 time: 0.566677 May 19 04:52:30.347963 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2469/4843] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:29 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1514 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:31.236372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-27429adc-a8bc-4185-9f64-3595eb18663e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:31.237655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-27429adc-a8bc-4185-9f64-3595eb18663e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:31.255666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27429adc-a8bc-4185-9f64-3595eb18663e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:31.257951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27429adc-a8bc-4185-9f64-3595eb18663e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:31.258932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27429adc-a8bc-4185-9f64-3595eb18663e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:31.261003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27429adc-a8bc-4185-9f64-3595eb18663e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:31.309490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73af5cd1-6be3-4ebc-a4f0-b99ecd6a4513 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:31.310829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73af5cd1-6be3-4ebc-a4f0-b99ecd6a4513 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:31.351175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73af5cd1-6be3-4ebc-a4f0-b99ecd6a4513 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:31.354784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73af5cd1-6be3-4ebc-a4f0-b99ecd6a4513 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:31.370547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73af5cd1-6be3-4ebc-a4f0-b99ecd6a4513 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:31.371004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73af5cd1-6be3-4ebc-a4f0-b99ecd6a4513 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:31.455201 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73af5cd1-6be3-4ebc-a4f0-b99ecd6a4513 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151819 May 19 04:52:31.457983 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2470/4844] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:31 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:52:31.472973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bf309a9d-fb05-4aeb-bd08-6156a3ab4d6f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:31.473706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bf309a9d-fb05-4aeb-bd08-6156a3ab4d6f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:31.497345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf309a9d-fb05-4aeb-bd08-6156a3ab4d6f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:31.497814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf309a9d-fb05-4aeb-bd08-6156a3ab4d6f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:31.500768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf309a9d-fb05-4aeb-bd08-6156a3ab4d6f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:31.501285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf309a9d-fb05-4aeb-bd08-6156a3ab4d6f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:32.059417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-27429adc-a8bc-4185-9f64-3595eb18663e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:32.071557 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-27429adc-a8bc-4185-9f64-3595eb18663e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.839444 May 19 04:52:32.077398 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2375/4845] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:31 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:32.260283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bf309a9d-fb05-4aeb-bd08-6156a3ab4d6f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:32.277669 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bf309a9d-fb05-4aeb-bd08-6156a3ab4d6f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.808021 May 19 04:52:32.288757 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2471/4846] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:31 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:32.471301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2e4c62a9-5b83-459a-a74d-f3733467d993 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:32.473542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2e4c62a9-5b83-459a-a74d-f3733467d993 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:32.486953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=66 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:32.492545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e4c62a9-5b83-459a-a74d-f3733467d993 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:32.494140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e4c62a9-5b83-459a-a74d-f3733467d993 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:32.498950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e4c62a9-5b83-459a-a74d-f3733467d993 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:32.499755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e4c62a9-5b83-459a-a74d-f3733467d993 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:32.578780 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2e4c62a9-5b83-459a-a74d-f3733467d993 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113389 May 19 04:52:32.585524 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2376/4847] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:32 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:33.091727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f7497227-85e2-4811-9902-f873c2672ac1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:33.092371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f7497227-85e2-4811-9902-f873c2672ac1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:33.118050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:33.119699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7497227-85e2-4811-9902-f873c2672ac1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:33.120176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7497227-85e2-4811-9902-f873c2672ac1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:33.120934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7497227-85e2-4811-9902-f873c2672ac1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:33.133277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7497227-85e2-4811-9902-f873c2672ac1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:33.225497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ac9c8d42-d3ae-46e2-a63d-73551b1382fd req-abc5f850-e962-4c2f-b684-b60cb3a5a2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78aba7da-ae55-4e89-aa6c-e226c570f780", "name": "network-vif-plugged", "status": "completed", "tag": "5632caf9-3896-4359-aa1f-68f1db858be0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:33.244992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ac9c8d42-d3ae-46e2-a63d-73551b1382fd req-abc5f850-e962-4c2f-b684-b60cb3a5a2e4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:33.252196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ac9c8d42-d3ae-46e2-a63d-73551b1382fd req-abc5f850-e962-4c2f-b684-b60cb3a5a2e4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:33.283444 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ac9c8d42-d3ae-46e2-a63d-73551b1382fd req-abc5f850-e962-4c2f-b684-b60cb3a5a2e4 service nova] Creating event network-vif-plugged:5632caf9-3896-4359-aa1f-68f1db858be0 for instance 78aba7da-ae55-4e89-aa6c-e226c570f780 on n-h1-766726-30 May 19 04:52:33.311159 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ac9c8d42-d3ae-46e2-a63d-73551b1382fd req-abc5f850-e962-4c2f-b684-b60cb3a5a2e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087664 May 19 04:52:33.311794 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2377/4848] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:52:33.345678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6a69e954-ea2c-494a-b426-6afd95d2bf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:33.355587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6a69e954-ea2c-494a-b426-6afd95d2bf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:33.379791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a69e954-ea2c-494a-b426-6afd95d2bf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:33.380268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a69e954-ea2c-494a-b426-6afd95d2bf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:33.381048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a69e954-ea2c-494a-b426-6afd95d2bf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:33.381522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a69e954-ea2c-494a-b426-6afd95d2bf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:33.953392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f7497227-85e2-4811-9902-f873c2672ac1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:33.958594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:33.978465 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f7497227-85e2-4811-9902-f873c2672ac1 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.889209 May 19 04:52:33.998063 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2472/4849] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:33 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:34.022989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b46f3064-d1e8-4a78-b8ee-2f103fa82951 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:34.028320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b46f3064-d1e8-4a78-b8ee-2f103fa82951 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:34.054615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b46f3064-d1e8-4a78-b8ee-2f103fa82951 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:34.059542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b46f3064-d1e8-4a78-b8ee-2f103fa82951 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:34.060453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b46f3064-d1e8-4a78-b8ee-2f103fa82951 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:34.062143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b46f3064-d1e8-4a78-b8ee-2f103fa82951 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:34.219123 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b46f3064-d1e8-4a78-b8ee-2f103fa82951 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.217879 May 19 04:52:34.223057 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2473/4850] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:33 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:34.591209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6a69e954-ea2c-494a-b426-6afd95d2bf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:34.615924 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6a69e954-ea2c-494a-b426-6afd95d2bf46 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 1.292541 May 19 04:52:34.629471 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2378/4851] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:33 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:34.778174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-42d97940-b509-4de6-9808-8a419e66dcc7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:34.779514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-42d97940-b509-4de6-9808-8a419e66dcc7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:34.792855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42d97940-b509-4de6-9808-8a419e66dcc7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:34.801146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42d97940-b509-4de6-9808-8a419e66dcc7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:34.802528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42d97940-b509-4de6-9808-8a419e66dcc7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:34.806482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42d97940-b509-4de6-9808-8a419e66dcc7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:34.905552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-42d97940-b509-4de6-9808-8a419e66dcc7 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135129 May 19 04:52:34.912603 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2474/4852] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:52:34 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:52:35.015416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d0f9f20-a2f8-4193-8696-ac61c63310ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:35.016037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9d0f9f20-a2f8-4193-8696-ac61c63310ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:35.028697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d0f9f20-a2f8-4193-8696-ac61c63310ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.029770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d0f9f20-a2f8-4193-8696-ac61c63310ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:35.030754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d0f9f20-a2f8-4193-8696-ac61c63310ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.032508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d0f9f20-a2f8-4193-8696-ac61c63310ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:35.109417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99da86f3-95e1-4e6a-bebd-86d491698f3e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:35.111336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-99da86f3-95e1-4e6a-bebd-86d491698f3e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:35.122870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99da86f3-95e1-4e6a-bebd-86d491698f3e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.128479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99da86f3-95e1-4e6a-bebd-86d491698f3e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:35.129520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99da86f3-95e1-4e6a-bebd-86d491698f3e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.130807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99da86f3-95e1-4e6a-bebd-86d491698f3e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:35.233541 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99da86f3-95e1-4e6a-bebd-86d491698f3e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121884 May 19 04:52:35.233541 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2475/4853] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:52:35 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:52:35.261773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0dabe3d4-ac67-441e-9d55-56e13f93b093 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:35.267919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0dabe3d4-ac67-441e-9d55-56e13f93b093 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:35.290271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dabe3d4-ac67-441e-9d55-56e13f93b093 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.291199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dabe3d4-ac67-441e-9d55-56e13f93b093 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:35.301220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dabe3d4-ac67-441e-9d55-56e13f93b093 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.304158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0dabe3d4-ac67-441e-9d55-56e13f93b093 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:35.418044 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0dabe3d4-ac67-441e-9d55-56e13f93b093 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180207 May 19 04:52:35.422573 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2476/4854] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:35 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:52:35.437584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35c5de8c-a9c5-4f65-befb-bc93acb5ad7b tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:35.439073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-35c5de8c-a9c5-4f65-befb-bc93acb5ad7b tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:35.446859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35c5de8c-a9c5-4f65-befb-bc93acb5ad7b tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.447630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35c5de8c-a9c5-4f65-befb-bc93acb5ad7b tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:35.449130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35c5de8c-a9c5-4f65-befb-bc93acb5ad7b tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.449802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35c5de8c-a9c5-4f65-befb-bc93acb5ad7b tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:35.495637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-35c5de8c-a9c5-4f65-befb-bc93acb5ad7b tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:52:35.692276 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-35c5de8c-a9c5-4f65-befb-bc93acb5ad7b tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 204 len: 0 microversion: 2.1 time: 0.264996 May 19 04:52:35.694026 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2477/4855] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:35 2022] DELETE /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:52:35.711413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8929ba5b-16a0-4c29-a6b9-21e8205d7aac tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:35.713011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8929ba5b-16a0-4c29-a6b9-21e8205d7aac tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:35.728427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8929ba5b-16a0-4c29-a6b9-21e8205d7aac tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.729186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8929ba5b-16a0-4c29-a6b9-21e8205d7aac tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:35.730455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8929ba5b-16a0-4c29-a6b9-21e8205d7aac tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:35.731129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8929ba5b-16a0-4c29-a6b9-21e8205d7aac tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:36.278291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9d0f9f20-a2f8-4193-8696-ac61c63310ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:36.286372 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9d0f9f20-a2f8-4193-8696-ac61c63310ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 1.275181 May 19 04:52:36.286981 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2379/4856] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:35 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:36.294366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2e12d8a1-16d9-4070-b137-437ea1ae9bad tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:36.308581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2e12d8a1-16d9-4070-b137-437ea1ae9bad tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:36.347024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e12d8a1-16d9-4070-b137-437ea1ae9bad tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:36.349648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e12d8a1-16d9-4070-b137-437ea1ae9bad tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:36.350632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e12d8a1-16d9-4070-b137-437ea1ae9bad tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:36.354602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e12d8a1-16d9-4070-b137-437ea1ae9bad tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:36.816083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8929ba5b-16a0-4c29-a6b9-21e8205d7aac tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:36.838128 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8929ba5b-16a0-4c29-a6b9-21e8205d7aac tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 1.142581 May 19 04:52:36.838743 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2478/4857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:35 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:36.858255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c132a343-dc68-4ff7-ae27-d0f4fa40111e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:36.859229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c132a343-dc68-4ff7-ae27-d0f4fa40111e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:36.883947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c132a343-dc68-4ff7-ae27-d0f4fa40111e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:36.884404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c132a343-dc68-4ff7-ae27-d0f4fa40111e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:36.885231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c132a343-dc68-4ff7-ae27-d0f4fa40111e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:36.885676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c132a343-dc68-4ff7-ae27-d0f4fa40111e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:37.025808 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c132a343-dc68-4ff7-ae27-d0f4fa40111e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.177108 May 19 04:52:37.026419 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2479/4858] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:36 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:37.304631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a6bea90-301c-4dce-8cc8-93f353df0a85 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:37.305402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a6bea90-301c-4dce-8cc8-93f353df0a85 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:37.342756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2e12d8a1-16d9-4070-b137-437ea1ae9bad tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:37.348627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a6bea90-301c-4dce-8cc8-93f353df0a85 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:37.349361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a6bea90-301c-4dce-8cc8-93f353df0a85 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:37.352333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a6bea90-301c-4dce-8cc8-93f353df0a85 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:37.353001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a6bea90-301c-4dce-8cc8-93f353df0a85 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:37.356792 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2e12d8a1-16d9-4070-b137-437ea1ae9bad tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1677 microversion: 2.1 time: 1.068712 May 19 04:52:37.363542 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2380/4859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:36 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1677 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:37.864804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48ebf4b7-083a-4a20-8f43-f5486150280e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:37.866306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-48ebf4b7-083a-4a20-8f43-f5486150280e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:37.891387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48ebf4b7-083a-4a20-8f43-f5486150280e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:37.894664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48ebf4b7-083a-4a20-8f43-f5486150280e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:37.895677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48ebf4b7-083a-4a20-8f43-f5486150280e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:37.896193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48ebf4b7-083a-4a20-8f43-f5486150280e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:37.961430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:38.042022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a6bea90-301c-4dce-8cc8-93f353df0a85 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:38.056320 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a6bea90-301c-4dce-8cc8-93f353df0a85 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.755284 May 19 04:52:38.068034 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2480/4860] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:37 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:38.083319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-85b0e231-5ddd-49c9-911a-3584752cb669 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:38.084775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-85b0e231-5ddd-49c9-911a-3584752cb669 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:38.106080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85b0e231-5ddd-49c9-911a-3584752cb669 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:38.114645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85b0e231-5ddd-49c9-911a-3584752cb669 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:38.115627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85b0e231-5ddd-49c9-911a-3584752cb669 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:38.118041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-85b0e231-5ddd-49c9-911a-3584752cb669 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:38.225629 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-85b0e231-5ddd-49c9-911a-3584752cb669 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.149285 May 19 04:52:38.230626 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2481/4861] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:38 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:38.381994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f69b91fb-4057-4cfa-9183-7c95aba94bb0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:38.382523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f69b91fb-4057-4cfa-9183-7c95aba94bb0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:38.408854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f69b91fb-4057-4cfa-9183-7c95aba94bb0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:38.414521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f69b91fb-4057-4cfa-9183-7c95aba94bb0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:38.418794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f69b91fb-4057-4cfa-9183-7c95aba94bb0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:38.421687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f69b91fb-4057-4cfa-9183-7c95aba94bb0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:38.776975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-48ebf4b7-083a-4a20-8f43-f5486150280e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:38.804660 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-48ebf4b7-083a-4a20-8f43-f5486150280e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.953379 May 19 04:52:38.806701 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2381/4862] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:37 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:39.074801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b540986-d510-42fc-80df-338005c9fb90 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:39.075778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b540986-d510-42fc-80df-338005c9fb90 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:39.117471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b540986-d510-42fc-80df-338005c9fb90 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:39.123392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b540986-d510-42fc-80df-338005c9fb90 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:39.126419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b540986-d510-42fc-80df-338005c9fb90 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:39.127808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b540986-d510-42fc-80df-338005c9fb90 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:39.475427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f69b91fb-4057-4cfa-9183-7c95aba94bb0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:39.490137 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f69b91fb-4057-4cfa-9183-7c95aba94bb0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1677 microversion: 2.1 time: 1.113799 May 19 04:52:39.493997 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2482/4863] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:38 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1677 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:39.499105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88e84b42-9bab-4475-96fa-6111d2c2b88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:39.500103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-88e84b42-9bab-4475-96fa-6111d2c2b88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:39.521009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88e84b42-9bab-4475-96fa-6111d2c2b88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:39.522663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88e84b42-9bab-4475-96fa-6111d2c2b88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:39.524863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88e84b42-9bab-4475-96fa-6111d2c2b88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:39.526577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88e84b42-9bab-4475-96fa-6111d2c2b88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:39.640365 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88e84b42-9bab-4475-96fa-6111d2c2b88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145210 May 19 04:52:39.640972 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2483/4864] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:39 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:39.740868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b540986-d510-42fc-80df-338005c9fb90 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:39.754849 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b540986-d510-42fc-80df-338005c9fb90 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.684569 May 19 04:52:39.763754 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2382/4865] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:39 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:39.822809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-300cc0df-b901-4cdc-b3b3-3316a5142389 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:39.823957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-300cc0df-b901-4cdc-b3b3-3316a5142389 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:39.839375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-300cc0df-b901-4cdc-b3b3-3316a5142389 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:39.842554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-300cc0df-b901-4cdc-b3b3-3316a5142389 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:39.850086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-300cc0df-b901-4cdc-b3b3-3316a5142389 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:39.850623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-300cc0df-b901-4cdc-b3b3-3316a5142389 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:40.510245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df72fc6f-7e03-4913-8c53-1acb4b365466 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:40.511596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-df72fc6f-7e03-4913-8c53-1acb4b365466 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:40.528413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df72fc6f-7e03-4913-8c53-1acb4b365466 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:40.529260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df72fc6f-7e03-4913-8c53-1acb4b365466 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:40.530293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df72fc6f-7e03-4913-8c53-1acb4b365466 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:40.530991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df72fc6f-7e03-4913-8c53-1acb4b365466 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:40.927237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-300cc0df-b901-4cdc-b3b3-3316a5142389 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:40.955542 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-300cc0df-b901-4cdc-b3b3-3316a5142389 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 1.132514 May 19 04:52:40.963118 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2484/4866] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:39 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:40.990545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9366270e-4d67-4bbc-832e-e32a52c0e055 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:40.996553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9366270e-4d67-4bbc-832e-e32a52c0e055 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:41.028561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9366270e-4d67-4bbc-832e-e32a52c0e055 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:41.031204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9366270e-4d67-4bbc-832e-e32a52c0e055 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:41.038570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9366270e-4d67-4bbc-832e-e32a52c0e055 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:41.043302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9366270e-4d67-4bbc-832e-e32a52c0e055 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:41.131928 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9366270e-4d67-4bbc-832e-e32a52c0e055 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165879 May 19 04:52:41.132894 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2485/4867] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:40 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:41.139747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e19774c-9d2a-4b9a-ac9c-3127c44f07cf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:41.140703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6e19774c-9d2a-4b9a-ac9c-3127c44f07cf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:41.151170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e19774c-9d2a-4b9a-ac9c-3127c44f07cf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:41.152279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e19774c-9d2a-4b9a-ac9c-3127c44f07cf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:41.153351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e19774c-9d2a-4b9a-ac9c-3127c44f07cf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:41.154186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e19774c-9d2a-4b9a-ac9c-3127c44f07cf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:41.234164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df72fc6f-7e03-4913-8c53-1acb4b365466 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:41.244687 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-df72fc6f-7e03-4913-8c53-1acb4b365466 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1677 microversion: 2.1 time: 0.738563 May 19 04:52:41.258230 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2383/4868] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:40 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1677 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:41.978512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-45f8537a-c642-47dd-8f2d-a5b3ff7bdebc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:41.979290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-45f8537a-c642-47dd-8f2d-a5b3ff7bdebc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:41.995839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45f8537a-c642-47dd-8f2d-a5b3ff7bdebc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:41.999094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45f8537a-c642-47dd-8f2d-a5b3ff7bdebc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:42.000139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45f8537a-c642-47dd-8f2d-a5b3ff7bdebc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:42.000674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45f8537a-c642-47dd-8f2d-a5b3ff7bdebc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:42.012843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6e19774c-9d2a-4b9a-ac9c-3127c44f07cf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:42.023169 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e19774c-9d2a-4b9a-ac9c-3127c44f07cf tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1510 microversion: 2.1 time: 0.888623 May 19 04:52:42.038358 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2486/4869] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:41 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1510 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:42.146997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a3fcdea-8c35-4ad6-b730-96b1d63265df tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:42.148427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a3fcdea-8c35-4ad6-b730-96b1d63265df tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:42.164847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a3fcdea-8c35-4ad6-b730-96b1d63265df tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:42.165581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a3fcdea-8c35-4ad6-b730-96b1d63265df tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:42.166396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a3fcdea-8c35-4ad6-b730-96b1d63265df tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:42.166842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a3fcdea-8c35-4ad6-b730-96b1d63265df tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:42.231396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:42.260138 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a3fcdea-8c35-4ad6-b730-96b1d63265df tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119014 May 19 04:52:42.260760 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2487/4870] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:42 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:42.276773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad7935df-b936-46b2-99eb-4de0df97031c tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:42.277544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ad7935df-b936-46b2-99eb-4de0df97031c tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:42.291827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad7935df-b936-46b2-99eb-4de0df97031c tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:42.292049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad7935df-b936-46b2-99eb-4de0df97031c tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:42.292803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad7935df-b936-46b2-99eb-4de0df97031c tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:42.293277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad7935df-b936-46b2-99eb-4de0df97031c tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:42.488623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-45f8537a-c642-47dd-8f2d-a5b3ff7bdebc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:42.499981 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-45f8537a-c642-47dd-8f2d-a5b3ff7bdebc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.525379 May 19 04:52:42.500604 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2384/4871] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:41 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:43.045015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c5aa512-c34f-44cd-b95b-747aa4212b7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:43.045843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c5aa512-c34f-44cd-b95b-747aa4212b7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:43.067641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c5aa512-c34f-44cd-b95b-747aa4212b7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:43.068440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c5aa512-c34f-44cd-b95b-747aa4212b7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:43.069496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c5aa512-c34f-44cd-b95b-747aa4212b7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:43.070749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c5aa512-c34f-44cd-b95b-747aa4212b7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:43.098742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ad7935df-b936-46b2-99eb-4de0df97031c tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900a0416a1245d09eddd97c329c9fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dabcb42b8fd408cbeddbac6b5c90ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:43.109491 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad7935df-b936-46b2-99eb-4de0df97031c tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 200 len: 1610 microversion: 2.1 time: 0.837994 May 19 04:52:43.125608 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2488/4872] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:42 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 1610 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:43.201114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e075c175-2b41-4fb9-8832-834969560742 req-6df0c150-e638-46f8-8d68-ce993307c90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87f7ed9-b42a-4cb5-9a13-935e4469527f", "name": "network-vif-deleted", "tag": "015489ba-74b3-4018-ac39-fe4f05102749"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:43.221976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e075c175-2b41-4fb9-8832-834969560742 req-6df0c150-e638-46f8-8d68-ce993307c90f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:43.229835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e075c175-2b41-4fb9-8832-834969560742 req-6df0c150-e638-46f8-8d68-ce993307c90f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:43.272838 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e075c175-2b41-4fb9-8832-834969560742 req-6df0c150-e638-46f8-8d68-ce993307c90f service nova] Creating event network-vif-deleted:015489ba-74b3-4018-ac39-fe4f05102749 for instance c87f7ed9-b42a-4cb5-9a13-935e4469527f on n-h2-766726-30 May 19 04:52:43.288985 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e075c175-2b41-4fb9-8832-834969560742 req-6df0c150-e638-46f8-8d68-ce993307c90f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091518 May 19 04:52:43.292676 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2489/4873] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:52:43.299088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-113aeaef-67b3-46e3-9c03-29b5834c5abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:43.318761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-113aeaef-67b3-46e3-9c03-29b5834c5abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:43.340803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-113aeaef-67b3-46e3-9c03-29b5834c5abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:43.341570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-113aeaef-67b3-46e3-9c03-29b5834c5abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:43.355374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-113aeaef-67b3-46e3-9c03-29b5834c5abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:43.356179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-113aeaef-67b3-46e3-9c03-29b5834c5abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:43.467217 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-113aeaef-67b3-46e3-9c03-29b5834c5abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.172914 May 19 04:52:43.468550 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2490/4874] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:43 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:43.521443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3631ca29-6821-4d4f-80ad-5b1ed09c38d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:43.522491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3631ca29-6821-4d4f-80ad-5b1ed09c38d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:43.536777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3631ca29-6821-4d4f-80ad-5b1ed09c38d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:43.537661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3631ca29-6821-4d4f-80ad-5b1ed09c38d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:43.538671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3631ca29-6821-4d4f-80ad-5b1ed09c38d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:43.539336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3631ca29-6821-4d4f-80ad-5b1ed09c38d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:44.440627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c5aa512-c34f-44cd-b95b-747aa4212b7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:44.449309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c5aa512-c34f-44cd-b95b-747aa4212b7f tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1487 microversion: 2.1 time: 1.409043 May 19 04:52:44.458131 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2385/4875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:43 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1487 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:44.481444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:44.482091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:44.528302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:44.528762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:44.529616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:44.530069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:44.604782 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] HTTP exception thrown: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Request method failure captured: May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f HTTP/1.1 May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcxlWoLW3nEC0CqgAymKMkh2kkuWpYK4pZo2sJfLVXKLXPLbqfOCQqd4zOq-El8xG6R0nY-u1obGDX02wX4eK-v1U_mf1WzGJa3lEnByhRJW3icPgHYXB4W9ZVbmXAdDSzFmNJQPcTCWy9Fmy_pqO2F8di3BpladFoFHLoXi8t95glE May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 4dabcb42b8fd408cbeddbac6b5c90ba5 May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-167774588 May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-167774588 May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 4dabcb42b8fd408cbeddbac6b5c90ba5 May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-167774588 May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachSCSIVolumeTestJSON-167774588-project May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 2900a0416a1245d09eddd97c329c9fca May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-167774588-project May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c87f7ed9-b42a-4cb5-9a13-935e4469527f'} May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:44.622230 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:44.627123 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:44.627123 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:44.627123 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:44.627123 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:44.627123 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:44.627123 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:52:44.627123 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:44.628490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Returning 404 to user: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:44.630017 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8ce4eb0d-352b-4e19-81d6-9cc0dee2186f tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 404 len: 111 microversion: 2.1 time: 0.170859 May 19 04:52:44.634788 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2386/4876] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:44 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:44.640464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6eb23741-ab94-4a4e-b897-a508dcbd2478 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1275982241"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:44.643080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6eb23741-ab94-4a4e-b897-a508dcbd2478 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:44.651461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6eb23741-ab94-4a4e-b897-a508dcbd2478 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:44.652182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6eb23741-ab94-4a4e-b897-a508dcbd2478 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:44.653410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6eb23741-ab94-4a4e-b897-a508dcbd2478 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:44.654736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6eb23741-ab94-4a4e-b897-a508dcbd2478 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:44.704868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3631ca29-6821-4d4f-80ad-5b1ed09c38d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:44.717386 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3631ca29-6821-4d4f-80ad-5b1ed09c38d7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 1.203445 May 19 04:52:44.731496 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2491/4877] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:43 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:44.754080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fee824e3-46ff-4154-aa63-1a44ff87226d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:44.755563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fee824e3-46ff-4154-aa63-1a44ff87226d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:44.760142 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6eb23741-ab94-4a4e-b897-a508dcbd2478 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "PUT /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1061 microversion: 2.1 time: 0.123933 May 19 04:52:44.760802 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2387/4878] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 04:52:44 2022] PUT /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1061 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:44.768880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4401a6df-e808-4e99-8e27-36ff4e7098e0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '.version_select at 0x7fd3144f84c0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:44.772944 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4401a6df-e808-4e99-8e27-36ff4e7098e0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [765f2573-29b7-4480-b1cc-2043da8f5bbb] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 04:52:44.778349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fee824e3-46ff-4154-aa63-1a44ff87226d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:44.780403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fee824e3-46ff-4154-aa63-1a44ff87226d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:44.783320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fee824e3-46ff-4154-aa63-1a44ff87226d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:44.785403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fee824e3-46ff-4154-aa63-1a44ff87226d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:44.974930 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fee824e3-46ff-4154-aa63-1a44ff87226d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.241955 May 19 04:52:44.977307 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2492/4879] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:44 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:44.986868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-828269e3-6701-4536-b48f-d05864e47384 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:44.987507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-828269e3-6701-4536-b48f-d05864e47384 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:44.996767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-828269e3-6701-4536-b48f-d05864e47384 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:44.996767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-828269e3-6701-4536-b48f-d05864e47384 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:44.997556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-828269e3-6701-4536-b48f-d05864e47384 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:44.997556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-828269e3-6701-4536-b48f-d05864e47384 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:45.374140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-828269e3-6701-4536-b48f-d05864e47384 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:45.385647 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-828269e3-6701-4536-b48f-d05864e47384 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1488 microversion: 2.1 time: 0.406271 May 19 04:52:45.386908 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2493/4880] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:44 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1488 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:45.422519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96066227-d708-4d94-b3eb-5a0231544416 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:45.425167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96066227-d708-4d94-b3eb-5a0231544416 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:45.468341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96066227-d708-4d94-b3eb-5a0231544416 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:45.469871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96066227-d708-4d94-b3eb-5a0231544416 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:45.475802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96066227-d708-4d94-b3eb-5a0231544416 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:45.480591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96066227-d708-4d94-b3eb-5a0231544416 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:45.784119 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [None req-4401a6df-e808-4e99-8e27-36ff4e7098e0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [765f2573-29b7-4480-b1cc-2043da8f5bbb] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49066. May 19 04:52:45.821635 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4401a6df-e808-4e99-8e27-36ff4e7098e0 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87607397" status: 202 len: 0 microversion: 2.1 time: 1.058103 May 19 04:52:45.822151 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2388/4881] 10.222.0.58 () {58 vars in 1214 bytes} [Thu May 19 04:52:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87607397 => generated 0 bytes in 1059 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:52:45.830452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e59dd992-e440-47a8-87c9-f861eba67a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:45.832550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e59dd992-e440-47a8-87c9-f861eba67a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:45.852066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e59dd992-e440-47a8-87c9-f861eba67a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:45.852560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e59dd992-e440-47a8-87c9-f861eba67a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:45.853438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e59dd992-e440-47a8-87c9-f861eba67a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:45.853896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e59dd992-e440-47a8-87c9-f861eba67a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:46.010146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-96066227-d708-4d94-b3eb-5a0231544416 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:46.028146 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96066227-d708-4d94-b3eb-5a0231544416 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1488 microversion: 2.1 time: 0.629375 May 19 04:52:46.039463 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2494/4882] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:45 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1488 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:46.044553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8479d3ec-9801-4c7a-b9ca-e90bc283cb96 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:46.045567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8479d3ec-9801-4c7a-b9ca-e90bc283cb96 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:46.076769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8479d3ec-9801-4c7a-b9ca-e90bc283cb96 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:46.077253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8479d3ec-9801-4c7a-b9ca-e90bc283cb96 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:46.078033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8479d3ec-9801-4c7a-b9ca-e90bc283cb96 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:46.078468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8479d3ec-9801-4c7a-b9ca-e90bc283cb96 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:46.187263 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8479d3ec-9801-4c7a-b9ca-e90bc283cb96 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146566 May 19 04:52:46.187878 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2495/4883] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:46 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:46.195981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-83110b66-aba3-4aa9-be0b-b11b6e4d095e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:46.196394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-83110b66-aba3-4aa9-be0b-b11b6e4d095e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:46.227895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83110b66-aba3-4aa9-be0b-b11b6e4d095e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:46.228352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83110b66-aba3-4aa9-be0b-b11b6e4d095e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:46.229170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83110b66-aba3-4aa9-be0b-b11b6e4d095e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:46.229620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83110b66-aba3-4aa9-be0b-b11b6e4d095e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:46.300159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-83110b66-aba3-4aa9-be0b-b11b6e4d095e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:52:46.467914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-83110b66-aba3-4aa9-be0b-b11b6e4d095e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 204 len: 0 microversion: 2.1 time: 0.275429 May 19 04:52:46.472440 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2496/4884] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:46 2022] DELETE /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:52:46.478341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bcf7f601-07d0-43d1-b063-68f27cc452ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:46.479050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bcf7f601-07d0-43d1-b063-68f27cc452ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:46.494608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcf7f601-07d0-43d1-b063-68f27cc452ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:46.495066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcf7f601-07d0-43d1-b063-68f27cc452ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:46.495858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcf7f601-07d0-43d1-b063-68f27cc452ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:46.496297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bcf7f601-07d0-43d1-b063-68f27cc452ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:46.591373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e59dd992-e440-47a8-87c9-f861eba67a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:46.612118 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e59dd992-e440-47a8-87c9-f861eba67a07 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.785586 May 19 04:52:46.615006 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2389/4885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:45 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:47.151527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bcf7f601-07d0-43d1-b063-68f27cc452ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:47.169973 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bcf7f601-07d0-43d1-b063-68f27cc452ee tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1494 microversion: 2.1 time: 0.695698 May 19 04:52:47.172179 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2497/4886] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:46 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1494 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:47.202493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c07ed6a-1744-40f0-ab00-20194347c200 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:47.205584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c07ed6a-1744-40f0-ab00-20194347c200 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:47.227372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c07ed6a-1744-40f0-ab00-20194347c200 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:47.232519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c07ed6a-1744-40f0-ab00-20194347c200 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:47.233815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c07ed6a-1744-40f0-ab00-20194347c200 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:47.234777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c07ed6a-1744-40f0-ab00-20194347c200 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:47.353602 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c07ed6a-1744-40f0-ab00-20194347c200 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152380 May 19 04:52:47.356024 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2390/4887] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:47 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:47.633298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ceae4c1-38fe-4d03-89c5-6f40396080ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:47.634292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8ceae4c1-38fe-4d03-89c5-6f40396080ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:47.647936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ceae4c1-38fe-4d03-89c5-6f40396080ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:47.648787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ceae4c1-38fe-4d03-89c5-6f40396080ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:47.652064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ceae4c1-38fe-4d03-89c5-6f40396080ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:47.652789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ceae4c1-38fe-4d03-89c5-6f40396080ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:48.196103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b81b108-366d-4469-b776-f041f57a1d72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:48.197350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b81b108-366d-4469-b776-f041f57a1d72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:48.211218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b81b108-366d-4469-b776-f041f57a1d72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:48.215866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b81b108-366d-4469-b776-f041f57a1d72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:48.217107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b81b108-366d-4469-b776-f041f57a1d72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:48.220720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b81b108-366d-4469-b776-f041f57a1d72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:48.281005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8ceae4c1-38fe-4d03-89c5-6f40396080ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:48.295962 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ceae4c1-38fe-4d03-89c5-6f40396080ba tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.667962 May 19 04:52:48.301794 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2498/4888] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:47 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:48.367462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca3702fa-0376-40d3-9b1c-d6d796310be1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:48.368597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca3702fa-0376-40d3-9b1c-d6d796310be1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:48.394956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca3702fa-0376-40d3-9b1c-d6d796310be1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:48.395413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca3702fa-0376-40d3-9b1c-d6d796310be1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:48.398836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca3702fa-0376-40d3-9b1c-d6d796310be1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:48.399296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca3702fa-0376-40d3-9b1c-d6d796310be1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:48.505849 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ca3702fa-0376-40d3-9b1c-d6d796310be1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.142766 May 19 04:52:48.521612 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2499/4889] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:48 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:49.319359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db58b013-7e3c-42c8-8493-92e85f4ce64a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:49.320051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-db58b013-7e3c-42c8-8493-92e85f4ce64a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:49.345020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db58b013-7e3c-42c8-8493-92e85f4ce64a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:49.345502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db58b013-7e3c-42c8-8493-92e85f4ce64a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:49.346293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db58b013-7e3c-42c8-8493-92e85f4ce64a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:49.346733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db58b013-7e3c-42c8-8493-92e85f4ce64a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:50.009450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b81b108-366d-4469-b776-f041f57a1d72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:50.027443 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b81b108-366d-4469-b776-f041f57a1d72 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1494 microversion: 2.1 time: 1.840457 May 19 04:52:50.037562 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2391/4890] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:48 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1494 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:50.052232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7047270-adc6-4105-bd28-6550c6daa88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:50.053252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7047270-adc6-4105-bd28-6550c6daa88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:50.069032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7047270-adc6-4105-bd28-6550c6daa88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:50.083210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7047270-adc6-4105-bd28-6550c6daa88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:50.089894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7047270-adc6-4105-bd28-6550c6daa88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:50.090375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7047270-adc6-4105-bd28-6550c6daa88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:50.221538 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7047270-adc6-4105-bd28-6550c6daa88c tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.182592 May 19 04:52:50.228239 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2392/4891] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:50 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:50.538923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-db58b013-7e3c-42c8-8493-92e85f4ce64a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:50.557636 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-db58b013-7e3c-42c8-8493-92e85f4ce64a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 1.242105 May 19 04:52:50.575752 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2500/4892] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:49 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:51.056297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59d9efc8-132e-4559-bd3e-9752eddd0bd6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:51.058434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-59d9efc8-132e-4559-bd3e-9752eddd0bd6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:51.089006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59d9efc8-132e-4559-bd3e-9752eddd0bd6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:51.095924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59d9efc8-132e-4559-bd3e-9752eddd0bd6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:51.101059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59d9efc8-132e-4559-bd3e-9752eddd0bd6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:51.103288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59d9efc8-132e-4559-bd3e-9752eddd0bd6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:51.238009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-13ec625c-32fd-4cb6-bf81-3dfbb16c0c50 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:51.239127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-13ec625c-32fd-4cb6-bf81-3dfbb16c0c50 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:51.251738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13ec625c-32fd-4cb6-bf81-3dfbb16c0c50 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:51.252199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13ec625c-32fd-4cb6-bf81-3dfbb16c0c50 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:51.253004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13ec625c-32fd-4cb6-bf81-3dfbb16c0c50 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:51.253481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13ec625c-32fd-4cb6-bf81-3dfbb16c0c50 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:51.408704 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-13ec625c-32fd-4cb6-bf81-3dfbb16c0c50 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.169836 May 19 04:52:51.411640 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2501/4893] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:51 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 04:52:51.533556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a7ac0c0c-7948-475c-998b-9e2052eab17a req-aae83c3f-ad47-41c5-86e0-9a248fae190e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c23cbb-b744-4110-bd02-c6d2be32230d", "name": "network-vif-unplugged", "status": "completed", "tag": "f8ed2080-9b38-45c6-9d8a-687fbf9d9514"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:51.556891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a7ac0c0c-7948-475c-998b-9e2052eab17a req-aae83c3f-ad47-41c5-86e0-9a248fae190e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:51.560443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a7ac0c0c-7948-475c-998b-9e2052eab17a req-aae83c3f-ad47-41c5-86e0-9a248fae190e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:51.616267 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a7ac0c0c-7948-475c-998b-9e2052eab17a req-aae83c3f-ad47-41c5-86e0-9a248fae190e service nova] Creating event network-vif-unplugged:f8ed2080-9b38-45c6-9d8a-687fbf9d9514 for instance 12c23cbb-b744-4110-bd02-c6d2be32230d on n-h1-766726-30 May 19 04:52:51.637355 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a7ac0c0c-7948-475c-998b-9e2052eab17a req-aae83c3f-ad47-41c5-86e0-9a248fae190e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106018 May 19 04:52:51.637355 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2502/4894] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:52:51.650037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1dad6188-242a-4e76-84e5-d71440b1aebb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:51.651726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1dad6188-242a-4e76-84e5-d71440b1aebb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:51.703599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1dad6188-242a-4e76-84e5-d71440b1aebb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:51.713539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1dad6188-242a-4e76-84e5-d71440b1aebb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:51.713539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1dad6188-242a-4e76-84e5-d71440b1aebb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:51.713539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1dad6188-242a-4e76-84e5-d71440b1aebb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:52.066988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-59d9efc8-132e-4559-bd3e-9752eddd0bd6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:52.090635 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59d9efc8-132e-4559-bd3e-9752eddd0bd6 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1494 microversion: 2.1 time: 1.034498 May 19 04:52:52.094958 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2393/4895] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:51 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1494 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:52.421214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7e26c4e-e729-4b74-9b79-6a804858219e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:52.424447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e7e26c4e-e729-4b74-9b79-6a804858219e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:52.459305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e26c4e-e729-4b74-9b79-6a804858219e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:52.470302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e26c4e-e729-4b74-9b79-6a804858219e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:52.471423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e26c4e-e729-4b74-9b79-6a804858219e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:52.474082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e26c4e-e729-4b74-9b79-6a804858219e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:52.617260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1dad6188-242a-4e76-84e5-d71440b1aebb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:52.634169 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1dad6188-242a-4e76-84e5-d71440b1aebb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.998839 May 19 04:52:52.639366 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2503/4896] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:51 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:52.668611 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7e26c4e-e729-4b74-9b79-6a804858219e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.251645 May 19 04:52:52.676831 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2394/4897] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:52 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:52.688780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5bb8e2c7-b2b6-47bc-a92f-4148280b7db2 req-3acebb94-d616-439e-8674-90896295e244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c23cbb-b744-4110-bd02-c6d2be32230d", "name": "network-vif-deleted", "tag": "f8ed2080-9b38-45c6-9d8a-687fbf9d9514"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:52:52.714007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5bb8e2c7-b2b6-47bc-a92f-4148280b7db2 req-3acebb94-d616-439e-8674-90896295e244 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:52.714763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5bb8e2c7-b2b6-47bc-a92f-4148280b7db2 req-3acebb94-d616-439e-8674-90896295e244 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:52.740933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:52.746735 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5bb8e2c7-b2b6-47bc-a92f-4148280b7db2 req-3acebb94-d616-439e-8674-90896295e244 service nova] Creating event network-vif-deleted:f8ed2080-9b38-45c6-9d8a-687fbf9d9514 for instance 12c23cbb-b744-4110-bd02-c6d2be32230d on n-h1-766726-30 May 19 04:52:52.758671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5bb8e2c7-b2b6-47bc-a92f-4148280b7db2 req-3acebb94-d616-439e-8674-90896295e244 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072128 May 19 04:52:52.760534 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2504/4898] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:52:53.113105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:53.114865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:53.129728 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:53.130493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:53.133405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:53.141891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:53.221625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:53.223345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:53.226721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lazy-loading 'fault' on Instance uuid 12c23cbb-b744-4110-bd02-c6d2be32230d {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:52:53.343565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:53.359404 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4be9ce40-09da-46c7-9945-fef0acbd067e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 200 len: 1310 microversion: 2.1 time: 0.251459 May 19 04:52:53.360539 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2395/4899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:53 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 1310 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:53.657090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8a869501-422c-41df-a30d-532b45d332dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:53.657857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8a869501-422c-41df-a30d-532b45d332dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:53.686243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70687721-e5b2-40bb-84e7-e7eb6adcae92 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:53.687633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-70687721-e5b2-40bb-84e7-e7eb6adcae92 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:53.694810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a869501-422c-41df-a30d-532b45d332dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:53.695254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a869501-422c-41df-a30d-532b45d332dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:53.696056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a869501-422c-41df-a30d-532b45d332dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:53.696488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a869501-422c-41df-a30d-532b45d332dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:53.698129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70687721-e5b2-40bb-84e7-e7eb6adcae92 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:53.698926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70687721-e5b2-40bb-84e7-e7eb6adcae92 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:53.700035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70687721-e5b2-40bb-84e7-e7eb6adcae92 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:53.700702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70687721-e5b2-40bb-84e7-e7eb6adcae92 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:53.754309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-70687721-e5b2-40bb-84e7-e7eb6adcae92 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074270 May 19 04:52:53.756191 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2396/4900] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:53 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:53.953765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8a869501-422c-41df-a30d-532b45d332dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:53.962057 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8a869501-422c-41df-a30d-532b45d332dd tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.309993 May 19 04:52:53.976072 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2505/4901] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:53 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:54.379803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:54.380484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:54.397856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.398330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.404466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.405191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.458074 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d HTTP/1.1 May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '12c23cbb-b744-4110-bd02-c6d2be32230d'} May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.459659 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.463467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:54.463467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:54.463467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:54.463467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:54.463467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.463467 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.463467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:54.463467 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-12d6af8f-9a05-49b2-8bdb-629145bd1d7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 404 len: 111 microversion: 2.1 time: 0.085723 May 19 04:52:54.470041 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2397/4902] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:54 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:52:54.488796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:54.489349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:54.514148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.514617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.515412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.515857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.596959 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d HTTP/1.1 May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '12c23cbb-b744-4110-bd02-c6d2be32230d'} May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:54.604009 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.607581 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.614705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:54.616853 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cbe042cc-9992-43bb-bcf7-c30bd4af2eba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 404 len: 111 microversion: 2.1 time: 0.133590 May 19 04:52:54.623402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2506/4903] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:54 2022] DELETE /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:54.630614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:54.632150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 12c23cbb-b744-4110-bd02-c6d2be32230d] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:54.657395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.658487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.659819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.660567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.732234 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d HTTP/1.1 May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '12c23cbb-b744-4110-bd02-c6d2be32230d'} May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.737510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.743611 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:54.743611 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:54.743611 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:54.743611 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:54.743611 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. May 19 04:52:54.743611 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:54.749457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 12c23cbb-b744-4110-bd02-c6d2be32230d could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:54.753328 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5fe6fe81-8ba9-4881-ad0b-e1de0594d1b4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d" status: 404 len: 111 microversion: 2.1 time: 0.127290 May 19 04:52:54.757916 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2398/4904] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:54 2022] GET /compute/v2.1/servers/12c23cbb-b744-4110-bd02-c6d2be32230d => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:54.768874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:54.769555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:54.773066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-945938fc-f466-4ee3-84c8-4eda49bd5f98 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:54.774453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-945938fc-f466-4ee3-84c8-4eda49bd5f98 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:54.801614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-945938fc-f466-4ee3-84c8-4eda49bd5f98 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.804199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-945938fc-f466-4ee3-84c8-4eda49bd5f98 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.807605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-945938fc-f466-4ee3-84c8-4eda49bd5f98 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.809961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-945938fc-f466-4ee3-84c8-4eda49bd5f98 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.822113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.826509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.827394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:54.832828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:54.905644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:54.936382 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-945938fc-f466-4ee3-84c8-4eda49bd5f98 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.168724 May 19 04:52:54.937347 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2399/4905] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:54 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:52:54.950260 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 HTTP/1.1 May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c7ad340e-7fc0-43e0-8a45-8227ae528225'} May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:54.960643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:54.964214 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:54.976134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:54.982877 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ca289e7c-122e-435e-a027-394b4d7cc38a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 404 len: 111 microversion: 2.1 time: 0.219739 May 19 04:52:54.984009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-272fa974-dbab-4cd3-b12d-309d61c92e90 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:54.984836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-272fa974-dbab-4cd3-b12d-309d61c92e90 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:54.995590 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2507/4906] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:54 2022] DELETE /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:54.999733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-272fa974-dbab-4cd3-b12d-309d61c92e90 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.000217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-272fa974-dbab-4cd3-b12d-309d61c92e90 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.003926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-272fa974-dbab-4cd3-b12d-309d61c92e90 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.005007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-272fa974-dbab-4cd3-b12d-309d61c92e90 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.035358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.037531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: c7ad340e-7fc0-43e0-8a45-8227ae528225] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.072647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.073126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.073924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.074364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.140743 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 HTTP/1.1 May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c7ad340e-7fc0-43e0-8a45-8227ae528225'} May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.148008 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.152187 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.152187 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.152187 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:55.152187 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:55.152187 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. May 19 04:52:55.152187 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.153319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance c7ad340e-7fc0-43e0-8a45-8227ae528225 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:55.156850 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-445a6a0e-11e3-4f50-a7d9-d89b0bea61ba tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225" status: 404 len: 111 microversion: 2.1 time: 0.157276 May 19 04:52:55.161070 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2508/4907] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:54 2022] GET /compute/v2.1/servers/c7ad340e-7fc0-43e0-8a45-8227ae528225 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:55.175108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.179341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.202936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.205683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.210353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.210976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.246290 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a HTTP/1.1 May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '1a2ed4d7-0433-49e0-9b9a-8b69892c352a'} May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:55.248222 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.252284 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.256301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:55.257508 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1757cfe3-e6dd-44d9-b5d4-6a94b56dd65e tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 404 len: 111 microversion: 2.1 time: 0.092474 May 19 04:52:55.261872 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2509/4908] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:55 2022] DELETE /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:55.272246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.274545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 1a2ed4d7-0433-49e0-9b9a-8b69892c352a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.289765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.294369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.295569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.298254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.343539 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a HTTP/1.1 May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '1a2ed4d7-0433-49e0-9b9a-8b69892c352a'} May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.356659 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.360801 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.360801 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.360801 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:55.360801 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:55.360801 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. May 19 04:52:55.360801 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.375409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-272fa974-dbab-4cd3-b12d-309d61c92e90 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:55.376500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 1a2ed4d7-0433-49e0-9b9a-8b69892c352a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:55.377686 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-51f621f1-2330-4714-90b4-f6cbcb2e4a7d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a" status: 404 len: 111 microversion: 2.1 time: 0.112025 May 19 04:52:55.384681 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2510/4909] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:55 2022] GET /compute/v2.1/servers/1a2ed4d7-0433-49e0-9b9a-8b69892c352a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:52:55.399954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.404074 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-272fa974-dbab-4cd3-b12d-309d61c92e90 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.424330 May 19 04:52:55.408879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.418822 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2400/4910] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:54 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:55.439662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.440494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.441605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.454407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.521263 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 HTTP/1.1 May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '13fda296-1b39-442f-9602-e20099131e85'} May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:55.531092 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.535299 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.538393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:55.539875 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9526c0b1-fe95-42c4-9499-bb89f8df065a tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 404 len: 111 microversion: 2.1 time: 0.152622 May 19 04:52:55.549889 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2511/4911] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:55 2022] DELETE /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:55.557855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.561932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 13fda296-1b39-442f-9602-e20099131e85] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.572235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.573667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.574986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.575645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.614325 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 HTTP/1.1 May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '13fda296-1b39-442f-9602-e20099131e85'} May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.623566 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.628333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.628333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.628333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:55.628333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:55.628333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. May 19 04:52:55.628333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.633436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 13fda296-1b39-442f-9602-e20099131e85 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:55.636428 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3db6623-b298-4d13-951c-791ea2ba2694 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85" status: 404 len: 111 microversion: 2.1 time: 0.081271 May 19 04:52:55.639319 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2401/4912] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:55 2022] GET /compute/v2.1/servers/13fda296-1b39-442f-9602-e20099131e85 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:55.649336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.650222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.660221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.660678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.661505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.661944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.720250 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 HTTP/1.1 May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'db67f870-0190-4caa-b75c-b46d68452a48'} May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:55.721896 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c1655bf-9998-4008-9d49-66fa9209cd8d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 404 len: 111 microversion: 2.1 time: 0.080281 May 19 04:52:55.727546 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2512/4913] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:55 2022] DELETE /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:55.734024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.734559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: db67f870-0190-4caa-b75c-b46d68452a48] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.749303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.749754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.752328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.752770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.810543 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 HTTP/1.1 May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'db67f870-0190-4caa-b75c-b46d68452a48'} May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.812127 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.818457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.818457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.818457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:55.818457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:55.818457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. May 19 04:52:55.818457 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.818457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance db67f870-0190-4caa-b75c-b46d68452a48 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:55.818457 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-292e27dd-b64a-4d4c-8caa-9fefeeaa8491 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48" status: 404 len: 111 microversion: 2.1 time: 0.085458 May 19 04:52:55.825970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.827099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.829470 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2402/4914] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:55 2022] GET /compute/v2.1/servers/db67f870-0190-4caa-b75c-b46d68452a48 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:55.837748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.838535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.839790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.841721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.864890 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 HTTP/1.1 May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '5f1f1aff-9f46-4298-b952-fe6295c42f17'} May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:55.867390 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.871613 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:52:55.874802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:55.876437 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9b5d21fa-be2d-4cbe-9701-b2de3e28c1e9 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 404 len: 111 microversion: 2.1 time: 0.055032 May 19 04:52:55.877654 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2513/4915] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:55 2022] DELETE /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:55.885662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.886278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 5f1f1aff-9f46-4298-b952-fe6295c42f17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.900735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.901228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.902136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.902574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.948351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-275b42fe-cd21-4cc7-b5e9-e30574872ea7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.949322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-275b42fe-cd21-4cc7-b5e9-e30574872ea7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:55.963644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-275b42fe-cd21-4cc7-b5e9-e30574872ea7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.977673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-275b42fe-cd21-4cc7-b5e9-e30574872ea7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.977673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-275b42fe-cd21-4cc7-b5e9-e30574872ea7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:55.977673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-275b42fe-cd21-4cc7-b5e9-e30574872ea7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 HTTP/1.1 May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '5f1f1aff-9f46-4298-b952-fe6295c42f17'} May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:55.977948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 5f1f1aff-9f46-4298-b952-fe6295c42f17 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:55.984483 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9f588cc9-da17-4a7d-9a62-3bd82da1e92d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17" status: 404 len: 111 microversion: 2.1 time: 0.097552 May 19 04:52:55.992513 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2403/4916] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:55 2022] GET /compute/v2.1/servers/5f1f1aff-9f46-4298-b952-fe6295c42f17 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:55.997491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a522638a-7304-4cf4-9494-041ed654ecfa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:55.997991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a522638a-7304-4cf4-9494-041ed654ecfa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 0926a84c-907d-415f-af1d-ae2ac52f6778] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:56.037543 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-a522638a-7304-4cf4-9494-041ed654ecfa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a522638a-7304-4cf4-9494-041ed654ecfa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778 HTTP/1.1 May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '0926a84c-907d-415f-af1d-ae2ac52f6778'} May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:56.040503 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.046320 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:56.046320 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:56.046320 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:56.046320 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:56.046320 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:56.046320 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.046320 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.048375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a522638a-7304-4cf4-9494-041ed654ecfa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:56.049949 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a522638a-7304-4cf4-9494-041ed654ecfa tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778" status: 404 len: 111 microversion: 2.1 time: 0.056358 May 19 04:52:56.051215 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2404/4917] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:55 2022] DELETE /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:56.072845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b1670115-e0d9-4af6-a2a4-362e3d1f0c60 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:56.073988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b1670115-e0d9-4af6-a2a4-362e3d1f0c60 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 0926a84c-907d-415f-af1d-ae2ac52f6778] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:56.083139 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b1670115-e0d9-4af6-a2a4-362e3d1f0c60 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.087381 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-275b42fe-cd21-4cc7-b5e9-e30574872ea7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.143072 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b1670115-e0d9-4af6-a2a4-362e3d1f0c60 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778 HTTP/1.1 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '0926a84c-907d-415f-af1d-ae2ac52f6778'} May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:52:56.087912 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:52:56.093933 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:52:56.093933 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:52:56.093933 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. May 19 04:52:56.093933 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:52:56.097028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b1670115-e0d9-4af6-a2a4-362e3d1f0c60 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 0926a84c-907d-415f-af1d-ae2ac52f6778 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:52:56.098232 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b1670115-e0d9-4af6-a2a4-362e3d1f0c60 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778" status: 404 len: 111 microversion: 2.1 time: 0.042998 May 19 04:52:56.098847 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2514/4918] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:52:55 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:52:56.103446 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2405/4919] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:56 2022] GET /compute/v2.1/servers/0926a84c-907d-415f-af1d-ae2ac52f6778 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:52:56.108095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba5d9a4b-4ede-4957-8166-a7e5c8d16403 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:56.121915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba5d9a4b-4ede-4957-8166-a7e5c8d16403 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:56.147434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba5d9a4b-4ede-4957-8166-a7e5c8d16403 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:56.147434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba5d9a4b-4ede-4957-8166-a7e5c8d16403 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:56.147434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba5d9a4b-4ede-4957-8166-a7e5c8d16403 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:56.147434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba5d9a4b-4ede-4957-8166-a7e5c8d16403 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:56.227318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a6f5976b-e38e-4223-8704-dda2016d050f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:56.228050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a6f5976b-e38e-4223-8704-dda2016d050f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:56.248028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6f5976b-e38e-4223-8704-dda2016d050f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:56.248739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6f5976b-e38e-4223-8704-dda2016d050f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:56.253015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6f5976b-e38e-4223-8704-dda2016d050f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:56.253654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6f5976b-e38e-4223-8704-dda2016d050f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:56.258270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba5d9a4b-4ede-4957-8166-a7e5c8d16403 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:52:56.362242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a6f5976b-e38e-4223-8704-dda2016d050f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:52:56.493519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:52:56.539086 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba5d9a4b-4ede-4957-8166-a7e5c8d16403 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 204 len: 0 microversion: 2.1 time: 0.432829 May 19 04:52:56.541719 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2515/4920] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:52:56 2022] DELETE /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:52:56.553420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-26434e9b-6f27-415e-806a-2f0f63c8c50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:56.556236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-26434e9b-6f27-415e-806a-2f0f63c8c50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:56.578364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26434e9b-6f27-415e-806a-2f0f63c8c50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:56.589401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26434e9b-6f27-415e-806a-2f0f63c8c50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:56.590390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26434e9b-6f27-415e-806a-2f0f63c8c50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:56.592380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26434e9b-6f27-415e-806a-2f0f63c8c50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:56.665550 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a6f5976b-e38e-4223-8704-dda2016d050f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "DELETE /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 204 len: 0 microversion: 2.20 time: 0.442728 May 19 04:52:56.666702 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2406/4921] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:52:56 2022] DELETE /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:52:56.680893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90718eff-065f-4eb8-93fb-f3cb5223e5e4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:56.684142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-90718eff-065f-4eb8-93fb-f3cb5223e5e4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:56.712785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90718eff-065f-4eb8-93fb-f3cb5223e5e4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:56.713225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90718eff-065f-4eb8-93fb-f3cb5223e5e4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:56.714035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90718eff-065f-4eb8-93fb-f3cb5223e5e4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:56.714731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90718eff-065f-4eb8-93fb-f3cb5223e5e4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:57.135184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-26434e9b-6f27-415e-806a-2f0f63c8c50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:57.152679 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-26434e9b-6f27-415e-806a-2f0f63c8c50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.602762 May 19 04:52:57.153593 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2516/4922] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:56 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:57.178055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:57.178689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:57.209036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:57.209551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:57.212159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:57.228460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:57.393495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-90718eff-065f-4eb8-93fb-f3cb5223e5e4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:57.409576 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-90718eff-065f-4eb8-93fb-f3cb5223e5e4 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1480 microversion: 2.1 time: 0.741443 May 19 04:52:57.415622 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2407/4923] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:56 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1480 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:57.530308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:57.540067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:57.541617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:57.542826 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a63641a8-c3f9-4dac-8314-3c68a31244d2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1723 microversion: 2.20 time: 0.377025 May 19 04:52:57.543914 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2517/4924] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:52:57 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:52:58.174566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f14b9f3b-8308-456f-acb0-fab004521f7e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:58.175387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f14b9f3b-8308-456f-acb0-fab004521f7e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:58.193435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f14b9f3b-8308-456f-acb0-fab004521f7e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:58.194018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f14b9f3b-8308-456f-acb0-fab004521f7e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:58.194978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f14b9f3b-8308-456f-acb0-fab004521f7e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:58.195539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f14b9f3b-8308-456f-acb0-fab004521f7e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:58.433299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0c73e91b-90f8-4dd7-9050-0f5ef76c8895 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:58.435701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0c73e91b-90f8-4dd7-9050-0f5ef76c8895 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:58.463556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c73e91b-90f8-4dd7-9050-0f5ef76c8895 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:58.464013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c73e91b-90f8-4dd7-9050-0f5ef76c8895 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:58.464799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c73e91b-90f8-4dd7-9050-0f5ef76c8895 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:58.465267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c73e91b-90f8-4dd7-9050-0f5ef76c8895 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:58.999245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f14b9f3b-8308-456f-acb0-fab004521f7e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:52:59.021621 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f14b9f3b-8308-456f-acb0-fab004521f7e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.854756 May 19 04:52:59.022216 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2408/4925] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:58 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:52:59.036768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:52:59.037658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:52:59.050147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:59.056201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:52:59.057353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:52:59.057973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:00.214041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:00.237565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:00.239723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:00.241231 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9b4ee7e-7383-4fc5-b592-f9eed7840215 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1723 microversion: 2.20 time: 1.208297 May 19 04:53:00.254150 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2409/4926] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:52:59 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1723 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:00.264725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-05a64add-119e-40ae-aef5-03fd9b6f91b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:00.273121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-05a64add-119e-40ae-aef5-03fd9b6f91b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:00.292730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05a64add-119e-40ae-aef5-03fd9b6f91b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:00.293568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05a64add-119e-40ae-aef5-03fd9b6f91b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:00.294902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05a64add-119e-40ae-aef5-03fd9b6f91b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:00.295589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05a64add-119e-40ae-aef5-03fd9b6f91b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:00.352782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0c73e91b-90f8-4dd7-9050-0f5ef76c8895 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:00.370067 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0c73e91b-90f8-4dd7-9050-0f5ef76c8895 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1480 microversion: 2.1 time: 1.943680 May 19 04:53:00.370684 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2518/4927] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:52:58 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1480 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:00.848989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-cc7ff559-7333-4b7d-a8b6-b08180e29455 req-a2e4e423-b03c-4bde-8e7b-b1f1263424c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b5a7a27-6877-43f8-ba74-86a11b5716d9", "name": "network-vif-deleted", "tag": "f9cb6a4c-03c3-4e21-87b1-a1be46107fe4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:00.901466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-cc7ff559-7333-4b7d-a8b6-b08180e29455 req-a2e4e423-b03c-4bde-8e7b-b1f1263424c5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:00.901466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-cc7ff559-7333-4b7d-a8b6-b08180e29455 req-a2e4e423-b03c-4bde-8e7b-b1f1263424c5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:00.901466 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-cc7ff559-7333-4b7d-a8b6-b08180e29455 req-a2e4e423-b03c-4bde-8e7b-b1f1263424c5 service nova] Creating event network-vif-deleted:f9cb6a4c-03c3-4e21-87b1-a1be46107fe4 for instance 9b5a7a27-6877-43f8-ba74-86a11b5716d9 on n-h2-766726-30 May 19 04:53:00.901466 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-cc7ff559-7333-4b7d-a8b6-b08180e29455 req-a2e4e423-b03c-4bde-8e7b-b1f1263424c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063720 May 19 04:53:00.902410 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2519/4928] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:53:01.153664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-05a64add-119e-40ae-aef5-03fd9b6f91b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:01.194573 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-05a64add-119e-40ae-aef5-03fd9b6f91b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 0.938866 May 19 04:53:01.201067 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2410/4929] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:00 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:01.264314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:01.265660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:01.283590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:01.284277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:01.285276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:01.290079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:01.388132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:01.390121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:01.402225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:01.404923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:01.408905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:01.409742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:01.504112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:01.506285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:01.507928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lazy-loading 'fault' on Instance uuid 9b5a7a27-6877-43f8-ba74-86a11b5716d9 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:53:01.948890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a75cb8e84f674ef0814a39d2a4887933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e70c9ce9d477e860a2ba10d8b993a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:01.956688 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be649215-09da-4814-a605-e5fc1492cb03 tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 200 len: 1283 microversion: 2.1 time: 0.573128 May 19 04:53:01.960872 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2411/4930] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:01 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 1283 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:02.218734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c4e6a7ff-0bf1-4334-b485-d01bef659a39 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:02.219611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c4e6a7ff-0bf1-4334-b485-d01bef659a39 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:02.235855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4e6a7ff-0bf1-4334-b485-d01bef659a39 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:02.239133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4e6a7ff-0bf1-4334-b485-d01bef659a39 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:02.240833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4e6a7ff-0bf1-4334-b485-d01bef659a39 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:02.241798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4e6a7ff-0bf1-4334-b485-d01bef659a39 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:02.912429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:02.940176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:02.941966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:02.943925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b5a267ca-dd97-4c55-b82e-5351eef86c9b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1723 microversion: 2.20 time: 1.683369 May 19 04:53:02.956236 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2520/4931] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:01 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1723 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:02.976965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:02.977895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] [instance: 9b5a7a27-6877-43f8-ba74-86a11b5716d9] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:02.990698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:02.991435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:02.992385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:02.992973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:03.053055 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] HTTP exception thrown: Instance 9b5a7a27-6877-43f8-ba74-86a11b5716d9 could not be found. May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Request method failure captured: May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 HTTP/1.1 May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcw8PjzrhLxFCb1fTQNmihW5_UCBb75FPZ0xDn0SfmBYrj_U6HqAKpLmTKudNtUqM-bXg9SmZgN487--ROlCqQhoJag7EPiRiN7pzWDXvNfdyqbqNvN5dG9MnkWIFEwfwZGbQHCq6PqZW6Q7XypGx0whatOh5S76yA0BF7728NUj0r8 May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersTestJSON-1800557639 May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_360e70c9ce9d477e860a2ba10d8b993a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersTestJSON-1800557639 May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 360e70c9ce9d477e860a2ba10d8b993a May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersTestJSON-1800557639 May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersTestJSON-1800557639-project May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: a75cb8e84f674ef0814a39d2a4887933 May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersTestJSON-1800557639-project May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 9b5a7a27-6877-43f8-ba74-86a11b5716d9 could not be found. May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '9b5a7a27-6877-43f8-ba74-86a11b5716d9'} May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b5a7a27-6877-43f8-ba74-86a11b5716d9 could not be found. May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b5a7a27-6877-43f8-ba74-86a11b5716d9 could not be found. May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:03.055063 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:03.059049 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:03.059049 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:03.059049 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:53:03.059049 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:53:03.059049 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b5a7a27-6877-43f8-ba74-86a11b5716d9 could not be found. May 19 04:53:03.059049 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:03.062434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] Returning 404 to user: Instance 9b5a7a27-6877-43f8-ba74-86a11b5716d9 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:53:03.063591 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7c48677-fb28-4fe6-9a34-ba4d5accd08d tempest-ServersTestJSON-1800557639 tempest-ServersTestJSON-1800557639-project] 10.222.0.58 "GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9" status: 404 len: 111 microversion: 2.1 time: 0.091326 May 19 04:53:03.064701 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2521/4932] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:02 2022] GET /compute/v2.1/servers/9b5a7a27-6877-43f8-ba74-86a11b5716d9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:53:03.574939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c4e6a7ff-0bf1-4334-b485-d01bef659a39 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:03.590435 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c4e6a7ff-0bf1-4334-b485-d01bef659a39 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 1.374319 May 19 04:53:03.601593 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2412/4933] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:02 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:03.778077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-321d77be-29b7-482f-b0a6-d4cb040f0cd1 req-590b0593-2a91-404b-9f19-6529497de272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894769ad-4295-4aff-8ba0-30957e6ec8da", "name": "network-vif-deleted", "tag": "738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:03.799783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-321d77be-29b7-482f-b0a6-d4cb040f0cd1 req-590b0593-2a91-404b-9f19-6529497de272 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:03.809755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-321d77be-29b7-482f-b0a6-d4cb040f0cd1 req-590b0593-2a91-404b-9f19-6529497de272 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:03.827881 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-321d77be-29b7-482f-b0a6-d4cb040f0cd1 req-590b0593-2a91-404b-9f19-6529497de272 service nova] Creating event network-vif-deleted:738ddc07-5ec1-4aee-98b4-1c7b2a41b2a4 for instance 894769ad-4295-4aff-8ba0-30957e6ec8da on n-h1-766726-30 May 19 04:53:03.868868 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-321d77be-29b7-482f-b0a6-d4cb040f0cd1 req-590b0593-2a91-404b-9f19-6529497de272 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074334 May 19 04:53:03.869809 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2522/4934] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:53:03.964469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:03.966909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:03.978061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:03.982920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:03.984062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:03.986077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:03.987627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:04.062942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:04.063810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:04.066442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lazy-loading 'fault' on Instance uuid 894769ad-4295-4aff-8ba0-30957e6ec8da {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:53:04.149282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:04.165929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:04.172821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:04.178493 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-388f9381-8dec-485e-92db-fe46ea043921 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 200 len: 1370 microversion: 2.20 time: 0.217995 May 19 04:53:04.190651 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2413/4935] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:03 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:04.615207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0eef9e90-fc61-464d-8d1d-986734b92468 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:04.616293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0eef9e90-fc61-464d-8d1d-986734b92468 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:04.630128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0eef9e90-fc61-464d-8d1d-986734b92468 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:04.637284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0eef9e90-fc61-464d-8d1d-986734b92468 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:04.640056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0eef9e90-fc61-464d-8d1d-986734b92468 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:04.641180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0eef9e90-fc61-464d-8d1d-986734b92468 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:04.931283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0eef9e90-fc61-464d-8d1d-986734b92468 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:04.942567 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0eef9e90-fc61-464d-8d1d-986734b92468 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1506 microversion: 2.1 time: 0.331964 May 19 04:53:04.943422 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2523/4936] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:04 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:05.197149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:05.198429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:05.209959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:05.211703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:05.213709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:05.219208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:05.252691 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] HTTP exception thrown: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Request method failure captured: May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da HTTP/1.1 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwxaTv3uc4FXmEuIc304YX_0FKsW028TuyIRC3wdWPeTx0pP8Wl0476NGuLeS_gt_qr1T0hSPZouayZnmXdSkEwfeUmqY-l8HmdKRAoxpU_GBqHTBZoeUDdJdl7Y__pQcw_woOzSqRFmjIzVO53SdaXkHo37gNjPN19t2L8jmYfn6U May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.20 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 69228739a9134460960e474b3ef7bebf May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '894769ad-4295-4aff-8ba0-30957e6ec8da'} May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:05.257259 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:05.261599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:05.261599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:05.261599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:05.261599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:05.261599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:53:05.261599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:53:05.261599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:53:05.261599 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:05.263424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Returning 404 to user: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:53:05.266034 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-78c16b74-c098-4bc8-ba78-f6095175d534 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 404 len: 111 microversion: 2.20 time: 0.072968 May 19 04:53:05.267577 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2414/4937] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:05 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:53:05.276234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f68b0e1a-b0b1-470f-be8e-4b230b709091 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '.version_select at 0x7fd315f97ee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:05.319150 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f68b0e1a-b0b1-470f-be8e-4b230b709091 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843273444" status: 204 len: 0 microversion: 2.20 time: 0.046777 May 19 04:53:05.320087 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2524/4938] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843273444 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:53:05.961441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afe690f0-068f-4b92-a8e4-749eeb5a1d68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:05.962321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-afe690f0-068f-4b92-a8e4-749eeb5a1d68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:05.972987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afe690f0-068f-4b92-a8e4-749eeb5a1d68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:05.973725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afe690f0-068f-4b92-a8e4-749eeb5a1d68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:05.975193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afe690f0-068f-4b92-a8e4-749eeb5a1d68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:05.976934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afe690f0-068f-4b92-a8e4-749eeb5a1d68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:06.471175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afe690f0-068f-4b92-a8e4-749eeb5a1d68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:06.486719 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afe690f0-068f-4b92-a8e4-749eeb5a1d68 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1506 microversion: 2.1 time: 0.530611 May 19 04:53:06.488914 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2415/4939] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:05 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:06.776796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:06.778007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:06.785395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:06.786055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:06.786997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:06.787753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:06.804032 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] HTTP exception thrown: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Request method failure captured: May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f HTTP/1.1 May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcxlWoLW3nEC0CqgAymKMkh2kkuWpYK4pZo2sJfLVXKLXPLbqfOCQqd4zOq-El8xG6R0nY-u1obGDX02wX4eK-v1U_mf1WzGJa3lEnByhRJW3icPgHYXB4W9ZVbmXAdDSzFmNJQPcTCWy9Fmy_pqO2F8di3BpladFoFHLoXi8t95glE May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 4dabcb42b8fd408cbeddbac6b5c90ba5 May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-167774588 May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-167774588 May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 4dabcb42b8fd408cbeddbac6b5c90ba5 May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-167774588 May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachSCSIVolumeTestJSON-167774588-project May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 2900a0416a1245d09eddd97c329c9fca May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-167774588-project May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'c87f7ed9-b42a-4cb5-9a13-935e4469527f'} May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:53:06.806019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.810102 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:06.811734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Returning 404 to user: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:53:06.813455 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eb3e49b4-07b9-418b-9a34-6376d6b87b1e tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 404 len: 111 microversion: 2.1 time: 0.039888 May 19 04:53:06.814501 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2525/4940] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:53:06 2022] DELETE /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:53:06.822585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:06.823393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] [instance: c87f7ed9-b42a-4cb5-9a13-935e4469527f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:06.830101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:06.830772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:06.832091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:06.832720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:06.848112 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] HTTP exception thrown: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Request method failure captured: May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f HTTP/1.1 May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcxlWoLW3nEC0CqgAymKMkh2kkuWpYK4pZo2sJfLVXKLXPLbqfOCQqd4zOq-El8xG6R0nY-u1obGDX02wX4eK-v1U_mf1WzGJa3lEnByhRJW3icPgHYXB4W9ZVbmXAdDSzFmNJQPcTCWy9Fmy_pqO2F8di3BpladFoFHLoXi8t95glE May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 4dabcb42b8fd408cbeddbac6b5c90ba5 May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-167774588 May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4dabcb42b8fd408cbeddbac6b5c90ba5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-167774588 May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 4dabcb42b8fd408cbeddbac6b5c90ba5 May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-167774588 May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachSCSIVolumeTestJSON-167774588-project May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 2900a0416a1245d09eddd97c329c9fca May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-167774588-project May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c87f7ed9-b42a-4cb5-9a13-935e4469527f'} May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:06.850079 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:06.853822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:06.853822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:06.853822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:06.853822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:53:06.853822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:53:06.853822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. May 19 04:53:06.853822 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:06.856363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] Returning 404 to user: Instance c87f7ed9-b42a-4cb5-9a13-935e4469527f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:53:06.858645 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aa3effab-45fa-452b-b912-16caf5a09336 tempest-AttachSCSIVolumeTestJSON-167774588 tempest-AttachSCSIVolumeTestJSON-167774588-project] 10.222.0.58 "GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f" status: 404 len: 111 microversion: 2.1 time: 0.040267 May 19 04:53:06.861456 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2416/4941] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:06 2022] GET /compute/v2.1/servers/c87f7ed9-b42a-4cb5-9a13-935e4469527f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:53:07.259667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2104dc8a-ff64-4ac1-b87e-3baf518f810f req-07f257d6-6dc0-4d69-8b1c-411275f7aff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78aba7da-ae55-4e89-aa6c-e226c570f780", "name": "network-vif-unplugged", "status": "completed", "tag": "5632caf9-3896-4359-aa1f-68f1db858be0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:07.277723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2104dc8a-ff64-4ac1-b87e-3baf518f810f req-07f257d6-6dc0-4d69-8b1c-411275f7aff9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:07.278172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2104dc8a-ff64-4ac1-b87e-3baf518f810f req-07f257d6-6dc0-4d69-8b1c-411275f7aff9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:07.324796 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2104dc8a-ff64-4ac1-b87e-3baf518f810f req-07f257d6-6dc0-4d69-8b1c-411275f7aff9 service nova] Creating event network-vif-unplugged:5632caf9-3896-4359-aa1f-68f1db858be0 for instance 78aba7da-ae55-4e89-aa6c-e226c570f780 on n-h1-766726-30 May 19 04:53:07.342819 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2104dc8a-ff64-4ac1-b87e-3baf518f810f req-07f257d6-6dc0-4d69-8b1c-411275f7aff9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085545 May 19 04:53:07.347520 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2526/4942] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:53:07.482765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6fed2408-792b-4d88-acf8-de8d6a8d2abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'create', calling method: .version_select at 0x7fd315c7bd30>, body: {"keypair": {"name": "tempest-keypair-1571677450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCAerYfm2qfPNtyR90+L8IrPCLHKR5NJ64qW7FBB6dBvlkCPYWcOgtm/d4RkTJb20qF2g3H3uYJ8Grr/luH03O9I6HQMuASpqr5KWRlmd8f65ppSSm6P53fm44UhlpI4A=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:07.506555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1248a76b-12df-49e0-bc3e-cbcde5fb7931 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:07.507393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1248a76b-12df-49e0-bc3e-cbcde5fb7931 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:07.521880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1248a76b-12df-49e0-bc3e-cbcde5fb7931 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:07.532010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1248a76b-12df-49e0-bc3e-cbcde5fb7931 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:07.533137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1248a76b-12df-49e0-bc3e-cbcde5fb7931 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:07.534444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1248a76b-12df-49e0-bc3e-cbcde5fb7931 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:07.547461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6fed2408-792b-4d88-acf8-de8d6a8d2abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Getting quotas for project bd03a0c9b0e64169a903e07e1f2c97b6. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:53:07.574576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6fed2408-792b-4d88-acf8-de8d6a8d2abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Getting quotas for user 69228739a9134460960e474b3ef7bebf and project bd03a0c9b0e64169a903e07e1f2c97b6. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:53:07.670903 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6fed2408-792b-4d88-acf8-de8d6a8d2abd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.192999 May 19 04:53:07.679452 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2417/4943] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 19 04:53:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 04:53:08.318683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1248a76b-12df-49e0-bc3e-cbcde5fb7931 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:08.339319 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1248a76b-12df-49e0-bc3e-cbcde5fb7931 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1506 microversion: 2.1 time: 0.837855 May 19 04:53:08.346517 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2527/4944] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:07 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1506 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:53:09.374050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4140e6a6-9e30-48fa-b8b3-0a0c003ec50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:09.377994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4140e6a6-9e30-48fa-b8b3-0a0c003ec50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:09.400087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4140e6a6-9e30-48fa-b8b3-0a0c003ec50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:09.401935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4140e6a6-9e30-48fa-b8b3-0a0c003ec50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:09.405330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4140e6a6-9e30-48fa-b8b3-0a0c003ec50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:09.406717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4140e6a6-9e30-48fa-b8b3-0a0c003ec50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:10.615408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4140e6a6-9e30-48fa-b8b3-0a0c003ec50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:10.633503 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4140e6a6-9e30-48fa-b8b3-0a0c003ec50d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 200 len: 1509 microversion: 2.1 time: 1.273186 May 19 04:53:10.638018 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2418/4945] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:09 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 1509 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:10.656563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-23810c7f-9e1c-4210-9847-3b839da038b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:10.659919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-23810c7f-9e1c-4210-9847-3b839da038b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:10.687187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23810c7f-9e1c-4210-9847-3b839da038b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:10.688614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23810c7f-9e1c-4210-9847-3b839da038b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:10.691695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23810c7f-9e1c-4210-9847-3b839da038b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:10.692871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23810c7f-9e1c-4210-9847-3b839da038b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:11.070774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23810c7f-9e1c-4210-9847-3b839da038b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:11.094965 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-23810c7f-9e1c-4210-9847-3b839da038b3 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.445647 May 19 04:53:11.095801 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2528/4946] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:10 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:11.124319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3b96ebf-da8a-49f4-985c-44b57468d95b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:11.125771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3b96ebf-da8a-49f4-985c-44b57468d95b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:11.136672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3b96ebf-da8a-49f4-985c-44b57468d95b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:11.140576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3b96ebf-da8a-49f4-985c-44b57468d95b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:11.142056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3b96ebf-da8a-49f4-985c-44b57468d95b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:11.142668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3b96ebf-da8a-49f4-985c-44b57468d95b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:11.558507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3b96ebf-da8a-49f4-985c-44b57468d95b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:11.572682 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3b96ebf-da8a-49f4-985c-44b57468d95b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.453800 May 19 04:53:11.578784 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2419/4947] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:11 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:11.595075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e20fa28-f020-4656-9d16-3d6ea1cb1e37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:11.595709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6e20fa28-f020-4656-9d16-3d6ea1cb1e37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:11.613780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e20fa28-f020-4656-9d16-3d6ea1cb1e37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:11.614238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e20fa28-f020-4656-9d16-3d6ea1cb1e37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:11.615038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e20fa28-f020-4656-9d16-3d6ea1cb1e37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:11.615486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e20fa28-f020-4656-9d16-3d6ea1cb1e37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:11.650342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:12.007615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6e20fa28-f020-4656-9d16-3d6ea1cb1e37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:12.028535 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e20fa28-f020-4656-9d16-3d6ea1cb1e37 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.435092 May 19 04:53:12.029935 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2529/4948] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:11 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:12.047119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bbd24391-1477-4fff-815d-b260d20032d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:12.047732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bbd24391-1477-4fff-815d-b260d20032d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:12.060976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbd24391-1477-4fff-815d-b260d20032d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:12.061598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbd24391-1477-4fff-815d-b260d20032d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:12.062298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbd24391-1477-4fff-815d-b260d20032d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:12.064288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbd24391-1477-4fff-815d-b260d20032d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:12.111125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:12.655390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bbd24391-1477-4fff-815d-b260d20032d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:12.666307 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bbd24391-1477-4fff-815d-b260d20032d8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.622868 May 19 04:53:12.682480 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2420/4949] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:12 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:12.683968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-217963dc-c64f-44dd-882f-da86c084ea0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:12.699591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-217963dc-c64f-44dd-882f-da86c084ea0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:12.700262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-217963dc-c64f-44dd-882f-da86c084ea0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:12.743296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-217963dc-c64f-44dd-882f-da86c084ea0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Going to try to stop instance {{(pid=124818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 04:53:12.842824 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-217963dc-c64f-44dd-882f-da86c084ea0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.163233 May 19 04:53:12.843489 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2530/4950] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:53:12 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:53:12.852982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f66395c7-9f15-47a3-a3ac-295175d4e9d6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:12.853914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f66395c7-9f15-47a3-a3ac-295175d4e9d6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:12.872769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f66395c7-9f15-47a3-a3ac-295175d4e9d6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:12.873595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f66395c7-9f15-47a3-a3ac-295175d4e9d6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:12.880256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f66395c7-9f15-47a3-a3ac-295175d4e9d6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:12.880719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f66395c7-9f15-47a3-a3ac-295175d4e9d6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:13.002542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1693177158", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33d3d376-76a4-4d9f-8eb8-1a8298b802f8"}], "security_groups": [{"name": "tempest-securitygroup--740100102"}], "key_name": "tempest-keypair-1571677450", "user_data": "}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:13.261304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] validate_networks() for [('33d3d376-76a4-4d9f-8eb8-1a8298b802f8', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:53:13.752261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f66395c7-9f15-47a3-a3ac-295175d4e9d6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:13.769741 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f66395c7-9f15-47a3-a3ac-295175d4e9d6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.921523 May 19 04:53:13.770352 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2421/4951] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:12 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:14.787164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7ec6a3dc-1b1e-4bab-898f-2292be295015 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:14.787758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7ec6a3dc-1b1e-4bab-898f-2292be295015 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:14.810721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ec6a3dc-1b1e-4bab-898f-2292be295015 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:14.814346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ec6a3dc-1b1e-4bab-898f-2292be295015 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:14.815303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ec6a3dc-1b1e-4bab-898f-2292be295015 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:14.815935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ec6a3dc-1b1e-4bab-898f-2292be295015 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:15.561288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7ec6a3dc-1b1e-4bab-898f-2292be295015 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:15.579129 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7ec6a3dc-1b1e-4bab-898f-2292be295015 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.794730 May 19 04:53:15.591418 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2422/4952] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:14 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:15.708642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:53:15.709664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:53:15.710403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:53:15.710966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:53:15.711547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:53:15.746958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:15.747437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:15.751847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:15.753033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:15.822364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Getting quotas for project bd03a0c9b0e64169a903e07e1f2c97b6. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:53:15.849842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Getting quotas for user 69228739a9134460960e474b3ef7bebf and project bd03a0c9b0e64169a903e07e1f2c97b6. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:53:15.900756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:53:15.910288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:53:16.072428 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-75b9ee1e-aece-432e-b3a3-9ce0231a7da2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.074659 May 19 04:53:16.083260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-740c432e-1dd3-4dc7-92e2-4403e1e79213 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:16.083779 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2531/4953] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:53:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 3086 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 19 04:53:16.084845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-740c432e-1dd3-4dc7-92e2-4403e1e79213 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:16.233718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-740c432e-1dd3-4dc7-92e2-4403e1e79213 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:16.248738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-740c432e-1dd3-4dc7-92e2-4403e1e79213 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:16.250853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-740c432e-1dd3-4dc7-92e2-4403e1e79213 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:16.254050 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-740c432e-1dd3-4dc7-92e2-4403e1e79213 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1282 microversion: 2.20 time: 0.174816 May 19 04:53:16.256321 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2423/4954] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:16 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:53:16.598757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9163f83-16ba-48f8-b237-52a48e4308c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:16.600615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a9163f83-16ba-48f8-b237-52a48e4308c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:16.622199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9163f83-16ba-48f8-b237-52a48e4308c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:16.628122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9163f83-16ba-48f8-b237-52a48e4308c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:16.629275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9163f83-16ba-48f8-b237-52a48e4308c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:16.629742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9163f83-16ba-48f8-b237-52a48e4308c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:17.273529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:17.274921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:17.296822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:17.297887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:17.299576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:17.305524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:17.510552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:17.526393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:17.527843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:17.529480 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c2f14e53-13bd-4a18-97f6-a0ee8ba50df1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1334 microversion: 2.20 time: 0.259590 May 19 04:53:17.537939 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2424/4955] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:17 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1334 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:17.733270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a9163f83-16ba-48f8-b237-52a48e4308c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:17.742900 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a9163f83-16ba-48f8-b237-52a48e4308c8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 1.150566 May 19 04:53:17.750125 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2532/4956] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:16 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:18.557067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:18.557938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:18.573483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:18.575065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:18.581371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:18.582071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:18.757685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:18.767392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b3d4c52c-e0f6-485c-8133-69d08a3aac0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:18.768018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b3d4c52c-e0f6-485c-8133-69d08a3aac0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:18.792301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:18.812297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:18.813351 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da735a59-ca9e-4db1-888d-bd0ad6eb1589 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1340 microversion: 2.20 time: 0.261364 May 19 04:53:18.814209 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2425/4957] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:18 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1340 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:18.846926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3d4c52c-e0f6-485c-8133-69d08a3aac0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:18.846926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3d4c52c-e0f6-485c-8133-69d08a3aac0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:18.846926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3d4c52c-e0f6-485c-8133-69d08a3aac0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:18.846926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b3d4c52c-e0f6-485c-8133-69d08a3aac0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:19.291122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b3d4c52c-e0f6-485c-8133-69d08a3aac0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:19.304240 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b3d4c52c-e0f6-485c-8133-69d08a3aac0f tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.541573 May 19 04:53:19.305556 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2533/4958] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:18 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:19.838743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:19.839366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:19.872209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:19.873453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:19.876493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:19.881590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:20.222203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:20.236242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:20.250683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:20.254737 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-992613d3-bc24-4fb9-84a5-1619c72588f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1340 microversion: 2.20 time: 0.426198 May 19 04:53:20.258566 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2426/4959] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:19 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1340 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:20.327112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cb2c6993-0e72-4342-a41e-d7ef1e7bbb9e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:20.329277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb2c6993-0e72-4342-a41e-d7ef1e7bbb9e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:20.364756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb2c6993-0e72-4342-a41e-d7ef1e7bbb9e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:20.369177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb2c6993-0e72-4342-a41e-d7ef1e7bbb9e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:20.377225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb2c6993-0e72-4342-a41e-d7ef1e7bbb9e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:20.381102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb2c6993-0e72-4342-a41e-d7ef1e7bbb9e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:21.276997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:21.277837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:21.304159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:21.306857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:21.314727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:21.317228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:21.803077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:21.834127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:21.837768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:21.844732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1c76a82-6cff-495a-9d04-2ee0ff2dbd51 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1340 microversion: 2.20 time: 0.571901 May 19 04:53:21.847667 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2427/4960] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:21 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1340 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:53:22.108710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cb2c6993-0e72-4342-a41e-d7ef1e7bbb9e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:22.124768 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cb2c6993-0e72-4342-a41e-d7ef1e7bbb9e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 1.805623 May 19 04:53:22.129946 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2534/4961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:20 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:53:22.866030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:22.866657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:22.879217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:22.879675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:22.880489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:22.880912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:23.145709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-74b03030-b214-4bb6-8f01-dffdecb7f088 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:23.147873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-74b03030-b214-4bb6-8f01-dffdecb7f088 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:23.166111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74b03030-b214-4bb6-8f01-dffdecb7f088 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:23.168817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74b03030-b214-4bb6-8f01-dffdecb7f088 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:23.169968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74b03030-b214-4bb6-8f01-dffdecb7f088 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:23.173568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74b03030-b214-4bb6-8f01-dffdecb7f088 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:23.371695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:23.384544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:23.390549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:23.392038 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d572a48-2239-4085-8ce1-8acdf938f692 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1407 microversion: 2.20 time: 0.530604 May 19 04:53:23.394417 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2428/4962] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:22 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:23.753507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-74b03030-b214-4bb6-8f01-dffdecb7f088 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:23.772126 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-74b03030-b214-4bb6-8f01-dffdecb7f088 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1678 microversion: 2.1 time: 0.629521 May 19 04:53:23.788609 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2535/4963] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:23 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1678 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:24.425011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:24.425983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:24.463157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:24.464140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:24.465216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:24.466042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:24.806609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2fa7811d-ce61-47c6-bc19-a4a56cc17d9a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:24.809172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2fa7811d-ce61-47c6-bc19-a4a56cc17d9a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:24.835536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2fa7811d-ce61-47c6-bc19-a4a56cc17d9a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:24.841209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2fa7811d-ce61-47c6-bc19-a4a56cc17d9a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:24.842270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2fa7811d-ce61-47c6-bc19-a4a56cc17d9a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:24.845304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2fa7811d-ce61-47c6-bc19-a4a56cc17d9a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:24.950030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:24.966455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:24.969602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:24.971332 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-02a1ae0f-3f22-4a89-a64a-ed5b840fa6ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1407 microversion: 2.20 time: 0.563094 May 19 04:53:24.972659 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2429/4964] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:24 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:25.172863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2fa7811d-ce61-47c6-bc19-a4a56cc17d9a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:25.185739 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2fa7811d-ce61-47c6-bc19-a4a56cc17d9a tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1655 microversion: 2.1 time: 0.398426 May 19 04:53:25.190764 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2536/4965] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:24 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1655 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:25.219051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5857b0dd-d2c3-4817-91c3-f4dd335c7cd9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:25.226932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5857b0dd-d2c3-4817-91c3-f4dd335c7cd9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:25.227795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5857b0dd-d2c3-4817-91c3-f4dd335c7cd9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:25.306532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5857b0dd-d2c3-4817-91c3-f4dd335c7cd9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Going to try to start instance {{(pid=124819) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 04:53:25.420458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5857b0dd-d2c3-4817-91c3-f4dd335c7cd9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.215697 May 19 04:53:25.423317 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2430/4966] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:53:25 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:53:25.434336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33f066bc-1bcd-4614-9c6e-39550fcb4101 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:25.438994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-33f066bc-1bcd-4614-9c6e-39550fcb4101 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:25.455179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f066bc-1bcd-4614-9c6e-39550fcb4101 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:25.456366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f066bc-1bcd-4614-9c6e-39550fcb4101 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:25.457543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f066bc-1bcd-4614-9c6e-39550fcb4101 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:25.458255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f066bc-1bcd-4614-9c6e-39550fcb4101 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:25.788111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:25.859611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-33f066bc-1bcd-4614-9c6e-39550fcb4101 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:25.876182 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-33f066bc-1bcd-4614-9c6e-39550fcb4101 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1664 microversion: 2.1 time: 0.448148 May 19 04:53:25.877031 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2537/4967] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:25 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1664 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:53:25.992072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:25.992665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:26.011186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:26.020424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:26.026542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:26.026542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:26.239466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:26.561504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:26.600640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:26.609136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:26.612465 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69fa2d09-3c10-4de8-bf51-abbce1aa87f0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1407 microversion: 2.20 time: 0.625440 May 19 04:53:26.615822 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2431/4968] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:25 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:26.899907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c9503b90-fb8c-4478-9014-0ebf7f60d459 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:26.902019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c9503b90-fb8c-4478-9014-0ebf7f60d459 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:26.906106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:26.907933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:26.919342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9503b90-fb8c-4478-9014-0ebf7f60d459 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:26.920708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9503b90-fb8c-4478-9014-0ebf7f60d459 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:26.922672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9503b90-fb8c-4478-9014-0ebf7f60d459 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:26.925604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c9503b90-fb8c-4478-9014-0ebf7f60d459 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:27.637707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:27.639161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:27.672280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:27.674286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:27.678772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:27.685287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:28.241982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c9503b90-fb8c-4478-9014-0ebf7f60d459 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:28.247901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:28.269966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:28.272827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:28.273170 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c9503b90-fb8c-4478-9014-0ebf7f60d459 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1664 microversion: 2.1 time: 1.367506 May 19 04:53:28.276652 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d31d9d4-9aee-482f-a3d4-c0a362db0cd6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1407 microversion: 2.20 time: 0.645546 May 19 04:53:28.281519 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2538/4969] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:26 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1664 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:28.293218 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2432/4970] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:27 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1407 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:53:29.292087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2707c1cf-f44c-4b38-a01d-734a40852171 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:29.293473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2707c1cf-f44c-4b38-a01d-734a40852171 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:29.294292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:29.294920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:29.306486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:29.309940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:29.310598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2707c1cf-f44c-4b38-a01d-734a40852171 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:29.310781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:29.311371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2707c1cf-f44c-4b38-a01d-734a40852171 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:29.313865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2707c1cf-f44c-4b38-a01d-734a40852171 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:29.314733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2707c1cf-f44c-4b38-a01d-734a40852171 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:29.317485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:29.787847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:29.803252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2707c1cf-f44c-4b38-a01d-734a40852171 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:29.803729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:29.805673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:29.807196 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ce6e3b3-7c31-4135-a891-b180c5c13859 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1407 microversion: 2.20 time: 0.516610 May 19 04:53:29.807780 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2433/4971] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:29 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1407 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:53:29.822567 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2707c1cf-f44c-4b38-a01d-734a40852171 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.535308 May 19 04:53:29.836481 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2539/4972] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:29 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:29.844057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3f84830-9c3a-4a14-bbb2-079d062d65a6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:29.846184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e3f84830-9c3a-4a14-bbb2-079d062d65a6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:29.861186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3f84830-9c3a-4a14-bbb2-079d062d65a6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:29.865974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3f84830-9c3a-4a14-bbb2-079d062d65a6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:29.868013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3f84830-9c3a-4a14-bbb2-079d062d65a6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:29.869857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3f84830-9c3a-4a14-bbb2-079d062d65a6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:30.070274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3975aeb1-976e-418e-a897-a9308cd04924 req-98c42efe-0ad5-4300-866d-5b485cd2e1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac690db0-97d0-40dc-9503-32c5474812ac", "tag": "25b92ae1-0d83-44e7-bef8-803b7263b018"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:30.080761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3975aeb1-976e-418e-a897-a9308cd04924 req-98c42efe-0ad5-4300-866d-5b485cd2e1df service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:30.081553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3975aeb1-976e-418e-a897-a9308cd04924 req-98c42efe-0ad5-4300-866d-5b485cd2e1df service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:30.094827 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3975aeb1-976e-418e-a897-a9308cd04924 req-98c42efe-0ad5-4300-866d-5b485cd2e1df service nova] Creating event network-changed:25b92ae1-0d83-44e7-bef8-803b7263b018 for instance ac690db0-97d0-40dc-9503-32c5474812ac on n-h1-766726-30 May 19 04:53:30.100416 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3975aeb1-976e-418e-a897-a9308cd04924 req-98c42efe-0ad5-4300-866d-5b485cd2e1df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281113 May 19 04:53:30.101974 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2434/4973] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:53:30.146708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3f84830-9c3a-4a14-bbb2-079d062d65a6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:30.162827 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e3f84830-9c3a-4a14-bbb2-079d062d65a6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.323911 May 19 04:53:30.166886 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2540/4974] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:29 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:30.187294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13deb130-4f5f-4080-947e-d2db9457ff21 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:30.188381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13deb130-4f5f-4080-947e-d2db9457ff21 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:30.197335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13deb130-4f5f-4080-947e-d2db9457ff21 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:30.198030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13deb130-4f5f-4080-947e-d2db9457ff21 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:30.199999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13deb130-4f5f-4080-947e-d2db9457ff21 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:30.200846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13deb130-4f5f-4080-947e-d2db9457ff21 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:30.534446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-13deb130-4f5f-4080-947e-d2db9457ff21 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:30.543688 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13deb130-4f5f-4080-947e-d2db9457ff21 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.361921 May 19 04:53:30.545018 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2435/4975] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:30 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:30.560884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a520cd5b-9dd3-4a90-89dd-af6845ceed25 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:30.562275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a520cd5b-9dd3-4a90-89dd-af6845ceed25 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:30.579708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a520cd5b-9dd3-4a90-89dd-af6845ceed25 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:30.580857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a520cd5b-9dd3-4a90-89dd-af6845ceed25 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:30.580972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a520cd5b-9dd3-4a90-89dd-af6845ceed25 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:30.581493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a520cd5b-9dd3-4a90-89dd-af6845ceed25 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:30.825826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:30.826800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:30.833428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:30.834433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:30.835455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:30.836114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:30.901029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a520cd5b-9dd3-4a90-89dd-af6845ceed25 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:30.919977 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a520cd5b-9dd3-4a90-89dd-af6845ceed25 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.362388 May 19 04:53:30.930831 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2541/4976] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:30 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:30.938045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-228b86e3-6a99-4f16-befa-acdd747a7ea2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:30.938958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-228b86e3-6a99-4f16-befa-acdd747a7ea2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:30.946443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-228b86e3-6a99-4f16-befa-acdd747a7ea2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:30.947212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-228b86e3-6a99-4f16-befa-acdd747a7ea2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:30.948213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-228b86e3-6a99-4f16-befa-acdd747a7ea2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:30.948873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-228b86e3-6a99-4f16-befa-acdd747a7ea2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:31.295472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:31.309123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:31.312540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:31.314187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab4f5a16-dd1d-424d-aaf1-6a72b00308c8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1407 microversion: 2.20 time: 0.492301 May 19 04:53:31.319195 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2436/4977] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:30 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:53:31.373906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-228b86e3-6a99-4f16-befa-acdd747a7ea2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:31.390198 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-228b86e3-6a99-4f16-befa-acdd747a7ea2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.455478 May 19 04:53:31.391123 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2542/4978] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:30 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:31.411518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0dd3b7d1-017b-421e-809f-1614d1c3eee1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:31.413124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0dd3b7d1-017b-421e-809f-1614d1c3eee1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:31.422018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0dd3b7d1-017b-421e-809f-1614d1c3eee1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:31.422853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0dd3b7d1-017b-421e-809f-1614d1c3eee1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:31.424366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0dd3b7d1-017b-421e-809f-1614d1c3eee1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:31.425092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0dd3b7d1-017b-421e-809f-1614d1c3eee1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:31.456331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-0dd3b7d1-017b-421e-809f-1614d1c3eee1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lazy-loading 'flavor' on Instance uuid 073cbfef-d688-44eb-b0f7-5bc688c5f888 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:53:31.461983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:31.603439 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0dd3b7d1-017b-421e-809f-1614d1c3eee1 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.196361 May 19 04:53:31.606431 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2437/4979] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:53:31 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:53:31.614383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1516dd4f-74de-4850-a3f3-8136e5d7b61c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:31.615010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1516dd4f-74de-4850-a3f3-8136e5d7b61c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:31.623097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1516dd4f-74de-4850-a3f3-8136e5d7b61c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:31.624057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1516dd4f-74de-4850-a3f3-8136e5d7b61c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:31.625393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1516dd4f-74de-4850-a3f3-8136e5d7b61c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:31.626093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1516dd4f-74de-4850-a3f3-8136e5d7b61c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:32.434302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1516dd4f-74de-4850-a3f3-8136e5d7b61c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:32.445026 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1516dd4f-74de-4850-a3f3-8136e5d7b61c tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1676 microversion: 2.1 time: 0.834754 May 19 04:53:32.445657 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2543/4980] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:31 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1676 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:32.466388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:32.467302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:32.492120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:32.496649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:32.497969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:32.498712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:32.900006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb85b4b8-cd9c-4994-962b-a14d4bf801be tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'create', calling method: .version_select at 0x7fd315c7bb80>, body: {"keypair": {"name": "tempest-keypair-2086489007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlsc/mTDnbrZCfcmo6Wc1Gyy0g49KHS9oMqCE8lcPs/5D2+tkxRN/ngUrZnyg8fNYGs1idutL36y39yLIg4Jt3y9+dCPDPtk8yAIupJ9fvibDfr4BEDaePZ7N2Y9elDvA=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:32.930615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-fb85b4b8-cd9c-4994-962b-a14d4bf801be tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Getting quotas for project e7d15dedbc0c4eeb97a0d88d664b5818. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:53:32.949919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-fb85b4b8-cd9c-4994-962b-a14d4bf801be tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Getting quotas for user def2cad1e80b4ca6873f030527b0c5c7 and project e7d15dedbc0c4eeb97a0d88d664b5818. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:53:32.996944 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fb85b4b8-cd9c-4994-962b-a14d4bf801be tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.697433 May 19 04:53:32.997910 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2438/4981] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:53:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:53:33.145518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:33.159899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:33.162938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:33.167307 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-727d4c9a-2d24-4d00-8c31-9391da5a4274 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1407 microversion: 2.20 time: 0.716591 May 19 04:53:33.169735 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2544/4982] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:32 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1407 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:33.465335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79961bfc-eaff-4043-9fd8-243058c71551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:33.466262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-79961bfc-eaff-4043-9fd8-243058c71551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:33.485443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79961bfc-eaff-4043-9fd8-243058c71551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:33.487251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79961bfc-eaff-4043-9fd8-243058c71551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:33.490671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79961bfc-eaff-4043-9fd8-243058c71551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:33.491654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79961bfc-eaff-4043-9fd8-243058c71551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:34.188586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:34.189287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:34.208402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:34.208866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:34.209699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:34.210137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:35.428310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-79961bfc-eaff-4043-9fd8-243058c71551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:35.442905 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79961bfc-eaff-4043-9fd8-243058c71551 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1659 microversion: 2.1 time: 1.981627 May 19 04:53:35.444489 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2439/4983] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:33 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1659 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:35.452587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-dc241cba-7f54-4700-a9a3-b323b0819858 req-7cdfb1a9-0618-4f5d-8063-8d62603df0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac690db0-97d0-40dc-9503-32c5474812ac", "name": "network-vif-plugged", "status": "completed", "tag": "25b92ae1-0d83-44e7-bef8-803b7263b018"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:35.463302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:35.478782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dc241cba-7f54-4700-a9a3-b323b0819858 req-7cdfb1a9-0618-4f5d-8063-8d62603df0b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:35.479887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dc241cba-7f54-4700-a9a3-b323b0819858 req-7cdfb1a9-0618-4f5d-8063-8d62603df0b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:35.528098 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-dc241cba-7f54-4700-a9a3-b323b0819858 req-7cdfb1a9-0618-4f5d-8063-8d62603df0b7 service nova] Creating event network-vif-plugged:25b92ae1-0d83-44e7-bef8-803b7263b018 for instance ac690db0-97d0-40dc-9503-32c5474812ac on n-h1-766726-30 May 19 04:53:35.541378 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-dc241cba-7f54-4700-a9a3-b323b0819858 req-7cdfb1a9-0618-4f5d-8063-8d62603df0b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093904 May 19 04:53:35.542432 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2440/4984] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:53:35.550608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c5a6dff7-9f7a-415c-a649-8afb30e1e236 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:35.551544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c5a6dff7-9f7a-415c-a649-8afb30e1e236 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:35.559764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5a6dff7-9f7a-415c-a649-8afb30e1e236 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:35.560457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5a6dff7-9f7a-415c-a649-8afb30e1e236 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:35.562491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5a6dff7-9f7a-415c-a649-8afb30e1e236 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:35.580384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5a6dff7-9f7a-415c-a649-8afb30e1e236 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:35.658252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:35.661280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:35.671355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:35.681538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:35.682988 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-127ebab2-80b9-46d3-af20-e94bba3f8f41 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1407 microversion: 2.20 time: 1.499096 May 19 04:53:35.684258 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2545/4985] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:34 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1407 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:53:35.788884 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c5a6dff7-9f7a-415c-a649-8afb30e1e236 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action" status: 202 len: 0 microversion: 2.1 time: 0.233151 May 19 04:53:35.800622 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2441/4986] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:53:35 2022] POST /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:53:35.809192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aec5cde6-6d73-4ca8-a688-64933fc388cb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:35.810077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aec5cde6-6d73-4ca8-a688-64933fc388cb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:35.825849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aec5cde6-6d73-4ca8-a688-64933fc388cb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:35.829330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aec5cde6-6d73-4ca8-a688-64933fc388cb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:35.830850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aec5cde6-6d73-4ca8-a688-64933fc388cb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:35.831455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aec5cde6-6d73-4ca8-a688-64933fc388cb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:36.366721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aec5cde6-6d73-4ca8-a688-64933fc388cb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:36.382534 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aec5cde6-6d73-4ca8-a688-64933fc388cb tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1665 microversion: 2.1 time: 0.577984 May 19 04:53:36.383146 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2546/4987] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:35 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1665 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:36.706020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:36.707146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:36.721960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:36.735749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:36.735749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:36.735749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:37.390738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:37.400774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0af3bb45-bb0f-49bd-a689-ed98b4ed2ba4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:37.402633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0af3bb45-bb0f-49bd-a689-ed98b4ed2ba4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:37.409361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:37.416385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:37.418074 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4e52a51-ee86-42b3-b7ed-8d3d4e473663 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1407 microversion: 2.20 time: 0.718983 May 19 04:53:37.418901 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2442/4988] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:36 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1407 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:53:37.431109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af3bb45-bb0f-49bd-a689-ed98b4ed2ba4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:37.432235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af3bb45-bb0f-49bd-a689-ed98b4ed2ba4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:37.433357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af3bb45-bb0f-49bd-a689-ed98b4ed2ba4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:37.439035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af3bb45-bb0f-49bd-a689-ed98b4ed2ba4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:37.819880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0af3bb45-bb0f-49bd-a689-ed98b4ed2ba4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:37.827707 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0af3bb45-bb0f-49bd-a689-ed98b4ed2ba4 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1665 microversion: 2.1 time: 0.430753 May 19 04:53:37.830769 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2547/4989] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:37 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1665 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:53:38.375374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-222515123", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bfc03c1-8722-42b4-9527-7ed06dac2387"}], "security_groups": [{"name": "tempest-securitygroup--2070320200"}], "key_name": "tempest-keypair-2086489007", "user_data": "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:38.443620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:38.444244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:38.454484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:38.456196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:38.458569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:38.460792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:38.509591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] validate_networks() for [('4bfc03c1-8722-42b4-9527-7ed06dac2387', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:53:38.790098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:38.810713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:38.813743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:38.817749 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba4f530d-a46e-4dab-b619-92bfc1fa9407 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1600 microversion: 2.20 time: 0.383312 May 19 04:53:38.818912 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2548/4990] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:53:38 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1600 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:53:38.890158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ffb45e15-2f4e-4682-9b1a-da8b5972df52 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:38.890932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ffb45e15-2f4e-4682-9b1a-da8b5972df52 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:38.904662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ffb45e15-2f4e-4682-9b1a-da8b5972df52 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:38.905161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ffb45e15-2f4e-4682-9b1a-da8b5972df52 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:38.905946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ffb45e15-2f4e-4682-9b1a-da8b5972df52 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:38.906394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ffb45e15-2f4e-4682-9b1a-da8b5972df52 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:39.141866 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ffb45e15-2f4e-4682-9b1a-da8b5972df52 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.277199 May 19 04:53:39.142605 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2549/4991] 10.222.0.58 () {60 vars in 1315 bytes} [Thu May 19 04:53:38 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/os-interface => generated 285 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:53:39.153760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7afac68b-3316-41e2-8a41-f4a92b1ed6b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:39.154527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7afac68b-3316-41e2-8a41-f4a92b1ed6b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:39.168299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7afac68b-3316-41e2-8a41-f4a92b1ed6b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:39.171195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7afac68b-3316-41e2-8a41-f4a92b1ed6b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:39.174910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7afac68b-3316-41e2-8a41-f4a92b1ed6b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:39.175479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7afac68b-3316-41e2-8a41-f4a92b1ed6b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:39.586860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7afac68b-3316-41e2-8a41-f4a92b1ed6b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:39.595482 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7afac68b-3316-41e2-8a41-f4a92b1ed6b8 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 0.446187 May 19 04:53:39.596077 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2550/4992] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:39 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:39.611765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d00503fc-0a57-46ea-8fc5-e0b39e9e7f0b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:39.612751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d00503fc-0a57-46ea-8fc5-e0b39e9e7f0b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:39.628886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d00503fc-0a57-46ea-8fc5-e0b39e9e7f0b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:39.629366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d00503fc-0a57-46ea-8fc5-e0b39e9e7f0b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:39.630146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d00503fc-0a57-46ea-8fc5-e0b39e9e7f0b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:39.630586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d00503fc-0a57-46ea-8fc5-e0b39e9e7f0b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:40.726490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:53:40.727041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:53:40.727397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:53:40.727811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:53:40.728851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:53:40.753652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:40.754878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:40.757708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:40.758213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:40.833172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Getting quotas for project e7d15dedbc0c4eeb97a0d88d664b5818. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:53:40.848493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Getting quotas for user def2cad1e80b4ca6873f030527b0c5c7 and project e7d15dedbc0c4eeb97a0d88d664b5818. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:53:40.878941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:53:40.893527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:53:40.994498 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-718d14c5-6e52-4d95-a57f-16458adde446 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.622394 May 19 04:53:40.996719 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2443/4993] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:53:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 2626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:53:41.008360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0bc28c51-2e83-47d5-8722-050adeef693f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:41.010151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0bc28c51-2e83-47d5-8722-050adeef693f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:41.208683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d00503fc-0a57-46ea-8fc5-e0b39e9e7f0b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:41.215822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0bc28c51-2e83-47d5-8722-050adeef693f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:41.224891 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d00503fc-0a57-46ea-8fc5-e0b39e9e7f0b tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1668 microversion: 2.1 time: 1.616571 May 19 04:53:41.226103 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0bc28c51-2e83-47d5-8722-050adeef693f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1237 microversion: 2.1 time: 0.222319 May 19 04:53:41.237109 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2444/4994] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:41 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1237 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:53:41.237930 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2551/4995] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:39 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1668 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:53:41.249777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:41.252896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:41.266766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:41.267777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:41.268732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:41.270108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:41.323881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:53:41.342818 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Working on deleting snapshot ce94e2e7-89b3-4065-acc1-c71ad6e86af4 from shelved instance... May 19 04:53:42.247799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c25516e-4fd4-438b-bc70-703b38d93ff4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:42.248912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c25516e-4fd4-438b-bc70-703b38d93ff4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:42.269559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c25516e-4fd4-438b-bc70-703b38d93ff4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:42.271765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c25516e-4fd4-438b-bc70-703b38d93ff4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:42.280643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c25516e-4fd4-438b-bc70-703b38d93ff4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:42.290796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c25516e-4fd4-438b-bc70-703b38d93ff4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:42.628456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1c25516e-4fd4-438b-bc70-703b38d93ff4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:42.646553 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c25516e-4fd4-438b-bc70-703b38d93ff4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1289 microversion: 2.1 time: 0.405975 May 19 04:53:42.655543 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2445/4996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:42 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1289 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:42.682457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Doing local delete in cell c3fbadc6-eff8-4077-92b7-08b6c75fa89b(cell1) {{(pid=124818) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 19 04:53:42.685022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:42.686765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:42.689148 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 19 04:53:42.696834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] deallocate_for_instance() {{(pid=124818) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 19 04:53:42.747248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-928ca602-e1bc-4ba8-ab05-6aa2a8f64315 req-8035d32f-e48f-47a8-980e-46c01a051ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac690db0-97d0-40dc-9503-32c5474812ac", "tag": "25b92ae1-0d83-44e7-bef8-803b7263b018"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:42.776201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-928ca602-e1bc-4ba8-ab05-6aa2a8f64315 req-8035d32f-e48f-47a8-980e-46c01a051ed9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:42.778239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-928ca602-e1bc-4ba8-ab05-6aa2a8f64315 req-8035d32f-e48f-47a8-980e-46c01a051ed9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:42.830934 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-928ca602-e1bc-4ba8-ab05-6aa2a8f64315 req-8035d32f-e48f-47a8-980e-46c01a051ed9 service nova] Creating event network-changed:25b92ae1-0d83-44e7-bef8-803b7263b018 for instance ac690db0-97d0-40dc-9503-32c5474812ac on n-h1-766726-30 May 19 04:53:42.854638 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-928ca602-e1bc-4ba8-ab05-6aa2a8f64315 req-8035d32f-e48f-47a8-980e-46c01a051ed9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115685 May 19 04:53:42.855593 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2446/4997] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:53:43.678606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31bf0715-ccdf-41dd-9728-a298ec4a5ed3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:43.680373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31bf0715-ccdf-41dd-9728-a298ec4a5ed3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:43.696116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31bf0715-ccdf-41dd-9728-a298ec4a5ed3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:43.701426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31bf0715-ccdf-41dd-9728-a298ec4a5ed3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:43.703268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31bf0715-ccdf-41dd-9728-a298ec4a5ed3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:43.703895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31bf0715-ccdf-41dd-9728-a298ec4a5ed3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:43.848467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31bf0715-ccdf-41dd-9728-a298ec4a5ed3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:43.859655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31bf0715-ccdf-41dd-9728-a298ec4a5ed3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1295 microversion: 2.1 time: 0.185540 May 19 04:53:43.861840 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2447/4998] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:43 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1295 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:53:44.887261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bba0732f-1584-43c3-b94c-308bf577a9fb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:44.888751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bba0732f-1584-43c3-b94c-308bf577a9fb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:44.908786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bba0732f-1584-43c3-b94c-308bf577a9fb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:44.909781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bba0732f-1584-43c3-b94c-308bf577a9fb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:44.912208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bba0732f-1584-43c3-b94c-308bf577a9fb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:44.912650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bba0732f-1584-43c3-b94c-308bf577a9fb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:45.346066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Updating instance_info_cache with network_info: [] {{(pid=124818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:53:45.609560 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-de36d146-5d19-4cbd-9f6c-99f1d4b23a96 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "DELETE /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 204 len: 0 microversion: 2.1 time: 4.365691 May 19 04:53:45.610773 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2552/4999] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:53:41 2022] DELETE /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 0 bytes in 4368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:53:45.621888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-be80e2ee-4914-422f-a574-6315b07ea1ca req-1e3d5f38-ad91-4ba9-b17e-8172f11b43fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78aba7da-ae55-4e89-aa6c-e226c570f780", "name": "network-vif-deleted", "tag": "5632caf9-3896-4359-aa1f-68f1db858be0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:45.642064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-be80e2ee-4914-422f-a574-6315b07ea1ca req-1e3d5f38-ad91-4ba9-b17e-8172f11b43fa service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:45.648534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-be80e2ee-4914-422f-a574-6315b07ea1ca req-1e3d5f38-ad91-4ba9-b17e-8172f11b43fa service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:45.672912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.compute.server_external_events [req-be80e2ee-4914-422f-a574-6315b07ea1ca req-1e3d5f38-ad91-4ba9-b17e-8172f11b43fa service nova] Unable to find a host for instance 78aba7da-ae55-4e89-aa6c-e226c570f780. Dropping event network-vif-deleted {{(pid=124818) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 04:53:45.674339 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-be80e2ee-4914-422f-a574-6315b07ea1ca req-1e3d5f38-ad91-4ba9-b17e-8172f11b43fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.062399 May 19 04:53:45.677026 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2553/5000] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 04:53:45.683373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:45.684797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 78aba7da-ae55-4e89-aa6c-e226c570f780] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:45.695797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:45.698160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:45.699342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:45.700210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:45.723878 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] HTTP exception thrown: Instance 78aba7da-ae55-4e89-aa6c-e226c570f780 could not be found. May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Request method failure captured: May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 HTTP/1.1 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihct_APeUUwkAsVEog4z30SCbl9EKENFOQfyl2xYhzj2YzWvEJuSbvkD-kjHz-5gtgTKd4EsFcX0Ewg3jgqjv4EmUMAaGVJN8tkPahLj7YMKDzPyfkl4GxQlphj1eAZvJmhuijajE3_0rUgjLx7D0P3HLID6pkPXrkGJqKZnjxxAFg1g May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 346e3945e25c4638bef347149d914e61 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/346e3945e25c4638bef347149d914e61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_346e3945e25c4638bef347149d914e61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-642791081 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 346e3945e25c4638bef347149d914e61 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-642791081-project May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 87d19ae04b1d4f0e9e23872d9c2cd0a4 May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-642791081-project May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 78aba7da-ae55-4e89-aa6c-e226c570f780 could not be found. May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '78aba7da-ae55-4e89-aa6c-e226c570f780'} May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78aba7da-ae55-4e89-aa6c-e226c570f780 could not be found. May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78aba7da-ae55-4e89-aa6c-e226c570f780 could not be found. May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:45.726143 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:45.730023 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:45.730023 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:45.730023 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:45.730023 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:53:45.730023 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:53:45.730023 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78aba7da-ae55-4e89-aa6c-e226c570f780 could not be found. May 19 04:53:45.730023 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:53:45.732342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Returning 404 to user: Instance 78aba7da-ae55-4e89-aa6c-e226c570f780 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:53:45.734123 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-71d35fd1-ec59-4fe6-a6d5-9e0f5ed9cc16 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780" status: 404 len: 111 microversion: 2.1 time: 0.055711 May 19 04:53:45.735216 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2554/5001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:45 2022] GET /compute/v2.1/servers/78aba7da-ae55-4e89-aa6c-e226c570f780 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:53:45.746938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e479b9dc-1f6d-4e59-969b-6eda69fe1850 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:45.747718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e479b9dc-1f6d-4e59-969b-6eda69fe1850 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:45.756041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e479b9dc-1f6d-4e59-969b-6eda69fe1850 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:45.756875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e479b9dc-1f6d-4e59-969b-6eda69fe1850 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:45.757908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e479b9dc-1f6d-4e59-969b-6eda69fe1850 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:45.758550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e479b9dc-1f6d-4e59-969b-6eda69fe1850 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:45.802016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e479b9dc-1f6d-4e59-969b-6eda69fe1850 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:53:45.833990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bba0732f-1584-43c3-b94c-308bf577a9fb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:45.870675 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bba0732f-1584-43c3-b94c-308bf577a9fb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.992188 May 19 04:53:45.875742 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2448/5002] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:44 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:45.975879 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e479b9dc-1f6d-4e59-969b-6eda69fe1850 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 204 len: 0 microversion: 2.1 time: 0.235766 May 19 04:53:45.977116 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2555/5003] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:53:45 2022] DELETE /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:53:45.986444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-43d3c072-20f1-4f3e-b4f2-83de75a28a92 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:45.987431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-43d3c072-20f1-4f3e-b4f2-83de75a28a92 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:46.002279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-43d3c072-20f1-4f3e-b4f2-83de75a28a92 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:46.003648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-43d3c072-20f1-4f3e-b4f2-83de75a28a92 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:46.006716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-43d3c072-20f1-4f3e-b4f2-83de75a28a92 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:46.008221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-43d3c072-20f1-4f3e-b4f2-83de75a28a92 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:46.637255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-43d3c072-20f1-4f3e-b4f2-83de75a28a92 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:46.649258 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-43d3c072-20f1-4f3e-b4f2-83de75a28a92 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1466 microversion: 2.1 time: 0.665977 May 19 04:53:46.650395 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2449/5004] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:45 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1466 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:53:46.901766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1401d86-f60a-43fb-bfdc-d97dc10e6b1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:46.902738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1401d86-f60a-43fb-bfdc-d97dc10e6b1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:46.929796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1401d86-f60a-43fb-bfdc-d97dc10e6b1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:46.933761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1401d86-f60a-43fb-bfdc-d97dc10e6b1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:46.940215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1401d86-f60a-43fb-bfdc-d97dc10e6b1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:46.940846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1401d86-f60a-43fb-bfdc-d97dc10e6b1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:47.021467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:47.435092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1401d86-f60a-43fb-bfdc-d97dc10e6b1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:47.444922 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1401d86-f60a-43fb-bfdc-d97dc10e6b1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.549506 May 19 04:53:47.454896 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2556/5005] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:46 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:47.702196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e9170579-77f3-4d3f-b4ae-7a684b0a52cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:47.704686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e9170579-77f3-4d3f-b4ae-7a684b0a52cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:47.736155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9170579-77f3-4d3f-b4ae-7a684b0a52cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:47.736835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9170579-77f3-4d3f-b4ae-7a684b0a52cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:47.738171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9170579-77f3-4d3f-b4ae-7a684b0a52cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:47.743773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9170579-77f3-4d3f-b4ae-7a684b0a52cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:48.025205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8b4464c3-70bd-44f0-93f7-f5c86b42541e req-4f52bc9a-0115-45ac-8571-060edc766b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c54667-4cff-44ff-bf2d-776532b44bbb", "tag": "c98aad4d-3582-4e76-bd48-1c48c6206d54"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:48.051239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8b4464c3-70bd-44f0-93f7-f5c86b42541e req-4f52bc9a-0115-45ac-8571-060edc766b3c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:48.051797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8b4464c3-70bd-44f0-93f7-f5c86b42541e req-4f52bc9a-0115-45ac-8571-060edc766b3c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:48.105274 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8b4464c3-70bd-44f0-93f7-f5c86b42541e req-4f52bc9a-0115-45ac-8571-060edc766b3c service nova] Creating event network-changed:c98aad4d-3582-4e76-bd48-1c48c6206d54 for instance b0c54667-4cff-44ff-bf2d-776532b44bbb on n-h2-766726-30 May 19 04:53:48.110402 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8b4464c3-70bd-44f0-93f7-f5c86b42541e req-4f52bc9a-0115-45ac-8571-060edc766b3c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089878 May 19 04:53:48.111439 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2557/5006] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:53:48.218113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e9170579-77f3-4d3f-b4ae-7a684b0a52cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:48.233398 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e9170579-77f3-4d3f-b4ae-7a684b0a52cc tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 200 len: 1466 microversion: 2.1 time: 0.568165 May 19 04:53:48.242548 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2450/5007] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:47 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 1466 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:48.464535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a69eaca-6917-48b7-a5e5-01a583f58cba tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:48.466450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a69eaca-6917-48b7-a5e5-01a583f58cba tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:48.485757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a69eaca-6917-48b7-a5e5-01a583f58cba tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:48.486362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a69eaca-6917-48b7-a5e5-01a583f58cba tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:48.487515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a69eaca-6917-48b7-a5e5-01a583f58cba tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:48.488064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a69eaca-6917-48b7-a5e5-01a583f58cba tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:48.919788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a69eaca-6917-48b7-a5e5-01a583f58cba tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:48.930808 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a69eaca-6917-48b7-a5e5-01a583f58cba tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.468979 May 19 04:53:48.931817 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2558/5008] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:48 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:49.265617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:49.266250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 20b7780f-d310-45b9-b8f0-626c0433bb1b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:49.283014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:49.283480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:49.284282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:49.284733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:49.356480 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] HTTP exception thrown: Instance 20b7780f-d310-45b9-b8f0-626c0433bb1b could not be found. May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Request method failure captured: May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b HTTP/1.1 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihct_APeUUwkAsVEog4z30SCbl9EKENFOQfyl2xYhzj2YzWvEJuSbvkD-kjHz-5gtgTKd4EsFcX0Ewg3jgqjv4EmUMAaGVJN8tkPahLj7YMKDzPyfkl4GxQlphj1eAZvJmhuijajE3_0rUgjLx7D0P3HLID6pkPXrkGJqKZnjxxAFg1g May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 346e3945e25c4638bef347149d914e61 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/346e3945e25c4638bef347149d914e61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_346e3945e25c4638bef347149d914e61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-642791081 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 346e3945e25c4638bef347149d914e61 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-642791081-project May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 87d19ae04b1d4f0e9e23872d9c2cd0a4 May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-642791081-project May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 20b7780f-d310-45b9-b8f0-626c0433bb1b could not be found. May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '20b7780f-d310-45b9-b8f0-626c0433bb1b'} May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b7780f-d310-45b9-b8f0-626c0433bb1b could not be found. May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b7780f-d310-45b9-b8f0-626c0433bb1b could not be found. May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:49.359283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:49.364283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:49.364283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:49.364283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:49.364283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:53:49.364283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:53:49.364283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b7780f-d310-45b9-b8f0-626c0433bb1b could not be found. May 19 04:53:49.364283 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:49.364283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Returning 404 to user: Instance 20b7780f-d310-45b9-b8f0-626c0433bb1b could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:53:49.364283 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d11163e2-315b-4f89-ad8a-0b485bdc34d9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b" status: 404 len: 111 microversion: 2.1 time: 0.104790 May 19 04:53:49.365953 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2451/5009] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:49 2022] GET /compute/v2.1/servers/20b7780f-d310-45b9-b8f0-626c0433bb1b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:53:49.371790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c773cdf6-f307-4325-b678-ce14b4ac70e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:49.372285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c773cdf6-f307-4325-b678-ce14b4ac70e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:49.382215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c773cdf6-f307-4325-b678-ce14b4ac70e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:49.382667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c773cdf6-f307-4325-b678-ce14b4ac70e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:49.383442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c773cdf6-f307-4325-b678-ce14b4ac70e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:49.389571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c773cdf6-f307-4325-b678-ce14b4ac70e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:49.453957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c773cdf6-f307-4325-b678-ce14b4ac70e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:53:49.643654 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c773cdf6-f307-4325-b678-ce14b4ac70e7 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "DELETE /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 204 len: 0 microversion: 2.1 time: 0.276075 May 19 04:53:49.652505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd74710b-b810-49ca-b071-703694e0c9b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:49.653446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fd74710b-b810-49ca-b071-703694e0c9b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:49.655872 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2559/5010] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:53:49 2022] DELETE /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:53:49.663726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd74710b-b810-49ca-b071-703694e0c9b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:49.667676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd74710b-b810-49ca-b071-703694e0c9b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:49.673345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd74710b-b810-49ca-b071-703694e0c9b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:49.674199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd74710b-b810-49ca-b071-703694e0c9b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:49.973571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6fd801d6-b0a3-4a9f-a801-e09f7f3145a3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:49.974438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6fd801d6-b0a3-4a9f-a801-e09f7f3145a3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:49.992943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6fd801d6-b0a3-4a9f-a801-e09f7f3145a3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:49.993482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6fd801d6-b0a3-4a9f-a801-e09f7f3145a3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:49.994265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6fd801d6-b0a3-4a9f-a801-e09f7f3145a3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:49.994919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6fd801d6-b0a3-4a9f-a801-e09f7f3145a3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:50.506965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd74710b-b810-49ca-b071-703694e0c9b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:50.520469 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd74710b-b810-49ca-b071-703694e0c9b6 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1508 microversion: 2.1 time: 0.871491 May 19 04:53:50.525637 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2452/5011] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:49 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1508 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:50.537601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9c4c0642-8b84-4b46-8fec-aa3e5a98818b req-130ccbe8-3dd4-4769-a01a-49b4e46f99b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b7780f-d310-45b9-b8f0-626c0433bb1b", "name": "network-vif-deleted", "tag": "36afb44e-1ea7-422f-9da7-e21ed8f55f6e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:50.559391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9c4c0642-8b84-4b46-8fec-aa3e5a98818b req-130ccbe8-3dd4-4769-a01a-49b4e46f99b9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:50.562601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9c4c0642-8b84-4b46-8fec-aa3e5a98818b req-130ccbe8-3dd4-4769-a01a-49b4e46f99b9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:50.620111 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9c4c0642-8b84-4b46-8fec-aa3e5a98818b req-130ccbe8-3dd4-4769-a01a-49b4e46f99b9 service nova] Creating event network-vif-deleted:36afb44e-1ea7-422f-9da7-e21ed8f55f6e for instance 20b7780f-d310-45b9-b8f0-626c0433bb1b on n-h2-766726-30 May 19 04:53:50.638289 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9c4c0642-8b84-4b46-8fec-aa3e5a98818b req-130ccbe8-3dd4-4769-a01a-49b4e46f99b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111118 May 19 04:53:50.646885 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2453/5012] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:53:50.725356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6fd801d6-b0a3-4a9f-a801-e09f7f3145a3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:50.736786 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6fd801d6-b0a3-4a9f-a801-e09f7f3145a3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.791919 May 19 04:53:50.741648 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2560/5013] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:49 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:51.541573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6cc36bd9-423e-4390-afe2-e913fe798e30 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:51.542823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6cc36bd9-423e-4390-afe2-e913fe798e30 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:51.545866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:51.548429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=12 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:51.556116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cc36bd9-423e-4390-afe2-e913fe798e30 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:51.557128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cc36bd9-423e-4390-afe2-e913fe798e30 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:51.558331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cc36bd9-423e-4390-afe2-e913fe798e30 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:51.559003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cc36bd9-423e-4390-afe2-e913fe798e30 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:51.759103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e7f14ed4-e7d1-4725-818c-279cf0f448b8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:51.760433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e7f14ed4-e7d1-4725-818c-279cf0f448b8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:51.778382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7f14ed4-e7d1-4725-818c-279cf0f448b8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:51.780718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7f14ed4-e7d1-4725-818c-279cf0f448b8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:51.782915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7f14ed4-e7d1-4725-818c-279cf0f448b8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:51.784558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7f14ed4-e7d1-4725-818c-279cf0f448b8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:52.512886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e7f14ed4-e7d1-4725-818c-279cf0f448b8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:52.529472 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e7f14ed4-e7d1-4725-818c-279cf0f448b8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.773155 May 19 04:53:52.543841 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2561/5014] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:51 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:52.553621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fcfd2e42-7a27-494b-8b52-b10dc41953d6 req-83451b1a-cf0a-4c81-88b4-0a0b3c8606de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bd7ce2-12b8-4198-a5c2-9b68fe7c9732", "name": "network-vif-deleted", "tag": "58124628-f4db-49df-91e7-d61322a39a88"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:52.568827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fcfd2e42-7a27-494b-8b52-b10dc41953d6 req-83451b1a-cf0a-4c81-88b4-0a0b3c8606de service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:52.569901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fcfd2e42-7a27-494b-8b52-b10dc41953d6 req-83451b1a-cf0a-4c81-88b4-0a0b3c8606de service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:52.594977 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fcfd2e42-7a27-494b-8b52-b10dc41953d6 req-83451b1a-cf0a-4c81-88b4-0a0b3c8606de service nova] Creating event network-vif-deleted:58124628-f4db-49df-91e7-d61322a39a88 for instance 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 on n-h1-766726-30 May 19 04:53:52.602925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fcfd2e42-7a27-494b-8b52-b10dc41953d6 req-83451b1a-cf0a-4c81-88b4-0a0b3c8606de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065804 May 19 04:53:52.603992 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2562/5015] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:53:52.665615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6cc36bd9-423e-4390-afe2-e913fe798e30 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:52.674873 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6cc36bd9-423e-4390-afe2-e913fe798e30 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 200 len: 1508 microversion: 2.1 time: 1.140511 May 19 04:53:52.681570 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2454/5016] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:51 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 1508 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:53.553726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1850159-8073-4cfa-ac35-802931427aa5 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:53.554439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1850159-8073-4cfa-ac35-802931427aa5 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:53.566810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1850159-8073-4cfa-ac35-802931427aa5 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:53.570561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1850159-8073-4cfa-ac35-802931427aa5 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:53.571442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1850159-8073-4cfa-ac35-802931427aa5 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:53.571893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1850159-8073-4cfa-ac35-802931427aa5 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:53.698511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:53.700812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:53.719742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:53.720205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:53.720996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:53.723838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:53.754755 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] HTTP exception thrown: Instance 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 could not be found. May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Request method failure captured: May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 HTTP/1.1 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihct_APeUUwkAsVEog4z30SCbl9EKENFOQfyl2xYhzj2YzWvEJuSbvkD-kjHz-5gtgTKd4EsFcX0Ewg3jgqjv4EmUMAaGVJN8tkPahLj7YMKDzPyfkl4GxQlphj1eAZvJmhuijajE3_0rUgjLx7D0P3HLID6pkPXrkGJqKZnjxxAFg1g May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 346e3945e25c4638bef347149d914e61 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/346e3945e25c4638bef347149d914e61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_346e3945e25c4638bef347149d914e61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-642791081 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 346e3945e25c4638bef347149d914e61 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-642791081-project May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 87d19ae04b1d4f0e9e23872d9c2cd0a4 May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-642791081-project May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 could not be found. May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '98bd7ce2-12b8-4198-a5c2-9b68fe7c9732'} May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 could not be found. May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 could not be found. May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:53.756733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:53.761455 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:53.761455 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:53.761455 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:53.761455 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:53:53.761455 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:53:53.761455 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 could not be found. May 19 04:53:53.761455 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:53.764977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Returning 404 to user: Instance 98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:53:53.770148 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-018b8855-dfa2-40b9-9275-8a2961511d3d tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732" status: 404 len: 111 microversion: 2.1 time: 0.076682 May 19 04:53:53.773988 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2455/5017] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:53 2022] GET /compute/v2.1/servers/98bd7ce2-12b8-4198-a5c2-9b68fe7c9732 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 04:53:53.784892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61b9dfd8-75fa-4897-be9c-d856628befa9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:53.785787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-61b9dfd8-75fa-4897-be9c-d856628befa9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:53.800711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61b9dfd8-75fa-4897-be9c-d856628befa9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:53.801444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61b9dfd8-75fa-4897-be9c-d856628befa9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:53.802417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61b9dfd8-75fa-4897-be9c-d856628befa9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:53.805333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61b9dfd8-75fa-4897-be9c-d856628befa9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:53.860106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-61b9dfd8-75fa-4897-be9c-d856628befa9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:53:53.922109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1850159-8073-4cfa-ac35-802931427aa5 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:53.930225 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1850159-8073-4cfa-ac35-802931427aa5 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.381747 May 19 04:53:53.935152 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2563/5018] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:53 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:53.945414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:54.055784 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-61b9dfd8-75fa-4897-be9c-d856628befa9 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "DELETE /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 204 len: 0 microversion: 2.1 time: 0.279551 May 19 04:53:54.057163 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2456/5019] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:53:53 2022] DELETE /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:53:54.068379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-436f6ea6-e6d3-474f-99d3-d2fc488d19be tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:54.069956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-436f6ea6-e6d3-474f-99d3-d2fc488d19be tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:54.079803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-436f6ea6-e6d3-474f-99d3-d2fc488d19be tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:54.080572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-436f6ea6-e6d3-474f-99d3-d2fc488d19be tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:54.081654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-436f6ea6-e6d3-474f-99d3-d2fc488d19be tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:54.082296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-436f6ea6-e6d3-474f-99d3-d2fc488d19be tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:54.645924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-436f6ea6-e6d3-474f-99d3-d2fc488d19be tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:54.657474 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-436f6ea6-e6d3-474f-99d3-d2fc488d19be tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1494 microversion: 2.1 time: 0.594752 May 19 04:53:54.658654 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2564/5020] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:54 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1494 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:54.947055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b501ad79-39a2-4b59-8757-1ce754387320 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:54.948538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b501ad79-39a2-4b59-8757-1ce754387320 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:54.962619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b501ad79-39a2-4b59-8757-1ce754387320 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:54.963359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b501ad79-39a2-4b59-8757-1ce754387320 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:54.964382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b501ad79-39a2-4b59-8757-1ce754387320 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:54.965048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b501ad79-39a2-4b59-8757-1ce754387320 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:55.371814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b501ad79-39a2-4b59-8757-1ce754387320 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:55.379920 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b501ad79-39a2-4b59-8757-1ce754387320 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.437191 May 19 04:53:55.385047 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2457/5021] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:54 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:55.677583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e48308e-fc97-4a30-9a12-0c12785e6c32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:55.678461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e48308e-fc97-4a30-9a12-0c12785e6c32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:55.693815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e48308e-fc97-4a30-9a12-0c12785e6c32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:55.694548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e48308e-fc97-4a30-9a12-0c12785e6c32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:55.695537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e48308e-fc97-4a30-9a12-0c12785e6c32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:55.697811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e48308e-fc97-4a30-9a12-0c12785e6c32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:55.923340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2104924642", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "a27101e5-12cf-4a2f-988f-b86045a72d3f"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:56.013216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] validate_networks() for [('a27101e5-12cf-4a2f-988f-b86045a72d3f', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:53:56.388578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e48308e-fc97-4a30-9a12-0c12785e6c32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:56.401663 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e48308e-fc97-4a30-9a12-0c12785e6c32 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 200 len: 1452 microversion: 2.1 time: 0.730754 May 19 04:53:56.403185 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2458/5022] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:55 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 1452 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:56.411665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cac3242c-105e-447a-80c8-795122be43ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:56.414829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cac3242c-105e-447a-80c8-795122be43ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:56.424863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cac3242c-105e-447a-80c8-795122be43ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:56.427275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cac3242c-105e-447a-80c8-795122be43ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:56.428467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cac3242c-105e-447a-80c8-795122be43ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:56.429160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cac3242c-105e-447a-80c8-795122be43ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.126906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cac3242c-105e-447a-80c8-795122be43ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:57.135624 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cac3242c-105e-447a-80c8-795122be43ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.731055 May 19 04:53:57.140809 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2459/5023] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:56 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:57.156167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-12f8b685-30a8-48b1-998e-3d569460a3f1 req-bc48bc6c-e7ba-459f-82d6-a705f996b725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3e8348-e01c-4df9-84b1-b13607f495a2", "name": "network-vif-deleted", "tag": "0e54c145-1ac9-45b7-9f2f-916911e6deab"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:57.172207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-12f8b685-30a8-48b1-998e-3d569460a3f1 req-bc48bc6c-e7ba-459f-82d6-a705f996b725 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.172890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-12f8b685-30a8-48b1-998e-3d569460a3f1 req-bc48bc6c-e7ba-459f-82d6-a705f996b725 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.203706 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-12f8b685-30a8-48b1-998e-3d569460a3f1 req-bc48bc6c-e7ba-459f-82d6-a705f996b725 service nova] Creating event network-vif-deleted:0e54c145-1ac9-45b7-9f2f-916911e6deab for instance db3e8348-e01c-4df9-84b1-b13607f495a2 on n-h2-766726-30 May 19 04:53:57.221176 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-12f8b685-30a8-48b1-998e-3d569460a3f1 req-bc48bc6c-e7ba-459f-82d6-a705f996b725 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078792 May 19 04:53:57.222486 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2460/5024] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:53:57.228932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-78c64e4a-0d80-430c-9e27-887deadbb8e2 req-558ec985-a1c1-42c2-8788-45626c5d6261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c54667-4cff-44ff-bf2d-776532b44bbb", "name": "network-vif-plugged", "status": "completed", "tag": "c98aad4d-3582-4e76-bd48-1c48c6206d54"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:53:57.256636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-78c64e4a-0d80-430c-9e27-887deadbb8e2 req-558ec985-a1c1-42c2-8788-45626c5d6261 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.257422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-78c64e4a-0d80-430c-9e27-887deadbb8e2 req-558ec985-a1c1-42c2-8788-45626c5d6261 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.276535 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-78c64e4a-0d80-430c-9e27-887deadbb8e2 req-558ec985-a1c1-42c2-8788-45626c5d6261 service nova] Creating event network-vif-plugged:c98aad4d-3582-4e76-bd48-1c48c6206d54 for instance b0c54667-4cff-44ff-bf2d-776532b44bbb on n-h2-766726-30 May 19 04:53:57.285289 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-78c64e4a-0d80-430c-9e27-887deadbb8e2 req-558ec985-a1c1-42c2-8788-45626c5d6261 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061140 May 19 04:53:57.297918 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2461/5025] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:53:57.423291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:57.424729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: db3e8348-e01c-4df9-84b1-b13607f495a2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:57.441311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.445150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.446356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.452275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.486264 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] HTTP exception thrown: Instance db3e8348-e01c-4df9-84b1-b13607f495a2 could not be found. May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Request method failure captured: May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 HTTP/1.1 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihct_APeUUwkAsVEog4z30SCbl9EKENFOQfyl2xYhzj2YzWvEJuSbvkD-kjHz-5gtgTKd4EsFcX0Ewg3jgqjv4EmUMAaGVJN8tkPahLj7YMKDzPyfkl4GxQlphj1eAZvJmhuijajE3_0rUgjLx7D0P3HLID6pkPXrkGJqKZnjxxAFg1g May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 346e3945e25c4638bef347149d914e61 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/346e3945e25c4638bef347149d914e61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_346e3945e25c4638bef347149d914e61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-642791081 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 346e3945e25c4638bef347149d914e61 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-642791081-project May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 87d19ae04b1d4f0e9e23872d9c2cd0a4 May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-642791081-project May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance db3e8348-e01c-4df9-84b1-b13607f495a2 could not be found. May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'db3e8348-e01c-4df9-84b1-b13607f495a2'} May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3e8348-e01c-4df9-84b1-b13607f495a2 could not be found. May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3e8348-e01c-4df9-84b1-b13607f495a2 could not be found. May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:53:57.494604 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:57.498451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:53:57.498451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:53:57.498451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:53:57.498451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:53:57.498451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:53:57.498451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3e8348-e01c-4df9-84b1-b13607f495a2 could not be found. May 19 04:53:57.498451 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:53:57.500556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Returning 404 to user: Instance db3e8348-e01c-4df9-84b1-b13607f495a2 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:53:57.501736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-efefd909-8dd1-435a-b991-cabb40ba0a83 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2" status: 404 len: 111 microversion: 2.1 time: 0.085284 May 19 04:53:57.503491 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2462/5026] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:57 2022] GET /compute/v2.1/servers/db3e8348-e01c-4df9-84b1-b13607f495a2 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:53:57.515401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3003317e-37ae-44c9-b9db-b8eb45787256 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:57.516273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3003317e-37ae-44c9-b9db-b8eb45787256 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:57.526410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:53:57.527390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:53:57.528094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:53:57.528929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:53:57.530447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:53:57.533182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:53:57.558770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3003317e-37ae-44c9-b9db-b8eb45787256 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.560518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.561260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3003317e-37ae-44c9-b9db-b8eb45787256 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.562915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3003317e-37ae-44c9-b9db-b8eb45787256 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.563580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.565128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3003317e-37ae-44c9-b9db-b8eb45787256 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.567007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.567714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.643554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Getting quotas for project 4323b9ee49f1481bbcfe7679ca57016f. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:53:57.654946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3003317e-37ae-44c9-b9db-b8eb45787256 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:53:57.667033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Getting quotas for user cc799d5d90bf49c28182dca25f656aaf and project 4323b9ee49f1481bbcfe7679ca57016f. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:53:57.691563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:53:57.724584 n-d-766726-30 devstack@n-api.service[124818]: WARNING nova.utils [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2104924642 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-210492464 May 19 04:53:57.725385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:53:57.840197 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3003317e-37ae-44c9-b9db-b8eb45787256 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "DELETE /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 204 len: 0 microversion: 2.1 time: 0.327958 May 19 04:53:57.842504 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2463/5027] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:53:57 2022] DELETE /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:53:57.857328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c265b54-78a3-49cd-a316-1e0810ce6ff2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:57.859568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c265b54-78a3-49cd-a316-1e0810ce6ff2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:57.871805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c265b54-78a3-49cd-a316-1e0810ce6ff2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.872489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c265b54-78a3-49cd-a316-1e0810ce6ff2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.874319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c265b54-78a3-49cd-a316-1e0810ce6ff2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:57.875599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c265b54-78a3-49cd-a316-1e0810ce6ff2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:57.887869 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd08aeaa-fc4b-47bd-bdac-88f9803a554b tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.278282 May 19 04:53:57.889115 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2565/5028] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:53:57.932235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa7c0544-921e-404b-a3ec-8ab82abc3274 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:57.932857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aa7c0544-921e-404b-a3ec-8ab82abc3274 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:58.181479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aa7c0544-921e-404b-a3ec-8ab82abc3274 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:58.195490 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa7c0544-921e-404b-a3ec-8ab82abc3274 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1232 microversion: 2.1 time: 0.298742 May 19 04:53:58.196720 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2566/5029] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:57 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1232 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:58.208197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a965ae3-2a37-4aa5-a2d5-3722fec98be3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:58.212517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2a965ae3-2a37-4aa5-a2d5-3722fec98be3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:58.224977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a965ae3-2a37-4aa5-a2d5-3722fec98be3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:58.225918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a965ae3-2a37-4aa5-a2d5-3722fec98be3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:58.228713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a965ae3-2a37-4aa5-a2d5-3722fec98be3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:58.229424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a965ae3-2a37-4aa5-a2d5-3722fec98be3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:58.862110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0c265b54-78a3-49cd-a316-1e0810ce6ff2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:58.877151 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c265b54-78a3-49cd-a316-1e0810ce6ff2 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1674 microversion: 2.1 time: 1.027947 May 19 04:53:58.879227 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2464/5030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:57 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1674 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:58.944773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2a965ae3-2a37-4aa5-a2d5-3722fec98be3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:58.956203 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2a965ae3-2a37-4aa5-a2d5-3722fec98be3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.757190 May 19 04:53:58.956812 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2567/5031] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:58 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:59.214460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8fc69f90-8464-4283-aea5-ca35ca25bed6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:59.215189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8fc69f90-8464-4283-aea5-ca35ca25bed6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:59.235759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8fc69f90-8464-4283-aea5-ca35ca25bed6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:59.244806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8fc69f90-8464-4283-aea5-ca35ca25bed6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:59.247351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8fc69f90-8464-4283-aea5-ca35ca25bed6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:59.252882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8fc69f90-8464-4283-aea5-ca35ca25bed6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:59.564414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8fc69f90-8464-4283-aea5-ca35ca25bed6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:53:59.574234 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8fc69f90-8464-4283-aea5-ca35ca25bed6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1284 microversion: 2.1 time: 0.364613 May 19 04:53:59.575082 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2465/5032] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:59 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:53:59.895843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47eefda6-0447-466f-a4e9-d05a9362d34e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:59.896479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47eefda6-0447-466f-a4e9-d05a9362d34e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:59.912708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47eefda6-0447-466f-a4e9-d05a9362d34e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:59.913205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47eefda6-0447-466f-a4e9-d05a9362d34e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:59.914057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47eefda6-0447-466f-a4e9-d05a9362d34e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:53:59.914453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47eefda6-0447-466f-a4e9-d05a9362d34e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:53:59.974854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-39a6a0f7-f653-4c62-9c36-5f4f8c41698d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:53:59.975472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-39a6a0f7-f653-4c62-9c36-5f4f8c41698d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:53:59.999129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39a6a0f7-f653-4c62-9c36-5f4f8c41698d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:00.003738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39a6a0f7-f653-4c62-9c36-5f4f8c41698d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:00.005674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39a6a0f7-f653-4c62-9c36-5f4f8c41698d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:00.008871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39a6a0f7-f653-4c62-9c36-5f4f8c41698d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:00.356389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47eefda6-0447-466f-a4e9-d05a9362d34e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:00.368477 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47eefda6-0447-466f-a4e9-d05a9362d34e tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1674 microversion: 2.1 time: 0.476690 May 19 04:54:00.370131 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2568/5033] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:59 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1674 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:00.548585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-39a6a0f7-f653-4c62-9c36-5f4f8c41698d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:00.576360 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-39a6a0f7-f653-4c62-9c36-5f4f8c41698d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1363 microversion: 2.1 time: 0.606092 May 19 04:54:00.581966 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2466/5034] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:53:59 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1363 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:00.595350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fd247ceb-1958-48cc-9a44-be92b1242e82 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:00.595490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fd247ceb-1958-48cc-9a44-be92b1242e82 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:00.614779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd247ceb-1958-48cc-9a44-be92b1242e82 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:00.615460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd247ceb-1958-48cc-9a44-be92b1242e82 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:00.616860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd247ceb-1958-48cc-9a44-be92b1242e82 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:00.617506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fd247ceb-1958-48cc-9a44-be92b1242e82 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:00.752802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fd247ceb-1958-48cc-9a44-be92b1242e82 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:00.765979 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fd247ceb-1958-48cc-9a44-be92b1242e82 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1290 microversion: 2.1 time: 0.177317 May 19 04:54:00.782446 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2569/5035] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:00 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1290 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:01.386630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ae4c5ea-8122-4fbf-8aff-885c60f2cd65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:01.387255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3ae4c5ea-8122-4fbf-8aff-885c60f2cd65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:01.413966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ae4c5ea-8122-4fbf-8aff-885c60f2cd65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:01.414438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ae4c5ea-8122-4fbf-8aff-885c60f2cd65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:01.415249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ae4c5ea-8122-4fbf-8aff-885c60f2cd65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:01.415697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ae4c5ea-8122-4fbf-8aff-885c60f2cd65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:01.598577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-42f0f844-31b6-4a16-b785-0bc5a483fb1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:01.599199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-42f0f844-31b6-4a16-b785-0bc5a483fb1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:01.614873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42f0f844-31b6-4a16-b785-0bc5a483fb1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:01.615575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3ae4c5ea-8122-4fbf-8aff-885c60f2cd65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d19ae04b1d4f0e9e23872d9c2cd0a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346e3945e25c4638bef347149d914e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:01.620153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42f0f844-31b6-4a16-b785-0bc5a483fb1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:01.621213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42f0f844-31b6-4a16-b785-0bc5a483fb1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:01.621866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42f0f844-31b6-4a16-b785-0bc5a483fb1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:01.628890 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ae4c5ea-8122-4fbf-8aff-885c60f2cd65 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 200 len: 1607 microversion: 2.1 time: 0.246365 May 19 04:54:01.629523 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2467/5036] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:01 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 1607 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:01.783839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d154974-fbd9-4f1d-8ae4-3bca6d1595c5 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:01.784679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d154974-fbd9-4f1d-8ae4-3bca6d1595c5 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:01.791771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d154974-fbd9-4f1d-8ae4-3bca6d1595c5 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:01.796560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d154974-fbd9-4f1d-8ae4-3bca6d1595c5 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:01.797774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d154974-fbd9-4f1d-8ae4-3bca6d1595c5 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:01.800112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d154974-fbd9-4f1d-8ae4-3bca6d1595c5 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:03.104686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6d154974-fbd9-4f1d-8ae4-3bca6d1595c5 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:03.117296 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d154974-fbd9-4f1d-8ae4-3bca6d1595c5 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 1.337129 May 19 04:54:03.119068 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2468/5037] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:01 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:54:03.133640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-646095ae-b691-4294-82fb-7d915e6ec761 req-b781f58e-9a00-4014-a25e-8a454fe86414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073cbfef-d688-44eb-b0f7-5bc688c5f888", "name": "network-vif-deleted", "tag": "5714230e-fb09-428d-9f25-49fc1e77c1be"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:03.158500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-646095ae-b691-4294-82fb-7d915e6ec761 req-b781f58e-9a00-4014-a25e-8a454fe86414 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:03.160621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-646095ae-b691-4294-82fb-7d915e6ec761 req-b781f58e-9a00-4014-a25e-8a454fe86414 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:03.181230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-42f0f844-31b6-4a16-b785-0bc5a483fb1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:03.198803 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-646095ae-b691-4294-82fb-7d915e6ec761 req-b781f58e-9a00-4014-a25e-8a454fe86414 service nova] Creating event network-vif-deleted:5714230e-fb09-428d-9f25-49fc1e77c1be for instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 on n-h2-766726-30 May 19 04:54:03.233686 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-42f0f844-31b6-4a16-b785-0bc5a483fb1c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1550 microversion: 2.1 time: 1.631979 May 19 04:54:03.235845 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-646095ae-b691-4294-82fb-7d915e6ec761 req-b781f58e-9a00-4014-a25e-8a454fe86414 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110386 May 19 04:54:03.236195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2570/5038] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:01 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1550 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:03.241767 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2469/5039] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:03.251314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:03.256254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] [instance: 073cbfef-d688-44eb-b0f7-5bc688c5f888] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:03.267022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6986b8df-e61d-42dd-af8b-d9da53b55b64 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:03.267624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6986b8df-e61d-42dd-af8b-d9da53b55b64 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:03.272607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:03.273866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:03.276556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:03.277260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:03.288719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6986b8df-e61d-42dd-af8b-d9da53b55b64 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:03.291702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6986b8df-e61d-42dd-af8b-d9da53b55b64 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:03.292527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6986b8df-e61d-42dd-af8b-d9da53b55b64 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:03.293154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6986b8df-e61d-42dd-af8b-d9da53b55b64 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:03.300685 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] HTTP exception thrown: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 could not be found. May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Request method failure captured: May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 HTTP/1.1 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihct_APeUUwkAsVEog4z30SCbl9EKENFOQfyl2xYhzj2YzWvEJuSbvkD-kjHz-5gtgTKd4EsFcX0Ewg3jgqjv4EmUMAaGVJN8tkPahLj7YMKDzPyfkl4GxQlphj1eAZvJmhuijajE3_0rUgjLx7D0P3HLID6pkPXrkGJqKZnjxxAFg1g May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 346e3945e25c4638bef347149d914e61 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/346e3945e25c4638bef347149d914e61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/346e3945e25c4638bef347149d914e61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_346e3945e25c4638bef347149d914e61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-642791081 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 346e3945e25c4638bef347149d914e61 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-642791081 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-642791081-project May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 87d19ae04b1d4f0e9e23872d9c2cd0a4 May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-642791081-project May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 could not be found. May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '073cbfef-d688-44eb-b0f7-5bc688c5f888'} May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 could not be found. May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 could not be found. May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:03.304255 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:03.308757 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:03.308757 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:03.308757 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:03.308757 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:54:03.308757 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:54:03.308757 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 could not be found. May 19 04:54:03.308757 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:03.327161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Returning 404 to user: Instance 073cbfef-d688-44eb-b0f7-5bc688c5f888 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:54:03.328305 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2771049-cd28-45bc-992b-3f2caa07b612 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888" status: 404 len: 111 microversion: 2.1 time: 0.086981 May 19 04:54:03.332307 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2571/5040] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:03 2022] GET /compute/v2.1/servers/073cbfef-d688-44eb-b0f7-5bc688c5f888 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:54:03.348158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-137591d7-a6b1-4f0a-af8d-5a1ba0929957 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] Calling method '.version_select at 0x7fd315eac8b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:03.381264 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-137591d7-a6b1-4f0a-af8d-5a1ba0929957 tempest-ServerActionsTestJSON-642791081 tempest-ServerActionsTestJSON-642791081-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-278839671" status: 202 len: 0 microversion: 2.1 time: 0.040408 May 19 04:54:03.382416 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2572/5041] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:54:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-278839671 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:54:03.514298 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6986b8df-e61d-42dd-af8b-d9da53b55b64 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.263608 May 19 04:54:03.515745 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2470/5042] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:54:03 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/os-interface => generated 285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:04.139441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f6940bbb-4f28-4e51-9935-a595d82bcb6f tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:04.140084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f6940bbb-4f28-4e51-9935-a595d82bcb6f tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:04.176090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6940bbb-4f28-4e51-9935-a595d82bcb6f tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:04.177017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6940bbb-4f28-4e51-9935-a595d82bcb6f tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:04.177883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6940bbb-4f28-4e51-9935-a595d82bcb6f tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:04.180701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f6940bbb-4f28-4e51-9935-a595d82bcb6f tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:04.878509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f6940bbb-4f28-4e51-9935-a595d82bcb6f tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:04.890159 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f6940bbb-4f28-4e51-9935-a595d82bcb6f tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 0.758360 May 19 04:54:04.896777 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2573/5043] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:04 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:05.912165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-68548399-d17f-43cd-8f4c-980ba9896c31 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:05.913524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-68548399-d17f-43cd-8f4c-980ba9896c31 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:05.934640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:05.943801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68548399-d17f-43cd-8f4c-980ba9896c31 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:05.944764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68548399-d17f-43cd-8f4c-980ba9896c31 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:05.947518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68548399-d17f-43cd-8f4c-980ba9896c31 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:05.948509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-68548399-d17f-43cd-8f4c-980ba9896c31 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:06.067951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3f02cf27-c2bf-4b23-9e54-ff840e506c1e req-1cb796e0-bbb5-454a-9a81-8a1d5809ce4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc9404a-e1ed-4ee5-97c0-454f45421267", "tag": "427b5b74-2341-44c8-9877-03e23a9e3aa1"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:06.094561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3f02cf27-c2bf-4b23-9e54-ff840e506c1e req-1cb796e0-bbb5-454a-9a81-8a1d5809ce4b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:06.095527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3f02cf27-c2bf-4b23-9e54-ff840e506c1e req-1cb796e0-bbb5-454a-9a81-8a1d5809ce4b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:06.157673 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3f02cf27-c2bf-4b23-9e54-ff840e506c1e req-1cb796e0-bbb5-454a-9a81-8a1d5809ce4b service nova] Creating event network-changed:427b5b74-2341-44c8-9877-03e23a9e3aa1 for instance dcc9404a-e1ed-4ee5-97c0-454f45421267 on n-h1-766726-30 May 19 04:54:06.165497 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3f02cf27-c2bf-4b23-9e54-ff840e506c1e req-1cb796e0-bbb5-454a-9a81-8a1d5809ce4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102133 May 19 04:54:06.166661 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2574/5044] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:54:06.552605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-68548399-d17f-43cd-8f4c-980ba9896c31 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:06.565215 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-68548399-d17f-43cd-8f4c-980ba9896c31 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 0.660679 May 19 04:54:06.566880 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2471/5045] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:05 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:06.662301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c7079cda-6a5d-4706-9374-ea54181976e1 req-70d0999c-61bc-4dcb-aaf2-7daf761b485f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c54667-4cff-44ff-bf2d-776532b44bbb", "tag": "c98aad4d-3582-4e76-bd48-1c48c6206d54"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:06.675119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c7079cda-6a5d-4706-9374-ea54181976e1 req-70d0999c-61bc-4dcb-aaf2-7daf761b485f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:06.680126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c7079cda-6a5d-4706-9374-ea54181976e1 req-70d0999c-61bc-4dcb-aaf2-7daf761b485f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:06.703753 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c7079cda-6a5d-4706-9374-ea54181976e1 req-70d0999c-61bc-4dcb-aaf2-7daf761b485f service nova] Creating event network-changed:c98aad4d-3582-4e76-bd48-1c48c6206d54 for instance b0c54667-4cff-44ff-bf2d-776532b44bbb on n-h2-766726-30 May 19 04:54:06.713283 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c7079cda-6a5d-4706-9374-ea54181976e1 req-70d0999c-61bc-4dcb-aaf2-7daf761b485f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055072 May 19 04:54:06.722052 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2575/5046] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:07.582304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aebf6073-5553-47c4-abb4-173a24e3ce83 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:07.583511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aebf6073-5553-47c4-abb4-173a24e3ce83 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:07.595880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aebf6073-5553-47c4-abb4-173a24e3ce83 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:07.596913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aebf6073-5553-47c4-abb4-173a24e3ce83 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:07.599454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aebf6073-5553-47c4-abb4-173a24e3ce83 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:07.602336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aebf6073-5553-47c4-abb4-173a24e3ce83 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:08.032346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aebf6073-5553-47c4-abb4-173a24e3ce83 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:08.045107 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aebf6073-5553-47c4-abb4-173a24e3ce83 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 0.466223 May 19 04:54:08.055163 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2472/5047] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:07 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:09.065888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:09.067280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:09.072562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac0378b8-8e28-41df-a08d-de37e5f6925c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:09.073516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac0378b8-8e28-41df-a08d-de37e5f6925c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:09.092120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0378b8-8e28-41df-a08d-de37e5f6925c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:09.098380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0378b8-8e28-41df-a08d-de37e5f6925c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:09.099554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0378b8-8e28-41df-a08d-de37e5f6925c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:09.104238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0378b8-8e28-41df-a08d-de37e5f6925c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:09.474965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac0378b8-8e28-41df-a08d-de37e5f6925c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:09.483839 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac0378b8-8e28-41df-a08d-de37e5f6925c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 0.423809 May 19 04:54:09.485056 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2576/5048] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:09 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:10.503048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-01148256-dffa-4c83-9130-bccba33176a0 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:10.504573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-01148256-dffa-4c83-9130-bccba33176a0 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:10.524842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01148256-dffa-4c83-9130-bccba33176a0 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:10.525732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01148256-dffa-4c83-9130-bccba33176a0 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:10.526740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01148256-dffa-4c83-9130-bccba33176a0 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:10.527997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01148256-dffa-4c83-9130-bccba33176a0 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:11.254610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-01148256-dffa-4c83-9130-bccba33176a0 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:11.267097 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-01148256-dffa-4c83-9130-bccba33176a0 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 0.769628 May 19 04:54:11.271203 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2473/5049] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:10 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:12.286787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af38ba4a-4a9f-47c4-a050-4a09d32b2090 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:12.287790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af38ba4a-4a9f-47c4-a050-4a09d32b2090 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:12.306547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af38ba4a-4a9f-47c4-a050-4a09d32b2090 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:12.307249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af38ba4a-4a9f-47c4-a050-4a09d32b2090 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:12.308283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af38ba4a-4a9f-47c4-a050-4a09d32b2090 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:12.312717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af38ba4a-4a9f-47c4-a050-4a09d32b2090 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:12.321152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:12.766594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-af38ba4a-4a9f-47c4-a050-4a09d32b2090 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:12.787760 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af38ba4a-4a9f-47c4-a050-4a09d32b2090 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 0.504053 May 19 04:54:12.789571 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2577/5050] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:12 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:13.804415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f407f8b6-b0c4-4e96-bf3e-52ebaac22578 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:13.805030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f407f8b6-b0c4-4e96-bf3e-52ebaac22578 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:13.817171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f407f8b6-b0c4-4e96-bf3e-52ebaac22578 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:13.817587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f407f8b6-b0c4-4e96-bf3e-52ebaac22578 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:13.818387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f407f8b6-b0c4-4e96-bf3e-52ebaac22578 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:13.818828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f407f8b6-b0c4-4e96-bf3e-52ebaac22578 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:13.842110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:14.228057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f407f8b6-b0c4-4e96-bf3e-52ebaac22578 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:14.248215 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f407f8b6-b0c4-4e96-bf3e-52ebaac22578 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 0.446422 May 19 04:54:14.252852 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2474/5051] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:13 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:15.268528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e14a7d09-0e88-42a5-835d-5e2fa9193ccb tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:15.269975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e14a7d09-0e88-42a5-835d-5e2fa9193ccb tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:15.295425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e14a7d09-0e88-42a5-835d-5e2fa9193ccb tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:15.296167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e14a7d09-0e88-42a5-835d-5e2fa9193ccb tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:15.297157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e14a7d09-0e88-42a5-835d-5e2fa9193ccb tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:15.297768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e14a7d09-0e88-42a5-835d-5e2fa9193ccb tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:15.758835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-67676aba-0fe8-40f3-8722-31517cad43db req-22cbe13f-db64-4e0d-afe6-36a5ba621088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc9404a-e1ed-4ee5-97c0-454f45421267", "name": "network-vif-plugged", "status": "completed", "tag": "427b5b74-2341-44c8-9877-03e23a9e3aa1"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:15.774503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-67676aba-0fe8-40f3-8722-31517cad43db req-22cbe13f-db64-4e0d-afe6-36a5ba621088 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:15.775111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-67676aba-0fe8-40f3-8722-31517cad43db req-22cbe13f-db64-4e0d-afe6-36a5ba621088 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:15.805125 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-67676aba-0fe8-40f3-8722-31517cad43db req-22cbe13f-db64-4e0d-afe6-36a5ba621088 service nova] Creating event network-vif-plugged:427b5b74-2341-44c8-9877-03e23a9e3aa1 for instance dcc9404a-e1ed-4ee5-97c0-454f45421267 on n-h1-766726-30 May 19 04:54:15.812370 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-67676aba-0fe8-40f3-8722-31517cad43db req-22cbe13f-db64-4e0d-afe6-36a5ba621088 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060038 May 19 04:54:15.813718 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2475/5052] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:54:16.012961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e14a7d09-0e88-42a5-835d-5e2fa9193ccb tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:16.023453 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e14a7d09-0e88-42a5-835d-5e2fa9193ccb tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 0.758759 May 19 04:54:16.038130 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2578/5053] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:15 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:17.046156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cb22c7ef-79af-4920-92b9-8f44ed0bfe16 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:17.047023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb22c7ef-79af-4920-92b9-8f44ed0bfe16 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:17.057580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb22c7ef-79af-4920-92b9-8f44ed0bfe16 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:17.071512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb22c7ef-79af-4920-92b9-8f44ed0bfe16 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:17.078047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb22c7ef-79af-4920-92b9-8f44ed0bfe16 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:17.079783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb22c7ef-79af-4920-92b9-8f44ed0bfe16 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:17.131703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6e5397d3-987e-449a-b4b6-19db9b329a01 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:17.132787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6e5397d3-987e-449a-b4b6-19db9b329a01 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:17.144809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e5397d3-987e-449a-b4b6-19db9b329a01 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:17.151497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e5397d3-987e-449a-b4b6-19db9b329a01 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:17.152448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e5397d3-987e-449a-b4b6-19db9b329a01 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:17.158196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e5397d3-987e-449a-b4b6-19db9b329a01 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:17.213812 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6e5397d3-987e-449a-b4b6-19db9b329a01 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/ips" status: 200 len: 152 microversion: 2.20 time: 0.549311 May 19 04:54:17.214392 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2476/5054] 10.222.0.58 () {60 vars in 1288 bytes} [Thu May 19 04:54:16 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/ips => generated 152 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:54:17.567521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cb22c7ef-79af-4920-92b9-8f44ed0bfe16 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:17.581103 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cb22c7ef-79af-4920-92b9-8f44ed0bfe16 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1332 microversion: 2.1 time: 0.537851 May 19 04:54:17.583779 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2579/5055] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:17 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1332 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:18.600079 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-639a7ab5-085e-4e34-a863-75ea8b184415 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:18.603896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-639a7ab5-085e-4e34-a863-75ea8b184415 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:18.630650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-639a7ab5-085e-4e34-a863-75ea8b184415 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:18.631917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-639a7ab5-085e-4e34-a863-75ea8b184415 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:18.634825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-639a7ab5-085e-4e34-a863-75ea8b184415 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:18.635983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-639a7ab5-085e-4e34-a863-75ea8b184415 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:19.168616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-639a7ab5-085e-4e34-a863-75ea8b184415 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:19.180768 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-639a7ab5-085e-4e34-a863-75ea8b184415 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1536 microversion: 2.1 time: 0.584589 May 19 04:54:19.181513 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2477/5056] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:18 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1536 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:19.203852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2bf9bf99-b1fa-4087-9fc8-512522f239ec tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Action: 'create', calling method: .version_select at 0x7fd315dd35e0>, body: {"pool": "43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:21.244812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-341497210", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": "none"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:21.370788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:54:21.371337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:54:21.372355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:54:21.372769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:54:21.373271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:54:21.406294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:21.407155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:21.409158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:21.409879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:21.453711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Getting quotas for project 3f68d9ec597143cfa10f105ac8625cb3. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:54:21.482163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Getting quotas for user 7c4569a286c94afa8bb60be1c9da9ce6 and project 3f68d9ec597143cfa10f105ac8625cb3. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:54:21.529700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:54:21.532302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:54:21.627325 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a8ae43e5-6a31-44d9-8dd6-2fe4245998d0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.599743 May 19 04:54:21.632521 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2478/5057] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 04:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 19 04:54:21.642718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-893a23fb-5bac-44bf-a678-5c1d8b611d01 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:21.643718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-893a23fb-5bac-44bf-a678-5c1d8b611d01 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:22.201013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-893a23fb-5bac-44bf-a678-5c1d8b611d01 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:22.237173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-893a23fb-5bac-44bf-a678-5c1d8b611d01 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:22.243503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-893a23fb-5bac-44bf-a678-5c1d8b611d01 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:22.252636 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-893a23fb-5bac-44bf-a678-5c1d8b611d01 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 200 len: 1280 microversion: 2.47 time: 0.606274 May 19 04:54:22.256813 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2479/5058] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:21 2022] GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 1280 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:54:22.780168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9791406f-15b5-41c2-afbd-9898be55382d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:22.780729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9791406f-15b5-41c2-afbd-9898be55382d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:22.791502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9791406f-15b5-41c2-afbd-9898be55382d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:22.791970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9791406f-15b5-41c2-afbd-9898be55382d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:22.792767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9791406f-15b5-41c2-afbd-9898be55382d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:22.793236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9791406f-15b5-41c2-afbd-9898be55382d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:22.875749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-9791406f-15b5-41c2-afbd-9898be55382d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lazy-loading 'flavor' on Instance uuid ac690db0-97d0-40dc-9503-32c5474812ac {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:54:23.467963 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9791406f-15b5-41c2-afbd-9898be55382d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/action" status: 202 len: 0 microversion: 2.20 time: 0.693627 May 19 04:54:23.486778 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2480/5059] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:54:22 2022] POST /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:54:23.492850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:23.504139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:23.538941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:23.541900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:23.548402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:23.550226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:23.700987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:23.714101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:23.715829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:23.716986 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a94b791f-71c2-40d1-9f7a-d26e19697d61 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 200 len: 1332 microversion: 2.47 time: 0.228720 May 19 04:54:23.733687 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2481/5060] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:23 2022] GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 1332 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:23.740007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:23.740928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:23.751718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:23.752270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:23.754856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:23.755321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:24.010308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:24.020046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:24.021945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:24.023458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0532cbca-1468-447d-b64b-02352b58f20b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1724 microversion: 2.20 time: 0.288574 May 19 04:54:24.031526 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2482/5061] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:23 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:24.074050 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2bf9bf99-b1fa-4087-9fc8-512522f239ec tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.878740 May 19 04:54:24.074669 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2580/5062] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:54:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:24.086408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.187"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:24.087574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:24.105505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:24.107291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:24.109392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:24.110057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:24.150550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Acquired lock "refresh_cache-dcc9404a-e1ed-4ee5-97c0-454f45421267" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:54:24.741507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:24.742141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:24.760735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:24.766395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:24.792958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:24.815176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:25.061999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:25.081532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:25.089644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:25.091585 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-29c47368-700d-499d-8076-9b59ac7bafca tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 200 len: 1338 microversion: 2.47 time: 0.355769 May 19 04:54:25.092184 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2581/5063] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:24 2022] GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 1338 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:25.096662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:25.097303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:25.123509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:25.123959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:25.128984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:25.129611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:25.543338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:25.573580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:25.579039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:25.589456 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f98d159-9bc4-4e15-9f8a-5bc3ce27c238 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1724 microversion: 2.20 time: 0.493433 May 19 04:54:25.592073 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2582/5064] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:25 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1724 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:26.111589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:26.112572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:26.131312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:26.131765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:26.132603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:26.134928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:26.567850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:26.582714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:26.586369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:26.597942 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f919b1dd-ba04-41e4-a74b-8aed1ccfcad6 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 200 len: 1338 microversion: 2.47 time: 0.491417 May 19 04:54:26.598830 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2583/5065] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:26 2022] GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 1338 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:54:26.615329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:26.616135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:26.630380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:26.631065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:26.639783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:26.640582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:27.090099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:27.110531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:27.112584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:27.113922 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a245cb1-afdb-4521-a04e-6985d536c3ba tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1724 microversion: 2.20 time: 0.503213 May 19 04:54:27.115269 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2584/5066] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:26 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1724 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:27.129644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Building network info cache for instance {{(pid=124819) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:54:27.138425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ecb1a40a-753c-4b57-9138-5abbe5721c5f req-db7ce31c-cbd3-4607-b2d9-bb273a44099e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc9404a-e1ed-4ee5-97c0-454f45421267", "tag": "427b5b74-2341-44c8-9877-03e23a9e3aa1"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:27.154013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ecb1a40a-753c-4b57-9138-5abbe5721c5f req-db7ce31c-cbd3-4607-b2d9-bb273a44099e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:27.159369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ecb1a40a-753c-4b57-9138-5abbe5721c5f req-db7ce31c-cbd3-4607-b2d9-bb273a44099e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:27.181766 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ecb1a40a-753c-4b57-9138-5abbe5721c5f req-db7ce31c-cbd3-4607-b2d9-bb273a44099e service nova] Creating event network-changed:427b5b74-2341-44c8-9877-03e23a9e3aa1 for instance dcc9404a-e1ed-4ee5-97c0-454f45421267 on n-h1-766726-30 May 19 04:54:27.199551 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ecb1a40a-753c-4b57-9138-5abbe5721c5f req-db7ce31c-cbd3-4607-b2d9-bb273a44099e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065328 May 19 04:54:27.201589 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2585/5067] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:27.620404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:27.622206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:27.635098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:27.636238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:27.637901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:27.638518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:27.785696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:27.799955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:27.810652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:27.812211 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f94afe78-a443-4d57-9df2-3ab84bcd3365 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 200 len: 1359 microversion: 2.47 time: 0.196357 May 19 04:54:27.812970 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2586/5068] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:27 2022] GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:27.830693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b32444e-4a1d-43e0-8a8e-ff2f5bfd50f0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1215336039"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:27.833266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b32444e-4a1d-43e0-8a8e-ff2f5bfd50f0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:27.838989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:27.840902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b32444e-4a1d-43e0-8a8e-ff2f5bfd50f0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:27.841689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b32444e-4a1d-43e0-8a8e-ff2f5bfd50f0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:27.842871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b32444e-4a1d-43e0-8a8e-ff2f5bfd50f0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:27.843544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b32444e-4a1d-43e0-8a8e-ff2f5bfd50f0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:28.405554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Updating instance_info_cache with network_info: [{"id": "427b5b74-2341-44c8-9877-03e23a9e3aa1", "address": "fa:16:3e:c9:94:89", "network": {"id": "a27101e5-12cf-4a2f-988f-b86045a72d3f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-984782428-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4323b9ee49f1481bbcfe7679ca57016f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap427b5b74-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124819) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:54:28.427918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Releasing lock "refresh_cache-dcc9404a-e1ed-4ee5-97c0-454f45421267" {{(pid=124819) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:54:28.429370 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b7d75896-b042-4953-aee1-27f0654369a6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action" status: 202 len: 0 microversion: 2.1 time: 4.346865 May 19 04:54:28.435264 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2483/5069] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:54:24 2022] POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action => generated 0 bytes in 4353 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 04:54:28.450097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:28.453007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:28.470111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:28.470846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:28.471879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:28.472532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:28.485377 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b32444e-4a1d-43e0-8a8e-ff2f5bfd50f0 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "POST /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47/action" status: 202 len: 52 microversion: 2.47 time: 0.656040 May 19 04:54:28.491087 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2587/5070] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:54:27 2022] POST /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47/action => generated 52 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) May 19 04:54:28.508540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f15fdf0-4ba1-4ea5-a743-d4127677e3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Action: 'create', calling method: .version_select at 0x7fd315592e50>, body: {"pool": "43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b"} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:28.853211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:28.870700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:28.879212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:28.880769 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b38fe455-6705-4fb2-940a-792ac52275c2 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1724 microversion: 2.20 time: 0.444380 May 19 04:54:28.881648 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2484/5071] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:28 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:28.901159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-853a0dd0-e689-4f2a-a224-5f2a844c2b4a tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:28.902060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-853a0dd0-e689-4f2a-a224-5f2a844c2b4a tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:28.926721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-853a0dd0-e689-4f2a-a224-5f2a844c2b4a tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:28.927186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-853a0dd0-e689-4f2a-a224-5f2a844c2b4a tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:28.928071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-853a0dd0-e689-4f2a-a224-5f2a844c2b4a tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:28.928549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-853a0dd0-e689-4f2a-a224-5f2a844c2b4a tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:29.001568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-853a0dd0-e689-4f2a-a224-5f2a844c2b4a tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:54:29.241122 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-853a0dd0-e689-4f2a-a224-5f2a844c2b4a tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 204 len: 0 microversion: 2.47 time: 0.337909 May 19 04:54:29.245757 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2485/5072] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:54:28 2022] DELETE /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:54:29.251745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:29.252451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:29.285134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:29.285615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:29.286426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:29.286880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:29.688419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:29.703584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:29.723423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:29.727503 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f727eb09-36ef-4f9f-b6dc-b915d8bc0423 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 200 len: 1365 microversion: 2.47 time: 0.480074 May 19 04:54:29.729548 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2486/5073] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:29 2022] GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 1365 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:54:29.902141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:29.903000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:29.911798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:29.912812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:29.913672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:29.914300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:30.744421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:30.765628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:30.767442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:30.768894 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6ac8674b-dc56-46de-98aa-1c454844b7ac tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1724 microversion: 2.20 time: 0.872622 May 19 04:54:30.780435 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2487/5074] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:29 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1724 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:54:30.785630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:30.786540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:30.793252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:30.793991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:30.794985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:30.795642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:30.998211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:31.014783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:31.019611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:31.023819 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-751dc5a1-6bc6-488d-90c0-a28836e898b7 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 200 len: 1365 microversion: 2.47 time: 0.240449 May 19 04:54:31.026233 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2488/5075] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:30 2022] GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:31.790266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:31.794102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:31.799747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:31.805361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:31.806500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:31.807838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:31.813901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:31.853959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:32.207469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:32.352485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:32.373709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:32.375585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:32.380069 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3e358fb3-91c9-4aba-b53d-90def53b5d6d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1724 microversion: 2.20 time: 0.593305 May 19 04:54:32.380781 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2489/5076] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:31 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1724 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:32.387984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:32.389194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:32.398352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:32.399424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:32.400448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:32.401290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:32.616365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:32.627612 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5f15fdf0-4ba1-4ea5-a743-d4127677e3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.134857 May 19 04:54:32.633235 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2588/5077] 10.222.0.58 () {60 vars in 1169 bytes} [Thu May 19 04:54:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:32.646328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Action: 'action', calling method: .version_select at 0x7fd3187b0ee0>, body: {"addFloatingIp": {"address": "172.25.4.117"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:32.647563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:32.655599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:32.660694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c4569a286c94afa8bb60be1c9da9ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f68d9ec597143cfa10f105ac8625cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:32.669600 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afaba580-fe3f-4e5c-a810-a1d760472828 tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 200 len: 1365 microversion: 2.47 time: 0.285679 May 19 04:54:32.683038 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2490/5078] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:32 2022] GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:32.683257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:32.683257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:32.683257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:32.683257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:32.723540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Acquired lock "refresh_cache-dcc9404a-e1ed-4ee5-97c0-454f45421267" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:54:33.391141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG neutronclient.v2_0.client [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.117 (9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae) with port 427b5b74-2341-44c8-9877-03e23a9e3aa1 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b.", "detail": ""}} {{(pid=124818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:54:33.391839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Releasing lock "refresh_cache-dcc9404a-e1ed-4ee5-97c0-454f45421267" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:54:33.392477 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.117 (9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae) with port 427b5b74-2341-44c8-9877-03e23a9e3aa1 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b. May 19 04:54:33.392477 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-f0cda552-dee1-4614-83c0-2598d7bc6053'] May 19 04:54:33.399312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:33.399963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:33.407044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:33.407502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:33.408413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:33.409038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Request method failure captured: May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action HTTP/1.1 May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 46 May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc1jMWCvnhfN4li3Dl5gH0m8kgsjVJjn9jQVLw-NUEPtuiLTOZfOisiYfKDYjAt_UfAhrgxtcS-alVjNBknspFgsGFwh91J_t0NieDlGyXXgCTouLCXmU57nDnEHd4tTpDEbod_Ul8QyNOXBYRV83FErR5QmL29YaeXeIJambQLGgCU May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: cc799d5d90bf49c28182dca25f656aaf May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: {"addFloatingIp": {"address": "172.25.4.117"}} May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot associate floating IP 172.25.4.117 (9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae) with port 427b5b74-2341-44c8-9877-03e23a9e3aa1 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b. May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-f0cda552-dee1-4614-83c0-2598d7bc6053'] May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'dcc9404a-e1ed-4ee5-97c0-454f45421267', 'body': {'addFloatingIp': {'address': '172.25.4.117'}}} May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2688, in associate_floating_ip May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:54:33.416113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.117 (9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae) with port 427b5b74-2341-44c8-9877-03e23a9e3aa1 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b. May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0cda552-dee1-4614-83c0-2598d7bc6053'] May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2690, in associate_floating_ip May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.117 (9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae) with port 427b5b74-2341-44c8-9877-03e23a9e3aa1 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b. May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0cda552-dee1-4614-83c0-2598d7bc6053'] May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.117 (9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae) with port 427b5b74-2341-44c8-9877-03e23a9e3aa1 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b. May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0cda552-dee1-4614-83c0-2598d7bc6053'] May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.117 (9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae) with port 427b5b74-2341-44c8-9877-03e23a9e3aa1 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b. May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0cda552-dee1-4614-83c0-2598d7bc6053'] May 19 04:54:33.420651 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:33.427164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Returning 400 to user: Cannot associate floating IP 172.25.4.117 (9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae) with port 427b5b74-2341-44c8-9877-03e23a9e3aa1 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 43a13c6b-2c7b-4d10-b6b5-2a6b471dde1b. May 19 04:54:33.427164 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-f0cda552-dee1-4614-83c0-2598d7bc6053'] {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:54:33.429405 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d0875a28-71b4-48c8-8af8-9980094e3e5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action" status: 400 len: 382 microversion: 2.1 time: 0.793885 May 19 04:54:33.430491 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2589/5079] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:54:32 2022] POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action => generated 382 bytes in 795 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:54:33.441679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41aed0ec-a15c-4992-a95a-67f4ba2a7b5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '.version_select at 0x7fd315590550>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:33.729840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:33.745346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:33.751244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:33.755748 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e081e1ed-b379-4731-8a2c-ddd7c24190d8 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1724 microversion: 2.20 time: 0.360581 May 19 04:54:33.757006 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2491/5080] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:33 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:54:33.762704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:33.763479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] [instance: eee60661-bc27-437d-8a63-24dbeb2d7e47] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:33.770838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:33.776564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:33.778337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:33.778949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:33.816148 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] HTTP exception thrown: Instance eee60661-bc27-437d-8a63-24dbeb2d7e47 could not be found. May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Request method failure captured: May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 HTTP/1.1 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc18OJm-PZwCI4p9pFfz9ov0Crsu8wHwOB8-uDwK2nurfwsQIz_ob_RyLKTu8Qfy2Q0R6d8_lHdYkzTpF39VFqIRdU2MaOwT6AvXUi2uKOX21BC44QS4PPelY9MR803KOxmGFmrptHBi1-9mO07d7kuQqgeTCqJd9PmTQNnyix3EwlE May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.47 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 3f68d9ec597143cfa10f105ac8625cb3 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersAaction247Test-1919639089 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3f68d9ec597143cfa10f105ac8625cb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3f68d9ec597143cfa10f105ac8625cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3f68d9ec597143cfa10f105ac8625cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3f68d9ec597143cfa10f105ac8625cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersAaction247Test-1919639089 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 3f68d9ec597143cfa10f105ac8625cb3 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersAaction247Test-1919639089 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersAaction247Test-1919639089-project May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 7c4569a286c94afa8bb60be1c9da9ce6 May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersAaction247Test-1919639089-project May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance eee60661-bc27-437d-8a63-24dbeb2d7e47 could not be found. May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'eee60661-bc27-437d-8a63-24dbeb2d7e47'} May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee60661-bc27-437d-8a63-24dbeb2d7e47 could not be found. May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee60661-bc27-437d-8a63-24dbeb2d7e47 could not be found. May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:33.821175 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:33.827019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:33.827019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:33.827019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:33.827019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:54:33.827019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:54:33.827019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee60661-bc27-437d-8a63-24dbeb2d7e47 could not be found. May 19 04:54:33.827019 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:33.829061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] Returning 404 to user: Instance eee60661-bc27-437d-8a63-24dbeb2d7e47 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:54:33.831287 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1b2d28d6-bf5a-4778-ba78-a0abbe759f7e tempest-ServersAaction247Test-1919639089 tempest-ServersAaction247Test-1919639089-project] 10.222.0.58 "GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47" status: 404 len: 111 microversion: 2.47 time: 0.071959 May 19 04:54:33.832089 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2492/5081] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:33 2022] GET /compute/v2.1/servers/eee60661-bc27-437d-8a63-24dbeb2d7e47 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:54:34.174457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a44303d0-9d16-482b-960e-64ae985c1072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:34.175006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a44303d0-9d16-482b-960e-64ae985c1072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:34.184677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a44303d0-9d16-482b-960e-64ae985c1072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:34.188284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a44303d0-9d16-482b-960e-64ae985c1072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:34.190056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a44303d0-9d16-482b-960e-64ae985c1072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:34.191798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a44303d0-9d16-482b-960e-64ae985c1072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:34.242994 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a44303d0-9d16-482b-960e-64ae985c1072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/ips" status: 200 len: 146 microversion: 2.1 time: 0.073376 May 19 04:54:34.244471 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2493/5082] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:54:34 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/ips => generated 146 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:34.772744 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-41aed0ec-a15c-4992-a95a-67f4ba2a7b5a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae" status: 202 len: 0 microversion: 2.1 time: 1.335138 May 19 04:54:34.777107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:34.777107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:34.778507 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2590/5083] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:54:33 2022] DELETE /compute/v2.1/os-floating-ips/9dd2b2c9-0dc5-40ae-bf9d-4a26764a93ae => generated 0 bytes in 1342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:54:34.785565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:34.786023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:34.786801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:34.787024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.187"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:34.787236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:35.495210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:35.497658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:35.503579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:35.504364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:35.505514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:35.506123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:35.507451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:35.508969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:35.518615 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8cab6711-d030-4b90-a733-f2ad1764bc15 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1745 microversion: 2.20 time: 0.747645 May 19 04:54:35.530177 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2494/5084] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:34 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1745 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:35.963623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Acquired lock "refresh_cache-dcc9404a-e1ed-4ee5-97c0-454f45421267" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:54:36.538689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:36.539328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:36.542244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:36.565947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:36.567912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:36.575643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:36.576245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:37.300356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:37.310652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:37.316003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:37.321361 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-773f7bea-8507-44ba-b45d-4b4940c23245 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.786895 May 19 04:54:37.337117 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2495/5085] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:36 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:54:37.971207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6db55fab-d486-479c-b02a-6584f655924d req-03e327db-110b-46ab-826e-89609046a83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac690db0-97d0-40dc-9503-32c5474812ac", "name": "network-vif-plugged", "status": "completed", "tag": "25b92ae1-0d83-44e7-bef8-803b7263b018"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:37.995200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6db55fab-d486-479c-b02a-6584f655924d req-03e327db-110b-46ab-826e-89609046a83f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:37.995969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6db55fab-d486-479c-b02a-6584f655924d req-03e327db-110b-46ab-826e-89609046a83f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:38.036420 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6db55fab-d486-479c-b02a-6584f655924d req-03e327db-110b-46ab-826e-89609046a83f service nova] Creating event network-vif-plugged:25b92ae1-0d83-44e7-bef8-803b7263b018 for instance ac690db0-97d0-40dc-9503-32c5474812ac on n-h1-766726-30 May 19 04:54:38.066217 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6db55fab-d486-479c-b02a-6584f655924d req-03e327db-110b-46ab-826e-89609046a83f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098267 May 19 04:54:38.068299 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2496/5086] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 19 04:54:38.414391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Building network info cache for instance {{(pid=124818) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 04:54:38.524300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0513c686-9829-4907-a780-ce7e02f453ae tempest-ExtensionsTest-1678653746 tempest-ExtensionsTest-1678653746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:38.526013 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0513c686-9829-4907-a780-ce7e02f453ae tempest-ExtensionsTest-1678653746 tempest-ExtensionsTest-1678653746-project] 10.222.0.58 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.299287 May 19 04:54:38.526860 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2497/5087] 10.222.0.58 () {58 vars in 1169 bytes} [Thu May 19 04:54:38 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:54:38.548871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:38.549756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:38.559876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:38.559876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:38.559876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:38.559876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:39.047977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:39.076111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:39.086599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:39.088314 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-356cae25-866f-496f-94f2-f88602467a25 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.560403 May 19 04:54:39.103019 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2498/5088] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:38 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:39.117689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-45f9c172-8ef9-4b15-bba4-53ba8d4b15eb req-1ceeb555-cec2-45cb-80be-2a82de5740cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc9404a-e1ed-4ee5-97c0-454f45421267", "tag": "427b5b74-2341-44c8-9877-03e23a9e3aa1"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:39.127628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-45f9c172-8ef9-4b15-bba4-53ba8d4b15eb req-1ceeb555-cec2-45cb-80be-2a82de5740cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:39.128076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-45f9c172-8ef9-4b15-bba4-53ba8d4b15eb req-1ceeb555-cec2-45cb-80be-2a82de5740cb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:39.156362 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-45f9c172-8ef9-4b15-bba4-53ba8d4b15eb req-1ceeb555-cec2-45cb-80be-2a82de5740cb service nova] Creating event network-changed:427b5b74-2341-44c8-9877-03e23a9e3aa1 for instance dcc9404a-e1ed-4ee5-97c0-454f45421267 on n-h1-766726-30 May 19 04:54:39.177244 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-45f9c172-8ef9-4b15-bba4-53ba8d4b15eb req-1ceeb555-cec2-45cb-80be-2a82de5740cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072771 May 19 04:54:39.178169 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2499/5089] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:39.203843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d9287c1e-0fb1-4583-8c17-85ad1b697bd4 tempest-ExtensionsTest-1678653746 tempest-ExtensionsTest-1678653746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:39.223372 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d9287c1e-0fb1-4583-8c17-85ad1b697bd4 tempest-ExtensionsTest-1678653746 tempest-ExtensionsTest-1678653746-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.028816 May 19 04:54:39.223995 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2500/5090] 10.222.0.58 () {58 vars in 1133 bytes} [Thu May 19 04:54:39 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:54:40.108952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:40.110653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:40.126270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:40.127340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:40.128701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:40.129379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:40.405671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Updating instance_info_cache with network_info: [{"id": "427b5b74-2341-44c8-9877-03e23a9e3aa1", "address": "fa:16:3e:c9:94:89", "network": {"id": "a27101e5-12cf-4a2f-988f-b86045a72d3f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-984782428-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4323b9ee49f1481bbcfe7679ca57016f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap427b5b74-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=124818) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 04:54:40.426631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Releasing lock "refresh_cache-dcc9404a-e1ed-4ee5-97c0-454f45421267" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:54:40.427685 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6954574-fcde-4adc-8448-427a90c44956 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action" status: 202 len: 0 microversion: 2.1 time: 5.647481 May 19 04:54:40.428320 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2591/5091] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:54:34 2022] POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action => generated 0 bytes in 5649 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 04:54:40.447944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88e9e08e-1919-4161-83c9-c009d9243924 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '.version_select at 0x7fd315592ca0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:40.958718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:40.987890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:40.994696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:40.997898 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59f1d620-92fa-4fd6-89ec-f52d411b04a0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.894011 May 19 04:54:41.012669 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2501/5092] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:40 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:54:41.031757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9fd1c272-da6b-4a0b-907b-23a3ebf931df tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0581e3c1-6d54-4a93-a423-12370b3422d1"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:41.032904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9fd1c272-da6b-4a0b-907b-23a3ebf931df tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:41.056772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fd1c272-da6b-4a0b-907b-23a3ebf931df tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:41.058702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fd1c272-da6b-4a0b-907b-23a3ebf931df tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:41.059561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fd1c272-da6b-4a0b-907b-23a3ebf931df tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:41.060020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9fd1c272-da6b-4a0b-907b-23a3ebf931df tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:41.557633 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9fd1c272-da6b-4a0b-907b-23a3ebf931df tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.551225 May 19 04:54:41.560454 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2502/5093] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:54:41 2022] POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:42.021463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:42.022143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:42.041339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:42.041935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:42.043337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:42.044428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:43.103692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:43.147526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:43.161202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:43.164123 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6f0bf27-4d5d-4963-afa2-53e61eda8c81 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 1.147629 May 19 04:54:43.171899 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2503/5094] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:42 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:54:43.337247 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88e9e08e-1919-4161-83c9-c009d9243924 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/7b396ba7-6992-46d4-ab1a-ed75def8ad41" status: 202 len: 0 microversion: 2.1 time: 2.901185 May 19 04:54:43.338531 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2592/5095] 10.222.0.58 () {58 vars in 1262 bytes} [Thu May 19 04:54:40 2022] DELETE /compute/v2.1/os-floating-ips/7b396ba7-6992-46d4-ab1a-ed75def8ad41 => generated 0 bytes in 2903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:54:43.350982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ea61078-fb21-4396-8673-966cce18b213 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ea61078-fb21-4396-8673-966cce18b213 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Request method failure captured: May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action HTTP/1.1 May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 34 May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc1jMWCvnhfN4li3Dl5gH0m8kgsjVJjn9jQVLw-NUEPtuiLTOZfOisiYfKDYjAt_UfAhrgxtcS-alVjNBknspFgsGFwh91J_t0NieDlGyXXgCTouLCXmU57nDnEHd4tTpDEbod_Ul8QyNOXBYRV83FErR5QmL29YaeXeIJambQLGgCU May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cc799d5d90bf49c28182dca25f656aaf May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: {"addFloatingIp": {"address": ""}} May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'dcc9404a-e1ed-4ee5-97c0-454f45421267', 'body': {'addFloatingIp': {'address': ''}}} May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise error May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi '' May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 04:54:43.354894 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 19 04:54:43.359690 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:43.363543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ea61078-fb21-4396-8673-966cce18b213 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:54:43.373209 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4ea61078-fb21-4396-8673-966cce18b213 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action" status: 400 len: 142 microversion: 2.1 time: 0.027578 May 19 04:54:43.387383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:43.389816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:43.392995 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2504/5096] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:54:43 2022] POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action => generated 142 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:54:43.400820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:43.406389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:43.407260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:43.407713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:43.428314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:43.519727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Acquired lock "refresh_cache-dcc9404a-e1ed-4ee5-97c0-454f45421267" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 04:54:44.012572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Releasing lock "refresh_cache-dcc9404a-e1ed-4ee5-97c0-454f45421267" {{(pid=124818) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 04:54:44.013393 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] HTTP exception thrown: floating IP not found May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Request method failure captured: May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action HTTP/1.1 May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 41 May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc1jMWCvnhfN4li3Dl5gH0m8kgsjVJjn9jQVLw-NUEPtuiLTOZfOisiYfKDYjAt_UfAhrgxtcS-alVjNBknspFgsGFwh91J_t0NieDlGyXXgCTouLCXmU57nDnEHd4tTpDEbod_Ul8QyNOXBYRV83FErR5QmL29YaeXeIJambQLGgCU May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: cc799d5d90bf49c28182dca25f656aaf May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: {"addFloatingIp": {"address": "0.0.0.0"}} May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: exception: floating IP not found May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'dcc9404a-e1ed-4ee5-97c0-454f45421267', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2684, in associate_floating_ip May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2996, in _get_floating_ip_by_address May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found May 19 04:54:44.015339 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:44.019113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:44.019113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:44.019113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:44.019113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:44.019113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:44.019113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:54:44.019113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:54:44.019113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found May 19 04:54:44.019113 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:54:44.020895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Returning 404 to user: floating IP not found {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:54:44.022764 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1c315109-9e69-4fe1-b770-b292557e8991 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action" status: 404 len: 67 microversion: 2.1 time: 0.639441 May 19 04:54:44.025777 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2593/5097] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:54:43 2022] POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action => generated 67 bytes in 644 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:54:44.039076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c1a99fd-8e9b-4df2-8c2e-995bd1878c2c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:44.204925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:44.205748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:44.257238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:44.261718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:44.262802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:44.264149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:44.314376 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5c1a99fd-8e9b-4df2-8c2e-995bd1878c2c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c1a99fd-8e9b-4df2-8c2e-995bd1878c2c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Request method failure captured: May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action HTTP/1.1 May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 44 May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc1jMWCvnhfN4li3Dl5gH0m8kgsjVJjn9jQVLw-NUEPtuiLTOZfOisiYfKDYjAt_UfAhrgxtcS-alVjNBknspFgsGFwh91J_t0NieDlGyXXgCTouLCXmU57nDnEHd4tTpDEbod_Ul8QyNOXBYRV83FErR5QmL29YaeXeIJambQLGgCU May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cc799d5d90bf49c28182dca25f656aaf May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: {"removeFloatingIp": {"address": "0.0.0.0"}} May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: exception: Floating IP not found for address 0.0.0.0. May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'dcc9404a-e1ed-4ee5-97c0-454f45421267', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2912, in get_instance_id_by_floating_address May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2996, in _get_floating_ip_by_address May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr May 19 04:54:44.316049 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c1a99fd-8e9b-4df2-8c2e-995bd1878c2c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5c1a99fd-8e9b-4df2-8c2e-995bd1878c2c tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action" status: 404 len: 88 microversion: 2.1 time: 0.287304 May 19 04:54:44.319736 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2505/5098] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:54:44 2022] POST /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267/action => generated 88 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:54:44.347561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17e7bf24-523f-44df-a460-210a7280fd0d tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:44.349012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17e7bf24-523f-44df-a460-210a7280fd0d tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:44.360443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17e7bf24-523f-44df-a460-210a7280fd0d tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:44.362019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17e7bf24-523f-44df-a460-210a7280fd0d tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:44.363192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17e7bf24-523f-44df-a460-210a7280fd0d tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:44.363811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17e7bf24-523f-44df-a460-210a7280fd0d tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:44.509883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17e7bf24-523f-44df-a460-210a7280fd0d tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:54:44.730237 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17e7bf24-523f-44df-a460-210a7280fd0d tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 204 len: 0 microversion: 2.1 time: 0.386189 May 19 04:54:44.742308 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2506/5099] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:54:44 2022] DELETE /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:54:44.758925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:44.768840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3b50393b-7936-4a7f-8537-e88040e4f5d7 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:44.769626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3b50393b-7936-4a7f-8537-e88040e4f5d7 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:44.778141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:44.779781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:44.781035 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ce632055-2439-4a06-8690-9817fc15ba48 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.583818 May 19 04:54:44.781659 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2594/5100] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:44 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:54:44.807771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b50393b-7936-4a7f-8537-e88040e4f5d7 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:44.808244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b50393b-7936-4a7f-8537-e88040e4f5d7 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:44.819738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b50393b-7936-4a7f-8537-e88040e4f5d7 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:44.820538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b50393b-7936-4a7f-8537-e88040e4f5d7 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:45.802690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:45.803367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:45.813795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:45.814243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:45.817231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:45.820326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:46.521762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3b50393b-7936-4a7f-8537-e88040e4f5d7 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:46.534229 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3b50393b-7936-4a7f-8537-e88040e4f5d7 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1542 microversion: 2.1 time: 1.789903 May 19 04:54:46.541170 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2507/5101] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:44 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1542 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:46.859142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:46.870788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:46.876731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:46.878157 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27af1b81-6d32-4401-9f83-3a1e969ac329 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 1.079839 May 19 04:54:46.878891 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2595/5102] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:45 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:47.560093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3fd31437-00ff-4b29-978a-c7cc6fe8b63a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:47.560718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3fd31437-00ff-4b29-978a-c7cc6fe8b63a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:47.578656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3fd31437-00ff-4b29-978a-c7cc6fe8b63a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:47.580511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3fd31437-00ff-4b29-978a-c7cc6fe8b63a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:47.581956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3fd31437-00ff-4b29-978a-c7cc6fe8b63a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:47.586628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3fd31437-00ff-4b29-978a-c7cc6fe8b63a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:47.895982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:47.896601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:47.910082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:47.910536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:47.911329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:47.911764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:48.301118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3fd31437-00ff-4b29-978a-c7cc6fe8b63a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:48.318824 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3fd31437-00ff-4b29-978a-c7cc6fe8b63a tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1542 microversion: 2.1 time: 0.763558 May 19 04:54:48.353805 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2508/5103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:47 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1542 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:48.484608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:48.518783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:48.532595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:48.533911 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0c97587a-a48f-4868-988a-98959e27a36a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.642101 May 19 04:54:48.545856 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2596/5104] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:47 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:49.349345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c0d2305d-fc5c-4467-8491-b2136158b1c2 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:49.349993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c0d2305d-fc5c-4467-8491-b2136158b1c2 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:49.361962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0d2305d-fc5c-4467-8491-b2136158b1c2 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:49.364254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0d2305d-fc5c-4467-8491-b2136158b1c2 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:49.365308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0d2305d-fc5c-4467-8491-b2136158b1c2 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:49.367681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0d2305d-fc5c-4467-8491-b2136158b1c2 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:49.446283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:49.553926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:49.554555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:49.567619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:49.568074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:49.568848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:49.569316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:50.454700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c0d2305d-fc5c-4467-8491-b2136158b1c2 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc799d5d90bf49c28182dca25f656aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4323b9ee49f1481bbcfe7679ca57016f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:50.467879 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c0d2305d-fc5c-4467-8491-b2136158b1c2 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 200 len: 1500 microversion: 2.1 time: 1.133776 May 19 04:54:50.475959 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2509/5105] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:49 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 1500 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:54:50.505170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a041b7ff-3a5e-415f-a43a-31f52d911378 req-32ad15d8-5f5f-4ac3-9018-9e4b0eda9877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc9404a-e1ed-4ee5-97c0-454f45421267", "name": "network-vif-deleted", "tag": "427b5b74-2341-44c8-9877-03e23a9e3aa1"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:54:50.553138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a041b7ff-3a5e-415f-a43a-31f52d911378 req-32ad15d8-5f5f-4ac3-9018-9e4b0eda9877 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:50.556196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a041b7ff-3a5e-415f-a43a-31f52d911378 req-32ad15d8-5f5f-4ac3-9018-9e4b0eda9877 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:50.630408 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a041b7ff-3a5e-415f-a43a-31f52d911378 req-32ad15d8-5f5f-4ac3-9018-9e4b0eda9877 service nova] Creating event network-vif-deleted:427b5b74-2341-44c8-9877-03e23a9e3aa1 for instance dcc9404a-e1ed-4ee5-97c0-454f45421267 on n-h1-766726-30 May 19 04:54:50.649660 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a041b7ff-3a5e-415f-a43a-31f52d911378 req-32ad15d8-5f5f-4ac3-9018-9e4b0eda9877 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171084 May 19 04:54:50.650647 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2510/5106] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:54:50.870134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:50.878527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:50.880670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:50.882398 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b573af0e-318d-47c5-91ec-aa6bcb16c3db tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 1.332738 May 19 04:54:50.883468 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2597/5107] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:49 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:51.492850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:51.494638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] [instance: dcc9404a-e1ed-4ee5-97c0-454f45421267] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:51.522501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:51.526463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:51.532510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:51.534968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:51.586016 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] HTTP exception thrown: Instance dcc9404a-e1ed-4ee5-97c0-454f45421267 could not be found. May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Request method failure captured: May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 HTTP/1.1 May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc1jMWCvnhfN4li3Dl5gH0m8kgsjVJjn9jQVLw-NUEPtuiLTOZfOisiYfKDYjAt_UfAhrgxtcS-alVjNBknspFgsGFwh91J_t0NieDlGyXXgCTouLCXmU57nDnEHd4tTpDEbod_Ul8QyNOXBYRV83FErR5QmL29YaeXeIJambQLGgCU May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4323b9ee49f1481bbcfe7679ca57016f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 4323b9ee49f1481bbcfe7679ca57016f May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: cc799d5d90bf49c28182dca25f656aaf May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance dcc9404a-e1ed-4ee5-97c0-454f45421267 could not be found. May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'dcc9404a-e1ed-4ee5-97c0-454f45421267'} May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc9404a-e1ed-4ee5-97c0-454f45421267 could not be found. May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc9404a-e1ed-4ee5-97c0-454f45421267 could not be found. May 19 04:54:51.602609 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:51.608025 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:54:51.608025 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:51.608025 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:54:51.608025 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:54:51.608025 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:54:51.608025 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:54:51.608025 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:54:51.608025 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc9404a-e1ed-4ee5-97c0-454f45421267 could not be found. May 19 04:54:51.608025 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:54:51.609519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] Returning 404 to user: Instance dcc9404a-e1ed-4ee5-97c0-454f45421267 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:54:51.612458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6283fc69-76fd-4238-99a7-74633264ac47 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091 tempest-FloatingIPsAssociationNegativeTestJSON-1150243091-project] 10.222.0.58 "GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267" status: 404 len: 111 microversion: 2.1 time: 0.123623 May 19 04:54:51.617053 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2511/5108] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:54:51 2022] GET /compute/v2.1/servers/dcc9404a-e1ed-4ee5-97c0-454f45421267 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:54:51.908376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:51.909047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:51.933477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:51.936415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:51.941468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:51.943312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:52.315239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:52.342227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:52.343759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:52.354855 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cafd7857-b311-47c5-bade-fb8d4995efe1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.452153 May 19 04:54:52.355799 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2598/5109] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:51 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:53.379336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:53.380637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:53.401062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:53.404568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:53.405654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:53.406312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:53.885677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:53.900048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:53.908481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:53.910636 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17a9335e-abe4-4b6a-9fce-6f01ba961a5b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.540065 May 19 04:54:53.916951 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2512/5110] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:53 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:54.936186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:54.936814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:54.964432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:54.967063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:54.968729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:54.975364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:56.440902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:56.461772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:56.469692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:56.475585 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-32757b74-9af0-434b-bab9-56061b35e13a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 1.544578 May 19 04:54:56.476743 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2599/5111] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:54 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:57.501001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:57.502840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:57.539666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:57.540123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:57.548691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:57.549195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:58.171595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:58.207976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:58.216223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:58.219442 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-239e7152-3831-449a-8fde-62382a4a4370 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.724586 May 19 04:54:58.220285 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2513/5112] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:57 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:54:59.239743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:54:59.240358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:54:59.252437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=20 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:54:59.272693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:59.279930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:59.282121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:54:59.282597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:54:59.646002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:59.669666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:59.673038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:54:59.676161 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b80afabe-b796-4eb7-9684-a47b76f01a4f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.441255 May 19 04:54:59.677930 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2600/5113] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:54:59 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:00.696162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:00.697435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:00.729439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:00.734598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:00.735782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:00.746122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:01.140191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:01.149590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:01.151092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:01.152915 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5a5e1d01-b7fa-4524-bd17-49e32fcd48fc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.461019 May 19 04:55:01.164118 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2514/5114] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:00 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:02.171317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:02.171934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:02.192866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:02.193348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:02.194151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:02.194592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:02.477965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:02.489048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:02.490850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:02.492414 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14a86f15-df0b-497a-b826-1a9c58988f2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.325606 May 19 04:55:02.503408 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2601/5115] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:02 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:03.511478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:03.512762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:03.524754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:03.527375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:03.528357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:03.533004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:04.102339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:04.124993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:04.130065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:04.134357 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6fa2298a-4bdc-4b51-a64a-31ec0d97e906 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.625963 May 19 04:55:04.139442 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2515/5116] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:03 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:05.162012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:05.164226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:05.195439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:05.196562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:05.197692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:05.199084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:05.775516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:05.803677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:05.812021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:05.817152 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-729ca636-d372-4d02-95c8-d99b7a5b7020 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1740 microversion: 2.20 time: 0.664181 May 19 04:55:05.829014 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2602/5117] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:05 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1740 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:06.835852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:06.837307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:06.842468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:55:06.856670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:06.858679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:06.862388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:06.863097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:07.592836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:07.603578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:07.606329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:07.607850 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4b4bbb14-ee3f-4c51-9ec1-4096fbc1a9c0 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1722 microversion: 2.20 time: 0.775972 May 19 04:55:07.620631 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2516/5118] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:06 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1722 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:08.627173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:08.627798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:08.648837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:08.654262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:08.657931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:08.659613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:09.123616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:09.144625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:09.146202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:09.147426 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f85d86d3-4044-44a7-95e5-2f4176a67f12 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1722 microversion: 2.20 time: 0.524336 May 19 04:55:09.156617 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2603/5119] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:08 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1722 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:10.174177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:10.174796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:10.185266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:10.185710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:10.186500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:10.186940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:10.602046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:10.621026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:10.628402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:10.649902 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7e186a9-23e0-49e1-8508-5de3900db6cd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1722 microversion: 2.20 time: 0.463006 May 19 04:55:10.657460 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2517/5120] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:10 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1722 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:11.677658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:11.678282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:11.702604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:11.703860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:11.706100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:11.706868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:11.806717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-aa733144-3217-4019-91b6-0dcfa68224f2 req-ae5f41b9-a54f-4049-babb-d3ecd0be11da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac690db0-97d0-40dc-9503-32c5474812ac", "name": "network-vif-unplugged", "status": "completed", "tag": "25b92ae1-0d83-44e7-bef8-803b7263b018"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:55:11.834603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-aa733144-3217-4019-91b6-0dcfa68224f2 req-ae5f41b9-a54f-4049-babb-d3ecd0be11da service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:11.835087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-aa733144-3217-4019-91b6-0dcfa68224f2 req-ae5f41b9-a54f-4049-babb-d3ecd0be11da service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:11.887986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.compute.server_external_events [req-aa733144-3217-4019-91b6-0dcfa68224f2 req-ae5f41b9-a54f-4049-babb-d3ecd0be11da service nova] Unable to find a host for instance ac690db0-97d0-40dc-9503-32c5474812ac. Dropping event network-vif-unplugged {{(pid=124819) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 04:55:11.895205 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-aa733144-3217-4019-91b6-0dcfa68224f2 req-ae5f41b9-a54f-4049-babb-d3ecd0be11da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.090515 May 19 04:55:11.896033 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2518/5121] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 04:55:12.355697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:12.376189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:12.380878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:12.382630 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-565fd08e-0a06-4b41-8877-bf362a12af9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1725 microversion: 2.20 time: 0.708681 May 19 04:55:12.383703 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2604/5122] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:11 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1725 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:12.405897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b38ca44-ddbe-4d56-8e4b-f971c37b2ce6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea5e5ff4-c6ff-4687-a55e-400cc8eaae02"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:55:12.406990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b38ca44-ddbe-4d56-8e4b-f971c37b2ce6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:12.418187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b38ca44-ddbe-4d56-8e4b-f971c37b2ce6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:12.418651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b38ca44-ddbe-4d56-8e4b-f971c37b2ce6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:12.419447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b38ca44-ddbe-4d56-8e4b-f971c37b2ce6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:12.419897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b38ca44-ddbe-4d56-8e4b-f971c37b2ce6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:13.156615 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b38ca44-ddbe-4d56-8e4b-f971c37b2ce6 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.755449 May 19 04:55:13.158307 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2519/5123] 10.222.0.58 () {62 vars in 1363 bytes} [Thu May 19 04:55:12 2022] POST /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/os-volume_attachments => generated 188 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 04:55:13.409219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43938def-5b08-41e4-830c-b8d5d6cd2a1e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:13.411463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43938def-5b08-41e4-830c-b8d5d6cd2a1e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:13.431732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43938def-5b08-41e4-830c-b8d5d6cd2a1e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:13.433922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43938def-5b08-41e4-830c-b8d5d6cd2a1e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:13.435749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43938def-5b08-41e4-830c-b8d5d6cd2a1e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:13.438335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43938def-5b08-41e4-830c-b8d5d6cd2a1e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:13.627986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=74 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:55:13.966256 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43938def-5b08-41e4-830c-b8d5d6cd2a1e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/os-volume_attachments/ea5e5ff4-c6ff-4687-a55e-400cc8eaae02" status: 202 len: 0 microversion: 2.20 time: 0.567724 May 19 04:55:13.967074 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2605/5124] 10.222.0.58 () {60 vars in 1456 bytes} [Thu May 19 04:55:13 2022] DELETE /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/os-volume_attachments/ea5e5ff4-c6ff-4687-a55e-400cc8eaae02 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:55:14.099381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0f0142db-9484-4545-984e-7510ef769355 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:55:14.099967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0f0142db-9484-4545-984e-7510ef769355 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:14.114801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f0142db-9484-4545-984e-7510ef769355 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:14.115273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f0142db-9484-4545-984e-7510ef769355 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:14.116909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f0142db-9484-4545-984e-7510ef769355 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:14.117391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f0142db-9484-4545-984e-7510ef769355 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:14.303488 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0f0142db-9484-4545-984e-7510ef769355 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "POST /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/action" status: 202 len: 0 microversion: 2.20 time: 0.212716 May 19 04:55:14.304130 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2520/5125] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 19 04:55:14 2022] POST /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 04:55:14.314150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:14.315436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:14.334749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:14.336771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:14.341837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:14.342540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:15.049688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:15.066502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:15.068044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:15.069311 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39b7bbbb-154c-4fd4-87a6-092cddba95f3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1673 microversion: 2.20 time: 0.760359 May 19 04:55:15.080501 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2606/5126] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:14 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1673 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:16.089492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:16.090237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:16.114156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:16.115015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:16.116026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:16.116845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:16.598601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:16.615290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:16.616805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:16.618071 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b7389ea-afb1-4151-a16a-e626510979e1 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1673 microversion: 2.20 time: 0.533318 May 19 04:55:16.619454 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2521/5127] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:16 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1673 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:17.639172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:17.639844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:17.677468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:17.678452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:17.687082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:17.687556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:19.188969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:19.198774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:19.206948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:19.214677 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-edfa9255-f3fe-49ed-a8f4-d88469f208ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1673 microversion: 2.20 time: 1.577237 May 19 04:55:19.216005 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2607/5128] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:17 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1673 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:19.483120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c785d8b4-f0a6-4a2a-9417-ac276a7a06e0 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:55:19.496489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c785d8b4-f0a6-4a2a-9417-ac276a7a06e0 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:19.496957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c785d8b4-f0a6-4a2a-9417-ac276a7a06e0 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:19.501803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:55:19.628196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c785d8b4-f0a6-4a2a-9417-ac276a7a06e0 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Going to try to stop instance {{(pid=124819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 04:55:19.760303 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c785d8b4-f0a6-4a2a-9417-ac276a7a06e0 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.281458 May 19 04:55:19.761752 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2522/5129] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:55:19 2022] POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:55:19.770787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca3a4808-4af8-4dd3-8ae8-238bb7cab52f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:19.771433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca3a4808-4af8-4dd3-8ae8-238bb7cab52f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:19.790485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca3a4808-4af8-4dd3-8ae8-238bb7cab52f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:19.791002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca3a4808-4af8-4dd3-8ae8-238bb7cab52f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:19.792370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca3a4808-4af8-4dd3-8ae8-238bb7cab52f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:19.792874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca3a4808-4af8-4dd3-8ae8-238bb7cab52f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:20.243215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:20.245557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:20.262481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:20.263863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:20.266282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:20.267150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:20.737134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ca3a4808-4af8-4dd3-8ae8-238bb7cab52f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:20.754540 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ca3a4808-4af8-4dd3-8ae8-238bb7cab52f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 0.988709 May 19 04:55:20.765503 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2608/5130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:19 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:21.503899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:21.515098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:21.538570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:21.539832 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-481cc6e4-5e51-460b-8fda-8609ac8bc2dc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 1.308948 May 19 04:55:21.540615 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2523/5131] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:20 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:21.773494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-12b5bd32-a731-4351-846d-f152b011bd82 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:21.774272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-12b5bd32-a731-4351-846d-f152b011bd82 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:21.802878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12b5bd32-a731-4351-846d-f152b011bd82 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:21.805513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12b5bd32-a731-4351-846d-f152b011bd82 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:21.808498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12b5bd32-a731-4351-846d-f152b011bd82 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:21.811133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12b5bd32-a731-4351-846d-f152b011bd82 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:22.558609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:22.559238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:22.583660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:22.596498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:22.597679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:22.598286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:24.347501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-12b5bd32-a731-4351-846d-f152b011bd82 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:24.376795 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-12b5bd32-a731-4351-846d-f152b011bd82 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 2.608762 May 19 04:55:24.382280 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2609/5132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:21 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 2615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:24.710745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:24.736644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:24.739087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:24.750867 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bff1e751-4c3f-4ea8-b62d-ec5f6da7830a tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 2.196313 May 19 04:55:24.751972 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2524/5133] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:22 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:25.401149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-422b0362-5835-496c-9405-93130dfada05 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:25.401903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-422b0362-5835-496c-9405-93130dfada05 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:25.442403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-422b0362-5835-496c-9405-93130dfada05 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:25.442883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-422b0362-5835-496c-9405-93130dfada05 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:25.445316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-422b0362-5835-496c-9405-93130dfada05 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:25.446075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-422b0362-5835-496c-9405-93130dfada05 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:25.770612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:25.771591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:25.798496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:25.802542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:25.804641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:25.807527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:26.466064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-422b0362-5835-496c-9405-93130dfada05 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:26.480689 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-422b0362-5835-496c-9405-93130dfada05 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 1.084084 May 19 04:55:26.492239 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2610/5134] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:25 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:26.852540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:26.876923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:26.883133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:26.889986 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2fa5ccdb-25cf-4866-ae9e-baea948bcf9f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 1.123684 May 19 04:55:26.891211 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2525/5135] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:25 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:27.504948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48accdf5-5959-4c41-b400-a511340bfc03 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:27.509548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48accdf5-5959-4c41-b400-a511340bfc03 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:27.524293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48accdf5-5959-4c41-b400-a511340bfc03 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:27.524956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48accdf5-5959-4c41-b400-a511340bfc03 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:27.526239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48accdf5-5959-4c41-b400-a511340bfc03 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:27.526861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48accdf5-5959-4c41-b400-a511340bfc03 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:27.912566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:27.914022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:27.923869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:27.924542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:27.925661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:27.926410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:28.621588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:28.650213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:28.672247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:28.689725 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8542671-721f-4a37-9e7f-e78f567a640d tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 0.782908 May 19 04:55:28.692926 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2526/5136] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:27 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:55:28.716739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-48accdf5-5959-4c41-b400-a511340bfc03 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:28.728021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48accdf5-5959-4c41-b400-a511340bfc03 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 1.230705 May 19 04:55:28.750822 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2611/5137] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:27 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:29.167829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3f0bb87-8075-42a4-86fb-7f729266aa41 tempest-FloatingIPDetailsNegativeTestJSON-1725519290 tempest-FloatingIPDetailsNegativeTestJSON-1725519290-project] Calling method '.version_select at 0x7fd315d8d5e0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:29.716225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:29.717089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:29.720834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=24 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:55:29.736191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:29.739935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:29.742331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:29.743086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:30.082975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-b3f0bb87-8075-42a4-86fb-7f729266aa41 tempest-FloatingIPDetailsNegativeTestJSON-1725519290 tempest-FloatingIPDetailsNegativeTestJSON-1725519290-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b50686ce-ce2f-4fc7-a2df-3f4f5e53451e could not be found", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:55:30.083831 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b3f0bb87-8075-42a4-86fb-7f729266aa41 tempest-FloatingIPDetailsNegativeTestJSON-1725519290 tempest-FloatingIPDetailsNegativeTestJSON-1725519290-project] HTTP exception thrown: Floating IP not found for ID b50686ce-ce2f-4fc7-a2df-3f4f5e53451e May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3f0bb87-8075-42a4-86fb-7f729266aa41 tempest-FloatingIPDetailsNegativeTestJSON-1725519290 tempest-FloatingIPDetailsNegativeTestJSON-1725519290-project] Request method failure captured: May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/os-floating-ips/b50686ce-ce2f-4fc7-a2df-3f4f5e53451e HTTP/1.1 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc2_BJXGTSCzmNW3iJMeA0BrOg2QHC1werOVcdTOGPA2bJLHhUOtif9vMTVXnIAyUG8HSoP7cv3-x2sJ4iq0R730X1rF_kuqZOxU8WQ6mdoJdq0xSapomEr856wmpTDXCMIjrXko12JjTAxUwOZuSGlmOF9Ap766MNruWkEZ1KWd0XI May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: eee02cb1745547e69a232fe2298dfa81 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1725519290 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eee02cb1745547e69a232fe2298dfa81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eee02cb1745547e69a232fe2298dfa81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eee02cb1745547e69a232fe2298dfa81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eee02cb1745547e69a232fe2298dfa81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1725519290 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: eee02cb1745547e69a232fe2298dfa81 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1725519290 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1725519290-project May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: a285aaa1d77945b4ac2aac2a57e022ac May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1725519290-project May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: exception: Floating IP not found for ID b50686ce-ce2f-4fc7-a2df-3f4f5e53451e May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b50686ce-ce2f-4fc7-a2df-3f4f5e53451e'} May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b50686ce-ce2f-4fc7-a2df-3f4f5e53451e could not be found May 19 04:55:30.086878 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e261a27-7e48-4f21-b111-018639be9106'] May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b50686ce-ce2f-4fc7-a2df-3f4f5e53451e. May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b50686ce-ce2f-4fc7-a2df-3f4f5e53451e May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b50686ce-ce2f-4fc7-a2df-3f4f5e53451e May 19 04:55:30.091581 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:30.095065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3f0bb87-8075-42a4-86fb-7f729266aa41 tempest-FloatingIPDetailsNegativeTestJSON-1725519290 tempest-FloatingIPDetailsNegativeTestJSON-1725519290-project] Returning 404 to user: Floating IP not found for ID b50686ce-ce2f-4fc7-a2df-3f4f5e53451e {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:55:30.095065 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3f0bb87-8075-42a4-86fb-7f729266aa41 tempest-FloatingIPDetailsNegativeTestJSON-1725519290 tempest-FloatingIPDetailsNegativeTestJSON-1725519290-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/b50686ce-ce2f-4fc7-a2df-3f4f5e53451e" status: 404 len: 111 microversion: 2.1 time: 1.398683 May 19 04:55:30.099773 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2527/5138] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:55:28 2022] GET /compute/v2.1/os-floating-ips/b50686ce-ce2f-4fc7-a2df-3f4f5e53451e => generated 111 bytes in 1401 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:55:30.110152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aeab446f-be61-4a2e-afa1-e42ec2e1a382 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:30.111821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aeab446f-be61-4a2e-afa1-e42ec2e1a382 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:30.153831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aeab446f-be61-4a2e-afa1-e42ec2e1a382 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:30.154190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aeab446f-be61-4a2e-afa1-e42ec2e1a382 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:30.156259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aeab446f-be61-4a2e-afa1-e42ec2e1a382 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:30.156726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aeab446f-be61-4a2e-afa1-e42ec2e1a382 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:30.959946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:30.979377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:30.992650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:31.000272 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a3ad7e2f-721d-4e81-966d-5226a732ae71 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 1.288101 May 19 04:55:31.006788 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2612/5139] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:29 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:55:31.107858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aeab446f-be61-4a2e-afa1-e42ec2e1a382 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:31.117642 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aeab446f-be61-4a2e-afa1-e42ec2e1a382 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 1.020751 May 19 04:55:31.146812 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2528/5140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:30 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:32.031392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:32.032894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:32.044870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:32.048548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:32.049818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:32.052720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:32.139872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b19314f4-173d-4917-8e43-aba6522e46bc tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:32.140610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b19314f4-173d-4917-8e43-aba6522e46bc tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:32.168024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b19314f4-173d-4917-8e43-aba6522e46bc tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:32.171836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b19314f4-173d-4917-8e43-aba6522e46bc tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:32.175938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b19314f4-173d-4917-8e43-aba6522e46bc tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:32.180539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b19314f4-173d-4917-8e43-aba6522e46bc tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:33.427232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:33.447849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:33.450152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:33.453218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-13824930-9f6e-4998-af8a-785d6f25ce79 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 1.425588 May 19 04:55:33.454076 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2613/5141] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:32 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:33.677441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b19314f4-173d-4917-8e43-aba6522e46bc tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:33.718951 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b19314f4-173d-4917-8e43-aba6522e46bc tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 1.577729 May 19 04:55:33.724450 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2529/5142] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:32 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:55:34.475296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:34.476774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:34.492141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:34.497580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:34.501186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:34.503228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:34.742574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fae2161f-a62f-41f3-bc10-b99e0f085715 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:34.743217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fae2161f-a62f-41f3-bc10-b99e0f085715 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:34.777744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fae2161f-a62f-41f3-bc10-b99e0f085715 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:34.778351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fae2161f-a62f-41f3-bc10-b99e0f085715 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:34.779216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fae2161f-a62f-41f3-bc10-b99e0f085715 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:34.779670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fae2161f-a62f-41f3-bc10-b99e0f085715 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:35.894587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:35.908156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:35.922471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:35.925512 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1da6f80a-ad75-4b68-a29e-ce1fe2f041cf tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 1.456420 May 19 04:55:35.933561 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2614/5143] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:34 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:36.184065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fae2161f-a62f-41f3-bc10-b99e0f085715 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:36.240123 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fae2161f-a62f-41f3-bc10-b99e0f085715 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 1.500886 May 19 04:55:36.249545 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2530/5144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:34 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:36.947586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:36.948452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:36.996647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:37.004492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:37.005773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:37.007759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:37.268205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f208f00a-aa59-441d-9c33-04de2aa73673 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:37.268795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f208f00a-aa59-441d-9c33-04de2aa73673 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:37.290711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=30 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:55:37.297265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f208f00a-aa59-441d-9c33-04de2aa73673 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:37.297879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f208f00a-aa59-441d-9c33-04de2aa73673 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:37.298882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f208f00a-aa59-441d-9c33-04de2aa73673 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:37.301850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f208f00a-aa59-441d-9c33-04de2aa73673 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:38.872031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:38.874585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f208f00a-aa59-441d-9c33-04de2aa73673 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:38.889067 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f208f00a-aa59-441d-9c33-04de2aa73673 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 1.623602 May 19 04:55:38.898492 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2531/5145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:37 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:55:38.903672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:38.915130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:38.921222 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b7b88a24-26a3-4cc9-b1a3-04a7fd28d4c7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 1.979120 May 19 04:55:38.923355 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2615/5146] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:36 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:39.911901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92898b92-ef17-4071-901b-e58576dc9e37 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:39.913163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-92898b92-ef17-4071-901b-e58576dc9e37 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:39.933505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92898b92-ef17-4071-901b-e58576dc9e37 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:39.936496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92898b92-ef17-4071-901b-e58576dc9e37 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:39.948480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:39.949890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:39.953943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92898b92-ef17-4071-901b-e58576dc9e37 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:39.956143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92898b92-ef17-4071-901b-e58576dc9e37 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:39.968064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:39.971313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:39.974135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:39.976145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:40.698198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-92898b92-ef17-4071-901b-e58576dc9e37 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:40.715966 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92898b92-ef17-4071-901b-e58576dc9e37 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 0.807886 May 19 04:55:40.716720 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2532/5147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:39 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:41.031623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:41.040238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:41.041820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:41.042997 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6241d2b5-78e7-4f11-85af-189e94cbcacd tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 1.100220 May 19 04:55:41.043576 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2616/5148] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:39 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:41.739990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af1dce32-e709-489b-9d23-619917c9d39d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:41.743208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af1dce32-e709-489b-9d23-619917c9d39d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:41.763522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af1dce32-e709-489b-9d23-619917c9d39d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:41.766121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af1dce32-e709-489b-9d23-619917c9d39d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:41.768261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af1dce32-e709-489b-9d23-619917c9d39d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:41.768569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af1dce32-e709-489b-9d23-619917c9d39d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:42.063148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:42.063768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:42.071905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:42.078047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:42.078982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:42.081468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:43.035179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-af1dce32-e709-489b-9d23-619917c9d39d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:43.051957 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af1dce32-e709-489b-9d23-619917c9d39d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 1.317665 May 19 04:55:43.059585 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2533/5149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:41 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:43.644970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:43.656363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:55:43.682446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:43.692309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:43.698456 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c1840684-2660-4ad5-a90c-278989e78884 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 1.636683 May 19 04:55:43.701237 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2617/5150] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:42 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:44.079800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f9b89608-629d-45ee-a1ae-88af86f02e0d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:44.082166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9b89608-629d-45ee-a1ae-88af86f02e0d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:44.096420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9b89608-629d-45ee-a1ae-88af86f02e0d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:44.098804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9b89608-629d-45ee-a1ae-88af86f02e0d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:44.103351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9b89608-629d-45ee-a1ae-88af86f02e0d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:44.104056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9b89608-629d-45ee-a1ae-88af86f02e0d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:44.707998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f9b89608-629d-45ee-a1ae-88af86f02e0d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:44.719817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:44.720732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:44.722366 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f9b89608-629d-45ee-a1ae-88af86f02e0d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1724 microversion: 2.1 time: 0.647190 May 19 04:55:44.726381 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2534/5151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:44 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1724 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:44.737963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:44.739905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:44.742176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:44.743757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:45.206889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:45.231094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:45.245895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:45.251711 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-02f9913f-bfaa-4596-b1b6-1c5a5401c8e7 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 0.535997 May 19 04:55:45.253470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2618/5152] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:44 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:45.740625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87be1dd4-4cf8-4515-8278-dee002c3f9bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:45.741200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-87be1dd4-4cf8-4515-8278-dee002c3f9bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:45.755686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87be1dd4-4cf8-4515-8278-dee002c3f9bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:45.758505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87be1dd4-4cf8-4515-8278-dee002c3f9bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:45.759455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87be1dd4-4cf8-4515-8278-dee002c3f9bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:45.760935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87be1dd4-4cf8-4515-8278-dee002c3f9bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:46.275500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:46.276603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:46.297944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:46.298687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:46.302796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:46.309125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:46.872041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:46.886004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:46.890962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:46.892379 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-455d62b2-2433-42fe-b045-51be4088ec2b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 0.624454 May 19 04:55:46.902288 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2619/5153] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:46 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:46.997870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-87be1dd4-4cf8-4515-8278-dee002c3f9bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:47.012909 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87be1dd4-4cf8-4515-8278-dee002c3f9bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1701 microversion: 2.1 time: 1.275296 May 19 04:55:47.018923 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2535/5154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:45 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1701 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:47.038563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-de864f5d-7712-433a-b1d3-56d172fb4ad4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:55:47.050981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de864f5d-7712-433a-b1d3-56d172fb4ad4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:47.053200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de864f5d-7712-433a-b1d3-56d172fb4ad4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:47.115641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-de864f5d-7712-433a-b1d3-56d172fb4ad4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Going to try to start instance {{(pid=124818) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 04:55:47.243119 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-de864f5d-7712-433a-b1d3-56d172fb4ad4 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.208480 May 19 04:55:47.244237 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2620/5155] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:55:47 2022] POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:55:47.252832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2822c69-6fb0-4108-a7ff-e546a101966e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:47.253809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b2822c69-6fb0-4108-a7ff-e546a101966e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:47.272601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2822c69-6fb0-4108-a7ff-e546a101966e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:47.273133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2822c69-6fb0-4108-a7ff-e546a101966e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:47.278160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2822c69-6fb0-4108-a7ff-e546a101966e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:47.278636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2822c69-6fb0-4108-a7ff-e546a101966e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:47.925338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:47.926643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:47.947753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:47.952222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:47.954571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:47.957307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:48.225181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b2822c69-6fb0-4108-a7ff-e546a101966e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:48.241602 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b2822c69-6fb0-4108-a7ff-e546a101966e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1710 microversion: 2.1 time: 0.992617 May 19 04:55:48.249235 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2536/5156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:47 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1710 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:55:48.257374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-579488ab-d6fc-47e8-94a3-f6bd7fae727b req-161ea8e3-c3f7-4be7-8cd4-c87893fa23f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac690db0-97d0-40dc-9503-32c5474812ac", "name": "network-vif-plugged", "status": "completed", "tag": "25b92ae1-0d83-44e7-bef8-803b7263b018"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:55:48.280544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-579488ab-d6fc-47e8-94a3-f6bd7fae727b req-161ea8e3-c3f7-4be7-8cd4-c87893fa23f6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:48.284058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-579488ab-d6fc-47e8-94a3-f6bd7fae727b req-161ea8e3-c3f7-4be7-8cd4-c87893fa23f6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:48.320713 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-579488ab-d6fc-47e8-94a3-f6bd7fae727b req-161ea8e3-c3f7-4be7-8cd4-c87893fa23f6 service nova] Creating event network-vif-plugged:25b92ae1-0d83-44e7-bef8-803b7263b018 for instance ac690db0-97d0-40dc-9503-32c5474812ac on n-h1-766726-30 May 19 04:55:48.338660 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-579488ab-d6fc-47e8-94a3-f6bd7fae727b req-161ea8e3-c3f7-4be7-8cd4-c87893fa23f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087537 May 19 04:55:48.342394 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2537/5157] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:55:49.262108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9a92b53d-393e-4ca9-a3aa-11e778618339 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:49.262819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9a92b53d-393e-4ca9-a3aa-11e778618339 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:49.279744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a92b53d-393e-4ca9-a3aa-11e778618339 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:49.298635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a92b53d-393e-4ca9-a3aa-11e778618339 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:49.299932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a92b53d-393e-4ca9-a3aa-11e778618339 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:49.302257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a92b53d-393e-4ca9-a3aa-11e778618339 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:49.390454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:49.410801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:49.427491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:49.428879 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8d35296a-f22f-4a34-8f42-b4260a729f19 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 1.511662 May 19 04:55:49.429528 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2621/5158] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:47 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:50.015012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9a92b53d-393e-4ca9-a3aa-11e778618339 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:50.033007 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9a92b53d-393e-4ca9-a3aa-11e778618339 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1710 microversion: 2.1 time: 0.775693 May 19 04:55:50.033865 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2538/5159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:49 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1710 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:55:50.454401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:50.455126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:50.477041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:50.478181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:50.479161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:50.482720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:50.970382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:50.985005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:50.996624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:51.004287 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5bc8e090-cd8b-4f46-acb3-52d9751b8ac9 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1731 microversion: 2.20 time: 0.558684 May 19 04:55:51.005695 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2622/5160] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:50 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1731 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:51.052140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f8cd6473-e7de-4696-b877-2469dcee7037 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:51.053234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f8cd6473-e7de-4696-b877-2469dcee7037 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:51.063359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8cd6473-e7de-4696-b877-2469dcee7037 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:51.069686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8cd6473-e7de-4696-b877-2469dcee7037 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:51.071523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8cd6473-e7de-4696-b877-2469dcee7037 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:51.072213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8cd6473-e7de-4696-b877-2469dcee7037 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:51.200494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e013f618-3dec-4c72-b9bd-e1b9488b3ba8 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Calling method '.version_select at 0x7fd31b7f1550>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:51.234238 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-e013f618-3dec-4c72-b9bd-e1b9488b3ba8 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] HTTP exception thrown: Image not found. May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e013f618-3dec-4c72-b9bd-e1b9488b3ba8 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Request method failure captured: May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/images/a9d85bea-d45b-4264-b8d0-80e4f01f66d8/metadata/os_distro HTTP/1.1 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc3Wu91DDsakSQN04ABwuFeBcB3t1ZdZA_J8LYodsTuaJsKWneXenbVa-0wl2XfxYFAtRKYDPzDPbmkOi8vXrTxkx9tb1KXNg9b_aLX6_7EjSBvUbhPjHiF9H2L8RrD_lP_NYiayljh7fCm9kyooGOpB13AGFWQZVyALxkVhocmmyo4 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 721c092393ae46f1ae1509935ee3125f May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'image_id': 'a9d85bea-d45b-4264-b8d0-80e4f01f66d8', 'id': 'os_distro'} May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a9d85bea-d45b-4264-b8d0-80e4f01f66d8 May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:55:51.271013 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9d85bea-d45b-4264-b8d0-80e4f01f66d8 could not be found. May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:55:51.276830 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.282150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e013f618-3dec-4c72-b9bd-e1b9488b3ba8 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:55:51.283208 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e013f618-3dec-4c72-b9bd-e1b9488b3ba8 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] 10.222.0.58 "DELETE /compute/v2.1/images/a9d85bea-d45b-4264-b8d0-80e4f01f66d8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.267835 May 19 04:55:51.284399 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2539/5161] 10.222.0.58 () {58 vars in 1292 bytes} [Thu May 19 04:55:51 2022] DELETE /compute/v2.1/images/a9d85bea-d45b-4264-b8d0-80e4f01f66d8/metadata/os_distro => generated 62 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:55:51.294859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dc5ad8e8-3e21-4ba8-adf4-ddc65e6508ca tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Calling method '.version_select at 0x7fd31643f430>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:51.334321 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-dc5ad8e8-3e21-4ba8-adf4-ddc65e6508ca tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] HTTP exception thrown: Image not found. May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dc5ad8e8-3e21-4ba8-adf4-ddc65e6508ca tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Request method failure captured: May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/images/fd75c4a5-2b66-44d8-bba3-d5fc10b89a0a/metadata/os_version HTTP/1.1 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc3Wu91DDsakSQN04ABwuFeBcB3t1ZdZA_J8LYodsTuaJsKWneXenbVa-0wl2XfxYFAtRKYDPzDPbmkOi8vXrTxkx9tb1KXNg9b_aLX6_7EjSBvUbhPjHiF9H2L8RrD_lP_NYiayljh7fCm9kyooGOpB13AGFWQZVyALxkVhocmmyo4 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 721c092393ae46f1ae1509935ee3125f May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'image_id': 'fd75c4a5-2b66-44d8-bba3-d5fc10b89a0a', 'id': 'os_version'} May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fd75c4a5-2b66-44d8-bba3-d5fc10b89a0a May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:55:51.337808 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd75c4a5-2b66-44d8-bba3-d5fc10b89a0a could not be found. May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:55:51.343733 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.351069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dc5ad8e8-3e21-4ba8-adf4-ddc65e6508ca tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:55:51.353264 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dc5ad8e8-3e21-4ba8-adf4-ddc65e6508ca tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] 10.222.0.58 "GET /compute/v2.1/images/fd75c4a5-2b66-44d8-bba3-d5fc10b89a0a/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.062063 May 19 04:55:51.369299 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2540/5162] 10.222.0.58 () {58 vars in 1292 bytes} [Thu May 19 04:55:51 2022] GET /compute/v2.1/images/fd75c4a5-2b66-44d8-bba3-d5fc10b89a0a/metadata/os_version => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:55:51.386103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afaa7474-d443-43da-9f00-2e3d046b54af tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Calling method '.version_select at 0x7fd31b7b61f0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:51.414339 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-afaa7474-d443-43da-9f00-2e3d046b54af tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] HTTP exception thrown: Image not found. May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afaa7474-d443-43da-9f00-2e3d046b54af tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Request method failure captured: May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/images/5e37891e-5425-475b-b5e3-8bbd50bf51b3/metadata HTTP/1.1 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc3Wu91DDsakSQN04ABwuFeBcB3t1ZdZA_J8LYodsTuaJsKWneXenbVa-0wl2XfxYFAtRKYDPzDPbmkOi8vXrTxkx9tb1KXNg9b_aLX6_7EjSBvUbhPjHiF9H2L8RrD_lP_NYiayljh7fCm9kyooGOpB13AGFWQZVyALxkVhocmmyo4 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 721c092393ae46f1ae1509935ee3125f May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'image_id': '5e37891e-5425-475b-b5e3-8bbd50bf51b3'} May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5e37891e-5425-475b-b5e3-8bbd50bf51b3 May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:55:51.417662 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e37891e-5425-475b-b5e3-8bbd50bf51b3 could not be found. May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-afaa7474-d443-43da-9f00-2e3d046b54af tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-afaa7474-d443-43da-9f00-2e3d046b54af tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] 10.222.0.58 "GET /compute/v2.1/images/5e37891e-5425-475b-b5e3-8bbd50bf51b3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047178 May 19 04:55:51.422030 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2541/5163] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 04:55:51 2022] GET /compute/v2.1/images/5e37891e-5425-475b-b5e3-8bbd50bf51b3/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 19 04:55:51.438018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eac3a077-9b07-4205-9c94-2529779d72e7 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Action: 'update_all', calling method: .version_select at 0x7fd31b7b6ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:55:51.475109 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-eac3a077-9b07-4205-9c94-2529779d72e7 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] HTTP exception thrown: Image not found. May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eac3a077-9b07-4205-9c94-2529779d72e7 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Request method failure captured: May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/images/e2445775-a712-490a-9190-323f593e32ab/metadata HTTP/1.1 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 57 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc3Wu91DDsakSQN04ABwuFeBcB3t1ZdZA_J8LYodsTuaJsKWneXenbVa-0wl2XfxYFAtRKYDPzDPbmkOi8vXrTxkx9tb1KXNg9b_aLX6_7EjSBvUbhPjHiF9H2L8RrD_lP_NYiayljh7fCm9kyooGOpB13AGFWQZVyALxkVhocmmyo4 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 721c092393ae46f1ae1509935ee3125f May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'image_id': 'e2445775-a712-490a-9190-323f593e32ab', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e2445775-a712-490a-9190-323f593e32ab May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:55:51.478106 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e2445775-a712-490a-9190-323f593e32ab could not be found. May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eac3a077-9b07-4205-9c94-2529779d72e7 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eac3a077-9b07-4205-9c94-2529779d72e7 tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] 10.222.0.58 "PUT /compute/v2.1/images/e2445775-a712-490a-9190-323f593e32ab/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052912 May 19 04:55:51.482038 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2542/5164] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:55:51 2022] PUT /compute/v2.1/images/e2445775-a712-490a-9190-323f593e32ab/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:55:51.489856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0eb17a8c-56f9-4b20-885a-a67b601149ac tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Action: 'update', calling method: .version_select at 0x7fd314880af0>, body: {"meta": {"os_distro": "alt"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:55:51.520527 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-0eb17a8c-56f9-4b20-885a-a67b601149ac tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] HTTP exception thrown: Image not found. May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0eb17a8c-56f9-4b20-885a-a67b601149ac tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Request method failure captured: May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/images/df40144a-1533-47f2-b64f-a13bf0f950bc/metadata/os_distro HTTP/1.1 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 30 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc3Wu91DDsakSQN04ABwuFeBcB3t1ZdZA_J8LYodsTuaJsKWneXenbVa-0wl2XfxYFAtRKYDPzDPbmkOi8vXrTxkx9tb1KXNg9b_aLX6_7EjSBvUbhPjHiF9H2L8RrD_lP_NYiayljh7fCm9kyooGOpB13AGFWQZVyALxkVhocmmyo4 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 721c092393ae46f1ae1509935ee3125f May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: {"meta": {"os_distro": "alt"}} May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'image_id': 'df40144a-1533-47f2-b64f-a13bf0f950bc', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID df40144a-1533-47f2-b64f-a13bf0f950bc May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:55:51.525342 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df40144a-1533-47f2-b64f-a13bf0f950bc could not be found. May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:55:51.529966 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.535390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0eb17a8c-56f9-4b20-885a-a67b601149ac tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:55:51.536283 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0eb17a8c-56f9-4b20-885a-a67b601149ac tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] 10.222.0.58 "PUT /compute/v2.1/images/df40144a-1533-47f2-b64f-a13bf0f950bc/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.050630 May 19 04:55:51.537254 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2543/5165] 10.222.0.58 () {60 vars in 1309 bytes} [Thu May 19 04:55:51 2022] PUT /compute/v2.1/images/df40144a-1533-47f2-b64f-a13bf0f950bc/metadata/os_distro => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 19 04:55:51.551783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1de9cbb2-f6e4-4376-9d5a-f6de6f24a38e tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Action: 'create', calling method: .version_select at 0x7fd315c50700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:55:51.579576 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-1de9cbb2-f6e4-4376-9d5a-f6de6f24a38e tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] HTTP exception thrown: Image not found. May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1de9cbb2-f6e4-4376-9d5a-f6de6f24a38e tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Request method failure captured: May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/images/78c617f4-fbec-4310-aad8-33cfff3e2bd0/metadata HTTP/1.1 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 57 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc3Wu91DDsakSQN04ABwuFeBcB3t1ZdZA_J8LYodsTuaJsKWneXenbVa-0wl2XfxYFAtRKYDPzDPbmkOi8vXrTxkx9tb1KXNg9b_aLX6_7EjSBvUbhPjHiF9H2L8RrD_lP_NYiayljh7fCm9kyooGOpB13AGFWQZVyALxkVhocmmyo4 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd4a28f80dee40939789a80b3f57c280"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fd4a28f80dee40939789a80b3f57c280 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 721c092393ae46f1ae1509935ee3125f May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1456815854-project May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: exception: Image not found. May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'image_id': '78c617f4-fbec-4310-aad8-33cfff3e2bd0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 78c617f4-fbec-4310-aad8-33cfff3e2bd0 May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 04:55:51.582265 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 78c617f4-fbec-4310-aad8-33cfff3e2bd0 could not be found. May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 04:55:51.587524 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:55:51.593103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1de9cbb2-f6e4-4376-9d5a-f6de6f24a38e tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] Returning 404 to user: Image not found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:55:51.593103 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1de9cbb2-f6e4-4376-9d5a-f6de6f24a38e tempest-ImagesMetadataNegativeTestJSON-1456815854 tempest-ImagesMetadataNegativeTestJSON-1456815854-project] 10.222.0.58 "POST /compute/v2.1/images/78c617f4-fbec-4310-aad8-33cfff3e2bd0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048286 May 19 04:55:51.597915 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2544/5166] 10.222.0.58 () {60 vars in 1280 bytes} [Thu May 19 04:55:51 2022] POST /compute/v2.1/images/78c617f4-fbec-4310-aad8-33cfff3e2bd0/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 04:55:51.733616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f8cd6473-e7de-4696-b877-2469dcee7037 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:51.744481 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f8cd6473-e7de-4696-b877-2469dcee7037 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1714 microversion: 2.1 time: 0.698196 May 19 04:55:51.747178 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2623/5167] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:55:51 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1714 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:55:52.034225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:52.034889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:55:52.052429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:52.053954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:52.056522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:55:52.057375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:55:52.114267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:55:52.538161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:52.553705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:52.557805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:55:52.559985 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-096cb9fb-71ed-4fe2-8076-6e1c1926252f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1718 microversion: 2.20 time: 0.533585 May 19 04:55:52.562443 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2545/5168] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:55:52 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1718 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:55:58.795417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9d6b8f44-2a51-4eb1-8b6b-dcb8493032b8 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Calling method '.version_select at 0x7fd314df50d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:55:58.892500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG neutronclient.v2_0.client [None req-9d6b8f44-2a51-4eb1-8b6b-dcb8493032b8 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 96cf92b3-06ee-4c25-a216-7ace5c647b99 does not exist", "detail": ""}} {{(pid=124818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:55:58.893445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.security_group_api [None req-9d6b8f44-2a51-4eb1-8b6b-dcb8493032b8 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Neutron security group 96cf92b3-06ee-4c25-a216-7ace5c647b99 not found {{(pid=124818) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:55:58.894155 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9d6b8f44-2a51-4eb1-8b6b-dcb8493032b8 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] HTTP exception thrown: Security group 96cf92b3-06ee-4c25-a216-7ace5c647b99 does not exist May 19 04:55:58.894155 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-2c6762b1-dbcf-4de5-9b43-e8f3a5359c33'] May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9d6b8f44-2a51-4eb1-8b6b-dcb8493032b8 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Request method failure captured: May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/os-security-groups/96cf92b3-06ee-4c25-a216-7ace5c647b99 HTTP/1.1 May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc3ejmqL1dir7AQ7VMKgYGApRTtCfBzPmDUVnVHDmfEhKSyyWcnIbOQSxhA99EXUA8f7qMU54tT_mDisTF6Y9vcHlGxaJhDE7_TDocuwLUpu01wUNZH43PXFL6cHCs_VFQ1O2Tn6S1nyuSqb-ufTXehtinLzqRhO6pl8vVH43eoZv_U May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: cb2b8c8d87754b5eb6a7b00fa48a137a May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: cb2b8c8d87754b5eb6a7b00fa48a137a May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupsNegativeTestJSON-398596800-project May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 399b6b60104e4493ad54a6968cd27e60 May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-398596800-project May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: exception: Security group 96cf92b3-06ee-4c25-a216-7ace5c647b99 does not exist May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-2c6762b1-dbcf-4de5-9b43-e8f3a5359c33'] May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '96cf92b3-06ee-4c25-a216-7ace5c647b99'} May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:55:58.896457 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 96cf92b3-06ee-4c25-a216-7ace5c647b99 does not exist May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c6762b1-dbcf-4de5-9b43-e8f3a5359c33'] May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 96cf92b3-06ee-4c25-a216-7ace5c647b99 does not exist May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c6762b1-dbcf-4de5-9b43-e8f3a5359c33'] May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 96cf92b3-06ee-4c25-a216-7ace5c647b99 does not exist May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c6762b1-dbcf-4de5-9b43-e8f3a5359c33'] May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 96cf92b3-06ee-4c25-a216-7ace5c647b99 does not exist May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c6762b1-dbcf-4de5-9b43-e8f3a5359c33'] May 19 04:55:58.900303 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:55:58.904584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9d6b8f44-2a51-4eb1-8b6b-dcb8493032b8 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Returning 404 to user: Security group 96cf92b3-06ee-4c25-a216-7ace5c647b99 does not exist May 19 04:55:58.904584 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-2c6762b1-dbcf-4de5-9b43-e8f3a5359c33'] {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:55:58.905907 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9d6b8f44-2a51-4eb1-8b6b-dcb8493032b8 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/96cf92b3-06ee-4c25-a216-7ace5c647b99" status: 404 len: 194 microversion: 2.1 time: 0.671468 May 19 04:55:58.907074 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2624/5169] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:55:58 2022] DELETE /compute/v2.1/os-security-groups/96cf92b3-06ee-4c25-a216-7ace5c647b99 => generated 194 bytes in 673 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:55:58.917837 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d83932d0-68a0-40ed-beda-8e74e94dc3fb tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003990 May 19 04:55:58.918390 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2546/5170] 10.222.0.58 () {58 vars in 1163 bytes} [Thu May 19 04:55:58 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 04:55:58.934445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18cdf912-9670-47c8-bec1-bea28d25c959 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Calling method '.version_select at 0x7fd315533af0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:00.012155 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18cdf912-9670-47c8-bec1-bea28d25c959 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.086290 May 19 04:56:00.013470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2625/5171] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 04:55:58 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:56:00.025359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-55238c4b-f489-41a7-ae84-e5131b921afe tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Calling method '.version_select at 0x7fd315bec310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:01.384623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-55238c4b-f489-41a7-ae84-e5131b921afe tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:56:01.385399 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-55238c4b-f489-41a7-ae84-e5131b921afe tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] HTTP exception thrown: Insufficient rights for removing default security group. May 19 04:56:01.385399 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-a9d389b2-2e70-417f-84c4-fa9383757325'] May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-55238c4b-f489-41a7-ae84-e5131b921afe tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Request method failure captured: May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/os-security-groups/1c3df2f7-b318-44ef-9dd7-dc7f50129bb7 HTTP/1.1 May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc3ejmqL1dir7AQ7VMKgYGApRTtCfBzPmDUVnVHDmfEhKSyyWcnIbOQSxhA99EXUA8f7qMU54tT_mDisTF6Y9vcHlGxaJhDE7_TDocuwLUpu01wUNZH43PXFL6cHCs_VFQ1O2Tn6S1nyuSqb-ufTXehtinLzqRhO6pl8vVH43eoZv_U May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: cb2b8c8d87754b5eb6a7b00fa48a137a May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: cb2b8c8d87754b5eb6a7b00fa48a137a May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsNegativeTestJSON-398596800-project May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 399b6b60104e4493ad54a6968cd27e60 May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-398596800-project May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: exception: Insufficient rights for removing default security group. May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-a9d389b2-2e70-417f-84c4-fa9383757325'] May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '1c3df2f7-b318-44ef-9dd7-dc7f50129bb7'} May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:56:01.388048 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9d389b2-2e70-417f-84c4-fa9383757325'] May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9d389b2-2e70-417f-84c4-fa9383757325'] May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9d389b2-2e70-417f-84c4-fa9383757325'] May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9d389b2-2e70-417f-84c4-fa9383757325'] May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-55238c4b-f489-41a7-ae84-e5131b921afe tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Returning 400 to user: Insufficient rights for removing default security group. May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-a9d389b2-2e70-417f-84c4-fa9383757325'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:56:01.391722 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-55238c4b-f489-41a7-ae84-e5131b921afe tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/1c3df2f7-b318-44ef-9dd7-dc7f50129bb7" status: 400 len: 182 microversion: 2.1 time: 1.369248 May 19 04:56:01.398273 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2547/5172] 10.222.0.58 () {58 vars in 1271 bytes} [Thu May 19 04:56:00 2022] DELETE /compute/v2.1/os-security-groups/1c3df2f7-b318-44ef-9dd7-dc7f50129bb7 => generated 182 bytes in 1378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 04:56:01.404322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6df27d61-7326-4282-85f8-5331ce75068c tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Calling method '.version_select at 0x7fd3161918b0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:01.412881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=23 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:01.459089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG neutronclient.v2_0.client [None req-6df27d61-7326-4282-85f8-5331ce75068c tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8a8d9eea-656f-4262-95ad-39c24cf95eb2 does not exist", "detail": ""}} {{(pid=124818) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:56:01.459899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.security_group_api [None req-6df27d61-7326-4282-85f8-5331ce75068c tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Neutron security group 8a8d9eea-656f-4262-95ad-39c24cf95eb2 not found {{(pid=124818) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:56:01.461167 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-6df27d61-7326-4282-85f8-5331ce75068c tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] HTTP exception thrown: Security group 8a8d9eea-656f-4262-95ad-39c24cf95eb2 does not exist May 19 04:56:01.461167 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-182259df-13c5-4c23-8bdb-990c7fa63e13'] May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6df27d61-7326-4282-85f8-5331ce75068c tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Request method failure captured: May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/os-security-groups/8a8d9eea-656f-4262-95ad-39c24cf95eb2 HTTP/1.1 May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc3ejmqL1dir7AQ7VMKgYGApRTtCfBzPmDUVnVHDmfEhKSyyWcnIbOQSxhA99EXUA8f7qMU54tT_mDisTF6Y9vcHlGxaJhDE7_TDocuwLUpu01wUNZH43PXFL6cHCs_VFQ1O2Tn6S1nyuSqb-ufTXehtinLzqRhO6pl8vVH43eoZv_U May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: cb2b8c8d87754b5eb6a7b00fa48a137a May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: cb2b8c8d87754b5eb6a7b00fa48a137a May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-SecurityGroupsNegativeTestJSON-398596800-project May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 399b6b60104e4493ad54a6968cd27e60 May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-398596800-project May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: method: May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: exception: Security group 8a8d9eea-656f-4262-95ad-39c24cf95eb2 does not exist May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-182259df-13c5-4c23-8bdb-990c7fa63e13'] May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '8a8d9eea-656f-4262-95ad-39c24cf95eb2'} May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:56:01.464318 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8a8d9eea-656f-4262-95ad-39c24cf95eb2 does not exist May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-182259df-13c5-4c23-8bdb-990c7fa63e13'] May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8a8d9eea-656f-4262-95ad-39c24cf95eb2 does not exist May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-182259df-13c5-4c23-8bdb-990c7fa63e13'] May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8a8d9eea-656f-4262-95ad-39c24cf95eb2 does not exist May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-182259df-13c5-4c23-8bdb-990c7fa63e13'] May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8a8d9eea-656f-4262-95ad-39c24cf95eb2 does not exist May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-182259df-13c5-4c23-8bdb-990c7fa63e13'] May 19 04:56:01.468032 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:56:01.472210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6df27d61-7326-4282-85f8-5331ce75068c tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Returning 404 to user: Security group 8a8d9eea-656f-4262-95ad-39c24cf95eb2 does not exist May 19 04:56:01.472210 n-d-766726-30 devstack@n-api.service[124818]: Neutron server returns request_ids: ['req-182259df-13c5-4c23-8bdb-990c7fa63e13'] {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:56:01.474434 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6df27d61-7326-4282-85f8-5331ce75068c tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/8a8d9eea-656f-4262-95ad-39c24cf95eb2" status: 404 len: 194 microversion: 2.1 time: 0.074552 May 19 04:56:01.475526 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2626/5173] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 04:56:01 2022] GET /compute/v2.1/os-security-groups/8a8d9eea-656f-4262-95ad-39c24cf95eb2 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:56:01.487201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1cc821cb-ccc3-4926-9fc3-751c2d0d1e31 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Action: 'update', calling method: .version_select at 0x7fd31b7b6ee0>, body: {"security_group": {"name": "tempest-sg-60345765", "description": "tempest-description-1027946845"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:56:01.625915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG neutronclient.v2_0.client [None req-1cc821cb-ccc3-4926-9fc3-751c2d0d1e31 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6909d8c-2704-467b-8bf1-d154f6760941 does not exist", "detail": ""}} {{(pid=124819) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 04:56:01.626955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.security_group_api [None req-1cc821cb-ccc3-4926-9fc3-751c2d0d1e31 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Neutron security group c6909d8c-2704-467b-8bf1-d154f6760941 not found {{(pid=124819) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 04:56:01.628043 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-1cc821cb-ccc3-4926-9fc3-751c2d0d1e31 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] HTTP exception thrown: Security group c6909d8c-2704-467b-8bf1-d154f6760941 does not exist May 19 04:56:01.628043 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-54d7c6fe-e989-425f-80d6-f967dcd87eda'] May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1cc821cb-ccc3-4926-9fc3-751c2d0d1e31 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Request method failure captured: May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: request: PUT /compute/v2.1/os-security-groups/c6909d8c-2704-467b-8bf1-d154f6760941 HTTP/1.1 May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 100 May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc3ejmqL1dir7AQ7VMKgYGApRTtCfBzPmDUVnVHDmfEhKSyyWcnIbOQSxhA99EXUA8f7qMU54tT_mDisTF6Y9vcHlGxaJhDE7_TDocuwLUpu01wUNZH43PXFL6cHCs_VFQ1O2Tn6S1nyuSqb-ufTXehtinLzqRhO6pl8vVH43eoZv_U May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: cb2b8c8d87754b5eb6a7b00fa48a137a May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb2b8c8d87754b5eb6a7b00fa48a137a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: cb2b8c8d87754b5eb6a7b00fa48a137a May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-398596800 May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-SecurityGroupsNegativeTestJSON-398596800-project May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 399b6b60104e4493ad54a6968cd27e60 May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-398596800-project May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: {"security_group": {"name": "tempest-sg-60345765", "description": "tempest-description-1027946845"}} May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: method: May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: exception: Security group c6909d8c-2704-467b-8bf1-d154f6760941 does not exist May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-54d7c6fe-e989-425f-80d6-f967dcd87eda'] May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'c6909d8c-2704-467b-8bf1-d154f6760941', 'body': {'security_group': {'name': 'tempest-sg-60345765', 'description': 'tempest-description-1027946845'}}} May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 04:56:01.630959 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c6909d8c-2704-467b-8bf1-d154f6760941 does not exist May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54d7c6fe-e989-425f-80d6-f967dcd87eda'] May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c6909d8c-2704-467b-8bf1-d154f6760941 does not exist May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54d7c6fe-e989-425f-80d6-f967dcd87eda'] May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c6909d8c-2704-467b-8bf1-d154f6760941 does not exist May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54d7c6fe-e989-425f-80d6-f967dcd87eda'] May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c6909d8c-2704-467b-8bf1-d154f6760941 does not exist May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54d7c6fe-e989-425f-80d6-f967dcd87eda'] May 19 04:56:01.636010 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:01.641651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1cc821cb-ccc3-4926-9fc3-751c2d0d1e31 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] Returning 404 to user: Security group c6909d8c-2704-467b-8bf1-d154f6760941 does not exist May 19 04:56:01.641651 n-d-766726-30 devstack@n-api.service[124819]: Neutron server returns request_ids: ['req-54d7c6fe-e989-425f-80d6-f967dcd87eda'] {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:56:01.642912 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1cc821cb-ccc3-4926-9fc3-751c2d0d1e31 tempest-SecurityGroupsNegativeTestJSON-398596800 tempest-SecurityGroupsNegativeTestJSON-398596800-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/c6909d8c-2704-467b-8bf1-d154f6760941" status: 404 len: 194 microversion: 2.1 time: 0.162157 May 19 04:56:01.645200 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2548/5174] 10.222.0.58 () {60 vars in 1289 bytes} [Thu May 19 04:56:01 2022] PUT /compute/v2.1/os-security-groups/c6909d8c-2704-467b-8bf1-d154f6760941 => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:56:21.571462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:22.290006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cdb952ce-5216-41c6-84ef-e719f493a031 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Action: 'create', calling method: .version_select at 0x7fd3161bd4c0>, body: {"keypair": {"name": "tempest-keypair-774725680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWSmzu4++oMT4k/t22bTYNCUDzqwO6xnZ+saSp0ANh8WssYzKkBHJ2NAWM+9RESEwXzenIVPe4wnV5NRF88Sfh0csg1HnKt1TYjYiXGaEUr9ByPzGrCmsDb1vDV8xCyfg=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:56:22.310886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cdb952ce-5216-41c6-84ef-e719f493a031 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Getting quotas for project 94336246766545d08f043e75d47708d7. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:56:22.319602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cdb952ce-5216-41c6-84ef-e719f493a031 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Getting quotas for user 5d9d074b50ca4ed38fed487ebac3955d and project 94336246766545d08f043e75d47708d7. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:56:22.354152 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cdb952ce-5216-41c6-84ef-e719f493a031 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.783379 May 19 04:56:22.355524 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2627/5175] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:56:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:56:24.300010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=17 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:24.301056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=5 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:24.305890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c4fe989c-336e-4ded-b9e1-244339c8a78f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:24.306402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c4fe989c-336e-4ded-b9e1-244339c8a78f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:24.356496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4fe989c-336e-4ded-b9e1-244339c8a78f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:24.361888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4fe989c-336e-4ded-b9e1-244339c8a78f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:24.368480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4fe989c-336e-4ded-b9e1-244339c8a78f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:24.369055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4fe989c-336e-4ded-b9e1-244339c8a78f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:24.646562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-c4fe989c-336e-4ded-b9e1-244339c8a78f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lazy-loading 'services' on Instance uuid b0c54667-4cff-44ff-bf2d-776532b44bbb {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:56:24.686965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0a7c694-3f5e-4bb2-b586-f12679b07af3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:24.687913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f0a7c694-3f5e-4bb2-b586-f12679b07af3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:24.726220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a7c694-3f5e-4bb2-b586-f12679b07af3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:24.727619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a7c694-3f5e-4bb2-b586-f12679b07af3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:24.730984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a7c694-3f5e-4bb2-b586-f12679b07af3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:24.731634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0a7c694-3f5e-4bb2-b586-f12679b07af3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:24.877768 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0a7c694-3f5e-4bb2-b586-f12679b07af3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.199424 May 19 04:56:24.883937 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2628/5176] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 19 04:56:24 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac/os-volume_attachments => generated 25 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:24.932279 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c4fe989c-336e-4ded-b9e1-244339c8a78f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/os-volume_attachments/0581e3c1-6d54-4a93-a423-12370b3422d1" status: 202 len: 0 microversion: 2.1 time: 0.631002 May 19 04:56:24.934354 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2549/5177] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 04:56:24 2022] DELETE /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/os-volume_attachments/0581e3c1-6d54-4a93-a423-12370b3422d1 => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:56:25.040904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1971d8b0-ce64-4631-bf8a-ee280815e06e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:25.041469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1971d8b0-ce64-4631-bf8a-ee280815e06e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:25.048930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1971d8b0-ce64-4631-bf8a-ee280815e06e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:25.067976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1971d8b0-ce64-4631-bf8a-ee280815e06e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:25.068704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1971d8b0-ce64-4631-bf8a-ee280815e06e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:25.069176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1971d8b0-ce64-4631-bf8a-ee280815e06e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:25.181801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1971d8b0-ce64-4631-bf8a-ee280815e06e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:56:25.427869 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1971d8b0-ce64-4631-bf8a-ee280815e06e tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 204 len: 0 microversion: 2.20 time: 0.390501 May 19 04:56:25.433345 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2629/5178] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:56:25 2022] DELETE /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:56:25.440037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:25.440882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:25.474152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:25.478682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:25.483520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:25.484346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:27.376423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:27.396594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:27.404125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:27.408106 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-95adfb83-6263-472c-aaa0-42f27a013f76 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1724 microversion: 2.20 time: 1.973272 May 19 04:56:27.411372 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2550/5179] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:56:25 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1724 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:56:28.430650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:28.432090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:28.452014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:28.453954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:28.458207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:28.461937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:29.425041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:29.458121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:29.463498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:29.467767 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c73af2d-268e-4614-9d99-2ceab51f2cdc tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1724 microversion: 2.20 time: 1.043176 May 19 04:56:29.469953 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2630/5180] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:56:28 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1724 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:56:29.730576 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 04:56:29.731954 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 04:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 04:56:30.489382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:30.490933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:30.508216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:30.511634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:30.515841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:30.516670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:30.728438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:30.739698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:30.742623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:30.746866 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-22373fd9-b6c0-4d8f-b363-fdf9a522a2fe tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1657 microversion: 2.20 time: 0.262683 May 19 04:56:30.759499 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2551/5181] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:56:30 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1657 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 04:56:30.927513 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 04:56:30.928274 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 04:56:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 04:56:31.158949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-173312077", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "afc6345a-a054-4291-8222-33773181f0d4"}], "security_groups": [{"name": "tempest-securitygroup--1285287088"}], "key_name": "tempest-keypair-774725680", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:56:31.400076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] validate_networks() for [('afc6345a-a054-4291-8222-33773181f0d4', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:56:31.769245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:31.770484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:31.790961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:31.792129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:31.796200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:31.797673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:32.235113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:32.246251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:32.247789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69228739a9134460960e474b3ef7bebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd03a0c9b0e64169a903e07e1f2c97b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:32.248996 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74060461-26c8-43bc-beec-2a542fa37881 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 200 len: 1657 microversion: 2.20 time: 0.488404 May 19 04:56:32.276478 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2552/5182] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:56:31 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 1657 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 04:56:32.292057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-fc682cd3-3531-47ac-88ad-c28a55706c2a req-56f5672c-7ec2-4cd5-83f8-304ba32bd11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac690db0-97d0-40dc-9503-32c5474812ac", "name": "network-vif-deleted", "tag": "25b92ae1-0d83-44e7-bef8-803b7263b018"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:56:32.325448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fc682cd3-3531-47ac-88ad-c28a55706c2a req-56f5672c-7ec2-4cd5-83f8-304ba32bd11e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:32.330914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:32.336336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fc682cd3-3531-47ac-88ad-c28a55706c2a req-56f5672c-7ec2-4cd5-83f8-304ba32bd11e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:32.380588 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-fc682cd3-3531-47ac-88ad-c28a55706c2a req-56f5672c-7ec2-4cd5-83f8-304ba32bd11e service nova] Creating event network-vif-deleted:25b92ae1-0d83-44e7-bef8-803b7263b018 for instance ac690db0-97d0-40dc-9503-32c5474812ac on n-h1-766726-30 May 19 04:56:32.396697 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-fc682cd3-3531-47ac-88ad-c28a55706c2a req-56f5672c-7ec2-4cd5-83f8-304ba32bd11e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117366 May 19 04:56:32.397382 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2553/5183] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:56:33.295604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:33.297258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:33.336988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:33.349306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:33.353579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:33.354826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:33.389315 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] HTTP exception thrown: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:33.394945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Getting quotas for project 94336246766545d08f043e75d47708d7. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Request method failure captured: May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac HTTP/1.1 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwxaTv3uc4FXmEuIc304YX_0FKsW028TuyIRC3wdWPeTx0pP8Wl0476NGuLeS_gt_qr1T0hSPZouayZnmXdSkEwfeUmqY-l8HmdKRAoxpU_GBqHTBZoeUDdJdl7Y__pQcw_woOzSqRFmjIzVO53SdaXkHo37gNjPN19t2L8jmYfn6U May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.20 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 69228739a9134460960e474b3ef7bebf May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'ac690db0-97d0-40dc-9503-32c5474812ac'} May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:33.398502 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Returning 404 to user: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7f0c56ac-6b33-4bc9-8dfd-6e24166ffa97 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 404 len: 111 microversion: 2.20 time: 0.109006 May 19 04:56:33.406890 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2554/5184] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:56:33 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:56:33.415117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9107c0bd-4edb-4ae4-8e36-72b50811dc44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '.version_select at 0x7fd315c50700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:33.420053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Getting quotas for user 5d9d074b50ca4ed38fed487ebac3955d and project 94336246766545d08f043e75d47708d7. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:56:33.454517 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9107c0bd-4edb-4ae4-8e36-72b50811dc44 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571677450" status: 204 len: 0 microversion: 2.20 time: 0.048605 May 19 04:56:33.458523 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2555/5185] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 19 04:56:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571677450 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 04:56:33.471917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:56:33.472524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:56:33.474729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:56:33.475170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:56:33.478698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:56:33.506518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:33.508928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:33.512607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:33.513104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:33.559761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Getting quotas for project 94336246766545d08f043e75d47708d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:56:33.593852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Getting quotas for user 5d9d074b50ca4ed38fed487ebac3955d and project 94336246766545d08f043e75d47708d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:56:33.624142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:56:33.626587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:56:33.762542 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c14fe0c1-6750-4e51-bc12-5e8907962af1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.607777 May 19 04:56:33.763223 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2631/5186] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:56:31 2022] POST /compute/v2.1/servers => generated 407 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:56:33.775170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e0955756-78fa-4a3a-b239-49942a9ab2e8 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:33.776338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e0955756-78fa-4a3a-b239-49942a9ab2e8 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:34.527066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e0955756-78fa-4a3a-b239-49942a9ab2e8 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:34.540325 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e0955756-78fa-4a3a-b239-49942a9ab2e8 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1268 microversion: 2.1 time: 0.770768 May 19 04:56:34.543802 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2556/5187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:33 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1268 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:35.561727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b33f1415-b22e-49b1-a477-8ea642015c5a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:35.563836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b33f1415-b22e-49b1-a477-8ea642015c5a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:35.612472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b33f1415-b22e-49b1-a477-8ea642015c5a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:35.614887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b33f1415-b22e-49b1-a477-8ea642015c5a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:35.620875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b33f1415-b22e-49b1-a477-8ea642015c5a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:35.626192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b33f1415-b22e-49b1-a477-8ea642015c5a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:36.774211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b33f1415-b22e-49b1-a477-8ea642015c5a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:36.790015 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b33f1415-b22e-49b1-a477-8ea642015c5a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1320 microversion: 2.1 time: 1.236941 May 19 04:56:36.792540 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2632/5188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:35 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1320 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:37.808972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c439c7e6-06df-45c2-a0cc-3382312c1b3e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:37.810226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c439c7e6-06df-45c2-a0cc-3382312c1b3e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:37.821755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c439c7e6-06df-45c2-a0cc-3382312c1b3e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:37.829263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c439c7e6-06df-45c2-a0cc-3382312c1b3e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:37.830296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c439c7e6-06df-45c2-a0cc-3382312c1b3e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:37.830759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c439c7e6-06df-45c2-a0cc-3382312c1b3e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:37.948936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c439c7e6-06df-45c2-a0cc-3382312c1b3e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:37.961409 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c439c7e6-06df-45c2-a0cc-3382312c1b3e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1326 microversion: 2.1 time: 0.156188 May 19 04:56:37.963359 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2557/5189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:37 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1326 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:38.980591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2cb97917-ef1b-438b-b620-f04e007629b1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:38.981907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2cb97917-ef1b-438b-b620-f04e007629b1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:38.998407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cb97917-ef1b-438b-b620-f04e007629b1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:38.998866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cb97917-ef1b-438b-b620-f04e007629b1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:38.999649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cb97917-ef1b-438b-b620-f04e007629b1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:39.000088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2cb97917-ef1b-438b-b620-f04e007629b1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:39.947802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2cb97917-ef1b-438b-b620-f04e007629b1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:39.962683 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2cb97917-ef1b-438b-b620-f04e007629b1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1394 microversion: 2.1 time: 0.987218 May 19 04:56:39.968406 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2633/5190] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:38 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1394 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:40.368999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5a6cdcdf-a42a-43b3-bcd6-645b6d71595f req-08409822-3dd4-47dc-b524-4ffafd03add7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4ddb87-a16b-4ee0-9be4-fdac5e326ece", "tag": "1eeec9d8-5e09-4654-9f65-61f889c788d0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:56:40.388551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5a6cdcdf-a42a-43b3-bcd6-645b6d71595f req-08409822-3dd4-47dc-b524-4ffafd03add7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:40.393961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5a6cdcdf-a42a-43b3-bcd6-645b6d71595f req-08409822-3dd4-47dc-b524-4ffafd03add7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:40.418463 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5a6cdcdf-a42a-43b3-bcd6-645b6d71595f req-08409822-3dd4-47dc-b524-4ffafd03add7 service nova] Creating event network-changed:1eeec9d8-5e09-4654-9f65-61f889c788d0 for instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece on n-h1-766726-30 May 19 04:56:40.427372 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5a6cdcdf-a42a-43b3-bcd6-645b6d71595f req-08409822-3dd4-47dc-b524-4ffafd03add7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063350 May 19 04:56:40.429439 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2558/5191] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:56:40.984630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a45f10da-863a-420d-8564-6397e40209a5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:40.985425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a45f10da-863a-420d-8564-6397e40209a5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:41.020035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a45f10da-863a-420d-8564-6397e40209a5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:41.024282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a45f10da-863a-420d-8564-6397e40209a5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:41.025823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a45f10da-863a-420d-8564-6397e40209a5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:41.027581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a45f10da-863a-420d-8564-6397e40209a5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:41.660881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a45f10da-863a-420d-8564-6397e40209a5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:41.671186 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a45f10da-863a-420d-8564-6397e40209a5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1394 microversion: 2.1 time: 0.690877 May 19 04:56:41.677381 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2634/5192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:40 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1394 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:42.697571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9360ec47-1c9e-4500-8f2e-ba8b87b1614a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:42.698292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9360ec47-1c9e-4500-8f2e-ba8b87b1614a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:42.719904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9360ec47-1c9e-4500-8f2e-ba8b87b1614a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:42.720366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9360ec47-1c9e-4500-8f2e-ba8b87b1614a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:42.721185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9360ec47-1c9e-4500-8f2e-ba8b87b1614a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:42.721635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9360ec47-1c9e-4500-8f2e-ba8b87b1614a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:43.294907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9360ec47-1c9e-4500-8f2e-ba8b87b1614a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:43.308449 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9360ec47-1c9e-4500-8f2e-ba8b87b1614a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1394 microversion: 2.1 time: 0.616778 May 19 04:56:43.311505 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2559/5193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:42 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1394 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:44.325185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:44.326866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=10 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:44.333151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89ee429f-c7d6-430f-8839-befd102ef894 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:44.334820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-89ee429f-c7d6-430f-8839-befd102ef894 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:44.359397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ee429f-c7d6-430f-8839-befd102ef894 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:44.377217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ee429f-c7d6-430f-8839-befd102ef894 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:44.379490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ee429f-c7d6-430f-8839-befd102ef894 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:44.380128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ee429f-c7d6-430f-8839-befd102ef894 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:44.795562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:44.796125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:44.804391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:44.806707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:44.808353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:44.809433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:44.810191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:44.849350 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] HTTP exception thrown: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Request method failure captured: May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac HTTP/1.1 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwxaTv3uc4FXmEuIc304YX_0FKsW028TuyIRC3wdWPeTx0pP8Wl0476NGuLeS_gt_qr1T0hSPZouayZnmXdSkEwfeUmqY-l8HmdKRAoxpU_GBqHTBZoeUDdJdl7Y__pQcw_woOzSqRFmjIzVO53SdaXkHo37gNjPN19t2L8jmYfn6U May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.20 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 69228739a9134460960e474b3ef7bebf May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'ac690db0-97d0-40dc-9503-32c5474812ac'} May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:56:44.851810 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.857292 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.860262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Returning 404 to user: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:56:44.861534 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-14b21959-0f8a-4742-84d0-39e86eeeb5ae tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 404 len: 111 microversion: 2.20 time: 0.072525 May 19 04:56:44.866813 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2560/5194] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:56:44 2022] DELETE /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:56:44.872900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:44.873766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: ac690db0-97d0-40dc-9503-32c5474812ac] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:44.891413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:44.893571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:44.898695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:44.899365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:44.932880 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] HTTP exception thrown: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Request method failure captured: May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac HTTP/1.1 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwxaTv3uc4FXmEuIc304YX_0FKsW028TuyIRC3wdWPeTx0pP8Wl0476NGuLeS_gt_qr1T0hSPZouayZnmXdSkEwfeUmqY-l8HmdKRAoxpU_GBqHTBZoeUDdJdl7Y__pQcw_woOzSqRFmjIzVO53SdaXkHo37gNjPN19t2L8jmYfn6U May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.20 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 69228739a9134460960e474b3ef7bebf May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'ac690db0-97d0-40dc-9503-32c5474812ac'} May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.935510 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:56:44.940385 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.940385 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:56:44.940385 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:56:44.940385 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:56:44.940385 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:56:44.940385 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:56:44.940385 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. May 19 04:56:44.940385 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:56:44.942030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Returning 404 to user: Instance ac690db0-97d0-40dc-9503-32c5474812ac could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:56:44.945331 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eed3c944-93bd-405f-b495-bb8d0f2efc0f tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac" status: 404 len: 111 microversion: 2.20 time: 0.077171 May 19 04:56:44.953257 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2561/5195] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:56:44 2022] GET /compute/v2.1/servers/ac690db0-97d0-40dc-9503-32c5474812ac => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:56:45.681162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-89ee429f-c7d6-430f-8839-befd102ef894 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:45.698281 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-89ee429f-c7d6-430f-8839-befd102ef894 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1394 microversion: 2.1 time: 1.375053 May 19 04:56:45.699204 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2635/5196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:44 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1394 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:46.716230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69d74286-dc5c-4304-9a13-b5ced74e729e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:46.717499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-69d74286-dc5c-4304-9a13-b5ced74e729e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:46.727793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69d74286-dc5c-4304-9a13-b5ced74e729e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:46.730520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69d74286-dc5c-4304-9a13-b5ced74e729e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:46.731889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69d74286-dc5c-4304-9a13-b5ced74e729e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:46.733696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69d74286-dc5c-4304-9a13-b5ced74e729e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:47.285489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69d74286-dc5c-4304-9a13-b5ced74e729e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:47.296758 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69d74286-dc5c-4304-9a13-b5ced74e729e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1394 microversion: 2.1 time: 0.585235 May 19 04:56:47.302792 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2562/5197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:46 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1394 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:48.319176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d46da95-b9eb-4678-9b0e-ed76d4c545ca tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:48.319803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7d46da95-b9eb-4678-9b0e-ed76d4c545ca tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:48.332633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d46da95-b9eb-4678-9b0e-ed76d4c545ca tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:48.333351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d46da95-b9eb-4678-9b0e-ed76d4c545ca tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:48.337174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d46da95-b9eb-4678-9b0e-ed76d4c545ca tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:48.337820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d46da95-b9eb-4678-9b0e-ed76d4c545ca tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:48.488504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9846df94-2c3e-4ec4-9268-8f7bcd67ccf0 req-ab3b2398-2f50-4747-93ea-ca6d0aaac755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4ddb87-a16b-4ee0-9be4-fdac5e326ece", "name": "network-vif-plugged", "status": "completed", "tag": "1eeec9d8-5e09-4654-9f65-61f889c788d0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:56:48.517587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9846df94-2c3e-4ec4-9268-8f7bcd67ccf0 req-ab3b2398-2f50-4747-93ea-ca6d0aaac755 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:48.519292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9846df94-2c3e-4ec4-9268-8f7bcd67ccf0 req-ab3b2398-2f50-4747-93ea-ca6d0aaac755 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:48.564308 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9846df94-2c3e-4ec4-9268-8f7bcd67ccf0 req-ab3b2398-2f50-4747-93ea-ca6d0aaac755 service nova] Creating event network-vif-plugged:1eeec9d8-5e09-4654-9f65-61f889c788d0 for instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece on n-h1-766726-30 May 19 04:56:48.584451 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9846df94-2c3e-4ec4-9268-8f7bcd67ccf0 req-ab3b2398-2f50-4747-93ea-ca6d0aaac755 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094903 May 19 04:56:48.590485 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2563/5198] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:56:48.765239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7d46da95-b9eb-4678-9b0e-ed76d4c545ca tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:48.778493 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d46da95-b9eb-4678-9b0e-ed76d4c545ca tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1394 microversion: 2.1 time: 0.460845 May 19 04:56:48.779140 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2636/5199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:48 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1394 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:49.802905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c63ca2e-5faa-441f-b9e7-091362f4f25a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:49.804240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c63ca2e-5faa-441f-b9e7-091362f4f25a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:49.815607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c63ca2e-5faa-441f-b9e7-091362f4f25a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:49.824619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c63ca2e-5faa-441f-b9e7-091362f4f25a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:49.825428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c63ca2e-5faa-441f-b9e7-091362f4f25a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:49.829733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c63ca2e-5faa-441f-b9e7-091362f4f25a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:50.253016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0c63ca2e-5faa-441f-b9e7-091362f4f25a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:50.267797 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c63ca2e-5faa-441f-b9e7-091362f4f25a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1394 microversion: 2.1 time: 0.473464 May 19 04:56:50.277486 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2564/5200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:49 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1394 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:51.284425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c1954f6-0ae6-45d5-a1b1-841f3785a94a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:51.285421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1c1954f6-0ae6-45d5-a1b1-841f3785a94a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:51.298405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c1954f6-0ae6-45d5-a1b1-841f3785a94a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:51.300579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c1954f6-0ae6-45d5-a1b1-841f3785a94a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:51.304008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c1954f6-0ae6-45d5-a1b1-841f3785a94a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:51.304726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c1954f6-0ae6-45d5-a1b1-841f3785a94a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:51.575262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1c1954f6-0ae6-45d5-a1b1-841f3785a94a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:51.588809 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1c1954f6-0ae6-45d5-a1b1-841f3785a94a tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1575 microversion: 2.1 time: 0.308611 May 19 04:56:51.590258 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2637/5201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:51 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1575 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:51.610283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-abd432e9-7a2d-4689-898e-157750f6b913 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:51.610843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-abd432e9-7a2d-4689-898e-157750f6b913 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:51.634334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abd432e9-7a2d-4689-898e-157750f6b913 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:51.634802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abd432e9-7a2d-4689-898e-157750f6b913 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:51.635598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abd432e9-7a2d-4689-898e-157750f6b913 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:51.640633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abd432e9-7a2d-4689-898e-157750f6b913 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:51.887156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-061b7a50-9243-456e-b80e-f96c165541fe tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:56:51.897321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:51.900728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-9243-456e-b80e-f96c165541fe tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:51.901443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-9243-456e-b80e-f96c165541fe tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:51.942079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:51.943372 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-abd432e9-7a2d-4689-898e-157750f6b913 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.341256 May 19 04:56:51.945285 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2565/5202] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:56:51 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece/os-interface => generated 284 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:56:51.950156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-061b7a50-9243-456e-b80e-f96c165541fe tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Going to try to stop instance {{(pid=124818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 04:56:52.040946 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-061b7a50-9243-456e-b80e-f96c165541fe tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.161439 May 19 04:56:52.044115 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2638/5203] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:56:51 2022] POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:56:52.050748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32fae009-4d97-404f-91b9-603f4421481e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:52.051303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-32fae009-4d97-404f-91b9-603f4421481e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:52.060753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32fae009-4d97-404f-91b9-603f4421481e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:52.061339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32fae009-4d97-404f-91b9-603f4421481e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:52.062136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32fae009-4d97-404f-91b9-603f4421481e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:52.062580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32fae009-4d97-404f-91b9-603f4421481e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:52.607969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-32fae009-4d97-404f-91b9-603f4421481e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:52.622626 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-32fae009-4d97-404f-91b9-603f4421481e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1678 microversion: 2.1 time: 0.575853 May 19 04:56:52.634004 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2566/5204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:52 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1678 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:53.640811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df8a8fce-0de1-40c7-b9a2-b5e7afcb8e3d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:53.641765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df8a8fce-0de1-40c7-b9a2-b5e7afcb8e3d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:53.654996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df8a8fce-0de1-40c7-b9a2-b5e7afcb8e3d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:53.661703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df8a8fce-0de1-40c7-b9a2-b5e7afcb8e3d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:53.665912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df8a8fce-0de1-40c7-b9a2-b5e7afcb8e3d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:53.666869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df8a8fce-0de1-40c7-b9a2-b5e7afcb8e3d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:54.192348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-df8a8fce-0de1-40c7-b9a2-b5e7afcb8e3d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:54.207385 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df8a8fce-0de1-40c7-b9a2-b5e7afcb8e3d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1678 microversion: 2.1 time: 0.571261 May 19 04:56:54.212910 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2639/5205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:53 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1678 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:55.232832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-95fb4a55-25d3-4faf-a011-8a7e9b36ed1d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:55.234114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-95fb4a55-25d3-4faf-a011-8a7e9b36ed1d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:55.247693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:55.250113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95fb4a55-25d3-4faf-a011-8a7e9b36ed1d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:55.254872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95fb4a55-25d3-4faf-a011-8a7e9b36ed1d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:55.258226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95fb4a55-25d3-4faf-a011-8a7e9b36ed1d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:55.265023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95fb4a55-25d3-4faf-a011-8a7e9b36ed1d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:55.279922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:56:55.648757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-95fb4a55-25d3-4faf-a011-8a7e9b36ed1d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:55.683367 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-95fb4a55-25d3-4faf-a011-8a7e9b36ed1d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1678 microversion: 2.1 time: 0.455811 May 19 04:56:55.685039 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2567/5206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:55 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1678 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:56.092504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aff37eff-eb3c-4c19-8146-1885fec8ace5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:56.093156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aff37eff-eb3c-4c19-8146-1885fec8ace5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:56.121726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aff37eff-eb3c-4c19-8146-1885fec8ace5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:56.122179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aff37eff-eb3c-4c19-8146-1885fec8ace5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:56.122977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aff37eff-eb3c-4c19-8146-1885fec8ace5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:56.123425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aff37eff-eb3c-4c19-8146-1885fec8ace5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:56.603140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9496c01f-44ce-4993-8297-64ae7dec6ead req-10fb029f-ba5b-4cfb-af2e-3e874d1db80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4ddb87-a16b-4ee0-9be4-fdac5e326ece", "tag": "1eeec9d8-5e09-4654-9f65-61f889c788d0"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:56:56.628293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9496c01f-44ce-4993-8297-64ae7dec6ead req-10fb029f-ba5b-4cfb-af2e-3e874d1db80b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:56.629803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9496c01f-44ce-4993-8297-64ae7dec6ead req-10fb029f-ba5b-4cfb-af2e-3e874d1db80b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:56.642508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aff37eff-eb3c-4c19-8146-1885fec8ace5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:56.668684 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aff37eff-eb3c-4c19-8146-1885fec8ace5 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1575 microversion: 2.1 time: 0.580573 May 19 04:56:56.681204 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9496c01f-44ce-4993-8297-64ae7dec6ead req-10fb029f-ba5b-4cfb-af2e-3e874d1db80b service nova] Creating event network-changed:1eeec9d8-5e09-4654-9f65-61f889c788d0 for instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece on n-h1-766726-30 May 19 04:56:56.681588 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2640/5207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:56 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1575 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:56.682299 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9496c01f-44ce-4993-8297-64ae7dec6ead req-10fb029f-ba5b-4cfb-af2e-3e874d1db80b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.586318 May 19 04:56:56.685545 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2568/5208] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:56:56.704634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48f8a1fb-679a-4a01-be01-a919171f0108 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:56.709470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48f8a1fb-679a-4a01-be01-a919171f0108 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:56.727849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48f8a1fb-679a-4a01-be01-a919171f0108 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:56.731624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48f8a1fb-679a-4a01-be01-a919171f0108 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:56.733738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48f8a1fb-679a-4a01-be01-a919171f0108 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:56.742540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48f8a1fb-679a-4a01-be01-a919171f0108 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:57.076936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-48f8a1fb-679a-4a01-be01-a919171f0108 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:57.088664 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48f8a1fb-679a-4a01-be01-a919171f0108 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1678 microversion: 2.1 time: 0.388889 May 19 04:56:57.091216 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2641/5209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:56 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1678 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:58.109470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b4d4b93-57c0-40f5-b097-872fbcc36600 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:58.110968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b4d4b93-57c0-40f5-b097-872fbcc36600 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:58.122086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b4d4b93-57c0-40f5-b097-872fbcc36600 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:58.125700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b4d4b93-57c0-40f5-b097-872fbcc36600 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:58.126839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b4d4b93-57c0-40f5-b097-872fbcc36600 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:58.130084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b4d4b93-57c0-40f5-b097-872fbcc36600 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:58.755962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b4d4b93-57c0-40f5-b097-872fbcc36600 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:56:58.766901 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b4d4b93-57c0-40f5-b097-872fbcc36600 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1678 microversion: 2.1 time: 0.662294 May 19 04:56:58.770250 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2569/5210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:58 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1678 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:56:59.788993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-155df189-8294-434d-b6a3-b915c25d2bb9 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:56:59.790199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-155df189-8294-434d-b6a3-b915c25d2bb9 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:56:59.806604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-155df189-8294-434d-b6a3-b915c25d2bb9 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:59.808741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-155df189-8294-434d-b6a3-b915c25d2bb9 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:56:59.809816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-155df189-8294-434d-b6a3-b915c25d2bb9 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:56:59.810475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-155df189-8294-434d-b6a3-b915c25d2bb9 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:00.387841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-155df189-8294-434d-b6a3-b915c25d2bb9 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:00.397251 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-155df189-8294-434d-b6a3-b915c25d2bb9 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1678 microversion: 2.1 time: 0.613675 May 19 04:57:00.409788 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2642/5211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:56:59 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1678 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:01.415682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d3d2624-323f-41c9-9a07-a72b790b031f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:01.417189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2d3d2624-323f-41c9-9a07-a72b790b031f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:01.439429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d3d2624-323f-41c9-9a07-a72b790b031f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:01.440103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d3d2624-323f-41c9-9a07-a72b790b031f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:01.440956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d3d2624-323f-41c9-9a07-a72b790b031f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:01.441436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d3d2624-323f-41c9-9a07-a72b790b031f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:01.677598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d3d2624-323f-41c9-9a07-a72b790b031f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:01.686985 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d3d2624-323f-41c9-9a07-a72b790b031f tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1678 microversion: 2.1 time: 0.275887 May 19 04:57:01.688558 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2570/5212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:01 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1678 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:02.180146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:02.180777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:02.200576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:02.202383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:02.204633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:02.206654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:02.237793 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] HTTP exception thrown: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Request method failure captured: May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da HTTP/1.1 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihcwxaTv3uc4FXmEuIc304YX_0FKsW028TuyIRC3wdWPeTx0pP8Wl0476NGuLeS_gt_qr1T0hSPZouayZnmXdSkEwfeUmqY-l8HmdKRAoxpU_GBqHTBZoeUDdJdl7Y__pQcw_woOzSqRFmjIzVO53SdaXkHo37gNjPN19t2L8jmYfn6U May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Openstack-Nova-Api-Version: 2.20 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 69228739a9134460960e474b3ef7bebf May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '894769ad-4295-4aff-8ba0-30957e6ec8da'} May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:57:02.239525 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:02.243782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Returning 404 to user: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:57:02.246292 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1796dcc-2a63-478a-b92b-cfcbc20e71e3 tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "DELETE /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 404 len: 111 microversion: 2.20 time: 0.070096 May 19 04:57:02.247247 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2643/5213] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 04:57:02 2022] DELETE /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 04:57:02.256607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:02.257228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] [instance: 894769ad-4295-4aff-8ba0-30957e6ec8da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:02.268858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:02.269191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:02.270002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:02.270454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:02.303072 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] HTTP exception thrown: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Request method failure captured: May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da HTTP/1.1 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihcwxaTv3uc4FXmEuIc304YX_0FKsW028TuyIRC3wdWPeTx0pP8Wl0476NGuLeS_gt_qr1T0hSPZouayZnmXdSkEwfeUmqY-l8HmdKRAoxpU_GBqHTBZoeUDdJdl7Y__pQcw_woOzSqRFmjIzVO53SdaXkHo37gNjPN19t2L8jmYfn6U May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.20 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd03a0c9b0e64169a903e07e1f2c97b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bd03a0c9b0e64169a903e07e1f2c97b6 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1866394442 May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 69228739a9134460960e474b3ef7bebf May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1866394442-project May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '894769ad-4295-4aff-8ba0-30957e6ec8da'} May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:02.306434 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:57:02.310699 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:02.310699 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:02.310699 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:57:02.310699 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:57:02.310699 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:57:02.310699 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:57:02.310699 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. May 19 04:57:02.310699 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:02.322798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] Returning 404 to user: Instance 894769ad-4295-4aff-8ba0-30957e6ec8da could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:57:02.327428 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9d39bfe6-2561-4136-87b3-4473270dc45b tempest-AttachVolumeShelveTestJSON-1866394442 tempest-AttachVolumeShelveTestJSON-1866394442-project] 10.222.0.58 "GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da" status: 404 len: 111 microversion: 2.20 time: 0.075612 May 19 04:57:02.343254 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2571/5214] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 04:57:02 2022] GET /compute/v2.1/servers/894769ad-4295-4aff-8ba0-30957e6ec8da => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 04:57:02.704451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-37fc7c0a-d3a9-4c0f-9aa2-8d4b79888a0e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:02.705113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-37fc7c0a-d3a9-4c0f-9aa2-8d4b79888a0e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:02.713475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37fc7c0a-d3a9-4c0f-9aa2-8d4b79888a0e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:02.713870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37fc7c0a-d3a9-4c0f-9aa2-8d4b79888a0e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:02.714677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37fc7c0a-d3a9-4c0f-9aa2-8d4b79888a0e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:02.715124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37fc7c0a-d3a9-4c0f-9aa2-8d4b79888a0e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:03.086623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-37fc7c0a-d3a9-4c0f-9aa2-8d4b79888a0e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:03.098398 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-37fc7c0a-d3a9-4c0f-9aa2-8d4b79888a0e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1655 microversion: 2.1 time: 0.397722 May 19 04:57:03.098993 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2644/5215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:02 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1655 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:03.115489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bf1d5747-8e54-4424-88a5-6be21a11514d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:57:03.139397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf1d5747-8e54-4424-88a5-6be21a11514d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:03.140149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf1d5747-8e54-4424-88a5-6be21a11514d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:03.198882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bf1d5747-8e54-4424-88a5-6be21a11514d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Going to try to start instance {{(pid=124819) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 04:57:03.320690 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bf1d5747-8e54-4424-88a5-6be21a11514d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.209073 May 19 04:57:03.321348 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2572/5216] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:57:03 2022] POST /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 04:57:03.329780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64cac166-c0ba-472f-a739-8799520e5275 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:03.330483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64cac166-c0ba-472f-a739-8799520e5275 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:03.351996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64cac166-c0ba-472f-a739-8799520e5275 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:03.355368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64cac166-c0ba-472f-a739-8799520e5275 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:03.356372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64cac166-c0ba-472f-a739-8799520e5275 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:03.359541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64cac166-c0ba-472f-a739-8799520e5275 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:04.050426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-64cac166-c0ba-472f-a739-8799520e5275 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:04.059446 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64cac166-c0ba-472f-a739-8799520e5275 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1664 microversion: 2.1 time: 0.733585 May 19 04:57:04.066141 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2645/5217] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:03 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1664 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:05.084715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7de9605b-5954-4952-b558-0a33d1a9ec10 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:05.086023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7de9605b-5954-4952-b558-0a33d1a9ec10 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:05.103392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7de9605b-5954-4952-b558-0a33d1a9ec10 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:05.103854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7de9605b-5954-4952-b558-0a33d1a9ec10 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:05.109818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7de9605b-5954-4952-b558-0a33d1a9ec10 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:05.112117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7de9605b-5954-4952-b558-0a33d1a9ec10 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:05.650094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7de9605b-5954-4952-b558-0a33d1a9ec10 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:05.661353 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7de9605b-5954-4952-b558-0a33d1a9ec10 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1664 microversion: 2.1 time: 0.582284 May 19 04:57:05.672800 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2573/5218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:05 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1664 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:06.687519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca67b4a7-4064-4a82-a0ac-34a21ea55b08 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:06.688489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca67b4a7-4064-4a82-a0ac-34a21ea55b08 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:06.701637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca67b4a7-4064-4a82-a0ac-34a21ea55b08 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:06.708714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca67b4a7-4064-4a82-a0ac-34a21ea55b08 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:06.710038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca67b4a7-4064-4a82-a0ac-34a21ea55b08 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:06.711816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca67b4a7-4064-4a82-a0ac-34a21ea55b08 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:07.229712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ca67b4a7-4064-4a82-a0ac-34a21ea55b08 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:07.238025 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ca67b4a7-4064-4a82-a0ac-34a21ea55b08 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1668 microversion: 2.1 time: 0.554092 May 19 04:57:07.241852 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2646/5219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:06 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1668 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:29.756840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3458ec9d-4239-4f87-a0d8-0ea89c6c85d3 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:29.762211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3458ec9d-4239-4f87-a0d8-0ea89c6c85d3 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:29.766183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3458ec9d-4239-4f87-a0d8-0ea89c6c85d3 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Searching by: {'deleted': False, 'project_id': '94336246766545d08f043e75d47708d7'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:57:29.800166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=13 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:57:29.815209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:57:29.824162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3458ec9d-4239-4f87-a0d8-0ea89c6c85d3 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:29.824635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3458ec9d-4239-4f87-a0d8-0ea89c6c85d3 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:29.829993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3458ec9d-4239-4f87-a0d8-0ea89c6c85d3 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:29.832008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3458ec9d-4239-4f87-a0d8-0ea89c6c85d3 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:29.911771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-3458ec9d-4239-4f87-a0d8-0ea89c6c85d3 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:57:30.046725 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3458ec9d-4239-4f87-a0d8-0ea89c6c85d3 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.294849 May 19 04:57:30.049483 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2574/5220] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 04:57:29 2022] GET /compute/v2.1/servers => generated 333 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:57:30.066007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:30.079343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:30.081800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Searching by: {'deleted': False, 'project_id': '94336246766545d08f043e75d47708d7'} {{(pid=124818) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 04:57:30.101953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=17 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:57:30.105027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:57:30.121626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:30.122526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:30.123428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:30.123881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:30.278730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.multi_cell_list [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124818) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 04:57:30.450022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:30.486420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:30.488836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:31.207202 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73179bb7-c96e-4fd6-8f8f-d83655e108e1 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 1.145360 May 19 04:57:31.209865 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2647/5221] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 04:57:30 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:57:31.253475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79453121-e0ac-4bc7-a570-76a59eecd4a8 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:31.273477 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79453121-e0ac-4bc7-a570-76a59eecd4a8 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026419 May 19 04:57:31.277873 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2575/5222] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 19 04:57:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:57:31.632737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b046175b-a2f2-44c2-8508-00cd3b20a9ec tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:31.633641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b046175b-a2f2-44c2-8508-00cd3b20a9ec tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:31.643783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b046175b-a2f2-44c2-8508-00cd3b20a9ec tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:31.644802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b046175b-a2f2-44c2-8508-00cd3b20a9ec tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:31.647072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b046175b-a2f2-44c2-8508-00cd3b20a9ec tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:31.647864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b046175b-a2f2-44c2-8508-00cd3b20a9ec tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:31.707184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b046175b-a2f2-44c2-8508-00cd3b20a9ec tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:57:31.864180 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b046175b-a2f2-44c2-8508-00cd3b20a9ec tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 204 len: 0 microversion: 2.1 time: 0.236280 May 19 04:57:31.865156 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2648/5223] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:57:31 2022] DELETE /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:57:31.887154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3f0743e-885e-4993-861c-0dd506fcb9cd tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:31.890376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c3f0743e-885e-4993-861c-0dd506fcb9cd tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:31.916730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3f0743e-885e-4993-861c-0dd506fcb9cd tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:31.919450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3f0743e-885e-4993-861c-0dd506fcb9cd tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:31.922859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3f0743e-885e-4993-861c-0dd506fcb9cd tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:31.923649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3f0743e-885e-4993-861c-0dd506fcb9cd tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:32.696268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c3f0743e-885e-4993-861c-0dd506fcb9cd tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:32.713777 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3f0743e-885e-4993-861c-0dd506fcb9cd tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1699 microversion: 2.1 time: 0.842491 May 19 04:57:32.714408 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2576/5224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:31 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1699 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:33.738980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d379057-28fe-44ea-8d75-371950cbe34e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:33.739937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7d379057-28fe-44ea-8d75-371950cbe34e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:33.754771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d379057-28fe-44ea-8d75-371950cbe34e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:33.765534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d379057-28fe-44ea-8d75-371950cbe34e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:33.772115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d379057-28fe-44ea-8d75-371950cbe34e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:33.772839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d379057-28fe-44ea-8d75-371950cbe34e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:34.165282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7d379057-28fe-44ea-8d75-371950cbe34e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:34.188500 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d379057-28fe-44ea-8d75-371950cbe34e tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1699 microversion: 2.1 time: 0.454790 May 19 04:57:34.207770 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2649/5225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:33 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1699 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:35.217046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d921bc2c-238b-4f6a-bcca-6bfaf1a48155 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:35.219361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d921bc2c-238b-4f6a-bcca-6bfaf1a48155 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:35.251406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d921bc2c-238b-4f6a-bcca-6bfaf1a48155 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:35.252030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d921bc2c-238b-4f6a-bcca-6bfaf1a48155 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:35.253486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d921bc2c-238b-4f6a-bcca-6bfaf1a48155 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:35.254956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d921bc2c-238b-4f6a-bcca-6bfaf1a48155 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:36.652639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d921bc2c-238b-4f6a-bcca-6bfaf1a48155 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9d074b50ca4ed38fed487ebac3955d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94336246766545d08f043e75d47708d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:36.709864 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d921bc2c-238b-4f6a-bcca-6bfaf1a48155 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 200 len: 1699 microversion: 2.1 time: 1.498271 May 19 04:57:36.714005 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2577/5226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:35 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 1699 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:36.845837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-394b56b6-154b-4991-8337-349acedd6b54 req-41cf945c-ad5f-48f5-a9db-90aa9dc05cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4ddb87-a16b-4ee0-9be4-fdac5e326ece", "name": "network-vif-deleted", "tag": "1eeec9d8-5e09-4654-9f65-61f889c788d0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:57:36.885574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-394b56b6-154b-4991-8337-349acedd6b54 req-41cf945c-ad5f-48f5-a9db-90aa9dc05cf2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:36.904841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-394b56b6-154b-4991-8337-349acedd6b54 req-41cf945c-ad5f-48f5-a9db-90aa9dc05cf2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:36.976278 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-394b56b6-154b-4991-8337-349acedd6b54 req-41cf945c-ad5f-48f5-a9db-90aa9dc05cf2 service nova] Creating event network-vif-deleted:1eeec9d8-5e09-4654-9f65-61f889c788d0 for instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece on n-h1-766726-30 May 19 04:57:36.993486 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-394b56b6-154b-4991-8337-349acedd6b54 req-41cf945c-ad5f-48f5-a9db-90aa9dc05cf2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158988 May 19 04:57:37.001627 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2650/5227] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:57:37.733035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:37.734325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] [instance: ee4ddb87-a16b-4ee0-9be4-fdac5e326ece] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:37.762484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:37.764016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:37.767835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:37.770209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:37.850868 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] HTTP exception thrown: Instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece could not be found. May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Request method failure captured: May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece HTTP/1.1 May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc311GVUYtf_OMS6eXYx63FMrdbU4Ogxtm4Bk9-rd3lJ9cralI4P4eTJmyZQTYhI3n-zn1dMrH652xRIGPspibl9lJa9t9e5waIX1dIuGWalRxz0p50aDHyNVPpKiVHRFKIfJ5p0rCi5jSeUQTTI8Bgbv8LtGx8UQaFYR9bEqEH1FlM May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 94336246766545d08f043e75d47708d7 May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersTestJSON-521098754 May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/94336246766545d08f043e75d47708d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94336246766545d08f043e75d47708d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94336246766545d08f043e75d47708d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_94336246766545d08f043e75d47708d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersTestJSON-521098754 May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 94336246766545d08f043e75d47708d7 May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersTestJSON-521098754 May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersTestJSON-521098754-project May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5d9d074b50ca4ed38fed487ebac3955d May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersTestJSON-521098754-project May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece could not be found. May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'ee4ddb87-a16b-4ee0-9be4-fdac5e326ece'} May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece could not be found. May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece could not be found. May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:37.854534 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:37.860117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:57:37.860117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:57:37.860117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:57:37.860117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:57:37.860117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece could not be found. May 19 04:57:37.860117 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:57:37.863805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Returning 404 to user: Instance ee4ddb87-a16b-4ee0-9be4-fdac5e326ece could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:57:37.868479 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4a14a529-6d6b-49db-aeee-7d2e78e796ce tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece" status: 404 len: 111 microversion: 2.1 time: 0.141428 May 19 04:57:37.872565 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2578/5228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:37 2022] GET /compute/v2.1/servers/ee4ddb87-a16b-4ee0-9be4-fdac5e326ece => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:57:37.883025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb16514a-8bc2-4b99-9e0a-07ae6114d4d8 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] Calling method '.version_select at 0x7fd314f1eee0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:37.963646 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eb16514a-8bc2-4b99-9e0a-07ae6114d4d8 tempest-ServersTestJSON-521098754 tempest-ServersTestJSON-521098754-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774725680" status: 202 len: 0 microversion: 2.1 time: 0.086017 May 19 04:57:37.976091 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2651/5229] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 19 04:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774725680 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:57:40.250082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-522dd105-5826-4603-8159-4fef12c588f8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:40.251952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-522dd105-5826-4603-8159-4fef12c588f8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:40.262181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:57:40.278318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-522dd105-5826-4603-8159-4fef12c588f8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:40.280300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-522dd105-5826-4603-8159-4fef12c588f8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:40.281199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-522dd105-5826-4603-8159-4fef12c588f8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:40.281663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-522dd105-5826-4603-8159-4fef12c588f8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:40.408670 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-522dd105-5826-4603-8159-4fef12c588f8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.169634 May 19 04:57:40.412234 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2579/5230] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 04:57:40 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:57:40.576597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:57:40.579203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:57:40.592630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43282733-9761-4c64-87b7-5b9ced228453 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:40.604514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43282733-9761-4c64-87b7-5b9ced228453 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:40.632222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43282733-9761-4c64-87b7-5b9ced228453 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:40.638689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43282733-9761-4c64-87b7-5b9ced228453 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:40.639821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43282733-9761-4c64-87b7-5b9ced228453 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:40.640442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43282733-9761-4c64-87b7-5b9ced228453 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:40.713038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43282733-9761-4c64-87b7-5b9ced228453 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 04:57:40.958306 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43282733-9761-4c64-87b7-5b9ced228453 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 204 len: 0 microversion: 2.1 time: 0.377430 May 19 04:57:40.960246 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2652/5231] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 04:57:40 2022] DELETE /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 04:57:40.968545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-751054a3-9ec2-4be8-a672-73aa238b6b48 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:40.969218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-751054a3-9ec2-4be8-a672-73aa238b6b48 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:40.983795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-751054a3-9ec2-4be8-a672-73aa238b6b48 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:40.991602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-751054a3-9ec2-4be8-a672-73aa238b6b48 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:40.992871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-751054a3-9ec2-4be8-a672-73aa238b6b48 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:40.993611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-751054a3-9ec2-4be8-a672-73aa238b6b48 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:41.626364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-751054a3-9ec2-4be8-a672-73aa238b6b48 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:41.637250 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-751054a3-9ec2-4be8-a672-73aa238b6b48 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1674 microversion: 2.1 time: 0.671856 May 19 04:57:41.639236 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2580/5232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:40 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1674 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:42.656265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a7dbbcd-3292-4c91-ac5d-a3e276a627af tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:42.657683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a7dbbcd-3292-4c91-ac5d-a3e276a627af tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:42.676390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a7dbbcd-3292-4c91-ac5d-a3e276a627af tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:42.679284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a7dbbcd-3292-4c91-ac5d-a3e276a627af tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:42.683961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a7dbbcd-3292-4c91-ac5d-a3e276a627af tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:42.685606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a7dbbcd-3292-4c91-ac5d-a3e276a627af tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:43.510448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a7dbbcd-3292-4c91-ac5d-a3e276a627af tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:43.528632 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a7dbbcd-3292-4c91-ac5d-a3e276a627af tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1674 microversion: 2.1 time: 0.876852 May 19 04:57:43.529568 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2653/5233] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:42 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1674 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:44.547210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a3e2aed-1c2e-4e39-8ceb-cac47fe1ab6a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:44.548532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2a3e2aed-1c2e-4e39-8ceb-cac47fe1ab6a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:44.563881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a3e2aed-1c2e-4e39-8ceb-cac47fe1ab6a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:44.564420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a3e2aed-1c2e-4e39-8ceb-cac47fe1ab6a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:44.567718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a3e2aed-1c2e-4e39-8ceb-cac47fe1ab6a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:44.568278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a3e2aed-1c2e-4e39-8ceb-cac47fe1ab6a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:44.772259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2a3e2aed-1c2e-4e39-8ceb-cac47fe1ab6a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:44.783254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a3e2aed-1c2e-4e39-8ceb-cac47fe1ab6a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1606 microversion: 2.1 time: 0.239914 May 19 04:57:44.784701 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2581/5234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:44 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1606 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:45.386048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-48d6c5f7-9877-43b1-ac05-abc6f7754882 req-7fe91d34-b03a-4194-95d1-1a5625c5f31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c54667-4cff-44ff-bf2d-776532b44bbb", "name": "network-vif-deleted", "tag": "c98aad4d-3582-4e76-bd48-1c48c6206d54"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:57:45.403420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-48d6c5f7-9877-43b1-ac05-abc6f7754882 req-7fe91d34-b03a-4194-95d1-1a5625c5f31d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:45.405659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-48d6c5f7-9877-43b1-ac05-abc6f7754882 req-7fe91d34-b03a-4194-95d1-1a5625c5f31d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:45.427446 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-48d6c5f7-9877-43b1-ac05-abc6f7754882 req-7fe91d34-b03a-4194-95d1-1a5625c5f31d service nova] Creating event network-vif-deleted:c98aad4d-3582-4e76-bd48-1c48c6206d54 for instance b0c54667-4cff-44ff-bf2d-776532b44bbb on n-h2-766726-30 May 19 04:57:45.467075 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-48d6c5f7-9877-43b1-ac05-abc6f7754882 req-7fe91d34-b03a-4194-95d1-1a5625c5f31d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088789 May 19 04:57:45.479396 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2654/5235] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:57:45.806828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:45.809059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:45.836990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:45.839417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:45.845810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:45.849266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:46.038838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:46.045808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:46.055191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lazy-loading 'fault' on Instance uuid b0c54667-4cff-44ff-bf2d-776532b44bbb {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:57:46.163016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:57:46.190492 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c5a8319-2a8a-4e50-ac82-ef2504a83786 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 200 len: 1327 microversion: 2.1 time: 0.392303 May 19 04:57:46.196999 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2582/5236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:45 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 1327 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:57:47.217605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:47.218880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:57:47.239516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:47.256594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:47.257879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:57:47.258555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:57:47.302456 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] HTTP exception thrown: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Request method failure captured: May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb HTTP/1.1 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc1MYGlSCjIKY9S_BwpQUAg9JUsYSzvxqCnPYFDL3TbyzveY3prJJg2S1NYiApfITLVv5oqxbIJJ8MKQ2GJOpfx8amV3lvP96kFs4Bk7CYsHSLFIJmWIfjVjhS-thkN4LeYd8sdQw_u0M7eaCjwY0TT9wMTj9jtOUVINIhMTsYowjJc May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeTestJSON-1836870491 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeTestJSON-1836870491-project May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: def2cad1e80b4ca6873f030527b0c5c7 May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeTestJSON-1836870491-project May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'b0c54667-4cff-44ff-bf2d-776532b44bbb'} May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:57:47.316391 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:47.320704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:57:47.320704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:57:47.320704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:57:47.320704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:57:47.320704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:57:47.320704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 04:57:47.320704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:57:47.323545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Returning 404 to user: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:57:47.324701 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d53a6388-69e3-4eea-8d67-733c7d2ca944 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 404 len: 111 microversion: 2.1 time: 0.114953 May 19 04:57:47.329257 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2655/5237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:57:47 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:57:47.338396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b2fbc9e-cf1b-4fe9-81d0-edff26fc0185 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '.version_select at 0x7fd315a17b80>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:57:47.387187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b2fbc9e-cf1b-4fe9-81d0-edff26fc0185 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086489007" status: 202 len: 0 microversion: 2.1 time: 0.051621 May 19 04:57:47.388407 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2583/5238] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 19 04:57:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086489007 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:57:52.759000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-56f91f58-17a1-4402-b981-9a8320c8b40d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'create', calling method: .version_select at 0x7fd314df5820>, body: {"keypair": {"name": "tempest-keypair-1921893673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyWGOtW3UcQF2mWb2kWIJzZmc5bVYiAqUD9+DSyxFCiHqXMszw6OHKviKSzdpCdOC6JMrUgRTD7snwMg97ztSSidp+VujJU0tHLb3toDej4rIPb/UNyvDsJr3Q2MCJnwg=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:57:52.803618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-56f91f58-17a1-4402-b981-9a8320c8b40d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Getting quotas for project e7d15dedbc0c4eeb97a0d88d664b5818. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:57:52.830672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-56f91f58-17a1-4402-b981-9a8320c8b40d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Getting quotas for user def2cad1e80b4ca6873f030527b0c5c7 and project e7d15dedbc0c4eeb97a0d88d664b5818. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:57:52.913019 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-56f91f58-17a1-4402-b981-9a8320c8b40d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158113 May 19 04:57:52.919922 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2656/5239] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 04:57:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:58:01.701546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1803487236", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bfc03c1-8722-42b4-9527-7ed06dac2387"}], "security_groups": [{"name": "tempest-securitygroup--406855705"}], "key_name": "tempest-keypair-1921893673", "user_data": "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:58:01.770860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=48 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:01.772796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:02.015407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] validate_networks() for [('4bfc03c1-8722-42b4-9527-7ed06dac2387', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:58:04.274540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:58:04.275179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:58:04.276000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:58:04.276505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:58:04.277300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:58:04.312050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:04.313533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:04.313533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:04.313882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:04.437901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Getting quotas for project e7d15dedbc0c4eeb97a0d88d664b5818. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:58:04.453413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Getting quotas for user def2cad1e80b4ca6873f030527b0c5c7 and project e7d15dedbc0c4eeb97a0d88d664b5818. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:58:04.499105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:58:04.501546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:58:04.686543 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [60b054fc-875c-4035-941a-ea23b453aade] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 04:58:05.700352 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [60b054fc-875c-4035-941a-ea23b453aade] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 56826. May 19 04:58:05.715740 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f509234c-6266-436b-bf79-e7b7e3293ef7 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.015224 May 19 04:58:05.717176 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2584/5240] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:58:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 4021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:58:05.728378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:05.730324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:05.731319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:05.744706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-53952695-d423-49bb-a52a-744fd884e350 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:05.745655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-53952695-d423-49bb-a52a-744fd884e350 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:06.026616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-53952695-d423-49bb-a52a-744fd884e350 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:06.033924 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-53952695-d423-49bb-a52a-744fd884e350 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1238 microversion: 2.1 time: 0.310399 May 19 04:58:06.037689 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2657/5241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:05 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1238 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:07.056045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1261f54-3547-44c3-bedc-88f19a058365 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:07.056682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e1261f54-3547-44c3-bedc-88f19a058365 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:07.491788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e1261f54-3547-44c3-bedc-88f19a058365 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:07.507052 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e1261f54-3547-44c3-bedc-88f19a058365 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1238 microversion: 2.1 time: 0.456385 May 19 04:58:07.508064 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2585/5242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:07 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1238 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:08.525968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6acac031-33df-4262-9ca8-1b0bc162c36d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:08.526715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6acac031-33df-4262-9ca8-1b0bc162c36d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:08.852824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6acac031-33df-4262-9ca8-1b0bc162c36d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:08.860627 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6acac031-33df-4262-9ca8-1b0bc162c36d tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1238 microversion: 2.1 time: 0.338384 May 19 04:58:08.863637 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2658/5243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:08 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1238 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:09.883449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3afdc278-4121-4955-a038-e76ed0a57200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:09.885959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3afdc278-4121-4955-a038-e76ed0a57200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:09.982004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3afdc278-4121-4955-a038-e76ed0a57200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:09.994716 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3afdc278-4121-4955-a038-e76ed0a57200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1238 microversion: 2.1 time: 0.118223 May 19 04:58:09.996596 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2586/5244] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:09 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:11.013601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c130196d-b727-4c94-b119-1af1a48bba85 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:11.015307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c130196d-b727-4c94-b119-1af1a48bba85 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:11.025594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c130196d-b727-4c94-b119-1af1a48bba85 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:11.033924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c130196d-b727-4c94-b119-1af1a48bba85 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:11.035064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c130196d-b727-4c94-b119-1af1a48bba85 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:11.035736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c130196d-b727-4c94-b119-1af1a48bba85 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:11.309783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c130196d-b727-4c94-b119-1af1a48bba85 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:11.322862 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c130196d-b727-4c94-b119-1af1a48bba85 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1242 microversion: 2.1 time: 0.313002 May 19 04:58:11.324122 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2659/5245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:11 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1242 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:12.348850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7791d4be-caf0-4e28-b798-9fa8842ab370 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:12.353979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7791d4be-caf0-4e28-b798-9fa8842ab370 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:12.369318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7791d4be-caf0-4e28-b798-9fa8842ab370 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:12.370154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7791d4be-caf0-4e28-b798-9fa8842ab370 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:12.371218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7791d4be-caf0-4e28-b798-9fa8842ab370 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:12.371888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7791d4be-caf0-4e28-b798-9fa8842ab370 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:13.044233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7791d4be-caf0-4e28-b798-9fa8842ab370 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:13.060407 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7791d4be-caf0-4e28-b798-9fa8842ab370 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1308 microversion: 2.1 time: 0.708420 May 19 04:58:13.061215 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2587/5246] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:12 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1308 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:14.090911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47aa51de-015a-4e65-a403-408f8e96be9e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:14.092732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47aa51de-015a-4e65-a403-408f8e96be9e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:14.125733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47aa51de-015a-4e65-a403-408f8e96be9e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:14.148930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47aa51de-015a-4e65-a403-408f8e96be9e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:14.150102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47aa51de-015a-4e65-a403-408f8e96be9e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:14.154598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47aa51de-015a-4e65-a403-408f8e96be9e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:14.507214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47aa51de-015a-4e65-a403-408f8e96be9e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:14.522445 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47aa51de-015a-4e65-a403-408f8e96be9e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1296 microversion: 2.1 time: 0.437630 May 19 04:58:14.523024 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2660/5247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:14 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1296 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:15.539824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24add0cb-f55d-4636-ad1f-44e07e947fc8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:15.540356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-24add0cb-f55d-4636-ad1f-44e07e947fc8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:15.543932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:15.557963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24add0cb-f55d-4636-ad1f-44e07e947fc8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:15.558419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24add0cb-f55d-4636-ad1f-44e07e947fc8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:15.559328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24add0cb-f55d-4636-ad1f-44e07e947fc8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:15.562788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24add0cb-f55d-4636-ad1f-44e07e947fc8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:15.858106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-24add0cb-f55d-4636-ad1f-44e07e947fc8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:15.875687 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-24add0cb-f55d-4636-ad1f-44e07e947fc8 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1296 microversion: 2.1 time: 0.340148 May 19 04:58:15.876301 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2588/5248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:15 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1296 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:16.893242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-996778d9-829d-473a-bc4d-9a9a394f1699 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:16.894688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-996778d9-829d-473a-bc4d-9a9a394f1699 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:16.917232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-996778d9-829d-473a-bc4d-9a9a394f1699 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:16.917746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-996778d9-829d-473a-bc4d-9a9a394f1699 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:16.920714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-996778d9-829d-473a-bc4d-9a9a394f1699 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:16.921202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-996778d9-829d-473a-bc4d-9a9a394f1699 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:18.550754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-996778d9-829d-473a-bc4d-9a9a394f1699 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:18.560771 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-996778d9-829d-473a-bc4d-9a9a394f1699 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 1.670712 May 19 04:58:18.574813 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2661/5249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:16 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:19.578333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-16c16d00-9a95-4154-8664-68485d5c13f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:19.578954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-16c16d00-9a95-4154-8664-68485d5c13f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:19.594678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16c16d00-9a95-4154-8664-68485d5c13f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:19.595137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16c16d00-9a95-4154-8664-68485d5c13f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:19.596466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16c16d00-9a95-4154-8664-68485d5c13f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:19.596902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16c16d00-9a95-4154-8664-68485d5c13f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:19.988113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=10 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:21.068082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-16c16d00-9a95-4154-8664-68485d5c13f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:21.096919 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-16c16d00-9a95-4154-8664-68485d5c13f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 1.522351 May 19 04:58:21.098495 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2589/5250] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:19 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:22.126581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0e7bf8b5-04ab-4f2a-9447-ab1456a2d8fd tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:22.129864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0e7bf8b5-04ab-4f2a-9447-ab1456a2d8fd tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:22.134862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:22.162942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e7bf8b5-04ab-4f2a-9447-ab1456a2d8fd tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:22.164300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e7bf8b5-04ab-4f2a-9447-ab1456a2d8fd tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:22.167104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e7bf8b5-04ab-4f2a-9447-ab1456a2d8fd tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:22.170030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e7bf8b5-04ab-4f2a-9447-ab1456a2d8fd tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:22.853785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0e7bf8b5-04ab-4f2a-9447-ab1456a2d8fd tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:22.876186 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0e7bf8b5-04ab-4f2a-9447-ab1456a2d8fd tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 0.765131 May 19 04:58:22.887271 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2662/5251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:22 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:23.711035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a384fc3b-d5b9-48ce-81b6-101adc72a703 req-96618f64-7de4-4d15-b880-436a06886992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd", "tag": "9332fda4-9dc7-4e6d-b4a4-5f7a2c52cded"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:58:23.735031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a384fc3b-d5b9-48ce-81b6-101adc72a703 req-96618f64-7de4-4d15-b880-436a06886992 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:23.735478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a384fc3b-d5b9-48ce-81b6-101adc72a703 req-96618f64-7de4-4d15-b880-436a06886992 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:23.783739 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a384fc3b-d5b9-48ce-81b6-101adc72a703 req-96618f64-7de4-4d15-b880-436a06886992 service nova] Creating event network-changed:9332fda4-9dc7-4e6d-b4a4-5f7a2c52cded for instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd on n-h2-766726-30 May 19 04:58:23.801682 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a384fc3b-d5b9-48ce-81b6-101adc72a703 req-96618f64-7de4-4d15-b880-436a06886992 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099051 May 19 04:58:23.805193 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2590/5252] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:58:23.898985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-21f490e6-4245-410b-aa7e-accb74dd2f0c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:23.909231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-21f490e6-4245-410b-aa7e-accb74dd2f0c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:23.932182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21f490e6-4245-410b-aa7e-accb74dd2f0c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:23.933037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21f490e6-4245-410b-aa7e-accb74dd2f0c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:23.936106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21f490e6-4245-410b-aa7e-accb74dd2f0c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:23.936906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-21f490e6-4245-410b-aa7e-accb74dd2f0c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:25.697485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-21f490e6-4245-410b-aa7e-accb74dd2f0c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:25.713107 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-21f490e6-4245-410b-aa7e-accb74dd2f0c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 1.822042 May 19 04:58:25.727333 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2663/5253] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:23 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:26.737411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aafd0ded-b66a-4347-a2ad-7d7f8006a9f1 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:26.738249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aafd0ded-b66a-4347-a2ad-7d7f8006a9f1 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:26.755931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aafd0ded-b66a-4347-a2ad-7d7f8006a9f1 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:26.761414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aafd0ded-b66a-4347-a2ad-7d7f8006a9f1 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:26.773467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aafd0ded-b66a-4347-a2ad-7d7f8006a9f1 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:26.775812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aafd0ded-b66a-4347-a2ad-7d7f8006a9f1 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:28.043107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aafd0ded-b66a-4347-a2ad-7d7f8006a9f1 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:28.059719 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aafd0ded-b66a-4347-a2ad-7d7f8006a9f1 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 1.329696 May 19 04:58:28.063136 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2591/5254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:26 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:29.080709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-95311756-7ce9-449c-a771-25b2e24e06f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:29.082310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-95311756-7ce9-449c-a771-25b2e24e06f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:29.101156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95311756-7ce9-449c-a771-25b2e24e06f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:29.103514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95311756-7ce9-449c-a771-25b2e24e06f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:29.105212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95311756-7ce9-449c-a771-25b2e24e06f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:29.106583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95311756-7ce9-449c-a771-25b2e24e06f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:31.377098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-95311756-7ce9-449c-a771-25b2e24e06f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:31.415640 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-95311756-7ce9-449c-a771-25b2e24e06f2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 2.340411 May 19 04:58:31.426598 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2664/5255] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:29 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:32.435897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd5ecf65-4e4e-4ba9-a756-aa463977ec24 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:32.436529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bd5ecf65-4e4e-4ba9-a756-aa463977ec24 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:32.479581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:32.484703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd5ecf65-4e4e-4ba9-a756-aa463977ec24 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:32.488914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd5ecf65-4e4e-4ba9-a756-aa463977ec24 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:32.490512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd5ecf65-4e4e-4ba9-a756-aa463977ec24 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:32.491176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd5ecf65-4e4e-4ba9-a756-aa463977ec24 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:32.558063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=29 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:34.254201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bd5ecf65-4e4e-4ba9-a756-aa463977ec24 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:34.279772 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd5ecf65-4e4e-4ba9-a756-aa463977ec24 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 1.837455 May 19 04:58:34.282442 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2592/5256] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:32 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:35.058320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1496664186", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:58:35.269473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] validate_networks() for [('1db4a5ca-bf36-40c5-88df-09d75f43d7e7', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:58:35.326126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-98aa1e37-317c-4e5d-bbb5-076a62fe599a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:35.333693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-98aa1e37-317c-4e5d-bbb5-076a62fe599a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:35.351270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98aa1e37-317c-4e5d-bbb5-076a62fe599a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:35.351964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98aa1e37-317c-4e5d-bbb5-076a62fe599a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:35.356476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98aa1e37-317c-4e5d-bbb5-076a62fe599a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:35.358818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98aa1e37-317c-4e5d-bbb5-076a62fe599a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:36.614382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-98aa1e37-317c-4e5d-bbb5-076a62fe599a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:36.640186 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-98aa1e37-317c-4e5d-bbb5-076a62fe599a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 1.326450 May 19 04:58:36.648954 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2593/5257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:35 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:37.523353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:58:37.523899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:58:37.524293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:58:37.524711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:58:37.526557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:58:37.536892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=23 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:37.565862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:37.569670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:37.570805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:37.573050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:37.638060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=37 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:37.664520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3ed6d031-4c74-49b3-96dd-deeb2019e0e3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:37.665203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3ed6d031-4c74-49b3-96dd-deeb2019e0e3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:37.682140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Getting quotas for project 92d413674d7946c4a845a0ab2c2cec20. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:58:37.694111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Getting quotas for user 0e75fb6c77b44c22b95693d01448e3d2 and project 92d413674d7946c4a845a0ab2c2cec20. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:58:37.696437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ed6d031-4c74-49b3-96dd-deeb2019e0e3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:37.696900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ed6d031-4c74-49b3-96dd-deeb2019e0e3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:37.702222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ed6d031-4c74-49b3-96dd-deeb2019e0e3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:37.704442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3ed6d031-4c74-49b3-96dd-deeb2019e0e3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:37.727830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:58:37.731042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:58:37.944916 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a75deb2-9a7b-44ce-ac66-08362ef97e0f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.460984 May 19 04:58:37.961760 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2665/5258] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:58:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 3479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:58:37.977432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4cf9b068-2984-4f1e-b014-d2972dda9a22 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:37.978199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4cf9b068-2984-4f1e-b014-d2972dda9a22 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:38.303946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4cf9b068-2984-4f1e-b014-d2972dda9a22 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:38.312552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4cf9b068-2984-4f1e-b014-d2972dda9a22 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1222 microversion: 2.1 time: 0.348122 May 19 04:58:38.316206 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2666/5259] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:37 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1222 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:38.581938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3ed6d031-4c74-49b3-96dd-deeb2019e0e3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:38.591065 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3ed6d031-4c74-49b3-96dd-deeb2019e0e3 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 0.932994 May 19 04:58:38.593161 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2594/5260] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:37 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:58:38.625318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-20738456", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:58:38.785109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] validate_networks() for [('1db4a5ca-bf36-40c5-88df-09d75f43d7e7', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 04:58:38.875045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-95ba2ea7-d0af-4f73-b7d9-05dc32fe0384 req-284b9e2c-8fc7-459f-83fc-50ec713cc4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd", "name": "network-vif-plugged", "status": "completed", "tag": "9332fda4-9dc7-4e6d-b4a4-5f7a2c52cded"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:58:38.897790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-95ba2ea7-d0af-4f73-b7d9-05dc32fe0384 req-284b9e2c-8fc7-459f-83fc-50ec713cc4ca service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:38.898649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-95ba2ea7-d0af-4f73-b7d9-05dc32fe0384 req-284b9e2c-8fc7-459f-83fc-50ec713cc4ca service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:38.927389 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-95ba2ea7-d0af-4f73-b7d9-05dc32fe0384 req-284b9e2c-8fc7-459f-83fc-50ec713cc4ca service nova] Creating event network-vif-plugged:9332fda4-9dc7-4e6d-b4a4-5f7a2c52cded for instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd on n-h2-766726-30 May 19 04:58:38.937124 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-95ba2ea7-d0af-4f73-b7d9-05dc32fe0384 req-284b9e2c-8fc7-459f-83fc-50ec713cc4ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.619499 May 19 04:58:38.938717 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2667/5261] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:58:39.621362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0555f67a-13f1-4665-b083-c224bd72cf7c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:39.622089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0555f67a-13f1-4665-b083-c224bd72cf7c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:39.642749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0555f67a-13f1-4665-b083-c224bd72cf7c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:39.649791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0555f67a-13f1-4665-b083-c224bd72cf7c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:39.651109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0555f67a-13f1-4665-b083-c224bd72cf7c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:39.651732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0555f67a-13f1-4665-b083-c224bd72cf7c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:40.799055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0555f67a-13f1-4665-b083-c224bd72cf7c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:40.833858 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0555f67a-13f1-4665-b083-c224bd72cf7c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1363 microversion: 2.1 time: 1.217281 May 19 04:58:40.837727 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2668/5262] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:39 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1363 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:41.853833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-de83e4b1-e27d-4716-9fbf-dae9e0e8b23a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:41.855658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-de83e4b1-e27d-4716-9fbf-dae9e0e8b23a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:41.872230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de83e4b1-e27d-4716-9fbf-dae9e0e8b23a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:41.886478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de83e4b1-e27d-4716-9fbf-dae9e0e8b23a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:41.890992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de83e4b1-e27d-4716-9fbf-dae9e0e8b23a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:41.894504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-de83e4b1-e27d-4716-9fbf-dae9e0e8b23a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:42.109404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 04:58:42.110116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 04:58:42.110406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 04:58:42.110802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 04:58:42.111173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 04:58:42.129620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:42.130034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:42.130889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:42.131305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:42.210424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Getting quotas for project 92d413674d7946c4a845a0ab2c2cec20. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 04:58:42.225710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Getting quotas for user 0e75fb6c77b44c22b95693d01448e3d2 and project 92d413674d7946c4a845a0ab2c2cec20. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 04:58:42.241944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 04:58:42.244476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 04:58:42.396740 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-731c626e-00cb-4ca0-a52a-56e7b6abf168 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.776865 May 19 04:58:42.403675 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2595/5263] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 04:58:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 3785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 04:58:42.417030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1b6c211-7e99-42f8-87af-71524b18df56 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:42.420017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f1b6c211-7e99-42f8-87af-71524b18df56 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:42.770118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f1b6c211-7e99-42f8-87af-71524b18df56 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:42.781967 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f1b6c211-7e99-42f8-87af-71524b18df56 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1220 microversion: 2.1 time: 0.376261 May 19 04:58:42.783582 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2596/5264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:42 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1220 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:43.247906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-de83e4b1-e27d-4716-9fbf-dae9e0e8b23a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:43.261521 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-de83e4b1-e27d-4716-9fbf-dae9e0e8b23a tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1549 microversion: 2.1 time: 1.409828 May 19 04:58:43.276101 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2669/5265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:41 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1549 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:43.281521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-808b424b-eba8-4947-8c57-92c8bfeef380 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:43.282306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-808b424b-eba8-4947-8c57-92c8bfeef380 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:43.294503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-808b424b-eba8-4947-8c57-92c8bfeef380 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:43.309465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-808b424b-eba8-4947-8c57-92c8bfeef380 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:43.310458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-808b424b-eba8-4947-8c57-92c8bfeef380 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:43.310927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-808b424b-eba8-4947-8c57-92c8bfeef380 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:43.703813 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-808b424b-eba8-4947-8c57-92c8bfeef380 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.425929 May 19 04:58:43.705871 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2597/5266] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 04:58:43 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-interface => generated 284 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:58:43.802955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d178a526-a681-4b56-b72d-9f95fea08f7a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:43.804045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d178a526-a681-4b56-b72d-9f95fea08f7a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:43.821710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d178a526-a681-4b56-b72d-9f95fea08f7a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:43.823324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d178a526-a681-4b56-b72d-9f95fea08f7a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:43.825908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d178a526-a681-4b56-b72d-9f95fea08f7a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:43.828916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d178a526-a681-4b56-b72d-9f95fea08f7a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:44.219075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d178a526-a681-4b56-b72d-9f95fea08f7a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:44.256776 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d178a526-a681-4b56-b72d-9f95fea08f7a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1216 microversion: 2.1 time: 0.460559 May 19 04:58:44.279401 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2670/5267] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:43 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1216 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:45.281818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d49db655-aaa8-4262-8aa8-555dac4fa5b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:45.282671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d49db655-aaa8-4262-8aa8-555dac4fa5b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:45.295943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d49db655-aaa8-4262-8aa8-555dac4fa5b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:45.296694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d49db655-aaa8-4262-8aa8-555dac4fa5b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:45.298396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d49db655-aaa8-4262-8aa8-555dac4fa5b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:45.300864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d49db655-aaa8-4262-8aa8-555dac4fa5b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:46.094394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d49db655-aaa8-4262-8aa8-555dac4fa5b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:46.132816 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d49db655-aaa8-4262-8aa8-555dac4fa5b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1278 microversion: 2.1 time: 0.851137 May 19 04:58:46.161305 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2598/5268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:45 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1278 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:47.165277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6906c1de-5abc-41f1-9e6c-8dc8db3daa10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:47.166057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6906c1de-5abc-41f1-9e6c-8dc8db3daa10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:47.194070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6906c1de-5abc-41f1-9e6c-8dc8db3daa10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:47.196122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6906c1de-5abc-41f1-9e6c-8dc8db3daa10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:47.200181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6906c1de-5abc-41f1-9e6c-8dc8db3daa10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:47.202961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6906c1de-5abc-41f1-9e6c-8dc8db3daa10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:47.352407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-351e67a4-1912-4011-a561-96335b7f3ba1 req-14c267d5-0162-4a25-ad5c-280d1cd596c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58ad16d-f383-4e83-9fa9-77275956590c", "tag": "7e7974e1-fefd-4636-9522-51a5ac917637"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:58:47.374743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-351e67a4-1912-4011-a561-96335b7f3ba1 req-14c267d5-0162-4a25-ad5c-280d1cd596c8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:47.381814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-351e67a4-1912-4011-a561-96335b7f3ba1 req-14c267d5-0162-4a25-ad5c-280d1cd596c8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:47.443148 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-351e67a4-1912-4011-a561-96335b7f3ba1 req-14c267d5-0162-4a25-ad5c-280d1cd596c8 service nova] Creating event network-changed:7e7974e1-fefd-4636-9522-51a5ac917637 for instance d58ad16d-f383-4e83-9fa9-77275956590c on n-h1-766726-30 May 19 04:58:47.459144 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-351e67a4-1912-4011-a561-96335b7f3ba1 req-14c267d5-0162-4a25-ad5c-280d1cd596c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522007 May 19 04:58:47.465162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2671/5269] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:58:48.044157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6906c1de-5abc-41f1-9e6c-8dc8db3daa10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:48.052739 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6906c1de-5abc-41f1-9e6c-8dc8db3daa10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1278 microversion: 2.1 time: 0.900895 May 19 04:58:48.053739 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2599/5270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:47 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1278 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:58:49.073050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2773e285-2f81-4be3-ab22-e77c709ee842 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:49.075198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2773e285-2f81-4be3-ab22-e77c709ee842 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:49.079700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:49.086141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:49.110229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2773e285-2f81-4be3-ab22-e77c709ee842 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:49.113452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2773e285-2f81-4be3-ab22-e77c709ee842 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:49.125489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2773e285-2f81-4be3-ab22-e77c709ee842 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:49.126600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2773e285-2f81-4be3-ab22-e77c709ee842 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:50.350625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2773e285-2f81-4be3-ab22-e77c709ee842 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:50.371010 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2773e285-2f81-4be3-ab22-e77c709ee842 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 1.303782 May 19 04:58:50.377857 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2672/5271] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:49 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:51.388801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5162a978-42b1-4f2f-948f-a97383457c6f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:51.389451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5162a978-42b1-4f2f-948f-a97383457c6f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:51.434736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5162a978-42b1-4f2f-948f-a97383457c6f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:51.434921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5162a978-42b1-4f2f-948f-a97383457c6f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:51.435596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5162a978-42b1-4f2f-948f-a97383457c6f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:51.446604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5162a978-42b1-4f2f-948f-a97383457c6f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:52.060072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-468ded7d-ea8d-48ad-9f42-d0e24996b131 req-83c6b055-499c-4108-903c-72f73af6f610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd", "tag": "9332fda4-9dc7-4e6d-b4a4-5f7a2c52cded"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:58:52.092011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-468ded7d-ea8d-48ad-9f42-d0e24996b131 req-83c6b055-499c-4108-903c-72f73af6f610 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:52.093563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-468ded7d-ea8d-48ad-9f42-d0e24996b131 req-83c6b055-499c-4108-903c-72f73af6f610 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:52.133166 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-468ded7d-ea8d-48ad-9f42-d0e24996b131 req-83c6b055-499c-4108-903c-72f73af6f610 service nova] Creating event network-changed:9332fda4-9dc7-4e6d-b4a4-5f7a2c52cded for instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd on n-h2-766726-30 May 19 04:58:52.148343 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-468ded7d-ea8d-48ad-9f42-d0e24996b131 req-83c6b055-499c-4108-903c-72f73af6f610 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092422 May 19 04:58:52.168576 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2673/5272] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 04:58:52.173060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:52.706027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5162a978-42b1-4f2f-948f-a97383457c6f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:52.714370 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5162a978-42b1-4f2f-948f-a97383457c6f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 1.329343 May 19 04:58:52.722103 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2600/5273] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:51 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:53.737573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47cd21ed-adb7-48a1-b884-a9c66676f759 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:53.738453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47cd21ed-adb7-48a1-b884-a9c66676f759 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:53.754402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47cd21ed-adb7-48a1-b884-a9c66676f759 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:53.755516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47cd21ed-adb7-48a1-b884-a9c66676f759 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:53.760254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47cd21ed-adb7-48a1-b884-a9c66676f759 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:53.761626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47cd21ed-adb7-48a1-b884-a9c66676f759 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:54.924580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47cd21ed-adb7-48a1-b884-a9c66676f759 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:54.939073 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47cd21ed-adb7-48a1-b884-a9c66676f759 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 1.206395 May 19 04:58:54.948760 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2674/5274] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:53 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:55.675222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9297e3b5-5bea-473e-b46b-ce75d4ba3697 req-a3fde7ef-9500-4068-85f4-97fc3d57b38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd9ce50f-6f23-448f-ae78-8ed9778f4509", "tag": "04b88959-165d-4b98-a36a-7e964d709b64"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:58:55.682478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:58:55.700784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9297e3b5-5bea-473e-b46b-ce75d4ba3697 req-a3fde7ef-9500-4068-85f4-97fc3d57b38a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:55.701366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9297e3b5-5bea-473e-b46b-ce75d4ba3697 req-a3fde7ef-9500-4068-85f4-97fc3d57b38a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:55.736911 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9297e3b5-5bea-473e-b46b-ce75d4ba3697 req-a3fde7ef-9500-4068-85f4-97fc3d57b38a service nova] Creating event network-changed:04b88959-165d-4b98-a36a-7e964d709b64 for instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 on n-h2-766726-30 May 19 04:58:55.749024 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9297e3b5-5bea-473e-b46b-ce75d4ba3697 req-a3fde7ef-9500-4068-85f4-97fc3d57b38a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077246 May 19 04:58:55.753516 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2601/5275] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:58:55.958063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03895678-2463-4e0d-8c48-ed757ea45b79 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:55.958842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-03895678-2463-4e0d-8c48-ed757ea45b79 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:55.973195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03895678-2463-4e0d-8c48-ed757ea45b79 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:55.974966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03895678-2463-4e0d-8c48-ed757ea45b79 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:55.979096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03895678-2463-4e0d-8c48-ed757ea45b79 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:55.979953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03895678-2463-4e0d-8c48-ed757ea45b79 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:57.728153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03895678-2463-4e0d-8c48-ed757ea45b79 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:57.738592 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-03895678-2463-4e0d-8c48-ed757ea45b79 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 1.786040 May 19 04:58:57.745832 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2675/5276] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:55 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:58:58.771548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab74ebdf-f273-46a0-a105-e43245482868 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:58:58.774344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ab74ebdf-f273-46a0-a105-e43245482868 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:58:58.791222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab74ebdf-f273-46a0-a105-e43245482868 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:58.795599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab74ebdf-f273-46a0-a105-e43245482868 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:58.796933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab74ebdf-f273-46a0-a105-e43245482868 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:58:58.799977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab74ebdf-f273-46a0-a105-e43245482868 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:58:59.881295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab74ebdf-f273-46a0-a105-e43245482868 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:58:59.890889 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab74ebdf-f273-46a0-a105-e43245482868 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 1.128792 May 19 04:58:59.903919 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2602/5277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:58:58 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:00.910830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0af27fa7-df8d-4cc6-a84b-2b743e76ee81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:00.911444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0af27fa7-df8d-4cc6-a84b-2b743e76ee81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:00.936008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af27fa7-df8d-4cc6-a84b-2b743e76ee81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:00.936737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af27fa7-df8d-4cc6-a84b-2b743e76ee81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:00.938066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af27fa7-df8d-4cc6-a84b-2b743e76ee81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:00.938675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0af27fa7-df8d-4cc6-a84b-2b743e76ee81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:01.374499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0af27fa7-df8d-4cc6-a84b-2b743e76ee81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:01.384552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0af27fa7-df8d-4cc6-a84b-2b743e76ee81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 0.480317 May 19 04:59:01.385361 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2676/5278] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:00 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:02.403067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3dd213de-0d5e-4081-97de-5577ff52dc6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:02.403765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3dd213de-0d5e-4081-97de-5577ff52dc6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:02.422764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dd213de-0d5e-4081-97de-5577ff52dc6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:02.423735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dd213de-0d5e-4081-97de-5577ff52dc6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:02.424852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dd213de-0d5e-4081-97de-5577ff52dc6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:02.425619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dd213de-0d5e-4081-97de-5577ff52dc6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:03.594138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f86e0479-fd5c-418e-8757-bc70292d8ae9 req-f9eb6470-916a-4f33-89f3-e52c231dcb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58ad16d-f383-4e83-9fa9-77275956590c", "name": "network-vif-plugged", "status": "completed", "tag": "7e7974e1-fefd-4636-9522-51a5ac917637"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:03.620733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f86e0479-fd5c-418e-8757-bc70292d8ae9 req-f9eb6470-916a-4f33-89f3-e52c231dcb56 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:03.626007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f86e0479-fd5c-418e-8757-bc70292d8ae9 req-f9eb6470-916a-4f33-89f3-e52c231dcb56 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:03.643441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3dd213de-0d5e-4081-97de-5577ff52dc6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:03.650391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=54 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:59:03.657031 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3dd213de-0d5e-4081-97de-5577ff52dc6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 1.257545 May 19 04:59:03.666090 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f86e0479-fd5c-418e-8757-bc70292d8ae9 req-f9eb6470-916a-4f33-89f3-e52c231dcb56 service nova] Creating event network-vif-plugged:7e7974e1-fefd-4636-9522-51a5ac917637 for instance d58ad16d-f383-4e83-9fa9-77275956590c on n-h1-766726-30 May 19 04:59:03.672178 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2603/5279] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:02 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:03.678928 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f86e0479-fd5c-418e-8757-bc70292d8ae9 req-f9eb6470-916a-4f33-89f3-e52c231dcb56 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095078 May 19 04:59:03.682736 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2677/5280] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:59:04.679977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e098d221-5f8c-429c-957a-4354c424db87 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:04.680600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e098d221-5f8c-429c-957a-4354c424db87 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:04.700325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:59:04.714898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e098d221-5f8c-429c-957a-4354c424db87 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:04.717659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e098d221-5f8c-429c-957a-4354c424db87 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:04.718441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e098d221-5f8c-429c-957a-4354c424db87 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:04.720766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e098d221-5f8c-429c-957a-4354c424db87 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:05.434534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e098d221-5f8c-429c-957a-4354c424db87 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:05.444534 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e098d221-5f8c-429c-957a-4354c424db87 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 0.768412 May 19 04:59:05.459628 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2604/5281] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:04 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:06.476661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fcee718a-52f0-4142-a632-4b3c0688bee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:06.478278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fcee718a-52f0-4142-a632-4b3c0688bee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:06.495618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcee718a-52f0-4142-a632-4b3c0688bee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:06.496080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcee718a-52f0-4142-a632-4b3c0688bee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:06.498130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcee718a-52f0-4142-a632-4b3c0688bee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:06.499747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcee718a-52f0-4142-a632-4b3c0688bee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:06.757867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-99d52ef4-d5d0-4943-8e26-2e3a498186a4 req-ab090cab-d137-4d65-9076-b61365c3803f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9ce50f-6f23-448f-ae78-8ed9778f4509", "name": "network-vif-plugged", "status": "completed", "tag": "04b88959-165d-4b98-a36a-7e964d709b64"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:06.778645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-99d52ef4-d5d0-4943-8e26-2e3a498186a4 req-ab090cab-d137-4d65-9076-b61365c3803f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:06.779091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-99d52ef4-d5d0-4943-8e26-2e3a498186a4 req-ab090cab-d137-4d65-9076-b61365c3803f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:06.821674 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-99d52ef4-d5d0-4943-8e26-2e3a498186a4 req-ab090cab-d137-4d65-9076-b61365c3803f service nova] Creating event network-vif-plugged:04b88959-165d-4b98-a36a-7e964d709b64 for instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 on n-h2-766726-30 May 19 04:59:06.833501 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-99d52ef4-d5d0-4943-8e26-2e3a498186a4 req-ab090cab-d137-4d65-9076-b61365c3803f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074590 May 19 04:59:06.834460 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2605/5282] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 04:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:59:07.245733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fcee718a-52f0-4142-a632-4b3c0688bee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:07.263145 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fcee718a-52f0-4142-a632-4b3c0688bee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 0.785087 May 19 04:59:07.264829 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2678/5283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:06 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:08.290287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75b554ad-c272-415c-b2b8-ccb6b50f7bb6 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:08.292320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-75b554ad-c272-415c-b2b8-ccb6b50f7bb6 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:08.303364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75b554ad-c272-415c-b2b8-ccb6b50f7bb6 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:08.304138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75b554ad-c272-415c-b2b8-ccb6b50f7bb6 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:08.314239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75b554ad-c272-415c-b2b8-ccb6b50f7bb6 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:08.315458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75b554ad-c272-415c-b2b8-ccb6b50f7bb6 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:08.947529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-75b554ad-c272-415c-b2b8-ccb6b50f7bb6 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:08.955406 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-75b554ad-c272-415c-b2b8-ccb6b50f7bb6 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1320 microversion: 2.1 time: 0.674860 May 19 04:59:08.965946 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2606/5284] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:08 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1320 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:09.979327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b4d22ec-7c34-41b2-a5bb-45f712cbc360 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:09.981469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b4d22ec-7c34-41b2-a5bb-45f712cbc360 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:09.999325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:59:10.005607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b4d22ec-7c34-41b2-a5bb-45f712cbc360 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:10.006352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b4d22ec-7c34-41b2-a5bb-45f712cbc360 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:10.009412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b4d22ec-7c34-41b2-a5bb-45f712cbc360 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:10.010737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b4d22ec-7c34-41b2-a5bb-45f712cbc360 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:10.112094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=58 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:59:10.978628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2b4d22ec-7c34-41b2-a5bb-45f712cbc360 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:10.987922 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b4d22ec-7c34-41b2-a5bb-45f712cbc360 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1513 microversion: 2.1 time: 1.017463 May 19 04:59:10.990100 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2679/5285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:09 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1513 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:11.006637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1fdeaacd-2c39-4c1c-8f0d-1c364fa83539 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:11.008160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1fdeaacd-2c39-4c1c-8f0d-1c364fa83539 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:11.029386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fdeaacd-2c39-4c1c-8f0d-1c364fa83539 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:11.029854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fdeaacd-2c39-4c1c-8f0d-1c364fa83539 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:11.031303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fdeaacd-2c39-4c1c-8f0d-1c364fa83539 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:11.031303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fdeaacd-2c39-4c1c-8f0d-1c364fa83539 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:11.076049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-1fdeaacd-2c39-4c1c-8f0d-1c364fa83539 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lazy-loading 'flavor' on Instance uuid bd9ce50f-6f23-448f-ae78-8ed9778f4509 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:59:11.216165 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1fdeaacd-2c39-4c1c-8f0d-1c364fa83539 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509/action" status: 200 len: 32 microversion: 2.1 time: 0.213632 May 19 04:59:11.217205 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2607/5286] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:59:11 2022] POST /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:59:11.226072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d353ed02-91a7-4940-beb1-9ea619d125df tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:11.226720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d353ed02-91a7-4940-beb1-9ea619d125df tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:11.235509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d353ed02-91a7-4940-beb1-9ea619d125df tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:11.235509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d353ed02-91a7-4940-beb1-9ea619d125df tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:11.236280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d353ed02-91a7-4940-beb1-9ea619d125df tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:11.236724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d353ed02-91a7-4940-beb1-9ea619d125df tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:11.793332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d353ed02-91a7-4940-beb1-9ea619d125df tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:11.813324 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d353ed02-91a7-4940-beb1-9ea619d125df tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 0.590912 May 19 04:59:11.813811 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2680/5287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:11 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:12.831316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf7cd5ea-113e-423e-9aee-88e69cf87850 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:12.832032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf7cd5ea-113e-423e-9aee-88e69cf87850 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:12.859084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf7cd5ea-113e-423e-9aee-88e69cf87850 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:12.860366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf7cd5ea-113e-423e-9aee-88e69cf87850 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:12.861366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf7cd5ea-113e-423e-9aee-88e69cf87850 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:12.862092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf7cd5ea-113e-423e-9aee-88e69cf87850 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:14.352973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cf7cd5ea-113e-423e-9aee-88e69cf87850 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:14.365979 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf7cd5ea-113e-423e-9aee-88e69cf87850 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 1.540117 May 19 04:59:14.367909 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2608/5288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:12 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:14.876180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73d45170-fec0-4ec8-9d3d-74e6c154b575 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:14.877276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73d45170-fec0-4ec8-9d3d-74e6c154b575 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:14.888723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d45170-fec0-4ec8-9d3d-74e6c154b575 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:14.897787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d45170-fec0-4ec8-9d3d-74e6c154b575 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:14.899335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d45170-fec0-4ec8-9d3d-74e6c154b575 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:14.899951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d45170-fec0-4ec8-9d3d-74e6c154b575 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:14.967586 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73d45170-fec0-4ec8-9d3d-74e6c154b575 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/ips" status: 200 len: 145 microversion: 2.1 time: 0.095032 May 19 04:59:14.969951 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2681/5289] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 19 04:59:14 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/ips => generated 145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:59:15.383912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f539a1f6-d638-42e5-8914-ac14163e5655 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:15.384550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f539a1f6-d638-42e5-8914-ac14163e5655 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:15.401025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f539a1f6-d638-42e5-8914-ac14163e5655 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:15.401511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f539a1f6-d638-42e5-8914-ac14163e5655 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:15.402318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f539a1f6-d638-42e5-8914-ac14163e5655 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:15.402882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f539a1f6-d638-42e5-8914-ac14163e5655 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:15.884474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f539a1f6-d638-42e5-8914-ac14163e5655 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:15.907204 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f539a1f6-d638-42e5-8914-ac14163e5655 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 0.513531 May 19 04:59:15.907879 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2609/5290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:15 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:16.924508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b94cd609-a6e2-459e-958a-3a450f38ebac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:16.925954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b94cd609-a6e2-459e-958a-3a450f38ebac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:16.942192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b94cd609-a6e2-459e-958a-3a450f38ebac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:16.943041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b94cd609-a6e2-459e-958a-3a450f38ebac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:16.944079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b94cd609-a6e2-459e-958a-3a450f38ebac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:16.944798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b94cd609-a6e2-459e-958a-3a450f38ebac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:17.634282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b94cd609-a6e2-459e-958a-3a450f38ebac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:17.647946 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b94cd609-a6e2-459e-958a-3a450f38ebac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 0.727986 May 19 04:59:17.652828 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2682/5291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:16 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:18.669447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-775a979f-d88f-49bb-8a0b-fa2d09b94d3d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:18.670245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-775a979f-d88f-49bb-8a0b-fa2d09b94d3d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:18.687618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-775a979f-d88f-49bb-8a0b-fa2d09b94d3d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:18.688187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-775a979f-d88f-49bb-8a0b-fa2d09b94d3d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:18.689109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-775a979f-d88f-49bb-8a0b-fa2d09b94d3d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:18.689683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-775a979f-d88f-49bb-8a0b-fa2d09b94d3d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:19.967237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-775a979f-d88f-49bb-8a0b-fa2d09b94d3d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:19.975997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-775a979f-d88f-49bb-8a0b-fa2d09b94d3d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 1.310437 May 19 04:59:19.985957 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2610/5292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:18 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:20.576934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9125fd8b-94b5-49d2-89a4-cb74c7a6bd34 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ef5f6a1-9a78-41b1-b31b-a9cf14a9c9e4"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:20.578612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9125fd8b-94b5-49d2-89a4-cb74c7a6bd34 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:20.598695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9125fd8b-94b5-49d2-89a4-cb74c7a6bd34 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:20.599157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9125fd8b-94b5-49d2-89a4-cb74c7a6bd34 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:20.599956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9125fd8b-94b5-49d2-89a4-cb74c7a6bd34 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:20.600404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9125fd8b-94b5-49d2-89a4-cb74c7a6bd34 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:21.003946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-575d6dd1-287c-483b-bdbd-d6405f53f886 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:21.004645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-575d6dd1-287c-483b-bdbd-d6405f53f886 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:21.034314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-575d6dd1-287c-483b-bdbd-d6405f53f886 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:21.034892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-575d6dd1-287c-483b-bdbd-d6405f53f886 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:21.035742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-575d6dd1-287c-483b-bdbd-d6405f53f886 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:21.036345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-575d6dd1-287c-483b-bdbd-d6405f53f886 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:21.327092 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9125fd8b-94b5-49d2-89a4-cb74c7a6bd34 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753067 May 19 04:59:21.333584 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2683/5293] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:59:20 2022] POST /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 04:59:22.288281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-575d6dd1-287c-483b-bdbd-d6405f53f886 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:22.296441 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-575d6dd1-287c-483b-bdbd-d6405f53f886 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 1.296865 May 19 04:59:22.302576 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2611/5294] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:20 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:23.313842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ecc8f93d-0e92-4df9-968c-4708f06d8047 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:23.315176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ecc8f93d-0e92-4df9-968c-4708f06d8047 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:23.338527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecc8f93d-0e92-4df9-968c-4708f06d8047 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:23.343552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecc8f93d-0e92-4df9-968c-4708f06d8047 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:23.344612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecc8f93d-0e92-4df9-968c-4708f06d8047 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:23.345009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ecc8f93d-0e92-4df9-968c-4708f06d8047 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:25.992825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ecc8f93d-0e92-4df9-968c-4708f06d8047 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:26.021099 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ecc8f93d-0e92-4df9-968c-4708f06d8047 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 2.709264 May 19 04:59:26.023556 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2684/5295] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:23 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:27.042251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-98450326-a9df-4caf-91b7-57ab69bd12f2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:27.047862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-98450326-a9df-4caf-91b7-57ab69bd12f2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:27.087319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98450326-a9df-4caf-91b7-57ab69bd12f2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:27.088470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98450326-a9df-4caf-91b7-57ab69bd12f2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:27.089560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98450326-a9df-4caf-91b7-57ab69bd12f2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:27.090258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98450326-a9df-4caf-91b7-57ab69bd12f2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:27.587627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-98450326-a9df-4caf-91b7-57ab69bd12f2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:27.599642 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-98450326-a9df-4caf-91b7-57ab69bd12f2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 0.563055 May 19 04:59:27.607571 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2612/5296] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:27 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:28.621998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96a6f68f-fb8b-4d18-ab5f-4cd769e2b086 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:28.623304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96a6f68f-fb8b-4d18-ab5f-4cd769e2b086 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:28.638888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96a6f68f-fb8b-4d18-ab5f-4cd769e2b086 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:28.639353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96a6f68f-fb8b-4d18-ab5f-4cd769e2b086 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:28.643059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96a6f68f-fb8b-4d18-ab5f-4cd769e2b086 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:28.643563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96a6f68f-fb8b-4d18-ab5f-4cd769e2b086 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:29.137749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-96a6f68f-fb8b-4d18-ab5f-4cd769e2b086 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:29.151489 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96a6f68f-fb8b-4d18-ab5f-4cd769e2b086 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 0.529798 May 19 04:59:29.153160 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2685/5297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:28 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:30.172012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c649a1d2-23be-42f5-b1db-bb4403c09f9a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:30.172647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c649a1d2-23be-42f5-b1db-bb4403c09f9a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:30.197813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c649a1d2-23be-42f5-b1db-bb4403c09f9a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:30.198306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c649a1d2-23be-42f5-b1db-bb4403c09f9a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:30.199133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c649a1d2-23be-42f5-b1db-bb4403c09f9a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:30.199570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c649a1d2-23be-42f5-b1db-bb4403c09f9a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:31.309500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c649a1d2-23be-42f5-b1db-bb4403c09f9a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:31.337700 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c649a1d2-23be-42f5-b1db-bb4403c09f9a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 1.164119 May 19 04:59:31.346509 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2613/5298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:30 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:32.364659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e62eac6-c4fe-45cc-963e-1e4aec867f36 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:32.365650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4e62eac6-c4fe-45cc-963e-1e4aec867f36 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:32.379761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e62eac6-c4fe-45cc-963e-1e4aec867f36 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:32.382814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e62eac6-c4fe-45cc-963e-1e4aec867f36 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:32.384853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e62eac6-c4fe-45cc-963e-1e4aec867f36 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:32.385565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e62eac6-c4fe-45cc-963e-1e4aec867f36 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:33.291117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4e62eac6-c4fe-45cc-963e-1e4aec867f36 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:33.304609 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4e62eac6-c4fe-45cc-963e-1e4aec867f36 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1519 microversion: 2.1 time: 0.943407 May 19 04:59:33.305243 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2686/5299] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:32 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1519 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:34.322076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1250ed16-bfcb-42ea-91e7-b72efd021b65 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:34.324025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1250ed16-bfcb-42ea-91e7-b72efd021b65 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:34.339427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1250ed16-bfcb-42ea-91e7-b72efd021b65 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:34.341914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1250ed16-bfcb-42ea-91e7-b72efd021b65 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:34.348455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1250ed16-bfcb-42ea-91e7-b72efd021b65 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:34.349220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1250ed16-bfcb-42ea-91e7-b72efd021b65 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:34.752050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1250ed16-bfcb-42ea-91e7-b72efd021b65 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:34.760143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:59:34.766354 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1250ed16-bfcb-42ea-91e7-b72efd021b65 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1499 microversion: 2.1 time: 0.448973 May 19 04:59:34.772998 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2614/5300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:34 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1499 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:34.790964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-518a0aee-15e9-4bf4-aed0-f33f98432352 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:34.792281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-518a0aee-15e9-4bf4-aed0-f33f98432352 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:34.813410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-518a0aee-15e9-4bf4-aed0-f33f98432352 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:34.813410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-518a0aee-15e9-4bf4-aed0-f33f98432352 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:34.824017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-518a0aee-15e9-4bf4-aed0-f33f98432352 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:34.825759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-518a0aee-15e9-4bf4-aed0-f33f98432352 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:35.139997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-518a0aee-15e9-4bf4-aed0-f33f98432352 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:35.152920 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-518a0aee-15e9-4bf4-aed0-f33f98432352 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1516 microversion: 2.1 time: 0.367561 May 19 04:59:35.161247 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2687/5301] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:34 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1516 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:35.176081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1c4a06d-0c2e-43aa-b7eb-d0a6c382dc4c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:35.177679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e1c4a06d-0c2e-43aa-b7eb-d0a6c382dc4c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: f80212d3-2900-44ec-b88d-3f322cac3b65] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:35.189580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=22 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:59:35.191006 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-e1c4a06d-0c2e-43aa-b7eb-d0a6c382dc4c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] HTTP exception thrown: Instance f80212d3-2900-44ec-b88d-3f322cac3b65 could not be found. May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1c4a06d-0c2e-43aa-b7eb-d0a6c382dc4c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Request method failure captured: May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/f80212d3-2900-44ec-b88d-3f322cac3b65/action HTTP/1.1 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 14 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc552hVIo4gddG1TsyjmdiR4FI-JaQWAI2htXnFCrEGDKOYsH4E1XezkrXoYbLKVx2oQ0SvwM5ir8T3Pst5EgfSG9x1mXTMB6grf-HgGlu6N1XdfyruY3CowYDE4FL4j4mU5LfyG9tECTRcDp-giFDz68AbxVhmT6rWj0Yst-Jw0c2o May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerRescueNegativeTestJSON-560727433 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 0e75fb6c77b44c22b95693d01448e3d2 May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: {"rescue": {}} May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance f80212d3-2900-44ec-b88d-3f322cac3b65 could not be found. May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'f80212d3-2900-44ec-b88d-3f322cac3b65', 'body': {'rescue': {}}} May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f80212d3-2900-44ec-b88d-3f322cac3b65 could not be found. May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f80212d3-2900-44ec-b88d-3f322cac3b65 could not be found. May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:35.200602 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:59:35.207011 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:59:35.207011 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:59:35.207011 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:59:35.207011 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:59:35.207011 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f80212d3-2900-44ec-b88d-3f322cac3b65 could not be found. May 19 04:59:35.207011 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:35.207011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1c4a06d-0c2e-43aa-b7eb-d0a6c382dc4c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Returning 404 to user: Instance f80212d3-2900-44ec-b88d-3f322cac3b65 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:59:35.207011 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e1c4a06d-0c2e-43aa-b7eb-d0a6c382dc4c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/f80212d3-2900-44ec-b88d-3f322cac3b65/action" status: 404 len: 111 microversion: 2.1 time: 0.034746 May 19 04:59:35.207011 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2615/5302] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:59:35 2022] POST /compute/v2.1/servers/f80212d3-2900-44ec-b88d-3f322cac3b65/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 04:59:35.216687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-83f50600-4df9-40f5-ac45-fecb2de22c32 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:35.217399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-83f50600-4df9-40f5-ac45-fecb2de22c32 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:35.227107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83f50600-4df9-40f5-ac45-fecb2de22c32 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:35.231345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83f50600-4df9-40f5-ac45-fecb2de22c32 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:35.235282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83f50600-4df9-40f5-ac45-fecb2de22c32 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:35.235901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83f50600-4df9-40f5-ac45-fecb2de22c32 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:35.415532 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-83f50600-4df9-40f5-ac45-fecb2de22c32 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action" status: 202 len: 0 microversion: 2.1 time: 0.203007 May 19 04:59:35.416779 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2688/5303] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:59:35 2022] POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:59:35.433334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c7251fb-c754-4827-8798-7565a01f8cb7 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:35.435654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c7251fb-c754-4827-8798-7565a01f8cb7 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:35.458047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c7251fb-c754-4827-8798-7565a01f8cb7 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:35.459379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c7251fb-c754-4827-8798-7565a01f8cb7 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:35.465361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c7251fb-c754-4827-8798-7565a01f8cb7 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:35.466305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c7251fb-c754-4827-8798-7565a01f8cb7 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:35.894760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c7251fb-c754-4827-8798-7565a01f8cb7 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:35.907416 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c7251fb-c754-4827-8798-7565a01f8cb7 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1521 microversion: 2.1 time: 0.486555 May 19 04:59:35.909193 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2616/5304] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:35 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:36.927223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c35ed4a1-fa8a-41ca-a33c-5d31545af19c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:36.927933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c35ed4a1-fa8a-41ca-a33c-5d31545af19c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:36.942426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c35ed4a1-fa8a-41ca-a33c-5d31545af19c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:36.943171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c35ed4a1-fa8a-41ca-a33c-5d31545af19c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:36.947690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c35ed4a1-fa8a-41ca-a33c-5d31545af19c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:36.948834 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c35ed4a1-fa8a-41ca-a33c-5d31545af19c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:37.630636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c35ed4a1-fa8a-41ca-a33c-5d31545af19c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:37.639900 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c35ed4a1-fa8a-41ca-a33c-5d31545af19c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1501 microversion: 2.1 time: 0.716477 May 19 04:59:37.640500 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2689/5305] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:36 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1501 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:37.657003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:37.660849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:37.675480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:37.678827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:37.681981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:37.686862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:37.734113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lazy-loading 'flavor' on Instance uuid d58ad16d-f383-4e83-9fa9-77275956590c {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:59:37.755528 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] HTTP exception thrown: Cannot 'rescue' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state paused May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Request method failure captured: May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action HTTP/1.1 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 14 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc552hVIo4gddG1TsyjmdiR4FI-JaQWAI2htXnFCrEGDKOYsH4E1XezkrXoYbLKVx2oQ0SvwM5ir8T3Pst5EgfSG9x1mXTMB6grf-HgGlu6N1XdfyruY3CowYDE4FL4j4mU5LfyG9tECTRcDp-giFDz68AbxVhmT6rWj0Yst-Jw0c2o May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerRescueNegativeTestJSON-560727433 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 0e75fb6c77b44c22b95693d01448e3d2 May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: {"rescue": {}} May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: exception: Cannot 'rescue' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state paused May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'd58ad16d-f383-4e83-9fa9-77275956590c', 'body': {'rescue': {}}} May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d58ad16d-f383-4e83-9fa9-77275956590c in vm_state paused. Cannot rescue while the instance is in this state. May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state paused May 19 04:59:37.757374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state paused May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Returning 409 to user: Cannot 'rescue' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state paused {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f8d79e53-c98d-4592-9240-412d541b0b2a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action" status: 409 len: 144 microversion: 2.1 time: 0.106448 May 19 04:59:37.763547 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2617/5306] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:59:37 2022] POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action => generated 144 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:59:37.769011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-58a9f999-79e2-48e3-8718-778c17561b1f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:37.769587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-58a9f999-79e2-48e3-8718-778c17561b1f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:37.776428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58a9f999-79e2-48e3-8718-778c17561b1f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:37.777229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58a9f999-79e2-48e3-8718-778c17561b1f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:37.778594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58a9f999-79e2-48e3-8718-778c17561b1f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:37.779208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58a9f999-79e2-48e3-8718-778c17561b1f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:37.887260 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-58a9f999-79e2-48e3-8718-778c17561b1f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action" status: 202 len: 0 microversion: 2.1 time: 0.122817 May 19 04:59:37.890493 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2690/5307] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:59:37 2022] POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:59:37.902284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c815fc17-9ec7-4eb6-aaa4-11d3dd572cc1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:37.903081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c815fc17-9ec7-4eb6-aaa4-11d3dd572cc1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:37.912731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c815fc17-9ec7-4eb6-aaa4-11d3dd572cc1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:37.925555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c815fc17-9ec7-4eb6-aaa4-11d3dd572cc1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:37.926409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c815fc17-9ec7-4eb6-aaa4-11d3dd572cc1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:37.926963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c815fc17-9ec7-4eb6-aaa4-11d3dd572cc1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:38.457297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c815fc17-9ec7-4eb6-aaa4-11d3dd572cc1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:38.470760 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c815fc17-9ec7-4eb6-aaa4-11d3dd572cc1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1508 microversion: 2.1 time: 0.573766 May 19 04:59:38.475497 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2618/5308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:37 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1508 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 04:59:39.501189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3692cc4-d4e8-4a50-ae16-967f7a9828a1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:39.503114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e3692cc4-d4e8-4a50-ae16-967f7a9828a1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:39.520050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3692cc4-d4e8-4a50-ae16-967f7a9828a1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:39.526004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3692cc4-d4e8-4a50-ae16-967f7a9828a1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:39.527156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3692cc4-d4e8-4a50-ae16-967f7a9828a1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:39.527800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3692cc4-d4e8-4a50-ae16-967f7a9828a1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:39.979199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3692cc4-d4e8-4a50-ae16-967f7a9828a1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:39.987831 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e3692cc4-d4e8-4a50-ae16-967f7a9828a1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1516 microversion: 2.1 time: 0.499168 May 19 04:59:40.004544 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2691/5309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:39 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1516 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:43.604997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35daf1be-858e-45d7-aaf5-e2440e2a320c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:43.606461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-35daf1be-858e-45d7-aaf5-e2440e2a320c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:43.621262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35daf1be-858e-45d7-aaf5-e2440e2a320c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:43.623915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35daf1be-858e-45d7-aaf5-e2440e2a320c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:43.624943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35daf1be-858e-45d7-aaf5-e2440e2a320c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:43.626680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35daf1be-858e-45d7-aaf5-e2440e2a320c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:43.655389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-35daf1be-858e-45d7-aaf5-e2440e2a320c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lazy-loading 'flavor' on Instance uuid d58ad16d-f383-4e83-9fa9-77275956590c {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 04:59:43.788734 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-35daf1be-858e-45d7-aaf5-e2440e2a320c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action" status: 200 len: 32 microversion: 2.1 time: 0.189402 May 19 04:59:43.790092 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2619/5310] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:59:43 2022] POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 04:59:43.811174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-50ec5f65-4d96-45e1-81c6-fc8ba3f83f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:43.813016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-50ec5f65-4d96-45e1-81c6-fc8ba3f83f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:43.852743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=26 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:59:43.862853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50ec5f65-4d96-45e1-81c6-fc8ba3f83f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:43.867184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50ec5f65-4d96-45e1-81c6-fc8ba3f83f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:43.871757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50ec5f65-4d96-45e1-81c6-fc8ba3f83f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:43.876569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50ec5f65-4d96-45e1-81c6-fc8ba3f83f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:43.966428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 04:59:44.943616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-50ec5f65-4d96-45e1-81c6-fc8ba3f83f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:44.961236 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-50ec5f65-4d96-45e1-81c6-fc8ba3f83f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 1.161577 May 19 04:59:44.964218 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2692/5311] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:43 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:45.984210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dbad0eb0-e5bd-4e02-aa1d-a5db4e7f0724 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:45.985123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dbad0eb0-e5bd-4e02-aa1d-a5db4e7f0724 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:45.999164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbad0eb0-e5bd-4e02-aa1d-a5db4e7f0724 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:45.999852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbad0eb0-e5bd-4e02-aa1d-a5db4e7f0724 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:46.006088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbad0eb0-e5bd-4e02-aa1d-a5db4e7f0724 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:46.006862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbad0eb0-e5bd-4e02-aa1d-a5db4e7f0724 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:46.603856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dbad0eb0-e5bd-4e02-aa1d-a5db4e7f0724 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:46.617639 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dbad0eb0-e5bd-4e02-aa1d-a5db4e7f0724 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.638247 May 19 04:59:46.619710 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2620/5312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:45 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:47.637002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3779544-a481-4c4b-ab75-4192c6f9c532 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:47.640060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e3779544-a481-4c4b-ab75-4192c6f9c532 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:47.658202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3779544-a481-4c4b-ab75-4192c6f9c532 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:47.662143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3779544-a481-4c4b-ab75-4192c6f9c532 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:47.666331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3779544-a481-4c4b-ab75-4192c6f9c532 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:47.670741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3779544-a481-4c4b-ab75-4192c6f9c532 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:48.417591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3779544-a481-4c4b-ab75-4192c6f9c532 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:48.431122 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e3779544-a481-4c4b-ab75-4192c6f9c532 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.799117 May 19 04:59:48.445236 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2693/5313] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:47 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:49.460744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2e965b6a-df20-46b0-9b8a-6f771102815c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:49.461492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2e965b6a-df20-46b0-9b8a-6f771102815c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:49.473735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e965b6a-df20-46b0-9b8a-6f771102815c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:49.474167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e965b6a-df20-46b0-9b8a-6f771102815c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:49.479269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e965b6a-df20-46b0-9b8a-6f771102815c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:49.479733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e965b6a-df20-46b0-9b8a-6f771102815c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:49.767991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2e965b6a-df20-46b0-9b8a-6f771102815c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:49.791924 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2e965b6a-df20-46b0-9b8a-6f771102815c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.334391 May 19 04:59:49.798667 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2621/5314] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:49 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:50.809945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d257c15a-04df-4d02-90ad-e456401f3d9b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:50.812490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d257c15a-04df-4d02-90ad-e456401f3d9b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:50.829389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d257c15a-04df-4d02-90ad-e456401f3d9b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:50.830228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d257c15a-04df-4d02-90ad-e456401f3d9b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:50.831308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d257c15a-04df-4d02-90ad-e456401f3d9b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:50.832854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d257c15a-04df-4d02-90ad-e456401f3d9b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:51.383522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d257c15a-04df-4d02-90ad-e456401f3d9b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:51.411194 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d257c15a-04df-4d02-90ad-e456401f3d9b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.603020 May 19 04:59:51.425365 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2694/5315] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:50 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:52.431658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7061e614-f758-4c2d-9043-501870655c4f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:52.432272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7061e614-f758-4c2d-9043-501870655c4f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:52.445662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7061e614-f758-4c2d-9043-501870655c4f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:52.447901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7061e614-f758-4c2d-9043-501870655c4f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:52.448734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7061e614-f758-4c2d-9043-501870655c4f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:52.449213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7061e614-f758-4c2d-9043-501870655c4f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:52.780771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7061e614-f758-4c2d-9043-501870655c4f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:52.799056 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7061e614-f758-4c2d-9043-501870655c4f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.371578 May 19 04:59:52.800717 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2622/5316] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:52 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:53.823952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6966a019-56c6-456c-86ed-0613e167d75a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:53.831430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6966a019-56c6-456c-86ed-0613e167d75a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:53.859924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6966a019-56c6-456c-86ed-0613e167d75a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:53.869934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6966a019-56c6-456c-86ed-0613e167d75a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:53.871237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6966a019-56c6-456c-86ed-0613e167d75a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:53.872521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6966a019-56c6-456c-86ed-0613e167d75a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:54.204624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6966a019-56c6-456c-86ed-0613e167d75a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:54.230415 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6966a019-56c6-456c-86ed-0613e167d75a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.409823 May 19 04:59:54.233031 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2695/5317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:53 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:55.251505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-032ae4a8-200b-425a-ad99-c6ce743afbe3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:55.253065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-032ae4a8-200b-425a-ad99-c6ce743afbe3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:55.274670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-032ae4a8-200b-425a-ad99-c6ce743afbe3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:55.275952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-032ae4a8-200b-425a-ad99-c6ce743afbe3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:55.281683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-032ae4a8-200b-425a-ad99-c6ce743afbe3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:55.282500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-032ae4a8-200b-425a-ad99-c6ce743afbe3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:55.608674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-032ae4a8-200b-425a-ad99-c6ce743afbe3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:55.632315 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-032ae4a8-200b-425a-ad99-c6ce743afbe3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.388484 May 19 04:59:55.635639 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2623/5318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:55 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:56.654707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09bb6279-02e5-4708-9a70-8078ec1e6bba tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:56.656152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-09bb6279-02e5-4708-9a70-8078ec1e6bba tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:56.684194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09bb6279-02e5-4708-9a70-8078ec1e6bba tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:56.684832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09bb6279-02e5-4708-9a70-8078ec1e6bba tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:56.688032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09bb6279-02e5-4708-9a70-8078ec1e6bba tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:56.693976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09bb6279-02e5-4708-9a70-8078ec1e6bba tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:57.818593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-09bb6279-02e5-4708-9a70-8078ec1e6bba tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:57.827412 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-09bb6279-02e5-4708-9a70-8078ec1e6bba tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 1.178223 May 19 04:59:57.837042 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2696/5319] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:56 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:58.845696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90074046-47a2-4a7e-8dab-eed2e4d2f46b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:58.846329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-90074046-47a2-4a7e-8dab-eed2e4d2f46b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:58.867824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90074046-47a2-4a7e-8dab-eed2e4d2f46b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:58.868307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90074046-47a2-4a7e-8dab-eed2e4d2f46b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:58.871452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90074046-47a2-4a7e-8dab-eed2e4d2f46b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:58.871822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90074046-47a2-4a7e-8dab-eed2e4d2f46b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:59.231584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-90074046-47a2-4a7e-8dab-eed2e4d2f46b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 04:59:59.242916 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-90074046-47a2-4a7e-8dab-eed2e4d2f46b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1502 microversion: 2.1 time: 0.399884 May 19 04:59:59.244275 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2624/5320] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:58 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1502 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 04:59:59.267567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e4b57de-b69f-495c-9b07-ba0c311974d7"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:59.269560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:59.294625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:59.295087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:59.295932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:59.305646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:59.380271 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] HTTP exception thrown: Cannot 'attach_volume' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state rescued May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Request method failure captured: May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/os-volume_attachments HTTP/1.1 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 74 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc552hVIo4gddG1TsyjmdiR4FI-JaQWAI2htXnFCrEGDKOYsH4E1XezkrXoYbLKVx2oQ0SvwM5ir8T3Pst5EgfSG9x1mXTMB6grf-HgGlu6N1XdfyruY3CowYDE4FL4j4mU5LfyG9tECTRcDp-giFDz68AbxVhmT6rWj0Yst-Jw0c2o May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-560727433 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 0e75fb6c77b44c22b95693d01448e3d2 May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: {"volumeAttachment": {"volumeId": "1e4b57de-b69f-495c-9b07-ba0c311974d7"}} May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'attach_volume' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state rescued May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'server_id': 'd58ad16d-f383-4e83-9fa9-77275956590c', 'body': {'volumeAttachment': {'volumeId': '1e4b57de-b69f-495c-9b07-ba0c311974d7'}}} May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d58ad16d-f383-4e83-9fa9-77275956590c in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 04:59:59.382545 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state rescued May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state rescued May 19 04:59:59.387199 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 04:59:59.393279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Returning 409 to user: Cannot 'attach_volume' instance d58ad16d-f383-4e83-9fa9-77275956590c while it is in vm_state rescued {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 04:59:59.394856 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9971cc73-3b5b-43e6-92d4-caabf0b8c93b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.132331 May 19 04:59:59.407514 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2697/5321] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 04:59:59 2022] POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/os-volume_attachments => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 04:59:59.416992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eadf9c29-f37d-4126-a209-64d74711dac3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 04:59:59.428516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eadf9c29-f37d-4126-a209-64d74711dac3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:59.443067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eadf9c29-f37d-4126-a209-64d74711dac3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:59.444949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eadf9c29-f37d-4126-a209-64d74711dac3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:59.446467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eadf9c29-f37d-4126-a209-64d74711dac3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:59.448045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eadf9c29-f37d-4126-a209-64d74711dac3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:59.785474 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eadf9c29-f37d-4126-a209-64d74711dac3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action" status: 202 len: 0 microversion: 2.1 time: 0.373090 May 19 04:59:59.786520 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2625/5322] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 04:59:59 2022] POST /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 04:59:59.800477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7cd4853f-8024-4ffc-8ada-e18e85763687 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 04:59:59.801723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7cd4853f-8024-4ffc-8ada-e18e85763687 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 04:59:59.830692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cd4853f-8024-4ffc-8ada-e18e85763687 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:59.832121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cd4853f-8024-4ffc-8ada-e18e85763687 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 04:59:59.833437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cd4853f-8024-4ffc-8ada-e18e85763687 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 04:59:59.839514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7cd4853f-8024-4ffc-8ada-e18e85763687 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:00.504071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7cd4853f-8024-4ffc-8ada-e18e85763687 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:00.527022 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7cd4853f-8024-4ffc-8ada-e18e85763687 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1510 microversion: 2.1 time: 0.726522 May 19 05:00:00.536674 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2698/5323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 04:59:59 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1510 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:00.626661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bcf60065-30e8-42a4-9693-49b1fb830603 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:00.627875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bcf60065-30e8-42a4-9693-49b1fb830603 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:00.655604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bcf60065-30e8-42a4-9693-49b1fb830603 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:00.656065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bcf60065-30e8-42a4-9693-49b1fb830603 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:00.656854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bcf60065-30e8-42a4-9693-49b1fb830603 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:00.657317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bcf60065-30e8-42a4-9693-49b1fb830603 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:00.713566 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bcf60065-30e8-42a4-9693-49b1fb830603 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123083 May 19 05:00:00.720380 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2626/5324] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:00:00 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:00:00.726176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f524ab2f-12f9-424c-adf4-16e61748a2ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:00.727177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f524ab2f-12f9-424c-adf4-16e61748a2ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:00.735072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f524ab2f-12f9-424c-adf4-16e61748a2ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:00.737899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f524ab2f-12f9-424c-adf4-16e61748a2ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:00.740407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f524ab2f-12f9-424c-adf4-16e61748a2ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:00.741629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f524ab2f-12f9-424c-adf4-16e61748a2ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:00.826912 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f524ab2f-12f9-424c-adf4-16e61748a2ad tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/4ef5f6a1-9a78-41b1-b31b-a9cf14a9c9e4" status: 200 len: 194 microversion: 2.1 time: 0.104855 May 19 05:00:00.827926 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2699/5325] 10.222.0.58 () {58 vars in 1412 bytes} [Thu May 19 05:00:00 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/4ef5f6a1-9a78-41b1-b31b-a9cf14a9c9e4 => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:00:01.548227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-530b2add-e1c8-4e87-b90f-6e6571637049 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:01.552703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-530b2add-e1c8-4e87-b90f-6e6571637049 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:01.594377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-530b2add-e1c8-4e87-b90f-6e6571637049 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:01.594844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-530b2add-e1c8-4e87-b90f-6e6571637049 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:01.595720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-530b2add-e1c8-4e87-b90f-6e6571637049 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:01.596089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-530b2add-e1c8-4e87-b90f-6e6571637049 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:02.468464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-530b2add-e1c8-4e87-b90f-6e6571637049 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:02.490825 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-530b2add-e1c8-4e87-b90f-6e6571637049 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1510 microversion: 2.1 time: 0.949809 May 19 05:00:02.492748 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2627/5326] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:01 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1510 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:03.509708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6afd7eaa-de1f-42ce-9a0c-49c4a3809d8f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:03.511051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6afd7eaa-de1f-42ce-9a0c-49c4a3809d8f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:03.540454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6afd7eaa-de1f-42ce-9a0c-49c4a3809d8f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:03.548318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6afd7eaa-de1f-42ce-9a0c-49c4a3809d8f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:03.549648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6afd7eaa-de1f-42ce-9a0c-49c4a3809d8f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:03.552741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6afd7eaa-de1f-42ce-9a0c-49c4a3809d8f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:04.057291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6afd7eaa-de1f-42ce-9a0c-49c4a3809d8f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:04.066993 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6afd7eaa-de1f-42ce-9a0c-49c4a3809d8f tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1516 microversion: 2.1 time: 0.561460 May 19 05:00:04.070728 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2700/5327] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:03 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1516 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:06.320564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ddd3a52-cf50-4ae7-8f94-f074b5c52832 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1093321c-d1c1-4fc5-a247-92a82b14cadb"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:00:06.350745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2ddd3a52-cf50-4ae7-8f94-f074b5c52832 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:06.370643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=26 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:00:06.379350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ddd3a52-cf50-4ae7-8f94-f074b5c52832 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:06.380470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ddd3a52-cf50-4ae7-8f94-f074b5c52832 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:06.392288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ddd3a52-cf50-4ae7-8f94-f074b5c52832 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:06.394290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ddd3a52-cf50-4ae7-8f94-f074b5c52832 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:06.482374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:00:07.162255 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ddd3a52-cf50-4ae7-8f94-f074b5c52832 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "POST /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847567 May 19 05:00:07.163370 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2628/5328] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 05:00:06 2022] POST /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:00:09.853250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3592331d-5159-46b1-803d-755221d42ee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'create', calling method: .version_select at 0x7fd314deb550>, body: {"keypair": {"name": "tempest-keypair-1522962942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsUmCeu5eV1CIxD4BM8a6eFHN7T25nqmxIkFPXKoGDn5vbEwQd5swMVpXfyC+eyjsDwTpVC3RAGUtvqR1A0CZqYN68wJlhQiVsmDCdlH4RHswGLzv81ubkj30Z770w+Bw=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:00:09.899829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-3592331d-5159-46b1-803d-755221d42ee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Getting quotas for project 92d413674d7946c4a845a0ab2c2cec20. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:00:09.912957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-3592331d-5159-46b1-803d-755221d42ee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Getting quotas for user 0e75fb6c77b44c22b95693d01448e3d2 and project 92d413674d7946c4a845a0ab2c2cec20. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:00:10.004527 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3592331d-5159-46b1-803d-755221d42ee1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160256 May 19 05:00:10.013160 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2701/5329] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:00:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:00:17.164051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:00:17.164821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:00:17.170970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-188615864", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1db4a5ca-bf36-40c5-88df-09d75f43d7e7"}], "security_groups": [{"name": "tempest-securitygroup--1958348006"}], "key_name": "tempest-keypair-1522962942", "user_data": "}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:00:17.471943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] validate_networks() for [('1db4a5ca-bf36-40c5-88df-09d75f43d7e7', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:00:19.005640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:00:19.007035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:00:19.007303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:00:19.007798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:00:19.009105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:00:19.030908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:19.031698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:19.035645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:19.037560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:19.106566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Getting quotas for project 92d413674d7946c4a845a0ab2c2cec20. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:00:19.163372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Getting quotas for user 0e75fb6c77b44c22b95693d01448e3d2 and project 92d413674d7946c4a845a0ab2c2cec20. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:00:19.202184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:00:19.204588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:00:19.310788 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-935ca713-16d4-422f-8d4b-5ed16bcfde10 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.148527 May 19 05:00:19.311620 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2629/5330] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:00:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 05:00:19.319310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=51 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:00:19.332033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ebaaa60f-db2c-4e3d-8ea4-a984467e0c86 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:19.332241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ebaaa60f-db2c-4e3d-8ea4-a984467e0c86 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:19.337805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:00:19.846189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ebaaa60f-db2c-4e3d-8ea4-a984467e0c86 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:19.857021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ebaaa60f-db2c-4e3d-8ea4-a984467e0c86 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1245 microversion: 2.1 time: 0.537597 May 19 05:00:19.860185 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2702/5331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:19 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1245 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:20.887049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-717e3548-5b97-4699-80d4-fe268a1ff418 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:20.889714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-717e3548-5b97-4699-80d4-fe268a1ff418 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:20.926120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-717e3548-5b97-4699-80d4-fe268a1ff418 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:20.930484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-717e3548-5b97-4699-80d4-fe268a1ff418 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:20.931778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-717e3548-5b97-4699-80d4-fe268a1ff418 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:20.933875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-717e3548-5b97-4699-80d4-fe268a1ff418 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:21.171616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-717e3548-5b97-4699-80d4-fe268a1ff418 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:21.209989 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-717e3548-5b97-4699-80d4-fe268a1ff418 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1297 microversion: 2.1 time: 0.336352 May 19 05:00:21.214994 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2630/5332] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:20 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1297 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:22.232411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03be90a6-3be0-43f1-9713-f70d901ea84d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:22.233037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-03be90a6-3be0-43f1-9713-f70d901ea84d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:22.263645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03be90a6-3be0-43f1-9713-f70d901ea84d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:22.271166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03be90a6-3be0-43f1-9713-f70d901ea84d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:22.276451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03be90a6-3be0-43f1-9713-f70d901ea84d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:22.277061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03be90a6-3be0-43f1-9713-f70d901ea84d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:22.579699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03be90a6-3be0-43f1-9713-f70d901ea84d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:22.591291 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-03be90a6-3be0-43f1-9713-f70d901ea84d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1303 microversion: 2.1 time: 0.361897 May 19 05:00:22.595799 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2703/5333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:22 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1303 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:23.609223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac7f5133-a27d-4a1c-9cd4-de82dca1a195 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:23.609856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ac7f5133-a27d-4a1c-9cd4-de82dca1a195 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:23.621868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac7f5133-a27d-4a1c-9cd4-de82dca1a195 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:23.626108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac7f5133-a27d-4a1c-9cd4-de82dca1a195 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:23.629479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac7f5133-a27d-4a1c-9cd4-de82dca1a195 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:23.629992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac7f5133-a27d-4a1c-9cd4-de82dca1a195 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:23.946118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ac7f5133-a27d-4a1c-9cd4-de82dca1a195 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:23.975727 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac7f5133-a27d-4a1c-9cd4-de82dca1a195 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1303 microversion: 2.1 time: 0.370488 May 19 05:00:23.988444 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2631/5334] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:23 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1303 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:25.057500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c3f5dc5-7483-47e9-8e54-2cf2723d6dfd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:25.059422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c3f5dc5-7483-47e9-8e54-2cf2723d6dfd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:25.104663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c3f5dc5-7483-47e9-8e54-2cf2723d6dfd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:25.106316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c3f5dc5-7483-47e9-8e54-2cf2723d6dfd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:25.107156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c3f5dc5-7483-47e9-8e54-2cf2723d6dfd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:25.109691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c3f5dc5-7483-47e9-8e54-2cf2723d6dfd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:25.670220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5c3f5dc5-7483-47e9-8e54-2cf2723d6dfd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:25.679346 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c3f5dc5-7483-47e9-8e54-2cf2723d6dfd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1371 microversion: 2.1 time: 0.678358 May 19 05:00:25.686051 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2704/5335] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:24 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1371 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:26.700289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92d75063-3084-4050-88d0-fbf5bd4b70b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:26.701805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-92d75063-3084-4050-88d0-fbf5bd4b70b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:26.716408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92d75063-3084-4050-88d0-fbf5bd4b70b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:26.717614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92d75063-3084-4050-88d0-fbf5bd4b70b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:26.719004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92d75063-3084-4050-88d0-fbf5bd4b70b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:26.722473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92d75063-3084-4050-88d0-fbf5bd4b70b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:27.243252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a8c6726e-b3ee-43ee-812c-34d753fb7357 req-f91e65c1-8618-4b47-aac6-fa77aea38aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffa6106-5902-4d87-8122-46fa440cf7d0", "tag": "f00d4861-60ae-4c13-b353-46467a43e631"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:00:27.283293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a8c6726e-b3ee-43ee-812c-34d753fb7357 req-f91e65c1-8618-4b47-aac6-fa77aea38aef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:27.285315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a8c6726e-b3ee-43ee-812c-34d753fb7357 req-f91e65c1-8618-4b47-aac6-fa77aea38aef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:27.362172 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a8c6726e-b3ee-43ee-812c-34d753fb7357 req-f91e65c1-8618-4b47-aac6-fa77aea38aef service nova] Creating event network-changed:f00d4861-60ae-4c13-b353-46467a43e631 for instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 on n-h1-766726-30 May 19 05:00:27.398062 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a8c6726e-b3ee-43ee-812c-34d753fb7357 req-f91e65c1-8618-4b47-aac6-fa77aea38aef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158755 May 19 05:00:27.404860 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2705/5336] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:00:27.474199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-92d75063-3084-4050-88d0-fbf5bd4b70b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:27.480309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92d75063-3084-4050-88d0-fbf5bd4b70b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1371 microversion: 2.1 time: 0.785712 May 19 05:00:27.493479 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2632/5337] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:26 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1371 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:28.516517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-888f811b-a99d-40b3-b668-c75099900421 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:28.521875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-888f811b-a99d-40b3-b668-c75099900421 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:28.582644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-888f811b-a99d-40b3-b668-c75099900421 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:28.588008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-888f811b-a99d-40b3-b668-c75099900421 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:28.593963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-888f811b-a99d-40b3-b668-c75099900421 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:28.596748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-888f811b-a99d-40b3-b668-c75099900421 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:29.172379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-888f811b-a99d-40b3-b668-c75099900421 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:29.180805 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-888f811b-a99d-40b3-b668-c75099900421 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1371 microversion: 2.1 time: 0.682320 May 19 05:00:29.191172 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2706/5338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:28 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1371 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:30.202443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a93b2b52-be06-42d9-818d-da45375bf27e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:30.203062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a93b2b52-be06-42d9-818d-da45375bf27e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:30.205978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:00:30.208208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:00:30.223002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a93b2b52-be06-42d9-818d-da45375bf27e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:30.231002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a93b2b52-be06-42d9-818d-da45375bf27e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:30.237719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a93b2b52-be06-42d9-818d-da45375bf27e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:30.238195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a93b2b52-be06-42d9-818d-da45375bf27e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:31.364686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a93b2b52-be06-42d9-818d-da45375bf27e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:31.381506 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a93b2b52-be06-42d9-818d-da45375bf27e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1371 microversion: 2.1 time: 1.182729 May 19 05:00:31.382147 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2633/5339] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:30 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1371 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:32.399088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-812c19f7-a537-46f6-a97a-ff12ac20792d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:32.399704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-812c19f7-a537-46f6-a97a-ff12ac20792d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:32.416461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:00:32.422915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-812c19f7-a537-46f6-a97a-ff12ac20792d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:32.426850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-812c19f7-a537-46f6-a97a-ff12ac20792d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:32.444059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-812c19f7-a537-46f6-a97a-ff12ac20792d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:32.444535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-812c19f7-a537-46f6-a97a-ff12ac20792d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:33.042172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-812c19f7-a537-46f6-a97a-ff12ac20792d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:33.060080 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-812c19f7-a537-46f6-a97a-ff12ac20792d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1371 microversion: 2.1 time: 0.664765 May 19 05:00:33.060906 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2707/5340] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:32 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1371 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:34.078665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac19befe-2625-42ce-9b7d-46c21cb7b1a4 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:34.080069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ac19befe-2625-42ce-9b7d-46c21cb7b1a4 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:34.094041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac19befe-2625-42ce-9b7d-46c21cb7b1a4 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:34.094657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac19befe-2625-42ce-9b7d-46c21cb7b1a4 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:34.097179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac19befe-2625-42ce-9b7d-46c21cb7b1a4 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:34.097821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac19befe-2625-42ce-9b7d-46c21cb7b1a4 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:34.762746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5dae42f0-f7bd-4c66-866e-9bd366d0b1e6 req-b12827a1-5f49-41b0-89e1-ccc2cad7e989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ffa6106-5902-4d87-8122-46fa440cf7d0", "name": "network-vif-plugged", "status": "completed", "tag": "f00d4861-60ae-4c13-b353-46467a43e631"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:00:34.779592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5dae42f0-f7bd-4c66-866e-9bd366d0b1e6 req-b12827a1-5f49-41b0-89e1-ccc2cad7e989 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:34.780047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5dae42f0-f7bd-4c66-866e-9bd366d0b1e6 req-b12827a1-5f49-41b0-89e1-ccc2cad7e989 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:34.815151 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5dae42f0-f7bd-4c66-866e-9bd366d0b1e6 req-b12827a1-5f49-41b0-89e1-ccc2cad7e989 service nova] Creating event network-vif-plugged:f00d4861-60ae-4c13-b353-46467a43e631 for instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 on n-h1-766726-30 May 19 05:00:34.830590 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5dae42f0-f7bd-4c66-866e-9bd366d0b1e6 req-b12827a1-5f49-41b0-89e1-ccc2cad7e989 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072917 May 19 05:00:34.833023 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2708/5341] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:00:35.002894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ac19befe-2625-42ce-9b7d-46c21cb7b1a4 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:35.014868 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac19befe-2625-42ce-9b7d-46c21cb7b1a4 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1371 microversion: 2.1 time: 0.941185 May 19 05:00:35.015760 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2634/5342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:34 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1371 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:36.034127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8982e313-4677-48cc-8454-1d5d92c5c4ed tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:36.034837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8982e313-4677-48cc-8454-1d5d92c5c4ed tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:36.049848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8982e313-4677-48cc-8454-1d5d92c5c4ed tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:36.050215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8982e313-4677-48cc-8454-1d5d92c5c4ed tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:36.050997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8982e313-4677-48cc-8454-1d5d92c5c4ed tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:36.051436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8982e313-4677-48cc-8454-1d5d92c5c4ed tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:36.361903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8982e313-4677-48cc-8454-1d5d92c5c4ed tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:36.381844 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8982e313-4677-48cc-8454-1d5d92c5c4ed tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1371 microversion: 2.1 time: 0.348547 May 19 05:00:36.384458 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2709/5343] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:36 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:37.400228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-edd0e757-4547-4cbc-9d93-eda01bb6edb5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:37.401477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-edd0e757-4547-4cbc-9d93-eda01bb6edb5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:37.414375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edd0e757-4547-4cbc-9d93-eda01bb6edb5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:37.415203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edd0e757-4547-4cbc-9d93-eda01bb6edb5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:37.416149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edd0e757-4547-4cbc-9d93-eda01bb6edb5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:37.416739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edd0e757-4547-4cbc-9d93-eda01bb6edb5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:37.873070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-edd0e757-4547-4cbc-9d93-eda01bb6edb5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:00:37.888070 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-edd0e757-4547-4cbc-9d93-eda01bb6edb5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1564 microversion: 2.1 time: 0.491945 May 19 05:00:37.920155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-831cacfe-4ef5-42cf-92a7-ec6d5c08da1b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:00:37.920647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-831cacfe-4ef5-42cf-92a7-ec6d5c08da1b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:00:37.925576 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2635/5344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:00:37 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1564 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:00:37.940493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-831cacfe-4ef5-42cf-92a7-ec6d5c08da1b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:37.941044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-831cacfe-4ef5-42cf-92a7-ec6d5c08da1b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:37.946511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-831cacfe-4ef5-42cf-92a7-ec6d5c08da1b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:37.954038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-831cacfe-4ef5-42cf-92a7-ec6d5c08da1b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:38.256396 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-831cacfe-4ef5-42cf-92a7-ec6d5c08da1b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.341431 May 19 05:00:38.264138 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2710/5345] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 05:00:37 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-interface => generated 284 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:00:42.972884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-220b240e-fea4-440f-b89c-a04e4143e26a req-15e4b39a-b83e-4a95-95c3-859e4e10eb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffa6106-5902-4d87-8122-46fa440cf7d0", "tag": "f00d4861-60ae-4c13-b353-46467a43e631"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:00:42.987013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-220b240e-fea4-440f-b89c-a04e4143e26a req-15e4b39a-b83e-4a95-95c3-859e4e10eb4c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:00:42.987459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-220b240e-fea4-440f-b89c-a04e4143e26a req-15e4b39a-b83e-4a95-95c3-859e4e10eb4c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:00:43.008672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-220b240e-fea4-440f-b89c-a04e4143e26a req-15e4b39a-b83e-4a95-95c3-859e4e10eb4c service nova] Creating event network-changed:f00d4861-60ae-4c13-b353-46467a43e631 for instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 on n-h1-766726-30 May 19 05:00:43.024605 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-220b240e-fea4-440f-b89c-a04e4143e26a req-15e4b39a-b83e-4a95-95c3-859e4e10eb4c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054306 May 19 05:00:43.028058 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2636/5346] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:15.022083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=19 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:01:15.022893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=38 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:01:15.029690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-76076440-730b-4deb-b73b-69f552e314ef tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "074aa387-e821-4e35-99b7-c6b06fa1e150"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:01:15.032419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-76076440-730b-4deb-b73b-69f552e314ef tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:01:15.061178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76076440-730b-4deb-b73b-69f552e314ef tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:15.065825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76076440-730b-4deb-b73b-69f552e314ef tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:15.066754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76076440-730b-4deb-b73b-69f552e314ef tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:15.067207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76076440-730b-4deb-b73b-69f552e314ef tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:15.776526 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-76076440-730b-4deb-b73b-69f552e314ef tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756486 May 19 05:01:15.779294 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2711/5347] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 05:01:15 2022] POST /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:24.411470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4b9859cb-1693-4354-95c8-b1238638a072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:01:24.412645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4b9859cb-1693-4354-95c8-b1238638a072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:01:24.428483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:01:24.434750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=40 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:01:24.447502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b9859cb-1693-4354-95c8-b1238638a072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:24.470181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b9859cb-1693-4354-95c8-b1238638a072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:24.471378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b9859cb-1693-4354-95c8-b1238638a072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:24.472206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4b9859cb-1693-4354-95c8-b1238638a072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:24.611755 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4b9859cb-1693-4354-95c8-b1238638a072 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.206338 May 19 05:01:24.620053 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2637/5348] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:01:24 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments => generated 371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:24.832726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-30da478f-2c60-4dda-acf1-b07aa869fd72 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:01:24.833991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-30da478f-2c60-4dda-acf1-b07aa869fd72 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:01:24.848338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30da478f-2c60-4dda-acf1-b07aa869fd72 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:24.850943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30da478f-2c60-4dda-acf1-b07aa869fd72 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:24.854038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30da478f-2c60-4dda-acf1-b07aa869fd72 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:24.854699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30da478f-2c60-4dda-acf1-b07aa869fd72 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:24.908500 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-30da478f-2c60-4dda-acf1-b07aa869fd72 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/4ef5f6a1-9a78-41b1-b31b-a9cf14a9c9e4" status: 200 len: 194 microversion: 2.1 time: 0.112087 May 19 05:01:24.909687 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2712/5349] 10.222.0.58 () {58 vars in 1412 bytes} [Thu May 19 05:01:24 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/4ef5f6a1-9a78-41b1-b31b-a9cf14a9c9e4 => generated 194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:24.926369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cc42bb32-8d50-4762-a9aa-97e1594f5077 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:01:24.927365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cc42bb32-8d50-4762-a9aa-97e1594f5077 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:01:24.939508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc42bb32-8d50-4762-a9aa-97e1594f5077 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:24.940258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc42bb32-8d50-4762-a9aa-97e1594f5077 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:24.942004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc42bb32-8d50-4762-a9aa-97e1594f5077 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:24.943706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc42bb32-8d50-4762-a9aa-97e1594f5077 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:25.166103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-cc42bb32-8d50-4762-a9aa-97e1594f5077 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lazy-loading 'services' on Instance uuid ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:01:25.348809 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cc42bb32-8d50-4762-a9aa-97e1594f5077 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/4ef5f6a1-9a78-41b1-b31b-a9cf14a9c9e4" status: 202 len: 0 microversion: 2.1 time: 0.431176 May 19 05:01:25.385991 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2638/5350] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:01:24 2022] DELETE /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/4ef5f6a1-9a78-41b1-b31b-a9cf14a9c9e4 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:01:30.940016 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:01:30.940648 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:01:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:01:52.485100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f5c8d440-3067-48cc-bc84-0fa3685b99d2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:01:52.486143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f5c8d440-3067-48cc-bc84-0fa3685b99d2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:01:52.488725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:01:52.489424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:01:52.519124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5c8d440-3067-48cc-bc84-0fa3685b99d2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:52.521031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5c8d440-3067-48cc-bc84-0fa3685b99d2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:52.523087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5c8d440-3067-48cc-bc84-0fa3685b99d2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:52.527453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5c8d440-3067-48cc-bc84-0fa3685b99d2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:52.650714 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f5c8d440-3067-48cc-bc84-0fa3685b99d2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/1093321c-d1c1-4fc5-a247-92a82b14cadb" status: 200 len: 194 microversion: 2.1 time: 0.170605 May 19 05:01:52.651352 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2713/5351] 10.222.0.58 () {58 vars in 1412 bytes} [Thu May 19 05:01:52 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/1093321c-d1c1-4fc5-a247-92a82b14cadb => generated 194 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:52.662177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab3f88f7-8a8f-43fc-ac10-71ea22358200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:01:52.663368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ab3f88f7-8a8f-43fc-ac10-71ea22358200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:01:52.673109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:01:52.676939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:01:52.681289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab3f88f7-8a8f-43fc-ac10-71ea22358200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:52.686457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab3f88f7-8a8f-43fc-ac10-71ea22358200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:52.687458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab3f88f7-8a8f-43fc-ac10-71ea22358200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:52.705976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab3f88f7-8a8f-43fc-ac10-71ea22358200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:53.606975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-ab3f88f7-8a8f-43fc-ac10-71ea22358200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lazy-loading 'services' on Instance uuid ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:01:54.149490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab3f88f7-8a8f-43fc-ac10-71ea22358200 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/1093321c-d1c1-4fc5-a247-92a82b14cadb" status: 202 len: 0 microversion: 2.1 time: 1.491726 May 19 05:01:54.162254 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2639/5352] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:01:52 2022] DELETE /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments/1093321c-d1c1-4fc5-a247-92a82b14cadb => generated 0 bytes in 1503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:01:57.522616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9ef2abbd-60a4-4d82-bd06-27774fe55d3d tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-748855413", "availability_zone": "foo_zone"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:01:57.524221 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:57.524221 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:01:57.525261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.aggregate [None req-9ef2abbd-60a4-4d82-bd06-27774fe55d3d tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Generated uuid ad5c9b10-e773-4233-9c5c-7e5c0877f963 for aggregate {{(pid=124818) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 05:01:57.599571 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9ef2abbd-60a4-4d82-bd06-27774fe55d3d tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.280155 May 19 05:01:57.600536 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2714/5353] 10.222.0.58 () {60 vars in 1163 bytes} [Thu May 19 05:01:57 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:57.613013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-47df19ef-bd27-471c-b73a-33d99d180578 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:01:57.616470 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:57.616470 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 05:01:57.676629 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-47df19ef-bd27-471c-b73a-33d99d180578 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.068822 May 19 05:01:57.678286 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2640/5354] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 05:01:57 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:57.697596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-486715c8-d976-452f-9cb5-5af2d355e5d6 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:01:57.699474 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:57.699474 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:01:57.702582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-486715c8-d976-452f-9cb5-5af2d355e5d6 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:57.704002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-486715c8-d976-452f-9cb5-5af2d355e5d6 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:57.708104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-486715c8-d976-452f-9cb5-5af2d355e5d6 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:57.709878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-486715c8-d976-452f-9cb5-5af2d355e5d6 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:57.815167 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-486715c8-d976-452f-9cb5-5af2d355e5d6 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.129532 May 19 05:01:57.825097 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2715/5355] 10.222.0.58 () {58 vars in 1175 bytes} [Thu May 19 05:01:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:57.830288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-066641a2-a5f6-4a74-8f2f-bed43eb252d2 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:01:57.831321 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:57.831321 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 05:01:57.845485 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-066641a2-a5f6-4a74-8f2f-bed43eb252d2 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.017809 May 19 05:01:57.849380 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2641/5356] 10.222.0.58 () {58 vars in 1142 bytes} [Thu May 19 05:01:57 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:01:57.861053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4133edbf-45f9-4b13-a8ec-247ead0366f8 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-766726-30"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:01:57.862479 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:57.862479 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:01:57.895612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4133edbf-45f9-4b13-a8ec-247ead0366f8 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:57.896289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4133edbf-45f9-4b13-a8ec-247ead0366f8 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:01:58.800642 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4133edbf-45f9-4b13-a8ec-247ead0366f8 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.944685 May 19 05:01:58.803421 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2716/5357] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 05:01:57 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:58.815502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2fd72e25-7628-4c28-9518-468cb6103fa0 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:01:58.817610 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:58.817610 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 05:01:58.839772 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2fd72e25-7628-4c28-9518-468cb6103fa0 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.030348 May 19 05:01:58.840376 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2642/5358] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 05:01:58 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:58.859360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8395ef6f-b8b4-47d5-8bb1-7f0861bedba3 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1331004722", "availability_zone": "foo_zone"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:01:59.168022 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:59.168022 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:01:59.355628 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8395ef6f-b8b4-47d5-8bb1-7f0861bedba3 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.505712 May 19 05:01:59.364584 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2717/5359] 10.222.0.58 () {60 vars in 1172 bytes} [Thu May 19 05:01:58 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:59.372194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4db96565-da3a-4fcb-8ab3-8b2127dbaf63 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:01:59.373780 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:59.373780 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 05:01:59.490625 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4db96565-da3a-4fcb-8ab3-8b2127dbaf63 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.124754 May 19 05:01:59.502929 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2643/5360] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 05:01:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:59.512161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-58d044a7-3788-4bfe-a72d-290d353e4335 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:01:59.513060 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:59.513060 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:01:59.538576 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-58d044a7-3788-4bfe-a72d-290d353e4335 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.033720 May 19 05:01:59.542705 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2718/5361] 10.222.0.58 () {58 vars in 1151 bytes} [Thu May 19 05:01:59 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:01:59.566818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d728341c-3183-447a-8a00-a54904567d16 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-766726-30"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:01:59.569704 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:01:59.569704 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 05:01:59.580263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d728341c-3183-447a-8a00-a54904567d16 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:01:59.580989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d728341c-3183-447a-8a00-a54904567d16 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:00.013103 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d728341c-3183-447a-8a00-a54904567d16 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.462983 May 19 05:02:00.015357 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2644/5362] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 19 05:01:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:02:00.026049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e1a60e7-6475-40bf-8dab-27b1b5e14350 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:00.027088 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:02:00.027088 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:02:00.125094 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4e1a60e7-6475-40bf-8dab-27b1b5e14350 tempest-TestAggregatesBasicOps-1690291346 tempest-TestAggregatesBasicOps-1690291346-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.103518 May 19 05:02:00.136327 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2719/5363] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 19 05:02:00 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 05:02:08.817003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9f028ec8-ff0a-4808-8359-d1067fe7d9c3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:02:08.818420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9f028ec8-ff0a-4808-8359-d1067fe7d9c3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:08.850755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f028ec8-ff0a-4808-8359-d1067fe7d9c3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:08.856377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f028ec8-ff0a-4808-8359-d1067fe7d9c3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:08.858145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f028ec8-ff0a-4808-8359-d1067fe7d9c3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:08.858765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9f028ec8-ff0a-4808-8359-d1067fe7d9c3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:08.922039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-9f028ec8-ff0a-4808-8359-d1067fe7d9c3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lazy-loading 'flavor' on Instance uuid 8ffa6106-5902-4d87-8122-46fa440cf7d0 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:02:09.232023 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9f028ec8-ff0a-4808-8359-d1067fe7d9c3 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/action" status: 200 len: 32 microversion: 2.1 time: 0.425195 May 19 05:02:09.238004 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2645/5364] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:02:08 2022] POST /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/action => generated 32 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 05:02:09.241162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:09.242697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:09.253534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ec103065-0b91-441a-a3af-892ce93a3250 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:09.254565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ec103065-0b91-441a-a3af-892ce93a3250 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:09.285700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec103065-0b91-441a-a3af-892ce93a3250 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:09.286176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec103065-0b91-441a-a3af-892ce93a3250 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:09.287006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec103065-0b91-441a-a3af-892ce93a3250 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:09.287458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec103065-0b91-441a-a3af-892ce93a3250 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:10.439784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ec103065-0b91-441a-a3af-892ce93a3250 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:10.454990 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ec103065-0b91-441a-a3af-892ce93a3250 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 1.215469 May 19 05:02:10.456697 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2720/5365] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:09 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:11.486996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6a7ac8c1-9576-4e89-a767-d354369d6fd8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:11.487849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6a7ac8c1-9576-4e89-a767-d354369d6fd8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:11.520927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a7ac8c1-9576-4e89-a767-d354369d6fd8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:11.521685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a7ac8c1-9576-4e89-a767-d354369d6fd8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:11.523390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a7ac8c1-9576-4e89-a767-d354369d6fd8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:11.529538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a7ac8c1-9576-4e89-a767-d354369d6fd8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:12.030637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6a7ac8c1-9576-4e89-a767-d354369d6fd8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:12.038881 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6a7ac8c1-9576-4e89-a767-d354369d6fd8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.568237 May 19 05:02:12.049162 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2646/5366] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:11 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:13.060185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4d2cdd63-d2c7-431b-aca6-86fec2762b85 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:13.061489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4d2cdd63-d2c7-431b-aca6-86fec2762b85 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:13.089128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d2cdd63-d2c7-431b-aca6-86fec2762b85 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:13.089659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d2cdd63-d2c7-431b-aca6-86fec2762b85 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:13.109823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d2cdd63-d2c7-431b-aca6-86fec2762b85 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:13.112881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d2cdd63-d2c7-431b-aca6-86fec2762b85 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:13.563453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4d2cdd63-d2c7-431b-aca6-86fec2762b85 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:13.582699 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4d2cdd63-d2c7-431b-aca6-86fec2762b85 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.527224 May 19 05:02:13.595855 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2721/5367] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:13 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:14.602612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f9db3ebd-57a3-4cc5-aab2-a91abfc07e0c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:14.603241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9db3ebd-57a3-4cc5-aab2-a91abfc07e0c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:14.624006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9db3ebd-57a3-4cc5-aab2-a91abfc07e0c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:14.624487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9db3ebd-57a3-4cc5-aab2-a91abfc07e0c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:14.626155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9db3ebd-57a3-4cc5-aab2-a91abfc07e0c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:14.629522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9db3ebd-57a3-4cc5-aab2-a91abfc07e0c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:15.452658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f9db3ebd-57a3-4cc5-aab2-a91abfc07e0c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:15.469024 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f9db3ebd-57a3-4cc5-aab2-a91abfc07e0c tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.870109 May 19 05:02:15.469988 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2647/5368] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:14 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:16.491993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4f20b68a-5ee3-4958-a531-25d7c6677d82 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:16.492778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4f20b68a-5ee3-4958-a531-25d7c6677d82 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:16.512084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f20b68a-5ee3-4958-a531-25d7c6677d82 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:16.512551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f20b68a-5ee3-4958-a531-25d7c6677d82 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:16.515484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f20b68a-5ee3-4958-a531-25d7c6677d82 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:16.516294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f20b68a-5ee3-4958-a531-25d7c6677d82 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:17.267434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4f20b68a-5ee3-4958-a531-25d7c6677d82 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:17.281279 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4f20b68a-5ee3-4958-a531-25d7c6677d82 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.794010 May 19 05:02:17.286256 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2722/5369] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:16 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:18.300237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3dd9cf5e-4e5b-4614-b143-dbad7925c5a9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:18.300945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3dd9cf5e-4e5b-4614-b143-dbad7925c5a9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:18.322257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dd9cf5e-4e5b-4614-b143-dbad7925c5a9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:18.325200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dd9cf5e-4e5b-4614-b143-dbad7925c5a9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:18.326257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dd9cf5e-4e5b-4614-b143-dbad7925c5a9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:18.327738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dd9cf5e-4e5b-4614-b143-dbad7925c5a9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:19.119186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3dd9cf5e-4e5b-4614-b143-dbad7925c5a9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:19.155221 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3dd9cf5e-4e5b-4614-b143-dbad7925c5a9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.860441 May 19 05:02:19.156569 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2648/5370] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:18 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:20.173429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d1a97b1a-9c30-46d1-9942-f755735108b8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:20.175242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d1a97b1a-9c30-46d1-9942-f755735108b8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:20.191162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1a97b1a-9c30-46d1-9942-f755735108b8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:20.191972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1a97b1a-9c30-46d1-9942-f755735108b8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:20.193019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1a97b1a-9c30-46d1-9942-f755735108b8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:20.198210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1a97b1a-9c30-46d1-9942-f755735108b8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:20.594684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d1a97b1a-9c30-46d1-9942-f755735108b8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:20.615037 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d1a97b1a-9c30-46d1-9942-f755735108b8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.446272 May 19 05:02:20.618928 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2723/5371] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:20 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:20.991750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4c6076ba-34e8-4488-8eb7-d8e068c7b5bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:20.993187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4c6076ba-34e8-4488-8eb7-d8e068c7b5bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:21.020008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4c6076ba-34e8-4488-8eb7-d8e068c7b5bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.022656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4c6076ba-34e8-4488-8eb7-d8e068c7b5bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:21.027218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4c6076ba-34e8-4488-8eb7-d8e068c7b5bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.029592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4c6076ba-34e8-4488-8eb7-d8e068c7b5bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:21.094505 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4c6076ba-34e8-4488-8eb7-d8e068c7b5bb tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109151 May 19 05:02:21.096264 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2649/5372] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:02:20 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 05:02:21.290724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96d5c71e-3a49-496b-b342-f330a4229325 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:21.292946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96d5c71e-3a49-496b-b342-f330a4229325 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:21.309917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96d5c71e-3a49-496b-b342-f330a4229325 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.310382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96d5c71e-3a49-496b-b342-f330a4229325 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:21.311195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96d5c71e-3a49-496b-b342-f330a4229325 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.316833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96d5c71e-3a49-496b-b342-f330a4229325 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:21.378859 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96d5c71e-3a49-496b-b342-f330a4229325 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094406 May 19 05:02:21.380087 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2724/5373] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:02:21 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 05:02:21.492938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cb45a3be-c54f-4bef-a355-82c02efe357e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:21.493767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cb45a3be-c54f-4bef-a355-82c02efe357e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:21.510233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cb45a3be-c54f-4bef-a355-82c02efe357e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.510572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cb45a3be-c54f-4bef-a355-82c02efe357e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:21.511391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cb45a3be-c54f-4bef-a355-82c02efe357e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.511844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cb45a3be-c54f-4bef-a355-82c02efe357e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:21.595054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cb45a3be-c54f-4bef-a355-82c02efe357e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:02:21.641098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e7a19506-1d22-4adf-9b67-cfc193060a2b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:21.642302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e7a19506-1d22-4adf-9b67-cfc193060a2b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:21.670657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7a19506-1d22-4adf-9b67-cfc193060a2b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.683629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7a19506-1d22-4adf-9b67-cfc193060a2b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:21.686071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7a19506-1d22-4adf-9b67-cfc193060a2b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.690948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7a19506-1d22-4adf-9b67-cfc193060a2b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:21.784076 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cb45a3be-c54f-4bef-a355-82c02efe357e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 204 len: 0 microversion: 2.1 time: 0.295429 May 19 05:02:21.785001 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2650/5374] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:02:21 2022] DELETE /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:02:21.793581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b6935b0-5d0a-4b8d-8e56-e1058e18252c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:21.794675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b6935b0-5d0a-4b8d-8e56-e1058e18252c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:21.806099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b6935b0-5d0a-4b8d-8e56-e1058e18252c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.809646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b6935b0-5d0a-4b8d-8e56-e1058e18252c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:21.810798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b6935b0-5d0a-4b8d-8e56-e1058e18252c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:21.811479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b6935b0-5d0a-4b8d-8e56-e1058e18252c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:22.338709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e7a19506-1d22-4adf-9b67-cfc193060a2b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:22.354584 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e7a19506-1d22-4adf-9b67-cfc193060a2b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.723336 May 19 05:02:22.357366 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2725/5375] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:21 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:02:22.519782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b6935b0-5d0a-4b8d-8e56-e1058e18252c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:22.529393 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b6935b0-5d0a-4b8d-8e56-e1058e18252c tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1673 microversion: 2.1 time: 0.740130 May 19 05:02:22.529992 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2651/5376] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:21 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1673 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:02:23.372969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ff880ba6-6231-413f-9737-f2e4900c014a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:23.374299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ff880ba6-6231-413f-9737-f2e4900c014a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:23.377570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:23.388836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff880ba6-6231-413f-9737-f2e4900c014a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:23.389757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff880ba6-6231-413f-9737-f2e4900c014a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:23.390778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff880ba6-6231-413f-9737-f2e4900c014a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:23.391427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff880ba6-6231-413f-9737-f2e4900c014a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:23.549007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-603dbd42-64c4-4dbe-a35e-5d7975bfd0b2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:23.549812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-603dbd42-64c4-4dbe-a35e-5d7975bfd0b2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:23.555081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:23.582973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-603dbd42-64c4-4dbe-a35e-5d7975bfd0b2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:23.583425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-603dbd42-64c4-4dbe-a35e-5d7975bfd0b2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:23.594452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-603dbd42-64c4-4dbe-a35e-5d7975bfd0b2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:23.594787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-603dbd42-64c4-4dbe-a35e-5d7975bfd0b2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:23.667804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:24.063961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ff880ba6-6231-413f-9737-f2e4900c014a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:24.087882 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ff880ba6-6231-413f-9737-f2e4900c014a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.718691 May 19 05:02:24.091706 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2726/5377] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:23 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:24.798302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-603dbd42-64c4-4dbe-a35e-5d7975bfd0b2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:24.808133 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-603dbd42-64c4-4dbe-a35e-5d7975bfd0b2 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1673 microversion: 2.1 time: 1.263958 May 19 05:02:24.808810 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2652/5378] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:23 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1673 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:25.110792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-62ad7142-cc6d-4748-a2b1-8152875def6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:25.111799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-62ad7142-cc6d-4748-a2b1-8152875def6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:25.133421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-62ad7142-cc6d-4748-a2b1-8152875def6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:25.137382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-62ad7142-cc6d-4748-a2b1-8152875def6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:25.141862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-62ad7142-cc6d-4748-a2b1-8152875def6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:25.142745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-62ad7142-cc6d-4748-a2b1-8152875def6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:25.825834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c289f73f-35db-4ee1-9a3a-e2d74e2fe730 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:25.826456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c289f73f-35db-4ee1-9a3a-e2d74e2fe730 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:25.841104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c289f73f-35db-4ee1-9a3a-e2d74e2fe730 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:25.843467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c289f73f-35db-4ee1-9a3a-e2d74e2fe730 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:25.844511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c289f73f-35db-4ee1-9a3a-e2d74e2fe730 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:25.846763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c289f73f-35db-4ee1-9a3a-e2d74e2fe730 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:25.962382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-62ad7142-cc6d-4748-a2b1-8152875def6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:25.974360 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-62ad7142-cc6d-4748-a2b1-8152875def6d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.867007 May 19 05:02:25.984852 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2727/5379] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:25 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:26.039680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c289f73f-35db-4ee1-9a3a-e2d74e2fe730 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:26.065115 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c289f73f-35db-4ee1-9a3a-e2d74e2fe730 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1606 microversion: 2.1 time: 0.233500 May 19 05:02:26.072229 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2653/5380] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:25 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1606 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:26.991656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66f01361-d633-4e50-8399-1d52e0b0d204 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:26.992306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66f01361-d633-4e50-8399-1d52e0b0d204 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:27.000384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66f01361-d633-4e50-8399-1d52e0b0d204 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:27.006170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66f01361-d633-4e50-8399-1d52e0b0d204 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:27.017186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66f01361-d633-4e50-8399-1d52e0b0d204 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:27.017951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66f01361-d633-4e50-8399-1d52e0b0d204 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:27.090388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f276b3fe-b38c-441f-8c84-75020a6bc2ef tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:27.091023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f276b3fe-b38c-441f-8c84-75020a6bc2ef tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:27.103841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f276b3fe-b38c-441f-8c84-75020a6bc2ef tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:27.109363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f276b3fe-b38c-441f-8c84-75020a6bc2ef tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:27.110208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f276b3fe-b38c-441f-8c84-75020a6bc2ef tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:27.114245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f276b3fe-b38c-441f-8c84-75020a6bc2ef tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:27.555755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f276b3fe-b38c-441f-8c84-75020a6bc2ef tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def2cad1e80b4ca6873f030527b0c5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d15dedbc0c4eeb97a0d88d664b5818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:27.575188 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f276b3fe-b38c-441f-8c84-75020a6bc2ef tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 200 len: 1606 microversion: 2.1 time: 0.480491 May 19 05:02:27.576495 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2654/5381] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:27 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 1606 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:27.946352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-66f01361-d633-4e50-8399-1d52e0b0d204 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:27.977860 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66f01361-d633-4e50-8399-1d52e0b0d204 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.989193 May 19 05:02:28.004458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8337bde9-d418-45c0-8c62-7a160666188e req-dc10dd48-f9dd-4635-b9bd-a6484d63ee97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd", "name": "network-vif-deleted", "tag": "9332fda4-9dc7-4e6d-b4a4-5f7a2c52cded"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:02:28.010632 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2728/5382] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:26 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:28.035142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8337bde9-d418-45c0-8c62-7a160666188e req-dc10dd48-f9dd-4635-b9bd-a6484d63ee97 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:28.035627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8337bde9-d418-45c0-8c62-7a160666188e req-dc10dd48-f9dd-4635-b9bd-a6484d63ee97 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:28.071365 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8337bde9-d418-45c0-8c62-7a160666188e req-dc10dd48-f9dd-4635-b9bd-a6484d63ee97 service nova] Creating event network-vif-deleted:9332fda4-9dc7-4e6d-b4a4-5f7a2c52cded for instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd on n-h2-766726-30 May 19 05:02:28.086673 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8337bde9-d418-45c0-8c62-7a160666188e req-dc10dd48-f9dd-4635-b9bd-a6484d63ee97 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.504036 May 19 05:02:28.087406 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2655/5383] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:02:28.593796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:28.596385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:28.611259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:28.611772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:28.612486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:28.612914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:28.673289 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] HTTP exception thrown: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Request method failure captured: May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd HTTP/1.1 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc1MYGlSCjIKY9S_BwpQUAg9JUsYSzvxqCnPYFDL3TbyzveY3prJJg2S1NYiApfITLVv5oqxbIJJ8MKQ2GJOpfx8amV3lvP96kFs4Bk7CYsHSLFIJmWIfjVjhS-thkN4LeYd8sdQw_u0M7eaCjwY0TT9wMTj9jtOUVINIhMTsYowjJc May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeTestJSON-1836870491 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: def2cad1e80b4ca6873f030527b0c5c7 May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd'} May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:02:28.677561 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Returning 404 to user: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72aa2605-4954-489f-be35-7589b8cb7a3e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 404 len: 111 microversion: 2.1 time: 0.090225 May 19 05:02:28.681482 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2729/5384] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:28 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:02:28.696836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92bbd14b-e2c6-4249-aaa5-f3e551a59b69 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '.version_select at 0x7fd3144abe50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:28.766954 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92bbd14b-e2c6-4249-aaa5-f3e551a59b69 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921893673" status: 202 len: 0 microversion: 2.1 time: 0.062565 May 19 05:02:28.773320 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2656/5385] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 19 05:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921893673 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:02:29.002655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e406fc8-0034-4615-8c13-322c6c13836a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:29.003570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7e406fc8-0034-4615-8c13-322c6c13836a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:29.015789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e406fc8-0034-4615-8c13-322c6c13836a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:29.016419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e406fc8-0034-4615-8c13-322c6c13836a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:29.017026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e406fc8-0034-4615-8c13-322c6c13836a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:29.017502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e406fc8-0034-4615-8c13-322c6c13836a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:29.409341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7e406fc8-0034-4615-8c13-322c6c13836a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:29.421762 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e406fc8-0034-4615-8c13-322c6c13836a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1735 microversion: 2.1 time: 0.427998 May 19 05:02:29.432531 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2730/5386] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:28 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1735 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:30.442232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-824dfd80-5ec0-445d-84db-94fad8ce290a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:30.444509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-824dfd80-5ec0-445d-84db-94fad8ce290a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:30.466986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-824dfd80-5ec0-445d-84db-94fad8ce290a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:30.469565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-824dfd80-5ec0-445d-84db-94fad8ce290a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:30.477320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-824dfd80-5ec0-445d-84db-94fad8ce290a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:30.482125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-824dfd80-5ec0-445d-84db-94fad8ce290a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:30.912226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-824dfd80-5ec0-445d-84db-94fad8ce290a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:30.947067 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-824dfd80-5ec0-445d-84db-94fad8ce290a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1715 microversion: 2.1 time: 0.509627 May 19 05:02:30.949441 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2657/5387] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:30 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1715 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:31.147164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:31.148744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:31.180750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:31.181249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:31.182047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:31.182486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:31.423991 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] HTTP exception thrown: Cannot 'detach_volume' instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 while it is in vm_state rescued May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Request method failure captured: May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments/074aa387-e821-4e35-99b7-c6b06fa1e150 HTTP/1.1 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc552hVIo4gddG1TsyjmdiR4FI-JaQWAI2htXnFCrEGDKOYsH4E1XezkrXoYbLKVx2oQ0SvwM5ir8T3Pst5EgfSG9x1mXTMB6grf-HgGlu6N1XdfyruY3CowYDE4FL4j4mU5LfyG9tECTRcDp-giFDz68AbxVhmT6rWj0Yst-Jw0c2o May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 0e75fb6c77b44c22b95693d01448e3d2 May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'detach_volume' instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 while it is in vm_state rescued May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'server_id': '8ffa6106-5902-4d87-8122-46fa440cf7d0', 'id': '074aa387-e821-4e35-99b7-c6b06fa1e150'} May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 while it is in vm_state rescued May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:31.425552 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:02:31.429377 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:02:31.429377 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:02:31.429377 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:02:31.429377 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:02:31.429377 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 while it is in vm_state rescued May 19 05:02:31.429377 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:02:31.429377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Returning 409 to user: Cannot 'detach_volume' instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 while it is in vm_state rescued {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:02:31.429377 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a933ffab-c54a-41fe-be45-8cbdd06004fb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments/074aa387-e821-4e35-99b7-c6b06fa1e150" status: 409 len: 152 microversion: 2.1 time: 0.283943 May 19 05:02:31.430999 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2731/5388] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:02:31 2022] DELETE /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments/074aa387-e821-4e35-99b7-c6b06fa1e150 => generated 152 bytes in 288 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 05:02:31.435789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ec13a641-d761-40db-ae08-c46f9c131ea9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:02:31.436327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ec13a641-d761-40db-ae08-c46f9c131ea9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:31.443160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec13a641-d761-40db-ae08-c46f9c131ea9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:31.443769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec13a641-d761-40db-ae08-c46f9c131ea9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:31.468531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec13a641-d761-40db-ae08-c46f9c131ea9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:31.469894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec13a641-d761-40db-ae08-c46f9c131ea9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:31.625339 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ec13a641-d761-40db-ae08-c46f9c131ea9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/action" status: 202 len: 0 microversion: 2.1 time: 0.192784 May 19 05:02:31.628996 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2658/5389] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:02:31 2022] POST /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:02:31.635242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2e807cfe-b378-46e9-8177-c21cedfc1a30 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:31.636160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2e807cfe-b378-46e9-8177-c21cedfc1a30 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:31.648272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e807cfe-b378-46e9-8177-c21cedfc1a30 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:31.651497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e807cfe-b378-46e9-8177-c21cedfc1a30 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:31.652550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e807cfe-b378-46e9-8177-c21cedfc1a30 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:31.657729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e807cfe-b378-46e9-8177-c21cedfc1a30 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:32.032684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2e807cfe-b378-46e9-8177-c21cedfc1a30 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:32.047877 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2e807cfe-b378-46e9-8177-c21cedfc1a30 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1723 microversion: 2.1 time: 0.417136 May 19 05:02:32.054255 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2732/5390] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:31 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:33.070205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b87dd0f5-9b73-4670-a0bd-f87e1d6b14d9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:33.072742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b87dd0f5-9b73-4670-a0bd-f87e1d6b14d9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:33.091145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b87dd0f5-9b73-4670-a0bd-f87e1d6b14d9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:33.091963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b87dd0f5-9b73-4670-a0bd-f87e1d6b14d9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:33.093023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b87dd0f5-9b73-4670-a0bd-f87e1d6b14d9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:33.094705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b87dd0f5-9b73-4670-a0bd-f87e1d6b14d9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:34.135632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b87dd0f5-9b73-4670-a0bd-f87e1d6b14d9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:34.151095 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b87dd0f5-9b73-4670-a0bd-f87e1d6b14d9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1723 microversion: 2.1 time: 1.083055 May 19 05:02:34.154615 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2659/5391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:33 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1723 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:35.172641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b5fda53b-3466-4485-ae60-a779c0e7ecee tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:35.173638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b5fda53b-3466-4485-ae60-a779c0e7ecee tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:35.184025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5fda53b-3466-4485-ae60-a779c0e7ecee tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:35.184758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5fda53b-3466-4485-ae60-a779c0e7ecee tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:35.185790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5fda53b-3466-4485-ae60-a779c0e7ecee tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:35.186589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5fda53b-3466-4485-ae60-a779c0e7ecee tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:35.763249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5fda53b-3466-4485-ae60-a779c0e7ecee tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:35.781545 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b5fda53b-3466-4485-ae60-a779c0e7ecee tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1723 microversion: 2.1 time: 0.613568 May 19 05:02:35.800050 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2733/5392] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:35 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1723 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:36.799729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a70119d2-58a3-4664-9ea2-86d671072626 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:36.800346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a70119d2-58a3-4664-9ea2-86d671072626 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:36.811142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a70119d2-58a3-4664-9ea2-86d671072626 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:36.811594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a70119d2-58a3-4664-9ea2-86d671072626 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:36.812369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a70119d2-58a3-4664-9ea2-86d671072626 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:36.813980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a70119d2-58a3-4664-9ea2-86d671072626 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:37.062028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a70119d2-58a3-4664-9ea2-86d671072626 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:37.072538 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a70119d2-58a3-4664-9ea2-86d671072626 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1729 microversion: 2.1 time: 0.276607 May 19 05:02:37.073574 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2660/5393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:36 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:37.090052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b8da9bbe-a032-4516-a862-8bca609e114b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:37.090614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b8da9bbe-a032-4516-a862-8bca609e114b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:37.098211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8da9bbe-a032-4516-a862-8bca609e114b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:37.098918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8da9bbe-a032-4516-a862-8bca609e114b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:37.100468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8da9bbe-a032-4516-a862-8bca609e114b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:37.101183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8da9bbe-a032-4516-a862-8bca609e114b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:37.348236 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b8da9bbe-a032-4516-a862-8bca609e114b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.262069 May 19 05:02:37.348843 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2734/5394] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 05:02:37 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:02:39.717376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f6c57784-2f75-42f4-911d-6be7ba0f19ab req-fa64a051-3597-4a62-8c1c-b28f3cd6d15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffa6106-5902-4d87-8122-46fa440cf7d0", "tag": "f00d4861-60ae-4c13-b353-46467a43e631"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:02:39.739928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f6c57784-2f75-42f4-911d-6be7ba0f19ab req-fa64a051-3597-4a62-8c1c-b28f3cd6d15a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:39.740911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f6c57784-2f75-42f4-911d-6be7ba0f19ab req-fa64a051-3597-4a62-8c1c-b28f3cd6d15a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:39.793483 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f6c57784-2f75-42f4-911d-6be7ba0f19ab req-fa64a051-3597-4a62-8c1c-b28f3cd6d15a service nova] Creating event network-changed:f00d4861-60ae-4c13-b353-46467a43e631 for instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 on n-h1-766726-30 May 19 05:02:39.810347 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f6c57784-2f75-42f4-911d-6be7ba0f19ab req-fa64a051-3597-4a62-8c1c-b28f3cd6d15a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097216 May 19 05:02:39.822658 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2661/5395] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:02:41.935171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-90ecfa50-7ae1-46ab-95f2-70e1b8d0f21c req-1d95f11d-1cc2-4b52-9c9d-ac4ebc8cfec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffa6106-5902-4d87-8122-46fa440cf7d0", "tag": "f00d4861-60ae-4c13-b353-46467a43e631"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:02:41.951340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-90ecfa50-7ae1-46ab-95f2-70e1b8d0f21c req-1d95f11d-1cc2-4b52-9c9d-ac4ebc8cfec3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:41.954266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-90ecfa50-7ae1-46ab-95f2-70e1b8d0f21c req-1d95f11d-1cc2-4b52-9c9d-ac4ebc8cfec3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:41.983336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=85 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:41.985755 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-90ecfa50-7ae1-46ab-95f2-70e1b8d0f21c req-1d95f11d-1cc2-4b52-9c9d-ac4ebc8cfec3 service nova] Creating event network-changed:f00d4861-60ae-4c13-b353-46467a43e631 for instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 on n-h1-766726-30 May 19 05:02:42.002668 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-90ecfa50-7ae1-46ab-95f2-70e1b8d0f21c req-1d95f11d-1cc2-4b52-9c9d-ac4ebc8cfec3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071567 May 19 05:02:42.003744 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2735/5396] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:02:44.779510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2118022795", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "67290692-f3ed-493a-be8a-70b336d93e9a"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:02:44.914423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] validate_networks() for [('67290692-f3ed-493a-be8a-70b336d93e9a', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:02:45.770851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:02:45.771466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:02:45.772383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:02:45.772950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:02:45.773533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:02:45.786127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:45.788575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:45.791430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:45.792651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:45.853442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Getting quotas for project daac089e082242389760bbb43920d258. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:02:45.861408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Getting quotas for user bab10051a56c40d998731e09515e18c9 and project daac089e082242389760bbb43920d258. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:02:45.915609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:02:45.923438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:02:46.104118 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ba102909-77e3-4932-b0e1-0b81503a3b6b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.616566 May 19 05:02:46.110887 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2662/5397] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:02:46.117273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c18718a-c31e-4e60-bca6-34aaff8ae04e tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:46.117955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9c18718a-c31e-4e60-bca6-34aaff8ae04e tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:46.348285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c18718a-c31e-4e60-bca6-34aaff8ae04e tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:46.386998 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c18718a-c31e-4e60-bca6-34aaff8ae04e tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1214 microversion: 2.1 time: 0.271804 May 19 05:02:46.397110 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2736/5398] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:46 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:47.415204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-46a15db7-ea88-44b1-b19f-d11aa1c77016 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:47.415864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-46a15db7-ea88-44b1-b19f-d11aa1c77016 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:47.443327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46a15db7-ea88-44b1-b19f-d11aa1c77016 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:47.443809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46a15db7-ea88-44b1-b19f-d11aa1c77016 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:47.444643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46a15db7-ea88-44b1-b19f-d11aa1c77016 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:47.448457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46a15db7-ea88-44b1-b19f-d11aa1c77016 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:47.634016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-46a15db7-ea88-44b1-b19f-d11aa1c77016 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:47.644421 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-46a15db7-ea88-44b1-b19f-d11aa1c77016 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1210 microversion: 2.1 time: 0.236073 May 19 05:02:47.655367 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2663/5399] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:47 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1210 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:47.655559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-356318837", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "bae5d27d-4a18-48a7-8414-a513b404cd6a"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:02:47.738916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] validate_networks() for [('bae5d27d-4a18-48a7-8414-a513b404cd6a', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:02:48.664587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e5f006f-da01-427a-bea6-26de20f847ee tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:48.665824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e5f006f-da01-427a-bea6-26de20f847ee tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:48.678192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e5f006f-da01-427a-bea6-26de20f847ee tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:48.683230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e5f006f-da01-427a-bea6-26de20f847ee tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:48.684293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e5f006f-da01-427a-bea6-26de20f847ee tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:48.685450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e5f006f-da01-427a-bea6-26de20f847ee tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:48.704096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:02:48.704652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:02:48.704986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:02:48.705428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:02:48.705841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:02:48.724917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:48.725680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:48.726618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:48.727067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:48.778546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Getting quotas for project 809713a72c8848bc8d75fe5661ef7bff. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:02:48.798054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Getting quotas for user 0c1a374e9ff94035bcdd10aa278873c9 and project 809713a72c8848bc8d75fe5661ef7bff. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:02:48.830768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:02:48.836704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:02:48.945569 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-59d2f154-23d0-4dd2-a107-e65d0c6438fc tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294345 May 19 05:02:48.947767 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2737/5400] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:02:48.957806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dd3e78a6-2f81-477d-9831-c34989dd1cdf tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:48.958990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dd3e78a6-2f81-477d-9831-c34989dd1cdf tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:49.030437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e5f006f-da01-427a-bea6-26de20f847ee tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:49.039653 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e5f006f-da01-427a-bea6-26de20f847ee tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1272 microversion: 2.1 time: 0.379679 May 19 05:02:49.041659 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2664/5401] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:48 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:02:49.088087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dd3e78a6-2f81-477d-9831-c34989dd1cdf tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:49.103002 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dd3e78a6-2f81-477d-9831-c34989dd1cdf tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1218 microversion: 2.1 time: 0.148017 May 19 05:02:49.104725 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2738/5402] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:48 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:50.060627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ba5d1038-e356-42bc-9017-0666a7b2653d tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:50.062151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba5d1038-e356-42bc-9017-0666a7b2653d tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:50.070248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba5d1038-e356-42bc-9017-0666a7b2653d tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:50.071076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba5d1038-e356-42bc-9017-0666a7b2653d tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:50.072042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba5d1038-e356-42bc-9017-0666a7b2653d tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:50.072764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba5d1038-e356-42bc-9017-0666a7b2653d tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:50.120391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-80c95f8d-62e5-4d7b-91f8-84155c417b80 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:50.121713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-80c95f8d-62e5-4d7b-91f8-84155c417b80 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:50.307381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-80c95f8d-62e5-4d7b-91f8-84155c417b80 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:50.319720 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-80c95f8d-62e5-4d7b-91f8-84155c417b80 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1218 microversion: 2.1 time: 0.203744 May 19 05:02:50.320691 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2739/5403] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:50 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1218 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:02:50.464660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ba5d1038-e356-42bc-9017-0666a7b2653d tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:50.496784 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ba5d1038-e356-42bc-9017-0666a7b2653d tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1314 microversion: 2.1 time: 0.432798 May 19 05:02:50.509166 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2665/5404] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:50 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:51.338928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2e12705-4aad-4799-b829-9c103f50f856 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:51.339612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c2e12705-4aad-4799-b829-9c103f50f856 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:51.517401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-70397959-c47e-4c0f-a676-49da74820594 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:51.517956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-70397959-c47e-4c0f-a676-49da74820594 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:51.538408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70397959-c47e-4c0f-a676-49da74820594 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:51.538955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70397959-c47e-4c0f-a676-49da74820594 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:51.540042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70397959-c47e-4c0f-a676-49da74820594 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:51.540491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-70397959-c47e-4c0f-a676-49da74820594 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:52.279209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c2e12705-4aad-4799-b829-9c103f50f856 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:52.297042 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2e12705-4aad-4799-b829-9c103f50f856 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1218 microversion: 2.1 time: 0.963487 May 19 05:02:52.311135 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2740/5405] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:51 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1218 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:52.556691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-70397959-c47e-4c0f-a676-49da74820594 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:52.577742 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-70397959-c47e-4c0f-a676-49da74820594 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1314 microversion: 2.1 time: 1.061444 May 19 05:02:52.591016 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2666/5406] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:51 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:52.891080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4ee65652-49aa-4072-a7de-cfa60ae23891 req-be6d4878-35bb-40d6-9389-7848872a342e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1380e7e-23dc-4493-ab93-102290d64d10", "tag": "1c88b9a7-e11f-478b-ab99-848a0adc1eac"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:02:52.949211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4ee65652-49aa-4072-a7de-cfa60ae23891 req-be6d4878-35bb-40d6-9389-7848872a342e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:52.949830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4ee65652-49aa-4072-a7de-cfa60ae23891 req-be6d4878-35bb-40d6-9389-7848872a342e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:52.965394 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4ee65652-49aa-4072-a7de-cfa60ae23891 req-be6d4878-35bb-40d6-9389-7848872a342e service nova] Creating event network-changed:1c88b9a7-e11f-478b-ab99-848a0adc1eac for instance e1380e7e-23dc-4493-ab93-102290d64d10 on n-h2-766726-30 May 19 05:02:52.971897 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4ee65652-49aa-4072-a7de-cfa60ae23891 req-be6d4878-35bb-40d6-9389-7848872a342e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085518 May 19 05:02:52.973450 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2741/5407] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:02:53.319955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c954445-fed1-4955-934a-46f2ce08cf63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:53.320969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5c954445-fed1-4955-934a-46f2ce08cf63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:53.333983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c954445-fed1-4955-934a-46f2ce08cf63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:53.336410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c954445-fed1-4955-934a-46f2ce08cf63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:53.337942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c954445-fed1-4955-934a-46f2ce08cf63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:53.339339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c954445-fed1-4955-934a-46f2ce08cf63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:53.487501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c954445-fed1-4955-934a-46f2ce08cf63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:53.499166 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5c954445-fed1-4955-934a-46f2ce08cf63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1222 microversion: 2.1 time: 0.185443 May 19 05:02:53.499890 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2667/5408] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:53 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1222 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:53.608297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27d4588b-9f68-4d66-b41c-ea53eeb8e593 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:53.615954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27d4588b-9f68-4d66-b41c-ea53eeb8e593 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:53.623844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:53.644789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d4588b-9f68-4d66-b41c-ea53eeb8e593 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:53.645892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d4588b-9f68-4d66-b41c-ea53eeb8e593 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:53.647070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d4588b-9f68-4d66-b41c-ea53eeb8e593 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:53.653032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27d4588b-9f68-4d66-b41c-ea53eeb8e593 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:54.148448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27d4588b-9f68-4d66-b41c-ea53eeb8e593 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:54.158071 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27d4588b-9f68-4d66-b41c-ea53eeb8e593 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1314 microversion: 2.1 time: 0.563720 May 19 05:02:54.161709 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2742/5409] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:53 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:54.517753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a5b7f6ae-52d6-4aa8-886a-0ea9b6e70e2c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:54.525689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a5b7f6ae-52d6-4aa8-886a-0ea9b6e70e2c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:54.531826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:54.554042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5b7f6ae-52d6-4aa8-886a-0ea9b6e70e2c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:54.561848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5b7f6ae-52d6-4aa8-886a-0ea9b6e70e2c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:54.563095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5b7f6ae-52d6-4aa8-886a-0ea9b6e70e2c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:54.569509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5b7f6ae-52d6-4aa8-886a-0ea9b6e70e2c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:54.621215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:54.782785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a5b7f6ae-52d6-4aa8-886a-0ea9b6e70e2c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:54.791898 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a5b7f6ae-52d6-4aa8-886a-0ea9b6e70e2c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1270 microversion: 2.1 time: 0.278526 May 19 05:02:54.798201 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2668/5410] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:54 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1270 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:55.178018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2816cf8-5ffa-4448-b470-6272247bebfd tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:55.179353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d2816cf8-5ffa-4448-b470-6272247bebfd tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:55.212439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2816cf8-5ffa-4448-b470-6272247bebfd tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:55.213070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2816cf8-5ffa-4448-b470-6272247bebfd tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:55.214978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2816cf8-5ffa-4448-b470-6272247bebfd tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:55.229835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2816cf8-5ffa-4448-b470-6272247bebfd tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:55.815233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1fcdb54b-d744-4dc7-8831-22858f4547c9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:55.816101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1fcdb54b-d744-4dc7-8831-22858f4547c9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:55.829793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:55.836368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fcdb54b-d744-4dc7-8831-22858f4547c9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:55.844131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fcdb54b-d744-4dc7-8831-22858f4547c9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:55.845211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fcdb54b-d744-4dc7-8831-22858f4547c9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:55.853813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fcdb54b-d744-4dc7-8831-22858f4547c9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:55.918187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:56.447876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1fcdb54b-d744-4dc7-8831-22858f4547c9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:56.465953 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1fcdb54b-d744-4dc7-8831-22858f4547c9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1276 microversion: 2.1 time: 0.654909 May 19 05:02:56.467655 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2669/5411] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:55 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1276 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:56.572189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d2816cf8-5ffa-4448-b470-6272247bebfd tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:56.584667 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2816cf8-5ffa-4448-b470-6272247bebfd tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1314 microversion: 2.1 time: 1.408705 May 19 05:02:56.587187 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2743/5412] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:55 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1314 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:57.484980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-65826c10-e213-4a68-ace4-a791555050f0 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:57.486392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-65826c10-e213-4a68-ace4-a791555050f0 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:57.504025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65826c10-e213-4a68-ace4-a791555050f0 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:57.508781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65826c10-e213-4a68-ace4-a791555050f0 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:57.512072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65826c10-e213-4a68-ace4-a791555050f0 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:57.512652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65826c10-e213-4a68-ace4-a791555050f0 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:57.605756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-20df3ca3-9cf1-4230-bed2-4d9996d9ed47 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:57.607095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-20df3ca3-9cf1-4230-bed2-4d9996d9ed47 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:57.654066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20df3ca3-9cf1-4230-bed2-4d9996d9ed47 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:57.665282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20df3ca3-9cf1-4230-bed2-4d9996d9ed47 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:57.672611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20df3ca3-9cf1-4230-bed2-4d9996d9ed47 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:57.673197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20df3ca3-9cf1-4230-bed2-4d9996d9ed47 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:58.107921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-20df3ca3-9cf1-4230-bed2-4d9996d9ed47 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:58.117422 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-20df3ca3-9cf1-4230-bed2-4d9996d9ed47 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1314 microversion: 2.1 time: 0.516188 May 19 05:02:58.131878 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2744/5413] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:57 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:02:58.154540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-65826c10-e213-4a68-ace4-a791555050f0 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:58.163668 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-65826c10-e213-4a68-ace4-a791555050f0 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1318 microversion: 2.1 time: 0.683730 May 19 05:02:58.165966 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2670/5414] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:57 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:59.139162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba4e334a-c14b-491f-b418-b94cb49c13d6 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:59.140398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba4e334a-c14b-491f-b418-b94cb49c13d6 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:59.145327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:02:59.168139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba4e334a-c14b-491f-b418-b94cb49c13d6 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:59.171865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba4e334a-c14b-491f-b418-b94cb49c13d6 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:59.172879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba4e334a-c14b-491f-b418-b94cb49c13d6 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:59.173520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba4e334a-c14b-491f-b418-b94cb49c13d6 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:59.183521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4d5aaec-8045-403e-b43a-82dbb9f53310 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:02:59.184761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f4d5aaec-8045-403e-b43a-82dbb9f53310 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:02:59.195852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d5aaec-8045-403e-b43a-82dbb9f53310 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:59.212510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d5aaec-8045-403e-b43a-82dbb9f53310 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:59.213566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d5aaec-8045-403e-b43a-82dbb9f53310 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:59.222133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4d5aaec-8045-403e-b43a-82dbb9f53310 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:59.734636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba4e334a-c14b-491f-b418-b94cb49c13d6 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:59.742224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4d5aaec-8045-403e-b43a-82dbb9f53310 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:02:59.757883 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba4e334a-c14b-491f-b418-b94cb49c13d6 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1314 microversion: 2.1 time: 0.622678 May 19 05:02:59.773309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4d5aaec-8045-403e-b43a-82dbb9f53310 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1318 microversion: 2.1 time: 0.594316 May 19 05:02:59.778058 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2745/5415] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:59 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:02:59.781302 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2671/5416] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:02:59 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:02:59.799872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ccc276e6-588a-438c-8f4b-52c8d69955ae req-681aebc9-ea12-4160-a6b7-f86edb436265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1380e7e-23dc-4493-ab93-102290d64d10", "name": "network-vif-plugged", "status": "completed", "tag": "1c88b9a7-e11f-478b-ab99-848a0adc1eac"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:02:59.850100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ccc276e6-588a-438c-8f4b-52c8d69955ae req-681aebc9-ea12-4160-a6b7-f86edb436265 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:02:59.852270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ccc276e6-588a-438c-8f4b-52c8d69955ae req-681aebc9-ea12-4160-a6b7-f86edb436265 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:02:59.903473 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ccc276e6-588a-438c-8f4b-52c8d69955ae req-681aebc9-ea12-4160-a6b7-f86edb436265 service nova] Creating event network-vif-plugged:1c88b9a7-e11f-478b-ab99-848a0adc1eac for instance e1380e7e-23dc-4493-ab93-102290d64d10 on n-h2-766726-30 May 19 05:02:59.923511 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ccc276e6-588a-438c-8f4b-52c8d69955ae req-681aebc9-ea12-4160-a6b7-f86edb436265 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143428 May 19 05:02:59.929339 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2746/5417] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:00.348699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f832a7a7-3871-4829-b586-cad25ba30131 req-8ede1d75-6834-4b9a-bd8e-e8594a876753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4af25c8-f777-43e5-91ae-ac7cc7a1c83c", "tag": "d79e33f7-9c3b-4e46-b5b3-9f9670306689"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:03:00.377944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f832a7a7-3871-4829-b586-cad25ba30131 req-8ede1d75-6834-4b9a-bd8e-e8594a876753 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:00.384464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f832a7a7-3871-4829-b586-cad25ba30131 req-8ede1d75-6834-4b9a-bd8e-e8594a876753 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:00.404765 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f832a7a7-3871-4829-b586-cad25ba30131 req-8ede1d75-6834-4b9a-bd8e-e8594a876753 service nova] Creating event network-changed:d79e33f7-9c3b-4e46-b5b3-9f9670306689 for instance d4af25c8-f777-43e5-91ae-ac7cc7a1c83c on n-h1-766726-30 May 19 05:03:00.427862 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f832a7a7-3871-4829-b586-cad25ba30131 req-8ede1d75-6834-4b9a-bd8e-e8594a876753 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082518 May 19 05:03:00.428765 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2672/5418] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:00.788093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a097df5d-2ac7-4e83-b28b-66ebe5102c5a tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:00.789222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a097df5d-2ac7-4e83-b28b-66ebe5102c5a tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:00.798394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c638530-7b7d-42a8-9607-79ee9b067fe3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:00.799483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5c638530-7b7d-42a8-9607-79ee9b067fe3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:00.811051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c638530-7b7d-42a8-9607-79ee9b067fe3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:00.813458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a097df5d-2ac7-4e83-b28b-66ebe5102c5a tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:00.821256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c638530-7b7d-42a8-9607-79ee9b067fe3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:00.822443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c638530-7b7d-42a8-9607-79ee9b067fe3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:00.823262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a097df5d-2ac7-4e83-b28b-66ebe5102c5a tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:00.823935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5c638530-7b7d-42a8-9607-79ee9b067fe3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:00.825144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a097df5d-2ac7-4e83-b28b-66ebe5102c5a tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:00.828681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a097df5d-2ac7-4e83-b28b-66ebe5102c5a tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:01.177594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a097df5d-2ac7-4e83-b28b-66ebe5102c5a tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:01.187973 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a097df5d-2ac7-4e83-b28b-66ebe5102c5a tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1314 microversion: 2.1 time: 0.406272 May 19 05:03:01.190242 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2747/5419] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:00 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:01.321335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5c638530-7b7d-42a8-9607-79ee9b067fe3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:01.342747 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5c638530-7b7d-42a8-9607-79ee9b067fe3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1318 microversion: 2.1 time: 0.548435 May 19 05:03:01.360303 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2673/5420] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:00 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:02.211020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b9b8b193-453d-4cc3-832d-b450772cf0de tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:02.211693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b9b8b193-453d-4cc3-832d-b450772cf0de tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:02.229618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9b8b193-453d-4cc3-832d-b450772cf0de tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:02.229618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9b8b193-453d-4cc3-832d-b450772cf0de tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:02.229898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9b8b193-453d-4cc3-832d-b450772cf0de tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:02.230515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9b8b193-453d-4cc3-832d-b450772cf0de tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:02.299572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=14 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:03:02.371548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a73f4da-dde8-4794-8adb-965630cc348a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:02.372912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3a73f4da-dde8-4794-8adb-965630cc348a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:02.401895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a73f4da-dde8-4794-8adb-965630cc348a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:02.402264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a73f4da-dde8-4794-8adb-965630cc348a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:02.403055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a73f4da-dde8-4794-8adb-965630cc348a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:02.403481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a73f4da-dde8-4794-8adb-965630cc348a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:02.557680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b9b8b193-453d-4cc3-832d-b450772cf0de tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:02.565940 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b9b8b193-453d-4cc3-832d-b450772cf0de tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1499 microversion: 2.1 time: 0.357025 May 19 05:03:02.579619 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2748/5421] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:02 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1499 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:03:02.749913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3a73f4da-dde8-4794-8adb-965630cc348a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:02.759730 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a73f4da-dde8-4794-8adb-965630cc348a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1318 microversion: 2.1 time: 0.395405 May 19 05:03:02.764065 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2674/5422] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:02 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:03:03.782427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a632f0c3-06cd-4757-8e05-60d54fd5a837 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:03.783708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a632f0c3-06cd-4757-8e05-60d54fd5a837 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:03.796035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a632f0c3-06cd-4757-8e05-60d54fd5a837 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:03.802961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a632f0c3-06cd-4757-8e05-60d54fd5a837 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:03.805809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a632f0c3-06cd-4757-8e05-60d54fd5a837 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:03.807092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a632f0c3-06cd-4757-8e05-60d54fd5a837 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:04.106198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a632f0c3-06cd-4757-8e05-60d54fd5a837 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:04.118269 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a632f0c3-06cd-4757-8e05-60d54fd5a837 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1318 microversion: 2.1 time: 0.339870 May 19 05:03:04.120080 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2749/5423] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:03 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:04.244806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:04.245424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:04.260193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:04.260740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:04.261841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:04.262586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:04.300125 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] HTTP exception thrown: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Request method failure captured: May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd HTTP/1.1 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc1MYGlSCjIKY9S_BwpQUAg9JUsYSzvxqCnPYFDL3TbyzveY3prJJg2S1NYiApfITLVv5oqxbIJJ8MKQ2GJOpfx8amV3lvP96kFs4Bk7CYsHSLFIJmWIfjVjhS-thkN4LeYd8sdQw_u0M7eaCjwY0TT9wMTj9jtOUVINIhMTsYowjJc May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: def2cad1e80b4ca6873f030527b0c5c7 May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd'} May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:03:04.305932 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.310650 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:04.312435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Returning 404 to user: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:03:04.318250 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d47c84f8-443a-43d6-a76f-a37d7626bb06 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 404 len: 111 microversion: 2.1 time: 0.077341 May 19 05:03:04.319506 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2675/5424] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:03:04 2022] DELETE /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:03:04.346999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:04.348083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:04.360773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:04.361499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:04.362452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:04.363059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:04.386431 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] HTTP exception thrown: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Request method failure captured: May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd HTTP/1.1 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc1MYGlSCjIKY9S_BwpQUAg9JUsYSzvxqCnPYFDL3TbyzveY3prJJg2S1NYiApfITLVv5oqxbIJJ8MKQ2GJOpfx8amV3lvP96kFs4Bk7CYsHSLFIJmWIfjVjhS-thkN4LeYd8sdQw_u0M7eaCjwY0TT9wMTj9jtOUVINIhMTsYowjJc May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: def2cad1e80b4ca6873f030527b0c5c7 May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd'} May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:04.389551 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:04.394225 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:04.394225 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:04.394225 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:04.394225 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:03:04.394225 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:03:04.394225 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. May 19 05:03:04.394225 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:04.396207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Returning 404 to user: Instance ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:03:04.398086 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ff5ec5c-e533-4ec6-bece-9c437ea3d80e tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd" status: 404 len: 111 microversion: 2.1 time: 0.071501 May 19 05:03:04.400705 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2750/5425] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:04 2022] GET /compute/v2.1/servers/ee4f3950-f0c0-4b73-9ed9-b66e6259d1dd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:03:05.136139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a59ffc9e-b871-4b8d-bfb0-e0c8febd5b4b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:05.137013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a59ffc9e-b871-4b8d-bfb0-e0c8febd5b4b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:05.156227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a59ffc9e-b871-4b8d-bfb0-e0c8febd5b4b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:05.156918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a59ffc9e-b871-4b8d-bfb0-e0c8febd5b4b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:05.162662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a59ffc9e-b871-4b8d-bfb0-e0c8febd5b4b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:05.164332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a59ffc9e-b871-4b8d-bfb0-e0c8febd5b4b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:05.579671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a59ffc9e-b871-4b8d-bfb0-e0c8febd5b4b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:05.593752 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a59ffc9e-b871-4b8d-bfb0-e0c8febd5b4b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1318 microversion: 2.1 time: 0.458865 May 19 05:03:05.605757 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2676/5426] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:05 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:06.235682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-02ae2fee-e8ff-40bd-81ca-f2129f69b2fc req-b85b949f-d1d7-4cf6-ba7d-1ffeed13a7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4af25c8-f777-43e5-91ae-ac7cc7a1c83c", "name": "network-vif-plugged", "status": "completed", "tag": "d79e33f7-9c3b-4e46-b5b3-9f9670306689"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:03:06.280644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-02ae2fee-e8ff-40bd-81ca-f2129f69b2fc req-b85b949f-d1d7-4cf6-ba7d-1ffeed13a7a5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:06.300758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-02ae2fee-e8ff-40bd-81ca-f2129f69b2fc req-b85b949f-d1d7-4cf6-ba7d-1ffeed13a7a5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:06.331544 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-02ae2fee-e8ff-40bd-81ca-f2129f69b2fc req-b85b949f-d1d7-4cf6-ba7d-1ffeed13a7a5 service nova] Creating event network-vif-plugged:d79e33f7-9c3b-4e46-b5b3-9f9670306689 for instance d4af25c8-f777-43e5-91ae-ac7cc7a1c83c on n-h1-766726-30 May 19 05:03:06.339349 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-02ae2fee-e8ff-40bd-81ca-f2129f69b2fc req-b85b949f-d1d7-4cf6-ba7d-1ffeed13a7a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108779 May 19 05:03:06.340486 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2751/5427] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:06.611829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0787988a-52d3-441d-8bbd-5b023dfa250c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:06.612735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0787988a-52d3-441d-8bbd-5b023dfa250c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:06.627344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0787988a-52d3-441d-8bbd-5b023dfa250c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:06.629688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0787988a-52d3-441d-8bbd-5b023dfa250c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:06.636068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0787988a-52d3-441d-8bbd-5b023dfa250c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:06.636670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0787988a-52d3-441d-8bbd-5b023dfa250c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:07.238607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0787988a-52d3-441d-8bbd-5b023dfa250c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:07.253615 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0787988a-52d3-441d-8bbd-5b023dfa250c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1318 microversion: 2.1 time: 0.640186 May 19 05:03:07.256204 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2677/5428] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:06 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:08.273593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ec440f6a-1439-47cd-946e-22a2fe59e0ef tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:08.274336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ec440f6a-1439-47cd-946e-22a2fe59e0ef tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:08.287079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec440f6a-1439-47cd-946e-22a2fe59e0ef tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:08.289374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec440f6a-1439-47cd-946e-22a2fe59e0ef tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:08.290375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec440f6a-1439-47cd-946e-22a2fe59e0ef tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:08.292351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec440f6a-1439-47cd-946e-22a2fe59e0ef tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:08.369791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f9b167c6-bd06-4932-8156-7883ee31d86b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:08.370332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9b167c6-bd06-4932-8156-7883ee31d86b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:08.382578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9b167c6-bd06-4932-8156-7883ee31d86b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:08.386203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9b167c6-bd06-4932-8156-7883ee31d86b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:08.388022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9b167c6-bd06-4932-8156-7883ee31d86b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:08.389273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9b167c6-bd06-4932-8156-7883ee31d86b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:08.436468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9b167c6-bd06-4932-8156-7883ee31d86b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:03:08.666292 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f9b167c6-bd06-4932-8156-7883ee31d86b tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 204 len: 0 microversion: 2.1 time: 0.297980 May 19 05:03:08.667690 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2678/5429] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:03:08 2022] DELETE /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:03:08.685408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af67570b-5a66-4544-8ce0-efc94ac9c348 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:08.687831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af67570b-5a66-4544-8ce0-efc94ac9c348 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:08.703289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af67570b-5a66-4544-8ce0-efc94ac9c348 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:08.703773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af67570b-5a66-4544-8ce0-efc94ac9c348 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:08.704602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af67570b-5a66-4544-8ce0-efc94ac9c348 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:08.705047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af67570b-5a66-4544-8ce0-efc94ac9c348 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:09.071441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ec440f6a-1439-47cd-946e-22a2fe59e0ef tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:09.084561 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ec440f6a-1439-47cd-946e-22a2fe59e0ef tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1506 microversion: 2.1 time: 0.816669 May 19 05:03:09.085174 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2752/5430] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:08 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1506 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:09.404301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-af67570b-5a66-4544-8ce0-efc94ac9c348 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:09.414439 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af67570b-5a66-4544-8ce0-efc94ac9c348 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1505 microversion: 2.1 time: 0.735292 May 19 05:03:09.415902 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2679/5431] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:08 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1505 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:03:10.431833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a89ce616-ce16-46c8-b4dc-e59d3190d3bf tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:10.433052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a89ce616-ce16-46c8-b4dc-e59d3190d3bf tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:10.448334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a89ce616-ce16-46c8-b4dc-e59d3190d3bf tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:10.449314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a89ce616-ce16-46c8-b4dc-e59d3190d3bf tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:10.450283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a89ce616-ce16-46c8-b4dc-e59d3190d3bf tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:10.450917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a89ce616-ce16-46c8-b4dc-e59d3190d3bf tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:10.994818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-627cd26c-e2a8-4598-af19-3e4f24d83610 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:10.996761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-627cd26c-e2a8-4598-af19-3e4f24d83610 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:11.009970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-627cd26c-e2a8-4598-af19-3e4f24d83610 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:11.013156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-627cd26c-e2a8-4598-af19-3e4f24d83610 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:11.014887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-627cd26c-e2a8-4598-af19-3e4f24d83610 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:11.017469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-627cd26c-e2a8-4598-af19-3e4f24d83610 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:11.066299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a89ce616-ce16-46c8-b4dc-e59d3190d3bf tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:11.075698 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a89ce616-ce16-46c8-b4dc-e59d3190d3bf tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1505 microversion: 2.1 time: 0.647600 May 19 05:03:11.089679 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2753/5432] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:10 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1505 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:11.299183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-627cd26c-e2a8-4598-af19-3e4f24d83610 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lazy-loading 'services' on Instance uuid 8ffa6106-5902-4d87-8122-46fa440cf7d0 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:03:11.435749 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-627cd26c-e2a8-4598-af19-3e4f24d83610 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments/074aa387-e821-4e35-99b7-c6b06fa1e150" status: 202 len: 0 microversion: 2.1 time: 0.444721 May 19 05:03:11.437531 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2680/5433] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:03:10 2022] DELETE /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments/074aa387-e821-4e35-99b7-c6b06fa1e150 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:03:11.452003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa8e1383-de8b-4a20-8d7e-79016adfda02 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:11.452957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aa8e1383-de8b-4a20-8d7e-79016adfda02 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:11.469268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa8e1383-de8b-4a20-8d7e-79016adfda02 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:11.469731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa8e1383-de8b-4a20-8d7e-79016adfda02 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:11.470537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa8e1383-de8b-4a20-8d7e-79016adfda02 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:11.470984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa8e1383-de8b-4a20-8d7e-79016adfda02 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:11.531013 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa8e1383-de8b-4a20-8d7e-79016adfda02 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082928 May 19 05:03:11.536190 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2754/5434] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:11 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:12.045370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b8fdb602-b7df-467b-b709-88a0deb02444 req-f118f9a6-85ba-4a66-976f-90d3de4f66d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1380e7e-23dc-4493-ab93-102290d64d10", "name": "network-vif-deleted", "tag": "1c88b9a7-e11f-478b-ab99-848a0adc1eac"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:03:12.056661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b8fdb602-b7df-467b-b709-88a0deb02444 req-f118f9a6-85ba-4a66-976f-90d3de4f66d6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:12.057427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b8fdb602-b7df-467b-b709-88a0deb02444 req-f118f9a6-85ba-4a66-976f-90d3de4f66d6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:12.072997 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b8fdb602-b7df-467b-b709-88a0deb02444 req-f118f9a6-85ba-4a66-976f-90d3de4f66d6 service nova] Creating event network-vif-deleted:1c88b9a7-e11f-478b-ab99-848a0adc1eac for instance e1380e7e-23dc-4493-ab93-102290d64d10 on n-h2-766726-30 May 19 05:03:12.080331 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b8fdb602-b7df-467b-b709-88a0deb02444 req-f118f9a6-85ba-4a66-976f-90d3de4f66d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038954 May 19 05:03:12.083232 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2681/5435] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:12.097015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:12.098884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:12.116249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:12.118576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:12.122286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:12.134448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:12.232367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:12.234431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:12.235090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lazy-loading 'fault' on Instance uuid e1380e7e-23dc-4493-ab93-102290d64d10 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:03:12.338806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab10051a56c40d998731e09515e18c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daac089e082242389760bbb43920d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:12.353514 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7ebcd9a1-a958-43c5-9b9a-65ad70999784 tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 200 len: 1304 microversion: 2.1 time: 0.261518 May 19 05:03:12.354580 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2755/5436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:12 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 1304 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:12.543225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c8d504f-b223-4aa8-b972-88d65736417d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:12.545348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c8d504f-b223-4aa8-b972-88d65736417d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:12.565685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c8d504f-b223-4aa8-b972-88d65736417d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:12.567410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c8d504f-b223-4aa8-b972-88d65736417d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:12.569774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c8d504f-b223-4aa8-b972-88d65736417d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:12.574713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c8d504f-b223-4aa8-b972-88d65736417d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:12.650298 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c8d504f-b223-4aa8-b972-88d65736417d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111446 May 19 05:03:12.650977 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2682/5437] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:12 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:13.370687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:13.371869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] [instance: e1380e7e-23dc-4493-ab93-102290d64d10] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:13.386700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:13.387299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:13.388326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:13.388915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:13.434238 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] HTTP exception thrown: Instance e1380e7e-23dc-4493-ab93-102290d64d10 could not be found. May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Request method failure captured: May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 HTTP/1.1 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc9vhGuobkWt4BuxaTrizKrrN5EPE6CmSBvdACZ1W5yH9SKcbJ6aRKvblp2Lczk_hfvdkmy_0RxsZWztwR_-X9hb2zh37-ox9rLhFhpQsDbZeXZa4i_4tWzIVK-tcr_Qo2r8vAZXrr7KoyxuISqnhqzGPSiPqgR9-gKn3f8xIfqVoMY May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: daac089e082242389760bbb43920d258 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesActionsTest-2118871023 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/daac089e082242389760bbb43920d258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/daac089e082242389760bbb43920d258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/daac089e082242389760bbb43920d258"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_daac089e082242389760bbb43920d258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesActionsTest-2118871023 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: daac089e082242389760bbb43920d258 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesActionsTest-2118871023 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesActionsTest-2118871023-project May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: bab10051a56c40d998731e09515e18c9 May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesActionsTest-2118871023-project May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance e1380e7e-23dc-4493-ab93-102290d64d10 could not be found. May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'e1380e7e-23dc-4493-ab93-102290d64d10'} May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1380e7e-23dc-4493-ab93-102290d64d10 could not be found. May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1380e7e-23dc-4493-ab93-102290d64d10 could not be found. May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:13.436321 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:13.441428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:13.441428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:13.441428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:13.441428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:03:13.441428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:03:13.441428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1380e7e-23dc-4493-ab93-102290d64d10 could not be found. May 19 05:03:13.441428 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:13.443653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] Returning 404 to user: Instance e1380e7e-23dc-4493-ab93-102290d64d10 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:03:13.444687 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-64fa258d-52c0-4149-8969-177d58f523eb tempest-VolumesActionsTest-2118871023 tempest-VolumesActionsTest-2118871023-project] 10.222.0.58 "GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10" status: 404 len: 111 microversion: 2.1 time: 0.077873 May 19 05:03:13.447197 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2756/5438] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:13 2022] GET /compute/v2.1/servers/e1380e7e-23dc-4493-ab93-102290d64d10 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:03:13.665438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cacfe99d-4745-48fd-81c9-2cb17be41d7e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:13.666402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cacfe99d-4745-48fd-81c9-2cb17be41d7e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:13.681801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cacfe99d-4745-48fd-81c9-2cb17be41d7e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:13.682270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cacfe99d-4745-48fd-81c9-2cb17be41d7e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:13.683062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cacfe99d-4745-48fd-81c9-2cb17be41d7e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:13.687390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cacfe99d-4745-48fd-81c9-2cb17be41d7e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:13.762998 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cacfe99d-4745-48fd-81c9-2cb17be41d7e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102903 May 19 05:03:13.764602 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2683/5439] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:13 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:03:14.775429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1fbd88b1-79ca-45f6-8d03-b04245d78d16 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:14.776357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1fbd88b1-79ca-45f6-8d03-b04245d78d16 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:14.805920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fbd88b1-79ca-45f6-8d03-b04245d78d16 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:14.806403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fbd88b1-79ca-45f6-8d03-b04245d78d16 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:14.807221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fbd88b1-79ca-45f6-8d03-b04245d78d16 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:14.809018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fbd88b1-79ca-45f6-8d03-b04245d78d16 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:14.885350 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1fbd88b1-79ca-45f6-8d03-b04245d78d16 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113721 May 19 05:03:14.892737 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2757/5440] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:14 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:15.777719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:15.778364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:15.804895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:15.805768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:15.807518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:15.815517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:15.858996 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] HTTP exception thrown: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Request method failure captured: May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb HTTP/1.1 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc1MYGlSCjIKY9S_BwpQUAg9JUsYSzvxqCnPYFDL3TbyzveY3prJJg2S1NYiApfITLVv5oqxbIJJ8MKQ2GJOpfx8amV3lvP96kFs4Bk7CYsHSLFIJmWIfjVjhS-thkN4LeYd8sdQw_u0M7eaCjwY0TT9wMTj9jtOUVINIhMTsYowjJc May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: def2cad1e80b4ca6873f030527b0c5c7 May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b0c54667-4cff-44ff-bf2d-776532b44bbb'} May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:03:15.860899 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.865876 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:15.866696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Returning 404 to user: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:03:15.867679 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4dc6cc9-a4a0-4094-8052-87696cb53920 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 404 len: 111 microversion: 2.1 time: 0.093873 May 19 05:03:15.871886 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2684/5441] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:03:15 2022] DELETE /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:03:15.880857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:15.881497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] [instance: b0c54667-4cff-44ff-bf2d-776532b44bbb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:15.901326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:15.901634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f9d8a4a2-4605-4bfb-8ef6-4b8df34fabbe tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:15.902830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9d8a4a2-4605-4bfb-8ef6-4b8df34fabbe tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:15.913251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:15.914088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:15.914535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:15.915850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9d8a4a2-4605-4bfb-8ef6-4b8df34fabbe tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:15.923232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9d8a4a2-4605-4bfb-8ef6-4b8df34fabbe tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:15.924297 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9d8a4a2-4605-4bfb-8ef6-4b8df34fabbe tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:15.924856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9d8a4a2-4605-4bfb-8ef6-4b8df34fabbe tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:15.961203 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] HTTP exception thrown: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Request method failure captured: May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb HTTP/1.1 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc1MYGlSCjIKY9S_BwpQUAg9JUsYSzvxqCnPYFDL3TbyzveY3prJJg2S1NYiApfITLVv5oqxbIJJ8MKQ2GJOpfx8amV3lvP96kFs4Bk7CYsHSLFIJmWIfjVjhS-thkN4LeYd8sdQw_u0M7eaCjwY0TT9wMTj9jtOUVINIhMTsYowjJc May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7d15dedbc0c4eeb97a0d88d664b5818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: e7d15dedbc0c4eeb97a0d88d664b5818 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1836870491 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: def2cad1e80b4ca6873f030527b0c5c7 May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-AttachVolumeTestJSON-1836870491-project May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'b0c54667-4cff-44ff-bf2d-776532b44bbb'} May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:15.969126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:15.974362 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:15.974362 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:15.974362 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:15.974362 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:03:15.974362 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:03:15.974362 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. May 19 05:03:15.974362 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:15.976771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] Returning 404 to user: Instance b0c54667-4cff-44ff-bf2d-776532b44bbb could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:03:15.977867 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-84a09206-31f0-40db-a3b1-90bc28055593 tempest-AttachVolumeTestJSON-1836870491 tempest-AttachVolumeTestJSON-1836870491-project] 10.222.0.58 "GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb" status: 404 len: 111 microversion: 2.1 time: 0.101683 May 19 05:03:15.981226 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2758/5442] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:15 2022] GET /compute/v2.1/servers/b0c54667-4cff-44ff-bf2d-776532b44bbb => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:03:15.995827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:03:16.019871 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f9d8a4a2-4605-4bfb-8ef6-4b8df34fabbe tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122200 May 19 05:03:16.024070 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2685/5443] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:15 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:03:17.032501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b83c56cb-d938-4024-8a80-e28ef4d05c58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:17.033669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b83c56cb-d938-4024-8a80-e28ef4d05c58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:17.044351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b83c56cb-d938-4024-8a80-e28ef4d05c58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:17.048415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b83c56cb-d938-4024-8a80-e28ef4d05c58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:17.055895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b83c56cb-d938-4024-8a80-e28ef4d05c58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:17.056581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b83c56cb-d938-4024-8a80-e28ef4d05c58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:17.115745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=90 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:03:17.140305 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b83c56cb-d938-4024-8a80-e28ef4d05c58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112127 May 19 05:03:17.145046 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2759/5444] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:17 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:18.158695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fc7daae2-1248-41d2-afb2-b8b766205995 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:18.162647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fc7daae2-1248-41d2-afb2-b8b766205995 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:18.195165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc7daae2-1248-41d2-afb2-b8b766205995 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:18.203606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc7daae2-1248-41d2-afb2-b8b766205995 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:18.210304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc7daae2-1248-41d2-afb2-b8b766205995 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:18.216515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fc7daae2-1248-41d2-afb2-b8b766205995 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:18.354986 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fc7daae2-1248-41d2-afb2-b8b766205995 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203281 May 19 05:03:18.362778 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2686/5445] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:18 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:19.373467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-87652bb1-75e8-4216-a1ba-9898e6acbcfb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:19.375270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-87652bb1-75e8-4216-a1ba-9898e6acbcfb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:19.398916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87652bb1-75e8-4216-a1ba-9898e6acbcfb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:19.399604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87652bb1-75e8-4216-a1ba-9898e6acbcfb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:19.401256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87652bb1-75e8-4216-a1ba-9898e6acbcfb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:19.404033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87652bb1-75e8-4216-a1ba-9898e6acbcfb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:19.476902 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-87652bb1-75e8-4216-a1ba-9898e6acbcfb tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107390 May 19 05:03:19.478279 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2760/5446] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:19 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:20.490166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c96cd3f-866d-4372-8ee5-d038d2ddb153 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:20.493486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c96cd3f-866d-4372-8ee5-d038d2ddb153 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:20.519195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c96cd3f-866d-4372-8ee5-d038d2ddb153 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:20.520533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c96cd3f-866d-4372-8ee5-d038d2ddb153 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:20.521635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c96cd3f-866d-4372-8ee5-d038d2ddb153 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:20.522288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c96cd3f-866d-4372-8ee5-d038d2ddb153 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:20.605832 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c96cd3f-866d-4372-8ee5-d038d2ddb153 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120477 May 19 05:03:20.611093 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2687/5447] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:20 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:21.622451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e62638e2-3603-4fdd-a611-0257941b2d61 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:21.623401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e62638e2-3603-4fdd-a611-0257941b2d61 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:21.635351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e62638e2-3603-4fdd-a611-0257941b2d61 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:21.636085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e62638e2-3603-4fdd-a611-0257941b2d61 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:21.637878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e62638e2-3603-4fdd-a611-0257941b2d61 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:21.640279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e62638e2-3603-4fdd-a611-0257941b2d61 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:21.710372 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e62638e2-3603-4fdd-a611-0257941b2d61 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092165 May 19 05:03:21.717821 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2761/5448] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:21 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:22.732287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8d38a86b-50ec-4104-b1fe-9366a1916f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:22.735469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8d38a86b-50ec-4104-b1fe-9366a1916f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:22.755941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d38a86b-50ec-4104-b1fe-9366a1916f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:22.756759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d38a86b-50ec-4104-b1fe-9366a1916f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:22.757961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d38a86b-50ec-4104-b1fe-9366a1916f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:22.758629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8d38a86b-50ec-4104-b1fe-9366a1916f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:22.836994 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8d38a86b-50ec-4104-b1fe-9366a1916f76 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111826 May 19 05:03:22.838089 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2688/5449] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:22 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:23.852612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b694c5cd-4334-49d3-b608-f2fe340ff064 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:23.854257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b694c5cd-4334-49d3-b608-f2fe340ff064 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:23.873244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=42 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:03:23.877728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b694c5cd-4334-49d3-b608-f2fe340ff064 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:23.878719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b694c5cd-4334-49d3-b608-f2fe340ff064 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:23.882341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b694c5cd-4334-49d3-b608-f2fe340ff064 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:23.884568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b694c5cd-4334-49d3-b608-f2fe340ff064 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:23.974826 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b694c5cd-4334-49d3-b608-f2fe340ff064 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127363 May 19 05:03:23.981263 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2762/5450] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:23 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:24.987506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48433455-a742-4f3a-97a4-180430f16648 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:24.990518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-48433455-a742-4f3a-97a4-180430f16648 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:25.009043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:03:25.020789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48433455-a742-4f3a-97a4-180430f16648 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:25.023379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48433455-a742-4f3a-97a4-180430f16648 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:25.025303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48433455-a742-4f3a-97a4-180430f16648 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:25.026839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48433455-a742-4f3a-97a4-180430f16648 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:25.170422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-48433455-a742-4f3a-97a4-180430f16648 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187179 May 19 05:03:25.183589 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2689/5451] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:24 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:26.186942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-70bb91a8-c478-40af-9b5d-0034fb92feac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:26.192827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-70bb91a8-c478-40af-9b5d-0034fb92feac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:26.218189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70bb91a8-c478-40af-9b5d-0034fb92feac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:26.219429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70bb91a8-c478-40af-9b5d-0034fb92feac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:26.226270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70bb91a8-c478-40af-9b5d-0034fb92feac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:26.227306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70bb91a8-c478-40af-9b5d-0034fb92feac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:26.318692 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-70bb91a8-c478-40af-9b5d-0034fb92feac tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135776 May 19 05:03:26.319845 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2763/5452] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:26 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:27.332441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-113d2677-45db-400c-bb47-171eb966b581 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:27.336052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-113d2677-45db-400c-bb47-171eb966b581 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:27.363712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-113d2677-45db-400c-bb47-171eb966b581 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:27.375894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-113d2677-45db-400c-bb47-171eb966b581 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:27.381670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-113d2677-45db-400c-bb47-171eb966b581 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:27.390084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-113d2677-45db-400c-bb47-171eb966b581 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:27.507007 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-113d2677-45db-400c-bb47-171eb966b581 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179848 May 19 05:03:27.515088 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2690/5453] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:27 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:28.526404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-78be5329-f642-4577-b94e-a183a57bd023 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:28.527384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-78be5329-f642-4577-b94e-a183a57bd023 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:28.561778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78be5329-f642-4577-b94e-a183a57bd023 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:28.563348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78be5329-f642-4577-b94e-a183a57bd023 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:28.567081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78be5329-f642-4577-b94e-a183a57bd023 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:28.574632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-78be5329-f642-4577-b94e-a183a57bd023 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:28.731342 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-78be5329-f642-4577-b94e-a183a57bd023 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211208 May 19 05:03:28.731954 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2764/5454] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:28 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:03:29.744734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a20a27ae-0180-442b-80cb-d449c0759709 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:29.745935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a20a27ae-0180-442b-80cb-d449c0759709 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:29.763289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a20a27ae-0180-442b-80cb-d449c0759709 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:29.773578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a20a27ae-0180-442b-80cb-d449c0759709 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:29.774709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a20a27ae-0180-442b-80cb-d449c0759709 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:29.779025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a20a27ae-0180-442b-80cb-d449c0759709 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:29.937945 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a20a27ae-0180-442b-80cb-d449c0759709 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198102 May 19 05:03:29.947726 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2691/5455] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:29 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:30.960331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43fd7993-110b-4b29-9d77-c1707ad77fc2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:30.962011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43fd7993-110b-4b29-9d77-c1707ad77fc2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:30.981942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43fd7993-110b-4b29-9d77-c1707ad77fc2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:30.985895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43fd7993-110b-4b29-9d77-c1707ad77fc2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:30.990104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43fd7993-110b-4b29-9d77-c1707ad77fc2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:30.991093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43fd7993-110b-4b29-9d77-c1707ad77fc2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:31.085521 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43fd7993-110b-4b29-9d77-c1707ad77fc2 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129970 May 19 05:03:31.093517 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2765/5456] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:30 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:32.106574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7514740e-fabe-40f6-b751-a4263afcde5b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:32.107567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7514740e-fabe-40f6-b751-a4263afcde5b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:32.138791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7514740e-fabe-40f6-b751-a4263afcde5b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:32.139256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7514740e-fabe-40f6-b751-a4263afcde5b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:32.140064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7514740e-fabe-40f6-b751-a4263afcde5b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:32.145092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7514740e-fabe-40f6-b751-a4263afcde5b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:32.260186 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7514740e-fabe-40f6-b751-a4263afcde5b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164433 May 19 05:03:32.264232 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2692/5457] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:32 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:03:33.275218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-54c7d06a-db16-4033-b335-236f2b958f2d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:33.276173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-54c7d06a-db16-4033-b335-236f2b958f2d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:33.294227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54c7d06a-db16-4033-b335-236f2b958f2d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:33.297867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54c7d06a-db16-4033-b335-236f2b958f2d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:33.298927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54c7d06a-db16-4033-b335-236f2b958f2d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:33.301361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54c7d06a-db16-4033-b335-236f2b958f2d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:33.424455 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-54c7d06a-db16-4033-b335-236f2b958f2d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153574 May 19 05:03:33.425657 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2766/5458] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:33 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:35.175248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-73a4eb5c-6a17-4f67-b82e-fc09f5ff12c1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:35.181049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-73a4eb5c-6a17-4f67-b82e-fc09f5ff12c1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:35.202965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73a4eb5c-6a17-4f67-b82e-fc09f5ff12c1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:35.210769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73a4eb5c-6a17-4f67-b82e-fc09f5ff12c1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:35.210769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73a4eb5c-6a17-4f67-b82e-fc09f5ff12c1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:35.217872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73a4eb5c-6a17-4f67-b82e-fc09f5ff12c1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:35.388560 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-73a4eb5c-6a17-4f67-b82e-fc09f5ff12c1 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.953567 May 19 05:03:35.390991 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2693/5459] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:34 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:36.405042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed1c27b2-53ef-45c7-a7bc-cd5b998d2853 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:36.406783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ed1c27b2-53ef-45c7-a7bc-cd5b998d2853 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:36.426080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed1c27b2-53ef-45c7-a7bc-cd5b998d2853 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:36.428198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed1c27b2-53ef-45c7-a7bc-cd5b998d2853 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:36.432219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed1c27b2-53ef-45c7-a7bc-cd5b998d2853 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:36.433554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed1c27b2-53ef-45c7-a7bc-cd5b998d2853 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:36.529149 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ed1c27b2-53ef-45c7-a7bc-cd5b998d2853 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129637 May 19 05:03:36.531918 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2767/5460] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:36 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:37.541040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-18df6467-2143-49a9-88c7-058f3d72d669 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:37.541941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-18df6467-2143-49a9-88c7-058f3d72d669 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:37.565120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18df6467-2143-49a9-88c7-058f3d72d669 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:37.566196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18df6467-2143-49a9-88c7-058f3d72d669 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:37.567063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18df6467-2143-49a9-88c7-058f3d72d669 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:37.567518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-18df6467-2143-49a9-88c7-058f3d72d669 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:37.677049 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-18df6467-2143-49a9-88c7-058f3d72d669 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140376 May 19 05:03:37.687967 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2694/5461] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:37 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:38.696677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8093a715-a1b5-4445-8acb-3b4eeff09793 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:38.699800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8093a715-a1b5-4445-8acb-3b4eeff09793 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:38.712721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8093a715-a1b5-4445-8acb-3b4eeff09793 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:38.713194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8093a715-a1b5-4445-8acb-3b4eeff09793 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:38.717392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8093a715-a1b5-4445-8acb-3b4eeff09793 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:38.720638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8093a715-a1b5-4445-8acb-3b4eeff09793 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:38.803652 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8093a715-a1b5-4445-8acb-3b4eeff09793 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118388 May 19 05:03:38.807476 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2768/5462] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:38 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:39.824514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e3a13a3f-9721-453d-b674-cc78cb2bb819 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:39.826474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e3a13a3f-9721-453d-b674-cc78cb2bb819 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:39.862543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3a13a3f-9721-453d-b674-cc78cb2bb819 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:39.863725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3a13a3f-9721-453d-b674-cc78cb2bb819 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:39.866399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3a13a3f-9721-453d-b674-cc78cb2bb819 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:39.866867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3a13a3f-9721-453d-b674-cc78cb2bb819 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:39.955421 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e3a13a3f-9721-453d-b674-cc78cb2bb819 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140345 May 19 05:03:39.956061 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2695/5463] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:39 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:40.969797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-640cdc45-167b-45e0-a380-cb0d7caeecfc tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:40.972416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-640cdc45-167b-45e0-a380-cb0d7caeecfc tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:40.990172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-640cdc45-167b-45e0-a380-cb0d7caeecfc tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:40.990988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-640cdc45-167b-45e0-a380-cb0d7caeecfc tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:40.992040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-640cdc45-167b-45e0-a380-cb0d7caeecfc tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:40.992681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-640cdc45-167b-45e0-a380-cb0d7caeecfc tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:41.062867 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-640cdc45-167b-45e0-a380-cb0d7caeecfc tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098620 May 19 05:03:41.068762 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2769/5464] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:40 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:42.077063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf4594c7-6b67-4a67-b843-52b1a272bcaa tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:42.078062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf4594c7-6b67-4a67-b843-52b1a272bcaa tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:42.103720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf4594c7-6b67-4a67-b843-52b1a272bcaa tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:42.103720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf4594c7-6b67-4a67-b843-52b1a272bcaa tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:42.103720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf4594c7-6b67-4a67-b843-52b1a272bcaa tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:42.104136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf4594c7-6b67-4a67-b843-52b1a272bcaa tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:42.174028 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf4594c7-6b67-4a67-b843-52b1a272bcaa tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101890 May 19 05:03:42.179518 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2696/5465] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:42 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:43.191711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bdd680c-5698-4b40-b22c-dd1976bf01ea tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:43.194005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4bdd680c-5698-4b40-b22c-dd1976bf01ea tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:43.206207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdd680c-5698-4b40-b22c-dd1976bf01ea tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:43.211450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdd680c-5698-4b40-b22c-dd1976bf01ea tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:43.217695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdd680c-5698-4b40-b22c-dd1976bf01ea tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:43.218395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bdd680c-5698-4b40-b22c-dd1976bf01ea tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:43.362116 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4bdd680c-5698-4b40-b22c-dd1976bf01ea tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179225 May 19 05:03:43.362732 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2770/5466] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:43 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:44.376417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-168b410e-a50c-4922-aab1-b5ad04faac58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:44.377476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-168b410e-a50c-4922-aab1-b5ad04faac58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:44.404696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-168b410e-a50c-4922-aab1-b5ad04faac58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:44.409584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-168b410e-a50c-4922-aab1-b5ad04faac58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:44.410481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-168b410e-a50c-4922-aab1-b5ad04faac58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:44.410945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-168b410e-a50c-4922-aab1-b5ad04faac58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:44.521187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-168b410e-a50c-4922-aab1-b5ad04faac58 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150983 May 19 05:03:44.528191 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2697/5467] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:44 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:03:45.535887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d57ee297-05d4-4d66-80d4-904bf7bff91e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:45.536835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d57ee297-05d4-4d66-80d4-904bf7bff91e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:45.551183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d57ee297-05d4-4d66-80d4-904bf7bff91e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:45.562606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d57ee297-05d4-4d66-80d4-904bf7bff91e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:45.563702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d57ee297-05d4-4d66-80d4-904bf7bff91e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:45.564313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d57ee297-05d4-4d66-80d4-904bf7bff91e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:45.666580 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d57ee297-05d4-4d66-80d4-904bf7bff91e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134004 May 19 05:03:45.667222 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2771/5468] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:45 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:03:46.679654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-186fb1e6-d26a-4473-b7bf-fc3ce3ba671b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:46.680604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-186fb1e6-d26a-4473-b7bf-fc3ce3ba671b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:46.708759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-186fb1e6-d26a-4473-b7bf-fc3ce3ba671b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:46.709451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-186fb1e6-d26a-4473-b7bf-fc3ce3ba671b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:46.710284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-186fb1e6-d26a-4473-b7bf-fc3ce3ba671b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:46.710734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-186fb1e6-d26a-4473-b7bf-fc3ce3ba671b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:46.869587 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-186fb1e6-d26a-4473-b7bf-fc3ce3ba671b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.175906 May 19 05:03:46.874040 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2698/5469] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:03:46 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0/os-volume_attachments => generated 25 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 05:03:47.120714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:03:47.122424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:47.150373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:47.151170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:47.153936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:47.160618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:47.185503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=78 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:03:47.243288 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] HTTP exception thrown: Cannot 'reboot' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Request method failure captured: May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509/action HTTP/1.1 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 28 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc552hVIo4gddG1TsyjmdiR4FI-JaQWAI2htXnFCrEGDKOYsH4E1XezkrXoYbLKVx2oQ0SvwM5ir8T3Pst5EgfSG9x1mXTMB6grf-HgGlu6N1XdfyruY3CowYDE4FL4j4mU5LfyG9tECTRcDp-giFDz68AbxVhmT6rWj0Yst-Jw0c2o May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 0e75fb6c77b44c22b95693d01448e3d2 May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: {"reboot": {"type": "HARD"}} May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: exception: Cannot 'reboot' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'bd9ce50f-6f23-448f-ae78-8ed9778f4509', 'body': {'reboot': {'type': 'HARD'}}} May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1038, in _action_reboot May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1042, in _action_reboot May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 05:03:47.246740 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued May 19 05:03:47.250485 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:47.257067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Returning 409 to user: Cannot 'reboot' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:03:47.258244 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0c890605-a3d3-43ad-aff0-8ae800a1cff0 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509/action" status: 409 len: 145 microversion: 2.1 time: 0.142443 May 19 05:03:47.264343 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2772/5470] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:03:47 2022] POST /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509/action => generated 145 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 05:03:47.274030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:03:47.275907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:47.296600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:47.297568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:47.298724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:47.299426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:47.403119 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] HTTP exception thrown: Cannot 'rebuild' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Request method failure captured: May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509/action HTTP/1.1 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 65 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc552hVIo4gddG1TsyjmdiR4FI-JaQWAI2htXnFCrEGDKOYsH4E1XezkrXoYbLKVx2oQ0SvwM5ir8T3Pst5EgfSG9x1mXTMB6grf-HgGlu6N1XdfyruY3CowYDE4FL4j4mU5LfyG9tECTRcDp-giFDz68AbxVhmT6rWj0Yst-Jw0c2o May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 0e75fb6c77b44c22b95693d01448e3d2 May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: exception: Cannot 'rebuild' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'bd9ce50f-6f23-448f-ae78-8ed9778f4509', 'body': {'rebuild': {'imageRef': 'a784e77f-4241-416d-b5b0-40834f7e24eb'}}} May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1222, in _action_rebuild May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 in vm_state rescued. Cannot rebuild while the instance is in this state. May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:03:47.406999 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1230, in _action_rebuild May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued May 19 05:03:47.411437 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:03:47.413761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Returning 409 to user: Cannot 'rebuild' instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 while it is in vm_state rescued {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:03:47.415904 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eb9559d5-a22b-439f-8d28-1f5c8380d9af tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "POST /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509/action" status: 409 len: 146 microversion: 2.1 time: 0.145977 May 19 05:03:47.418061 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2699/5471] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:03:47 2022] POST /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509/action => generated 146 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 05:03:47.427336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f125b8b9-4312-4eb5-94eb-7a6de791802a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:47.427956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f125b8b9-4312-4eb5-94eb-7a6de791802a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:47.437852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f125b8b9-4312-4eb5-94eb-7a6de791802a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:47.439452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f125b8b9-4312-4eb5-94eb-7a6de791802a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:47.443462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f125b8b9-4312-4eb5-94eb-7a6de791802a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:47.447470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f125b8b9-4312-4eb5-94eb-7a6de791802a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:47.521804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f125b8b9-4312-4eb5-94eb-7a6de791802a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:03:47.759454 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f125b8b9-4312-4eb5-94eb-7a6de791802a tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 204 len: 0 microversion: 2.1 time: 0.336038 May 19 05:03:47.765468 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2773/5472] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:03:47 2022] DELETE /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:03:47.773552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e38c1245-8ce9-434f-8e9c-65e57d274da5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:47.774489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e38c1245-8ce9-434f-8e9c-65e57d274da5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:47.784729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e38c1245-8ce9-434f-8e9c-65e57d274da5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:47.792633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e38c1245-8ce9-434f-8e9c-65e57d274da5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:47.793683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e38c1245-8ce9-434f-8e9c-65e57d274da5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:47.798410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e38c1245-8ce9-434f-8e9c-65e57d274da5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:48.205650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e38c1245-8ce9-434f-8e9c-65e57d274da5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:48.215440 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e38c1245-8ce9-434f-8e9c-65e57d274da5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1689 microversion: 2.1 time: 0.446014 May 19 05:03:48.241407 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2700/5473] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:47 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1689 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:49.257335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3dbc30b3-ba34-4ef1-b7a6-7bdc985a469d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:49.263352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3dbc30b3-ba34-4ef1-b7a6-7bdc985a469d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:49.303222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3dbc30b3-ba34-4ef1-b7a6-7bdc985a469d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:49.303690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3dbc30b3-ba34-4ef1-b7a6-7bdc985a469d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:49.304481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3dbc30b3-ba34-4ef1-b7a6-7bdc985a469d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:49.304927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3dbc30b3-ba34-4ef1-b7a6-7bdc985a469d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:50.395859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3dbc30b3-ba34-4ef1-b7a6-7bdc985a469d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:50.406626 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3dbc30b3-ba34-4ef1-b7a6-7bdc985a469d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1689 microversion: 2.1 time: 1.153997 May 19 05:03:50.407219 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2774/5474] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:49 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1689 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:51.424233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee1c938b-2878-4301-824a-0540689b075e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:51.424970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee1c938b-2878-4301-824a-0540689b075e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:51.448838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee1c938b-2878-4301-824a-0540689b075e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:51.449588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee1c938b-2878-4301-824a-0540689b075e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:51.450508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee1c938b-2878-4301-824a-0540689b075e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:51.451458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee1c938b-2878-4301-824a-0540689b075e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:51.544698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=94 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:03:52.157449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ee1c938b-2878-4301-824a-0540689b075e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:52.190777 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee1c938b-2878-4301-824a-0540689b075e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1689 microversion: 2.1 time: 0.763907 May 19 05:03:52.199339 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2701/5475] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:51 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1689 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:53.214862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca356aa4-06eb-49b6-88a2-21377aff92d8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:53.215481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca356aa4-06eb-49b6-88a2-21377aff92d8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:53.234581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca356aa4-06eb-49b6-88a2-21377aff92d8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:53.235048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca356aa4-06eb-49b6-88a2-21377aff92d8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:53.235845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca356aa4-06eb-49b6-88a2-21377aff92d8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:53.236290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca356aa4-06eb-49b6-88a2-21377aff92d8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:53.547960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ca356aa4-06eb-49b6-88a2-21377aff92d8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:53.566238 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ca356aa4-06eb-49b6-88a2-21377aff92d8 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1621 microversion: 2.1 time: 0.355167 May 19 05:03:53.566851 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2775/5476] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:53 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1621 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:54.583698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f7610d09-0652-423a-b979-670ec71d3e49 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:54.584992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f7610d09-0652-423a-b979-670ec71d3e49 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:54.600466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7610d09-0652-423a-b979-670ec71d3e49 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:54.601207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7610d09-0652-423a-b979-670ec71d3e49 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:54.603895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7610d09-0652-423a-b979-670ec71d3e49 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:54.605110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7610d09-0652-423a-b979-670ec71d3e49 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:54.786735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f7610d09-0652-423a-b979-670ec71d3e49 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:54.795202 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f7610d09-0652-423a-b979-670ec71d3e49 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1621 microversion: 2.1 time: 0.215880 May 19 05:03:54.805258 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2702/5477] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:54 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1621 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:55.824488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6e2ebeb-4eae-4396-b601-74cb0c8487dd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:55.825122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6e2ebeb-4eae-4396-b601-74cb0c8487dd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:55.828799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:03:55.853939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6e2ebeb-4eae-4396-b601-74cb0c8487dd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:55.857388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6e2ebeb-4eae-4396-b601-74cb0c8487dd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:55.862878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6e2ebeb-4eae-4396-b601-74cb0c8487dd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:55.864276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6e2ebeb-4eae-4396-b601-74cb0c8487dd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:56.188567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e6e2ebeb-4eae-4396-b601-74cb0c8487dd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:03:56.212039 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6e2ebeb-4eae-4396-b601-74cb0c8487dd tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 200 len: 1621 microversion: 2.1 time: 0.393100 May 19 05:03:56.223153 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2776/5478] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:55 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 1621 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:03:56.494194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2daef536-b7e4-49e3-bacc-60f9d5c3ac92 req-37eee76d-0fff-4cd7-9396-558fd7314393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ffa6106-5902-4d87-8122-46fa440cf7d0", "name": "network-vif-deleted", "tag": "f00d4861-60ae-4c13-b353-46467a43e631"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:03:56.500014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=28 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:03:56.525829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2daef536-b7e4-49e3-bacc-60f9d5c3ac92 req-37eee76d-0fff-4cd7-9396-558fd7314393 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:56.527504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2daef536-b7e4-49e3-bacc-60f9d5c3ac92 req-37eee76d-0fff-4cd7-9396-558fd7314393 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:56.599143 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2daef536-b7e4-49e3-bacc-60f9d5c3ac92 req-37eee76d-0fff-4cd7-9396-558fd7314393 service nova] Creating event network-vif-deleted:f00d4861-60ae-4c13-b353-46467a43e631 for instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 on n-h1-766726-30 May 19 05:03:56.619085 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2daef536-b7e4-49e3-bacc-60f9d5c3ac92 req-37eee76d-0fff-4cd7-9396-558fd7314393 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.605306 May 19 05:03:56.624230 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2703/5479] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:03:57.237382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:57.238016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: 8ffa6106-5902-4d87-8122-46fa440cf7d0] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:03:57.261881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:57.262431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:57.263283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:03:57.263733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:03:57.313023 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] HTTP exception thrown: Instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 could not be found. May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Request method failure captured: May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 HTTP/1.1 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc552hVIo4gddG1TsyjmdiR4FI-JaQWAI2htXnFCrEGDKOYsH4E1XezkrXoYbLKVx2oQ0SvwM5ir8T3Pst5EgfSG9x1mXTMB6grf-HgGlu6N1XdfyruY3CowYDE4FL4j4mU5LfyG9tECTRcDp-giFDz68AbxVhmT6rWj0Yst-Jw0c2o May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 0e75fb6c77b44c22b95693d01448e3d2 May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 could not be found. May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '8ffa6106-5902-4d87-8122-46fa440cf7d0'} May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 could not be found. May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 could not be found. May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:03:57.315463 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:57.320040 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:03:57.320040 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:03:57.320040 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:03:57.320040 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:03:57.320040 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:03:57.320040 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 could not be found. May 19 05:03:57.320040 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:03:57.333069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Returning 404 to user: Instance 8ffa6106-5902-4d87-8122-46fa440cf7d0 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:03:57.334342 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f46c06c1-5a48-45e0-b84f-267578b1bb81 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0" status: 404 len: 111 microversion: 2.1 time: 0.100926 May 19 05:03:57.335403 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2777/5480] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:03:57 2022] GET /compute/v2.1/servers/8ffa6106-5902-4d87-8122-46fa440cf7d0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:03:57.344064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3000533f-f4d5-4e3e-9523-0c83af1c78b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '.version_select at 0x7fd314435280>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:03:57.417411 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3000533f-f4d5-4e3e-9523-0c83af1c78b9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522962942" status: 202 len: 0 microversion: 2.1 time: 0.077387 May 19 05:03:57.422118 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2704/5481] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 19 05:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522962942 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:04:05.724728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd27a442-f56f-4a21-99f0-5f56e0837af1 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b23cccd-52b1-4b97-9807-d58bddaaa87a", "device": "/dev/sdb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:04:05.726799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bd27a442-f56f-4a21-99f0-5f56e0837af1 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:05.757219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd27a442-f56f-4a21-99f0-5f56e0837af1 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:05.759600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd27a442-f56f-4a21-99f0-5f56e0837af1 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:05.763974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd27a442-f56f-4a21-99f0-5f56e0837af1 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:05.766102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd27a442-f56f-4a21-99f0-5f56e0837af1 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:06.324925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bd27a442-f56f-4a21-99f0-5f56e0837af1 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "POST /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615002 May 19 05:04:06.326239 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2778/5482] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 05:04:05 2022] POST /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c/os-volume_attachments => generated 194 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:04:25.728676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=13 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:04:25.730029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:04:25.743030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-449c9b7d-fedb-42bd-a188-1d3fab07cce5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:25.743030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-449c9b7d-fedb-42bd-a188-1d3fab07cce5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:25.748950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-449c9b7d-fedb-42bd-a188-1d3fab07cce5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:25.757932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-449c9b7d-fedb-42bd-a188-1d3fab07cce5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:25.758814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-449c9b7d-fedb-42bd-a188-1d3fab07cce5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:25.759273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-449c9b7d-fedb-42bd-a188-1d3fab07cce5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:25.830796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-449c9b7d-fedb-42bd-a188-1d3fab07cce5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:04:25.962421 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-449c9b7d-fedb-42bd-a188-1d3fab07cce5 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 204 len: 0 microversion: 2.1 time: 0.235420 May 19 05:04:25.963636 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2705/5483] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:04:25 2022] DELETE /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:04:25.970146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=5 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:04:25.970981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:04:25.975795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-69350fd8-80e9-4d01-b8da-7c69e605944b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:25.982680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-69350fd8-80e9-4d01-b8da-7c69e605944b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:26.025725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69350fd8-80e9-4d01-b8da-7c69e605944b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:26.026188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69350fd8-80e9-4d01-b8da-7c69e605944b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:26.027010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69350fd8-80e9-4d01-b8da-7c69e605944b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:26.027439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69350fd8-80e9-4d01-b8da-7c69e605944b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:26.554411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-69350fd8-80e9-4d01-b8da-7c69e605944b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:26.563300 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-69350fd8-80e9-4d01-b8da-7c69e605944b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1505 microversion: 2.1 time: 0.595358 May 19 05:04:26.571003 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2779/5484] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:04:25 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:04:27.587368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6aee744-cdf6-4c6d-82f0-b923a51b129e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:27.588077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6aee744-cdf6-4c6d-82f0-b923a51b129e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:27.612812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6aee744-cdf6-4c6d-82f0-b923a51b129e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:27.616471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6aee744-cdf6-4c6d-82f0-b923a51b129e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:27.617326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6aee744-cdf6-4c6d-82f0-b923a51b129e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:27.617783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6aee744-cdf6-4c6d-82f0-b923a51b129e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:28.296124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d6aee744-cdf6-4c6d-82f0-b923a51b129e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:28.308379 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6aee744-cdf6-4c6d-82f0-b923a51b129e tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 200 len: 1463 microversion: 2.1 time: 0.725947 May 19 05:04:28.309326 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2706/5485] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:04:27 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 1463 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:04:28.366256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3f73c134-d956-46ab-9868-065c3b666176 req-8e73b888-c81a-43a4-ae10-068d8e4cb869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9ce50f-6f23-448f-ae78-8ed9778f4509", "name": "network-vif-deleted", "tag": "04b88959-165d-4b98-a36a-7e964d709b64"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:04:28.380339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3f73c134-d956-46ab-9868-065c3b666176 req-8e73b888-c81a-43a4-ae10-068d8e4cb869 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:28.384410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3f73c134-d956-46ab-9868-065c3b666176 req-8e73b888-c81a-43a4-ae10-068d8e4cb869 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:28.411119 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3f73c134-d956-46ab-9868-065c3b666176 req-8e73b888-c81a-43a4-ae10-068d8e4cb869 service nova] Creating event network-vif-deleted:04b88959-165d-4b98-a36a-7e964d709b64 for instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 on n-h2-766726-30 May 19 05:04:28.417633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3f73c134-d956-46ab-9868-065c3b666176 req-8e73b888-c81a-43a4-ae10-068d8e4cb869 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055310 May 19 05:04:28.418817 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2780/5486] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:04:29.325373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:29.325999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: bd9ce50f-6f23-448f-ae78-8ed9778f4509] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:29.345229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:29.345690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:29.346480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:29.346924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:29.372519 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] HTTP exception thrown: Instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 could not be found. May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Request method failure captured: May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 HTTP/1.1 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc552hVIo4gddG1TsyjmdiR4FI-JaQWAI2htXnFCrEGDKOYsH4E1XezkrXoYbLKVx2oQ0SvwM5ir8T3Pst5EgfSG9x1mXTMB6grf-HgGlu6N1XdfyruY3CowYDE4FL4j4mU5LfyG9tECTRcDp-giFDz68AbxVhmT6rWj0Yst-Jw0c2o May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 0e75fb6c77b44c22b95693d01448e3d2 May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 could not be found. May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'bd9ce50f-6f23-448f-ae78-8ed9778f4509'} May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 could not be found. May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 could not be found. May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:04:29.378030 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:04:29.383374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:04:29.383374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:04:29.383374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:04:29.383374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:04:29.383374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:04:29.383374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 could not be found. May 19 05:04:29.383374 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:04:29.385459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Returning 404 to user: Instance bd9ce50f-6f23-448f-ae78-8ed9778f4509 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:04:29.386895 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7d15ef74-dea5-4759-9bb8-827d50bd69f9 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509" status: 404 len: 111 microversion: 2.1 time: 0.065514 May 19 05:04:29.388222 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2707/5487] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:04:29 2022] GET /compute/v2.1/servers/bd9ce50f-6f23-448f-ae78-8ed9778f4509 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:04:29.401246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cc033338-29fc-4ed6-a1b2-4775cc7d5069 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:29.401246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cc033338-29fc-4ed6-a1b2-4775cc7d5069 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:29.413586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc033338-29fc-4ed6-a1b2-4775cc7d5069 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:29.417466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc033338-29fc-4ed6-a1b2-4775cc7d5069 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:29.418279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc033338-29fc-4ed6-a1b2-4775cc7d5069 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:29.418733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc033338-29fc-4ed6-a1b2-4775cc7d5069 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:29.544546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cc033338-29fc-4ed6-a1b2-4775cc7d5069 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:04:29.816975 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cc033338-29fc-4ed6-a1b2-4775cc7d5069 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 204 len: 0 microversion: 2.1 time: 0.423261 May 19 05:04:29.822122 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2781/5488] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:04:29 2022] DELETE /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:04:29.826242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-92266c45-9c9e-43f6-89a0-ed3f6ae2be4b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:29.826918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-92266c45-9c9e-43f6-89a0-ed3f6ae2be4b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:29.842058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92266c45-9c9e-43f6-89a0-ed3f6ae2be4b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:29.845496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92266c45-9c9e-43f6-89a0-ed3f6ae2be4b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:29.853737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92266c45-9c9e-43f6-89a0-ed3f6ae2be4b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:29.854279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-92266c45-9c9e-43f6-89a0-ed3f6ae2be4b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:30.195440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-92266c45-9c9e-43f6-89a0-ed3f6ae2be4b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:30.204276 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-92266c45-9c9e-43f6-89a0-ed3f6ae2be4b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.381517 May 19 05:04:30.210681 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2708/5489] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:04:29 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:04:31.228137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8cfb75f9-d7a0-4ed6-ad7b-177fbf6d234b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:31.229480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8cfb75f9-d7a0-4ed6-ad7b-177fbf6d234b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:31.243152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8cfb75f9-d7a0-4ed6-ad7b-177fbf6d234b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:31.253977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8cfb75f9-d7a0-4ed6-ad7b-177fbf6d234b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:31.257760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8cfb75f9-d7a0-4ed6-ad7b-177fbf6d234b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:31.258489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8cfb75f9-d7a0-4ed6-ad7b-177fbf6d234b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:31.776969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8cfb75f9-d7a0-4ed6-ad7b-177fbf6d234b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:31.787071 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8cfb75f9-d7a0-4ed6-ad7b-177fbf6d234b tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.563485 May 19 05:04:31.788008 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2782/5490] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:04:31 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:04:32.804002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e9fb6d6-d03b-46d2-a13d-fd0263046419 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:32.805259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e9fb6d6-d03b-46d2-a13d-fd0263046419 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:32.814450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e9fb6d6-d03b-46d2-a13d-fd0263046419 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:32.819777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e9fb6d6-d03b-46d2-a13d-fd0263046419 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:32.822537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e9fb6d6-d03b-46d2-a13d-fd0263046419 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:32.823219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e9fb6d6-d03b-46d2-a13d-fd0263046419 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:33.153194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e9fb6d6-d03b-46d2-a13d-fd0263046419 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:33.167587 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e9fb6d6-d03b-46d2-a13d-fd0263046419 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1522 microversion: 2.1 time: 0.365804 May 19 05:04:33.170684 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2709/5491] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:04:32 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:04:34.006419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a240a831-60af-409e-8c35-b3b3295f3a70 req-d8aeea42-ac89-49a4-97d7-645933f56b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58ad16d-f383-4e83-9fa9-77275956590c", "name": "network-vif-deleted", "tag": "7e7974e1-fefd-4636-9522-51a5ac917637"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:04:34.026481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a240a831-60af-409e-8c35-b3b3295f3a70 req-d8aeea42-ac89-49a4-97d7-645933f56b28 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:34.027284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a240a831-60af-409e-8c35-b3b3295f3a70 req-d8aeea42-ac89-49a4-97d7-645933f56b28 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:34.091811 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a240a831-60af-409e-8c35-b3b3295f3a70 req-d8aeea42-ac89-49a4-97d7-645933f56b28 service nova] Creating event network-vif-deleted:7e7974e1-fefd-4636-9522-51a5ac917637 for instance d58ad16d-f383-4e83-9fa9-77275956590c on n-h1-766726-30 May 19 05:04:34.107930 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a240a831-60af-409e-8c35-b3b3295f3a70 req-d8aeea42-ac89-49a4-97d7-645933f56b28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107258 May 19 05:04:34.116769 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2783/5492] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:04:34.189619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:34.190861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:34.216488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:34.232013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:34.254959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:34.255729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:34.371740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:34.372196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:34.372664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lazy-loading 'fault' on Instance uuid d58ad16d-f383-4e83-9fa9-77275956590c {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:04:34.589144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e75fb6c77b44c22b95693d01448e3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d413674d7946c4a845a0ab2c2cec20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:34.594748 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a01fb643-f6c5-41cc-8219-82f0cab8eb09 tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 200 len: 1312 microversion: 2.1 time: 0.411948 May 19 05:04:34.595519 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2710/5493] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:04:34 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 1312 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:04:35.614726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:35.616661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] [instance: d58ad16d-f383-4e83-9fa9-77275956590c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:35.624040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:35.624826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:35.626357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:35.626961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:35.652767 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] HTTP exception thrown: Instance d58ad16d-f383-4e83-9fa9-77275956590c could not be found. May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Request method failure captured: May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c HTTP/1.1 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc552hVIo4gddG1TsyjmdiR4FI-JaQWAI2htXnFCrEGDKOYsH4E1XezkrXoYbLKVx2oQ0SvwM5ir8T3Pst5EgfSG9x1mXTMB6grf-HgGlu6N1XdfyruY3CowYDE4FL4j4mU5LfyG9tECTRcDp-giFDz68AbxVhmT6rWj0Yst-Jw0c2o May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_92d413674d7946c4a845a0ab2c2cec20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 92d413674d7946c4a845a0ab2c2cec20 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-560727433 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 0e75fb6c77b44c22b95693d01448e3d2 May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerRescueNegativeTestJSON-560727433-project May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance d58ad16d-f383-4e83-9fa9-77275956590c could not be found. May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'd58ad16d-f383-4e83-9fa9-77275956590c'} May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58ad16d-f383-4e83-9fa9-77275956590c could not be found. May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58ad16d-f383-4e83-9fa9-77275956590c could not be found. May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:04:35.656534 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:04:35.661035 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:04:35.661035 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:04:35.661035 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:04:35.661035 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:04:35.661035 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:04:35.661035 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58ad16d-f383-4e83-9fa9-77275956590c could not be found. May 19 05:04:35.661035 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:04:35.663008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] Returning 404 to user: Instance d58ad16d-f383-4e83-9fa9-77275956590c could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:04:35.665013 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-622a0653-5082-4ba5-b82f-153880b72d0d tempest-ServerRescueNegativeTestJSON-560727433 tempest-ServerRescueNegativeTestJSON-560727433-project] 10.222.0.58 "GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c" status: 404 len: 111 microversion: 2.1 time: 0.056117 May 19 05:04:35.667986 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2784/5494] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:04:35 2022] GET /compute/v2.1/servers/d58ad16d-f383-4e83-9fa9-77275956590c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:04:47.881963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:04:47.883440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:04:48.477610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1905534587", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": "none"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:04:48.596940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:04:48.597398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:04:48.597879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:04:48.598276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:04:48.598753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:04:48.621605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:48.627456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:48.628472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:48.628847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:48.679334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Getting quotas for project 3962e299d9724ca5b65c4492efc7240a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:04:48.686918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Getting quotas for user 01a9443552c64507b0a9af7631220173 and project 3962e299d9724ca5b65c4492efc7240a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:04:48.702601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:04:48.706225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:04:48.779313 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f449fa64-7c2c-4826-b94e-f4e9040740a4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.903198 May 19 05:04:48.782490 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2711/5495] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 19 05:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 05:04:48.794083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ddd39eac-b0eb-4e1f-9684-ced994e98ebc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:48.795184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ddd39eac-b0eb-4e1f-9684-ced994e98ebc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:48.798893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:04:48.799773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:04:48.909469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ddd39eac-b0eb-4e1f-9684-ced994e98ebc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:48.918794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ddd39eac-b0eb-4e1f-9684-ced994e98ebc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:48.920571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ddd39eac-b0eb-4e1f-9684-ced994e98ebc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:48.924008 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ddd39eac-b0eb-4e1f-9684-ced994e98ebc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1278 microversion: 2.54 time: 0.135484 May 19 05:04:48.926105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2785/5496] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:48 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:04:48.993824 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:04:48.994378 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:04:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:04:49.944108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:49.944830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:49.958818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:49.959506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:49.961833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:49.969769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:50.185433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:50.201763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:50.205822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:50.208459 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-16c3e041-34f6-41f4-84fb-7ef065ad3fa7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1282 microversion: 2.54 time: 0.269255 May 19 05:04:50.210267 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2712/5497] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:49 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1282 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:04:51.227805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:51.228418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:51.237510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:51.238317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:51.239316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:51.241131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:51.339968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:51.352030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:51.355698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:51.357704 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-102c76e5-5bbb-4527-a613-891eb7822024 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1336 microversion: 2.54 time: 0.133814 May 19 05:04:51.362765 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2786/5498] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:51 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1336 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:04:52.376740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:52.378145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:52.386042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:52.386884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:52.387903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:52.388598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:52.491889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:52.500317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:52.501870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:52.503026 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e219911-8e0e-4f56-b800-864decf4aae8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1336 microversion: 2.54 time: 0.130980 May 19 05:04:52.503600 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2713/5499] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:52 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1336 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 05:04:53.521151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:53.522850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:53.533198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:53.535799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:53.539447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:53.540332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:53.684503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:53.695587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:53.697873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:53.700318 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86249d7e-856c-43bf-9f11-e60f31ba3a12 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1357 microversion: 2.54 time: 0.182267 May 19 05:04:53.714349 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2787/5500] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:53 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:04:53.723555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a5c9c547-f68e-48d7-a58f-e3054eb9d067 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Action: 'create', calling method: .version_select at 0x7fd3145c0820>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1088852393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmIf8H0ISEX3b74L/vAsxk+uViQw0UCVdr+FONh5eUZuC9X2tJFZQ+oJ6Ltf3d0bE64lTDuGWA4g4ODLawmQ65xYZHCq2JhMQ9M8fkYuB9L3TicHAD8vcNSZq8rZ45YFw=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:04:53.742380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a5c9c547-f68e-48d7-a58f-e3054eb9d067 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Getting quotas for project 3962e299d9724ca5b65c4492efc7240a. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:04:53.753421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a5c9c547-f68e-48d7-a58f-e3054eb9d067 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Getting quotas for user 01a9443552c64507b0a9af7631220173 and project 3962e299d9724ca5b65c4492efc7240a. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:04:53.806531 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a5c9c547-f68e-48d7-a58f-e3054eb9d067 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.087139 May 19 05:04:53.807101 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2714/5501] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 19 05:04:53 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 05:04:53.819228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1088852393", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:04:53.821189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:53.831098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:53.834364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:53.836118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:53.836575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:54.029818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:04:54.030547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:04:54.033312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:04:54.033977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:04:54.034815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:04:54.240363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:54.257282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:54.257748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:54.258549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:54.264742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:54.385341 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7057c1d8-ff0d-46a5-9dec-faeca10800bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "POST /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103/action" status: 202 len: 1140 microversion: 2.54 time: 0.571296 May 19 05:04:54.392130 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2788/5502] 10.222.0.58 () {62 vars in 1319 bytes} [Thu May 19 05:04:53 2022] POST /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103/action => generated 1140 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 19 05:04:54.413177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:54.415049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:54.436101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:54.440756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:54.443218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:54.443768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:54.662516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:54.713930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:54.722375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:54.728549 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9bf8689f-3635-48d1-8ed2-b3221667a535 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.323415 May 19 05:04:54.732225 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2715/5503] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:54 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:04:55.750742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:55.751525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:55.773696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:55.774167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:55.784894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:55.785420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:55.870800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:55.882004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:55.887327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:55.890336 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-22718869-c353-4417-8c54-4a96a14488be tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.145192 May 19 05:04:55.903857 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2789/5504] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:55 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:04:56.927967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:56.931669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:56.978351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:56.978814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:56.979621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:56.981617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:57.140236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:57.165384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:57.166920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:57.168115 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ba2f179-fe17-4a81-84ea-7fb6000506e8 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.257361 May 19 05:04:57.178229 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2716/5505] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:56 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:04:58.196784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:58.197435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:58.207812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:58.217981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:58.219429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:58.219893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:58.370879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:58.382733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:58.387107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:58.389718 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-81196924-0c8a-4b4f-bec4-87b20ce5a30b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.197812 May 19 05:04:58.393992 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2790/5506] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:58 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:04:59.412615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:04:59.413270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:04:59.416057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:04:59.453505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:59.455470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:59.471192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:04:59.472038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:04:59.628766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:59.637617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:59.642766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:04:59.644002 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e05b3102-f5c4-4565-88c6-3c4354d786db tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.236153 May 19 05:04:59.644573 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2717/5507] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:04:59 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:00.664929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:00.667906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:00.678780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:00.684777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:00.688458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:00.689542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:00.690151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:00.799597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:00.809002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:00.812783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:00.815066 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-975a4f74-1c2b-4367-804a-0913579b25a7 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.154049 May 19 05:05:00.816159 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2791/5508] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:00 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:01.837200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:01.837885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:01.855225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:01.857885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:01.860824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:01.863353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:02.025392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:02.041763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:02.043816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:02.045027 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-58542795-b65d-4ac1-b0f1-e11b89520890 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.213065 May 19 05:05:02.062602 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2718/5509] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:01 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:03.068503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:03.069156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:03.079919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:03.080392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:03.081183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:03.085698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:03.218746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:03.240902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:03.244223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:03.247107 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5fe0e232-d36e-4ae6-bcb3-9a3e383b4adb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.182596 May 19 05:05:03.249036 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2792/5510] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:03 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:04.271791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:04.272415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:04.275165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=10 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:04.293878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:04.294349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:04.295144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:04.295595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:04.464757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:04.472061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:04.481135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:04.483745 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d78f000e-9f00-459b-b710-3aca7486717c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.219855 May 19 05:05:04.497448 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2719/5511] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:04 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:05.508274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:05.513447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:05.540810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:05.542933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:05.546273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:05.547579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:05.696622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:05.708055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:05.711140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:05.725837 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b01a8cc-5fbb-4353-9761-fb33bcb6490b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.214431 May 19 05:05:05.729820 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2793/5512] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:05 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:06.748378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:06.749382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:06.757830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:06.773640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:06.774940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:06.775672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:06.894463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:06.904106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:06.906206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:06.907597 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-36d01aed-0a34-4b43-a88f-be4d866c7c8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.163299 May 19 05:05:06.908663 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2720/5513] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:06 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:07.936233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:07.937567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:07.955068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:07.957165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:07.960052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:07.962317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:08.163385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:08.172147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:08.182084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:08.183353 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-30e23470-51fa-4d85-a3b5-94d8bddbe7f4 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.257160 May 19 05:05:08.196589 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2794/5514] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:07 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:09.225660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:09.226394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:09.243337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:09.244169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:09.248005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:09.253033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:09.985653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:10.003792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:10.036795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:10.059837 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3821a45-55e8-409a-8f62-0388d87392bd tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.818117 May 19 05:05:10.078656 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2721/5515] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:09 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:11.083436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:11.084769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:11.109136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:11.110531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:11.112046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:11.114506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:11.292621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:11.302867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:11.321522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:11.338380 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99dcfcb6-0f60-4e93-9ee2-97fd0e9e4e8e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.244974 May 19 05:05:11.341922 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2795/5516] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:11 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 05:05:12.358581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:12.359738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:12.374655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:12.375124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:12.375931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:12.379314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:12.571052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:12.585127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:12.595558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:12.609311 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f530d500-0e0c-4ab5-930e-d481cdec7f14 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.254372 May 19 05:05:12.609953 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2722/5517] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:12 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:13.631365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:13.632562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:13.644219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:13.644868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:13.645867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:13.646472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:13.752279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:13.788638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:13.796955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:13.801795 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-077705d4-388c-4c9f-a62c-7a4cf63da8eb tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.175980 May 19 05:05:13.803858 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2796/5518] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:13 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:13.963459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f02cfb16-879b-4a0a-847b-0c155a47e0d9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:13.964000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f02cfb16-879b-4a0a-847b-0c155a47e0d9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:13.995039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f02cfb16-879b-4a0a-847b-0c155a47e0d9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:13.995507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f02cfb16-879b-4a0a-847b-0c155a47e0d9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:13.996311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f02cfb16-879b-4a0a-847b-0c155a47e0d9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:13.996756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f02cfb16-879b-4a0a-847b-0c155a47e0d9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:14.180351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-f02cfb16-879b-4a0a-847b-0c155a47e0d9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lazy-loading 'services' on Instance uuid d4af25c8-f777-43e5-91ae-ac7cc7a1c83c {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:05:14.444115 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f02cfb16-879b-4a0a-847b-0c155a47e0d9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c/os-volume_attachments/2b23cccd-52b1-4b97-9807-d58bddaaa87a" status: 202 len: 0 microversion: 2.1 time: 0.484579 May 19 05:05:14.444896 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2723/5519] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:05:13 2022] DELETE /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c/os-volume_attachments/2b23cccd-52b1-4b97-9807-d58bddaaa87a => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:05:14.835887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:14.838103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:14.851429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:14.852156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:14.853955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:14.855182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:15.032530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:15.051303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:15.060770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:15.066506 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cf9d9d0c-8710-4dea-ab2f-e8c32e12ef5d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.244353 May 19 05:05:15.068377 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2797/5520] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:14 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:16.090074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:16.090790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:16.108983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:16.110614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:16.121914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:16.124285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:16.313316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:16.330650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:16.337397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:16.338968 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6b899e9d-c657-49ff-8aa1-4adf8ce86d6c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.253144 May 19 05:05:16.343700 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2724/5521] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:16 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:17.361670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:17.362432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:17.370270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:17.381287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:17.383875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:17.385893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:17.584298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:17.597559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:17.607462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:17.611280 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1ced095e-1678-4ac0-bd58-57662a87e95e tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.252153 May 19 05:05:17.613259 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2798/5522] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:17 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:18.631184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:18.631993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:18.635025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:18.646652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:18.655038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:18.656701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:18.666234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:18.683926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:19.121874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:19.134207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:19.153587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:19.165099 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dea388e7-9600-439a-8f78-70b56cd6ccd3 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.528673 May 19 05:05:19.166037 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2725/5523] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:18 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:20.185907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:20.188070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:20.194174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=37 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:20.209553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:20.210007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:20.215257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:20.217665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:20.335383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:20.573936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:20.587386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:20.589803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:20.594410 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-258a95d8-b2d2-4a30-9c08-5c743edc8a48 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1409 microversion: 2.54 time: 0.412887 May 19 05:05:20.613562 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2799/5524] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:20 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1409 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:21.619326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:21.620191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:21.635233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:21.637281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:21.638810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:21.641371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:21.810817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:21.821022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:21.832592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:21.842476 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-60aa2eba-ebb1-4b6c-9877-5b1898dde337 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1415 microversion: 2.54 time: 0.219175 May 19 05:05:21.845028 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2726/5525] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:21 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1415 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:22.863828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:22.865043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:22.889155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:22.889858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:22.890830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:22.891427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:23.174013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:23.187259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:23.189610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:23.197406 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1fee31f-fa15-4524-b385-2af5e6e3b4f6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1415 microversion: 2.54 time: 0.337346 May 19 05:05:23.202725 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2800/5526] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:22 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1415 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:24.221202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:24.221867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:24.242944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:24.243408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:24.246788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:24.247103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:24.430087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:24.460653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:24.468488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:24.473707 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e64555d-8b44-402c-a95f-b31a785faef9 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1400 microversion: 2.54 time: 0.256539 May 19 05:05:24.475991 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2727/5527] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:24 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1400 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:24.509620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2a6adf9-ba54-4fde-b234-03c48bab3a19 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '.version_select at 0x7fd314b2c160>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:24.559338 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2a6adf9-ba54-4fde-b234-03c48bab3a19 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1088852393" status: 204 len: 0 microversion: 2.54 time: 0.065754 May 19 05:05:24.564159 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2801/5528] 10.222.0.58 () {60 vars in 1318 bytes} [Thu May 19 05:05:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1088852393 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 05:05:24.581746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-407cbcc1-6af7-4f2e-940d-1082403933b6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:24.582305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-407cbcc1-6af7-4f2e-940d-1082403933b6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:24.590652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-407cbcc1-6af7-4f2e-940d-1082403933b6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:24.591117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-407cbcc1-6af7-4f2e-940d-1082403933b6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:24.614845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-407cbcc1-6af7-4f2e-940d-1082403933b6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:24.617463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-407cbcc1-6af7-4f2e-940d-1082403933b6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:24.682851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-407cbcc1-6af7-4f2e-940d-1082403933b6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:05:24.928305 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-407cbcc1-6af7-4f2e-940d-1082403933b6 tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "DELETE /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 204 len: 0 microversion: 2.54 time: 0.352653 May 19 05:05:24.930379 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2728/5529] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 19 05:05:24 2022] DELETE /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 05:05:24.940298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:24.941606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:24.952298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:24.953049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:24.954077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:24.962481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:25.193376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:25.220228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:25.228253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:25.229558 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5ab3572-47eb-44c1-b18f-5f89f3435d8d tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1406 microversion: 2.54 time: 0.293983 May 19 05:05:25.230141 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2802/5530] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:24 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:26.254527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:26.255376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:26.269699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:26.272018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:26.276700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:26.277345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:26.518412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:26.529468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:26.533887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:26.541119 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d1db7371-4e2b-4cf7-bfad-05aed129cacc tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1406 microversion: 2.54 time: 0.296061 May 19 05:05:26.542837 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2729/5531] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:26 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:27.568062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:27.568709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:27.589887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:27.593478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:27.595419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:27.598781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:27.744291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:27.745111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:27.745863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lazy-loading 'fault' on Instance uuid 34f7b47a-73df-4764-a1a3-f9fe56c03103 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:05:27.867597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:27.877368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:27.878875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01a9443552c64507b0a9af7631220173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3962e299d9724ca5b65c4492efc7240a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:27.894279 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fea9199c-e37e-4405-9d7a-307bfd92c39b tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 200 len: 1411 microversion: 2.54 time: 0.332772 May 19 05:05:27.897470 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2803/5532] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:27 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 1411 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 05:05:28.914558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:28.916000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] [instance: 34f7b47a-73df-4764-a1a3-f9fe56c03103] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:28.937263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:28.939419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:28.941581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:28.943659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:29.000933 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] HTTP exception thrown: Instance 34f7b47a-73df-4764-a1a3-f9fe56c03103 could not be found. May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Request method failure captured: May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 HTTP/1.1 May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc_vwU3u4US-YtJXZVfm-zoXsHU5WREakkPDgr44MlT2xZsu63ao7A8mtIHQv8jHhJXI6rZMBo6gjzDgRLmb_mPaeWkgQVeixJm8JkW1PRcxjuT7vhk4OouKe0SxAGPNu4YRGaeO3NYpp2-gVoSSKan9357XLnScrqP-b-suY0uX3ss May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Openstack-Nova-Api-Version: 2.54 May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 3962e299d9724ca5b65c4492efc7240a May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerShowV254Test-86583019 May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3962e299d9724ca5b65c4492efc7240a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3962e299d9724ca5b65c4492efc7240a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3962e299d9724ca5b65c4492efc7240a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3962e299d9724ca5b65c4492efc7240a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerShowV254Test-86583019 May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 3962e299d9724ca5b65c4492efc7240a May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerShowV254Test-86583019 May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerShowV254Test-86583019-project May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 01a9443552c64507b0a9af7631220173 May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerShowV254Test-86583019-project May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 34f7b47a-73df-4764-a1a3-f9fe56c03103 could not be found. May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '34f7b47a-73df-4764-a1a3-f9fe56c03103'} May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f7b47a-73df-4764-a1a3-f9fe56c03103 could not be found. May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f7b47a-73df-4764-a1a3-f9fe56c03103 could not be found. May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:05:29.006369 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:29.011488 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:05:29.011488 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:05:29.011488 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:05:29.011488 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:05:29.011488 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:05:29.011488 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f7b47a-73df-4764-a1a3-f9fe56c03103 could not be found. May 19 05:05:29.011488 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:29.014785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] Returning 404 to user: Instance 34f7b47a-73df-4764-a1a3-f9fe56c03103 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:05:29.016006 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-df06ef8a-80ee-471e-a8dc-82ca63a2fb4c tempest-ServerShowV254Test-86583019 tempest-ServerShowV254Test-86583019-project] 10.222.0.58 "GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103" status: 404 len: 111 microversion: 2.54 time: 0.106288 May 19 05:05:29.019560 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2730/5533] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 19 05:05:28 2022] GET /compute/v2.1/servers/34f7b47a-73df-4764-a1a3-f9fe56c03103 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 05:05:35.495570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-caa98230-caf6-4e09-9934-e25fdf8ca0f4 tempest-ComputeTenantNetworksTest-217061044 tempest-ComputeTenantNetworksTest-217061044-project] Calling method '.version_select at 0x7fd314ba9e50>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:35.760152 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-caa98230-caf6-4e09-9934-e25fdf8ca0f4 tempest-ComputeTenantNetworksTest-217061044 tempest-ComputeTenantNetworksTest-217061044-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.507346 May 19 05:05:35.761270 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2804/5534] 10.222.0.58 () {58 vars in 1157 bytes} [Thu May 19 05:05:35 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:05:35.772569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-95b984ba-da84-4d36-8853-b0a0720e2d0c tempest-ComputeTenantNetworksTest-217061044 tempest-ComputeTenantNetworksTest-217061044-project] Calling method '.version_select at 0x7fd31444dc10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:36.083948 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-95b984ba-da84-4d36-8853-b0a0720e2d0c tempest-ComputeTenantNetworksTest-217061044 tempest-ComputeTenantNetworksTest-217061044-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks/db283ab5-f007-455b-b8e4-3d68a18cda96" status: 200 len: 139 microversion: 2.1 time: 0.316131 May 19 05:05:36.092343 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2731/5535] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 05:05:35 2022] GET /compute/v2.1/os-tenant-networks/db283ab5-f007-455b-b8e4-3d68a18cda96 => generated 139 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:05:36.566844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-62d86269-1e22-45bd-b722-9f65bf2214d1 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Action: 'create', calling method: .version_select at 0x7fd314b1f4c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1247604620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkzKx6678hB8SJrHdX3f2IIdm29G2oWuMwhehtjxaOtuDVBeBKSgZ4roHCFAjEwKKQr8Nfhj/ecbin1YeaC/dJAgfyNmMJeVyJcUN1z3ez9QtBnYrD57ImvMyzmRzLNUg=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:05:36.598806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-62d86269-1e22-45bd-b722-9f65bf2214d1 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Getting quotas for project e9a0bffaa990446a9163b476f462fff2. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:05:36.622107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-62d86269-1e22-45bd-b722-9f65bf2214d1 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Getting quotas for user 00b4c70b8f224ac6b5c292563bad8651 and project e9a0bffaa990446a9163b476f462fff2. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:05:36.687672 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-62d86269-1e22-45bd-b722-9f65bf2214d1 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.404051 May 19 05:05:36.693110 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2805/5536] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:05:36 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:05:42.414483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:42.416193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:42.422130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2f79324e-2523-41e2-989f-187b5f730d6b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:42.422984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2f79324e-2523-41e2-989f-187b5f730d6b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:42.442686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f79324e-2523-41e2-989f-187b5f730d6b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:42.443590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f79324e-2523-41e2-989f-187b5f730d6b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:42.444731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f79324e-2523-41e2-989f-187b5f730d6b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:42.446412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f79324e-2523-41e2-989f-187b5f730d6b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:42.508717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2f79324e-2523-41e2-989f-187b5f730d6b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:05:42.673963 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2f79324e-2523-41e2-989f-187b5f730d6b tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 204 len: 0 microversion: 2.1 time: 0.260547 May 19 05:05:42.675531 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2732/5537] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:05:42 2022] DELETE /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:05:42.687906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2dca12f7-8e27-4bfd-97f8-5d20380d5900 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:42.689419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2dca12f7-8e27-4bfd-97f8-5d20380d5900 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:42.701570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=25 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:42.712184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dca12f7-8e27-4bfd-97f8-5d20380d5900 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:42.718097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dca12f7-8e27-4bfd-97f8-5d20380d5900 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:42.720210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dca12f7-8e27-4bfd-97f8-5d20380d5900 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:42.721403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dca12f7-8e27-4bfd-97f8-5d20380d5900 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:43.067429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2dca12f7-8e27-4bfd-97f8-5d20380d5900 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:43.079612 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2dca12f7-8e27-4bfd-97f8-5d20380d5900 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1512 microversion: 2.1 time: 0.399788 May 19 05:05:43.083111 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2806/5538] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:05:42 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:05:44.102360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-81aa13f0-618c-421e-a2bd-b3425fd1cbdb tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:44.103783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-81aa13f0-618c-421e-a2bd-b3425fd1cbdb tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:44.141028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81aa13f0-618c-421e-a2bd-b3425fd1cbdb tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:44.144442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81aa13f0-618c-421e-a2bd-b3425fd1cbdb tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:44.148328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81aa13f0-618c-421e-a2bd-b3425fd1cbdb tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:44.149980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81aa13f0-618c-421e-a2bd-b3425fd1cbdb tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:44.971707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-81aa13f0-618c-421e-a2bd-b3425fd1cbdb tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:44.998989 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-81aa13f0-618c-421e-a2bd-b3425fd1cbdb tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1512 microversion: 2.1 time: 0.901324 May 19 05:05:45.010980 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2733/5539] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:05:44 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1512 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:05:46.035498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-79bd221e-d713-47cf-8cbe-2cd196d84e5a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:46.037462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-79bd221e-d713-47cf-8cbe-2cd196d84e5a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:46.065889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79bd221e-d713-47cf-8cbe-2cd196d84e5a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:46.075250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79bd221e-d713-47cf-8cbe-2cd196d84e5a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:46.083204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79bd221e-d713-47cf-8cbe-2cd196d84e5a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:46.088796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-79bd221e-d713-47cf-8cbe-2cd196d84e5a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:46.314834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-808451c0-51cc-4089-b17c-77dcd4b956d7 req-e73f5d6b-6748-4666-9bcd-ae6592bc486d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4af25c8-f777-43e5-91ae-ac7cc7a1c83c", "name": "network-vif-deleted", "tag": "d79e33f7-9c3b-4e46-b5b3-9f9670306689"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:05:46.384983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-808451c0-51cc-4089-b17c-77dcd4b956d7 req-e73f5d6b-6748-4666-9bcd-ae6592bc486d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:46.385632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-808451c0-51cc-4089-b17c-77dcd4b956d7 req-e73f5d6b-6748-4666-9bcd-ae6592bc486d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:46.426494 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-808451c0-51cc-4089-b17c-77dcd4b956d7 req-e73f5d6b-6748-4666-9bcd-ae6592bc486d service nova] Creating event network-vif-deleted:d79e33f7-9c3b-4e46-b5b3-9f9670306689 for instance d4af25c8-f777-43e5-91ae-ac7cc7a1c83c on n-h1-766726-30 May 19 05:05:46.474476 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-808451c0-51cc-4089-b17c-77dcd4b956d7 req-e73f5d6b-6748-4666-9bcd-ae6592bc486d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163420 May 19 05:05:46.479244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-79bd221e-d713-47cf-8cbe-2cd196d84e5a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:46.485807 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2734/5540] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:05:46.516887 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-79bd221e-d713-47cf-8cbe-2cd196d84e5a tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 200 len: 1470 microversion: 2.1 time: 0.492859 May 19 05:05:46.519527 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2807/5541] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:05:46 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:05:47.539335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:47.540041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: d4af25c8-f777-43e5-91ae-ac7cc7a1c83c] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:47.562004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:47.565309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:47.568072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:47.568573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:47.644289 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] HTTP exception thrown: Instance d4af25c8-f777-43e5-91ae-ac7cc7a1c83c could not be found. May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Request method failure captured: May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c HTTP/1.1 May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihc66-IrZJXf3r5Qih9UxE6KeEnPVQn4ay1Dex6aGOJhnaVhUZ-8k0PaQtdgBLrMudshHWlF5qEUY3WgKiGAYTjHQ7k3v84yglJit47x4vENcJjD2eTv8qCoIS9Ezuf5TSGbjJ1A0mthYqqw7SOCx2WqTrcUU7yl6_Y8TWqzpCra-FNw May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 809713a72c8848bc8d75fe5661ef7bff May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-VolumesSnapshotTestJSON-404094688 May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/809713a72c8848bc8d75fe5661ef7bff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/809713a72c8848bc8d75fe5661ef7bff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/809713a72c8848bc8d75fe5661ef7bff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_809713a72c8848bc8d75fe5661ef7bff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-VolumesSnapshotTestJSON-404094688 May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 809713a72c8848bc8d75fe5661ef7bff May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-404094688 May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-VolumesSnapshotTestJSON-404094688-project May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 0c1a374e9ff94035bcdd10aa278873c9 May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-VolumesSnapshotTestJSON-404094688-project May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance d4af25c8-f777-43e5-91ae-ac7cc7a1c83c could not be found. May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'd4af25c8-f777-43e5-91ae-ac7cc7a1c83c'} May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4af25c8-f777-43e5-91ae-ac7cc7a1c83c could not be found. May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4af25c8-f777-43e5-91ae-ac7cc7a1c83c could not be found. May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:05:47.647469 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:47.652250 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:05:47.652250 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:05:47.652250 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:05:47.652250 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:05:47.652250 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:05:47.652250 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4af25c8-f777-43e5-91ae-ac7cc7a1c83c could not be found. May 19 05:05:47.652250 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:05:47.663468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Returning 404 to user: Instance d4af25c8-f777-43e5-91ae-ac7cc7a1c83c could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:05:47.673325 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-61e76889-2046-45b3-83a1-cb0318fdf726 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c" status: 404 len: 111 microversion: 2.1 time: 0.134691 May 19 05:05:47.685895 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2735/5542] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:05:47 2022] GET /compute/v2.1/servers/d4af25c8-f777-43e5-91ae-ac7cc7a1c83c => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:05:52.027418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1951916775-access_point-1372584173", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "1938f808-4004-4f16-ba83-260d2141811f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1247604620", "security_groups": [{"name": "tempest-secgroup_access--143093117"}, {"name": "tempest-secgroup_general--199742195"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:05:52.067019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:52.071688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:52.702766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] validate_networks() for [('1938f808-4004-4f16-ba83-260d2141811f', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:05:56.498389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:56.723994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:05:56.724424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:05:56.724918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:05:56.725499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:05:56.725887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:05:56.756040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:56.756501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:56.757344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:56.762810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:56.854715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Getting quotas for project e9a0bffaa990446a9163b476f462fff2. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:05:56.880983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Getting quotas for user 00b4c70b8f224ac6b5c292563bad8651 and project e9a0bffaa990446a9163b476f462fff2. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:05:56.957527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:05:56.979723 n-d-766726-30 devstack@n-api.service[124818]: WARNING nova.utils [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1951916775-access_point-1372584173 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1951916775-ac May 19 05:05:56.980566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:05:57.207692 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ca72eddb-5a2b-498f-8f19-e5abd0b9a54f tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 5.182517 May 19 05:05:57.209573 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2808/5543] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:05:52 2022] POST /compute/v2.1/servers => generated 456 bytes in 5191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:05:57.226276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-852d8a73-18f1-4049-9e1e-7ba7b651a05a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:57.227149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-852d8a73-18f1-4049-9e1e-7ba7b651a05a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:57.461763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-852d8a73-18f1-4049-9e1e-7ba7b651a05a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:57.481935 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-852d8a73-18f1-4049-9e1e-7ba7b651a05a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1295 microversion: 2.1 time: 0.262921 May 19 05:05:57.491954 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2736/5544] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:05:57 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1295 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:05:58.508534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e29b0e6b-1ed7-435d-b80a-15a23ed645d9 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:58.509507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e29b0e6b-1ed7-435d-b80a-15a23ed645d9 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:58.560234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e29b0e6b-1ed7-435d-b80a-15a23ed645d9 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:58.560912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e29b0e6b-1ed7-435d-b80a-15a23ed645d9 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:58.569328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e29b0e6b-1ed7-435d-b80a-15a23ed645d9 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:58.571537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e29b0e6b-1ed7-435d-b80a-15a23ed645d9 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:58.798153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e29b0e6b-1ed7-435d-b80a-15a23ed645d9 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:05:58.820287 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e29b0e6b-1ed7-435d-b80a-15a23ed645d9 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1299 microversion: 2.1 time: 0.302919 May 19 05:05:58.823106 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2809/5545] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:05:58 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1299 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:05:59.846696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e66e5075-3205-42db-900b-7a4bcd9a4aad tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:05:59.847990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e66e5075-3205-42db-900b-7a4bcd9a4aad tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:05:59.865552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:05:59.880865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e66e5075-3205-42db-900b-7a4bcd9a4aad tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:59.881807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e66e5075-3205-42db-900b-7a4bcd9a4aad tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:05:59.886608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e66e5075-3205-42db-900b-7a4bcd9a4aad tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:05:59.889517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e66e5075-3205-42db-900b-7a4bcd9a4aad tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:00.313172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e66e5075-3205-42db-900b-7a4bcd9a4aad tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:00.325617 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e66e5075-3205-42db-900b-7a4bcd9a4aad tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1353 microversion: 2.1 time: 0.481320 May 19 05:06:00.335939 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2737/5546] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:05:59 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1353 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:01.355507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7530e51-3765-4b0d-bcdb-9a01a75cb72d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:01.357585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7530e51-3765-4b0d-bcdb-9a01a75cb72d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:01.404658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7530e51-3765-4b0d-bcdb-9a01a75cb72d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:01.412822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7530e51-3765-4b0d-bcdb-9a01a75cb72d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:01.415977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7530e51-3765-4b0d-bcdb-9a01a75cb72d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:01.417026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7530e51-3765-4b0d-bcdb-9a01a75cb72d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:01.707253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a7530e51-3765-4b0d-bcdb-9a01a75cb72d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:01.721965 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7530e51-3765-4b0d-bcdb-9a01a75cb72d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1353 microversion: 2.1 time: 0.383428 May 19 05:06:01.727326 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2810/5547] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:01 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1353 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:02.742385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8469229-7964-41c8-9fae-08fb23585e8d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:02.743361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f8469229-7964-41c8-9fae-08fb23585e8d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:02.755300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8469229-7964-41c8-9fae-08fb23585e8d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:02.758678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8469229-7964-41c8-9fae-08fb23585e8d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:02.759655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8469229-7964-41c8-9fae-08fb23585e8d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:02.761604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8469229-7964-41c8-9fae-08fb23585e8d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:03.216212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f8469229-7964-41c8-9fae-08fb23585e8d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:03.226546 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f8469229-7964-41c8-9fae-08fb23585e8d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1471 microversion: 2.1 time: 0.488119 May 19 05:06:03.235917 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2738/5548] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:02 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1471 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:04.245400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-822b371b-0c98-430d-adb7-ce3e34363588 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:04.246203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-822b371b-0c98-430d-adb7-ce3e34363588 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:04.264104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-822b371b-0c98-430d-adb7-ce3e34363588 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:04.264830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-822b371b-0c98-430d-adb7-ce3e34363588 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:04.267677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-822b371b-0c98-430d-adb7-ce3e34363588 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:04.269641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-822b371b-0c98-430d-adb7-ce3e34363588 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:04.880974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-822b371b-0c98-430d-adb7-ce3e34363588 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:04.896750 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-822b371b-0c98-430d-adb7-ce3e34363588 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1471 microversion: 2.1 time: 0.655538 May 19 05:06:04.909239 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2811/5549] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:04 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1471 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:04.936488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-fbda256a-e686-4353-b0e5-81099ba0ca4f req-87bf320c-6874-4617-a30d-426a2623aadb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95677ab7-a536-4db0-b058-1bd8a4d04239", "tag": "80a687ec-e67f-44e9-9622-aa2b07f1f1cd"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:04.967640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fbda256a-e686-4353-b0e5-81099ba0ca4f req-87bf320c-6874-4617-a30d-426a2623aadb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:04.968170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fbda256a-e686-4353-b0e5-81099ba0ca4f req-87bf320c-6874-4617-a30d-426a2623aadb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:05.014250 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-fbda256a-e686-4353-b0e5-81099ba0ca4f req-87bf320c-6874-4617-a30d-426a2623aadb service nova] Creating event network-changed:80a687ec-e67f-44e9-9622-aa2b07f1f1cd for instance 95677ab7-a536-4db0-b058-1bd8a4d04239 on n-h2-766726-30 May 19 05:06:05.026663 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-fbda256a-e686-4353-b0e5-81099ba0ca4f req-87bf320c-6874-4617-a30d-426a2623aadb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094302 May 19 05:06:05.033163 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2739/5550] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:06:05.918382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4cf05e81-e9ff-4b8f-a586-bfae38996195 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:05.919788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4cf05e81-e9ff-4b8f-a586-bfae38996195 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:05.931380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cf05e81-e9ff-4b8f-a586-bfae38996195 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:05.934733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cf05e81-e9ff-4b8f-a586-bfae38996195 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:05.935827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cf05e81-e9ff-4b8f-a586-bfae38996195 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:05.938308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cf05e81-e9ff-4b8f-a586-bfae38996195 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:06.310046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4cf05e81-e9ff-4b8f-a586-bfae38996195 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:06.318138 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4cf05e81-e9ff-4b8f-a586-bfae38996195 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1471 microversion: 2.1 time: 0.403885 May 19 05:06:06.323719 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2812/5551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:05 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1471 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:07.337796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e0e25a4f-e093-4b56-afab-ab8a5a623f82 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:07.338939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e0e25a4f-e093-4b56-afab-ab8a5a623f82 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:07.353493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0e25a4f-e093-4b56-afab-ab8a5a623f82 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:07.356361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0e25a4f-e093-4b56-afab-ab8a5a623f82 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:07.358402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0e25a4f-e093-4b56-afab-ab8a5a623f82 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:07.359699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0e25a4f-e093-4b56-afab-ab8a5a623f82 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:07.482990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:07.814732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e0e25a4f-e093-4b56-afab-ab8a5a623f82 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:07.833416 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e0e25a4f-e093-4b56-afab-ab8a5a623f82 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1471 microversion: 2.1 time: 0.500759 May 19 05:06:07.842532 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2740/5552] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:07 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:08.860616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88d4cf8f-75c9-49d0-8b92-93819016aeb8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:08.861604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-88d4cf8f-75c9-49d0-8b92-93819016aeb8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:08.869391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:08.872992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:08.902174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88d4cf8f-75c9-49d0-8b92-93819016aeb8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:08.910975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88d4cf8f-75c9-49d0-8b92-93819016aeb8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:08.912843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88d4cf8f-75c9-49d0-8b92-93819016aeb8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:08.915065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88d4cf8f-75c9-49d0-8b92-93819016aeb8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:09.454671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-88d4cf8f-75c9-49d0-8b92-93819016aeb8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:09.471939 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88d4cf8f-75c9-49d0-8b92-93819016aeb8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1471 microversion: 2.1 time: 0.616582 May 19 05:06:09.481407 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2813/5553] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:08 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1471 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:10.275760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1669159683", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "bae5d27d-4a18-48a7-8414-a513b404cd6a"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:10.412694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] validate_networks() for [('bae5d27d-4a18-48a7-8414-a513b404cd6a', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:06:10.489184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86ac3b38-a07a-4ea1-a3b4-22ba1bdf2910 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:10.489815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86ac3b38-a07a-4ea1-a3b4-22ba1bdf2910 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:10.500080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86ac3b38-a07a-4ea1-a3b4-22ba1bdf2910 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:10.505679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86ac3b38-a07a-4ea1-a3b4-22ba1bdf2910 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:10.507050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86ac3b38-a07a-4ea1-a3b4-22ba1bdf2910 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:10.507650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86ac3b38-a07a-4ea1-a3b4-22ba1bdf2910 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:10.858313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86ac3b38-a07a-4ea1-a3b4-22ba1bdf2910 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:10.873232 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86ac3b38-a07a-4ea1-a3b4-22ba1bdf2910 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1471 microversion: 2.1 time: 0.380856 May 19 05:06:10.874366 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2814/5554] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:10 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:06:11.313189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-47e679ad-ce43-46c6-8465-abf8f75418f9 req-defd5453-8f09-4f1d-8762-ed8eb891823d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95677ab7-a536-4db0-b058-1bd8a4d04239", "name": "network-vif-plugged", "status": "completed", "tag": "80a687ec-e67f-44e9-9622-aa2b07f1f1cd"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:11.329361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-47e679ad-ce43-46c6-8465-abf8f75418f9 req-defd5453-8f09-4f1d-8762-ed8eb891823d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:11.330199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-47e679ad-ce43-46c6-8465-abf8f75418f9 req-defd5453-8f09-4f1d-8762-ed8eb891823d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:11.357560 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-47e679ad-ce43-46c6-8465-abf8f75418f9 req-defd5453-8f09-4f1d-8762-ed8eb891823d service nova] Creating event network-vif-plugged:80a687ec-e67f-44e9-9622-aa2b07f1f1cd for instance 95677ab7-a536-4db0-b058-1bd8a4d04239 on n-h2-766726-30 May 19 05:06:11.366476 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-47e679ad-ce43-46c6-8465-abf8f75418f9 req-defd5453-8f09-4f1d-8762-ed8eb891823d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312334 May 19 05:06:11.383500 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2815/5555] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:06:11.892377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f6813da-236a-49c8-bfc7-2dab2e82f736 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:11.893812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f6813da-236a-49c8-bfc7-2dab2e82f736 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:11.900829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f6813da-236a-49c8-bfc7-2dab2e82f736 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:11.905156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f6813da-236a-49c8-bfc7-2dab2e82f736 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:11.908228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f6813da-236a-49c8-bfc7-2dab2e82f736 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:11.909870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f6813da-236a-49c8-bfc7-2dab2e82f736 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:12.712502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0f6813da-236a-49c8-bfc7-2dab2e82f736 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:12.722404 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f6813da-236a-49c8-bfc7-2dab2e82f736 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1471 microversion: 2.1 time: 0.835675 May 19 05:06:12.732042 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2816/5556] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:11 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1471 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:06:12.734792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:06:12.735245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:06:12.735691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:06:12.736107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:06:12.736568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:06:12.740049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:12.780827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:12.793379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:12.801539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:12.808675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:12.889881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Getting quotas for project 809713a72c8848bc8d75fe5661ef7bff. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:06:12.906662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Getting quotas for user 0c1a374e9ff94035bcdd10aa278873c9 and project 809713a72c8848bc8d75fe5661ef7bff. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:06:12.937902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:06:12.942237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:06:13.207916 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dc7a4f7d-9726-4256-9d8b-0f6e05a5a01c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.930002 May 19 05:06:13.212042 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2741/5557] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:06:13.222057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-11226e45-db65-4003-8f59-98892360cc89 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:13.222682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-11226e45-db65-4003-8f59-98892360cc89 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:13.416649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-11226e45-db65-4003-8f59-98892360cc89 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:13.425375 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-11226e45-db65-4003-8f59-98892360cc89 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1219 microversion: 2.1 time: 0.207356 May 19 05:06:13.429136 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2817/5558] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:13 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:13.741400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-881173bf-c4a1-4f5f-a1a3-561eeeee6a25 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:13.742660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-881173bf-c4a1-4f5f-a1a3-561eeeee6a25 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:13.761365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-881173bf-c4a1-4f5f-a1a3-561eeeee6a25 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:13.764028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-881173bf-c4a1-4f5f-a1a3-561eeeee6a25 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:13.778460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-881173bf-c4a1-4f5f-a1a3-561eeeee6a25 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:13.785364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-881173bf-c4a1-4f5f-a1a3-561eeeee6a25 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:14.443236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-81eba60e-2c5c-42f1-b094-be21c251fbf5 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:14.444384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-81eba60e-2c5c-42f1-b094-be21c251fbf5 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:14.463432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81eba60e-2c5c-42f1-b094-be21c251fbf5 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:14.466608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81eba60e-2c5c-42f1-b094-be21c251fbf5 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:14.468575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81eba60e-2c5c-42f1-b094-be21c251fbf5 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:14.475430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81eba60e-2c5c-42f1-b094-be21c251fbf5 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:14.847866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-81eba60e-2c5c-42f1-b094-be21c251fbf5 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:14.856761 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-81eba60e-2c5c-42f1-b094-be21c251fbf5 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1215 microversion: 2.1 time: 0.417623 May 19 05:06:14.867534 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2818/5559] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:14 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1215 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:15.147179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-881173bf-c4a1-4f5f-a1a3-561eeeee6a25 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:15.161530 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-881173bf-c4a1-4f5f-a1a3-561eeeee6a25 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1471 microversion: 2.1 time: 1.420243 May 19 05:06:15.165420 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2742/5560] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:13 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1471 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:15.883890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d0937564-3e58-4965-a93a-44b88c2e5e46 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:15.885207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d0937564-3e58-4965-a93a-44b88c2e5e46 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:15.912835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0937564-3e58-4965-a93a-44b88c2e5e46 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:15.913689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0937564-3e58-4965-a93a-44b88c2e5e46 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:15.914707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0937564-3e58-4965-a93a-44b88c2e5e46 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:15.915551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d0937564-3e58-4965-a93a-44b88c2e5e46 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:16.071859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d0937564-3e58-4965-a93a-44b88c2e5e46 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:16.080664 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d0937564-3e58-4965-a93a-44b88c2e5e46 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1277 microversion: 2.1 time: 0.200822 May 19 05:06:16.088437 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2819/5561] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:15 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:16.182667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-847fae09-409e-4adc-b58d-c80a4ba593be tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:16.184555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-847fae09-409e-4adc-b58d-c80a4ba593be tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:16.202707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-847fae09-409e-4adc-b58d-c80a4ba593be tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:16.203361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-847fae09-409e-4adc-b58d-c80a4ba593be tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:16.204325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-847fae09-409e-4adc-b58d-c80a4ba593be tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:16.204930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-847fae09-409e-4adc-b58d-c80a4ba593be tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:16.577954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-847fae09-409e-4adc-b58d-c80a4ba593be tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:16.591661 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-847fae09-409e-4adc-b58d-c80a4ba593be tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1644 microversion: 2.1 time: 0.412735 May 19 05:06:16.593106 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2743/5562] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:16 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1644 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:16.614449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c52a372-5656-46e8-9c0c-c2f6628c0f04 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:16.614449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9c52a372-5656-46e8-9c0c-c2f6628c0f04 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:16.621983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c52a372-5656-46e8-9c0c-c2f6628c0f04 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:16.622501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c52a372-5656-46e8-9c0c-c2f6628c0f04 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:16.624416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c52a372-5656-46e8-9c0c-c2f6628c0f04 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:16.624981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c52a372-5656-46e8-9c0c-c2f6628c0f04 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:16.914486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c52a372-5656-46e8-9c0c-c2f6628c0f04 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:16.941038 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c52a372-5656-46e8-9c0c-c2f6628c0f04 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1644 microversion: 2.1 time: 0.332030 May 19 05:06:16.957788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a751d3a-4f66-4d6e-9138-5ea2e4c182c1 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:16.957998 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2820/5563] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:16 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1644 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:16.959054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3a751d3a-4f66-4d6e-9138-5ea2e4c182c1 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:16.971228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a751d3a-4f66-4d6e-9138-5ea2e4c182c1 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:16.972791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a751d3a-4f66-4d6e-9138-5ea2e4c182c1 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:16.974078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a751d3a-4f66-4d6e-9138-5ea2e4c182c1 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:16.978629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a751d3a-4f66-4d6e-9138-5ea2e4c182c1 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:17.109438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-25ba7860-d914-4875-8ea4-0e4a70edb779 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:17.110279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-25ba7860-d914-4875-8ea4-0e4a70edb779 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:17.123380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25ba7860-d914-4875-8ea4-0e4a70edb779 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:17.130299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25ba7860-d914-4875-8ea4-0e4a70edb779 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:17.131921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25ba7860-d914-4875-8ea4-0e4a70edb779 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:17.133051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25ba7860-d914-4875-8ea4-0e4a70edb779 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:17.777579 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a751d3a-4f66-4d6e-9138-5ea2e4c182c1 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1797 microversion: 2.1 time: 0.823431 May 19 05:06:17.782794 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2744/5564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:16 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1797 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:17.836344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-25ba7860-d914-4875-8ea4-0e4a70edb779 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:17.863662 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-25ba7860-d914-4875-8ea4-0e4a70edb779 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1319 microversion: 2.1 time: 0.748103 May 19 05:06:17.864351 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2821/5565] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:17 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1319 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:18.879694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-07a3f760-197c-4027-b050-daa01cb7a5b3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:18.880478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-07a3f760-197c-4027-b050-daa01cb7a5b3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:18.887590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07a3f760-197c-4027-b050-daa01cb7a5b3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:18.899700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07a3f760-197c-4027-b050-daa01cb7a5b3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:18.900703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07a3f760-197c-4027-b050-daa01cb7a5b3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:18.902257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07a3f760-197c-4027-b050-daa01cb7a5b3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:19.493591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-07a3f760-197c-4027-b050-daa01cb7a5b3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:19.503103 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-07a3f760-197c-4027-b050-daa01cb7a5b3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1319 microversion: 2.1 time: 0.627179 May 19 05:06:19.514485 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2745/5566] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:18 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:19.855496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8faa6bba-eb92-49ca-93ae-f0d06eb91cf2 req-372cfec0-7ca6-49e5-8826-55e9db55f529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743ae7dd-d080-4bbc-9ac0-3ff80d2f42da", "tag": "71ad7570-687a-48b4-bbf3-4690ee02575d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:19.875116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8faa6bba-eb92-49ca-93ae-f0d06eb91cf2 req-372cfec0-7ca6-49e5-8826-55e9db55f529 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:19.876318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8faa6bba-eb92-49ca-93ae-f0d06eb91cf2 req-372cfec0-7ca6-49e5-8826-55e9db55f529 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:19.919601 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8faa6bba-eb92-49ca-93ae-f0d06eb91cf2 req-372cfec0-7ca6-49e5-8826-55e9db55f529 service nova] Creating event network-changed:71ad7570-687a-48b4-bbf3-4690ee02575d for instance 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da on n-h1-766726-30 May 19 05:06:19.932628 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8faa6bba-eb92-49ca-93ae-f0d06eb91cf2 req-372cfec0-7ca6-49e5-8826-55e9db55f529 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080094 May 19 05:06:19.934521 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2822/5567] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:06:20.521176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21e84c51-67a8-4036-b8cc-c6452dab2bd9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:20.521801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-21e84c51-67a8-4036-b8cc-c6452dab2bd9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:20.529673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21e84c51-67a8-4036-b8cc-c6452dab2bd9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:20.530132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21e84c51-67a8-4036-b8cc-c6452dab2bd9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:20.530919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21e84c51-67a8-4036-b8cc-c6452dab2bd9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:20.531357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21e84c51-67a8-4036-b8cc-c6452dab2bd9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:21.007206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-21e84c51-67a8-4036-b8cc-c6452dab2bd9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:21.035241 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21e84c51-67a8-4036-b8cc-c6452dab2bd9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1319 microversion: 2.1 time: 0.516587 May 19 05:06:21.039170 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2746/5568] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:20 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:22.056979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c56333a-efaa-48ca-8b62-df83d9ef346e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:22.057844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4c56333a-efaa-48ca-8b62-df83d9ef346e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:22.076795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c56333a-efaa-48ca-8b62-df83d9ef346e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:22.077514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c56333a-efaa-48ca-8b62-df83d9ef346e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:22.078851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c56333a-efaa-48ca-8b62-df83d9ef346e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:22.080009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c56333a-efaa-48ca-8b62-df83d9ef346e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:23.385400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c56333a-efaa-48ca-8b62-df83d9ef346e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:23.398369 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c56333a-efaa-48ca-8b62-df83d9ef346e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1319 microversion: 2.1 time: 1.346339 May 19 05:06:23.408841 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2823/5569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:22 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1319 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:23.942196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-eed3242b-34c1-4d12-8d08-9bcee2ef04ee req-39d7e2ee-508c-4be5-9242-13102788ee1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95677ab7-a536-4db0-b058-1bd8a4d04239", "tag": "80a687ec-e67f-44e9-9622-aa2b07f1f1cd"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:23.959083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:23.960149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:23.962814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-eed3242b-34c1-4d12-8d08-9bcee2ef04ee req-39d7e2ee-508c-4be5-9242-13102788ee1c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:23.963455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-eed3242b-34c1-4d12-8d08-9bcee2ef04ee req-39d7e2ee-508c-4be5-9242-13102788ee1c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:23.999870 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-eed3242b-34c1-4d12-8d08-9bcee2ef04ee req-39d7e2ee-508c-4be5-9242-13102788ee1c service nova] Creating event network-changed:80a687ec-e67f-44e9-9622-aa2b07f1f1cd for instance 95677ab7-a536-4db0-b058-1bd8a4d04239 on n-h2-766726-30 May 19 05:06:24.016324 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-eed3242b-34c1-4d12-8d08-9bcee2ef04ee req-39d7e2ee-508c-4be5-9242-13102788ee1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086502 May 19 05:06:24.017673 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2747/5570] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:06:24.416405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-30eeb6aa-320e-448a-b9e4-e11fc78bd10c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:24.424693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-30eeb6aa-320e-448a-b9e4-e11fc78bd10c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:24.462914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:24.481567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:24.483332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30eeb6aa-320e-448a-b9e4-e11fc78bd10c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:24.485886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30eeb6aa-320e-448a-b9e4-e11fc78bd10c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:24.486725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30eeb6aa-320e-448a-b9e4-e11fc78bd10c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:24.490906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30eeb6aa-320e-448a-b9e4-e11fc78bd10c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:25.005773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5b954dc-584e-451a-ba08-27835cb1033a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'create', calling method: .version_select at 0x7fd31448f160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-968650700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZqj6AA/+RzT6DfAc42dO/o5dFuW+99tk0gkOfEIFo0zupODQWEaCwI6PWf2JeFDDD23ne5szPo4cWXnw30FoxCmkRQTeUprgR6RSh7ICTy9sJW0WhCAmirOAkWy9UiUA=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:25.050375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b5b954dc-584e-451a-ba08-27835cb1033a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:06:25.067873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b5b954dc-584e-451a-ba08-27835cb1033a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for user 195b7b4b7d384374ac86bdeaf7568026 and project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:06:25.141353 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5b954dc-584e-451a-ba08-27835cb1033a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.664533 May 19 05:06:25.148384 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2748/5571] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:06:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:06:25.295067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-30eeb6aa-320e-448a-b9e4-e11fc78bd10c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:25.310041 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-30eeb6aa-320e-448a-b9e4-e11fc78bd10c tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1319 microversion: 2.1 time: 0.898125 May 19 05:06:25.314311 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2824/5572] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:24 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1319 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:25.539943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3d2f03c0-0025-4c62-a53d-bae57401ee7b req-cef5ae4b-79ad-46c3-a8ca-13a6fa445837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743ae7dd-d080-4bbc-9ac0-3ff80d2f42da", "name": "network-vif-plugged", "status": "completed", "tag": "71ad7570-687a-48b4-bbf3-4690ee02575d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:25.566579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3d2f03c0-0025-4c62-a53d-bae57401ee7b req-cef5ae4b-79ad-46c3-a8ca-13a6fa445837 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:25.567789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3d2f03c0-0025-4c62-a53d-bae57401ee7b req-cef5ae4b-79ad-46c3-a8ca-13a6fa445837 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:25.599656 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3d2f03c0-0025-4c62-a53d-bae57401ee7b req-cef5ae4b-79ad-46c3-a8ca-13a6fa445837 service nova] Creating event network-vif-plugged:71ad7570-687a-48b4-bbf3-4690ee02575d for instance 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da on n-h1-766726-30 May 19 05:06:25.625485 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3d2f03c0-0025-4c62-a53d-bae57401ee7b req-cef5ae4b-79ad-46c3-a8ca-13a6fa445837 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091101 May 19 05:06:25.626113 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2749/5573] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:06:26.332498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-db18946d-d702-4654-8b66-1ec0cd967725 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:26.333456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-db18946d-d702-4654-8b66-1ec0cd967725 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:26.351526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db18946d-d702-4654-8b66-1ec0cd967725 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:26.352203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db18946d-d702-4654-8b66-1ec0cd967725 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:26.354040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db18946d-d702-4654-8b66-1ec0cd967725 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:26.358077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-db18946d-d702-4654-8b66-1ec0cd967725 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:26.884695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-db18946d-d702-4654-8b66-1ec0cd967725 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:26.887516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=89 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:26.895961 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-db18946d-d702-4654-8b66-1ec0cd967725 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1319 microversion: 2.1 time: 0.569228 May 19 05:06:26.897478 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2825/5574] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:26 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:27.915714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6160ed41-8cd3-4034-912c-af794a18458e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:27.916435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6160ed41-8cd3-4034-912c-af794a18458e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:27.933975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6160ed41-8cd3-4034-912c-af794a18458e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:27.936136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6160ed41-8cd3-4034-912c-af794a18458e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:27.940282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6160ed41-8cd3-4034-912c-af794a18458e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:27.941934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6160ed41-8cd3-4034-912c-af794a18458e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:28.746498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6160ed41-8cd3-4034-912c-af794a18458e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:28.773556 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6160ed41-8cd3-4034-912c-af794a18458e tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1507 microversion: 2.1 time: 0.862811 May 19 05:06:28.792713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4168b55f-0260-4d21-ae64-2ad49159b82f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "778a672b-8b1b-483c-a26c-e0230dad88bd", "device": "/dev/sdb"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:28.793897 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2750/5575] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:27 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1507 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:28.795055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4168b55f-0260-4d21-ae64-2ad49159b82f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:28.808976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4168b55f-0260-4d21-ae64-2ad49159b82f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:28.809524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4168b55f-0260-4d21-ae64-2ad49159b82f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:28.810528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4168b55f-0260-4d21-ae64-2ad49159b82f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:28.810990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4168b55f-0260-4d21-ae64-2ad49159b82f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:29.268473 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4168b55f-0260-4d21-ae64-2ad49159b82f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "POST /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481611 May 19 05:06:29.269906 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2826/5576] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 05:06:28 2022] POST /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:06:40.733609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1382739306", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "0d824292-85cc-40b4-a57c-2cbab4308141"}], "key_name": "tempest-TestNetworkAdvancedServerOps-968650700", "security_groups": [{"name": "tempest-secgroup-smoke-1531867588"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:40.756833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:40.759024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:40.762542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=62 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:41.009003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] validate_networks() for [('0d824292-85cc-40b4-a57c-2cbab4308141', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:06:41.736867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:06:41.737549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:06:41.737908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:06:41.738395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:06:41.738907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:06:41.759239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:41.760567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:41.762429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:41.764143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:41.811585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:06:41.825790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for user 195b7b4b7d384374ac86bdeaf7568026 and project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:06:41.856407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:06:41.860837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:06:41.977834 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8e1ff2d-477e-4019-9d4f-b148ee549587 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.246785 May 19 05:06:41.980601 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2751/5577] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:06:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:06:41.994437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=5 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:41.996556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:42.001795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-259e9147-8c53-458d-8a3a-8b9fe15929b4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:42.003634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-259e9147-8c53-458d-8a3a-8b9fe15929b4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:42.096118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-259e9147-8c53-458d-8a3a-8b9fe15929b4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:42.105780 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-259e9147-8c53-458d-8a3a-8b9fe15929b4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1266 microversion: 2.1 time: 0.117384 May 19 05:06:42.106996 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2827/5578] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:41 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:43.134933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-76cb1633-22b2-47e1-9e60-9b605d55a66c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:43.138201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-76cb1633-22b2-47e1-9e60-9b605d55a66c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:43.170533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76cb1633-22b2-47e1-9e60-9b605d55a66c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:43.172278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76cb1633-22b2-47e1-9e60-9b605d55a66c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:43.174364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76cb1633-22b2-47e1-9e60-9b605d55a66c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:43.177543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76cb1633-22b2-47e1-9e60-9b605d55a66c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:43.459873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-76cb1633-22b2-47e1-9e60-9b605d55a66c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:43.475630 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-76cb1633-22b2-47e1-9e60-9b605d55a66c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1270 microversion: 2.1 time: 0.352772 May 19 05:06:43.487617 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2752/5579] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:43 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1270 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:44.495423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ca75df5-5a6d-4f37-9ce5-ad4acf6f614f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:44.496041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2ca75df5-5a6d-4f37-9ce5-ad4acf6f614f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:44.511858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ca75df5-5a6d-4f37-9ce5-ad4acf6f614f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:44.512999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ca75df5-5a6d-4f37-9ce5-ad4acf6f614f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:44.513922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ca75df5-5a6d-4f37-9ce5-ad4acf6f614f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:44.514370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ca75df5-5a6d-4f37-9ce5-ad4acf6f614f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:45.446870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2ca75df5-5a6d-4f37-9ce5-ad4acf6f614f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:45.458744 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ca75df5-5a6d-4f37-9ce5-ad4acf6f614f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1324 microversion: 2.1 time: 0.967088 May 19 05:06:45.460830 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2828/5580] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:44 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1324 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:46.482393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e06cc2f-a120-4706-a287-21be13219369 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:46.484673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e06cc2f-a120-4706-a287-21be13219369 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:46.514608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e06cc2f-a120-4706-a287-21be13219369 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:46.517551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e06cc2f-a120-4706-a287-21be13219369 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:46.528983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e06cc2f-a120-4706-a287-21be13219369 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:46.530375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e06cc2f-a120-4706-a287-21be13219369 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:47.249194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e06cc2f-a120-4706-a287-21be13219369 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:47.262127 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e06cc2f-a120-4706-a287-21be13219369 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1392 microversion: 2.1 time: 0.785392 May 19 05:06:47.271388 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2753/5581] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:46 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1392 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:47.626273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4301f69f-9e23-4c0f-8ec5-b8ddb311bca3 req-9a137555-1670-43c4-8632-5235ec596949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d595b36-cd30-410e-90c7-15d27167c094", "tag": "1f49550d-4db4-4a59-8f47-781f3f1bb08f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:47.647173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4301f69f-9e23-4c0f-8ec5-b8ddb311bca3 req-9a137555-1670-43c4-8632-5235ec596949 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:47.648440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4301f69f-9e23-4c0f-8ec5-b8ddb311bca3 req-9a137555-1670-43c4-8632-5235ec596949 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:47.697513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4301f69f-9e23-4c0f-8ec5-b8ddb311bca3 req-9a137555-1670-43c4-8632-5235ec596949 service nova] Creating event network-changed:1f49550d-4db4-4a59-8f47-781f3f1bb08f for instance 5d595b36-cd30-410e-90c7-15d27167c094 on n-h2-766726-30 May 19 05:06:47.730070 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4301f69f-9e23-4c0f-8ec5-b8ddb311bca3 req-9a137555-1670-43c4-8632-5235ec596949 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099730 May 19 05:06:47.730793 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2829/5582] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:06:48.286599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3ed543b-cfbf-403c-b480-a5c05e58dd89 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:48.288720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3ed543b-cfbf-403c-b480-a5c05e58dd89 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:48.307088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3ed543b-cfbf-403c-b480-a5c05e58dd89 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:48.308794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3ed543b-cfbf-403c-b480-a5c05e58dd89 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:48.311101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3ed543b-cfbf-403c-b480-a5c05e58dd89 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:48.311770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3ed543b-cfbf-403c-b480-a5c05e58dd89 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:48.866485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3ed543b-cfbf-403c-b480-a5c05e58dd89 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:48.889756 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3ed543b-cfbf-403c-b480-a5c05e58dd89 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1392 microversion: 2.1 time: 0.613586 May 19 05:06:48.892777 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2754/5583] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:48 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1392 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:49.916720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-30557f6e-bc1c-4b5e-9859-d061eeb3101c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:49.919875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-30557f6e-bc1c-4b5e-9859-d061eeb3101c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:49.943172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30557f6e-bc1c-4b5e-9859-d061eeb3101c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:49.943634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30557f6e-bc1c-4b5e-9859-d061eeb3101c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:49.944436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30557f6e-bc1c-4b5e-9859-d061eeb3101c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:49.944888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-30557f6e-bc1c-4b5e-9859-d061eeb3101c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:50.497037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-30557f6e-bc1c-4b5e-9859-d061eeb3101c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:50.510144 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-30557f6e-bc1c-4b5e-9859-d061eeb3101c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1392 microversion: 2.1 time: 0.605286 May 19 05:06:50.511352 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2830/5584] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:49 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1392 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:51.527682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1eddee1c-c9e9-47a1-8b93-fd546a40d3cc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:51.528285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1eddee1c-c9e9-47a1-8b93-fd546a40d3cc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:51.547412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1eddee1c-c9e9-47a1-8b93-fd546a40d3cc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:51.547868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1eddee1c-c9e9-47a1-8b93-fd546a40d3cc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:51.548668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1eddee1c-c9e9-47a1-8b93-fd546a40d3cc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:51.549133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1eddee1c-c9e9-47a1-8b93-fd546a40d3cc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:51.787113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:51.849143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:51.959495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1eddee1c-c9e9-47a1-8b93-fd546a40d3cc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:51.968031 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1eddee1c-c9e9-47a1-8b93-fd546a40d3cc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1392 microversion: 2.1 time: 0.444126 May 19 05:06:51.968626 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2755/5585] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:51 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:52.983517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:06:52.988131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-15e2dad1-9761-4f79-b87f-febd5d1082b6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:52.988944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-15e2dad1-9761-4f79-b87f-febd5d1082b6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:53.004852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15e2dad1-9761-4f79-b87f-febd5d1082b6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:53.005573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15e2dad1-9761-4f79-b87f-febd5d1082b6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:53.006519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15e2dad1-9761-4f79-b87f-febd5d1082b6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:53.007131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15e2dad1-9761-4f79-b87f-febd5d1082b6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:53.210619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-15e2dad1-9761-4f79-b87f-febd5d1082b6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:53.220425 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-15e2dad1-9761-4f79-b87f-febd5d1082b6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1392 microversion: 2.1 time: 0.238587 May 19 05:06:53.230282 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2831/5586] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:52 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:53.585639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9a8119f7-7d7e-4344-95ee-c9b6bdba9fff req-cc769fbe-6a33-423e-862f-480d61e800ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d595b36-cd30-410e-90c7-15d27167c094", "name": "network-vif-plugged", "status": "completed", "tag": "1f49550d-4db4-4a59-8f47-781f3f1bb08f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:06:53.607317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9a8119f7-7d7e-4344-95ee-c9b6bdba9fff req-cc769fbe-6a33-423e-862f-480d61e800ef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:53.608604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9a8119f7-7d7e-4344-95ee-c9b6bdba9fff req-cc769fbe-6a33-423e-862f-480d61e800ef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:53.641014 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9a8119f7-7d7e-4344-95ee-c9b6bdba9fff req-cc769fbe-6a33-423e-862f-480d61e800ef service nova] Creating event network-vif-plugged:1f49550d-4db4-4a59-8f47-781f3f1bb08f for instance 5d595b36-cd30-410e-90c7-15d27167c094 on n-h2-766726-30 May 19 05:06:53.651715 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9a8119f7-7d7e-4344-95ee-c9b6bdba9fff req-cc769fbe-6a33-423e-862f-480d61e800ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069624 May 19 05:06:53.652884 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2756/5587] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:06:54.238906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c72417ab-e6c0-43fd-b916-eb0f6e0d8901 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:54.240222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c72417ab-e6c0-43fd-b916-eb0f6e0d8901 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:54.256627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c72417ab-e6c0-43fd-b916-eb0f6e0d8901 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:54.261621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c72417ab-e6c0-43fd-b916-eb0f6e0d8901 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:54.262716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c72417ab-e6c0-43fd-b916-eb0f6e0d8901 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:54.263348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c72417ab-e6c0-43fd-b916-eb0f6e0d8901 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:54.732344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c72417ab-e6c0-43fd-b916-eb0f6e0d8901 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:54.740973 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c72417ab-e6c0-43fd-b916-eb0f6e0d8901 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1392 microversion: 2.1 time: 0.506892 May 19 05:06:54.750234 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2832/5588] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:54 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1392 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:55.764927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-63ef4b9c-438c-47e5-b536-8788f18467c3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:55.766516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-63ef4b9c-438c-47e5-b536-8788f18467c3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:55.779599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63ef4b9c-438c-47e5-b536-8788f18467c3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:55.781812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63ef4b9c-438c-47e5-b536-8788f18467c3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:55.784480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63ef4b9c-438c-47e5-b536-8788f18467c3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:55.785286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-63ef4b9c-438c-47e5-b536-8788f18467c3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:56.787860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-63ef4b9c-438c-47e5-b536-8788f18467c3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:56.796445 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-63ef4b9c-438c-47e5-b536-8788f18467c3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1563 microversion: 2.1 time: 1.036080 May 19 05:06:56.807717 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2757/5589] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:55 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1563 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:06:56.813790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e158986b-dbcf-47bd-b6a9-8024d0084757 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:06:56.814419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e158986b-dbcf-47bd-b6a9-8024d0084757 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:06:56.826499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e158986b-dbcf-47bd-b6a9-8024d0084757 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:56.835225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e158986b-dbcf-47bd-b6a9-8024d0084757 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:56.836264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e158986b-dbcf-47bd-b6a9-8024d0084757 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:06:56.836894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e158986b-dbcf-47bd-b6a9-8024d0084757 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:06:57.268692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e158986b-dbcf-47bd-b6a9-8024d0084757 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:06:57.291665 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e158986b-dbcf-47bd-b6a9-8024d0084757 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1563 microversion: 2.1 time: 0.477798 May 19 05:06:57.292602 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2833/5590] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:06:56 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1563 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:01.902067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-461b45d7-0b47-4736-9e8a-5c7136a37536 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:01.903416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-461b45d7-0b47-4736-9e8a-5c7136a37536 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:01.916463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-461b45d7-0b47-4736-9e8a-5c7136a37536 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:01.918215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-461b45d7-0b47-4736-9e8a-5c7136a37536 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:01.920797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-392e26d6-2bb4-4622-b138-7a169987f71a req-36b1a1c5-f9f5-44ba-adab-01defaca1a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d595b36-cd30-410e-90c7-15d27167c094", "tag": "1f49550d-4db4-4a59-8f47-781f3f1bb08f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:01.922081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-461b45d7-0b47-4736-9e8a-5c7136a37536 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:01.922720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-461b45d7-0b47-4736-9e8a-5c7136a37536 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:01.939562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-392e26d6-2bb4-4622-b138-7a169987f71a req-36b1a1c5-f9f5-44ba-adab-01defaca1a69 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:01.941474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-392e26d6-2bb4-4622-b138-7a169987f71a req-36b1a1c5-f9f5-44ba-adab-01defaca1a69 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:01.967144 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-392e26d6-2bb4-4622-b138-7a169987f71a req-36b1a1c5-f9f5-44ba-adab-01defaca1a69 service nova] Creating event network-changed:1f49550d-4db4-4a59-8f47-781f3f1bb08f for instance 5d595b36-cd30-410e-90c7-15d27167c094 on n-h2-766726-30 May 19 05:07:01.978715 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-392e26d6-2bb4-4622-b138-7a169987f71a req-36b1a1c5-f9f5-44ba-adab-01defaca1a69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060071 May 19 05:07:01.982633 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2834/5591] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:03.171068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-461b45d7-0b47-4736-9e8a-5c7136a37536 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:03.179201 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-461b45d7-0b47-4736-9e8a-5c7136a37536 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1563 microversion: 2.1 time: 1.281124 May 19 05:07:03.205475 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2758/5592] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:01 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1563 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:04.546479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1086668616", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "fd03d2d3-fa1a-47f8-a367-3028dfc6473b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1247604620", "security_groups": []}, "os:scheduler_hints": {"different_host": ["95677ab7-a536-4db0-b058-1bd8a4d04239"]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:04.699634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] validate_networks() for [('fd03d2d3-fa1a-47f8-a367-3028dfc6473b', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:07:05.940544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:07:05.941931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:07:05.942688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:07:05.943396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:07:05.944281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:07:05.973336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:05.975460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:05.978503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:05.981351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:06.018088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Getting quotas for project e9a0bffaa990446a9163b476f462fff2. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:07:06.026285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Getting quotas for user 00b4c70b8f224ac6b5c292563bad8651 and project e9a0bffaa990446a9163b476f462fff2. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:07:06.052166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:07:06.056995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:07:06.204303 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-19d6ac1d-de7b-4d7c-8f97-7d4a6ad27557 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.662852 May 19 05:07:06.207271 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2835/5593] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:07:04 2022] POST /compute/v2.1/servers => generated 361 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:07:06.219601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-244256a0-81f6-492a-a3ea-02a71bd73c22 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:06.221493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-244256a0-81f6-492a-a3ea-02a71bd73c22 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:06.374641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-244256a0-81f6-492a-a3ea-02a71bd73c22 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:06.400719 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-244256a0-81f6-492a-a3ea-02a71bd73c22 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1242 microversion: 2.1 time: 0.187327 May 19 05:07:06.407594 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2759/5594] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:06 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:07.436274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a415a393-9ed0-40d5-814a-44a690681cdc tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:07.447272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a415a393-9ed0-40d5-814a-44a690681cdc tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:07.508460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a415a393-9ed0-40d5-814a-44a690681cdc tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:07.509569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a415a393-9ed0-40d5-814a-44a690681cdc tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:07.516060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a415a393-9ed0-40d5-814a-44a690681cdc tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:07.517652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a415a393-9ed0-40d5-814a-44a690681cdc tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:07.839266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a415a393-9ed0-40d5-814a-44a690681cdc tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:07.846888 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a415a393-9ed0-40d5-814a-44a690681cdc tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1238 microversion: 2.1 time: 0.426979 May 19 05:07:07.847484 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2836/5595] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:07 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1238 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:08.865178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-357ebfc9-c21a-409b-ac54-f480f0916204 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:08.865800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-357ebfc9-c21a-409b-ac54-f480f0916204 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:08.873386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-357ebfc9-c21a-409b-ac54-f480f0916204 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:08.884253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-357ebfc9-c21a-409b-ac54-f480f0916204 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:08.885496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-357ebfc9-c21a-409b-ac54-f480f0916204 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:08.887549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-357ebfc9-c21a-409b-ac54-f480f0916204 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:08.928008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-120640968", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "e6ffdbaf-dc07-4487-bc33-88a31cc0a8f8"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:09.049479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] validate_networks() for [('e6ffdbaf-dc07-4487-bc33-88a31cc0a8f8', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:07:09.171155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-357ebfc9-c21a-409b-ac54-f480f0916204 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:09.179344 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-357ebfc9-c21a-409b-ac54-f480f0916204 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1300 microversion: 2.1 time: 0.318820 May 19 05:07:09.188069 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2837/5596] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:08 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1300 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:09.877405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-44b46b49-cb72-4912-883f-222b129a0ae0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946-project-admin] Calling method '.version_select at 0x7fd314b99790>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:09.878457 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:07:09.878457 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:07:09.880423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44b46b49-cb72-4912-883f-222b129a0ae0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:09.881156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44b46b49-cb72-4912-883f-222b129a0ae0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:09.915601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44b46b49-cb72-4912-883f-222b129a0ae0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:09.916309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44b46b49-cb72-4912-883f-222b129a0ae0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:09.934722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44b46b49-cb72-4912-883f-222b129a0ae0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:09.940442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-44b46b49-cb72-4912-883f-222b129a0ae0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:09.956313 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-44b46b49-cb72-4912-883f-222b129a0ae0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1133207946-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.191946 May 19 05:07:09.957145 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2838/5597] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 05:07:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:10.198264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:07:10.199333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:07:10.200251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:07:10.201041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:07:10.201736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:07:10.204895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5d7cd32f-a60c-4b8a-a547-022e1f4958e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:10.205941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5d7cd32f-a60c-4b8a-a547-022e1f4958e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:10.214469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:10.215589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:10.216652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:10.217202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d7cd32f-a60c-4b8a-a547-022e1f4958e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:10.217657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:10.217782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d7cd32f-a60c-4b8a-a547-022e1f4958e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:10.218455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d7cd32f-a60c-4b8a-a547-022e1f4958e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:10.218902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d7cd32f-a60c-4b8a-a547-022e1f4958e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:10.255190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Getting quotas for project 90b146ac9b7f4af9b96292cc4671ab4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:07:10.271086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Getting quotas for user 9be83276d8444c30a17edf961c0fa19b and project 90b146ac9b7f4af9b96292cc4671ab4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:07:10.297401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:07:10.301557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:07:10.512412 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-139ee2ae-680b-48ee-b8e3-f184ef7365be tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.833285 May 19 05:07:10.519747 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2760/5598] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:07:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:07:10.543896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8782cb4c-5776-48e9-a74b-27ad550021e2 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:10.556639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8782cb4c-5776-48e9-a74b-27ad550021e2 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:10.897364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8782cb4c-5776-48e9-a74b-27ad550021e2 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:10.906816 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8782cb4c-5776-48e9-a74b-27ad550021e2 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1214 microversion: 2.1 time: 0.385694 May 19 05:07:10.924076 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2761/5599] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:10 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1214 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:10.963473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d7cd32f-a60c-4b8a-a547-022e1f4958e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:10.979400 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5d7cd32f-a60c-4b8a-a547-022e1f4958e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1300 microversion: 2.1 time: 0.778217 May 19 05:07:10.982881 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2839/5600] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:10 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1300 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:11.932234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74781e2a-c291-4340-94de-40203f51ee23 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:11.933191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74781e2a-c291-4340-94de-40203f51ee23 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:11.943837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:11.947956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74781e2a-c291-4340-94de-40203f51ee23 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:11.948917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74781e2a-c291-4340-94de-40203f51ee23 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:11.949953 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74781e2a-c291-4340-94de-40203f51ee23 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:11.950831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74781e2a-c291-4340-94de-40203f51ee23 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:12.016455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-638b25c8-72a8-4c93-87a4-e35b6a82b2ea tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:12.017123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-638b25c8-72a8-4c93-87a4-e35b6a82b2ea tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:12.033865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=43 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:12.058033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:12.091884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638b25c8-72a8-4c93-87a4-e35b6a82b2ea tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:12.093628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638b25c8-72a8-4c93-87a4-e35b6a82b2ea tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:12.098255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638b25c8-72a8-4c93-87a4-e35b6a82b2ea tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:12.101113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638b25c8-72a8-4c93-87a4-e35b6a82b2ea tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:12.122710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=61 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:12.151354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74781e2a-c291-4340-94de-40203f51ee23 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:12.166745 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74781e2a-c291-4340-94de-40203f51ee23 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1266 microversion: 2.1 time: 0.240602 May 19 05:07:12.175875 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2762/5601] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:11 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:12.296463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-638b25c8-72a8-4c93-87a4-e35b6a82b2ea tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:12.304553 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-638b25c8-72a8-4c93-87a4-e35b6a82b2ea tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1300 microversion: 2.1 time: 0.300601 May 19 05:07:12.317518 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2840/5602] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:12 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1300 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:13.185693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9a97bb76-3c4f-4110-9b9b-808cbedfb004 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:13.188762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9a97bb76-3c4f-4110-9b9b-808cbedfb004 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:13.198922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a97bb76-3c4f-4110-9b9b-808cbedfb004 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:13.199687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a97bb76-3c4f-4110-9b9b-808cbedfb004 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:13.200736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a97bb76-3c4f-4110-9b9b-808cbedfb004 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:13.201384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a97bb76-3c4f-4110-9b9b-808cbedfb004 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:13.288927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a68a12e1-e179-446e-b6f0-c47511e715fe req-7d46fbde-1a19-4097-9b32-8b8a575f5a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc", "tag": "c0a218b5-4b09-4f85-b832-d893f6dab1a7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:13.304249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a68a12e1-e179-446e-b6f0-c47511e715fe req-7d46fbde-1a19-4097-9b32-8b8a575f5a2d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:13.312937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9a97bb76-3c4f-4110-9b9b-808cbedfb004 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:13.340756 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9a97bb76-3c4f-4110-9b9b-808cbedfb004 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1272 microversion: 2.1 time: 0.160911 May 19 05:07:13.345431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a68a12e1-e179-446e-b6f0-c47511e715fe req-7d46fbde-1a19-4097-9b32-8b8a575f5a2d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:13.349901 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2763/5603] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:13 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:13.361985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4cf7724-06b7-493b-bf1d-dfd9294c7a1a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:13.370562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f4cf7724-06b7-493b-bf1d-dfd9294c7a1a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:13.394108 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a68a12e1-e179-446e-b6f0-c47511e715fe req-7d46fbde-1a19-4097-9b32-8b8a575f5a2d service nova] Creating event network-changed:c0a218b5-4b09-4f85-b832-d893f6dab1a7 for instance 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc on n-h1-766726-30 May 19 05:07:13.403757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4cf7724-06b7-493b-bf1d-dfd9294c7a1a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:13.412674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4cf7724-06b7-493b-bf1d-dfd9294c7a1a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:13.413742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4cf7724-06b7-493b-bf1d-dfd9294c7a1a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:13.414204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4cf7724-06b7-493b-bf1d-dfd9294c7a1a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:13.424826 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a68a12e1-e179-446e-b6f0-c47511e715fe req-7d46fbde-1a19-4097-9b32-8b8a575f5a2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139105 May 19 05:07:13.429929 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2841/5604] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:07:13.765809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4cf7724-06b7-493b-bf1d-dfd9294c7a1a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:13.778967 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4cf7724-06b7-493b-bf1d-dfd9294c7a1a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1300 microversion: 2.1 time: 0.426609 May 19 05:07:13.781656 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2764/5605] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:13 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1300 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:14.370532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-807b289b-c79e-4e71-b201-fd54dae50126 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:14.373278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-807b289b-c79e-4e71-b201-fd54dae50126 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:14.389276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-807b289b-c79e-4e71-b201-fd54dae50126 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:14.390320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-807b289b-c79e-4e71-b201-fd54dae50126 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:14.391319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-807b289b-c79e-4e71-b201-fd54dae50126 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:14.393791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-807b289b-c79e-4e71-b201-fd54dae50126 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:14.535199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-807b289b-c79e-4e71-b201-fd54dae50126 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:14.547199 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-807b289b-c79e-4e71-b201-fd54dae50126 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1272 microversion: 2.1 time: 0.184187 May 19 05:07:14.553611 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2842/5606] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:14 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:14.798146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d76477bf-dfe7-4bfe-b991-188fd9264c6d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:14.799411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d76477bf-dfe7-4bfe-b991-188fd9264c6d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:14.808058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d76477bf-dfe7-4bfe-b991-188fd9264c6d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:14.808513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d76477bf-dfe7-4bfe-b991-188fd9264c6d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:14.809333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d76477bf-dfe7-4bfe-b991-188fd9264c6d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:14.809800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d76477bf-dfe7-4bfe-b991-188fd9264c6d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:14.996631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d76477bf-dfe7-4bfe-b991-188fd9264c6d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:15.008027 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d76477bf-dfe7-4bfe-b991-188fd9264c6d tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1300 microversion: 2.1 time: 0.213875 May 19 05:07:15.014763 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2765/5607] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:14 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1300 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:15.565007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-22cae7a2-3069-42cd-a58d-058906f6a561 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:15.565613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-22cae7a2-3069-42cd-a58d-058906f6a561 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:15.580299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22cae7a2-3069-42cd-a58d-058906f6a561 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:15.582334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22cae7a2-3069-42cd-a58d-058906f6a561 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:15.583464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22cae7a2-3069-42cd-a58d-058906f6a561 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:15.585768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22cae7a2-3069-42cd-a58d-058906f6a561 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:16.005675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:16.035190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f52a33e9-e4cd-4c4e-a950-085d53f0688b tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:16.035803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f52a33e9-e4cd-4c4e-a950-085d53f0688b tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:16.040109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:16.049874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f52a33e9-e4cd-4c4e-a950-085d53f0688b tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:16.050329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f52a33e9-e4cd-4c4e-a950-085d53f0688b tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:16.053213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f52a33e9-e4cd-4c4e-a950-085d53f0688b tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:16.053771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f52a33e9-e4cd-4c4e-a950-085d53f0688b tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:16.276460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22cae7a2-3069-42cd-a58d-058906f6a561 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:16.302849 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-22cae7a2-3069-42cd-a58d-058906f6a561 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1314 microversion: 2.1 time: 0.742669 May 19 05:07:16.304971 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2843/5608] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:15 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:16.480584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f52a33e9-e4cd-4c4e-a950-085d53f0688b tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:16.501096 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f52a33e9-e4cd-4c4e-a950-085d53f0688b tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1300 microversion: 2.1 time: 0.459969 May 19 05:07:16.530018 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2766/5609] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:16 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1300 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:16.678223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c01fcf4f-733c-46df-a54e-717aac087b79 req-9ab138df-cf04-4e73-8484-3f7e45440ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964b3f31-905d-412c-80d6-de6cdb84fffe", "tag": "c323a22f-6643-4e53-8609-08ca894e9f49"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:16.699871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c01fcf4f-733c-46df-a54e-717aac087b79 req-9ab138df-cf04-4e73-8484-3f7e45440ae7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:16.703052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c01fcf4f-733c-46df-a54e-717aac087b79 req-9ab138df-cf04-4e73-8484-3f7e45440ae7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:16.738067 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c01fcf4f-733c-46df-a54e-717aac087b79 req-9ab138df-cf04-4e73-8484-3f7e45440ae7 service nova] Creating event network-changed:c323a22f-6643-4e53-8609-08ca894e9f49 for instance 964b3f31-905d-412c-80d6-de6cdb84fffe on n-h2-766726-30 May 19 05:07:16.743942 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c01fcf4f-733c-46df-a54e-717aac087b79 req-9ab138df-cf04-4e73-8484-3f7e45440ae7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071383 May 19 05:07:16.746676 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2844/5610] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:17.335934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d9d3c72-d801-494d-9dac-30ca88f68b56 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:17.337296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1d9d3c72-d801-494d-9dac-30ca88f68b56 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:17.373237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d9d3c72-d801-494d-9dac-30ca88f68b56 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:17.374992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d9d3c72-d801-494d-9dac-30ca88f68b56 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:17.381202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d9d3c72-d801-494d-9dac-30ca88f68b56 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:17.394273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d9d3c72-d801-494d-9dac-30ca88f68b56 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:17.536623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-942e3d24-02f3-415d-945a-2cfaa485106a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:17.537391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-942e3d24-02f3-415d-945a-2cfaa485106a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:17.548934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-942e3d24-02f3-415d-945a-2cfaa485106a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:17.549424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-942e3d24-02f3-415d-945a-2cfaa485106a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:17.550225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-942e3d24-02f3-415d-945a-2cfaa485106a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:17.550671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-942e3d24-02f3-415d-945a-2cfaa485106a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:17.875592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-942e3d24-02f3-415d-945a-2cfaa485106a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:17.887003 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-942e3d24-02f3-415d-945a-2cfaa485106a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1300 microversion: 2.1 time: 0.355665 May 19 05:07:17.899568 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2845/5611] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:17 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1300 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:17.985264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1d9d3c72-d801-494d-9dac-30ca88f68b56 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:17.993836 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d9d3c72-d801-494d-9dac-30ca88f68b56 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1314 microversion: 2.1 time: 0.675494 May 19 05:07:18.003012 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2767/5612] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:17 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:18.969039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b5bd812-d50f-40f0-a0cc-c90d4eddaa14 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:18.980176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b5bd812-d50f-40f0-a0cc-c90d4eddaa14 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:19.011866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-81565d30-92f6-4d41-8a04-7d56b40aabc1 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:19.012694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-81565d30-92f6-4d41-8a04-7d56b40aabc1 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:19.029067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81565d30-92f6-4d41-8a04-7d56b40aabc1 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:19.029551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81565d30-92f6-4d41-8a04-7d56b40aabc1 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:19.030364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81565d30-92f6-4d41-8a04-7d56b40aabc1 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:19.030809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81565d30-92f6-4d41-8a04-7d56b40aabc1 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:19.108496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b5bd812-d50f-40f0-a0cc-c90d4eddaa14 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:19.109610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b5bd812-d50f-40f0-a0cc-c90d4eddaa14 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:19.112183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b5bd812-d50f-40f0-a0cc-c90d4eddaa14 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:19.121894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b5bd812-d50f-40f0-a0cc-c90d4eddaa14 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:19.637397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0b5bd812-d50f-40f0-a0cc-c90d4eddaa14 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:19.657740 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b5bd812-d50f-40f0-a0cc-c90d4eddaa14 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1300 microversion: 2.1 time: 0.741453 May 19 05:07:19.658681 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2846/5613] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:18 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1300 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:19.663344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-dc7c9020-83f8-4898-91d9-639e7a538422 req-31710e76-77ec-4170-ba2d-2ef5e57ff3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc", "name": "network-vif-plugged", "status": "completed", "tag": "c0a218b5-4b09-4f85-b832-d893f6dab1a7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:19.698086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dc7c9020-83f8-4898-91d9-639e7a538422 req-31710e76-77ec-4170-ba2d-2ef5e57ff3b4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:19.698841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dc7c9020-83f8-4898-91d9-639e7a538422 req-31710e76-77ec-4170-ba2d-2ef5e57ff3b4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:19.720833 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-dc7c9020-83f8-4898-91d9-639e7a538422 req-31710e76-77ec-4170-ba2d-2ef5e57ff3b4 service nova] Creating event network-vif-plugged:c0a218b5-4b09-4f85-b832-d893f6dab1a7 for instance 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc on n-h1-766726-30 May 19 05:07:19.738816 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-dc7c9020-83f8-4898-91d9-639e7a538422 req-31710e76-77ec-4170-ba2d-2ef5e57ff3b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078829 May 19 05:07:19.739808 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2847/5614] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:19.963125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-81565d30-92f6-4d41-8a04-7d56b40aabc1 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:19.976574 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-81565d30-92f6-4d41-8a04-7d56b40aabc1 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1314 microversion: 2.1 time: 0.969099 May 19 05:07:19.988094 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2768/5615] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:19 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:20.686653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b31516c-7868-4948-a317-960232b7a521 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:20.688752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b31516c-7868-4948-a317-960232b7a521 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:20.711037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b31516c-7868-4948-a317-960232b7a521 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:20.714740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b31516c-7868-4948-a317-960232b7a521 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:20.715780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b31516c-7868-4948-a317-960232b7a521 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:20.728390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b31516c-7868-4948-a317-960232b7a521 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:20.997070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e567fd87-9d7e-48e7-851c-e602148d795e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:20.998401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e567fd87-9d7e-48e7-851c-e602148d795e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:21.011434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:21.017920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=10 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:21.022365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e567fd87-9d7e-48e7-851c-e602148d795e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:21.023056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e567fd87-9d7e-48e7-851c-e602148d795e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:21.045042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e567fd87-9d7e-48e7-851c-e602148d795e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:21.045963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e567fd87-9d7e-48e7-851c-e602148d795e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:21.281954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b31516c-7868-4948-a317-960232b7a521 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:21.293573 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b31516c-7868-4948-a317-960232b7a521 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1300 microversion: 2.1 time: 0.621275 May 19 05:07:21.294157 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2848/5616] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:20 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1300 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:21.311416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4400d93f-830f-4592-8fed-2ee7376b767f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:21.318256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4400d93f-830f-4592-8fed-2ee7376b767f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:21.340116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4400d93f-830f-4592-8fed-2ee7376b767f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:21.341260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4400d93f-830f-4592-8fed-2ee7376b767f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:21.346296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4400d93f-830f-4592-8fed-2ee7376b767f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:21.350417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4400d93f-830f-4592-8fed-2ee7376b767f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:21.387886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e567fd87-9d7e-48e7-851c-e602148d795e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:21.411970 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e567fd87-9d7e-48e7-851c-e602148d795e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1314 microversion: 2.1 time: 0.419499 May 19 05:07:21.436183 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2769/5617] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:20 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:21.441115 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4400d93f-830f-4592-8fed-2ee7376b767f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action" status: 200 len: 24573 microversion: 2.1 time: 0.143551 May 19 05:07:21.442189 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2849/5618] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:07:21 2022] POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action => generated 24573 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:07:22.310978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b7096c3-4f9d-4cc9-a7e7-d040729d53b4 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:22.311602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b7096c3-4f9d-4cc9-a7e7-d040729d53b4 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:22.321137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b7096c3-4f9d-4cc9-a7e7-d040729d53b4 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:22.321600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b7096c3-4f9d-4cc9-a7e7-d040729d53b4 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:22.330049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b7096c3-4f9d-4cc9-a7e7-d040729d53b4 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:22.330512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b7096c3-4f9d-4cc9-a7e7-d040729d53b4 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:22.455124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b1428e3e-9adf-4d7f-97a9-298a9b0a4297 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:22.455889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b1428e3e-9adf-4d7f-97a9-298a9b0a4297 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:22.467876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1428e3e-9adf-4d7f-97a9-298a9b0a4297 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:22.468337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1428e3e-9adf-4d7f-97a9-298a9b0a4297 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:22.470486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1428e3e-9adf-4d7f-97a9-298a9b0a4297 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:22.470948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b1428e3e-9adf-4d7f-97a9-298a9b0a4297 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:22.546030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b7096c3-4f9d-4cc9-a7e7-d040729d53b4 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:22.553639 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b7096c3-4f9d-4cc9-a7e7-d040729d53b4 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1473 microversion: 2.1 time: 0.247138 May 19 05:07:22.567215 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2770/5619] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:22 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1473 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:22.575048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b2caf75-d171-4b59-8deb-449514cc334e tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:22.576149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b2caf75-d171-4b59-8deb-449514cc334e tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:22.584042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b2caf75-d171-4b59-8deb-449514cc334e tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:22.584865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b2caf75-d171-4b59-8deb-449514cc334e tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:22.585988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b2caf75-d171-4b59-8deb-449514cc334e tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:22.587591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b2caf75-d171-4b59-8deb-449514cc334e tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:22.781276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b2caf75-d171-4b59-8deb-449514cc334e tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:22.793367 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b2caf75-d171-4b59-8deb-449514cc334e tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1473 microversion: 2.1 time: 0.223191 May 19 05:07:22.794288 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2771/5620] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:22 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1473 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:22.814398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ff0bbc8-8676-4750-8d54-9bd35250e1a6 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:22.815016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ff0bbc8-8676-4750-8d54-9bd35250e1a6 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:22.821986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ff0bbc8-8676-4750-8d54-9bd35250e1a6 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:22.822328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ff0bbc8-8676-4750-8d54-9bd35250e1a6 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:22.823319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ff0bbc8-8676-4750-8d54-9bd35250e1a6 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:22.823928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ff0bbc8-8676-4750-8d54-9bd35250e1a6 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:22.911150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b1428e3e-9adf-4d7f-97a9-298a9b0a4297 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:22.920233 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b1428e3e-9adf-4d7f-97a9-298a9b0a4297 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1314 microversion: 2.1 time: 0.471073 May 19 05:07:22.929738 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2850/5621] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:22 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:23.023475 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ff0bbc8-8676-4750-8d54-9bd35250e1a6 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1626 microversion: 2.1 time: 0.212818 May 19 05:07:23.026212 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2772/5622] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:22 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1626 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:23.041984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1cd5f9e0-57a5-46e2-9c81-5f11d1f27320 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:23.042886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1cd5f9e0-57a5-46e2-9c81-5f11d1f27320 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:23.051594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1cd5f9e0-57a5-46e2-9c81-5f11d1f27320 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:23.052360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1cd5f9e0-57a5-46e2-9c81-5f11d1f27320 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:23.053723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1cd5f9e0-57a5-46e2-9c81-5f11d1f27320 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:23.054630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1cd5f9e0-57a5-46e2-9c81-5f11d1f27320 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:23.653004 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1cd5f9e0-57a5-46e2-9c81-5f11d1f27320 tempest-TestSecurityGroupsBasicOps-379371251 tempest-TestSecurityGroupsBasicOps-379371251-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1916 microversion: 2.1 time: 0.615708 May 19 05:07:23.673060 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2851/5623] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:23 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1916 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:23.791434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8579a3ed-f1e5-4344-b4a8-09bee605f813 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:23.792845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8579a3ed-f1e5-4344-b4a8-09bee605f813 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:23.800872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8579a3ed-f1e5-4344-b4a8-09bee605f813 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:23.801757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8579a3ed-f1e5-4344-b4a8-09bee605f813 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:23.802949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8579a3ed-f1e5-4344-b4a8-09bee605f813 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:23.803637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8579a3ed-f1e5-4344-b4a8-09bee605f813 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:23.857552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-dc0d7bfe-b108-456c-970c-c6ec0e377c7a req-a75bfd7c-bf33-4c19-9948-38880c63521d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964b3f31-905d-412c-80d6-de6cdb84fffe", "name": "network-vif-plugged", "status": "completed", "tag": "c323a22f-6643-4e53-8609-08ca894e9f49"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:23.872438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8579a3ed-f1e5-4344-b4a8-09bee605f813 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:07:23.890272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dc0d7bfe-b108-456c-970c-c6ec0e377c7a req-a75bfd7c-bf33-4c19-9948-38880c63521d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:23.891019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dc0d7bfe-b108-456c-970c-c6ec0e377c7a req-a75bfd7c-bf33-4c19-9948-38880c63521d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:23.917359 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-dc0d7bfe-b108-456c-970c-c6ec0e377c7a req-a75bfd7c-bf33-4c19-9948-38880c63521d service nova] Creating event network-vif-plugged:c323a22f-6643-4e53-8609-08ca894e9f49 for instance 964b3f31-905d-412c-80d6-de6cdb84fffe on n-h2-766726-30 May 19 05:07:23.923041 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-dc0d7bfe-b108-456c-970c-c6ec0e377c7a req-a75bfd7c-bf33-4c19-9948-38880c63521d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069860 May 19 05:07:23.924809 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2852/5624] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:07:23.953874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ead8e408-dbc4-4954-895d-51d655a07b41 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:23.954682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ead8e408-dbc4-4954-895d-51d655a07b41 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:23.981317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ead8e408-dbc4-4954-895d-51d655a07b41 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:23.982075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ead8e408-dbc4-4954-895d-51d655a07b41 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:23.983060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ead8e408-dbc4-4954-895d-51d655a07b41 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:23.983676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ead8e408-dbc4-4954-895d-51d655a07b41 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:24.081313 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8579a3ed-f1e5-4344-b4a8-09bee605f813 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 204 len: 0 microversion: 2.1 time: 0.294084 May 19 05:07:24.082260 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2773/5625] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:07:23 2022] DELETE /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:07:24.095405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b5591dd-21ee-4a60-8692-4f39b004d7e6 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:24.096246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b5591dd-21ee-4a60-8692-4f39b004d7e6 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:24.103236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b5591dd-21ee-4a60-8692-4f39b004d7e6 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:24.103696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b5591dd-21ee-4a60-8692-4f39b004d7e6 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:24.105205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b5591dd-21ee-4a60-8692-4f39b004d7e6 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:24.105832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b5591dd-21ee-4a60-8692-4f39b004d7e6 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:24.456601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b5591dd-21ee-4a60-8692-4f39b004d7e6 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:24.476325 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b5591dd-21ee-4a60-8692-4f39b004d7e6 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1479 microversion: 2.1 time: 0.382230 May 19 05:07:24.482813 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2774/5626] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:24 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1479 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:24.487852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ead8e408-dbc4-4954-895d-51d655a07b41 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:24.499195 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ead8e408-dbc4-4954-895d-51d655a07b41 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1314 microversion: 2.1 time: 0.565355 May 19 05:07:24.499795 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2853/5627] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:23 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:25.494949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c8b1b5d-732a-435e-974c-fccd084d59e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:25.495576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c8b1b5d-732a-435e-974c-fccd084d59e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:25.524689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-04fdcd26-87dc-4122-96ef-3a5bd4b769dc tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:25.526174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-04fdcd26-87dc-4122-96ef-3a5bd4b769dc tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:25.539486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04fdcd26-87dc-4122-96ef-3a5bd4b769dc tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:25.540924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04fdcd26-87dc-4122-96ef-3a5bd4b769dc tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:25.542520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04fdcd26-87dc-4122-96ef-3a5bd4b769dc tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:25.543138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-04fdcd26-87dc-4122-96ef-3a5bd4b769dc tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:25.546176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8b1b5d-732a-435e-974c-fccd084d59e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:25.547023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8b1b5d-732a-435e-974c-fccd084d59e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:25.548086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8b1b5d-732a-435e-974c-fccd084d59e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:25.548750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c8b1b5d-732a-435e-974c-fccd084d59e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:25.919782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c8b1b5d-732a-435e-974c-fccd084d59e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:25.928569 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c8b1b5d-732a-435e-974c-fccd084d59e5 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1479 microversion: 2.1 time: 0.437961 May 19 05:07:25.933372 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2775/5628] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:25 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1479 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:25.993296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-04fdcd26-87dc-4122-96ef-3a5bd4b769dc tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:26.010505 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-04fdcd26-87dc-4122-96ef-3a5bd4b769dc tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1314 microversion: 2.1 time: 0.495284 May 19 05:07:26.019536 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2854/5629] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:25 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:26.953677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-53137e24-ff09-4707-be95-57cb1eda89d0 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:26.954863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-53137e24-ff09-4707-be95-57cb1eda89d0 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:26.990095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53137e24-ff09-4707-be95-57cb1eda89d0 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:26.990811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53137e24-ff09-4707-be95-57cb1eda89d0 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:26.995260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53137e24-ff09-4707-be95-57cb1eda89d0 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:26.996018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-53137e24-ff09-4707-be95-57cb1eda89d0 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:27.026921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2d60fcf8-49ab-4662-86c6-8526e8ac7e19 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:27.030440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2d60fcf8-49ab-4662-86c6-8526e8ac7e19 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:27.070796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d60fcf8-49ab-4662-86c6-8526e8ac7e19 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:27.073432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d60fcf8-49ab-4662-86c6-8526e8ac7e19 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:27.076230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d60fcf8-49ab-4662-86c6-8526e8ac7e19 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:27.077319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d60fcf8-49ab-4662-86c6-8526e8ac7e19 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:27.251801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-53137e24-ff09-4707-be95-57cb1eda89d0 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:27.265936 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-53137e24-ff09-4707-be95-57cb1eda89d0 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 200 len: 1479 microversion: 2.1 time: 0.318146 May 19 05:07:27.268421 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2776/5630] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:26 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 1479 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:27.283311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a2cf4e63-ab24-449d-b652-a8f90253eea6 req-a8046a9f-b730-4adc-bae9-f212f6e464b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc", "name": "network-vif-deleted", "tag": "c0a218b5-4b09-4f85-b832-d893f6dab1a7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:27.306630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a2cf4e63-ab24-449d-b652-a8f90253eea6 req-a8046a9f-b730-4adc-bae9-f212f6e464b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:27.307537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a2cf4e63-ab24-449d-b652-a8f90253eea6 req-a8046a9f-b730-4adc-bae9-f212f6e464b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:27.321197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:27.346452 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a2cf4e63-ab24-449d-b652-a8f90253eea6 req-a8046a9f-b730-4adc-bae9-f212f6e464b7 service nova] Creating event network-vif-deleted:c0a218b5-4b09-4f85-b832-d893f6dab1a7 for instance 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc on n-h1-766726-30 May 19 05:07:27.356832 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a2cf4e63-ab24-449d-b652-a8f90253eea6 req-a8046a9f-b730-4adc-bae9-f212f6e464b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086745 May 19 05:07:27.357982 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2777/5631] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:27.698306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5dc38c7-8f1f-49cf-b2e0-4a3c3e6666b7 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:27.699147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b5dc38c7-8f1f-49cf-b2e0-4a3c3e6666b7 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:27.716469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5dc38c7-8f1f-49cf-b2e0-4a3c3e6666b7 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:27.723115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5dc38c7-8f1f-49cf-b2e0-4a3c3e6666b7 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:27.724225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5dc38c7-8f1f-49cf-b2e0-4a3c3e6666b7 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:27.725180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5dc38c7-8f1f-49cf-b2e0-4a3c3e6666b7 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:27.737322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2d60fcf8-49ab-4662-86c6-8526e8ac7e19 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:27.753899 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2d60fcf8-49ab-4662-86c6-8526e8ac7e19 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1501 microversion: 2.1 time: 0.728426 May 19 05:07:27.754676 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2855/5632] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:27 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1501 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:27.779682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47b3acb7-a648-4cfa-aeba-392fa93be040 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:27.780616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47b3acb7-a648-4cfa-aeba-392fa93be040 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:27.807227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47b3acb7-a648-4cfa-aeba-392fa93be040 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:27.810628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47b3acb7-a648-4cfa-aeba-392fa93be040 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:27.815226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47b3acb7-a648-4cfa-aeba-392fa93be040 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:27.815808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47b3acb7-a648-4cfa-aeba-392fa93be040 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:28.415854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47b3acb7-a648-4cfa-aeba-392fa93be040 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:28.433473 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47b3acb7-a648-4cfa-aeba-392fa93be040 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1501 microversion: 2.1 time: 0.659909 May 19 05:07:28.435368 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2856/5633] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:27 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1501 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:28.471731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:28.474207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:28.497782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:28.501720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:28.502970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:28.505496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:28.569874 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] HTTP exception thrown: Instance 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc could not be found. May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Request method failure captured: May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc HTTP/1.1 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdAe07tV4b0Kj8gkBuRqZ94_ZCqu_9Fh0eSb6Kzypn4PGiliZzgjIAq5D0WQ_5gGqts2nBZgIevYUvQwL735kefDxriLzIcQf1r6aUogjPOk4IGHG6BdUDke3uDissj2rSluG5zK4BxUQrfKKShzElJe6y2iHNLwxmOYx-R8o78-FNg May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: e9a0bffaa990446a9163b476f462fff2 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1951916775 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9a0bffaa990446a9163b476f462fff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9a0bffaa990446a9163b476f462fff2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9a0bffaa990446a9163b476f462fff2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9a0bffaa990446a9163b476f462fff2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1951916775 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: e9a0bffaa990446a9163b476f462fff2 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1951916775 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestSecurityGroupsBasicOps-1951916775-project May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 00b4c70b8f224ac6b5c292563bad8651 May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1951916775-project May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc could not be found. May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc'} May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc could not be found. May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc could not be found. May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:07:28.576193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:28.582998 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:28.582998 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:07:28.582998 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:07:28.582998 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:07:28.582998 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:07:28.582998 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc could not be found. May 19 05:07:28.582998 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:28.582998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Returning 404 to user: Instance 4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:07:28.582998 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7aa037d5-811c-419c-bd72-88399a86506a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc" status: 404 len: 111 microversion: 2.1 time: 0.141619 May 19 05:07:28.590945 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2857/5634] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:28 2022] GET /compute/v2.1/servers/4e385cc1-10b4-4bc4-b5b7-10ac9d858bdc => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:07:28.602116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8cac1f7d-7a34-4e95-a027-ac4e45eb61d9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:28.608838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8cac1f7d-7a34-4e95-a027-ac4e45eb61d9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:28.624794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8cac1f7d-7a34-4e95-a027-ac4e45eb61d9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:28.625323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8cac1f7d-7a34-4e95-a027-ac4e45eb61d9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:28.634142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8cac1f7d-7a34-4e95-a027-ac4e45eb61d9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:28.639785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8cac1f7d-7a34-4e95-a027-ac4e45eb61d9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:28.732924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-8cac1f7d-7a34-4e95-a027-ac4e45eb61d9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lazy-loading 'flavor' on Instance uuid 964b3f31-905d-412c-80d6-de6cdb84fffe {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:07:28.861194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:28.891859 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8cac1f7d-7a34-4e95-a027-ac4e45eb61d9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "POST /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe/action" status: 202 len: 0 microversion: 2.1 time: 0.294893 May 19 05:07:28.891859 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2858/5635] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:07:28 2022] POST /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:07:28.904368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f8b383d2-d762-45c1-a6f8-2799ebe2376a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:28.906992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f8b383d2-d762-45c1-a6f8-2799ebe2376a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:28.922561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8b383d2-d762-45c1-a6f8-2799ebe2376a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:28.923068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8b383d2-d762-45c1-a6f8-2799ebe2376a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:28.923901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8b383d2-d762-45c1-a6f8-2799ebe2376a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:28.924345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8b383d2-d762-45c1-a6f8-2799ebe2376a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:28.996795 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5dc38c7-8f1f-49cf-b2e0-4a3c3e6666b7 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1834 microversion: 2.1 time: 1.302100 May 19 05:07:29.013221 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2778/5636] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:27 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1834 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:29.031387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9109e001-ed99-4329-bad7-002551f8d6f0 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:29.032439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9109e001-ed99-4329-bad7-002551f8d6f0 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:29.043324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9109e001-ed99-4329-bad7-002551f8d6f0 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:29.045149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9109e001-ed99-4329-bad7-002551f8d6f0 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:29.047272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9109e001-ed99-4329-bad7-002551f8d6f0 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:29.049570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9109e001-ed99-4329-bad7-002551f8d6f0 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:29.475876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9109e001-ed99-4329-bad7-002551f8d6f0 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:29.490513 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9109e001-ed99-4329-bad7-002551f8d6f0 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1681 microversion: 2.1 time: 0.467650 May 19 05:07:29.493380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f8b383d2-d762-45c1-a6f8-2799ebe2376a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:29.493916 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2779/5637] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:29 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1681 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:29.503245 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f8b383d2-d762-45c1-a6f8-2799ebe2376a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1509 microversion: 2.1 time: 0.605372 May 19 05:07:29.504042 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2859/5638] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:28 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1509 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:29.734764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e67f62be-3964-4561-b3e5-9df8ccd8f05e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:29.735792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e67f62be-3964-4561-b3e5-9df8ccd8f05e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:29.750337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e67f62be-3964-4561-b3e5-9df8ccd8f05e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:29.754056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e67f62be-3964-4561-b3e5-9df8ccd8f05e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:29.754994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e67f62be-3964-4561-b3e5-9df8ccd8f05e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:29.755956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e67f62be-3964-4561-b3e5-9df8ccd8f05e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:29.824067 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e67f62be-3964-4561-b3e5-9df8ccd8f05e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action" status: 200 len: 32648 microversion: 2.1 time: 0.093574 May 19 05:07:29.831417 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2780/5639] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:07:29 2022] POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action => generated 32648 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:07:30.052942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:30.053553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:30.061570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:30.062329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:30.063512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:30.067164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:30.169690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f44af66b680844659ef1dcc728fe2131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e256fc305dee4bdb85b3f27f6c98e72e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:30.170673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] flavor_id is None. Assuming migration. {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4142}} May 19 05:07:30.171299 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:07:30.524739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-598f1ba4-1a7b-434f-a74d-471a8d2b9fb4 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:30.525225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-598f1ba4-1a7b-434f-a74d-471a8d2b9fb4 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:30.589981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-598f1ba4-1a7b-434f-a74d-471a8d2b9fb4 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:30.593632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-598f1ba4-1a7b-434f-a74d-471a8d2b9fb4 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:30.595521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-598f1ba4-1a7b-434f-a74d-471a8d2b9fb4 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:30.597150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-598f1ba4-1a7b-434f-a74d-471a8d2b9fb4 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:30.736971 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a7757ec9-8a34-446a-860b-5d8e537a7523 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action" status: 202 len: 0 microversion: 2.1 time: 0.687912 May 19 05:07:30.740972 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2860/5640] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:07:30 2022] POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:07:30.752458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d662a91-d270-4eaf-b523-8bcfdb32a739 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:30.758374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d662a91-d270-4eaf-b523-8bcfdb32a739 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:30.776835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d662a91-d270-4eaf-b523-8bcfdb32a739 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:30.778962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d662a91-d270-4eaf-b523-8bcfdb32a739 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:30.780054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d662a91-d270-4eaf-b523-8bcfdb32a739 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:30.781539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d662a91-d270-4eaf-b523-8bcfdb32a739 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:31.977261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d662a91-d270-4eaf-b523-8bcfdb32a739 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:31.985435 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d662a91-d270-4eaf-b523-8bcfdb32a739 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1690 microversion: 2.1 time: 1.239141 May 19 05:07:32.000043 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2861/5641] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:30 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1690 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:32.009356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-598f1ba4-1a7b-434f-a74d-471a8d2b9fb4 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:32.018909 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-598f1ba4-1a7b-434f-a74d-471a8d2b9fb4 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1492 microversion: 2.1 time: 1.501084 May 19 05:07:32.028682 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2781/5642] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:30 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1492 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:32.046419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c06e8e6c-9c79-410c-818f-a8028fd7df06 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:32.048536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c06e8e6c-9c79-410c-818f-a8028fd7df06 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:32.058665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c06e8e6c-9c79-410c-818f-a8028fd7df06 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:32.059397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c06e8e6c-9c79-410c-818f-a8028fd7df06 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:32.060388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c06e8e6c-9c79-410c-818f-a8028fd7df06 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:32.061004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c06e8e6c-9c79-410c-818f-a8028fd7df06 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:32.173070 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c06e8e6c-9c79-410c-818f-a8028fd7df06 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "POST /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe/action" status: 202 len: 0 microversion: 2.1 time: 0.130826 May 19 05:07:32.185038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-03767c50-e176-478b-8461-a18ddb1bc83b tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:32.185957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-03767c50-e176-478b-8461-a18ddb1bc83b tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:32.190373 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2862/5643] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:07:32 2022] POST /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:07:32.194825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03767c50-e176-478b-8461-a18ddb1bc83b tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:32.195549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03767c50-e176-478b-8461-a18ddb1bc83b tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:32.196504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03767c50-e176-478b-8461-a18ddb1bc83b tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:32.197216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03767c50-e176-478b-8461-a18ddb1bc83b tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:32.615529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-03767c50-e176-478b-8461-a18ddb1bc83b tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:32.631223 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-03767c50-e176-478b-8461-a18ddb1bc83b tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1498 microversion: 2.1 time: 0.452434 May 19 05:07:32.631856 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2782/5644] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:32 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1498 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:33.008755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-65edfd01-0a51-4d32-a479-d897a4fc8fb2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:33.009703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-65edfd01-0a51-4d32-a479-d897a4fc8fb2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:33.052896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65edfd01-0a51-4d32-a479-d897a4fc8fb2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:33.053879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65edfd01-0a51-4d32-a479-d897a4fc8fb2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:33.054921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65edfd01-0a51-4d32-a479-d897a4fc8fb2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:33.056304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65edfd01-0a51-4d32-a479-d897a4fc8fb2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:33.648572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff2f7642-9dda-4912-8934-fab1a1e881ee tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:33.650106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff2f7642-9dda-4912-8934-fab1a1e881ee tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:33.678304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff2f7642-9dda-4912-8934-fab1a1e881ee tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:33.679140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff2f7642-9dda-4912-8934-fab1a1e881ee tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:33.680586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff2f7642-9dda-4912-8934-fab1a1e881ee tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:33.681127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff2f7642-9dda-4912-8934-fab1a1e881ee tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:34.970770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65edfd01-0a51-4d32-a479-d897a4fc8fb2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:34.994327 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-65edfd01-0a51-4d32-a479-d897a4fc8fb2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1690 microversion: 2.1 time: 1.989948 May 19 05:07:34.995901 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2863/5645] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:33 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1690 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:35.047992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff2f7642-9dda-4912-8934-fab1a1e881ee tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:35.063270 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff2f7642-9dda-4912-8934-fab1a1e881ee tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1498 microversion: 2.1 time: 1.418602 May 19 05:07:35.064200 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2783/5646] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:33 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1498 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:35.638046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d22584ac-b1b1-4c8c-a92a-4da089865638 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:35.638549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d22584ac-b1b1-4c8c-a92a-4da089865638 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:35.647793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d22584ac-b1b1-4c8c-a92a-4da089865638 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:35.648793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d22584ac-b1b1-4c8c-a92a-4da089865638 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:35.651163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d22584ac-b1b1-4c8c-a92a-4da089865638 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:35.657788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d22584ac-b1b1-4c8c-a92a-4da089865638 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:35.848225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-d22584ac-b1b1-4c8c-a92a-4da089865638 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lazy-loading 'services' on Instance uuid 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:07:36.010876 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d22584ac-b1b1-4c8c-a92a-4da089865638 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "DELETE /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da/os-volume_attachments/778a672b-8b1b-483c-a26c-e0230dad88bd" status: 202 len: 0 microversion: 2.1 time: 0.376688 May 19 05:07:36.014434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4addcbd5-d3fb-44ba-94f9-4432901ce4a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:36.015293 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2864/5647] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:07:35 2022] DELETE /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da/os-volume_attachments/778a672b-8b1b-483c-a26c-e0230dad88bd => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:07:36.026124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4addcbd5-d3fb-44ba-94f9-4432901ce4a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:36.041127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4addcbd5-d3fb-44ba-94f9-4432901ce4a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:36.041867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4addcbd5-d3fb-44ba-94f9-4432901ce4a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:36.043418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4addcbd5-d3fb-44ba-94f9-4432901ce4a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:36.047891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4addcbd5-d3fb-44ba-94f9-4432901ce4a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:36.083008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5bf826bc-1586-4b59-ae90-f8a8501a4073 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:36.084173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5bf826bc-1586-4b59-ae90-f8a8501a4073 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:36.117464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bf826bc-1586-4b59-ae90-f8a8501a4073 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:36.121400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bf826bc-1586-4b59-ae90-f8a8501a4073 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:36.122467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bf826bc-1586-4b59-ae90-f8a8501a4073 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:36.125015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5bf826bc-1586-4b59-ae90-f8a8501a4073 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:37.222353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5bf826bc-1586-4b59-ae90-f8a8501a4073 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:37.240215 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5bf826bc-1586-4b59-ae90-f8a8501a4073 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1498 microversion: 2.1 time: 1.163697 May 19 05:07:37.245387 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2865/5648] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:36 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1498 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:37.257957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4addcbd5-d3fb-44ba-94f9-4432901ce4a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:37.268102 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4addcbd5-d3fb-44ba-94f9-4432901ce4a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1690 microversion: 2.1 time: 1.259590 May 19 05:07:37.268688 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2784/5649] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:36 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1690 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:38.259964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6cd9c5e2-717f-4153-85f3-6f5b1a47bbaa tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:38.260592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6cd9c5e2-717f-4153-85f3-6f5b1a47bbaa tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:38.283389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cd9c5e2-717f-4153-85f3-6f5b1a47bbaa tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:38.284535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9029a9d3-b9be-4723-afeb-2b6f70085402 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:38.285241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9029a9d3-b9be-4723-afeb-2b6f70085402 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:38.285865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cd9c5e2-717f-4153-85f3-6f5b1a47bbaa tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:38.287033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cd9c5e2-717f-4153-85f3-6f5b1a47bbaa tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:38.290931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6cd9c5e2-717f-4153-85f3-6f5b1a47bbaa tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:38.302669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9029a9d3-b9be-4723-afeb-2b6f70085402 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:38.303197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9029a9d3-b9be-4723-afeb-2b6f70085402 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:38.304161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9029a9d3-b9be-4723-afeb-2b6f70085402 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:38.304493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9029a9d3-b9be-4723-afeb-2b6f70085402 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:38.787908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9029a9d3-b9be-4723-afeb-2b6f70085402 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:38.801982 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9029a9d3-b9be-4723-afeb-2b6f70085402 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1695 microversion: 2.1 time: 0.521252 May 19 05:07:38.803206 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2785/5650] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:38 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1695 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:38.824251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6cd9c5e2-717f-4153-85f3-6f5b1a47bbaa tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:38.835787 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6cd9c5e2-717f-4153-85f3-6f5b1a47bbaa tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1501 microversion: 2.1 time: 0.579658 May 19 05:07:38.836704 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2866/5651] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:38 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1501 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:38.855157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2eb89ccd-9625-470e-bb44-f75dd13d2e30 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:38.856349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2eb89ccd-9625-470e-bb44-f75dd13d2e30 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:38.865600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2eb89ccd-9625-470e-bb44-f75dd13d2e30 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:38.866448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2eb89ccd-9625-470e-bb44-f75dd13d2e30 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:38.868380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2eb89ccd-9625-470e-bb44-f75dd13d2e30 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:38.870027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2eb89ccd-9625-470e-bb44-f75dd13d2e30 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:38.909446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-2eb89ccd-9625-470e-bb44-f75dd13d2e30 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lazy-loading 'flavor' on Instance uuid 964b3f31-905d-412c-80d6-de6cdb84fffe {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:07:39.030750 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2eb89ccd-9625-470e-bb44-f75dd13d2e30 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "POST /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe/action" status: 202 len: 0 microversion: 2.1 time: 0.179578 May 19 05:07:39.032163 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2786/5652] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:07:38 2022] POST /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:07:39.046392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ec3640ec-1e48-49a5-9a31-bf00f1569e67 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:39.048266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ec3640ec-1e48-49a5-9a31-bf00f1569e67 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:39.068069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec3640ec-1e48-49a5-9a31-bf00f1569e67 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:39.068682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec3640ec-1e48-49a5-9a31-bf00f1569e67 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:39.076432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec3640ec-1e48-49a5-9a31-bf00f1569e67 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:39.077170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec3640ec-1e48-49a5-9a31-bf00f1569e67 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:39.463028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ec3640ec-1e48-49a5-9a31-bf00f1569e67 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:39.478537 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ec3640ec-1e48-49a5-9a31-bf00f1569e67 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1509 microversion: 2.1 time: 0.442119 May 19 05:07:39.484104 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2867/5653] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:39 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:39.822004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5a7c1904-3444-4172-9a56-8eb07513d988 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:39.823592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5a7c1904-3444-4172-9a56-8eb07513d988 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:39.833760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a7c1904-3444-4172-9a56-8eb07513d988 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:39.834588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a7c1904-3444-4172-9a56-8eb07513d988 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:39.836265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a7c1904-3444-4172-9a56-8eb07513d988 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:39.836980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a7c1904-3444-4172-9a56-8eb07513d988 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:40.259126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5a7c1904-3444-4172-9a56-8eb07513d988 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:40.272879 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5a7c1904-3444-4172-9a56-8eb07513d988 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1695 microversion: 2.1 time: 0.456624 May 19 05:07:40.273821 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2787/5654] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:39 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1695 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:40.498825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14399765-0ee6-4d4c-a577-e500bc3b5fa9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:40.501134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14399765-0ee6-4d4c-a577-e500bc3b5fa9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:40.517356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14399765-0ee6-4d4c-a577-e500bc3b5fa9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:40.518136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14399765-0ee6-4d4c-a577-e500bc3b5fa9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:40.519190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14399765-0ee6-4d4c-a577-e500bc3b5fa9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:40.519845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14399765-0ee6-4d4c-a577-e500bc3b5fa9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:40.891548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14399765-0ee6-4d4c-a577-e500bc3b5fa9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:40.914191 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14399765-0ee6-4d4c-a577-e500bc3b5fa9 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1492 microversion: 2.1 time: 0.420441 May 19 05:07:40.915949 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2868/5655] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:40 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1492 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:40.935078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8fa1084f-8924-4f71-8a9f-c361f002514e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:40.936340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8fa1084f-8924-4f71-8a9f-c361f002514e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:40.943621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8fa1084f-8924-4f71-8a9f-c361f002514e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:40.944393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8fa1084f-8924-4f71-8a9f-c361f002514e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:40.946052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8fa1084f-8924-4f71-8a9f-c361f002514e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:40.946736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8fa1084f-8924-4f71-8a9f-c361f002514e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:41.049884 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8fa1084f-8924-4f71-8a9f-c361f002514e tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "POST /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe/action" status: 202 len: 0 microversion: 2.1 time: 0.118095 May 19 05:07:41.051812 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2788/5656] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:07:40 2022] POST /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:07:41.064004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-029393ce-4934-4d4b-9899-57b1037addba tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:41.064650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-029393ce-4934-4d4b-9899-57b1037addba tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:41.074810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9028a42-bb56-42e6-aa9e-5fee9c26c5fd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:41.075942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a9028a42-bb56-42e6-aa9e-5fee9c26c5fd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:41.084266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9028a42-bb56-42e6-aa9e-5fee9c26c5fd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:41.085271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9028a42-bb56-42e6-aa9e-5fee9c26c5fd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:41.087072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9028a42-bb56-42e6-aa9e-5fee9c26c5fd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:41.087992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9028a42-bb56-42e6-aa9e-5fee9c26c5fd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:41.096582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-029393ce-4934-4d4b-9899-57b1037addba tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:41.099372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-029393ce-4934-4d4b-9899-57b1037addba tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:41.101910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-029393ce-4934-4d4b-9899-57b1037addba tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:41.109569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-029393ce-4934-4d4b-9899-57b1037addba tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:41.120189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a9028a42-bb56-42e6-aa9e-5fee9c26c5fd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:07:41.238273 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9028a42-bb56-42e6-aa9e-5fee9c26c5fd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "DELETE /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 204 len: 0 microversion: 2.1 time: 0.169399 May 19 05:07:41.239448 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2789/5657] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:07:41 2022] DELETE /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 05:07:41.246693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-16c62157-ed9c-42b9-8cfb-22491ddfb808 req-fef808fb-b82e-4cce-a21b-68d2d56cef22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95677ab7-a536-4db0-b058-1bd8a4d04239", "tag": "80a687ec-e67f-44e9-9622-aa2b07f1f1cd"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:41.256425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-16c62157-ed9c-42b9-8cfb-22491ddfb808 req-fef808fb-b82e-4cce-a21b-68d2d56cef22 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:41.256877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-16c62157-ed9c-42b9-8cfb-22491ddfb808 req-fef808fb-b82e-4cce-a21b-68d2d56cef22 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:41.270358 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-16c62157-ed9c-42b9-8cfb-22491ddfb808 req-fef808fb-b82e-4cce-a21b-68d2d56cef22 service nova] Creating event network-changed:80a687ec-e67f-44e9-9622-aa2b07f1f1cd for instance 95677ab7-a536-4db0-b058-1bd8a4d04239 on n-h2-766726-30 May 19 05:07:41.276099 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-16c62157-ed9c-42b9-8cfb-22491ddfb808 req-fef808fb-b82e-4cce-a21b-68d2d56cef22 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035246 May 19 05:07:41.277070 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2790/5658] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:41.283647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b783cf36-3d77-464e-ac94-1c0f0c3cb5de tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:41.284354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b783cf36-3d77-464e-ac94-1c0f0c3cb5de tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:41.294361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b783cf36-3d77-464e-ac94-1c0f0c3cb5de tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:41.295194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b783cf36-3d77-464e-ac94-1c0f0c3cb5de tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:41.295597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b783cf36-3d77-464e-ac94-1c0f0c3cb5de tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:41.296044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b783cf36-3d77-464e-ac94-1c0f0c3cb5de tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:41.327061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:41.847444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-029393ce-4934-4d4b-9899-57b1037addba tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:41.856887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b783cf36-3d77-464e-ac94-1c0f0c3cb5de tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:41.864134 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-029393ce-4934-4d4b-9899-57b1037addba tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1498 microversion: 2.1 time: 0.808516 May 19 05:07:41.869935 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b783cf36-3d77-464e-ac94-1c0f0c3cb5de tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1769 microversion: 2.1 time: 0.591501 May 19 05:07:41.873572 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2869/5659] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:41 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1498 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:41.881310 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2791/5660] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:41 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1769 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:41.888471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0ebc81b5-412f-43e7-8a2b-e7e48910597f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:41.889026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0ebc81b5-412f-43e7-8a2b-e7e48910597f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:41.908028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ebc81b5-412f-43e7-8a2b-e7e48910597f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:41.908494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ebc81b5-412f-43e7-8a2b-e7e48910597f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:41.910780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ebc81b5-412f-43e7-8a2b-e7e48910597f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:41.911288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ebc81b5-412f-43e7-8a2b-e7e48910597f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:42.687672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0ebc81b5-412f-43e7-8a2b-e7e48910597f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:42.698570 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0ebc81b5-412f-43e7-8a2b-e7e48910597f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1695 microversion: 2.1 time: 0.816845 May 19 05:07:42.709153 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2792/5661] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:41 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1695 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:42.891449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ba98489-0f07-48cf-a32f-2dee95ae33b8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:42.893199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8ba98489-0f07-48cf-a32f-2dee95ae33b8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:42.895354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=62 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:42.896799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5e93ae6a-5f44-41fc-acdb-823bf62bec7d tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:42.897547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5e93ae6a-5f44-41fc-acdb-823bf62bec7d tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:42.900025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:42.906488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ba98489-0f07-48cf-a32f-2dee95ae33b8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:42.906954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ba98489-0f07-48cf-a32f-2dee95ae33b8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:42.907736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ba98489-0f07-48cf-a32f-2dee95ae33b8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:42.911420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e93ae6a-5f44-41fc-acdb-823bf62bec7d tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:42.911879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e93ae6a-5f44-41fc-acdb-823bf62bec7d tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:42.912188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ba98489-0f07-48cf-a32f-2dee95ae33b8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:42.914703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e93ae6a-5f44-41fc-acdb-823bf62bec7d tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:42.923199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e93ae6a-5f44-41fc-acdb-823bf62bec7d tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:43.856539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5e93ae6a-5f44-41fc-acdb-823bf62bec7d tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:43.874248 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5e93ae6a-5f44-41fc-acdb-823bf62bec7d tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1498 microversion: 2.1 time: 0.981015 May 19 05:07:43.875012 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2793/5662] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:42 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1498 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:43.880399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a13f07e8-a338-4329-b0f8-be99ac950e9c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:43.881003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a13f07e8-a338-4329-b0f8-be99ac950e9c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:43.890638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8ba98489-0f07-48cf-a32f-2dee95ae33b8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:43.892263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a13f07e8-a338-4329-b0f8-be99ac950e9c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:43.893163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a13f07e8-a338-4329-b0f8-be99ac950e9c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:43.894938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a13f07e8-a338-4329-b0f8-be99ac950e9c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:43.895583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a13f07e8-a338-4329-b0f8-be99ac950e9c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:43.901763 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ba98489-0f07-48cf-a32f-2dee95ae33b8 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1769 microversion: 2.1 time: 1.018492 May 19 05:07:43.905155 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2870/5663] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:42 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1769 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:44.305490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a13f07e8-a338-4329-b0f8-be99ac950e9c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:44.337402 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a13f07e8-a338-4329-b0f8-be99ac950e9c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1695 microversion: 2.1 time: 0.460456 May 19 05:07:44.347936 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2794/5664] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:43 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1695 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:44.893402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5736ccce-59c0-4f57-a6c8-0dff8d8e2ca6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:44.894828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5736ccce-59c0-4f57-a6c8-0dff8d8e2ca6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:44.912829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5736ccce-59c0-4f57-a6c8-0dff8d8e2ca6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:44.913589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6eacd8d0-9b63-44f6-b33f-0e37b4a458e6 req-114217ca-c9a9-4d60-b696-e18b434cee7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95677ab7-a536-4db0-b058-1bd8a4d04239", "name": "network-vif-deleted", "tag": "80a687ec-e67f-44e9-9622-aa2b07f1f1cd"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:44.915289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5736ccce-59c0-4f57-a6c8-0dff8d8e2ca6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:44.916319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5736ccce-59c0-4f57-a6c8-0dff8d8e2ca6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:44.918643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5736ccce-59c0-4f57-a6c8-0dff8d8e2ca6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:44.931738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6eacd8d0-9b63-44f6-b33f-0e37b4a458e6 req-114217ca-c9a9-4d60-b696-e18b434cee7e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:44.939219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6eacd8d0-9b63-44f6-b33f-0e37b4a458e6 req-114217ca-c9a9-4d60-b696-e18b434cee7e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:44.989592 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6eacd8d0-9b63-44f6-b33f-0e37b4a458e6 req-114217ca-c9a9-4d60-b696-e18b434cee7e service nova] Creating event network-vif-deleted:80a687ec-e67f-44e9-9622-aa2b07f1f1cd for instance 95677ab7-a536-4db0-b058-1bd8a4d04239 on n-h2-766726-30 May 19 05:07:45.003237 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6eacd8d0-9b63-44f6-b33f-0e37b4a458e6 req-114217ca-c9a9-4d60-b696-e18b434cee7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.587957 May 19 05:07:45.003770 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2871/5665] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:45.015971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:45.022010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:45.039090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:45.039841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:45.040819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:45.043336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:45.119198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:45.119992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:45.120678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lazy-loading 'fault' on Instance uuid 95677ab7-a536-4db0-b058-1bd8a4d04239 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:07:45.142447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=94,nova_cell1:UPDATE=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:45.273766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b4c70b8f224ac6b5c292563bad8651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a0bffaa990446a9163b476f462fff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:45.295527 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-17dcb175-7a37-4f06-a445-5f8fd61f8884 tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 200 len: 1385 microversion: 2.1 time: 0.290328 May 19 05:07:45.296422 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2872/5666] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:45 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 1385 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:45.370024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47f4ff34-d6ff-4fcf-82c0-364b88213291 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:45.370986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47f4ff34-d6ff-4fcf-82c0-364b88213291 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:45.378500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47f4ff34-d6ff-4fcf-82c0-364b88213291 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:45.379263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47f4ff34-d6ff-4fcf-82c0-364b88213291 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:45.380072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47f4ff34-d6ff-4fcf-82c0-364b88213291 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:45.380667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47f4ff34-d6ff-4fcf-82c0-364b88213291 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:45.433032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5736ccce-59c0-4f57-a6c8-0dff8d8e2ca6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:45.455722 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5736ccce-59c0-4f57-a6c8-0dff8d8e2ca6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1498 microversion: 2.1 time: 0.567214 May 19 05:07:45.456547 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2795/5667] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:44 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1498 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:45.714275 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47f4ff34-d6ff-4fcf-82c0-364b88213291 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:45.722901 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47f4ff34-d6ff-4fcf-82c0-364b88213291 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1695 microversion: 2.1 time: 0.359690 May 19 05:07:45.728802 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2873/5668] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:45 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1695 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:46.330415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:46.333645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [instance: 95677ab7-a536-4db0-b058-1bd8a4d04239] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:46.352913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:46.353703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:46.354818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:46.355690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:46.387920 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] HTTP exception thrown: Instance 95677ab7-a536-4db0-b058-1bd8a4d04239 could not be found. May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Request method failure captured: May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 HTTP/1.1 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdAe07tV4b0Kj8gkBuRqZ94_ZCqu_9Fh0eSb6Kzypn4PGiliZzgjIAq5D0WQ_5gGqts2nBZgIevYUvQwL735kefDxriLzIcQf1r6aUogjPOk4IGHG6BdUDke3uDissj2rSluG5zK4BxUQrfKKShzElJe6y2iHNLwxmOYx-R8o78-FNg May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: e9a0bffaa990446a9163b476f462fff2 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1951916775 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9a0bffaa990446a9163b476f462fff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9a0bffaa990446a9163b476f462fff2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9a0bffaa990446a9163b476f462fff2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9a0bffaa990446a9163b476f462fff2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1951916775 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: e9a0bffaa990446a9163b476f462fff2 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1951916775 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestSecurityGroupsBasicOps-1951916775-project May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 00b4c70b8f224ac6b5c292563bad8651 May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1951916775-project May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 95677ab7-a536-4db0-b058-1bd8a4d04239 could not be found. May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '95677ab7-a536-4db0-b058-1bd8a4d04239'} May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95677ab7-a536-4db0-b058-1bd8a4d04239 could not be found. May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95677ab7-a536-4db0-b058-1bd8a4d04239 could not be found. May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:07:46.394100 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:46.399329 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:46.399329 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:07:46.399329 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:07:46.399329 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:07:46.399329 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:07:46.399329 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95677ab7-a536-4db0-b058-1bd8a4d04239 could not be found. May 19 05:07:46.399329 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:46.402444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Returning 404 to user: Instance 95677ab7-a536-4db0-b058-1bd8a4d04239 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:07:46.407186 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59bdaa95-66c8-4918-851f-d1d0856d2ffd tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239" status: 404 len: 111 microversion: 2.1 time: 0.096413 May 19 05:07:46.410563 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2796/5669] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:46 2022] GET /compute/v2.1/servers/95677ab7-a536-4db0-b058-1bd8a4d04239 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:07:46.475273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a1db3846-87b3-43ea-b88f-09ce604b236c tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:46.477774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a1db3846-87b3-43ea-b88f-09ce604b236c tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:46.487891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1db3846-87b3-43ea-b88f-09ce604b236c tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:46.488597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1db3846-87b3-43ea-b88f-09ce604b236c tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:46.489644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1db3846-87b3-43ea-b88f-09ce604b236c tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:46.490311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1db3846-87b3-43ea-b88f-09ce604b236c tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:46.748043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ff7cf6b-f5f2-4db9-a81e-79a34ee3caeb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:46.748606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2ff7cf6b-f5f2-4db9-a81e-79a34ee3caeb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:46.754983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ff7cf6b-f5f2-4db9-a81e-79a34ee3caeb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:46.756065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ff7cf6b-f5f2-4db9-a81e-79a34ee3caeb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:46.757650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ff7cf6b-f5f2-4db9-a81e-79a34ee3caeb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:46.758319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ff7cf6b-f5f2-4db9-a81e-79a34ee3caeb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:46.762446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a1db3846-87b3-43ea-b88f-09ce604b236c tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:46.779950 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a1db3846-87b3-43ea-b88f-09ce604b236c tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1501 microversion: 2.1 time: 0.308999 May 19 05:07:46.780923 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2874/5670] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:46 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1501 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:46.801662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b45e4ea-238b-4320-b569-1c1b06145e37 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:46.801662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b45e4ea-238b-4320-b569-1c1b06145e37 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:46.808569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b45e4ea-238b-4320-b569-1c1b06145e37 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:46.809611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b45e4ea-238b-4320-b569-1c1b06145e37 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:46.810913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b45e4ea-238b-4320-b569-1c1b06145e37 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:46.811698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b45e4ea-238b-4320-b569-1c1b06145e37 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:46.855668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b45e4ea-238b-4320-b569-1c1b06145e37 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:07:46.999287 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b45e4ea-238b-4320-b569-1c1b06145e37 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "DELETE /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 204 len: 0 microversion: 2.1 time: 0.201870 May 19 05:07:47.000049 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2875/5671] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:07:46 2022] DELETE /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:07:47.011126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-16490372-53ce-41d5-bf82-2268d9e41b1a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:47.011795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-16490372-53ce-41d5-bf82-2268d9e41b1a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:47.031026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16490372-53ce-41d5-bf82-2268d9e41b1a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:47.031480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16490372-53ce-41d5-bf82-2268d9e41b1a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:47.032479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16490372-53ce-41d5-bf82-2268d9e41b1a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:47.033393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16490372-53ce-41d5-bf82-2268d9e41b1a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:47.071994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ff7cf6b-f5f2-4db9-a81e-79a34ee3caeb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:47.107939 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ff7cf6b-f5f2-4db9-a81e-79a34ee3caeb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1695 microversion: 2.1 time: 0.366492 May 19 05:07:47.108529 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2797/5672] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:46 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1695 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:47.275770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-16490372-53ce-41d5-bf82-2268d9e41b1a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:47.306772 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-16490372-53ce-41d5-bf82-2268d9e41b1a tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1507 microversion: 2.1 time: 0.297771 May 19 05:07:47.307708 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2876/5673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:47 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:48.127879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a6b29745-6cd6-4a96-8a16-4195ac723038 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:48.128411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a6b29745-6cd6-4a96-8a16-4195ac723038 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:48.144002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6b29745-6cd6-4a96-8a16-4195ac723038 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:48.144466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6b29745-6cd6-4a96-8a16-4195ac723038 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:48.145286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6b29745-6cd6-4a96-8a16-4195ac723038 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:48.145924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6b29745-6cd6-4a96-8a16-4195ac723038 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:48.325411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a5be1a41-f725-420f-8a07-18b31b085837 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:48.326751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a5be1a41-f725-420f-8a07-18b31b085837 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:48.339840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5be1a41-f725-420f-8a07-18b31b085837 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:48.345464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5be1a41-f725-420f-8a07-18b31b085837 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:48.346310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5be1a41-f725-420f-8a07-18b31b085837 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:48.346761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5be1a41-f725-420f-8a07-18b31b085837 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:48.665244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a5be1a41-f725-420f-8a07-18b31b085837 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:48.673332 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a5be1a41-f725-420f-8a07-18b31b085837 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1507 microversion: 2.1 time: 0.352655 May 19 05:07:48.677103 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2877/5674] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:48 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:49.214449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6b29745-6cd6-4a96-8a16-4195ac723038 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:49.228646 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a6b29745-6cd6-4a96-8a16-4195ac723038 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1695 microversion: 2.1 time: 1.104921 May 19 05:07:49.229412 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2798/5675] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:48 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1695 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:49.694543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b9c56492-4b06-47b0-9a31-99b79c08fb98 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:49.695254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b9c56492-4b06-47b0-9a31-99b79c08fb98 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:49.707495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9c56492-4b06-47b0-9a31-99b79c08fb98 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:49.707961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9c56492-4b06-47b0-9a31-99b79c08fb98 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:49.708761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9c56492-4b06-47b0-9a31-99b79c08fb98 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:49.709239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9c56492-4b06-47b0-9a31-99b79c08fb98 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:50.247993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce118927-5cba-4a17-b165-a3bcf420b274 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:50.249761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ce118927-5cba-4a17-b165-a3bcf420b274 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:50.264411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce118927-5cba-4a17-b165-a3bcf420b274 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:50.268035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce118927-5cba-4a17-b165-a3bcf420b274 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:50.269446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce118927-5cba-4a17-b165-a3bcf420b274 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:50.270519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce118927-5cba-4a17-b165-a3bcf420b274 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:50.465406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b9c56492-4b06-47b0-9a31-99b79c08fb98 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:50.479517 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b9c56492-4b06-47b0-9a31-99b79c08fb98 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1507 microversion: 2.1 time: 0.789061 May 19 05:07:50.480460 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2878/5676] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:49 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1507 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:50.499691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f88c95b-d033-4a60-b430-172566d7d64f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:50.500226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f88c95b-d033-4a60-b430-172566d7d64f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:50.521462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f88c95b-d033-4a60-b430-172566d7d64f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:50.521923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f88c95b-d033-4a60-b430-172566d7d64f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:50.525386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f88c95b-d033-4a60-b430-172566d7d64f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:50.525745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f88c95b-d033-4a60-b430-172566d7d64f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:50.594603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f88c95b-d033-4a60-b430-172566d7d64f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:07:50.810339 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f88c95b-d033-4a60-b430-172566d7d64f tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "DELETE /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 204 len: 0 microversion: 2.1 time: 0.328408 May 19 05:07:50.812311 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2879/5677] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:07:50 2022] DELETE /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:07:50.825437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-74eab96d-55e5-467b-b333-56645ab618a3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:50.829895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-74eab96d-55e5-467b-b333-56645ab618a3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:50.846089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74eab96d-55e5-467b-b333-56645ab618a3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:50.846953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74eab96d-55e5-467b-b333-56645ab618a3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:50.850066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74eab96d-55e5-467b-b333-56645ab618a3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:50.850927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-74eab96d-55e5-467b-b333-56645ab618a3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:50.914553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ce118927-5cba-4a17-b165-a3bcf420b274 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:50.926982 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce118927-5cba-4a17-b165-a3bcf420b274 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1694 microversion: 2.1 time: 0.684274 May 19 05:07:50.928678 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2799/5678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:50 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1694 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:51.307917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-74eab96d-55e5-467b-b333-56645ab618a3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:51.323360 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-74eab96d-55e5-467b-b333-56645ab618a3 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1513 microversion: 2.1 time: 0.504411 May 19 05:07:51.324022 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2880/5679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:50 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:51.498787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2bb21a7e-eb20-426b-a9ec-a263ab8acaa6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:51.499535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2bb21a7e-eb20-426b-a9ec-a263ab8acaa6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:51.509572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bb21a7e-eb20-426b-a9ec-a263ab8acaa6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:51.513711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bb21a7e-eb20-426b-a9ec-a263ab8acaa6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:51.515722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bb21a7e-eb20-426b-a9ec-a263ab8acaa6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:51.520678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bb21a7e-eb20-426b-a9ec-a263ab8acaa6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:51.829954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a3241937-d620-4eec-a9d0-da3947f8af2e req-8aa293af-a6f1-4f4c-9ecb-5a3b1064c6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964b3f31-905d-412c-80d6-de6cdb84fffe", "name": "network-vif-unplugged", "status": "completed", "tag": "c323a22f-6643-4e53-8609-08ca894e9f49"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:51.849880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a3241937-d620-4eec-a9d0-da3947f8af2e req-8aa293af-a6f1-4f4c-9ecb-5a3b1064c6a9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:51.853452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a3241937-d620-4eec-a9d0-da3947f8af2e req-8aa293af-a6f1-4f4c-9ecb-5a3b1064c6a9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:51.880021 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a3241937-d620-4eec-a9d0-da3947f8af2e req-8aa293af-a6f1-4f4c-9ecb-5a3b1064c6a9 service nova] Creating event network-vif-unplugged:c323a22f-6643-4e53-8609-08ca894e9f49 for instance 964b3f31-905d-412c-80d6-de6cdb84fffe on n-h2-766726-30 May 19 05:07:51.905215 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a3241937-d620-4eec-a9d0-da3947f8af2e req-8aa293af-a6f1-4f4c-9ecb-5a3b1064c6a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077662 May 19 05:07:51.906273 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2881/5680] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:51.947542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b1c22c3-7864-4fd1-aea4-eb52ec8e354a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:51.949994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b1c22c3-7864-4fd1-aea4-eb52ec8e354a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:51.967410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2bb21a7e-eb20-426b-a9ec-a263ab8acaa6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:51.971406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b1c22c3-7864-4fd1-aea4-eb52ec8e354a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:51.972470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b1c22c3-7864-4fd1-aea4-eb52ec8e354a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:51.978359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b1c22c3-7864-4fd1-aea4-eb52ec8e354a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:51.979095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b1c22c3-7864-4fd1-aea4-eb52ec8e354a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:51.990334 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2bb21a7e-eb20-426b-a9ec-a263ab8acaa6 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1507 microversion: 2.1 time: 0.495840 May 19 05:07:52.001275 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2800/5681] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:51 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:52.085614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9fae4ab0-26ba-4fca-9143-a7c1febd9f07 req-a3ca8544-3656-4faf-b3db-55d855f975aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d595b36-cd30-410e-90c7-15d27167c094", "name": "network-vif-unplugged", "status": "completed", "tag": "1f49550d-4db4-4a59-8f47-781f3f1bb08f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:52.104848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9fae4ab0-26ba-4fca-9143-a7c1febd9f07 req-a3ca8544-3656-4faf-b3db-55d855f975aa service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:52.105576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9fae4ab0-26ba-4fca-9143-a7c1febd9f07 req-a3ca8544-3656-4faf-b3db-55d855f975aa service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:52.139654 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9fae4ab0-26ba-4fca-9143-a7c1febd9f07 req-a3ca8544-3656-4faf-b3db-55d855f975aa service nova] Creating event network-vif-unplugged:1f49550d-4db4-4a59-8f47-781f3f1bb08f for instance 5d595b36-cd30-410e-90c7-15d27167c094 on n-h1-766726-30 May 19 05:07:52.166149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-9fae4ab0-26ba-4fca-9143-a7c1febd9f07 req-a3ca8544-3656-4faf-b3db-55d855f975aa service nova] Instance 5d595b36-cd30-410e-90c7-15d27167c094 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:07:52.191532 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9fae4ab0-26ba-4fca-9143-a7c1febd9f07 req-a3ca8544-3656-4faf-b3db-55d855f975aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112475 May 19 05:07:52.192175 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2801/5682] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:07:52.349288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-27602ec1-e52b-43b0-98fc-baf58b448b51 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:52.349596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-27602ec1-e52b-43b0-98fc-baf58b448b51 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:52.378968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27602ec1-e52b-43b0-98fc-baf58b448b51 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:52.379582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27602ec1-e52b-43b0-98fc-baf58b448b51 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:52.381106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27602ec1-e52b-43b0-98fc-baf58b448b51 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:52.382159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27602ec1-e52b-43b0-98fc-baf58b448b51 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:52.844578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2b1c22c3-7864-4fd1-aea4-eb52ec8e354a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:52.857688 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b1c22c3-7864-4fd1-aea4-eb52ec8e354a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1694 microversion: 2.1 time: 0.916162 May 19 05:07:52.861682 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2882/5683] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:51 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1694 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:07:52.935170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-d80453f3-8ba1-4f84-b9e0-8af09f2b675f req-c871715a-bc3f-4461-b44f-7e61d07ffd3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964b3f31-905d-412c-80d6-de6cdb84fffe", "name": "network-vif-deleted", "tag": "c323a22f-6643-4e53-8609-08ca894e9f49"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:52.945659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d80453f3-8ba1-4f84-b9e0-8af09f2b675f req-c871715a-bc3f-4461-b44f-7e61d07ffd3d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:52.946119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-d80453f3-8ba1-4f84-b9e0-8af09f2b675f req-c871715a-bc3f-4461-b44f-7e61d07ffd3d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:52.997307 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-d80453f3-8ba1-4f84-b9e0-8af09f2b675f req-c871715a-bc3f-4461-b44f-7e61d07ffd3d service nova] Creating event network-vif-deleted:c323a22f-6643-4e53-8609-08ca894e9f49 for instance 964b3f31-905d-412c-80d6-de6cdb84fffe on n-h2-766726-30 May 19 05:07:53.014050 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-d80453f3-8ba1-4f84-b9e0-8af09f2b675f req-c871715a-bc3f-4461-b44f-7e61d07ffd3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082685 May 19 05:07:53.014678 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2883/5684] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:53.019852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:53.020572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:53.043414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:53.044247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:53.045379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:53.047314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:53.081869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-27602ec1-e52b-43b0-98fc-baf58b448b51 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:53.092412 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-27602ec1-e52b-43b0-98fc-baf58b448b51 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1513 microversion: 2.1 time: 0.755769 May 19 05:07:53.114590 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2802/5685] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:52 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1513 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:53.124332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:53.124818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:53.126323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lazy-loading 'fault' on Instance uuid 964b3f31-905d-412c-80d6-de6cdb84fffe {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:07:53.301531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be83276d8444c30a17edf961c0fa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b146ac9b7f4af9b96292cc4671ab4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:53.323925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a9a547e-a34a-49bc-877e-22b251b77307 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 200 len: 1304 microversion: 2.1 time: 0.305608 May 19 05:07:53.340148 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2884/5686] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:53 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 1304 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:53.875425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-361456fd-eac5-4898-b12e-6c0b8af11753 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:53.876057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-361456fd-eac5-4898-b12e-6c0b8af11753 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:53.886735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-361456fd-eac5-4898-b12e-6c0b8af11753 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:53.887193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-361456fd-eac5-4898-b12e-6c0b8af11753 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:53.888110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-361456fd-eac5-4898-b12e-6c0b8af11753 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:53.888429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-361456fd-eac5-4898-b12e-6c0b8af11753 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:54.120860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33266814-fc5b-4041-b40d-ce8af563a889 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:54.122234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-33266814-fc5b-4041-b40d-ce8af563a889 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:54.139174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33266814-fc5b-4041-b40d-ce8af563a889 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:54.139632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33266814-fc5b-4041-b40d-ce8af563a889 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:54.140436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33266814-fc5b-4041-b40d-ce8af563a889 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:54.141119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33266814-fc5b-4041-b40d-ce8af563a889 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:54.865901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-361456fd-eac5-4898-b12e-6c0b8af11753 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:54.874947 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-361456fd-eac5-4898-b12e-6c0b8af11753 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1694 microversion: 2.1 time: 1.003754 May 19 05:07:54.875540 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2803/5687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:53 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1694 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:54.895446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:54.896785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] [instance: 964b3f31-905d-412c-80d6-de6cdb84fffe] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:54.919068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:54.919700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:54.920622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:54.922884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:54.961165 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] HTTP exception thrown: Instance 964b3f31-905d-412c-80d6-de6cdb84fffe could not be found. May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Request method failure captured: May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe HTTP/1.1 May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdB4H_vR9EknX4IcRQhXYNLibK5vpsQsOTauW5i1JrTlXaSAq4k0sxop3eh3AZMZ7nJ37-ijAwII4VTrGHewpId_wqRJ4Eo8sEYvUkWZoeZLk90-2gEXfak1yQsdXKfFR40cQ5J5ffRnLoAGTMLuAShrtM_EUvrLUeFl1TKWR0jNwpM May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 90b146ac9b7f4af9b96292cc4671ab4a May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestServerAdvancedOps-895204116 May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90b146ac9b7f4af9b96292cc4671ab4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90b146ac9b7f4af9b96292cc4671ab4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90b146ac9b7f4af9b96292cc4671ab4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90b146ac9b7f4af9b96292cc4671ab4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestServerAdvancedOps-895204116 May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 90b146ac9b7f4af9b96292cc4671ab4a May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestServerAdvancedOps-895204116 May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestServerAdvancedOps-895204116-project May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 9be83276d8444c30a17edf961c0fa19b May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestServerAdvancedOps-895204116-project May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 964b3f31-905d-412c-80d6-de6cdb84fffe could not be found. May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '964b3f31-905d-412c-80d6-de6cdb84fffe'} May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964b3f31-905d-412c-80d6-de6cdb84fffe could not be found. May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964b3f31-905d-412c-80d6-de6cdb84fffe could not be found. May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:07:54.965405 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:54.970561 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:54.970561 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:07:54.970561 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:07:54.970561 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:07:54.970561 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:07:54.970561 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964b3f31-905d-412c-80d6-de6cdb84fffe could not be found. May 19 05:07:54.970561 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:07:54.972119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] Returning 404 to user: Instance 964b3f31-905d-412c-80d6-de6cdb84fffe could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:07:54.978692 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fa6d5b57-da6c-49f0-864a-4c12eab67686 tempest-TestServerAdvancedOps-895204116 tempest-TestServerAdvancedOps-895204116-project] 10.222.0.58 "GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe" status: 404 len: 111 microversion: 2.1 time: 0.084483 May 19 05:07:54.979937 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2804/5688] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:54 2022] GET /compute/v2.1/servers/964b3f31-905d-412c-80d6-de6cdb84fffe => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:07:54.991955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2a3a7c7d-ee3f-4615-98fc-5c9d6f4dfa62 req-925b6c5b-5f36-4a2c-a13b-9168729ab2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d595b36-cd30-410e-90c7-15d27167c094", "tag": "1f49550d-4db4-4a59-8f47-781f3f1bb08f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:55.015633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2a3a7c7d-ee3f-4615-98fc-5c9d6f4dfa62 req-925b6c5b-5f36-4a2c-a13b-9168729ab2fa service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:55.016217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2a3a7c7d-ee3f-4615-98fc-5c9d6f4dfa62 req-925b6c5b-5f36-4a2c-a13b-9168729ab2fa service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:55.056870 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2a3a7c7d-ee3f-4615-98fc-5c9d6f4dfa62 req-925b6c5b-5f36-4a2c-a13b-9168729ab2fa service nova] Creating event network-changed:1f49550d-4db4-4a59-8f47-781f3f1bb08f for instance 5d595b36-cd30-410e-90c7-15d27167c094 on n-h1-766726-30 May 19 05:07:55.064417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-33266814-fc5b-4041-b40d-ce8af563a889 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:55.072030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-2a3a7c7d-ee3f-4615-98fc-5c9d6f4dfa62 req-925b6c5b-5f36-4a2c-a13b-9168729ab2fa service nova] Instance 5d595b36-cd30-410e-90c7-15d27167c094 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:07:55.085448 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-33266814-fc5b-4041-b40d-ce8af563a889 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1513 microversion: 2.1 time: 0.960168 May 19 05:07:55.086369 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2885/5689] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:54 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1513 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:55.097879 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2a3a7c7d-ee3f-4615-98fc-5c9d6f4dfa62 req-925b6c5b-5f36-4a2c-a13b-9168729ab2fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116365 May 19 05:07:55.102499 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2805/5690] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:55.726465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-aea8256d-d735-49a3-892b-770e8c4aa824 req-be151899-72d2-4d14-9aa3-d0e14f8d60ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743ae7dd-d080-4bbc-9ac0-3ff80d2f42da", "name": "network-vif-deleted", "tag": "71ad7570-687a-48b4-bbf3-4690ee02575d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:55.745171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-aea8256d-d735-49a3-892b-770e8c4aa824 req-be151899-72d2-4d14-9aa3-d0e14f8d60ef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:55.745624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-aea8256d-d735-49a3-892b-770e8c4aa824 req-be151899-72d2-4d14-9aa3-d0e14f8d60ef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:55.778146 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-aea8256d-d735-49a3-892b-770e8c4aa824 req-be151899-72d2-4d14-9aa3-d0e14f8d60ef service nova] Creating event network-vif-deleted:71ad7570-687a-48b4-bbf3-4690ee02575d for instance 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da on n-h1-766726-30 May 19 05:07:55.784397 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-aea8256d-d735-49a3-892b-770e8c4aa824 req-be151899-72d2-4d14-9aa3-d0e14f8d60ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062246 May 19 05:07:55.785311 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2886/5691] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:07:55.893567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c2fe4cd-1aa7-4428-8ad3-555b922cf4dd tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:55.895175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c2fe4cd-1aa7-4428-8ad3-555b922cf4dd tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:55.921869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4cd-1aa7-4428-8ad3-555b922cf4dd tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:55.922649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4cd-1aa7-4428-8ad3-555b922cf4dd tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:55.923697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4cd-1aa7-4428-8ad3-555b922cf4dd tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:55.924375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4cd-1aa7-4428-8ad3-555b922cf4dd tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:56.107766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b9c6dca-c44a-41da-bc27-b75b9b592aa9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:56.108505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b9c6dca-c44a-41da-bc27-b75b9b592aa9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:56.121465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b9c6dca-c44a-41da-bc27-b75b9b592aa9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:56.122354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b9c6dca-c44a-41da-bc27-b75b9b592aa9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:56.123536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b9c6dca-c44a-41da-bc27-b75b9b592aa9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:56.125769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b9c6dca-c44a-41da-bc27-b75b9b592aa9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:56.154110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:56.349420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2b9c6dca-c44a-41da-bc27-b75b9b592aa9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:56.372455 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b9c6dca-c44a-41da-bc27-b75b9b592aa9 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1471 microversion: 2.1 time: 0.263026 May 19 05:07:56.372455 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2887/5692] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:56 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:56.595571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0c2fe4cd-1aa7-4428-8ad3-555b922cf4dd tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:56.605805 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c2fe4cd-1aa7-4428-8ad3-555b922cf4dd tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1692 microversion: 2.1 time: 0.716104 May 19 05:07:56.606652 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2806/5693] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:55 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1692 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:57.380837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:57.391930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:57.407066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:57.409825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:57.412080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:57.413920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:57.473398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:57.474237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:57.475125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lazy-loading 'fault' on Instance uuid 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:07:57.547960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1a374e9ff94035bcdd10aa278873c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809713a72c8848bc8d75fe5661ef7bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:57.563368 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fefe3711-8a11-4f8e-b487-c4e4faff5f63 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 200 len: 1309 microversion: 2.1 time: 0.187324 May 19 05:07:57.564275 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2888/5694] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:57 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 1309 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:57.625964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d17ba625-7330-4582-ae1d-c467d313db91 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:57.626789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d17ba625-7330-4582-ae1d-c467d313db91 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:57.635313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d17ba625-7330-4582-ae1d-c467d313db91 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:57.636466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d17ba625-7330-4582-ae1d-c467d313db91 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:57.637466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d17ba625-7330-4582-ae1d-c467d313db91 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:57.638075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d17ba625-7330-4582-ae1d-c467d313db91 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:57.804179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-deb6c719-e50c-4c51-930c-39d4daa2a13a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] Calling method '.version_select at 0x7fd315c030d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:57.808373 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-deb6c719-e50c-4c51-930c-39d4daa2a13a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [76c52dcd-8ac9-4d6d-9f16-0cf6d6e01740] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 05:07:57.885896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d17ba625-7330-4582-ae1d-c467d313db91 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:57.908604 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d17ba625-7330-4582-ae1d-c467d313db91 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1689 microversion: 2.1 time: 0.287059 May 19 05:07:57.913418 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2807/5695] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:57 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1689 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:07:57.929876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c57dfd33-744c-4d5d-b4e1-2ab4fcc998fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:07:57.930605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c57dfd33-744c-4d5d-b4e1-2ab4fcc998fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:57.941056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c57dfd33-744c-4d5d-b4e1-2ab4fcc998fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:57.941524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c57dfd33-744c-4d5d-b4e1-2ab4fcc998fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:57.942298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c57dfd33-744c-4d5d-b4e1-2ab4fcc998fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:57.942734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c57dfd33-744c-4d5d-b4e1-2ab4fcc998fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:58.000076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:07:58.047140 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c57dfd33-744c-4d5d-b4e1-2ab4fcc998fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action" status: 204 len: 0 microversion: 2.1 time: 0.121843 May 19 05:07:58.048629 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2808/5696] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:07:57 2022] POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 05:07:58.082282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69666270-320e-4b64-b116-77e8360bcd66 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:58.089144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-69666270-320e-4b64-b116-77e8360bcd66 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:58.098318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69666270-320e-4b64-b116-77e8360bcd66 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:58.099274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69666270-320e-4b64-b116-77e8360bcd66 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:58.100886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69666270-320e-4b64-b116-77e8360bcd66 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:58.101656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69666270-320e-4b64-b116-77e8360bcd66 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:58.825196 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [None req-deb6c719-e50c-4c51-930c-39d4daa2a13a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] [76c52dcd-8ac9-4d6d-9f16-0cf6d6e01740] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 44776. May 19 05:07:58.855462 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-deb6c719-e50c-4c51-930c-39d4daa2a13a tempest-TestSecurityGroupsBasicOps-1951916775 tempest-TestSecurityGroupsBasicOps-1951916775-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1247604620" status: 202 len: 0 microversion: 2.1 time: 1.056722 May 19 05:07:58.857553 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2889/5697] 10.222.0.58 () {58 vars in 1277 bytes} [Thu May 19 05:07:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1247604620 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 05:07:58.862620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:07:58.874091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] [instance: 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:07:58.882633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:58.883864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:58.885053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:07:58.900746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:07:58.956447 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] HTTP exception thrown: Instance 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da could not be found. May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Request method failure captured: May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da HTTP/1.1 May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihc66-IrZJXf3r5Qih9UxE6KeEnPVQn4ay1Dex6aGOJhnaVhUZ-8k0PaQtdgBLrMudshHWlF5qEUY3WgKiGAYTjHQ7k3v84yglJit47x4vENcJjD2eTv8qCoIS9Ezuf5TSGbjJ1A0mthYqqw7SOCx2WqTrcUU7yl6_Y8TWqzpCra-FNw May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 809713a72c8848bc8d75fe5661ef7bff May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesSnapshotTestJSON-404094688 May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/809713a72c8848bc8d75fe5661ef7bff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/809713a72c8848bc8d75fe5661ef7bff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/809713a72c8848bc8d75fe5661ef7bff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_809713a72c8848bc8d75fe5661ef7bff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesSnapshotTestJSON-404094688 May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 809713a72c8848bc8d75fe5661ef7bff May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-404094688 May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesSnapshotTestJSON-404094688-project May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 0c1a374e9ff94035bcdd10aa278873c9 May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesSnapshotTestJSON-404094688-project May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da could not be found. May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '743ae7dd-d080-4bbc-9ac0-3ff80d2f42da'} May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da could not be found. May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da could not be found. May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:07:58.966664 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:58.971328 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:07:58.971328 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:07:58.971328 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:07:58.971328 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:07:58.971328 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:07:58.971328 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da could not be found. May 19 05:07:58.971328 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:07:58.973860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] Returning 404 to user: Instance 743ae7dd-d080-4bbc-9ac0-3ff80d2f42da could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:07:58.980424 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-41244a6b-9d14-47ae-b341-d3abc0bb7e98 tempest-VolumesSnapshotTestJSON-404094688 tempest-VolumesSnapshotTestJSON-404094688-project] 10.222.0.58 "GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da" status: 404 len: 111 microversion: 2.1 time: 0.121606 May 19 05:07:58.985098 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2890/5698] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:58 2022] GET /compute/v2.1/servers/743ae7dd-d080-4bbc-9ac0-3ff80d2f42da => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:07:59.558565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69666270-320e-4b64-b116-77e8360bcd66 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:07:59.577887 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69666270-320e-4b64-b116-77e8360bcd66 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1689 microversion: 2.1 time: 1.510547 May 19 05:07:59.580004 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2809/5699] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:07:58 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1689 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:00.602594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d186f74d-4cc8-49ce-8b97-89738c50ec9e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:00.603236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d186f74d-4cc8-49ce-8b97-89738c50ec9e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:00.619720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d186f74d-4cc8-49ce-8b97-89738c50ec9e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:00.620363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d186f74d-4cc8-49ce-8b97-89738c50ec9e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:00.621214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d186f74d-4cc8-49ce-8b97-89738c50ec9e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:00.621656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d186f74d-4cc8-49ce-8b97-89738c50ec9e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:01.949298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d186f74d-4cc8-49ce-8b97-89738c50ec9e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:08:01.957895 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d186f74d-4cc8-49ce-8b97-89738c50ec9e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1689 microversion: 2.1 time: 1.362007 May 19 05:08:01.968929 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2891/5700] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:00 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1689 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:02.987224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e8fdead2-cd85-442f-bd70-9fc2129d4443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:02.988007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e8fdead2-cd85-442f-bd70-9fc2129d4443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:03.020565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8fdead2-cd85-442f-bd70-9fc2129d4443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:03.021159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8fdead2-cd85-442f-bd70-9fc2129d4443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:03.021898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8fdead2-cd85-442f-bd70-9fc2129d4443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:03.022308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e8fdead2-cd85-442f-bd70-9fc2129d4443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:03.801446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e8fdead2-cd85-442f-bd70-9fc2129d4443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:08:03.836565 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e8fdead2-cd85-442f-bd70-9fc2129d4443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1681 microversion: 2.1 time: 0.853040 May 19 05:08:03.875667 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2810/5701] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:02 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1681 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:05.736538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3398e755-9a99-4be0-b538-ba00a37e693f req-56a8647d-071e-4134-8553-2fe028c06e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d595b36-cd30-410e-90c7-15d27167c094", "name": "network-vif-plugged", "status": "completed", "tag": "1f49550d-4db4-4a59-8f47-781f3f1bb08f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:08:05.751676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3398e755-9a99-4be0-b538-ba00a37e693f req-56a8647d-071e-4134-8553-2fe028c06e24 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:05.751932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3398e755-9a99-4be0-b538-ba00a37e693f req-56a8647d-071e-4134-8553-2fe028c06e24 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:05.797351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3398e755-9a99-4be0-b538-ba00a37e693f req-56a8647d-071e-4134-8553-2fe028c06e24 service nova] Creating event network-vif-plugged:1f49550d-4db4-4a59-8f47-781f3f1bb08f for instance 5d595b36-cd30-410e-90c7-15d27167c094 on n-h1-766726-30 May 19 05:08:05.804115 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3398e755-9a99-4be0-b538-ba00a37e693f req-56a8647d-071e-4134-8553-2fe028c06e24 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071868 May 19 05:08:05.808555 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2892/5702] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:08:24.135312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c362da67-81dc-4b85-a6bf-4ca76a5a6086 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:08:24.139197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c362da67-81dc-4b85-a6bf-4ca76a5a6086 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:24.143901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=35 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:08:24.148940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:08:24.166460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c362da67-81dc-4b85-a6bf-4ca76a5a6086 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:24.184671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c362da67-81dc-4b85-a6bf-4ca76a5a6086 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:24.187540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c362da67-81dc-4b85-a6bf-4ca76a5a6086 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:24.190619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c362da67-81dc-4b85-a6bf-4ca76a5a6086 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:24.384182 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c362da67-81dc-4b85-a6bf-4ca76a5a6086 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action" status: 200 len: 24571 microversion: 2.1 time: 0.254589 May 19 05:08:24.385633 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2811/5703] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:08:24 2022] POST /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094/action => generated 24571 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:08:30.749240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09e482cb-57f6-4d72-8a15-ac7d4995eb21 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:30.750613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-09e482cb-57f6-4d72-8a15-ac7d4995eb21 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:30.763995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:08:30.765353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=21 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:08:30.784903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09e482cb-57f6-4d72-8a15-ac7d4995eb21 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:30.785469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09e482cb-57f6-4d72-8a15-ac7d4995eb21 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:30.786540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09e482cb-57f6-4d72-8a15-ac7d4995eb21 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:30.786987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-09e482cb-57f6-4d72-8a15-ac7d4995eb21 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:31.391760 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-09e482cb-57f6-4d72-8a15-ac7d4995eb21 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1834 microversion: 2.1 time: 0.642876 May 19 05:08:31.405318 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2893/5704] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:30 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1834 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:35.649395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64d7676f-7c04-4c6c-998a-c283c2405be1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:35.650732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64d7676f-7c04-4c6c-998a-c283c2405be1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:35.674095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:08:35.679101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:08:35.691766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-cd4a1d9c-87b9-4e93-b804-cea9b8729ae9 req-0fc843b7-81e6-49cc-991b-16934c65025b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d595b36-cd30-410e-90c7-15d27167c094", "tag": "1f49550d-4db4-4a59-8f47-781f3f1bb08f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:08:35.718030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64d7676f-7c04-4c6c-998a-c283c2405be1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:35.722049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64d7676f-7c04-4c6c-998a-c283c2405be1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:35.722960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64d7676f-7c04-4c6c-998a-c283c2405be1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:35.728867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64d7676f-7c04-4c6c-998a-c283c2405be1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:35.733345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-cd4a1d9c-87b9-4e93-b804-cea9b8729ae9 req-0fc843b7-81e6-49cc-991b-16934c65025b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:35.734212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-cd4a1d9c-87b9-4e93-b804-cea9b8729ae9 req-0fc843b7-81e6-49cc-991b-16934c65025b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:35.767073 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-cd4a1d9c-87b9-4e93-b804-cea9b8729ae9 req-0fc843b7-81e6-49cc-991b-16934c65025b service nova] Creating event network-changed:1f49550d-4db4-4a59-8f47-781f3f1bb08f for instance 5d595b36-cd30-410e-90c7-15d27167c094 on n-h1-766726-30 May 19 05:08:35.775243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64d7676f-7c04-4c6c-998a-c283c2405be1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:08:35.790287 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-cd4a1d9c-87b9-4e93-b804-cea9b8729ae9 req-0fc843b7-81e6-49cc-991b-16934c65025b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104654 May 19 05:08:35.797550 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2894/5705] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:08:35.992136 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64d7676f-7c04-4c6c-998a-c283c2405be1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 204 len: 0 microversion: 2.1 time: 0.356215 May 19 05:08:35.997838 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2812/5706] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:08:35 2022] DELETE /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:08:36.002766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5454f5bd-9aba-429a-b92c-f19ee7a5ed87 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:36.003554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5454f5bd-9aba-429a-b92c-f19ee7a5ed87 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:36.026575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5454f5bd-9aba-429a-b92c-f19ee7a5ed87 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:36.027948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5454f5bd-9aba-429a-b92c-f19ee7a5ed87 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:36.030254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5454f5bd-9aba-429a-b92c-f19ee7a5ed87 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:36.031128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5454f5bd-9aba-429a-b92c-f19ee7a5ed87 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:36.712026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5454f5bd-9aba-429a-b92c-f19ee7a5ed87 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:08:36.722159 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5454f5bd-9aba-429a-b92c-f19ee7a5ed87 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1687 microversion: 2.1 time: 0.723726 May 19 05:08:36.740529 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2895/5707] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:35 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1687 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:37.741290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa058d67-5670-4f87-ac91-e8332c75535f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:37.742568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aa058d67-5670-4f87-ac91-e8332c75535f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:37.757439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa058d67-5670-4f87-ac91-e8332c75535f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:37.758109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa058d67-5670-4f87-ac91-e8332c75535f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:37.760831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa058d67-5670-4f87-ac91-e8332c75535f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:37.761612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa058d67-5670-4f87-ac91-e8332c75535f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:38.233027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aa058d67-5670-4f87-ac91-e8332c75535f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:08:38.249760 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aa058d67-5670-4f87-ac91-e8332c75535f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1687 microversion: 2.1 time: 0.513260 May 19 05:08:38.250357 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2813/5708] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:37 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1687 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:39.267596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fca28278-b8fc-4d11-a511-c80d6637dd86 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:39.268224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fca28278-b8fc-4d11-a511-c80d6637dd86 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:39.285378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fca28278-b8fc-4d11-a511-c80d6637dd86 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:39.286408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fca28278-b8fc-4d11-a511-c80d6637dd86 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:39.298080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fca28278-b8fc-4d11-a511-c80d6637dd86 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:39.298573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fca28278-b8fc-4d11-a511-c80d6637dd86 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:39.664865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0752e2ea-4a4a-44f8-87fd-a2da2d6d9087 req-bd86f26e-0832-4c57-b67d-b842f4bfd89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d595b36-cd30-410e-90c7-15d27167c094", "name": "network-vif-deleted", "tag": "1f49550d-4db4-4a59-8f47-781f3f1bb08f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:08:39.692679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0752e2ea-4a4a-44f8-87fd-a2da2d6d9087 req-bd86f26e-0832-4c57-b67d-b842f4bfd89d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:39.695777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0752e2ea-4a4a-44f8-87fd-a2da2d6d9087 req-bd86f26e-0832-4c57-b67d-b842f4bfd89d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:39.725702 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0752e2ea-4a4a-44f8-87fd-a2da2d6d9087 req-bd86f26e-0832-4c57-b67d-b842f4bfd89d service nova] Creating event network-vif-deleted:1f49550d-4db4-4a59-8f47-781f3f1bb08f for instance 5d595b36-cd30-410e-90c7-15d27167c094 on n-h1-766726-30 May 19 05:08:39.738883 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0752e2ea-4a4a-44f8-87fd-a2da2d6d9087 req-bd86f26e-0832-4c57-b67d-b842f4bfd89d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077625 May 19 05:08:39.740199 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2814/5709] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:08:39.850298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fca28278-b8fc-4d11-a511-c80d6637dd86 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:08:39.859296 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fca28278-b8fc-4d11-a511-c80d6637dd86 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 200 len: 1501 microversion: 2.1 time: 0.595750 May 19 05:08:39.877845 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2896/5710] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:39 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 1501 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:40.878980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:40.880435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 5d595b36-cd30-410e-90c7-15d27167c094] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:40.900628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:40.903489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:40.904981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:40.912246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:40.949507 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] HTTP exception thrown: Instance 5d595b36-cd30-410e-90c7-15d27167c094 could not be found. May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Request method failure captured: May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 HTTP/1.1 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdBO1QaW5oc4f6Vrz9_NwPhOHXbWiDxmYrQKBdrJO1vjGvboRoh4Us4Qrl0niQvSpcbSKRZNOYd3wYZZ01n2S0A2Bcn-Shs64HIMUTvoCt-SNOaQMD9yf8DNih5M2vO7lT6UGNcxHOrZVfsf9K5fDqo0Bx0-_bGZxsamgPJQjmNVycw May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 3105ae3b914f4ac8a2a5466915fba229 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 3105ae3b914f4ac8a2a5466915fba229 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestNetworkAdvancedServerOps-1985069588-project May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 195b7b4b7d384374ac86bdeaf7568026 May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1985069588-project May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 5d595b36-cd30-410e-90c7-15d27167c094 could not be found. May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '5d595b36-cd30-410e-90c7-15d27167c094'} May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d595b36-cd30-410e-90c7-15d27167c094 could not be found. May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d595b36-cd30-410e-90c7-15d27167c094 could not be found. May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:08:40.959889 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:08:40.966014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:08:40.966014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:08:40.966014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:08:40.966014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:08:40.966014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:08:40.966014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:08:40.966014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d595b36-cd30-410e-90c7-15d27167c094 could not be found. May 19 05:08:40.966014 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:08:40.967908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Returning 404 to user: Instance 5d595b36-cd30-410e-90c7-15d27167c094 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:08:40.968944 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dab7fcba-368b-4a91-a7f6-f31cda85a414 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094" status: 404 len: 111 microversion: 2.1 time: 0.095668 May 19 05:08:40.976610 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2815/5711] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:40 2022] GET /compute/v2.1/servers/5d595b36-cd30-410e-90c7-15d27167c094 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:08:43.999662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-92ee0cf4-4560-4b99-8544-6f26b64e2475 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:44.002467 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:08:44.002467 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:08:44.003958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92ee0cf4-4560-4b99-8544-6f26b64e2475 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:44.004730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92ee0cf4-4560-4b99-8544-6f26b64e2475 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:44.005754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92ee0cf4-4560-4b99-8544-6f26b64e2475 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:44.006391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92ee0cf4-4560-4b99-8544-6f26b64e2475 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:44.100204 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-92ee0cf4-4560-4b99-8544-6f26b64e2475 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.494754 May 19 05:08:44.100822 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2897/5712] 10.222.0.58 () {58 vars in 1184 bytes} [Thu May 19 05:08:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:08:44.469912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1580220675", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "availability_zone": "nova:n-h1-766726-30", "networks": [{"uuid": "3b28e38e-5806-47cd-872c-2662346e41ce"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:08:44.622286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] validate_networks() for [('3b28e38e-5806-47cd-872c-2662346e41ce', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:08:45.971001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:08:45.972387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:08:45.974152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:08:45.974805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:08:45.975580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:08:45.999096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:46.001800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:46.003462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:46.005845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:46.058107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Getting quotas for project 6199150c159548889b24a8df336ead3e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:08:46.073138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Getting quotas for user 5fc8dcbee55b4f99b6bd423d955a0b3d and project 6199150c159548889b24a8df336ead3e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:08:46.104857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:08:46.111537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:08:46.218547 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-32d431b0-369a-455c-a403-c759dee5927f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.752311 May 19 05:08:46.226598 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2816/5713] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:08:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:08:46.236911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-637ba221-02c6-433a-98de-c467d3678f46 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:46.239816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-637ba221-02c6-433a-98de-c467d3678f46 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:46.422341 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-637ba221-02c6-433a-98de-c467d3678f46 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1329 microversion: 2.1 time: 0.193989 May 19 05:08:46.429872 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2898/5714] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:46 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1329 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:47.447566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-144bcc03-76ac-4339-9c67-292777133b3f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:47.448808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-144bcc03-76ac-4339-9c67-292777133b3f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:47.495688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-144bcc03-76ac-4339-9c67-292777133b3f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:47.504446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-144bcc03-76ac-4339-9c67-292777133b3f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:47.508221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-144bcc03-76ac-4339-9c67-292777133b3f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:47.508861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-144bcc03-76ac-4339-9c67-292777133b3f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:47.862225 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-144bcc03-76ac-4339-9c67-292777133b3f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1346 microversion: 2.1 time: 0.409027 May 19 05:08:47.864035 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2817/5715] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:47 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1346 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:48.880147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8203cf5-cb15-4f1e-94c1-7712b8f3bfce tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:48.906031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8203cf5-cb15-4f1e-94c1-7712b8f3bfce tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:48.938869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8203cf5-cb15-4f1e-94c1-7712b8f3bfce tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:48.944117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8203cf5-cb15-4f1e-94c1-7712b8f3bfce tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:48.947523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8203cf5-cb15-4f1e-94c1-7712b8f3bfce tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:48.948737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8203cf5-cb15-4f1e-94c1-7712b8f3bfce tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:49.184679 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8203cf5-cb15-4f1e-94c1-7712b8f3bfce tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1436 microversion: 2.1 time: 0.308243 May 19 05:08:49.188185 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2899/5716] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:48 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1436 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:50.210146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-306f91e3-df11-4a62-a2d0-d76e024cfd2d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:50.212439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-306f91e3-df11-4a62-a2d0-d76e024cfd2d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:50.264672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18eeebc0-e07d-43d6-8b83-7b35a646238e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '.version_select at 0x7fd314b84d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:50.275672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-306f91e3-df11-4a62-a2d0-d76e024cfd2d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:50.277219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-306f91e3-df11-4a62-a2d0-d76e024cfd2d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:50.281854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-306f91e3-df11-4a62-a2d0-d76e024cfd2d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:50.285706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-306f91e3-df11-4a62-a2d0-d76e024cfd2d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:50.330332 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18eeebc0-e07d-43d6-8b83-7b35a646238e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-968650700" status: 202 len: 0 microversion: 2.1 time: 0.080427 May 19 05:08:50.331579 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2900/5717] 10.222.0.58 () {58 vars in 1280 bytes} [Thu May 19 05:08:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-968650700 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:08:50.364637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fc814b5e-bbe8-4a94-8df8-1f635106c179 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'create', calling method: .version_select at 0x7fd315c030d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-870732238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML8BDthQG7DqzaJHpaMsMo0nqcXhytR0r8utqm5pz6rkyrSnxUALByl887J+0Tq6iSZBEaYOO+UPasMqAvRKJ0goiGtmLWKZ/fxYJpTjStFQco4+GyjQ3vtkrPHnopvVA=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:08:50.439026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-fc814b5e-bbe8-4a94-8df8-1f635106c179 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:08:50.461497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-fc814b5e-bbe8-4a94-8df8-1f635106c179 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for user 195b7b4b7d384374ac86bdeaf7568026 and project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:08:50.540113 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fc814b5e-bbe8-4a94-8df8-1f635106c179 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.180153 May 19 05:08:50.540881 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2901/5718] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:08:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:08:50.915034 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-306f91e3-df11-4a62-a2d0-d76e024cfd2d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1466 microversion: 2.1 time: 0.713533 May 19 05:08:50.935449 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2818/5719] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:50 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1466 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:08:51.934122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8f7c8ea1-9689-4226-8941-05efbdd2a08b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:51.937897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8f7c8ea1-9689-4226-8941-05efbdd2a08b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:51.986326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ea1-9689-4226-8941-05efbdd2a08b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:51.989553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ea1-9689-4226-8941-05efbdd2a08b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:51.990589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ea1-9689-4226-8941-05efbdd2a08b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:51.992629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ea1-9689-4226-8941-05efbdd2a08b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:52.327683 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8f7c8ea1-9689-4226-8941-05efbdd2a08b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1466 microversion: 2.1 time: 0.397801 May 19 05:08:52.345022 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2902/5720] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:51 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1466 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:52.440390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5ce2c5c0-0af3-4829-97d4-3e847a9922b7 req-b212e46d-eb59-466f-8f58-6fe7187b50b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "634f735d-5a43-4f2a-b9c2-dd6b7aed6629", "tag": "678d3071-2be1-4b59-80aa-3b5a4075fe8e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:08:52.457449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5ce2c5c0-0af3-4829-97d4-3e847a9922b7 req-b212e46d-eb59-466f-8f58-6fe7187b50b5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:52.463059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5ce2c5c0-0af3-4829-97d4-3e847a9922b7 req-b212e46d-eb59-466f-8f58-6fe7187b50b5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:52.502710 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5ce2c5c0-0af3-4829-97d4-3e847a9922b7 req-b212e46d-eb59-466f-8f58-6fe7187b50b5 service nova] Creating event network-changed:678d3071-2be1-4b59-80aa-3b5a4075fe8e for instance 634f735d-5a43-4f2a-b9c2-dd6b7aed6629 on n-h1-766726-30 May 19 05:08:52.522935 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5ce2c5c0-0af3-4829-97d4-3e847a9922b7 req-b212e46d-eb59-466f-8f58-6fe7187b50b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086233 May 19 05:08:52.532433 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2819/5721] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:08:53.374795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b73aa12-5587-4ecf-bfc8-69e8cf6b6eb5 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:53.376770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9b73aa12-5587-4ecf-bfc8-69e8cf6b6eb5 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:53.389728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b73aa12-5587-4ecf-bfc8-69e8cf6b6eb5 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:53.395407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b73aa12-5587-4ecf-bfc8-69e8cf6b6eb5 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:53.396641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b73aa12-5587-4ecf-bfc8-69e8cf6b6eb5 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:53.397540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b73aa12-5587-4ecf-bfc8-69e8cf6b6eb5 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:53.609118 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9b73aa12-5587-4ecf-bfc8-69e8cf6b6eb5 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1466 microversion: 2.1 time: 0.238007 May 19 05:08:53.624914 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2903/5722] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:53 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1466 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:54.640675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7a25f11a-77fc-4074-abc2-0eafbd45628f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:54.642382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7a25f11a-77fc-4074-abc2-0eafbd45628f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:54.659113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a25f11a-77fc-4074-abc2-0eafbd45628f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:54.659586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a25f11a-77fc-4074-abc2-0eafbd45628f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:54.664710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a25f11a-77fc-4074-abc2-0eafbd45628f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:54.665499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a25f11a-77fc-4074-abc2-0eafbd45628f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:55.065271 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7a25f11a-77fc-4074-abc2-0eafbd45628f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1466 microversion: 2.1 time: 0.427690 May 19 05:08:55.067193 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2820/5723] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:54 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1466 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:56.083376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-daa6b35c-63ac-492c-9624-91072bf9944b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:56.085020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-daa6b35c-63ac-492c-9624-91072bf9944b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:56.094599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:08:56.104423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daa6b35c-63ac-492c-9624-91072bf9944b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:56.106620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daa6b35c-63ac-492c-9624-91072bf9944b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:56.108646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daa6b35c-63ac-492c-9624-91072bf9944b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:56.109801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-daa6b35c-63ac-492c-9624-91072bf9944b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:56.452406 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-daa6b35c-63ac-492c-9624-91072bf9944b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1466 microversion: 2.1 time: 0.374209 May 19 05:08:56.452998 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2904/5724] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:56 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1466 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:57.469528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e079af5-bc06-42b0-ab6c-8530a8c840e0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:57.470777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e079af5-bc06-42b0-ab6c-8530a8c840e0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:57.474220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:08:57.477202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:08:57.500985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e079af5-bc06-42b0-ab6c-8530a8c840e0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:57.502438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e079af5-bc06-42b0-ab6c-8530a8c840e0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:57.504034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e079af5-bc06-42b0-ab6c-8530a8c840e0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:57.505626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1e079af5-bc06-42b0-ab6c-8530a8c840e0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:57.783419 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e079af5-bc06-42b0-ab6c-8530a8c840e0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1466 microversion: 2.1 time: 0.318016 May 19 05:08:57.784851 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2821/5725] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:57 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1466 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:08:58.285822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c86633ef-c5b0-4da3-99fc-db08a47b6611 req-219af7c9-3f54-4bd6-93ba-494e431b9465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634f735d-5a43-4f2a-b9c2-dd6b7aed6629", "name": "network-vif-plugged", "status": "completed", "tag": "678d3071-2be1-4b59-80aa-3b5a4075fe8e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:08:58.318827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c86633ef-c5b0-4da3-99fc-db08a47b6611 req-219af7c9-3f54-4bd6-93ba-494e431b9465 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:58.319556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c86633ef-c5b0-4da3-99fc-db08a47b6611 req-219af7c9-3f54-4bd6-93ba-494e431b9465 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:58.385609 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c86633ef-c5b0-4da3-99fc-db08a47b6611 req-219af7c9-3f54-4bd6-93ba-494e431b9465 service nova] Creating event network-vif-plugged:678d3071-2be1-4b59-80aa-3b5a4075fe8e for instance 634f735d-5a43-4f2a-b9c2-dd6b7aed6629 on n-h1-766726-30 May 19 05:08:58.408538 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c86633ef-c5b0-4da3-99fc-db08a47b6611 req-219af7c9-3f54-4bd6-93ba-494e431b9465 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126842 May 19 05:08:58.416084 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2905/5726] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:08:58.801743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ecbc0428-bbbe-4400-bedd-b12e72c80a0b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:08:58.803370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ecbc0428-bbbe-4400-bedd-b12e72c80a0b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:08:58.810500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ecbc0428-bbbe-4400-bedd-b12e72c80a0b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:58.811170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ecbc0428-bbbe-4400-bedd-b12e72c80a0b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:58.812136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ecbc0428-bbbe-4400-bedd-b12e72c80a0b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:08:58.812871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ecbc0428-bbbe-4400-bedd-b12e72c80a0b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:08:59.293835 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ecbc0428-bbbe-4400-bedd-b12e72c80a0b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1466 microversion: 2.1 time: 0.491017 May 19 05:08:59.295091 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2822/5727] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:08:58 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1466 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:00.314094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-912ce6d7-b06a-434b-8edb-df9f40c339fa tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:00.315586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-912ce6d7-b06a-434b-8edb-df9f40c339fa tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:00.331959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-912ce6d7-b06a-434b-8edb-df9f40c339fa tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:00.333837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-912ce6d7-b06a-434b-8edb-df9f40c339fa tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:00.334856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-912ce6d7-b06a-434b-8edb-df9f40c339fa tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:00.338054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-912ce6d7-b06a-434b-8edb-df9f40c339fa tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:00.487268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:00.851004 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-912ce6d7-b06a-434b-8edb-df9f40c339fa tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1650 microversion: 2.1 time: 0.543970 May 19 05:09:00.854256 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2906/5728] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:00 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1650 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:00.878395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b2ee5ed6-a5fa-4be0-9e1f-40a8606c330c tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:00.879271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b2ee5ed6-a5fa-4be0-9e1f-40a8606c330c tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:00.890411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ee5ed6-a5fa-4be0-9e1f-40a8606c330c tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:00.890772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ee5ed6-a5fa-4be0-9e1f-40a8606c330c tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:00.891906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ee5ed6-a5fa-4be0-9e1f-40a8606c330c tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:00.892623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b2ee5ed6-a5fa-4be0-9e1f-40a8606c330c tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:01.400378 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b2ee5ed6-a5fa-4be0-9e1f-40a8606c330c tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1650 microversion: 2.1 time: 0.527930 May 19 05:09:01.403866 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2823/5729] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:00 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1650 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:01.417181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-728f898f-4105-4c5f-b188-3eb14dcf3e1b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:01.418515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-728f898f-4105-4c5f-b188-3eb14dcf3e1b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:01.421991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:01.437431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-728f898f-4105-4c5f-b188-3eb14dcf3e1b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:01.437902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-728f898f-4105-4c5f-b188-3eb14dcf3e1b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:01.443298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-728f898f-4105-4c5f-b188-3eb14dcf3e1b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:01.444586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-728f898f-4105-4c5f-b188-3eb14dcf3e1b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:01.455703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=55 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:01.839178 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-728f898f-4105-4c5f-b188-3eb14dcf3e1b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1650 microversion: 2.1 time: 0.426300 May 19 05:09:01.839837 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2907/5730] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:01 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1650 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:02.258147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1840758700", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "availability_zone": "nova:n-h2-766726-30", "networks": [{"uuid": "3b28e38e-5806-47cd-872c-2662346e41ce"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:02.488216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] validate_networks() for [('3b28e38e-5806-47cd-872c-2662346e41ce', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:09:04.518004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:09:04.518540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:09:04.518936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:09:04.519348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:09:04.519967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:09:04.540557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:04.541049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:04.542271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:04.542271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:04.642094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Getting quotas for project 6199150c159548889b24a8df336ead3e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:09:04.659276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Getting quotas for user 5fc8dcbee55b4f99b6bd423d955a0b3d and project 6199150c159548889b24a8df336ead3e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:09:04.686328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:09:04.691928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:09:04.818158 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8831edff-cb25-4218-9919-7e6a6c667a56 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.566516 May 19 05:09:04.827882 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2824/5731] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:09:04.832952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a64bbb3-1669-4b0f-be5b-af8726930dd7 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:04.833800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a64bbb3-1669-4b0f-be5b-af8726930dd7 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:05.047985 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a64bbb3-1669-4b0f-be5b-af8726930dd7 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1329 microversion: 2.1 time: 0.220842 May 19 05:09:05.063381 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2908/5732] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:04 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1329 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:05.772308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1350872233", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "57041888-368b-4fe9-aa39-7c14aa5df9e6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-870732238", "security_groups": [{"name": "tempest-secgroup-smoke-606784646"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:05.827277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:06.064908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-689b9228-0850-419d-8860-aedf0ef99923 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:06.066247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-689b9228-0850-419d-8860-aedf0ef99923 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:06.082797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-689b9228-0850-419d-8860-aedf0ef99923 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:06.086742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-689b9228-0850-419d-8860-aedf0ef99923 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:06.088335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-689b9228-0850-419d-8860-aedf0ef99923 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:06.092158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-689b9228-0850-419d-8860-aedf0ef99923 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:06.244517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] validate_networks() for [('57041888-368b-4fe9-aa39-7c14aa5df9e6', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:09:06.413004 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-689b9228-0850-419d-8860-aedf0ef99923 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1346 microversion: 2.1 time: 0.351841 May 19 05:09:06.430003 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2909/5733] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:06 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1346 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:07.429785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-708918ca-310b-427c-b0c2-3fb962f7e2bd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:07.432202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-708918ca-310b-427c-b0c2-3fb962f7e2bd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:07.466912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-708918ca-310b-427c-b0c2-3fb962f7e2bd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:07.467961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-708918ca-310b-427c-b0c2-3fb962f7e2bd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:07.471718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-708918ca-310b-427c-b0c2-3fb962f7e2bd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:07.483018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-708918ca-310b-427c-b0c2-3fb962f7e2bd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:08.300519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:09:08.301046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:09:08.301905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:09:08.302433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:09:08.303104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:09:08.319731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:08.320554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:08.321650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:08.323039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:08.340216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:08.380811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:09:08.397190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for user 195b7b4b7d384374ac86bdeaf7568026 and project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:09:08.429969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:09:08.433810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:09:08.471392 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-708918ca-310b-427c-b0c2-3fb962f7e2bd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1466 microversion: 2.1 time: 1.045555 May 19 05:09:08.473018 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2910/5734] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:07 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1466 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:08.601876 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b7efb0d9-f796-49ae-969f-7f0e2b32896a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.834499 May 19 05:09:08.606760 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2825/5735] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:09:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 2840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:09:08.622852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad918228-f075-4428-9bc2-99ff5d1248b5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:08.625150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ad918228-f075-4428-9bc2-99ff5d1248b5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:08.807434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ad918228-f075-4428-9bc2-99ff5d1248b5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:08.822265 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad918228-f075-4428-9bc2-99ff5d1248b5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1266 microversion: 2.1 time: 0.208203 May 19 05:09:08.836105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2911/5736] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:08 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:09.491992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a318add2-a013-44be-ae53-67d41fab25cd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:09.492618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a318add2-a013-44be-ae53-67d41fab25cd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:09.505185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a318add2-a013-44be-ae53-67d41fab25cd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:09.507346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a318add2-a013-44be-ae53-67d41fab25cd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:09.510207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a318add2-a013-44be-ae53-67d41fab25cd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:09.512452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a318add2-a013-44be-ae53-67d41fab25cd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:09.848432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5188d3ca-fa8d-49ef-92ff-85d3b7166c20 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:09.849732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5188d3ca-fa8d-49ef-92ff-85d3b7166c20 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:09.882547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5188d3ca-fa8d-49ef-92ff-85d3b7166c20 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:09.898394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5188d3ca-fa8d-49ef-92ff-85d3b7166c20 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:09.935147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5188d3ca-fa8d-49ef-92ff-85d3b7166c20 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:09.940658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5188d3ca-fa8d-49ef-92ff-85d3b7166c20 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:10.262185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5188d3ca-fa8d-49ef-92ff-85d3b7166c20 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:10.278237 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5188d3ca-fa8d-49ef-92ff-85d3b7166c20 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1262 microversion: 2.1 time: 0.435929 May 19 05:09:10.281250 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2912/5737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:09 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1262 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:10.493112 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a318add2-a013-44be-ae53-67d41fab25cd tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1466 microversion: 2.1 time: 1.000391 May 19 05:09:10.495578 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2826/5738] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:09 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1466 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:11.297525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a7601d1-4776-4808-afa0-356410c0b48b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:11.298173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a7601d1-4776-4808-afa0-356410c0b48b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:11.314835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a7601d1-4776-4808-afa0-356410c0b48b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:11.315327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a7601d1-4776-4808-afa0-356410c0b48b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:11.316161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a7601d1-4776-4808-afa0-356410c0b48b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:11.316843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a7601d1-4776-4808-afa0-356410c0b48b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:11.367779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-42b863fe-7186-49b7-a554-0ea1927ff034 req-13d63d8c-3ff9-41db-9e3d-8f3f4d2b47a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef5d418-d686-4df9-a630-0e474abc9bf8", "tag": "524c9827-bc22-4ef7-bf8b-83ac010dd92d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:11.386632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-42b863fe-7186-49b7-a554-0ea1927ff034 req-13d63d8c-3ff9-41db-9e3d-8f3f4d2b47a2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:11.387287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-42b863fe-7186-49b7-a554-0ea1927ff034 req-13d63d8c-3ff9-41db-9e3d-8f3f4d2b47a2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:11.433771 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-42b863fe-7186-49b7-a554-0ea1927ff034 req-13d63d8c-3ff9-41db-9e3d-8f3f4d2b47a2 service nova] Creating event network-changed:524c9827-bc22-4ef7-bf8b-83ac010dd92d for instance 5ef5d418-d686-4df9-a630-0e474abc9bf8 on n-h2-766726-30 May 19 05:09:11.453738 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-42b863fe-7186-49b7-a554-0ea1927ff034 req-13d63d8c-3ff9-41db-9e3d-8f3f4d2b47a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089200 May 19 05:09:11.453738 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2827/5739] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:09:11.512379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6a43d86-f356-4da8-90e6-8cc6eba4125b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:11.513110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b6a43d86-f356-4da8-90e6-8cc6eba4125b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:11.525808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6a43d86-f356-4da8-90e6-8cc6eba4125b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:11.526484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6a43d86-f356-4da8-90e6-8cc6eba4125b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:11.527415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6a43d86-f356-4da8-90e6-8cc6eba4125b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:11.532204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6a43d86-f356-4da8-90e6-8cc6eba4125b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:11.612269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a7601d1-4776-4808-afa0-356410c0b48b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:11.637042 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a7601d1-4776-4808-afa0-356410c0b48b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1324 microversion: 2.1 time: 0.343739 May 19 05:09:11.637704 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2913/5740] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:11 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:12.149712 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6a43d86-f356-4da8-90e6-8cc6eba4125b tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1466 microversion: 2.1 time: 0.641355 May 19 05:09:12.159632 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2828/5741] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:11 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1466 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:12.656486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4c01fd90-963d-4a84-b81e-ac7d8e7cb14a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:12.659464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4c01fd90-963d-4a84-b81e-ac7d8e7cb14a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:12.670350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c01fd90-963d-4a84-b81e-ac7d8e7cb14a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:12.685132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c01fd90-963d-4a84-b81e-ac7d8e7cb14a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:12.686439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c01fd90-963d-4a84-b81e-ac7d8e7cb14a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:12.687159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4c01fd90-963d-4a84-b81e-ac7d8e7cb14a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:13.172015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7a06b724-ef6f-4f1a-8868-5333985de0b8 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:13.172645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7a06b724-ef6f-4f1a-8868-5333985de0b8 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:13.193984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a06b724-ef6f-4f1a-8868-5333985de0b8 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:13.195753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a06b724-ef6f-4f1a-8868-5333985de0b8 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:13.199649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a06b724-ef6f-4f1a-8868-5333985de0b8 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:13.201811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7a06b724-ef6f-4f1a-8868-5333985de0b8 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:13.249947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4c01fd90-963d-4a84-b81e-ac7d8e7cb14a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:13.258982 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4c01fd90-963d-4a84-b81e-ac7d8e7cb14a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1391 microversion: 2.1 time: 0.606890 May 19 05:09:13.259593 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2914/5742] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:12 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1391 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:13.441551 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7a06b724-ef6f-4f1a-8868-5333985de0b8 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1466 microversion: 2.1 time: 0.275074 May 19 05:09:13.444358 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2829/5743] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:13 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1466 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:14.289113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c88c7888-b69c-4514-877c-494dbc932e09 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:14.292331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c88c7888-b69c-4514-877c-494dbc932e09 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:14.314137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c88c7888-b69c-4514-877c-494dbc932e09 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:14.316194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c88c7888-b69c-4514-877c-494dbc932e09 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:14.318611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c88c7888-b69c-4514-877c-494dbc932e09 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:14.319780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c88c7888-b69c-4514-877c-494dbc932e09 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:14.460366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fbdd4115-3490-4d62-95f9-8eabd7532333 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:14.460977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fbdd4115-3490-4d62-95f9-8eabd7532333 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:14.468602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbdd4115-3490-4d62-95f9-8eabd7532333 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:14.473586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbdd4115-3490-4d62-95f9-8eabd7532333 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:14.476680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbdd4115-3490-4d62-95f9-8eabd7532333 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:14.478856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fbdd4115-3490-4d62-95f9-8eabd7532333 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:14.852445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c88c7888-b69c-4514-877c-494dbc932e09 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:14.863511 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c88c7888-b69c-4514-877c-494dbc932e09 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1391 microversion: 2.1 time: 0.582574 May 19 05:09:14.864754 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2915/5744] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:14 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1391 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:14.895120 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fbdd4115-3490-4d62-95f9-8eabd7532333 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1466 microversion: 2.1 time: 0.439104 May 19 05:09:14.896813 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2830/5745] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:14 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1466 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:15.656923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4b4a327d-9b70-4166-8316-c407dcbd0835 req-84005d2a-9a01-424a-8ec9-564035b6bd63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:15.683312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4b4a327d-9b70-4166-8316-c407dcbd0835 req-84005d2a-9a01-424a-8ec9-564035b6bd63 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:15.685203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4b4a327d-9b70-4166-8316-c407dcbd0835 req-84005d2a-9a01-424a-8ec9-564035b6bd63 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:15.721862 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4b4a327d-9b70-4166-8316-c407dcbd0835 req-84005d2a-9a01-424a-8ec9-564035b6bd63 service nova] Creating event network-changed:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h2-766726-30 May 19 05:09:15.728421 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4b4a327d-9b70-4166-8316-c407dcbd0835 req-84005d2a-9a01-424a-8ec9-564035b6bd63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075154 May 19 05:09:15.732410 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2916/5746] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:09:15.881301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed41606d-4c87-4dd6-9c7a-90c4f844b3fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:15.882101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed41606d-4c87-4dd6-9c7a-90c4f844b3fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:15.897750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed41606d-4c87-4dd6-9c7a-90c4f844b3fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:15.899583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed41606d-4c87-4dd6-9c7a-90c4f844b3fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:15.902174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed41606d-4c87-4dd6-9c7a-90c4f844b3fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:15.903099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed41606d-4c87-4dd6-9c7a-90c4f844b3fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:15.912807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e5afd933-adee-48f6-bde5-2961aeaaff95 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:15.913951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e5afd933-adee-48f6-bde5-2961aeaaff95 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:15.928147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5afd933-adee-48f6-bde5-2961aeaaff95 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:15.937734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5afd933-adee-48f6-bde5-2961aeaaff95 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:15.941542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5afd933-adee-48f6-bde5-2961aeaaff95 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:15.941542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e5afd933-adee-48f6-bde5-2961aeaaff95 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:17.214359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed41606d-4c87-4dd6-9c7a-90c4f844b3fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:17.226890 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed41606d-4c87-4dd6-9c7a-90c4f844b3fa tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1391 microversion: 2.1 time: 1.349945 May 19 05:09:17.231470 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2831/5747] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:15 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1391 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:17.287441 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e5afd933-adee-48f6-bde5-2961aeaaff95 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1466 microversion: 2.1 time: 1.379193 May 19 05:09:17.292115 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2917/5748] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:15 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1466 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:18.213401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d2febe22-0985-46f8-8884-a57d82cc63e4 req-67148498-5717-45c7-8b12-00ff48455d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef5d418-d686-4df9-a630-0e474abc9bf8", "name": "network-vif-plugged", "status": "completed", "tag": "524c9827-bc22-4ef7-bf8b-83ac010dd92d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:18.254326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7519f6e3-233b-40b2-b7ae-ae3bfda6c5e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:18.257240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7519f6e3-233b-40b2-b7ae-ae3bfda6c5e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:18.261765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d2febe22-0985-46f8-8884-a57d82cc63e4 req-67148498-5717-45c7-8b12-00ff48455d1b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:18.265972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d2febe22-0985-46f8-8884-a57d82cc63e4 req-67148498-5717-45c7-8b12-00ff48455d1b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:18.278368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7519f6e3-233b-40b2-b7ae-ae3bfda6c5e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:18.282126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7519f6e3-233b-40b2-b7ae-ae3bfda6c5e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:18.284818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7519f6e3-233b-40b2-b7ae-ae3bfda6c5e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:18.287477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7519f6e3-233b-40b2-b7ae-ae3bfda6c5e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:18.349268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:18.364775 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d2febe22-0985-46f8-8884-a57d82cc63e4 req-67148498-5717-45c7-8b12-00ff48455d1b service nova] Creating event network-vif-plugged:524c9827-bc22-4ef7-bf8b-83ac010dd92d for instance 5ef5d418-d686-4df9-a630-0e474abc9bf8 on n-h2-766726-30 May 19 05:09:18.383601 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d2febe22-0985-46f8-8884-a57d82cc63e4 req-67148498-5717-45c7-8b12-00ff48455d1b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175530 May 19 05:09:18.385757 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2832/5749] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:09:18.396524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-25f3fc37-a6eb-41fe-8ed7-39416c61e573 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:18.401653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-25f3fc37-a6eb-41fe-8ed7-39416c61e573 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:18.414179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25f3fc37-a6eb-41fe-8ed7-39416c61e573 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:18.414890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25f3fc37-a6eb-41fe-8ed7-39416c61e573 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:18.418335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25f3fc37-a6eb-41fe-8ed7-39416c61e573 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:18.421938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-25f3fc37-a6eb-41fe-8ed7-39416c61e573 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:18.423320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=12 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:18.820419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:18.956623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7519f6e3-233b-40b2-b7ae-ae3bfda6c5e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:18.971740 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7519f6e3-233b-40b2-b7ae-ae3bfda6c5e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1391 microversion: 2.1 time: 0.724946 May 19 05:09:18.978615 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2918/5750] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:18 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1391 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:19.046791 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-25f3fc37-a6eb-41fe-8ed7-39416c61e573 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1466 microversion: 2.1 time: 0.659055 May 19 05:09:19.047384 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2833/5751] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:18 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1466 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:19.999929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-debdb281-3364-42c3-9d5d-3c91788fcfdc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:20.008191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-debdb281-3364-42c3-9d5d-3c91788fcfdc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:20.028665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-debdb281-3364-42c3-9d5d-3c91788fcfdc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:20.029391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-debdb281-3364-42c3-9d5d-3c91788fcfdc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:20.042367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-debdb281-3364-42c3-9d5d-3c91788fcfdc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:20.052733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-debdb281-3364-42c3-9d5d-3c91788fcfdc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:20.064288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f5db13b4-e9f3-47a0-9cd5-0fc22160fb04 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:20.066236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f5db13b4-e9f3-47a0-9cd5-0fc22160fb04 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:20.093605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f5db13b4-e9f3-47a0-9cd5-0fc22160fb04 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:20.099868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f5db13b4-e9f3-47a0-9cd5-0fc22160fb04 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:20.101421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f5db13b4-e9f3-47a0-9cd5-0fc22160fb04 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:20.107142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f5db13b4-e9f3-47a0-9cd5-0fc22160fb04 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:20.604774 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f5db13b4-e9f3-47a0-9cd5-0fc22160fb04 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1466 microversion: 2.1 time: 0.540114 May 19 05:09:20.605450 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2834/5752] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:20 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1466 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:20.625668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-debdb281-3364-42c3-9d5d-3c91788fcfdc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:20.639625 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-debdb281-3364-42c3-9d5d-3c91788fcfdc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1391 microversion: 2.1 time: 0.644748 May 19 05:09:20.654625 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2919/5753] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:19 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1391 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:21.622710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c281e99f-047b-4731-94d9-aa9af2352b4e tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:21.623620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c281e99f-047b-4731-94d9-aa9af2352b4e tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:21.632946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c281e99f-047b-4731-94d9-aa9af2352b4e tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:21.633720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c281e99f-047b-4731-94d9-aa9af2352b4e tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:21.635677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c281e99f-047b-4731-94d9-aa9af2352b4e tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:21.636400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c281e99f-047b-4731-94d9-aa9af2352b4e tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:21.661651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-93f14081-9622-4970-a5de-6ddd7dc1959c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:21.662282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-93f14081-9622-4970-a5de-6ddd7dc1959c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:21.680082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93f14081-9622-4970-a5de-6ddd7dc1959c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:21.680562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93f14081-9622-4970-a5de-6ddd7dc1959c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:21.686568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93f14081-9622-4970-a5de-6ddd7dc1959c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:21.687177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93f14081-9622-4970-a5de-6ddd7dc1959c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:22.071378 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c281e99f-047b-4731-94d9-aa9af2352b4e tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1651 microversion: 2.1 time: 0.452873 May 19 05:09:22.078701 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2835/5754] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:21 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1651 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:09:22.106432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a35d821f-eaef-42b5-a88d-0a476b943080 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:22.108851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a35d821f-eaef-42b5-a88d-0a476b943080 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:22.125147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a35d821f-eaef-42b5-a88d-0a476b943080 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:22.128201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a35d821f-eaef-42b5-a88d-0a476b943080 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:22.130476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a35d821f-eaef-42b5-a88d-0a476b943080 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:22.132493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a35d821f-eaef-42b5-a88d-0a476b943080 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:22.150108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-93f14081-9622-4970-a5de-6ddd7dc1959c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:22.162618 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-93f14081-9622-4970-a5de-6ddd7dc1959c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1391 microversion: 2.1 time: 0.504707 May 19 05:09:22.178958 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2920/5755] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:21 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1391 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:22.265966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-bfd39c07-47cc-442c-b123-11c1f7190cdd req-a7e0b076-a469-4626-81bc-3dde650c6844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "name": "network-vif-plugged", "status": "completed", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:22.279878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bfd39c07-47cc-442c-b123-11c1f7190cdd req-a7e0b076-a469-4626-81bc-3dde650c6844 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:22.281379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-bfd39c07-47cc-442c-b123-11c1f7190cdd req-a7e0b076-a469-4626-81bc-3dde650c6844 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:22.310490 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-bfd39c07-47cc-442c-b123-11c1f7190cdd req-a7e0b076-a469-4626-81bc-3dde650c6844 service nova] Creating event network-vif-plugged:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h2-766726-30 May 19 05:09:22.323755 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-bfd39c07-47cc-442c-b123-11c1f7190cdd req-a7e0b076-a469-4626-81bc-3dde650c6844 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061842 May 19 05:09:22.326640 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2921/5756] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:09:22.532967 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a35d821f-eaef-42b5-a88d-0a476b943080 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1651 microversion: 2.1 time: 0.432085 May 19 05:09:22.534621 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2836/5757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:22 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1651 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:22.553997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c81f251-01aa-4eba-ad8d-2f10d240d094 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:22.557616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6c81f251-01aa-4eba-ad8d-2f10d240d094 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:22.572026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c81f251-01aa-4eba-ad8d-2f10d240d094 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:22.574432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c81f251-01aa-4eba-ad8d-2f10d240d094 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:22.576131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c81f251-01aa-4eba-ad8d-2f10d240d094 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:22.579643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c81f251-01aa-4eba-ad8d-2f10d240d094 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:22.814352 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6c81f251-01aa-4eba-ad8d-2f10d240d094 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1651 microversion: 2.1 time: 0.264236 May 19 05:09:22.816014 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2922/5758] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:22 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1651 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:22.831422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ef53eb4-1c24-4880-a30b-e51f6898c24f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:22.832730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4ef53eb4-1c24-4880-a30b-e51f6898c24f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:22.840821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ef53eb4-1c24-4880-a30b-e51f6898c24f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:22.841514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ef53eb4-1c24-4880-a30b-e51f6898c24f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:22.842432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ef53eb4-1c24-4880-a30b-e51f6898c24f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:22.843010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ef53eb4-1c24-4880-a30b-e51f6898c24f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:22.876891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4ef53eb4-1c24-4880-a30b-e51f6898c24f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:09:23.021228 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4ef53eb4-1c24-4880-a30b-e51f6898c24f tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 204 len: 0 microversion: 2.1 time: 0.193866 May 19 05:09:23.022437 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2837/5759] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:09:22 2022] DELETE /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:09:23.031564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fff9ace2-24f6-43bc-8abe-15c0339af6f0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:23.032272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fff9ace2-24f6-43bc-8abe-15c0339af6f0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:23.051358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fff9ace2-24f6-43bc-8abe-15c0339af6f0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:23.051820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fff9ace2-24f6-43bc-8abe-15c0339af6f0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:23.052641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fff9ace2-24f6-43bc-8abe-15c0339af6f0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:23.053148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fff9ace2-24f6-43bc-8abe-15c0339af6f0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:23.181775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c30b268f-563f-43f1-a020-ebeb487e717f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:23.182960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c30b268f-563f-43f1-a020-ebeb487e717f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:23.194756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c30b268f-563f-43f1-a020-ebeb487e717f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:23.196249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c30b268f-563f-43f1-a020-ebeb487e717f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:23.197972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c30b268f-563f-43f1-a020-ebeb487e717f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:23.200764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c30b268f-563f-43f1-a020-ebeb487e717f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:23.332386 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fff9ace2-24f6-43bc-8abe-15c0339af6f0 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1657 microversion: 2.1 time: 0.305290 May 19 05:09:23.336922 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2923/5760] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:23 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1657 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:23.473424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c30b268f-563f-43f1-a020-ebeb487e717f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:23.483112 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c30b268f-563f-43f1-a020-ebeb487e717f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1391 microversion: 2.1 time: 0.305479 May 19 05:09:23.496969 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2838/5761] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:23 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:24.353153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8173f911-6d23-4103-b437-ae270603a669 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:24.354326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8173f911-6d23-4103-b437-ae270603a669 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:24.369023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8173f911-6d23-4103-b437-ae270603a669 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:24.369702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8173f911-6d23-4103-b437-ae270603a669 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:24.370664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8173f911-6d23-4103-b437-ae270603a669 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:24.371255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8173f911-6d23-4103-b437-ae270603a669 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:24.499870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ea71ed5-5efc-4a61-b77c-cd02c6f8bb35 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:24.503044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9ea71ed5-5efc-4a61-b77c-cd02c6f8bb35 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:24.524102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ea71ed5-5efc-4a61-b77c-cd02c6f8bb35 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:24.524572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ea71ed5-5efc-4a61-b77c-cd02c6f8bb35 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:24.525415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ea71ed5-5efc-4a61-b77c-cd02c6f8bb35 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:24.525863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ea71ed5-5efc-4a61-b77c-cd02c6f8bb35 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:24.636513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8173f911-6d23-4103-b437-ae270603a669 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1657 microversion: 2.1 time: 0.287076 May 19 05:09:24.642031 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2924/5762] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:24 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1657 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:24.886870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9ea71ed5-5efc-4a61-b77c-cd02c6f8bb35 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:24.902019 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ea71ed5-5efc-4a61-b77c-cd02c6f8bb35 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1563 microversion: 2.1 time: 0.405826 May 19 05:09:24.902910 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2839/5763] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:24 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1563 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:24.920928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4a74255b-8546-4897-bfd0-cc4600183bd8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:24.921878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4a74255b-8546-4897-bfd0-cc4600183bd8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:24.935589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a74255b-8546-4897-bfd0-cc4600183bd8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:24.941169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a74255b-8546-4897-bfd0-cc4600183bd8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:24.943113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a74255b-8546-4897-bfd0-cc4600183bd8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:24.946256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a74255b-8546-4897-bfd0-cc4600183bd8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:25.328506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4a74255b-8546-4897-bfd0-cc4600183bd8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:25.345920 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4a74255b-8546-4897-bfd0-cc4600183bd8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1563 microversion: 2.1 time: 0.428714 May 19 05:09:25.369509 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2925/5764] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:24 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1563 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:25.653347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6e38e44-4b62-4d4b-9edc-68db55586745 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:25.653978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6e38e44-4b62-4d4b-9edc-68db55586745 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:25.670520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6e38e44-4b62-4d4b-9edc-68db55586745 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:25.670980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6e38e44-4b62-4d4b-9edc-68db55586745 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:25.671766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6e38e44-4b62-4d4b-9edc-68db55586745 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:25.672209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6e38e44-4b62-4d4b-9edc-68db55586745 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:26.164636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b5e00daf-db97-432a-a41a-0812c65c0f67 req-8da903d8-eb6a-4927-8c41-27d729d73a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef5d418-d686-4df9-a630-0e474abc9bf8", "name": "network-vif-deleted", "tag": "524c9827-bc22-4ef7-bf8b-83ac010dd92d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:26.198401 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6e38e44-4b62-4d4b-9edc-68db55586745 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 200 len: 1657 microversion: 2.1 time: 0.545266 May 19 05:09:26.203109 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2840/5765] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:25 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 1657 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:26.218401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b5e00daf-db97-432a-a41a-0812c65c0f67 req-8da903d8-eb6a-4927-8c41-27d729d73a54 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:26.220588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b5e00daf-db97-432a-a41a-0812c65c0f67 req-8da903d8-eb6a-4927-8c41-27d729d73a54 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:26.236723 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b5e00daf-db97-432a-a41a-0812c65c0f67 req-8da903d8-eb6a-4927-8c41-27d729d73a54 service nova] Creating event network-vif-deleted:524c9827-bc22-4ef7-bf8b-83ac010dd92d for instance 5ef5d418-d686-4df9-a630-0e474abc9bf8 on n-h2-766726-30 May 19 05:09:26.242467 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b5e00daf-db97-432a-a41a-0812c65c0f67 req-8da903d8-eb6a-4927-8c41-27d729d73a54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084105 May 19 05:09:26.243298 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2926/5766] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:09:27.218303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:27.218832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 5ef5d418-d686-4df9-a630-0e474abc9bf8] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:27.241678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:27.242134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:27.243751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:27.244179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:27.304212 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] HTTP exception thrown: Instance 5ef5d418-d686-4df9-a630-0e474abc9bf8 could not be found. May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Request method failure captured: May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 HTTP/1.1 May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdDbitAIGslJ2Xp-Kja6j-4hNsN3-sZ9zYMrilphOtJkHfWjZ2_nc9Zyhm7VfWeNXJm-vKtd2L4kGqADKWoDRIWPR213pCAXKwLIF5rC7bWOr5CR4VI4SJjc-8LlEfUO--jj-2eJMT9eNBvwbhfV_OSVm9ATPbDISJWhJg2XQyaeMpg May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 6199150c159548889b24a8df336ead3e May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestServerMultinode-469006779 May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6199150c159548889b24a8df336ead3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6199150c159548889b24a8df336ead3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6199150c159548889b24a8df336ead3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6199150c159548889b24a8df336ead3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestServerMultinode-469006779 May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 6199150c159548889b24a8df336ead3e May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestServerMultinode-469006779 May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestServerMultinode-469006779-project-admin May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5fc8dcbee55b4f99b6bd423d955a0b3d May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestServerMultinode-469006779-project-admin May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 5ef5d418-d686-4df9-a630-0e474abc9bf8 could not be found. May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '5ef5d418-d686-4df9-a630-0e474abc9bf8'} May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef5d418-d686-4df9-a630-0e474abc9bf8 could not be found. May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef5d418-d686-4df9-a630-0e474abc9bf8 could not be found. May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:09:27.311302 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:27.315375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:09:27.315375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:09:27.315375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:09:27.315375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:09:27.315375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:09:27.315375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef5d418-d686-4df9-a630-0e474abc9bf8 could not be found. May 19 05:09:27.315375 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:27.315375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Returning 404 to user: Instance 5ef5d418-d686-4df9-a630-0e474abc9bf8 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:09:27.315375 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-af8622d8-b73c-4b9e-97bd-837261f75ca4 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8" status: 404 len: 111 microversion: 2.1 time: 0.098463 May 19 05:09:27.324987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1a94f1d-d21a-4a51-b6be-903bd9200dab tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:27.326537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1a94f1d-d21a-4a51-b6be-903bd9200dab tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:27.340617 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2841/5767] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:27 2022] GET /compute/v2.1/servers/5ef5d418-d686-4df9-a630-0e474abc9bf8 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:09:27.343856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1a94f1d-d21a-4a51-b6be-903bd9200dab tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:27.345774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1a94f1d-d21a-4a51-b6be-903bd9200dab tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:27.348258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1a94f1d-d21a-4a51-b6be-903bd9200dab tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:27.352468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1a94f1d-d21a-4a51-b6be-903bd9200dab tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:27.404364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1a94f1d-d21a-4a51-b6be-903bd9200dab tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:09:27.414463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=100 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:27.599781 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1a94f1d-d21a-4a51-b6be-903bd9200dab tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 204 len: 0 microversion: 2.1 time: 0.280180 May 19 05:09:27.600923 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2927/5768] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:09:27 2022] DELETE /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:09:27.610152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0d18c241-7a4b-4502-9a62-247149ffa8b2 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:27.611272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0d18c241-7a4b-4502-9a62-247149ffa8b2 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:27.623183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d18c241-7a4b-4502-9a62-247149ffa8b2 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:27.623994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d18c241-7a4b-4502-9a62-247149ffa8b2 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:27.626162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d18c241-7a4b-4502-9a62-247149ffa8b2 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:27.628005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d18c241-7a4b-4502-9a62-247149ffa8b2 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:28.066855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:28.096949 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0d18c241-7a4b-4502-9a62-247149ffa8b2 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1656 microversion: 2.1 time: 0.491892 May 19 05:09:28.100316 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2842/5769] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:27 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1656 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:28.849489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e3d29f3e-ab0c-4c32-8fc4-1cd53b209772 req-a25962a1-1ff6-4b5c-9a09-1d5c0a2a3b20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:28.860547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-75932372-79cb-46f6-a0e5-154d3ca768e3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:28.875094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e3d29f3e-ab0c-4c32-8fc4-1cd53b209772 req-a25962a1-1ff6-4b5c-9a09-1d5c0a2a3b20 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:28.882449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e3d29f3e-ab0c-4c32-8fc4-1cd53b209772 req-a25962a1-1ff6-4b5c-9a09-1d5c0a2a3b20 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:28.883042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-75932372-79cb-46f6-a0e5-154d3ca768e3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:28.905556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75932372-79cb-46f6-a0e5-154d3ca768e3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:28.906293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75932372-79cb-46f6-a0e5-154d3ca768e3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:28.907246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75932372-79cb-46f6-a0e5-154d3ca768e3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:28.907846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-75932372-79cb-46f6-a0e5-154d3ca768e3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:28.929341 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e3d29f3e-ab0c-4c32-8fc4-1cd53b209772 req-a25962a1-1ff6-4b5c-9a09-1d5c0a2a3b20 service nova] Creating event network-changed:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h2-766726-30 May 19 05:09:28.945338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e3d29f3e-ab0c-4c32-8fc4-1cd53b209772 req-a25962a1-1ff6-4b5c-9a09-1d5c0a2a3b20 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097361 May 19 05:09:28.953559 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2843/5770] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:09:29.128860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a58c5a15-cbe8-4399-aa05-fcd0f427c88d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:29.129837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a58c5a15-cbe8-4399-aa05-fcd0f427c88d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:29.146317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a58c5a15-cbe8-4399-aa05-fcd0f427c88d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:29.160323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a58c5a15-cbe8-4399-aa05-fcd0f427c88d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:29.162035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a58c5a15-cbe8-4399-aa05-fcd0f427c88d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:29.163947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a58c5a15-cbe8-4399-aa05-fcd0f427c88d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:30.575398 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a58c5a15-cbe8-4399-aa05-fcd0f427c88d tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1656 microversion: 2.1 time: 1.461213 May 19 05:09:30.593792 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2844/5771] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:29 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1656 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:30.648349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-75932372-79cb-46f6-a0e5-154d3ca768e3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:30.659515 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-75932372-79cb-46f6-a0e5-154d3ca768e3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1563 microversion: 2.1 time: 1.818166 May 19 05:09:30.770749 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2928/5772] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:28 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1563 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:31.600176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c4c903f1-1bf0-4680-b0f5-bc8248399806 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:31.600975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c4c903f1-1bf0-4680-b0f5-bc8248399806 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:31.616903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4c903f1-1bf0-4680-b0f5-bc8248399806 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:31.617646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4c903f1-1bf0-4680-b0f5-bc8248399806 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:31.619462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4c903f1-1bf0-4680-b0f5-bc8248399806 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:31.619462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c4c903f1-1bf0-4680-b0f5-bc8248399806 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:31.873217 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c4c903f1-1bf0-4680-b0f5-bc8248399806 tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 200 len: 1614 microversion: 2.1 time: 0.277165 May 19 05:09:31.896972 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2845/5773] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:31 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 1614 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:31.970409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8134f395-b28c-4017-89fa-20533dc19d6e req-d9e3f5ac-5953-45d2-a503-e55a5071ce58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634f735d-5a43-4f2a-b9c2-dd6b7aed6629", "name": "network-vif-deleted", "tag": "678d3071-2be1-4b59-80aa-3b5a4075fe8e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:32.009693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:32.045934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8134f395-b28c-4017-89fa-20533dc19d6e req-d9e3f5ac-5953-45d2-a503-e55a5071ce58 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:32.046396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8134f395-b28c-4017-89fa-20533dc19d6e req-d9e3f5ac-5953-45d2-a503-e55a5071ce58 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:32.076774 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8134f395-b28c-4017-89fa-20533dc19d6e req-d9e3f5ac-5953-45d2-a503-e55a5071ce58 service nova] Creating event network-vif-deleted:678d3071-2be1-4b59-80aa-3b5a4075fe8e for instance 634f735d-5a43-4f2a-b9c2-dd6b7aed6629 on n-h1-766726-30 May 19 05:09:32.099589 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8134f395-b28c-4017-89fa-20533dc19d6e req-d9e3f5ac-5953-45d2-a503-e55a5071ce58 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129273 May 19 05:09:32.101115 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2929/5774] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:09:32.914567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:32.915950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] [instance: 634f735d-5a43-4f2a-b9c2-dd6b7aed6629] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:32.929555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:32.930226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:32.931149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:32.931733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:32.984121 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] HTTP exception thrown: Instance 634f735d-5a43-4f2a-b9c2-dd6b7aed6629 could not be found. May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Request method failure captured: May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 HTTP/1.1 May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdDbitAIGslJ2Xp-Kja6j-4hNsN3-sZ9zYMrilphOtJkHfWjZ2_nc9Zyhm7VfWeNXJm-vKtd2L4kGqADKWoDRIWPR213pCAXKwLIF5rC7bWOr5CR4VI4SJjc-8LlEfUO--jj-2eJMT9eNBvwbhfV_OSVm9ATPbDISJWhJg2XQyaeMpg May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 6199150c159548889b24a8df336ead3e May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestServerMultinode-469006779 May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6199150c159548889b24a8df336ead3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6199150c159548889b24a8df336ead3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6199150c159548889b24a8df336ead3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6199150c159548889b24a8df336ead3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestServerMultinode-469006779 May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 6199150c159548889b24a8df336ead3e May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestServerMultinode-469006779 May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestServerMultinode-469006779-project-admin May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 5fc8dcbee55b4f99b6bd423d955a0b3d May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestServerMultinode-469006779-project-admin May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 634f735d-5a43-4f2a-b9c2-dd6b7aed6629 could not be found. May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '634f735d-5a43-4f2a-b9c2-dd6b7aed6629'} May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 634f735d-5a43-4f2a-b9c2-dd6b7aed6629 could not be found. May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 634f735d-5a43-4f2a-b9c2-dd6b7aed6629 could not be found. May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:09:32.985986 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:32.990170 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:09:32.990170 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:09:32.990170 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:09:32.990170 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:09:32.990170 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:09:32.990170 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 634f735d-5a43-4f2a-b9c2-dd6b7aed6629 could not be found. May 19 05:09:32.990170 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:09:33.001774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] Returning 404 to user: Instance 634f735d-5a43-4f2a-b9c2-dd6b7aed6629 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:09:33.002854 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b094ec7b-8e57-4552-93fa-52b7ad8ce15a tempest-TestServerMultinode-469006779 tempest-TestServerMultinode-469006779-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629" status: 404 len: 111 microversion: 2.1 time: 0.092000 May 19 05:09:33.003858 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2846/5775] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:32 2022] GET /compute/v2.1/servers/634f735d-5a43-4f2a-b9c2-dd6b7aed6629 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:09:50.199520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8211e239-bf06-4f82-9780-8d64f4471aa5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:50.205052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8211e239-bf06-4f82-9780-8d64f4471aa5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:50.224213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:50.225122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:50.233825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8211e239-bf06-4f82-9780-8d64f4471aa5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:50.234537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8211e239-bf06-4f82-9780-8d64f4471aa5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:50.238120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8211e239-bf06-4f82-9780-8d64f4471aa5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:50.238758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8211e239-bf06-4f82-9780-8d64f4471aa5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:50.352045 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8211e239-bf06-4f82-9780-8d64f4471aa5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action" status: 200 len: 24571 microversion: 2.1 time: 0.163288 May 19 05:09:50.353383 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2930/5776] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:09:50 2022] POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action => generated 24571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:09:50.959835 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:09:50.960254 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:09:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:09:56.812042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-825df142-2c2e-4357-b7ef-5dd7bf0ca977 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:56.812815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-825df142-2c2e-4357-b7ef-5dd7bf0ca977 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:56.821021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:56.826135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=17 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:09:56.839004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-825df142-2c2e-4357-b7ef-5dd7bf0ca977 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:56.840773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-825df142-2c2e-4357-b7ef-5dd7bf0ca977 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:56.842947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-825df142-2c2e-4357-b7ef-5dd7bf0ca977 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:56.845069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-825df142-2c2e-4357-b7ef-5dd7bf0ca977 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:57.173555 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-825df142-2c2e-4357-b7ef-5dd7bf0ca977 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1834 microversion: 2.1 time: 0.361864 May 19 05:09:57.174472 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2847/5777] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:56 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1834 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:57.191357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c5298019-a8e3-4517-9fd3-1b58ad2d66ec tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:57.192082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c5298019-a8e3-4517-9fd3-1b58ad2d66ec tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:57.204931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5298019-a8e3-4517-9fd3-1b58ad2d66ec tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:57.212335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5298019-a8e3-4517-9fd3-1b58ad2d66ec tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:57.213303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5298019-a8e3-4517-9fd3-1b58ad2d66ec tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:57.213759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5298019-a8e3-4517-9fd3-1b58ad2d66ec tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:57.424707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c5298019-a8e3-4517-9fd3-1b58ad2d66ec tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:57.441127 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c5298019-a8e3-4517-9fd3-1b58ad2d66ec tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1681 microversion: 2.1 time: 0.253235 May 19 05:09:57.441127 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2931/5778] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:57 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:57.576807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf053ed8-216b-4b34-b197-3fc3386eff17 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:57.577762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf053ed8-216b-4b34-b197-3fc3386eff17 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:57.593698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf053ed8-216b-4b34-b197-3fc3386eff17 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:57.594517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf053ed8-216b-4b34-b197-3fc3386eff17 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:57.595520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf053ed8-216b-4b34-b197-3fc3386eff17 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:57.596438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf053ed8-216b-4b34-b197-3fc3386eff17 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:57.657494 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf053ed8-216b-4b34-b197-3fc3386eff17 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action" status: 200 len: 32642 microversion: 2.1 time: 0.084333 May 19 05:09:57.665739 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2848/5779] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:09:57 2022] POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action => generated 32642 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:09:57.895577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:09:57.896464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:57.906408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:57.907473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:57.908676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:57.909466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:57.980306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f44af66b680844659ef1dcc728fe2131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e256fc305dee4bdb85b3f27f6c98e72e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:57.981096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] flavor_id is None. Assuming migration. {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4142}} May 19 05:09:57.982196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:09:58.178427 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-325c9ddc-e209-4d93-8489-c1265a7eaf45 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action" status: 202 len: 0 microversion: 2.1 time: 0.287088 May 19 05:09:58.180526 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2932/5780] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:09:57 2022] POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:09:58.190441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bf7709ca-8188-4933-9a2e-592a2a94efce tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:58.191835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bf7709ca-8188-4933-9a2e-592a2a94efce tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:58.202338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf7709ca-8188-4933-9a2e-592a2a94efce tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:58.203226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf7709ca-8188-4933-9a2e-592a2a94efce tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:58.205234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf7709ca-8188-4933-9a2e-592a2a94efce tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:58.206082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bf7709ca-8188-4933-9a2e-592a2a94efce tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:58.412104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bf7709ca-8188-4933-9a2e-592a2a94efce tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:58.426852 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bf7709ca-8188-4933-9a2e-592a2a94efce tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1690 microversion: 2.1 time: 0.241792 May 19 05:09:58.427894 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2849/5781] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:58 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:09:59.445774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-90edecaa-aea7-4878-8ead-8c6905994e8f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:09:59.446954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-90edecaa-aea7-4878-8ead-8c6905994e8f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:09:59.457237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90edecaa-aea7-4878-8ead-8c6905994e8f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:59.461030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90edecaa-aea7-4878-8ead-8c6905994e8f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:59.462045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90edecaa-aea7-4878-8ead-8c6905994e8f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:09:59.462649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90edecaa-aea7-4878-8ead-8c6905994e8f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:09:59.716038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-90edecaa-aea7-4878-8ead-8c6905994e8f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:09:59.732664 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-90edecaa-aea7-4878-8ead-8c6905994e8f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1690 microversion: 2.1 time: 0.292499 May 19 05:09:59.733900 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2933/5782] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:09:59 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1690 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:00.752827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8db825c3-b1b9-4340-8660-72ed15c53c15 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:00.754357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8db825c3-b1b9-4340-8660-72ed15c53c15 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:00.772251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8db825c3-b1b9-4340-8660-72ed15c53c15 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:00.785187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8db825c3-b1b9-4340-8660-72ed15c53c15 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:00.786565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8db825c3-b1b9-4340-8660-72ed15c53c15 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:00.787335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8db825c3-b1b9-4340-8660-72ed15c53c15 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:01.150433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8db825c3-b1b9-4340-8660-72ed15c53c15 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:01.162750 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8db825c3-b1b9-4340-8660-72ed15c53c15 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1690 microversion: 2.1 time: 0.415381 May 19 05:10:01.165050 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2850/5783] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:00 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1690 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:02.183395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-77b48d6b-aa52-4486-872d-c56ae7282789 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:02.183949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-77b48d6b-aa52-4486-872d-c56ae7282789 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:02.198885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77b48d6b-aa52-4486-872d-c56ae7282789 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:02.201818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77b48d6b-aa52-4486-872d-c56ae7282789 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:02.202957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77b48d6b-aa52-4486-872d-c56ae7282789 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:02.206537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77b48d6b-aa52-4486-872d-c56ae7282789 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:02.464681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-77b48d6b-aa52-4486-872d-c56ae7282789 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:02.477382 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-77b48d6b-aa52-4486-872d-c56ae7282789 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.298845 May 19 05:10:02.498850 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2934/5784] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:02 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:03.507988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e54f7a7-6da2-4922-9f63-ef3872432c16 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:03.508858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7e54f7a7-6da2-4922-9f63-ef3872432c16 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:03.522770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e54f7a7-6da2-4922-9f63-ef3872432c16 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:03.523232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e54f7a7-6da2-4922-9f63-ef3872432c16 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:03.525299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e54f7a7-6da2-4922-9f63-ef3872432c16 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:03.525747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e54f7a7-6da2-4922-9f63-ef3872432c16 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:03.827582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e54f7a7-6da2-4922-9f63-ef3872432c16 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:03.837667 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e54f7a7-6da2-4922-9f63-ef3872432c16 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.334383 May 19 05:10:03.838495 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2851/5785] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:03 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:04.855523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-97320aaa-b889-474d-88c9-40c204013af9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:04.856167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-97320aaa-b889-474d-88c9-40c204013af9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:04.878909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97320aaa-b889-474d-88c9-40c204013af9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:04.879629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97320aaa-b889-474d-88c9-40c204013af9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:04.880585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97320aaa-b889-474d-88c9-40c204013af9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:04.886169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97320aaa-b889-474d-88c9-40c204013af9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:05.133428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-97320aaa-b889-474d-88c9-40c204013af9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:05.149159 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-97320aaa-b889-474d-88c9-40c204013af9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.298813 May 19 05:10:05.150018 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2935/5786] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:04 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:06.167652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1aa91934-c03b-4e7c-91eb-cae9152e06d6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:06.168420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1aa91934-c03b-4e7c-91eb-cae9152e06d6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:06.180765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1aa91934-c03b-4e7c-91eb-cae9152e06d6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:06.181190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1aa91934-c03b-4e7c-91eb-cae9152e06d6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:06.181986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1aa91934-c03b-4e7c-91eb-cae9152e06d6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:06.182432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1aa91934-c03b-4e7c-91eb-cae9152e06d6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:06.972731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1aa91934-c03b-4e7c-91eb-cae9152e06d6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:06.987245 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1aa91934-c03b-4e7c-91eb-cae9152e06d6 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.823629 May 19 05:10:06.988556 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2852/5787] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:06 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:08.006344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d0bca50-ab2a-4142-8e9e-1e8267ae1bb4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:08.007040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d0bca50-ab2a-4142-8e9e-1e8267ae1bb4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:08.027234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d0bca50-ab2a-4142-8e9e-1e8267ae1bb4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:08.027868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d0bca50-ab2a-4142-8e9e-1e8267ae1bb4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:08.030906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d0bca50-ab2a-4142-8e9e-1e8267ae1bb4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:08.031948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d0bca50-ab2a-4142-8e9e-1e8267ae1bb4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:08.378473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d0bca50-ab2a-4142-8e9e-1e8267ae1bb4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:08.389441 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d0bca50-ab2a-4142-8e9e-1e8267ae1bb4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.387953 May 19 05:10:08.390397 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2936/5788] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:08 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:09.409779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-47054493-3805-48a5-9dd0-5311e791b78d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:09.410709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-47054493-3805-48a5-9dd0-5311e791b78d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:09.446280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-47054493-3805-48a5-9dd0-5311e791b78d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:09.448188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-47054493-3805-48a5-9dd0-5311e791b78d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:09.450254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-47054493-3805-48a5-9dd0-5311e791b78d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:09.451464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-47054493-3805-48a5-9dd0-5311e791b78d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:09.908930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-47054493-3805-48a5-9dd0-5311e791b78d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:09.921509 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-47054493-3805-48a5-9dd0-5311e791b78d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.516199 May 19 05:10:09.924232 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2853/5789] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:09 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:10.943128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-deae549f-25d1-4084-a4b6-b4341dbf756e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:10.944730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-deae549f-25d1-4084-a4b6-b4341dbf756e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:10.960055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-deae549f-25d1-4084-a4b6-b4341dbf756e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:10.960508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-deae549f-25d1-4084-a4b6-b4341dbf756e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:10.961350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-deae549f-25d1-4084-a4b6-b4341dbf756e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:10.961788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-deae549f-25d1-4084-a4b6-b4341dbf756e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:11.302727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-deae549f-25d1-4084-a4b6-b4341dbf756e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:11.313572 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-deae549f-25d1-4084-a4b6-b4341dbf756e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.375646 May 19 05:10:11.325613 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2937/5790] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:10 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:12.330923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1188912f-68f1-4bad-8950-6463c5b9c7d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:12.331364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1188912f-68f1-4bad-8950-6463c5b9c7d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:12.345507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1188912f-68f1-4bad-8950-6463c5b9c7d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:12.346612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1188912f-68f1-4bad-8950-6463c5b9c7d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:12.348493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1188912f-68f1-4bad-8950-6463c5b9c7d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:12.351793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1188912f-68f1-4bad-8950-6463c5b9c7d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:12.653417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1188912f-68f1-4bad-8950-6463c5b9c7d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:12.666896 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1188912f-68f1-4bad-8950-6463c5b9c7d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.339563 May 19 05:10:12.668257 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2854/5791] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:12 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:13.685352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b4f1d07-ebeb-49aa-8e10-f85008b23638 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:13.685966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8b4f1d07-ebeb-49aa-8e10-f85008b23638 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:13.696955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b4f1d07-ebeb-49aa-8e10-f85008b23638 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:13.711800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b4f1d07-ebeb-49aa-8e10-f85008b23638 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:13.714281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b4f1d07-ebeb-49aa-8e10-f85008b23638 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:13.715157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b4f1d07-ebeb-49aa-8e10-f85008b23638 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:13.926644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8b4f1d07-ebeb-49aa-8e10-f85008b23638 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:13.939759 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b4f1d07-ebeb-49aa-8e10-f85008b23638 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.258533 May 19 05:10:13.940812 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2938/5792] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:13 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:14.958327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e7e09a99-1a7d-48d2-97d4-96fa57d3e2ae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:14.959121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e7e09a99-1a7d-48d2-97d4-96fa57d3e2ae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:14.968027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e09a99-1a7d-48d2-97d4-96fa57d3e2ae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:14.969420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e09a99-1a7d-48d2-97d4-96fa57d3e2ae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:14.970702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e09a99-1a7d-48d2-97d4-96fa57d3e2ae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:14.971378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e7e09a99-1a7d-48d2-97d4-96fa57d3e2ae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:15.165452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e7e09a99-1a7d-48d2-97d4-96fa57d3e2ae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:15.175265 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e7e09a99-1a7d-48d2-97d4-96fa57d3e2ae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.221557 May 19 05:10:15.176066 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2855/5793] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:14 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:16.192706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da12703d-78f6-44cd-999a-787dadac509f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:16.194100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da12703d-78f6-44cd-999a-787dadac509f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:16.206170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da12703d-78f6-44cd-999a-787dadac509f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:16.206576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da12703d-78f6-44cd-999a-787dadac509f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:16.207370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da12703d-78f6-44cd-999a-787dadac509f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:16.208500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da12703d-78f6-44cd-999a-787dadac509f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:16.502811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-da12703d-78f6-44cd-999a-787dadac509f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:16.518457 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da12703d-78f6-44cd-999a-787dadac509f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.330330 May 19 05:10:16.520121 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2939/5794] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:16 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:17.537619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6ad1dae2-9c28-47ae-87fb-773865ca87e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:17.538237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6ad1dae2-9c28-47ae-87fb-773865ca87e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:17.569067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ad1dae2-9c28-47ae-87fb-773865ca87e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:17.569548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ad1dae2-9c28-47ae-87fb-773865ca87e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:17.570348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ad1dae2-9c28-47ae-87fb-773865ca87e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:17.578978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ad1dae2-9c28-47ae-87fb-773865ca87e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:17.885209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6ad1dae2-9c28-47ae-87fb-773865ca87e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:17.894441 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6ad1dae2-9c28-47ae-87fb-773865ca87e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1695 microversion: 2.1 time: 0.360870 May 19 05:10:17.897773 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2856/5795] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:17 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1695 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:18.912819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4ea2d56b-ab3a-469a-b424-f0da0eac98c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:18.913594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4ea2d56b-ab3a-469a-b424-f0da0eac98c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:18.949217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ea2d56b-ab3a-469a-b424-f0da0eac98c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:18.950820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ea2d56b-ab3a-469a-b424-f0da0eac98c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:18.951960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ea2d56b-ab3a-469a-b424-f0da0eac98c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:18.954197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ea2d56b-ab3a-469a-b424-f0da0eac98c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:19.587796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4ea2d56b-ab3a-469a-b424-f0da0eac98c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:19.618656 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4ea2d56b-ab3a-469a-b424-f0da0eac98c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1694 microversion: 2.1 time: 0.702272 May 19 05:10:19.621322 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2940/5796] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:18 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1694 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:19.916157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-14cf3c40-1e37-415f-a010-23509ba72bad req-c133788e-fcda-4d81-824e-bf1d55eb06fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "name": "network-vif-unplugged", "status": "completed", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:10:19.955416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-14cf3c40-1e37-415f-a010-23509ba72bad req-c133788e-fcda-4d81-824e-bf1d55eb06fd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:19.956630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-14cf3c40-1e37-415f-a010-23509ba72bad req-c133788e-fcda-4d81-824e-bf1d55eb06fd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:20.008574 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-14cf3c40-1e37-415f-a010-23509ba72bad req-c133788e-fcda-4d81-824e-bf1d55eb06fd service nova] Creating event network-vif-unplugged:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h1-766726-30 May 19 05:10:20.031516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-14cf3c40-1e37-415f-a010-23509ba72bad req-c133788e-fcda-4d81-824e-bf1d55eb06fd service nova] Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:10:20.061651 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-14cf3c40-1e37-415f-a010-23509ba72bad req-c133788e-fcda-4d81-824e-bf1d55eb06fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150580 May 19 05:10:20.065852 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2857/5797] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:10:20.639983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe4c4819-9b12-4c19-a315-006e9f427cff tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:20.641440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fe4c4819-9b12-4c19-a315-006e9f427cff tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:20.651788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=25 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:10:20.657561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe4c4819-9b12-4c19-a315-006e9f427cff tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:20.659963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe4c4819-9b12-4c19-a315-006e9f427cff tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:20.664383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe4c4819-9b12-4c19-a315-006e9f427cff tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:20.665374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe4c4819-9b12-4c19-a315-006e9f427cff tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:20.721700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:10:21.107131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fe4c4819-9b12-4c19-a315-006e9f427cff tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:21.112181 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fe4c4819-9b12-4c19-a315-006e9f427cff tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1694 microversion: 2.1 time: 0.476323 May 19 05:10:21.122696 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2941/5798] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:20 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1694 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:22.088893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9fdb72d8-a328-4d46-8093-2bcbe6ffb5e8 req-1ec09eae-44e7-4611-b569-dfaf0359a0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:10:22.101459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9fdb72d8-a328-4d46-8093-2bcbe6ffb5e8 req-1ec09eae-44e7-4611-b569-dfaf0359a0ad service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:22.101911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9fdb72d8-a328-4d46-8093-2bcbe6ffb5e8 req-1ec09eae-44e7-4611-b569-dfaf0359a0ad service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:22.119651 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9fdb72d8-a328-4d46-8093-2bcbe6ffb5e8 req-1ec09eae-44e7-4611-b569-dfaf0359a0ad service nova] Creating event network-changed:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h1-766726-30 May 19 05:10:22.126506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-9fdb72d8-a328-4d46-8093-2bcbe6ffb5e8 req-1ec09eae-44e7-4611-b569-dfaf0359a0ad service nova] Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:10:22.129688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b250d8e-48c5-4e61-80bc-5c0476eae0b1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:22.130487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b250d8e-48c5-4e61-80bc-5c0476eae0b1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:22.138632 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9fdb72d8-a328-4d46-8093-2bcbe6ffb5e8 req-1ec09eae-44e7-4611-b569-dfaf0359a0ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056185 May 19 05:10:22.139827 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2858/5799] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:10:22.142476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b250d8e-48c5-4e61-80bc-5c0476eae0b1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:22.143055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b250d8e-48c5-4e61-80bc-5c0476eae0b1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:22.144084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b250d8e-48c5-4e61-80bc-5c0476eae0b1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:22.144702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b250d8e-48c5-4e61-80bc-5c0476eae0b1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:22.398473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0b250d8e-48c5-4e61-80bc-5c0476eae0b1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:22.411005 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b250d8e-48c5-4e61-80bc-5c0476eae0b1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1692 microversion: 2.1 time: 0.285336 May 19 05:10:22.412251 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2942/5800] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:22 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1692 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:10:23.433508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ebf85d6-f739-4bf5-9242-b08df26c29a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:23.434567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9ebf85d6-f739-4bf5-9242-b08df26c29a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:23.446710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ebf85d6-f739-4bf5-9242-b08df26c29a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:23.447404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ebf85d6-f739-4bf5-9242-b08df26c29a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:23.448370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ebf85d6-f739-4bf5-9242-b08df26c29a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:23.448972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ebf85d6-f739-4bf5-9242-b08df26c29a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:23.863733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9ebf85d6-f739-4bf5-9242-b08df26c29a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:23.885719 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ebf85d6-f739-4bf5-9242-b08df26c29a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1692 microversion: 2.1 time: 0.457391 May 19 05:10:23.889163 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2859/5801] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:23 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1692 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:24.903818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f2634dc2-d753-4a80-ad7d-f1cebd21f041 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:24.904819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f2634dc2-d753-4a80-ad7d-f1cebd21f041 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:24.913788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2634dc2-d753-4a80-ad7d-f1cebd21f041 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:24.914388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2634dc2-d753-4a80-ad7d-f1cebd21f041 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:24.915250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2634dc2-d753-4a80-ad7d-f1cebd21f041 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:24.915796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f2634dc2-d753-4a80-ad7d-f1cebd21f041 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:25.108546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f2634dc2-d753-4a80-ad7d-f1cebd21f041 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:25.118534 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f2634dc2-d753-4a80-ad7d-f1cebd21f041 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1689 microversion: 2.1 time: 0.218536 May 19 05:10:25.119136 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2943/5802] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:24 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1689 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:25.140190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6cf4693-7987-472a-9ec7-3e27ebe7b4c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:10:25.141481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6cf4693-7987-472a-9ec7-3e27ebe7b4c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:25.153878 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6cf4693-7987-472a-9ec7-3e27ebe7b4c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:25.157504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6cf4693-7987-472a-9ec7-3e27ebe7b4c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:25.162080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6cf4693-7987-472a-9ec7-3e27ebe7b4c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:25.162707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6cf4693-7987-472a-9ec7-3e27ebe7b4c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:25.389343 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6cf4693-7987-472a-9ec7-3e27ebe7b4c4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action" status: 202 len: 0 microversion: 2.1 time: 0.253112 May 19 05:10:25.393512 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2860/5803] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:10:25 2022] POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:10:25.400962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-87b6c6f1-2b18-447c-9f2c-5e5691f436ea tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:25.401878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-87b6c6f1-2b18-447c-9f2c-5e5691f436ea tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:25.420128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87b6c6f1-2b18-447c-9f2c-5e5691f436ea tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:25.420985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87b6c6f1-2b18-447c-9f2c-5e5691f436ea tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:25.423411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87b6c6f1-2b18-447c-9f2c-5e5691f436ea tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:25.425804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87b6c6f1-2b18-447c-9f2c-5e5691f436ea tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:25.926308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87b6c6f1-2b18-447c-9f2c-5e5691f436ea tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:25.937106 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-87b6c6f1-2b18-447c-9f2c-5e5691f436ea tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1688 microversion: 2.1 time: 0.541926 May 19 05:10:25.939032 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2944/5804] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:25 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1688 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:26.959496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5a33c93-7cff-4c7b-80ad-e0e6006c3d92 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:26.961119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e5a33c93-7cff-4c7b-80ad-e0e6006c3d92 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:26.972101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=33 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:10:26.989654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5a33c93-7cff-4c7b-80ad-e0e6006c3d92 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:26.990737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5a33c93-7cff-4c7b-80ad-e0e6006c3d92 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:26.991611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5a33c93-7cff-4c7b-80ad-e0e6006c3d92 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:26.992073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5a33c93-7cff-4c7b-80ad-e0e6006c3d92 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:27.007803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:10:27.256509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e5a33c93-7cff-4c7b-80ad-e0e6006c3d92 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:27.267150 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e5a33c93-7cff-4c7b-80ad-e0e6006c3d92 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1688 microversion: 2.1 time: 0.314010 May 19 05:10:27.268643 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2861/5805] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:26 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1688 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:28.285590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba9afed4-858b-4068-b047-29834b78d99b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:28.286801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba9afed4-858b-4068-b047-29834b78d99b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:28.300254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba9afed4-858b-4068-b047-29834b78d99b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:28.300978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba9afed4-858b-4068-b047-29834b78d99b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:28.302785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba9afed4-858b-4068-b047-29834b78d99b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:28.305894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba9afed4-858b-4068-b047-29834b78d99b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:28.329368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-44d98f1d-cd43-4c13-bfc9-b3f63db27fd8 req-2026c4b2-bddf-4932-8431-e1edcde342bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "name": "network-vif-plugged", "status": "completed", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:10:28.351850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-44d98f1d-cd43-4c13-bfc9-b3f63db27fd8 req-2026c4b2-bddf-4932-8431-e1edcde342bf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:28.355528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-44d98f1d-cd43-4c13-bfc9-b3f63db27fd8 req-2026c4b2-bddf-4932-8431-e1edcde342bf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:28.393255 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-44d98f1d-cd43-4c13-bfc9-b3f63db27fd8 req-2026c4b2-bddf-4932-8431-e1edcde342bf service nova] Creating event network-vif-plugged:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h1-766726-30 May 19 05:10:28.412521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-44d98f1d-cd43-4c13-bfc9-b3f63db27fd8 req-2026c4b2-bddf-4932-8431-e1edcde342bf service nova] Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:10:28.430400 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-44d98f1d-cd43-4c13-bfc9-b3f63db27fd8 req-2026c4b2-bddf-4932-8431-e1edcde342bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106487 May 19 05:10:28.432271 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2862/5806] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:10:28.618730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba9afed4-858b-4068-b047-29834b78d99b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:28.634114 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba9afed4-858b-4068-b047-29834b78d99b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1688 microversion: 2.1 time: 0.349674 May 19 05:10:28.636363 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2945/5807] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:28 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1688 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:29.653620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1309b6e-395f-4a90-b108-0a51cdd1395d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:29.654450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d1309b6e-395f-4a90-b108-0a51cdd1395d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:29.669522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1309b6e-395f-4a90-b108-0a51cdd1395d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:29.670272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1309b6e-395f-4a90-b108-0a51cdd1395d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:29.671834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1309b6e-395f-4a90-b108-0a51cdd1395d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:29.673373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1309b6e-395f-4a90-b108-0a51cdd1395d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:29.934931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-7d84aab1-5909-47a7-8533-e6ec89c4de08 req-599f6aa9-ca1a-419a-8cf6-7da7e19cbf44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "name": "network-vif-unplugged", "status": "completed", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:10:29.952616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7d84aab1-5909-47a7-8533-e6ec89c4de08 req-599f6aa9-ca1a-419a-8cf6-7da7e19cbf44 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:29.953068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7d84aab1-5909-47a7-8533-e6ec89c4de08 req-599f6aa9-ca1a-419a-8cf6-7da7e19cbf44 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:29.968382 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7d84aab1-5909-47a7-8533-e6ec89c4de08 req-599f6aa9-ca1a-419a-8cf6-7da7e19cbf44 service nova] Creating event network-vif-unplugged:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h2-766726-30 May 19 05:10:29.996873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-7d84aab1-5909-47a7-8533-e6ec89c4de08 req-599f6aa9-ca1a-419a-8cf6-7da7e19cbf44 service nova] Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:10:30.048044 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-7d84aab1-5909-47a7-8533-e6ec89c4de08 req-599f6aa9-ca1a-419a-8cf6-7da7e19cbf44 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105480 May 19 05:10:30.048757 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2946/5808] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:10:30.088144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1309b6e-395f-4a90-b108-0a51cdd1395d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:30.103995 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d1309b6e-395f-4a90-b108-0a51cdd1395d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1688 microversion: 2.1 time: 0.455637 May 19 05:10:30.105186 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2863/5809] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:29 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1688 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:31.124679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ae90dfca-c7e2-4380-a757-a18e14f48c58 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:31.125720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ae90dfca-c7e2-4380-a757-a18e14f48c58 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:31.136953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae90dfca-c7e2-4380-a757-a18e14f48c58 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:31.137463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae90dfca-c7e2-4380-a757-a18e14f48c58 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:31.138242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae90dfca-c7e2-4380-a757-a18e14f48c58 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:31.145346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae90dfca-c7e2-4380-a757-a18e14f48c58 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:31.647392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ae90dfca-c7e2-4380-a757-a18e14f48c58 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:31.657901 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ae90dfca-c7e2-4380-a757-a18e14f48c58 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1688 microversion: 2.1 time: 0.538254 May 19 05:10:31.659092 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2947/5810] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:31 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1688 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:32.114866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-da3ca53c-e2b7-4fd1-ab7e-3f5af3b0d026 req-39e2c802-cbac-41b2-9a00-0a44d3571f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:10:32.131756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-da3ca53c-e2b7-4fd1-ab7e-3f5af3b0d026 req-39e2c802-cbac-41b2-9a00-0a44d3571f4a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:32.133265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-da3ca53c-e2b7-4fd1-ab7e-3f5af3b0d026 req-39e2c802-cbac-41b2-9a00-0a44d3571f4a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:32.180851 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-da3ca53c-e2b7-4fd1-ab7e-3f5af3b0d026 req-39e2c802-cbac-41b2-9a00-0a44d3571f4a service nova] Creating event network-changed:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h2-766726-30 May 19 05:10:32.195280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-da3ca53c-e2b7-4fd1-ab7e-3f5af3b0d026 req-39e2c802-cbac-41b2-9a00-0a44d3571f4a service nova] Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:10:32.228844 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-da3ca53c-e2b7-4fd1-ab7e-3f5af3b0d026 req-39e2c802-cbac-41b2-9a00-0a44d3571f4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114819 May 19 05:10:32.229564 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2864/5811] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:10:32.679678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2be136fb-a500-444e-9d00-3355087ed12a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:32.680871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2be136fb-a500-444e-9d00-3355087ed12a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:32.695676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2be136fb-a500-444e-9d00-3355087ed12a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:32.697923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2be136fb-a500-444e-9d00-3355087ed12a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:32.699491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2be136fb-a500-444e-9d00-3355087ed12a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:32.703360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2be136fb-a500-444e-9d00-3355087ed12a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:32.936967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2be136fb-a500-444e-9d00-3355087ed12a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:32.948623 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2be136fb-a500-444e-9d00-3355087ed12a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1688 microversion: 2.1 time: 0.276440 May 19 05:10:32.954431 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2948/5812] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:32 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1688 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:33.968250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99e8fe93-d516-433f-ae16-d4c70299f77b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:33.969859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99e8fe93-d516-433f-ae16-d4c70299f77b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:33.993299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99e8fe93-d516-433f-ae16-d4c70299f77b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:33.995372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99e8fe93-d516-433f-ae16-d4c70299f77b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:33.996295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99e8fe93-d516-433f-ae16-d4c70299f77b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:33.996779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99e8fe93-d516-433f-ae16-d4c70299f77b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:34.567285 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99e8fe93-d516-433f-ae16-d4c70299f77b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:34.593334 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99e8fe93-d516-433f-ae16-d4c70299f77b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1688 microversion: 2.1 time: 0.629229 May 19 05:10:34.595280 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2865/5813] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:33 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1688 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:35.617063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dc6f3eff-efe6-4bbe-876d-1ef6aa930018 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:10:35.619911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dc6f3eff-efe6-4bbe-876d-1ef6aa930018 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:10:35.647968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc6f3eff-efe6-4bbe-876d-1ef6aa930018 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:35.648433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc6f3eff-efe6-4bbe-876d-1ef6aa930018 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:35.657650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc6f3eff-efe6-4bbe-876d-1ef6aa930018 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:35.658109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc6f3eff-efe6-4bbe-876d-1ef6aa930018 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:35.892075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc6f3eff-efe6-4bbe-876d-1ef6aa930018 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:10:35.903090 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dc6f3eff-efe6-4bbe-876d-1ef6aa930018 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1681 microversion: 2.1 time: 0.295370 May 19 05:10:35.904231 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2949/5814] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:10:35 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1681 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:10:36.598832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9ec36c08-e031-46f5-8c11-5f9b80335b38 req-294ea35a-76af-4401-bce5-13a69e9bd5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "name": "network-vif-plugged", "status": "completed", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:10:36.622931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9ec36c08-e031-46f5-8c11-5f9b80335b38 req-294ea35a-76af-4401-bce5-13a69e9bd5e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:10:36.623378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9ec36c08-e031-46f5-8c11-5f9b80335b38 req-294ea35a-76af-4401-bce5-13a69e9bd5e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:10:36.671488 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9ec36c08-e031-46f5-8c11-5f9b80335b38 req-294ea35a-76af-4401-bce5-13a69e9bd5e1 service nova] Creating event network-vif-plugged:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h2-766726-30 May 19 05:10:36.688849 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9ec36c08-e031-46f5-8c11-5f9b80335b38 req-294ea35a-76af-4401-bce5-13a69e9bd5e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095199 May 19 05:10:36.689517 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2866/5815] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:00.169230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2995d777-1d43-4eb7-90ac-67880df1329e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:00.170213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2995d777-1d43-4eb7-90ac-67880df1329e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:00.185343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=17 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:00.186081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=51 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:00.188186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2995d777-1d43-4eb7-90ac-67880df1329e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:00.188730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2995d777-1d43-4eb7-90ac-67880df1329e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:00.190515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2995d777-1d43-4eb7-90ac-67880df1329e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:00.192119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2995d777-1d43-4eb7-90ac-67880df1329e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:00.313221 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2995d777-1d43-4eb7-90ac-67880df1329e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action" status: 200 len: 63089 microversion: 2.1 time: 0.147855 May 19 05:11:00.315400 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2950/5816] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:11:00 2022] POST /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849/action => generated 63089 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:11:00.725633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=11 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:00.727163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=27 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:00.731217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c7093404-ac7d-490d-88f2-504a38558acb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Action: 'create', calling method: .version_select at 0x7fd314352af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-819768404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaTBUDF4Oq0H7AFUye25iwyQMoYMc4THNfqan9wqawNOpKyZmCXUmUWkC82gQgGC5WD0OlJSNxTYozVX/dZkiH00Y/ExKAr128SPQWYNPj9WCVzkngIRNvZmtdFgZPjZQ=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:00.767438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-c7093404-ac7d-490d-88f2-504a38558acb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for project fc642d868cb74f45b8df137d93a42e07. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:11:00.778555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-c7093404-ac7d-490d-88f2-504a38558acb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for user 21be8a1f15ac40c7851356be4dc2ce32 and project fc642d868cb74f45b8df137d93a42e07. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:11:00.803466 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c7093404-ac7d-490d-88f2-504a38558acb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [765f2573-29b7-4480-b1cc-2043da8f5bbb] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 05:11:01.811166 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [None req-c7093404-ac7d-490d-88f2-504a38558acb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [765f2573-29b7-4480-b1cc-2043da8f5bbb] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49336. May 19 05:11:01.835400 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c7093404-ac7d-490d-88f2-504a38558acb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.111928 May 19 05:11:01.847190 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2867/5817] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:11:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:03.961447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-287225851", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "9179d68b-cee9-40f1-92f6-dcbabda375e9"}], "key_name": "tempest-TestNetworkBasicOps-819768404", "security_groups": [{"name": "tempest-secgroup-smoke-648478916"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:04.152202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] validate_networks() for [('9179d68b-cee9-40f1-92f6-dcbabda375e9', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:11:04.992888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:11:04.993547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:11:04.993746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:11:04.994339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:11:04.994764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:11:05.006258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:05.006831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:05.007686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:05.008300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:05.029751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for project fc642d868cb74f45b8df137d93a42e07. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:11:05.037787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for user 21be8a1f15ac40c7851356be4dc2ce32 and project fc642d868cb74f45b8df137d93a42e07. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:11:05.051967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:11:05.054839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:11:05.133051 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5350a0dd-6249-4255-8127-c7dddb0311fb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.183014 May 19 05:11:05.140377 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2951/5818] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:11:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:11:05.149245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b534ba5f-5a7f-48fb-b9bc-00da388e6fb2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:05.150086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b534ba5f-5a7f-48fb-b9bc-00da388e6fb2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:05.291039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b534ba5f-5a7f-48fb-b9bc-00da388e6fb2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:05.299740 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b534ba5f-5a7f-48fb-b9bc-00da388e6fb2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1247 microversion: 2.1 time: 0.156675 May 19 05:11:05.311939 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2868/5819] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:05 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1247 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:06.320422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7f5cde8-e388-46d0-a586-dd4a0cd78c93 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:06.320959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b7f5cde8-e388-46d0-a586-dd4a0cd78c93 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:06.340394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7f5cde8-e388-46d0-a586-dd4a0cd78c93 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:06.340868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7f5cde8-e388-46d0-a586-dd4a0cd78c93 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:06.341706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7f5cde8-e388-46d0-a586-dd4a0cd78c93 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:06.342127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7f5cde8-e388-46d0-a586-dd4a0cd78c93 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:06.450178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b7f5cde8-e388-46d0-a586-dd4a0cd78c93 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:06.461535 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b7f5cde8-e388-46d0-a586-dd4a0cd78c93 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1243 microversion: 2.1 time: 0.144726 May 19 05:11:06.462368 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2952/5820] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:06 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1243 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:06.793003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c97f024b-0987-4647-8de0-541603e292d0 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:06.793003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c97f024b-0987-4647-8de0-541603e292d0 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:06.805828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c97f024b-0987-4647-8de0-541603e292d0 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:06.810382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c97f024b-0987-4647-8de0-541603e292d0 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:06.814773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c97f024b-0987-4647-8de0-541603e292d0 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:06.817428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c97f024b-0987-4647-8de0-541603e292d0 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:07.315578 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c97f024b-0987-4647-8de0-541603e292d0 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1834 microversion: 2.1 time: 0.523352 May 19 05:11:07.316713 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2869/5821] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:06 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1834 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:07.500132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e53d3e28-9eb0-495d-aa77-0813c6556ee2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:07.504273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e53d3e28-9eb0-495d-aa77-0813c6556ee2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:07.595052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e53d3e28-9eb0-495d-aa77-0813c6556ee2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:07.600339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e53d3e28-9eb0-495d-aa77-0813c6556ee2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:07.606309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e53d3e28-9eb0-495d-aa77-0813c6556ee2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:07.610770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e53d3e28-9eb0-495d-aa77-0813c6556ee2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:07.927164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e53d3e28-9eb0-495d-aa77-0813c6556ee2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:07.952112 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e53d3e28-9eb0-495d-aa77-0813c6556ee2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1305 microversion: 2.1 time: 0.467644 May 19 05:11:07.986058 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2953/5822] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:07 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1305 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:08.714496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-96802955-3c47-4716-96b0-e874d47d3021 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:08.715617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-96802955-3c47-4716-96b0-e874d47d3021 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:08.754929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96802955-3c47-4716-96b0-e874d47d3021 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:08.755648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96802955-3c47-4716-96b0-e874d47d3021 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:08.760389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96802955-3c47-4716-96b0-e874d47d3021 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:08.761536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96802955-3c47-4716-96b0-e874d47d3021 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:08.939550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-96802955-3c47-4716-96b0-e874d47d3021 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:11:09.181748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-99cd2ecf-0619-42c9-9026-df89681f2565 req-2ab41a76-9b54-48a5-bb15-6c03be46d6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:09.199377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-99cd2ecf-0619-42c9-9026-df89681f2565 req-2ab41a76-9b54-48a5-bb15-6c03be46d6b5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:09.200205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-99cd2ecf-0619-42c9-9026-df89681f2565 req-2ab41a76-9b54-48a5-bb15-6c03be46d6b5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:09.234071 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-99cd2ecf-0619-42c9-9026-df89681f2565 req-2ab41a76-9b54-48a5-bb15-6c03be46d6b5 service nova] Creating event network-changed:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h2-766726-30 May 19 05:11:09.245266 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-99cd2ecf-0619-42c9-9026-df89681f2565 req-2ab41a76-9b54-48a5-bb15-6c03be46d6b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.526446 May 19 05:11:09.246574 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2954/5823] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:11:09.259259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-317e7fd4-003f-4238-852f-3b1098c870a8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:09.263017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-317e7fd4-003f-4238-852f-3b1098c870a8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:09.286695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317e7fd4-003f-4238-852f-3b1098c870a8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:09.288072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317e7fd4-003f-4238-852f-3b1098c870a8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:09.293628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317e7fd4-003f-4238-852f-3b1098c870a8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:09.295334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317e7fd4-003f-4238-852f-3b1098c870a8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:09.374090 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-96802955-3c47-4716-96b0-e874d47d3021 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 204 len: 0 microversion: 2.1 time: 0.664557 May 19 05:11:09.374594 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2870/5824] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:11:08 2022] DELETE /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:11:09.403531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24bcf0af-3308-4f54-9413-0833e3307a3d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:09.410744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-24bcf0af-3308-4f54-9413-0833e3307a3d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:09.460596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24bcf0af-3308-4f54-9413-0833e3307a3d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:09.461535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24bcf0af-3308-4f54-9413-0833e3307a3d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:09.472735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24bcf0af-3308-4f54-9413-0833e3307a3d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:09.476914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24bcf0af-3308-4f54-9413-0833e3307a3d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:10.941182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-24bcf0af-3308-4f54-9413-0833e3307a3d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:10.950016 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-24bcf0af-3308-4f54-9413-0833e3307a3d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1687 microversion: 2.1 time: 1.569334 May 19 05:11:10.956846 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2871/5825] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:09 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1687 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:11.073693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-317e7fd4-003f-4238-852f-3b1098c870a8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:11.086062 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-317e7fd4-003f-4238-852f-3b1098c870a8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1372 microversion: 2.1 time: 1.835566 May 19 05:11:11.087195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2955/5826] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:09 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1372 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:11.973979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9be7f9b4-4c22-497a-b780-f277331cafaf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:11.974616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9be7f9b4-4c22-497a-b780-f277331cafaf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:11.988925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9be7f9b4-4c22-497a-b780-f277331cafaf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:11.989412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9be7f9b4-4c22-497a-b780-f277331cafaf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:11.990214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9be7f9b4-4c22-497a-b780-f277331cafaf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:11.990674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9be7f9b4-4c22-497a-b780-f277331cafaf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:12.103976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b5c03bd4-cd02-4b03-aca1-26789ece9c70 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:12.104602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b5c03bd4-cd02-4b03-aca1-26789ece9c70 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:12.116550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5c03bd4-cd02-4b03-aca1-26789ece9c70 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:12.117003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5c03bd4-cd02-4b03-aca1-26789ece9c70 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:12.123898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5c03bd4-cd02-4b03-aca1-26789ece9c70 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:12.124358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5c03bd4-cd02-4b03-aca1-26789ece9c70 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:12.634447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5c03bd4-cd02-4b03-aca1-26789ece9c70 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:12.648451 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b5c03bd4-cd02-4b03-aca1-26789ece9c70 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1372 microversion: 2.1 time: 0.548494 May 19 05:11:12.652673 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2956/5827] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:12 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1372 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:12.662597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-327f9c12-1694-46a6-a837-6587dbcf810d req-2d45fc30-1224-44e6-8859-21837712ca5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cd701d-be6a-44ee-81f6-d4135e49b250", "tag": "8bea8c46-47a9-4a2d-ba61-98e6b9a868f7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:12.682402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-327f9c12-1694-46a6-a837-6587dbcf810d req-2d45fc30-1224-44e6-8859-21837712ca5f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:12.682876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-327f9c12-1694-46a6-a837-6587dbcf810d req-2d45fc30-1224-44e6-8859-21837712ca5f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:12.704698 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-327f9c12-1694-46a6-a837-6587dbcf810d req-2d45fc30-1224-44e6-8859-21837712ca5f service nova] Creating event network-changed:8bea8c46-47a9-4a2d-ba61-98e6b9a868f7 for instance 45cd701d-be6a-44ee-81f6-d4135e49b250 on n-h1-766726-30 May 19 05:11:12.718248 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-327f9c12-1694-46a6-a837-6587dbcf810d req-2d45fc30-1224-44e6-8859-21837712ca5f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063955 May 19 05:11:12.724226 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2957/5828] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:13.074494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9be7f9b4-4c22-497a-b780-f277331cafaf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:13.085963 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9be7f9b4-4c22-497a-b780-f277331cafaf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 200 len: 1687 microversion: 2.1 time: 1.116461 May 19 05:11:13.103780 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2872/5829] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:11 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 1687 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:13.667104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-77d767fc-5fae-4c8f-9126-77ab400170f1 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:13.669171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-77d767fc-5fae-4c8f-9126-77ab400170f1 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:13.677189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77d767fc-5fae-4c8f-9126-77ab400170f1 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:13.677926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77d767fc-5fae-4c8f-9126-77ab400170f1 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:13.680220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77d767fc-5fae-4c8f-9126-77ab400170f1 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:13.681189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77d767fc-5fae-4c8f-9126-77ab400170f1 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:13.943549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-77d767fc-5fae-4c8f-9126-77ab400170f1 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:13.964771 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-77d767fc-5fae-4c8f-9126-77ab400170f1 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1372 microversion: 2.1 time: 0.301976 May 19 05:11:13.965951 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2958/5830] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:13 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1372 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:14.111214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:14.112412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: eb5f0f1d-9ed0-4387-95b5-48a138de2849] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:14.121746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:14.122209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:14.123001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:14.123459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:14.140004 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] HTTP exception thrown: Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 could not be found. May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Request method failure captured: May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 HTTP/1.1 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdBO1QaW5oc4f6Vrz9_NwPhOHXbWiDxmYrQKBdrJO1vjGvboRoh4Us4Qrl0niQvSpcbSKRZNOYd3wYZZ01n2S0A2Bcn-Shs64HIMUTvoCt-SNOaQMD9yf8DNih5M2vO7lT6UGNcxHOrZVfsf9K5fDqo0Bx0-_bGZxsamgPJQjmNVycw May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 3105ae3b914f4ac8a2a5466915fba229 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 3105ae3b914f4ac8a2a5466915fba229 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestNetworkAdvancedServerOps-1985069588-project May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 195b7b4b7d384374ac86bdeaf7568026 May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1985069588-project May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 could not be found. May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'eb5f0f1d-9ed0-4387-95b5-48a138de2849'} May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 could not be found. May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 could not be found. May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:11:14.141948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:11:14.146098 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:11:14.146098 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:11:14.146098 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:11:14.146098 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:11:14.146098 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:11:14.146098 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:11:14.146098 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 could not be found. May 19 05:11:14.146098 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:11:14.148722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Returning 404 to user: Instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:11:14.150285 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-06d18504-f399-4abd-981c-1f269c34ff46 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849" status: 404 len: 111 microversion: 2.1 time: 0.043399 May 19 05:11:14.151536 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2873/5831] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:14 2022] GET /compute/v2.1/servers/eb5f0f1d-9ed0-4387-95b5-48a138de2849 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:11:14.979675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b01f772b-3420-46d6-a027-b92952abbfd9 req-370d901d-a953-435a-973e-7d8e309dba8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5f0f1d-9ed0-4387-95b5-48a138de2849", "name": "network-vif-deleted", "tag": "c431a02c-dcda-4d3a-9f4d-794121ce4690"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:14.983004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-78ddaebb-c3c3-4b80-980d-bbd523131c91 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:14.983833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-78ddaebb-c3c3-4b80-980d-bbd523131c91 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:14.995275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78ddaebb-c3c3-4b80-980d-bbd523131c91 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:14.995912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78ddaebb-c3c3-4b80-980d-bbd523131c91 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:14.996883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78ddaebb-c3c3-4b80-980d-bbd523131c91 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:15.001039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b01f772b-3420-46d6-a027-b92952abbfd9 req-370d901d-a953-435a-973e-7d8e309dba8b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:15.001713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78ddaebb-c3c3-4b80-980d-bbd523131c91 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:15.004270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b01f772b-3420-46d6-a027-b92952abbfd9 req-370d901d-a953-435a-973e-7d8e309dba8b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:15.018766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:15.057047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:15.064549 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b01f772b-3420-46d6-a027-b92952abbfd9 req-370d901d-a953-435a-973e-7d8e309dba8b service nova] Creating event network-vif-deleted:c431a02c-dcda-4d3a-9f4d-794121ce4690 for instance eb5f0f1d-9ed0-4387-95b5-48a138de2849 on n-h2-766726-30 May 19 05:11:15.090994 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b01f772b-3420-46d6-a027-b92952abbfd9 req-370d901d-a953-435a-973e-7d8e309dba8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121334 May 19 05:11:15.091626 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2959/5832] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:15.296438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:15.493239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-78ddaebb-c3c3-4b80-980d-bbd523131c91 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:15.501655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-78ddaebb-c3c3-4b80-980d-bbd523131c91 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1372 microversion: 2.1 time: 0.522480 May 19 05:11:15.505939 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2874/5833] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:14 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1372 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:16.525363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b84ef12a-82f8-47d5-8a9f-273361a838bd tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:16.526836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b84ef12a-82f8-47d5-8a9f-273361a838bd tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:16.546350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b84ef12a-82f8-47d5-8a9f-273361a838bd tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:16.547182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b84ef12a-82f8-47d5-8a9f-273361a838bd tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:16.548164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b84ef12a-82f8-47d5-8a9f-273361a838bd tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:16.548752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b84ef12a-82f8-47d5-8a9f-273361a838bd tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:16.923427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b84ef12a-82f8-47d5-8a9f-273361a838bd tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:16.937575 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b84ef12a-82f8-47d5-8a9f-273361a838bd tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1372 microversion: 2.1 time: 0.415772 May 19 05:11:16.938341 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2960/5834] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:16 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1372 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:17.956487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-830b5ac0-7e7c-4f68-bd2a-d4e8ec95c9c2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:17.957854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-830b5ac0-7e7c-4f68-bd2a-d4e8ec95c9c2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:17.985624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-830b5ac0-7e7c-4f68-bd2a-d4e8ec95c9c2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:17.987674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-830b5ac0-7e7c-4f68-bd2a-d4e8ec95c9c2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:17.997113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-830b5ac0-7e7c-4f68-bd2a-d4e8ec95c9c2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:17.997594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-830b5ac0-7e7c-4f68-bd2a-d4e8ec95c9c2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:18.385692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-830b5ac0-7e7c-4f68-bd2a-d4e8ec95c9c2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:18.408526 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-830b5ac0-7e7c-4f68-bd2a-d4e8ec95c9c2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1372 microversion: 2.1 time: 0.456776 May 19 05:11:18.409450 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2875/5835] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:17 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1372 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:19.425406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-029b4c5a-f3ff-43b1-a493-42bee416175c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:19.426889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-029b4c5a-f3ff-43b1-a493-42bee416175c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:19.440758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-029b4c5a-f3ff-43b1-a493-42bee416175c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:19.442827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-029b4c5a-f3ff-43b1-a493-42bee416175c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:19.444989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-029b4c5a-f3ff-43b1-a493-42bee416175c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:19.446526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-029b4c5a-f3ff-43b1-a493-42bee416175c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:19.967671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b8a35d61-836b-4e96-8da8-37bdb5ee4da1 req-868221c2-7a64-4f37-83cf-2983ffa2526c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cd701d-be6a-44ee-81f6-d4135e49b250", "name": "network-vif-plugged", "status": "completed", "tag": "8bea8c46-47a9-4a2d-ba61-98e6b9a868f7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:19.991985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b8a35d61-836b-4e96-8da8-37bdb5ee4da1 req-868221c2-7a64-4f37-83cf-2983ffa2526c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:19.992444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b8a35d61-836b-4e96-8da8-37bdb5ee4da1 req-868221c2-7a64-4f37-83cf-2983ffa2526c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:20.026523 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b8a35d61-836b-4e96-8da8-37bdb5ee4da1 req-868221c2-7a64-4f37-83cf-2983ffa2526c service nova] Creating event network-vif-plugged:8bea8c46-47a9-4a2d-ba61-98e6b9a868f7 for instance 45cd701d-be6a-44ee-81f6-d4135e49b250 on n-h1-766726-30 May 19 05:11:20.040736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b8a35d61-836b-4e96-8da8-37bdb5ee4da1 req-868221c2-7a64-4f37-83cf-2983ffa2526c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.503064 May 19 05:11:20.045599 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2876/5836] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:20.223781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-029b4c5a-f3ff-43b1-a493-42bee416175c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:20.243476 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-029b4c5a-f3ff-43b1-a493-42bee416175c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1372 microversion: 2.1 time: 0.822305 May 19 05:11:20.257465 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2961/5837] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:19 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1372 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:21.023529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-45c193ea-2375-406a-9445-b070f8ee6c88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '.version_select at 0x7fd314352af0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:21.070656 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-45c193ea-2375-406a-9445-b070f8ee6c88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-870732238" status: 202 len: 0 microversion: 2.1 time: 0.051517 May 19 05:11:21.074585 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2877/5838] 10.222.0.58 () {58 vars in 1280 bytes} [Thu May 19 05:11:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-870732238 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:11:21.115150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-67421a71-6433-4c6f-91a6-96cbc2a0cfa3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'create', calling method: .version_select at 0x7fd3154f9ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1753800215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnMS22HXLT21wmCe2psxtsPVuqw88j/xulSBXbvOan4m6DVuIzSZhu+MoZRl4D6UJoSVx8k6pRPCGWk9sLl1mY1IzLx1lSUMmiFmbsvMuYddMJa8Nehlxsmc083fquM3A=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:21.156952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-67421a71-6433-4c6f-91a6-96cbc2a0cfa3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:11:21.170647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-67421a71-6433-4c6f-91a6-96cbc2a0cfa3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for user 195b7b4b7d384374ac86bdeaf7568026 and project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:11:21.193045 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [None req-67421a71-6433-4c6f-91a6-96cbc2a0cfa3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [76c52dcd-8ac9-4d6d-9f16-0cf6d6e01740] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 05:11:21.264810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7023107c-2a24-41f8-8237-bd85dfba7ab7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:21.268624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7023107c-2a24-41f8-8237-bd85dfba7ab7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:21.281123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7023107c-2a24-41f8-8237-bd85dfba7ab7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:21.281847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7023107c-2a24-41f8-8237-bd85dfba7ab7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:21.283617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7023107c-2a24-41f8-8237-bd85dfba7ab7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:21.284387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7023107c-2a24-41f8-8237-bd85dfba7ab7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:21.466813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7023107c-2a24-41f8-8237-bd85dfba7ab7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:21.477243 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7023107c-2a24-41f8-8237-bd85dfba7ab7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1372 microversion: 2.1 time: 0.221008 May 19 05:11:21.478398 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2878/5839] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:21 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:11:22.200405 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [None req-67421a71-6433-4c6f-91a6-96cbc2a0cfa3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [76c52dcd-8ac9-4d6d-9f16-0cf6d6e01740] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49654. May 19 05:11:22.226156 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-67421a71-6433-4c6f-91a6-96cbc2a0cfa3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.114793 May 19 05:11:22.235052 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2962/5840] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:11:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:22.496955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1348d0a4-4d2c-4928-b6d7-cec082719ec6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:22.496955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1348d0a4-4d2c-4928-b6d7-cec082719ec6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:22.514736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1348d0a4-4d2c-4928-b6d7-cec082719ec6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:22.515207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1348d0a4-4d2c-4928-b6d7-cec082719ec6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:22.520344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1348d0a4-4d2c-4928-b6d7-cec082719ec6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:22.520820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1348d0a4-4d2c-4928-b6d7-cec082719ec6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:22.808063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1348d0a4-4d2c-4928-b6d7-cec082719ec6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:22.813798 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1348d0a4-4d2c-4928-b6d7-cec082719ec6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1544 microversion: 2.1 time: 0.322987 May 19 05:11:22.814357 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2879/5841] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:22 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1544 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:22.833890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c120ff3-a972-4a3a-9678-8b9d21269ce6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:22.835006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9c120ff3-a972-4a3a-9678-8b9d21269ce6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:22.853434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c120ff3-a972-4a3a-9678-8b9d21269ce6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:22.854143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c120ff3-a972-4a3a-9678-8b9d21269ce6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:22.855103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c120ff3-a972-4a3a-9678-8b9d21269ce6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:22.856684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c120ff3-a972-4a3a-9678-8b9d21269ce6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:23.214032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c120ff3-a972-4a3a-9678-8b9d21269ce6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:23.231874 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c120ff3-a972-4a3a-9678-8b9d21269ce6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1544 microversion: 2.1 time: 0.394304 May 19 05:11:23.232873 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2963/5842] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:22 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1544 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:28.063962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-84a29736-7988-4e0a-8466-5f522bbf32d1 req-3649347e-8cb9-40b2-aa47-7b9ee24e60ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cd701d-be6a-44ee-81f6-d4135e49b250", "tag": "8bea8c46-47a9-4a2d-ba61-98e6b9a868f7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:28.090241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-84a29736-7988-4e0a-8466-5f522bbf32d1 req-3649347e-8cb9-40b2-aa47-7b9ee24e60ee service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:28.090694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-84a29736-7988-4e0a-8466-5f522bbf32d1 req-3649347e-8cb9-40b2-aa47-7b9ee24e60ee service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:28.136347 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-84a29736-7988-4e0a-8466-5f522bbf32d1 req-3649347e-8cb9-40b2-aa47-7b9ee24e60ee service nova] Creating event network-changed:8bea8c46-47a9-4a2d-ba61-98e6b9a868f7 for instance 45cd701d-be6a-44ee-81f6-d4135e49b250 on n-h1-766726-30 May 19 05:11:28.147116 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-84a29736-7988-4e0a-8466-5f522bbf32d1 req-3649347e-8cb9-40b2-aa47-7b9ee24e60ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087461 May 19 05:11:28.148549 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2880/5843] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:39.536329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2031344104", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "bffeb5aa-a91c-48b9-8c34-2223de944c63"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1753800215", "security_groups": [{"name": "tempest-secgroup-smoke-1444743420"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:39.555388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:39.557260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:39.557931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=60 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:39.935900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] validate_networks() for [('bffeb5aa-a91c-48b9-8c34-2223de944c63', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:11:40.867669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:11:40.868259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:11:40.868672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:11:40.869129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:11:40.869538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:11:40.887922 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:40.888516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:40.889385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:40.889830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:40.940187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:11:40.951889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for user 195b7b4b7d384374ac86bdeaf7568026 and project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:11:40.987438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:11:40.992760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:11:41.107115 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bbc6d949-990e-4b09-890f-9a048379eecf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.575990 May 19 05:11:41.126149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:41.127503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:41.132921 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2964/5844] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:11:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:11:41.137580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8043f81e-aa3b-480a-a7ec-b750d36b884c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:41.138473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8043f81e-aa3b-480a-a7ec-b750d36b884c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:41.354783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8043f81e-aa3b-480a-a7ec-b750d36b884c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:41.361923 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8043f81e-aa3b-480a-a7ec-b750d36b884c tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1267 microversion: 2.1 time: 0.237793 May 19 05:11:41.362680 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2881/5845] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:41 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:42.380014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e70d255-597f-41ad-855b-657c2647b500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:42.381293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7e70d255-597f-41ad-855b-657c2647b500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:42.405663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e70d255-597f-41ad-855b-657c2647b500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:42.406521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e70d255-597f-41ad-855b-657c2647b500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:42.407600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e70d255-597f-41ad-855b-657c2647b500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:42.408290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e70d255-597f-41ad-855b-657c2647b500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:42.722938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7e70d255-597f-41ad-855b-657c2647b500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:42.756490 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e70d255-597f-41ad-855b-657c2647b500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1263 microversion: 2.1 time: 0.367695 May 19 05:11:42.767471 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2965/5846] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:42 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1263 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:43.774498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e893e9e8-8631-4286-b4e2-7446448e68b9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:43.775119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e893e9e8-8631-4286-b4e2-7446448e68b9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:43.797975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e893e9e8-8631-4286-b4e2-7446448e68b9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:43.798657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e893e9e8-8631-4286-b4e2-7446448e68b9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:43.799619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e893e9e8-8631-4286-b4e2-7446448e68b9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:43.800284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e893e9e8-8631-4286-b4e2-7446448e68b9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:44.023677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e893e9e8-8631-4286-b4e2-7446448e68b9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:44.032998 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e893e9e8-8631-4286-b4e2-7446448e68b9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1325 microversion: 2.1 time: 0.263985 May 19 05:11:44.036034 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2882/5847] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:43 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:45.056134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-95548691-28fb-4492-99f5-bcf4431056e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:45.056782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-95548691-28fb-4492-99f5-bcf4431056e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:45.074957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95548691-28fb-4492-99f5-bcf4431056e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:45.075432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95548691-28fb-4492-99f5-bcf4431056e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:45.076310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95548691-28fb-4492-99f5-bcf4431056e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:45.076666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95548691-28fb-4492-99f5-bcf4431056e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:45.647443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-95548691-28fb-4492-99f5-bcf4431056e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:45.655552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-95548691-28fb-4492-99f5-bcf4431056e8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1393 microversion: 2.1 time: 0.607589 May 19 05:11:45.669146 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2966/5848] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:45 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1393 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:46.673385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8aaa0dc1-7aae-43ab-ae79-d23d9d205c19 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:46.677140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8aaa0dc1-7aae-43ab-ae79-d23d9d205c19 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:46.700906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8aaa0dc1-7aae-43ab-ae79-d23d9d205c19 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:46.704089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8aaa0dc1-7aae-43ab-ae79-d23d9d205c19 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:46.706537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8aaa0dc1-7aae-43ab-ae79-d23d9d205c19 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:46.708303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8aaa0dc1-7aae-43ab-ae79-d23d9d205c19 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:47.085238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-526a7700-fc35-45dc-960a-78b7629eba2e req-738c7126-9fa3-4be3-9aec-e3ab860d58ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a42fc8-6ec3-4919-b23b-baa4cd39222b", "tag": "7678eb52-5ab0-4d56-96b8-4dadc1278e12"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:47.086443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8aaa0dc1-7aae-43ab-ae79-d23d9d205c19 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:47.099242 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8aaa0dc1-7aae-43ab-ae79-d23d9d205c19 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1393 microversion: 2.1 time: 0.429802 May 19 05:11:47.116155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-526a7700-fc35-45dc-960a-78b7629eba2e req-738c7126-9fa3-4be3-9aec-e3ab860d58ef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:47.128620 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2883/5849] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:46 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1393 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:47.130437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-526a7700-fc35-45dc-960a-78b7629eba2e req-738c7126-9fa3-4be3-9aec-e3ab860d58ef service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:47.147074 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-526a7700-fc35-45dc-960a-78b7629eba2e req-738c7126-9fa3-4be3-9aec-e3ab860d58ef service nova] Creating event network-changed:7678eb52-5ab0-4d56-96b8-4dadc1278e12 for instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b on n-h2-766726-30 May 19 05:11:47.169358 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-526a7700-fc35-45dc-960a-78b7629eba2e req-738c7126-9fa3-4be3-9aec-e3ab860d58ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087797 May 19 05:11:47.174455 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2967/5850] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:48.135885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5c6d28a-3830-4472-9941-e383e6937316 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:48.137279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b5c6d28a-3830-4472-9941-e383e6937316 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:48.147583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5c6d28a-3830-4472-9941-e383e6937316 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:48.148041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5c6d28a-3830-4472-9941-e383e6937316 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:48.148828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5c6d28a-3830-4472-9941-e383e6937316 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:48.149299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5c6d28a-3830-4472-9941-e383e6937316 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:48.447632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b5c6d28a-3830-4472-9941-e383e6937316 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:48.461677 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5c6d28a-3830-4472-9941-e383e6937316 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1393 microversion: 2.1 time: 0.331191 May 19 05:11:48.462481 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2884/5851] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:48 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1393 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:48.575425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0013bc29-a90d-4a8b-b670-725096e6ec68 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:48.578674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0013bc29-a90d-4a8b-b670-725096e6ec68 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:48.591236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0013bc29-a90d-4a8b-b670-725096e6ec68 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:48.595794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0013bc29-a90d-4a8b-b670-725096e6ec68 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:48.597372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0013bc29-a90d-4a8b-b670-725096e6ec68 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:48.600426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0013bc29-a90d-4a8b-b670-725096e6ec68 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:48.682303 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0013bc29-a90d-4a8b-b670-725096e6ec68 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "POST /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250/action" status: 200 len: 24570 microversion: 2.1 time: 0.115035 May 19 05:11:48.683595 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2968/5852] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:11:48 2022] POST /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250/action => generated 24570 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:11:49.479528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c8ba58d8-6c12-4eb6-a463-100a3eb4241d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:49.480147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c8ba58d8-6c12-4eb6-a463-100a3eb4241d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:49.493580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8ba58d8-6c12-4eb6-a463-100a3eb4241d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:49.501159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8ba58d8-6c12-4eb6-a463-100a3eb4241d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:49.501159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8ba58d8-6c12-4eb6-a463-100a3eb4241d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:49.502312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c8ba58d8-6c12-4eb6-a463-100a3eb4241d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:50.014159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c8ba58d8-6c12-4eb6-a463-100a3eb4241d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:50.050430 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c8ba58d8-6c12-4eb6-a463-100a3eb4241d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1393 microversion: 2.1 time: 0.574645 May 19 05:11:50.052124 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2885/5853] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:49 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1393 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:51.075486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-059d825d-32ca-4856-9404-a69ccc337dae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:51.076287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-059d825d-32ca-4856-9404-a69ccc337dae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:51.096712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:51.097477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:51.106976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-059d825d-32ca-4856-9404-a69ccc337dae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:51.114567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-059d825d-32ca-4856-9404-a69ccc337dae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:51.116120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-059d825d-32ca-4856-9404-a69ccc337dae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:51.117099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-059d825d-32ca-4856-9404-a69ccc337dae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:51.526123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-059d825d-32ca-4856-9404-a69ccc337dae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:51.541869 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-059d825d-32ca-4856-9404-a69ccc337dae tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1393 microversion: 2.1 time: 0.477192 May 19 05:11:51.543619 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2969/5854] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:51 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1393 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:52.565596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4d9f807a-5101-45ab-8984-3e5f1254ef01 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:52.566824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4d9f807a-5101-45ab-8984-3e5f1254ef01 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:52.575872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:11:52.578282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d9f807a-5101-45ab-8984-3e5f1254ef01 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:52.579021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d9f807a-5101-45ab-8984-3e5f1254ef01 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:52.580503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d9f807a-5101-45ab-8984-3e5f1254ef01 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:52.581153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4d9f807a-5101-45ab-8984-3e5f1254ef01 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:52.928724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4d9f807a-5101-45ab-8984-3e5f1254ef01 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:52.937162 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4d9f807a-5101-45ab-8984-3e5f1254ef01 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1393 microversion: 2.1 time: 0.376362 May 19 05:11:52.938058 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2886/5855] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:52 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1393 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:53.718710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cae36715-3cde-4cf3-996f-e8ed3aadb4b5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Action: 'create', calling method: .version_select at 0x7fd316089d30>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1168433506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqLPJESkjkzdBVOcFZwauTUi90HwcVxaohsWcalQybRmRLG1Jdpvsmg28U03ARgXxn4U7c8vGNfvN6QALUyvxRWSuQw+kqfAK1lGsMsBiPEB3gqKuV00uOsJDH5i5Qvzw=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:53.738294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cae36715-3cde-4cf3-996f-e8ed3aadb4b5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Getting quotas for project 05224e9048b3453a9bb767f77165e1ed. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:11:53.745038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-cae36715-3cde-4cf3-996f-e8ed3aadb4b5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Getting quotas for user ed476fdeb1784b4c9decff54c7196e12 and project 05224e9048b3453a9bb767f77165e1ed. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:11:53.776257 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cae36715-3cde-4cf3-996f-e8ed3aadb4b5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.266038 May 19 05:11:53.777195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2970/5856] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:11:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:53.955454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8a753784-279c-4442-82cb-b0445a52f047 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:53.956286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8a753784-279c-4442-82cb-b0445a52f047 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:53.968748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a753784-279c-4442-82cb-b0445a52f047 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:53.969257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a753784-279c-4442-82cb-b0445a52f047 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:53.970054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a753784-279c-4442-82cb-b0445a52f047 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:53.972500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a753784-279c-4442-82cb-b0445a52f047 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:54.181799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8a753784-279c-4442-82cb-b0445a52f047 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:54.192739 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8a753784-279c-4442-82cb-b0445a52f047 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1393 microversion: 2.1 time: 0.241760 May 19 05:11:54.193614 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2887/5857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:53 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1393 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:54.693344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-16fe024d-d1fa-470f-a0a8-ad91e54d825c req-207267bd-fd45-491a-8322-4bcb7d32bc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a42fc8-6ec3-4919-b23b-baa4cd39222b", "name": "network-vif-plugged", "status": "completed", "tag": "7678eb52-5ab0-4d56-96b8-4dadc1278e12"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:54.719122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-16fe024d-d1fa-470f-a0a8-ad91e54d825c req-207267bd-fd45-491a-8322-4bcb7d32bc5d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:54.720516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-16fe024d-d1fa-470f-a0a8-ad91e54d825c req-207267bd-fd45-491a-8322-4bcb7d32bc5d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:54.752987 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-16fe024d-d1fa-470f-a0a8-ad91e54d825c req-207267bd-fd45-491a-8322-4bcb7d32bc5d service nova] Creating event network-vif-plugged:7678eb52-5ab0-4d56-96b8-4dadc1278e12 for instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b on n-h2-766726-30 May 19 05:11:54.770432 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-16fe024d-d1fa-470f-a0a8-ad91e54d825c req-207267bd-fd45-491a-8322-4bcb7d32bc5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079773 May 19 05:11:54.772910 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2971/5858] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:11:55.212802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-30731820-06c7-4554-b0e1-c185e5a13191 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:55.214657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-30731820-06c7-4554-b0e1-c185e5a13191 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:55.225181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30731820-06c7-4554-b0e1-c185e5a13191 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:55.226571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30731820-06c7-4554-b0e1-c185e5a13191 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:55.227561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30731820-06c7-4554-b0e1-c185e5a13191 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:55.228448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-30731820-06c7-4554-b0e1-c185e5a13191 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:55.437976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-30731820-06c7-4554-b0e1-c185e5a13191 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:55.450190 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-30731820-06c7-4554-b0e1-c185e5a13191 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1393 microversion: 2.1 time: 0.243525 May 19 05:11:55.451304 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2888/5859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:55 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1393 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:55.653474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1642830700", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1168433506", "security_groups": [{"name": "tempest-secgroup-smoke-350003123"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "7edae019-8d31-4eef-b742-a74a97529415"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:11:55.792486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] validate_networks() for [('7edae019-8d31-4eef-b742-a74a97529415', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:11:56.455977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Getting quotas for project 05224e9048b3453a9bb767f77165e1ed. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:11:56.468070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2a1ac0f-8953-4441-859f-663cffa7dde7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:56.468697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e2a1ac0f-8953-4441-859f-663cffa7dde7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:56.485124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Getting quotas for user ed476fdeb1784b4c9decff54c7196e12 and project 05224e9048b3453a9bb767f77165e1ed. Resources: dict_keys(['metadata_items']) {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:11:56.485779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2a1ac0f-8953-4441-859f-663cffa7dde7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:56.494196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2a1ac0f-8953-4441-859f-663cffa7dde7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:56.495826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2a1ac0f-8953-4441-859f-663cffa7dde7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:56.500600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2a1ac0f-8953-4441-859f-663cffa7dde7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:56.532349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:11:56.533719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:11:56.535036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:11:56.537114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:11:56.538451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:11:56.550497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:56.551464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:56.552608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:56.553253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:56.577343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Getting quotas for project 05224e9048b3453a9bb767f77165e1ed. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:11:56.584254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Getting quotas for user ed476fdeb1784b4c9decff54c7196e12 and project 05224e9048b3453a9bb767f77165e1ed. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:11:56.604462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:11:56.607233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:11:56.709811 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ce0b8b2f-196d-4572-906c-9e894a84eb57 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.060755 May 19 05:11:56.715168 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2972/5860] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:11:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:11:56.744349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9cd96eae-1247-4a8c-b88f-189a26a36e7d tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:56.745285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9cd96eae-1247-4a8c-b88f-189a26a36e7d tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:56.865357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9cd96eae-1247-4a8c-b88f-189a26a36e7d tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:56.875365 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9cd96eae-1247-4a8c-b88f-189a26a36e7d tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1303 microversion: 2.1 time: 0.156708 May 19 05:11:56.876456 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2973/5861] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:56 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:11:57.041930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e2a1ac0f-8953-4441-859f-663cffa7dde7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:57.050462 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2a1ac0f-8953-4441-859f-663cffa7dde7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1565 microversion: 2.1 time: 0.586476 May 19 05:11:57.063909 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2889/5862] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:56 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1565 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:57.070505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fcfcf9c5-4b95-4075-b8dd-8d68fc308500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:57.071428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fcfcf9c5-4b95-4075-b8dd-8d68fc308500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:57.085759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcfcf9c5-4b95-4075-b8dd-8d68fc308500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:57.086628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcfcf9c5-4b95-4075-b8dd-8d68fc308500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:57.087669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcfcf9c5-4b95-4075-b8dd-8d68fc308500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:57.090367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fcfcf9c5-4b95-4075-b8dd-8d68fc308500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:57.351968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fcfcf9c5-4b95-4075-b8dd-8d68fc308500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:57.360928 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fcfcf9c5-4b95-4075-b8dd-8d68fc308500 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1565 microversion: 2.1 time: 0.294976 May 19 05:11:57.364531 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2974/5863] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:57 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1565 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:57.901190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d16f1d9e-57eb-46e7-a84e-3e1b4f1e0f38 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:57.902497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d16f1d9e-57eb-46e7-a84e-3e1b4f1e0f38 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:57.919849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d16f1d9e-57eb-46e7-a84e-3e1b4f1e0f38 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:57.920856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d16f1d9e-57eb-46e7-a84e-3e1b4f1e0f38 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:57.922008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d16f1d9e-57eb-46e7-a84e-3e1b4f1e0f38 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:57.925248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d16f1d9e-57eb-46e7-a84e-3e1b4f1e0f38 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:58.074239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d16f1d9e-57eb-46e7-a84e-3e1b4f1e0f38 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:58.088135 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d16f1d9e-57eb-46e7-a84e-3e1b4f1e0f38 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1355 microversion: 2.1 time: 0.198692 May 19 05:11:58.099381 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2890/5864] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:57 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1355 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:11:59.109003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8c2b3f2e-18f6-498d-8393-375c9fb4eee5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:11:59.110407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8c2b3f2e-18f6-498d-8393-375c9fb4eee5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:11:59.132501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c2b3f2e-18f6-498d-8393-375c9fb4eee5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:59.133289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c2b3f2e-18f6-498d-8393-375c9fb4eee5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:59.136464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c2b3f2e-18f6-498d-8393-375c9fb4eee5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:11:59.137784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c2b3f2e-18f6-498d-8393-375c9fb4eee5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:11:59.288685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8c2b3f2e-18f6-498d-8393-375c9fb4eee5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:11:59.300363 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8c2b3f2e-18f6-498d-8393-375c9fb4eee5 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1361 microversion: 2.1 time: 0.196877 May 19 05:11:59.306028 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2975/5865] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:11:59 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:00.322624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-77f4c9e7-ba8f-4be3-8dfa-c014f8033855 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:00.335811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-77f4c9e7-ba8f-4be3-8dfa-c014f8033855 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:00.350795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77f4c9e7-ba8f-4be3-8dfa-c014f8033855 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:00.352355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77f4c9e7-ba8f-4be3-8dfa-c014f8033855 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:00.354055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77f4c9e7-ba8f-4be3-8dfa-c014f8033855 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:00.355365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77f4c9e7-ba8f-4be3-8dfa-c014f8033855 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:00.825276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-77f4c9e7-ba8f-4be3-8dfa-c014f8033855 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:00.835969 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-77f4c9e7-ba8f-4be3-8dfa-c014f8033855 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1428 microversion: 2.1 time: 0.517006 May 19 05:12:00.838366 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2891/5866] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:00 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1428 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:01.051618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-7264e24b-ef82-4092-86d9-1a971bc5b7fa req-d6957c38-5bd4-437b-995a-0312ebf5c609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03c88f4-54ef-4d70-bfb0-a3e26ae78a28", "tag": "29ea09a9-9f89-4ae9-90df-6a6dba81782d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:01.076348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b871db02-a5b0-4dc1-ae2f-2d66790e46bc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:01.076932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b871db02-a5b0-4dc1-ae2f-2d66790e46bc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:01.092600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b871db02-a5b0-4dc1-ae2f-2d66790e46bc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:01.093053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b871db02-a5b0-4dc1-ae2f-2d66790e46bc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:01.093877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b871db02-a5b0-4dc1-ae2f-2d66790e46bc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:01.094323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b871db02-a5b0-4dc1-ae2f-2d66790e46bc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:01.104687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7264e24b-ef82-4092-86d9-1a971bc5b7fa req-d6957c38-5bd4-437b-995a-0312ebf5c609 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:01.105155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7264e24b-ef82-4092-86d9-1a971bc5b7fa req-d6957c38-5bd4-437b-995a-0312ebf5c609 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:01.148940 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7264e24b-ef82-4092-86d9-1a971bc5b7fa req-d6957c38-5bd4-437b-995a-0312ebf5c609 service nova] Creating event network-changed:29ea09a9-9f89-4ae9-90df-6a6dba81782d for instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 on n-h1-766726-30 May 19 05:12:01.179102 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-7264e24b-ef82-4092-86d9-1a971bc5b7fa req-d6957c38-5bd4-437b-995a-0312ebf5c609 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132867 May 19 05:12:01.181825 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2976/5867] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:12:01.195236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0381a3b3-d221-45f3-9fc1-17fda007dba8 req-c3e18627-06fb-4a6b-9c2c-ba167c4fc79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a42fc8-6ec3-4919-b23b-baa4cd39222b", "tag": "7678eb52-5ab0-4d56-96b8-4dadc1278e12"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:01.221741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0381a3b3-d221-45f3-9fc1-17fda007dba8 req-c3e18627-06fb-4a6b-9c2c-ba167c4fc79a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:01.222201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0381a3b3-d221-45f3-9fc1-17fda007dba8 req-c3e18627-06fb-4a6b-9c2c-ba167c4fc79a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:01.244730 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0381a3b3-d221-45f3-9fc1-17fda007dba8 req-c3e18627-06fb-4a6b-9c2c-ba167c4fc79a service nova] Creating event network-changed:7678eb52-5ab0-4d56-96b8-4dadc1278e12 for instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b on n-h2-766726-30 May 19 05:12:01.258402 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0381a3b3-d221-45f3-9fc1-17fda007dba8 req-c3e18627-06fb-4a6b-9c2c-ba167c4fc79a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072561 May 19 05:12:01.264385 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2977/5868] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:12:01.630671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b871db02-a5b0-4dc1-ae2f-2d66790e46bc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:01.654200 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b871db02-a5b0-4dc1-ae2f-2d66790e46bc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1565 microversion: 2.1 time: 0.579052 May 19 05:12:01.654927 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2892/5869] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:01 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1565 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:01.854736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba2f115b-f4a5-45f4-8cf5-907030ba81c3 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:01.855509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba2f115b-f4a5-45f4-8cf5-907030ba81c3 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:01.866179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba2f115b-f4a5-45f4-8cf5-907030ba81c3 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:01.866642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba2f115b-f4a5-45f4-8cf5-907030ba81c3 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:01.867439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba2f115b-f4a5-45f4-8cf5-907030ba81c3 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:01.867889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba2f115b-f4a5-45f4-8cf5-907030ba81c3 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:02.244779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ba2f115b-f4a5-45f4-8cf5-907030ba81c3 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:02.260723 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba2f115b-f4a5-45f4-8cf5-907030ba81c3 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1428 microversion: 2.1 time: 0.410664 May 19 05:12:02.264379 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2978/5870] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:01 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1428 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:03.284351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1b0562b-2d53-40c3-a5ad-bed8e16ee0fd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:03.285126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f1b0562b-2d53-40c3-a5ad-bed8e16ee0fd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:03.306486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1b0562b-2d53-40c3-a5ad-bed8e16ee0fd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:03.308617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1b0562b-2d53-40c3-a5ad-bed8e16ee0fd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:03.309967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1b0562b-2d53-40c3-a5ad-bed8e16ee0fd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:03.311369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1b0562b-2d53-40c3-a5ad-bed8e16ee0fd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:03.635676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f1b0562b-2d53-40c3-a5ad-bed8e16ee0fd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:03.647035 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f1b0562b-2d53-40c3-a5ad-bed8e16ee0fd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1428 microversion: 2.1 time: 0.367277 May 19 05:12:03.648229 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2893/5871] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:03 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1428 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:04.110723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4d87bbac-fd80-43a8-b83f-7845089937a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Action: 'create', calling method: .version_select at 0x7fd314b504c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2024952480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUMQDi5xOGcbLxU82gOYoTuIq3vQHYoqSRkjMzwjHG+AoY2M28d2GJgpm2ryE1+N4n7DdW4Gc2r4SSeIwkTO6ddiMbhFKiXdftp4etGzyI8FJTNeuvXfsaqr8TYouWJYQ=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:04.145921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4d87bbac-fd80-43a8-b83f-7845089937a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for project fc642d868cb74f45b8df137d93a42e07. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:12:04.161683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4d87bbac-fd80-43a8-b83f-7845089937a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for user 21be8a1f15ac40c7851356be4dc2ce32 and project fc642d868cb74f45b8df137d93a42e07. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:12:04.204568 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4d87bbac-fd80-43a8-b83f-7845089937a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.095888 May 19 05:12:04.205515 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2979/5872] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:12:04 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:12:04.684464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6a69acb-178e-4eeb-95b0-84ae775fb599 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:04.716477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6a69acb-178e-4eeb-95b0-84ae775fb599 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:04.732585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6a69acb-178e-4eeb-95b0-84ae775fb599 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:04.733382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6a69acb-178e-4eeb-95b0-84ae775fb599 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:04.734758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6a69acb-178e-4eeb-95b0-84ae775fb599 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:04.735370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6a69acb-178e-4eeb-95b0-84ae775fb599 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:05.044678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d6a69acb-178e-4eeb-95b0-84ae775fb599 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:05.056512 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6a69acb-178e-4eeb-95b0-84ae775fb599 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1428 microversion: 2.1 time: 0.389653 May 19 05:12:05.057540 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2894/5873] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:04 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1428 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:05.999684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-105773038", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "0dc0c777-fa56-4ad6-98f5-20fb76cb12c7"}], "key_name": "tempest-TestNetworkBasicOps-2024952480", "security_groups": [{"name": "tempest-secgroup-smoke-1163635724"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:06.074896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b446a4f9-8c4a-4d1a-b8d6-9051d7236fa1 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:06.075621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b446a4f9-8c4a-4d1a-b8d6-9051d7236fa1 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:06.092248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b446a4f9-8c4a-4d1a-b8d6-9051d7236fa1 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:06.095491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b446a4f9-8c4a-4d1a-b8d6-9051d7236fa1 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:06.096451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b446a4f9-8c4a-4d1a-b8d6-9051d7236fa1 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:06.098655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b446a4f9-8c4a-4d1a-b8d6-9051d7236fa1 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:06.140348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] validate_networks() for [('0dc0c777-fa56-4ad6-98f5-20fb76cb12c7', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:12:06.382931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b446a4f9-8c4a-4d1a-b8d6-9051d7236fa1 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:06.407121 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b446a4f9-8c4a-4d1a-b8d6-9051d7236fa1 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1428 microversion: 2.1 time: 0.326082 May 19 05:12:06.408078 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2895/5874] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:06 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1428 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:12:06.568041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:06.788417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:12:06.789405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:12:06.790112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:12:06.790755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:12:06.791407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:12:06.794835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:06.804058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:06.805259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:06.806741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:06.807647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:06.851571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for project fc642d868cb74f45b8df137d93a42e07. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:12:06.864972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for user 21be8a1f15ac40c7851356be4dc2ce32 and project fc642d868cb74f45b8df137d93a42e07. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:12:06.890996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:12:06.893665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:12:06.962520 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-41c85524-7602-4c19-b034-7627ffd2618d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.966782 May 19 05:12:06.963516 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2980/5875] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:12:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:12:06.973580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f93500b2-3841-483f-9a9d-6ded88ed6487 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:06.974026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f93500b2-3841-483f-9a9d-6ded88ed6487 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:07.078718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f93500b2-3841-483f-9a9d-6ded88ed6487 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:07.087812 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f93500b2-3841-483f-9a9d-6ded88ed6487 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1248 microversion: 2.1 time: 0.118205 May 19 05:12:07.101962 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2896/5876] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:06 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1248 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:07.402383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-099bdeb6-1f1e-4373-9d3f-6a9935b442ec req-834338df-7905-48a1-93b9-3774934cf406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03c88f4-54ef-4d70-bfb0-a3e26ae78a28", "name": "network-vif-plugged", "status": "completed", "tag": "29ea09a9-9f89-4ae9-90df-6a6dba81782d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:07.427771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b154f00c-7310-4290-99d9-b86f106c9bcd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:07.428038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-099bdeb6-1f1e-4373-9d3f-6a9935b442ec req-834338df-7905-48a1-93b9-3774934cf406 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:07.428226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-099bdeb6-1f1e-4373-9d3f-6a9935b442ec req-834338df-7905-48a1-93b9-3774934cf406 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:07.433034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b154f00c-7310-4290-99d9-b86f106c9bcd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:07.449458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b154f00c-7310-4290-99d9-b86f106c9bcd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:07.451909 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-099bdeb6-1f1e-4373-9d3f-6a9935b442ec req-834338df-7905-48a1-93b9-3774934cf406 service nova] Creating event network-vif-plugged:29ea09a9-9f89-4ae9-90df-6a6dba81782d for instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 on n-h1-766726-30 May 19 05:12:07.452540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b154f00c-7310-4290-99d9-b86f106c9bcd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:07.453519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b154f00c-7310-4290-99d9-b86f106c9bcd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:07.455201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b154f00c-7310-4290-99d9-b86f106c9bcd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:07.469586 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-099bdeb6-1f1e-4373-9d3f-6a9935b442ec req-834338df-7905-48a1-93b9-3774934cf406 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073925 May 19 05:12:07.470512 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2981/5877] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:12:07.767000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b154f00c-7310-4290-99d9-b86f106c9bcd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:07.782589 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b154f00c-7310-4290-99d9-b86f106c9bcd tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1428 microversion: 2.1 time: 0.360175 May 19 05:12:07.792971 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2897/5878] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:07 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1428 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:08.115519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-77bff95d-ce67-445f-985e-b6e95b8fbb76 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:08.116595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-77bff95d-ce67-445f-985e-b6e95b8fbb76 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:08.124114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77bff95d-ce67-445f-985e-b6e95b8fbb76 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:08.124692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77bff95d-ce67-445f-985e-b6e95b8fbb76 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:08.125617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77bff95d-ce67-445f-985e-b6e95b8fbb76 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:08.126129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77bff95d-ce67-445f-985e-b6e95b8fbb76 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:08.205805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-77bff95d-ce67-445f-985e-b6e95b8fbb76 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:08.218064 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-77bff95d-ce67-445f-985e-b6e95b8fbb76 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1300 microversion: 2.1 time: 0.108828 May 19 05:12:08.219054 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2982/5879] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:08 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:08.806894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e64c99db-ad9b-4f15-8afb-53634db75f32 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:08.808025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e64c99db-ad9b-4f15-8afb-53634db75f32 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:08.815336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e64c99db-ad9b-4f15-8afb-53634db75f32 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:08.816178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e64c99db-ad9b-4f15-8afb-53634db75f32 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:08.817842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e64c99db-ad9b-4f15-8afb-53634db75f32 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:08.822583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e64c99db-ad9b-4f15-8afb-53634db75f32 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:09.108651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e64c99db-ad9b-4f15-8afb-53634db75f32 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:09.117452 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e64c99db-ad9b-4f15-8afb-53634db75f32 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1428 microversion: 2.1 time: 0.321113 May 19 05:12:09.118338 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2898/5880] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:08 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1428 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:09.235445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e19d6fdb-c90f-4d4c-b675-5c2f0dadddc6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:09.236076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e19d6fdb-c90f-4d4c-b675-5c2f0dadddc6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:09.249694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e19d6fdb-c90f-4d4c-b675-5c2f0dadddc6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:09.250411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e19d6fdb-c90f-4d4c-b675-5c2f0dadddc6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:09.251417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e19d6fdb-c90f-4d4c-b675-5c2f0dadddc6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:09.252048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e19d6fdb-c90f-4d4c-b675-5c2f0dadddc6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:09.526990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e19d6fdb-c90f-4d4c-b675-5c2f0dadddc6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:09.535838 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e19d6fdb-c90f-4d4c-b675-5c2f0dadddc6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1374 microversion: 2.1 time: 0.304459 May 19 05:12:09.536681 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2983/5881] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:09 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1374 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:10.137408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d0e21169-7f8d-498e-a8aa-1ca449787e91 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:10.137989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d0e21169-7f8d-498e-a8aa-1ca449787e91 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:10.144629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0e21169-7f8d-498e-a8aa-1ca449787e91 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:10.145400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0e21169-7f8d-498e-a8aa-1ca449787e91 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:10.146405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0e21169-7f8d-498e-a8aa-1ca449787e91 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:10.147365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d0e21169-7f8d-498e-a8aa-1ca449787e91 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:10.191830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:10.341976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-18d4e07f-9b9c-4857-9117-937ff2ecf811 req-cd9a4deb-ef6e-4065-b85c-b3b9da047842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5", "tag": "4f1514f5-73b7-4464-ad9f-f81dd2c3ee19"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:10.377151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-18d4e07f-9b9c-4857-9117-937ff2ecf811 req-cd9a4deb-ef6e-4065-b85c-b3b9da047842 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:10.378032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-18d4e07f-9b9c-4857-9117-937ff2ecf811 req-cd9a4deb-ef6e-4065-b85c-b3b9da047842 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:10.400400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=69 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:10.413813 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-18d4e07f-9b9c-4857-9117-937ff2ecf811 req-cd9a4deb-ef6e-4065-b85c-b3b9da047842 service nova] Creating event network-changed:4f1514f5-73b7-4464-ad9f-f81dd2c3ee19 for instance 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 on n-h2-766726-30 May 19 05:12:10.426227 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-18d4e07f-9b9c-4857-9117-937ff2ecf811 req-cd9a4deb-ef6e-4065-b85c-b3b9da047842 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132602 May 19 05:12:10.429401 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2984/5882] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:12:10.486091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d0e21169-7f8d-498e-a8aa-1ca449787e91 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:10.495804 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d0e21169-7f8d-498e-a8aa-1ca449787e91 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1608 microversion: 2.1 time: 0.363669 May 19 05:12:10.503693 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2899/5883] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:10 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1608 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:10.524579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d6006242-f77c-4718-88bc-75b757621caa tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:10.525987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d6006242-f77c-4718-88bc-75b757621caa tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:10.544898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6006242-f77c-4718-88bc-75b757621caa tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:10.545678 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6006242-f77c-4718-88bc-75b757621caa tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:10.547347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6006242-f77c-4718-88bc-75b757621caa tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:10.556076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ddee2b1-66e0-495a-bb09-5668a7b9f59e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:10.557419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9ddee2b1-66e0-495a-bb09-5668a7b9f59e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:10.561397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6006242-f77c-4718-88bc-75b757621caa tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:10.570799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ddee2b1-66e0-495a-bb09-5668a7b9f59e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:10.573270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ddee2b1-66e0-495a-bb09-5668a7b9f59e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:10.575097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ddee2b1-66e0-495a-bb09-5668a7b9f59e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:10.576907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ddee2b1-66e0-495a-bb09-5668a7b9f59e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:10.911905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9ddee2b1-66e0-495a-bb09-5668a7b9f59e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:10.920037 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ddee2b1-66e0-495a-bb09-5668a7b9f59e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1374 microversion: 2.1 time: 0.370672 May 19 05:12:10.920619 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2900/5884] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:10 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1374 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:10.962452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d6006242-f77c-4718-88bc-75b757621caa tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:10.970983 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d6006242-f77c-4718-88bc-75b757621caa tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1608 microversion: 2.1 time: 0.452333 May 19 05:12:10.971580 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2985/5885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:10 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1608 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:10.988330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1f8b7d02-d76a-490e-9e1c-1142c4bf5fa6 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:10.989920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1f8b7d02-d76a-490e-9e1c-1142c4bf5fa6 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:10.997516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f8b7d02-d76a-490e-9e1c-1142c4bf5fa6 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:10.997971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f8b7d02-d76a-490e-9e1c-1142c4bf5fa6 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:10.998754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f8b7d02-d76a-490e-9e1c-1142c4bf5fa6 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:10.999367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f8b7d02-d76a-490e-9e1c-1142c4bf5fa6 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:11.172031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1f8b7d02-d76a-490e-9e1c-1142c4bf5fa6 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:11.183861 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1f8b7d02-d76a-490e-9e1c-1142c4bf5fa6 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1608 microversion: 2.1 time: 0.199305 May 19 05:12:11.184605 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2901/5886] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:10 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1608 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:11.938006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-898b146d-bfe7-440a-9e56-0d340158d1b8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:11.938631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-898b146d-bfe7-440a-9e56-0d340158d1b8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:11.945513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-898b146d-bfe7-440a-9e56-0d340158d1b8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:11.946278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-898b146d-bfe7-440a-9e56-0d340158d1b8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:11.947272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-898b146d-bfe7-440a-9e56-0d340158d1b8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:11.947952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-898b146d-bfe7-440a-9e56-0d340158d1b8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:12.320692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-898b146d-bfe7-440a-9e56-0d340158d1b8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:12.345645 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-898b146d-bfe7-440a-9e56-0d340158d1b8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1374 microversion: 2.1 time: 0.411976 May 19 05:12:12.346595 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2986/5887] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:11 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1374 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:13.363089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e264c8ce-ccf1-400e-82f9-7b7c26b3b20b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:13.365150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e264c8ce-ccf1-400e-82f9-7b7c26b3b20b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:13.367464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=47 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:13.372601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e264c8ce-ccf1-400e-82f9-7b7c26b3b20b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:13.373719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e264c8ce-ccf1-400e-82f9-7b7c26b3b20b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:13.374732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e264c8ce-ccf1-400e-82f9-7b7c26b3b20b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:13.375566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e264c8ce-ccf1-400e-82f9-7b7c26b3b20b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:13.611607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e264c8ce-ccf1-400e-82f9-7b7c26b3b20b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:13.622548 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e264c8ce-ccf1-400e-82f9-7b7c26b3b20b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1374 microversion: 2.1 time: 0.264616 May 19 05:12:13.624272 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2902/5888] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:13 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1374 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:13.925644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8f3ba495-33f9-4b87-ab91-a009b1d5400a req-94a464c8-a299-4911-98a3-326ca8600ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03c88f4-54ef-4d70-bfb0-a3e26ae78a28", "tag": "29ea09a9-9f89-4ae9-90df-6a6dba81782d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:13.936232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8f3ba495-33f9-4b87-ab91-a009b1d5400a req-94a464c8-a299-4911-98a3-326ca8600ce9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:13.936694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8f3ba495-33f9-4b87-ab91-a009b1d5400a req-94a464c8-a299-4911-98a3-326ca8600ce9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:13.949417 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8f3ba495-33f9-4b87-ab91-a009b1d5400a req-94a464c8-a299-4911-98a3-326ca8600ce9 service nova] Creating event network-changed:29ea09a9-9f89-4ae9-90df-6a6dba81782d for instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 on n-h1-766726-30 May 19 05:12:13.954658 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8f3ba495-33f9-4b87-ab91-a009b1d5400a req-94a464c8-a299-4911-98a3-326ca8600ce9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033302 May 19 05:12:13.955744 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2987/5889] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:12:14.641874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c694fab6-8d15-41ab-909f-b5d5d537497c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:14.643258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c694fab6-8d15-41ab-909f-b5d5d537497c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:14.657485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c694fab6-8d15-41ab-909f-b5d5d537497c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:14.664990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c694fab6-8d15-41ab-909f-b5d5d537497c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:14.666312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c694fab6-8d15-41ab-909f-b5d5d537497c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:14.667033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c694fab6-8d15-41ab-909f-b5d5d537497c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:14.952981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c694fab6-8d15-41ab-909f-b5d5d537497c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:14.961674 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c694fab6-8d15-41ab-909f-b5d5d537497c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1374 microversion: 2.1 time: 0.324435 May 19 05:12:14.962288 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2903/5890] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:14 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1374 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:15.980584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7308729-758f-4902-b278-f84ecb6fb3e8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:15.982002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b7308729-758f-4902-b278-f84ecb6fb3e8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:15.988627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7308729-758f-4902-b278-f84ecb6fb3e8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:15.989859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7308729-758f-4902-b278-f84ecb6fb3e8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:15.990864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7308729-758f-4902-b278-f84ecb6fb3e8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:15.991509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7308729-758f-4902-b278-f84ecb6fb3e8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:16.157112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b7308729-758f-4902-b278-f84ecb6fb3e8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:16.165917 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b7308729-758f-4902-b278-f84ecb6fb3e8 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1374 microversion: 2.1 time: 0.190518 May 19 05:12:16.168105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2988/5891] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:15 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:16.700251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-4eecdbff-ccb8-4474-93f7-5f3f88304a14 req-41a17478-345a-4023-aa3f-07a677baaef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5", "name": "network-vif-plugged", "status": "completed", "tag": "4f1514f5-73b7-4464-ad9f-f81dd2c3ee19"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:16.710179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4eecdbff-ccb8-4474-93f7-5f3f88304a14 req-41a17478-345a-4023-aa3f-07a677baaef3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:16.710814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-4eecdbff-ccb8-4474-93f7-5f3f88304a14 req-41a17478-345a-4023-aa3f-07a677baaef3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:16.736374 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-4eecdbff-ccb8-4474-93f7-5f3f88304a14 req-41a17478-345a-4023-aa3f-07a677baaef3 service nova] Creating event network-vif-plugged:4f1514f5-73b7-4464-ad9f-f81dd2c3ee19 for instance 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 on n-h2-766726-30 May 19 05:12:16.745639 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-4eecdbff-ccb8-4474-93f7-5f3f88304a14 req-41a17478-345a-4023-aa3f-07a677baaef3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049090 May 19 05:12:16.746630 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2904/5892] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:12:17.185233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82c7fdc3-c7c6-4578-a361-0bbe1091137e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:17.185850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82c7fdc3-c7c6-4578-a361-0bbe1091137e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:17.196327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:17.197519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=26 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:17.200210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c7fdc3-c7c6-4578-a361-0bbe1091137e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:17.202884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c7fdc3-c7c6-4578-a361-0bbe1091137e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:17.203874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c7fdc3-c7c6-4578-a361-0bbe1091137e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:17.205738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c7fdc3-c7c6-4578-a361-0bbe1091137e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:17.527847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82c7fdc3-c7c6-4578-a361-0bbe1091137e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:17.539915 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82c7fdc3-c7c6-4578-a361-0bbe1091137e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1374 microversion: 2.1 time: 0.358502 May 19 05:12:17.540940 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2989/5893] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:17 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1374 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:12:18.555616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:18.562985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d9bc3f58-dba1-45c8-831e-64df6bb38edc tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:18.565303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d9bc3f58-dba1-45c8-831e-64df6bb38edc tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:18.574744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9bc3f58-dba1-45c8-831e-64df6bb38edc tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:18.575677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9bc3f58-dba1-45c8-831e-64df6bb38edc tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:18.577036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9bc3f58-dba1-45c8-831e-64df6bb38edc tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:18.577967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d9bc3f58-dba1-45c8-831e-64df6bb38edc tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:18.776238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d9bc3f58-dba1-45c8-831e-64df6bb38edc tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:18.788918 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d9bc3f58-dba1-45c8-831e-64df6bb38edc tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1547 microversion: 2.1 time: 0.233987 May 19 05:12:18.789960 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2905/5894] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:18 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1547 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:18.809693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb2bbacc-f385-484e-8037-005379c79cb0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:18.811421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eb2bbacc-f385-484e-8037-005379c79cb0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:18.821947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb2bbacc-f385-484e-8037-005379c79cb0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:18.822814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb2bbacc-f385-484e-8037-005379c79cb0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:18.823873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb2bbacc-f385-484e-8037-005379c79cb0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:18.824507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb2bbacc-f385-484e-8037-005379c79cb0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:19.031927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eb2bbacc-f385-484e-8037-005379c79cb0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:19.041824 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eb2bbacc-f385-484e-8037-005379c79cb0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1547 microversion: 2.1 time: 0.237371 May 19 05:12:19.044041 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2990/5895] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:18 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1547 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:21.092946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-34af283a-ed82-4eee-9647-65940891d473 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:21.094117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-34af283a-ed82-4eee-9647-65940891d473 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:21.109238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34af283a-ed82-4eee-9647-65940891d473 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:21.109922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34af283a-ed82-4eee-9647-65940891d473 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:21.110896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34af283a-ed82-4eee-9647-65940891d473 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:21.111516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34af283a-ed82-4eee-9647-65940891d473 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:21.164030 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-34af283a-ed82-4eee-9647-65940891d473 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b/action" status: 200 len: 24568 microversion: 2.1 time: 0.075381 May 19 05:12:21.172869 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2906/5896] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:12:21 2022] POST /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b/action => generated 24568 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:12:32.046117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-07983d0e-8e17-4811-a77a-5ae2e87e5566 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:32.049648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-07983d0e-8e17-4811-a77a-5ae2e87e5566 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:32.050066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:32.050825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=33 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:32.059380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07983d0e-8e17-4811-a77a-5ae2e87e5566 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:32.060391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07983d0e-8e17-4811-a77a-5ae2e87e5566 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:32.062048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07983d0e-8e17-4811-a77a-5ae2e87e5566 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:32.062965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07983d0e-8e17-4811-a77a-5ae2e87e5566 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:32.312465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-07983d0e-8e17-4811-a77a-5ae2e87e5566 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:32.323535 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-07983d0e-8e17-4811-a77a-5ae2e87e5566 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1684 microversion: 2.1 time: 0.281398 May 19 05:12:32.348986 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2991/5897] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:32 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1684 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:32.463998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5f75e35a-4167-489a-a246-bf59d772b773 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:32.465037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5f75e35a-4167-489a-a246-bf59d772b773 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:32.467943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=9 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:32.468606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=38 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:32.482519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f75e35a-4167-489a-a246-bf59d772b773 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:32.482973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f75e35a-4167-489a-a246-bf59d772b773 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:32.487104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f75e35a-4167-489a-a246-bf59d772b773 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:32.487777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f75e35a-4167-489a-a246-bf59d772b773 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:32.573687 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5f75e35a-4167-489a-a246-bf59d772b773 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b/action" status: 200 len: 32632 microversion: 2.1 time: 0.114609 May 19 05:12:32.581527 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2907/5898] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:12:32 2022] POST /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b/action => generated 32632 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:12:32.748690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3ae5f9b-6fe0-4040-917b-ca67a75b039e tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:32.749657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e3ae5f9b-6fe0-4040-917b-ca67a75b039e tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:32.758533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3ae5f9b-6fe0-4040-917b-ca67a75b039e tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:32.759215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3ae5f9b-6fe0-4040-917b-ca67a75b039e tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:32.760320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3ae5f9b-6fe0-4040-917b-ca67a75b039e tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:32.760924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3ae5f9b-6fe0-4040-917b-ca67a75b039e tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:33.020153 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e3ae5f9b-6fe0-4040-917b-ca67a75b039e tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1837 microversion: 2.1 time: 0.280908 May 19 05:12:33.020873 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2992/5899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:32 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1837 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:33.044820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e4841b3d-4c1d-465c-b2cb-e49f741b45d4 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:33.050051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e4841b3d-4c1d-465c-b2cb-e49f741b45d4 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:33.059326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4841b3d-4c1d-465c-b2cb-e49f741b45d4 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:33.060032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4841b3d-4c1d-465c-b2cb-e49f741b45d4 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:33.061294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4841b3d-4c1d-465c-b2cb-e49f741b45d4 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:33.062029 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4841b3d-4c1d-465c-b2cb-e49f741b45d4 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:33.217683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-e4841b3d-4c1d-465c-b2cb-e49f741b45d4 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lazy-loading 'flavor' on Instance uuid 75a42fc8-6ec3-4919-b23b-baa4cd39222b {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:12:33.238755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e4841b3d-4c1d-465c-b2cb-e49f741b45d4 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Going to try to live migrate instance to another host {{(pid=124819) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 05:12:35.912647 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e4841b3d-4c1d-465c-b2cb-e49f741b45d4 tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b/action" status: 202 len: 0 microversion: 2.1 time: 2.877035 May 19 05:12:35.913895 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2908/5900] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:12:33 2022] POST /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b/action => generated 0 bytes in 2880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:12:35.925863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2aacab84-9e79-437a-9979-c873894f1fc8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:35.927183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2aacab84-9e79-437a-9979-c873894f1fc8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:35.954929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2aacab84-9e79-437a-9979-c873894f1fc8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:35.957794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2aacab84-9e79-437a-9979-c873894f1fc8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:35.959983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2aacab84-9e79-437a-9979-c873894f1fc8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:35.962111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2aacab84-9e79-437a-9979-c873894f1fc8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:36.225675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2aacab84-9e79-437a-9979-c873894f1fc8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:36.236214 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2aacab84-9e79-437a-9979-c873894f1fc8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1694 microversion: 2.1 time: 0.317707 May 19 05:12:36.248224 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2993/5901] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:35 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1694 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:12:37.254840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c187b60f-6585-4f46-8d72-31515b797a36 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:37.255396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c187b60f-6585-4f46-8d72-31515b797a36 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:37.267917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c187b60f-6585-4f46-8d72-31515b797a36 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:37.268384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c187b60f-6585-4f46-8d72-31515b797a36 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:37.269207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c187b60f-6585-4f46-8d72-31515b797a36 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:37.269658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c187b60f-6585-4f46-8d72-31515b797a36 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:37.675274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c187b60f-6585-4f46-8d72-31515b797a36 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:37.691756 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c187b60f-6585-4f46-8d72-31515b797a36 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1694 microversion: 2.1 time: 0.440870 May 19 05:12:37.694561 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2909/5902] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:37 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1694 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:38.340388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e59c8a64-7841-4b63-9b39-44cbc75eb65d req-b32a70ea-fc80-4e54-b55e-68f6b5eadd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a42fc8-6ec3-4919-b23b-baa4cd39222b", "name": "network-vif-unplugged", "status": "completed", "tag": "7678eb52-5ab0-4d56-96b8-4dadc1278e12"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:38.371342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e59c8a64-7841-4b63-9b39-44cbc75eb65d req-b32a70ea-fc80-4e54-b55e-68f6b5eadd99 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:38.372031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e59c8a64-7841-4b63-9b39-44cbc75eb65d req-b32a70ea-fc80-4e54-b55e-68f6b5eadd99 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:38.386062 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e59c8a64-7841-4b63-9b39-44cbc75eb65d req-b32a70ea-fc80-4e54-b55e-68f6b5eadd99 service nova] Creating event network-vif-unplugged:7678eb52-5ab0-4d56-96b8-4dadc1278e12 for instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b on n-h2-766726-30 May 19 05:12:38.392596 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e59c8a64-7841-4b63-9b39-44cbc75eb65d req-b32a70ea-fc80-4e54-b55e-68f6b5eadd99 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055331 May 19 05:12:38.393507 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2994/5903] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:12:38.715841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5cab15da-1259-4563-8a03-e46db6349443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:38.716840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5cab15da-1259-4563-8a03-e46db6349443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:38.731655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cab15da-1259-4563-8a03-e46db6349443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:38.732432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cab15da-1259-4563-8a03-e46db6349443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:38.733467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cab15da-1259-4563-8a03-e46db6349443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:38.734072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5cab15da-1259-4563-8a03-e46db6349443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:39.065768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5cab15da-1259-4563-8a03-e46db6349443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:39.078745 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5cab15da-1259-4563-8a03-e46db6349443 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1694 microversion: 2.1 time: 0.372720 May 19 05:12:39.091602 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2910/5904] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:38 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1694 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:40.101871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-46a7313f-4bca-464c-a9c1-c70d7b17705e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:40.103032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-46a7313f-4bca-464c-a9c1-c70d7b17705e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:40.111440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46a7313f-4bca-464c-a9c1-c70d7b17705e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:40.112045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46a7313f-4bca-464c-a9c1-c70d7b17705e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:40.112831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46a7313f-4bca-464c-a9c1-c70d7b17705e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:40.113300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-46a7313f-4bca-464c-a9c1-c70d7b17705e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:40.284214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-46a7313f-4bca-464c-a9c1-c70d7b17705e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:40.305995 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-46a7313f-4bca-464c-a9c1-c70d7b17705e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1694 microversion: 2.1 time: 0.210755 May 19 05:12:40.306764 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2995/5905] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:40 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:40.413533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e725a114-6d7d-474c-b5dc-47808389edc4 req-8355338b-1c28-4a71-a53b-6823f56c3eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a42fc8-6ec3-4919-b23b-baa4cd39222b", "tag": "7678eb52-5ab0-4d56-96b8-4dadc1278e12"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:40.434963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e725a114-6d7d-474c-b5dc-47808389edc4 req-8355338b-1c28-4a71-a53b-6823f56c3eae service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:40.435525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e725a114-6d7d-474c-b5dc-47808389edc4 req-8355338b-1c28-4a71-a53b-6823f56c3eae service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:40.457124 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e725a114-6d7d-474c-b5dc-47808389edc4 req-8355338b-1c28-4a71-a53b-6823f56c3eae service nova] Creating event network-changed:7678eb52-5ab0-4d56-96b8-4dadc1278e12 for instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b on n-h2-766726-30 May 19 05:12:40.467222 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e725a114-6d7d-474c-b5dc-47808389edc4 req-8355338b-1c28-4a71-a53b-6823f56c3eae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059406 May 19 05:12:40.468073 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2911/5906] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:12:41.323556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4ca1e25e-5573-4be3-bddb-ada37f442cdb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:41.324862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4ca1e25e-5573-4be3-bddb-ada37f442cdb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:41.334416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ca1e25e-5573-4be3-bddb-ada37f442cdb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:41.335154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ca1e25e-5573-4be3-bddb-ada37f442cdb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:41.336099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ca1e25e-5573-4be3-bddb-ada37f442cdb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:41.336694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4ca1e25e-5573-4be3-bddb-ada37f442cdb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:41.622091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4ca1e25e-5573-4be3-bddb-ada37f442cdb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:41.635865 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4ca1e25e-5573-4be3-bddb-ada37f442cdb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1694 microversion: 2.1 time: 0.316341 May 19 05:12:41.641310 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2996/5907] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:41 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1694 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:42.655588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a9afede1-815c-45ae-aa86-4260f8272fd3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:42.656504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a9afede1-815c-45ae-aa86-4260f8272fd3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:42.667818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9afede1-815c-45ae-aa86-4260f8272fd3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:42.668561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9afede1-815c-45ae-aa86-4260f8272fd3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:42.670825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9afede1-815c-45ae-aa86-4260f8272fd3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:42.671472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a9afede1-815c-45ae-aa86-4260f8272fd3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:42.898215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a9afede1-815c-45ae-aa86-4260f8272fd3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:42.906785 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a9afede1-815c-45ae-aa86-4260f8272fd3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1694 microversion: 2.1 time: 0.257746 May 19 05:12:42.917513 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2912/5908] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:42 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1694 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:43.924846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-189f8b5a-b169-4295-9419-f7f34845e6c7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:43.925700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-189f8b5a-b169-4295-9419-f7f34845e6c7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:43.939010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-189f8b5a-b169-4295-9419-f7f34845e6c7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:43.939472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-189f8b5a-b169-4295-9419-f7f34845e6c7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:43.940269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-189f8b5a-b169-4295-9419-f7f34845e6c7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:43.940711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-189f8b5a-b169-4295-9419-f7f34845e6c7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:44.257163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-189f8b5a-b169-4295-9419-f7f34845e6c7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:44.268012 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-189f8b5a-b169-4295-9419-f7f34845e6c7 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1694 microversion: 2.1 time: 0.347050 May 19 05:12:44.268829 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2997/5909] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:43 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1694 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:45.286107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8bbe069-a768-4f2a-b066-2d9bc8cb1a1e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:45.286744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8bbe069-a768-4f2a-b066-2d9bc8cb1a1e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:45.300282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8bbe069-a768-4f2a-b066-2d9bc8cb1a1e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:45.300751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8bbe069-a768-4f2a-b066-2d9bc8cb1a1e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:45.301585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8bbe069-a768-4f2a-b066-2d9bc8cb1a1e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:45.307177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8bbe069-a768-4f2a-b066-2d9bc8cb1a1e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:45.493900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1a005917-6089-42c6-be18-1a9f72ab4a1d req-88713df3-b57f-4c58-8a45-f838002d4103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a42fc8-6ec3-4919-b23b-baa4cd39222b", "name": "network-vif-unplugged", "status": "completed", "tag": "7678eb52-5ab0-4d56-96b8-4dadc1278e12"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:45.502727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1a005917-6089-42c6-be18-1a9f72ab4a1d req-88713df3-b57f-4c58-8a45-f838002d4103 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:45.503173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1a005917-6089-42c6-be18-1a9f72ab4a1d req-88713df3-b57f-4c58-8a45-f838002d4103 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:45.523708 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1a005917-6089-42c6-be18-1a9f72ab4a1d req-88713df3-b57f-4c58-8a45-f838002d4103 service nova] Creating event network-vif-unplugged:7678eb52-5ab0-4d56-96b8-4dadc1278e12 for instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b on n-h2-766726-30 May 19 05:12:45.559042 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1a005917-6089-42c6-be18-1a9f72ab4a1d req-88713df3-b57f-4c58-8a45-f838002d4103 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.332422 May 19 05:12:45.560243 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2913/5910] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:12:45.744438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e8bbe069-a768-4f2a-b066-2d9bc8cb1a1e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:45.761918 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8bbe069-a768-4f2a-b066-2d9bc8cb1a1e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1694 microversion: 2.1 time: 0.480075 May 19 05:12:45.772005 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2998/5911] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:45 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1694 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:46.780481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa6c3d3f-5997-484c-a534-e5e9c1387b34 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:46.782133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa6c3d3f-5997-484c-a534-e5e9c1387b34 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:46.796287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6c3d3f-5997-484c-a534-e5e9c1387b34 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:46.800713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6c3d3f-5997-484c-a534-e5e9c1387b34 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:46.802226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6c3d3f-5997-484c-a534-e5e9c1387b34 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:46.811194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6c3d3f-5997-484c-a534-e5e9c1387b34 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:47.186580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fa6c3d3f-5997-484c-a534-e5e9c1387b34 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:47.203557 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fa6c3d3f-5997-484c-a534-e5e9c1387b34 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1694 microversion: 2.1 time: 0.428016 May 19 05:12:47.206748 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2914/5912] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:46 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1694 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:48.223342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e94aacdb-a63f-4b1e-bd72-8ee6f03e85fc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:48.225356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e94aacdb-a63f-4b1e-bd72-8ee6f03e85fc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:48.242783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e94aacdb-a63f-4b1e-bd72-8ee6f03e85fc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:48.246178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e94aacdb-a63f-4b1e-bd72-8ee6f03e85fc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:48.247383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e94aacdb-a63f-4b1e-bd72-8ee6f03e85fc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:48.250397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e94aacdb-a63f-4b1e-bd72-8ee6f03e85fc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:49.203972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e94aacdb-a63f-4b1e-bd72-8ee6f03e85fc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:49.213238 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e94aacdb-a63f-4b1e-bd72-8ee6f03e85fc tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1684 microversion: 2.1 time: 0.995227 May 19 05:12:49.214072 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 2999/5913] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:48 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1684 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:49.235386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1f8ab02a-82a5-48a4-91a0-dc61d9b2a6ce tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:49.236635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1f8ab02a-82a5-48a4-91a0-dc61d9b2a6ce tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:49.248842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f8ab02a-82a5-48a4-91a0-dc61d9b2a6ce tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:49.249580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f8ab02a-82a5-48a4-91a0-dc61d9b2a6ce tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:49.252030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f8ab02a-82a5-48a4-91a0-dc61d9b2a6ce tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:49.253947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f8ab02a-82a5-48a4-91a0-dc61d9b2a6ce tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:49.526138 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1f8ab02a-82a5-48a4-91a0-dc61d9b2a6ce tempest-TestNetworkAdvancedServerOps-985134108 tempest-TestNetworkAdvancedServerOps-985134108-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1837 microversion: 2.1 time: 0.292729 May 19 05:12:49.528532 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2915/5914] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:49 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1837 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:49.545656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e7b58979-14eb-4fff-afee-70af1a3365ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:49.547676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e7b58979-14eb-4fff-afee-70af1a3365ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:49.561185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7b58979-14eb-4fff-afee-70af1a3365ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:49.567682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7b58979-14eb-4fff-afee-70af1a3365ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:49.569625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7b58979-14eb-4fff-afee-70af1a3365ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:49.570264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e7b58979-14eb-4fff-afee-70af1a3365ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:49.669398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6a97a525-5f43-4164-b1a4-3ee23e96ee43 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:49.671603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6a97a525-5f43-4164-b1a4-3ee23e96ee43 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:49.687828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a97a525-5f43-4164-b1a4-3ee23e96ee43 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:49.688286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a97a525-5f43-4164-b1a4-3ee23e96ee43 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:49.690865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a97a525-5f43-4164-b1a4-3ee23e96ee43 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:49.692653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a97a525-5f43-4164-b1a4-3ee23e96ee43 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:49.755670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6a97a525-5f43-4164-b1a4-3ee23e96ee43 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:12:49.933968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e7b58979-14eb-4fff-afee-70af1a3365ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:49.952132 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e7b58979-14eb-4fff-afee-70af1a3365ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1684 microversion: 2.1 time: 0.411003 May 19 05:12:49.954409 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3000/5915] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:49 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1684 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:50.020016 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6a97a525-5f43-4164-b1a4-3ee23e96ee43 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 204 len: 0 microversion: 2.1 time: 0.363732 May 19 05:12:50.020702 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2916/5916] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:12:49 2022] DELETE /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 05:12:50.030952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f14f6934-d133-452a-a247-4f2431f524a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:50.032645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f14f6934-d133-452a-a247-4f2431f524a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:50.044104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f14f6934-d133-452a-a247-4f2431f524a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:50.044941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f14f6934-d133-452a-a247-4f2431f524a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:50.046438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f14f6934-d133-452a-a247-4f2431f524a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:50.047107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f14f6934-d133-452a-a247-4f2431f524a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:50.227891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f14f6934-d133-452a-a247-4f2431f524a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:50.237103 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f14f6934-d133-452a-a247-4f2431f524a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1553 microversion: 2.1 time: 0.210935 May 19 05:12:50.249217 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3001/5917] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:50 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:51.257857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5da7807a-6e3d-46cb-8d8f-f570dc54635b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:51.258553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5da7807a-6e3d-46cb-8d8f-f570dc54635b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:51.274467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5da7807a-6e3d-46cb-8d8f-f570dc54635b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:51.275187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5da7807a-6e3d-46cb-8d8f-f570dc54635b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:51.277520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5da7807a-6e3d-46cb-8d8f-f570dc54635b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:51.278237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5da7807a-6e3d-46cb-8d8f-f570dc54635b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:51.298025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-83cadd50-bf7a-45db-9b5d-86ab1e48cafc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:51.299177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-83cadd50-bf7a-45db-9b5d-86ab1e48cafc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:51.315563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83cadd50-bf7a-45db-9b5d-86ab1e48cafc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:51.316466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83cadd50-bf7a-45db-9b5d-86ab1e48cafc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:51.317713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83cadd50-bf7a-45db-9b5d-86ab1e48cafc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:51.318309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-83cadd50-bf7a-45db-9b5d-86ab1e48cafc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:51.409923 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-83cadd50-bf7a-45db-9b5d-86ab1e48cafc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.115098 May 19 05:12:51.411285 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3002/5918] 10.222.0.58 () {58 vars in 1292 bytes} [Thu May 19 05:12:51 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28/os-server-password => generated 116 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:12:51.771165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5da7807a-6e3d-46cb-8d8f-f570dc54635b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:51.785755 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5da7807a-6e3d-46cb-8d8f-f570dc54635b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1553 microversion: 2.1 time: 0.532397 May 19 05:12:51.787931 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2917/5919] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:51 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1553 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:52.127011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4d82bd58-8cc7-4307-909e-4d12ff0c1fb8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:52.129758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4d82bd58-8cc7-4307-909e-4d12ff0c1fb8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:52.146902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d82bd58-8cc7-4307-909e-4d12ff0c1fb8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:52.147543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d82bd58-8cc7-4307-909e-4d12ff0c1fb8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:52.148534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d82bd58-8cc7-4307-909e-4d12ff0c1fb8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:52.152016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d82bd58-8cc7-4307-909e-4d12ff0c1fb8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:52.227541 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4d82bd58-8cc7-4307-909e-4d12ff0c1fb8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b/action" status: 200 len: 38676 microversion: 2.1 time: 0.104355 May 19 05:12:52.235488 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3003/5920] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:12:52 2022] POST /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b/action => generated 38676 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:12:52.461967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d48e7e0e-0f68-4716-96af-98c574207fd5 req-69e34119-8b8e-4bd7-a7f0-8c87ed85e30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5", "name": "network-vif-deleted", "tag": "4f1514f5-73b7-4464-ad9f-f81dd2c3ee19"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:52.487212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d48e7e0e-0f68-4716-96af-98c574207fd5 req-69e34119-8b8e-4bd7-a7f0-8c87ed85e30e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:52.487670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d48e7e0e-0f68-4716-96af-98c574207fd5 req-69e34119-8b8e-4bd7-a7f0-8c87ed85e30e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:52.513666 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d48e7e0e-0f68-4716-96af-98c574207fd5 req-69e34119-8b8e-4bd7-a7f0-8c87ed85e30e service nova] Creating event network-vif-deleted:4f1514f5-73b7-4464-ad9f-f81dd2c3ee19 for instance 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 on n-h2-766726-30 May 19 05:12:52.543436 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d48e7e0e-0f68-4716-96af-98c574207fd5 req-69e34119-8b8e-4bd7-a7f0-8c87ed85e30e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091245 May 19 05:12:52.543988 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2918/5921] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 19 05:12:52.805958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:52.807296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:52.857511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:52.860764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:52.862001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:52.862630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:52.910048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:52.910683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:52.911237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lazy-loading 'fault' on Instance uuid 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:12:52.996223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:53.009881 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a67244fd-54a6-405d-977c-7333f76fd36b tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 200 len: 1338 microversion: 2.1 time: 0.208847 May 19 05:12:53.012297 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3004/5922] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:52 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 1338 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:54.036342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:54.037731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:54.055880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:54.056554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:54.057418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:54.061282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:54.094311 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] HTTP exception thrown: Instance 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 could not be found. May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Request method failure captured: May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 HTTP/1.1 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdFZR2hH4xVO4SsV0HNaPNxDJTWGLsBVZRFR_0Ye_aCNViAunh1p814jjZ4hiBgPGBF06mgOWY8DyloPd936OL3oVqPPAZi9Yv4i-3nHprpNzBJHwSE4JLhPVAh2Rqt5LIALM5kniW5fq3t5K6Y0wwNLLkrrZM2dO0Q_OLzfFPTT7Vo May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fc642d868cb74f45b8df137d93a42e07 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestNetworkBasicOps-939864809 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestNetworkBasicOps-939864809 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fc642d868cb74f45b8df137d93a42e07 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestNetworkBasicOps-939864809 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestNetworkBasicOps-939864809-project May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 21be8a1f15ac40c7851356be4dc2ce32 May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestNetworkBasicOps-939864809-project May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 could not be found. May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5'} May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 could not be found. May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 could not be found. May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:12:54.104268 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:12:54.111832 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:12:54.111832 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:12:54.111832 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:12:54.111832 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:12:54.111832 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:12:54.111832 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 could not be found. May 19 05:12:54.111832 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:12:54.124792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Returning 404 to user: Instance 08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:12:54.126516 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e1039eae-61cc-4bfb-8329-3509130575ab tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5" status: 404 len: 111 microversion: 2.1 time: 0.101746 May 19 05:12:54.157637 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2919/5923] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:54 2022] GET /compute/v2.1/servers/08f3d2b9-3bde-4a8b-b6fc-c93d085ab8c5 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:12:54.474552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-17bc1d65-41f3-4039-bdf3-2d9bde2107d5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '.version_select at 0x7fd315eac700>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:54.520051 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-17bc1d65-41f3-4039-bdf3-2d9bde2107d5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2024952480" status: 202 len: 0 microversion: 2.1 time: 0.051269 May 19 05:12:54.522124 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3005/5924] 10.222.0.58 () {58 vars in 1256 bytes} [Thu May 19 05:12:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2024952480 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:12:55.025760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-700b18d8-07c7-45f4-bc9d-23f5300de046 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:55.026788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-700b18d8-07c7-45f4-bc9d-23f5300de046 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:55.042900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-700b18d8-07c7-45f4-bc9d-23f5300de046 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:55.043551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-700b18d8-07c7-45f4-bc9d-23f5300de046 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:55.055552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-700b18d8-07c7-45f4-bc9d-23f5300de046 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:55.056227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-700b18d8-07c7-45f4-bc9d-23f5300de046 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:55.077987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-377daadd-27d8-4cc2-9f24-20ed878d9d41 req-108abca6-51e8-417f-a670-d51c645ab23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a42fc8-6ec3-4919-b23b-baa4cd39222b", "tag": "7678eb52-5ab0-4d56-96b8-4dadc1278e12"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:55.098725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-377daadd-27d8-4cc2-9f24-20ed878d9d41 req-108abca6-51e8-417f-a670-d51c645ab23d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:55.101556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-377daadd-27d8-4cc2-9f24-20ed878d9d41 req-108abca6-51e8-417f-a670-d51c645ab23d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:55.132292 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-377daadd-27d8-4cc2-9f24-20ed878d9d41 req-108abca6-51e8-417f-a670-d51c645ab23d service nova] Creating event network-changed:7678eb52-5ab0-4d56-96b8-4dadc1278e12 for instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b on n-h1-766726-30 May 19 05:12:55.136246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-700b18d8-07c7-45f4-bc9d-23f5300de046 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:12:55.152882 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-377daadd-27d8-4cc2-9f24-20ed878d9d41 req-108abca6-51e8-417f-a670-d51c645ab23d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087883 May 19 05:12:55.158560 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3006/5925] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:12:55.465641 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-700b18d8-07c7-45f4-bc9d-23f5300de046 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "DELETE /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 204 len: 0 microversion: 2.1 time: 0.443982 May 19 05:12:55.468431 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2920/5926] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:12:55 2022] DELETE /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:12:55.478188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cb9a80b6-f24d-4ca9-8f18-144150a6e394 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:55.479091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cb9a80b6-f24d-4ca9-8f18-144150a6e394 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:55.498166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb9a80b6-f24d-4ca9-8f18-144150a6e394 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:55.498883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb9a80b6-f24d-4ca9-8f18-144150a6e394 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:55.499797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb9a80b6-f24d-4ca9-8f18-144150a6e394 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:55.503356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cb9a80b6-f24d-4ca9-8f18-144150a6e394 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:56.454529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cb9a80b6-f24d-4ca9-8f18-144150a6e394 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:56.466176 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cb9a80b6-f24d-4ca9-8f18-144150a6e394 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1690 microversion: 2.1 time: 0.992576 May 19 05:12:56.466708 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3007/5927] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:55 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1690 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:57.484423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5999226-944d-4365-9753-3c8d8b31b682 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:57.488354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e5999226-944d-4365-9753-3c8d8b31b682 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:57.529109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5999226-944d-4365-9753-3c8d8b31b682 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:57.531624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5999226-944d-4365-9753-3c8d8b31b682 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:57.535004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5999226-944d-4365-9753-3c8d8b31b682 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:57.536392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5999226-944d-4365-9753-3c8d8b31b682 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:57.623680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:12:57.676822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-017bcab5-3378-438d-95ce-5399e246ee50 req-ac504f4c-17da-4bba-bd6d-1e3239e1e83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a42fc8-6ec3-4919-b23b-baa4cd39222b", "name": "network-vif-deleted", "tag": "7678eb52-5ab0-4d56-96b8-4dadc1278e12"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:57.715374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-017bcab5-3378-438d-95ce-5399e246ee50 req-ac504f4c-17da-4bba-bd6d-1e3239e1e83f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:57.718091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-017bcab5-3378-438d-95ce-5399e246ee50 req-ac504f4c-17da-4bba-bd6d-1e3239e1e83f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:57.779881 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-017bcab5-3378-438d-95ce-5399e246ee50 req-ac504f4c-17da-4bba-bd6d-1e3239e1e83f service nova] Creating event network-vif-deleted:7678eb52-5ab0-4d56-96b8-4dadc1278e12 for instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b on n-h1-766726-30 May 19 05:12:57.792914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-017bcab5-3378-438d-95ce-5399e246ee50 req-ac504f4c-17da-4bba-bd6d-1e3239e1e83f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121123 May 19 05:12:57.797634 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3008/5928] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:12:57.872053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e5999226-944d-4365-9753-3c8d8b31b682 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:12:57.882550 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e5999226-944d-4365-9753-3c8d8b31b682 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 200 len: 1503 microversion: 2.1 time: 0.402288 May 19 05:12:57.886133 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2921/5929] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:57 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 1503 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:12:58.904430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:58.905843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: 75a42fc8-6ec3-4919-b23b-baa4cd39222b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:58.916288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:58.916955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:58.917929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:58.918538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:58.936049 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] HTTP exception thrown: Instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b could not be found. May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Request method failure captured: May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b HTTP/1.1 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdBO1QaW5oc4f6Vrz9_NwPhOHXbWiDxmYrQKBdrJO1vjGvboRoh4Us4Qrl0niQvSpcbSKRZNOYd3wYZZ01n2S0A2Bcn-Shs64HIMUTvoCt-SNOaQMD9yf8DNih5M2vO7lT6UGNcxHOrZVfsf9K5fDqo0Bx0-_bGZxsamgPJQjmNVycw May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 3105ae3b914f4ac8a2a5466915fba229 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 3105ae3b914f4ac8a2a5466915fba229 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestNetworkAdvancedServerOps-1985069588-project May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 195b7b4b7d384374ac86bdeaf7568026 May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1985069588-project May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b could not be found. May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '75a42fc8-6ec3-4919-b23b-baa4cd39222b'} May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b could not be found. May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b could not be found. May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:12:58.937857 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b could not be found. May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Returning 404 to user: Instance 75a42fc8-6ec3-4919-b23b-baa4cd39222b could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7554f228-70d7-431b-b419-8edb0d040d08 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b" status: 404 len: 111 microversion: 2.1 time: 0.040375 May 19 05:12:58.942126 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3009/5930] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:58 2022] GET /compute/v2.1/servers/75a42fc8-6ec3-4919-b23b-baa4cd39222b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:12:59.220264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c6a78037-c39d-4b0b-af6c-9abc0f47baf7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:59.221015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c6a78037-c39d-4b0b-af6c-9abc0f47baf7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:59.238876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6a78037-c39d-4b0b-af6c-9abc0f47baf7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:59.239325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6a78037-c39d-4b0b-af6c-9abc0f47baf7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:59.242633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6a78037-c39d-4b0b-af6c-9abc0f47baf7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:59.250087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-538959cc-c67d-40b7-b234-05258d50af08 req-56bb6ae4-fac1-4211-b62e-dc09271fbd0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cd701d-be6a-44ee-81f6-d4135e49b250", "tag": "8bea8c46-47a9-4a2d-ba61-98e6b9a868f7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:12:59.251517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c6a78037-c39d-4b0b-af6c-9abc0f47baf7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:59.276614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-538959cc-c67d-40b7-b234-05258d50af08 req-56bb6ae4-fac1-4211-b62e-dc09271fbd0f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:59.277320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-538959cc-c67d-40b7-b234-05258d50af08 req-56bb6ae4-fac1-4211-b62e-dc09271fbd0f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:59.326880 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-538959cc-c67d-40b7-b234-05258d50af08 req-56bb6ae4-fac1-4211-b62e-dc09271fbd0f service nova] Creating event network-changed:8bea8c46-47a9-4a2d-ba61-98e6b9a868f7 for instance 45cd701d-be6a-44ee-81f6-d4135e49b250 on n-h1-766726-30 May 19 05:12:59.345745 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-538959cc-c67d-40b7-b234-05258d50af08 req-56bb6ae4-fac1-4211-b62e-dc09271fbd0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099543 May 19 05:12:59.373895 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3010/5931] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:12:59.421066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c6a78037-c39d-4b0b-af6c-9abc0f47baf7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:12:59.790358 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c6a78037-c39d-4b0b-af6c-9abc0f47baf7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 204 len: 0 microversion: 2.1 time: 0.574814 May 19 05:12:59.791974 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2922/5932] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:12:59 2022] DELETE /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:12:59.825795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-531ebaf9-8e1d-4394-bde0-c6a0611ba369 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:12:59.828779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-531ebaf9-8e1d-4394-bde0-c6a0611ba369 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:12:59.861009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-531ebaf9-8e1d-4394-bde0-c6a0611ba369 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:59.861498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-531ebaf9-8e1d-4394-bde0-c6a0611ba369 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:12:59.873440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-531ebaf9-8e1d-4394-bde0-c6a0611ba369 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:12:59.876664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-531ebaf9-8e1d-4394-bde0-c6a0611ba369 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:00.203322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-531ebaf9-8e1d-4394-bde0-c6a0611ba369 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:00.212355 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-531ebaf9-8e1d-4394-bde0-c6a0611ba369 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1669 microversion: 2.1 time: 0.412097 May 19 05:13:00.229387 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3011/5933] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:12:59 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1669 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:01.263594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4876858-685f-412f-943f-b2544c94edad tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:01.265700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4876858-685f-412f-943f-b2544c94edad tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:01.291786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4876858-685f-412f-943f-b2544c94edad tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:01.293443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4876858-685f-412f-943f-b2544c94edad tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:01.298621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4876858-685f-412f-943f-b2544c94edad tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:01.300588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4876858-685f-412f-943f-b2544c94edad tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:02.057889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a4876858-685f-412f-943f-b2544c94edad tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:02.077318 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4876858-685f-412f-943f-b2544c94edad tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1669 microversion: 2.1 time: 0.831114 May 19 05:13:02.089544 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2923/5934] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:01 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1669 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:02.605876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-eadb161a-96c4-4f00-90be-eba53b83f16f req-cbbc58c8-880c-4562-9300-4c097fa375a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cd701d-be6a-44ee-81f6-d4135e49b250", "name": "network-vif-deleted", "tag": "8bea8c46-47a9-4a2d-ba61-98e6b9a868f7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:02.631233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:02.642966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-eadb161a-96c4-4f00-90be-eba53b83f16f req-cbbc58c8-880c-4562-9300-4c097fa375a1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:02.643436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-eadb161a-96c4-4f00-90be-eba53b83f16f req-cbbc58c8-880c-4562-9300-4c097fa375a1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:02.674900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=99 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:02.678262 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-eadb161a-96c4-4f00-90be-eba53b83f16f req-cbbc58c8-880c-4562-9300-4c097fa375a1 service nova] Creating event network-vif-deleted:8bea8c46-47a9-4a2d-ba61-98e6b9a868f7 for instance 45cd701d-be6a-44ee-81f6-d4135e49b250 on n-h1-766726-30 May 19 05:13:02.689659 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-eadb161a-96c4-4f00-90be-eba53b83f16f req-cbbc58c8-880c-4562-9300-4c097fa375a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089735 May 19 05:13:02.691318 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3012/5935] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:13:03.109772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:03.110371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:03.122784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:03.124836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:03.125497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:03.130186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:03.130840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:03.288136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:03.292831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:03.293578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lazy-loading 'fault' on Instance uuid 45cd701d-be6a-44ee-81f6-d4135e49b250 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:13:03.433772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:03.443356 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e925fac5-55b5-4850-8c24-c7a56b0625ae tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 200 len: 1337 microversion: 2.1 time: 0.337502 May 19 05:13:03.454154 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2924/5936] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:03 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 1337 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:04.462256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:04.463542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 45cd701d-be6a-44ee-81f6-d4135e49b250] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:04.473355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:04.473861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:04.474582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:04.477483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:04.528570 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] HTTP exception thrown: Instance 45cd701d-be6a-44ee-81f6-d4135e49b250 could not be found. May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Request method failure captured: May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 HTTP/1.1 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdFZR2hH4xVO4SsV0HNaPNxDJTWGLsBVZRFR_0Ye_aCNViAunh1p814jjZ4hiBgPGBF06mgOWY8DyloPd936OL3oVqPPAZi9Yv4i-3nHprpNzBJHwSE4JLhPVAh2Rqt5LIALM5kniW5fq3t5K6Y0wwNLLkrrZM2dO0Q_OLzfFPTT7Vo May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: fc642d868cb74f45b8df137d93a42e07 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestNetworkBasicOps-939864809 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestNetworkBasicOps-939864809 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: fc642d868cb74f45b8df137d93a42e07 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestNetworkBasicOps-939864809 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestNetworkBasicOps-939864809-project May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 21be8a1f15ac40c7851356be4dc2ce32 May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestNetworkBasicOps-939864809-project May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 45cd701d-be6a-44ee-81f6-d4135e49b250 could not be found. May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '45cd701d-be6a-44ee-81f6-d4135e49b250'} May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cd701d-be6a-44ee-81f6-d4135e49b250 could not be found. May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cd701d-be6a-44ee-81f6-d4135e49b250 could not be found. May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:13:04.534843 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:13:04.539803 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:13:04.539803 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:13:04.539803 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:13:04.539803 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:13:04.539803 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:13:04.539803 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cd701d-be6a-44ee-81f6-d4135e49b250 could not be found. May 19 05:13:04.539803 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:13:04.543741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Returning 404 to user: Instance 45cd701d-be6a-44ee-81f6-d4135e49b250 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:13:04.546420 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-678f057a-7a89-4338-a027-c276e5f61b5d tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250" status: 404 len: 111 microversion: 2.1 time: 0.089538 May 19 05:13:04.550030 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3013/5937] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:04 2022] GET /compute/v2.1/servers/45cd701d-be6a-44ee-81f6-d4135e49b250 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:13:04.880732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69e1344c-87ee-4791-81e2-67a879d710f7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '.version_select at 0x7fd314387a60>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:04.926296 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69e1344c-87ee-4791-81e2-67a879d710f7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-819768404" status: 202 len: 0 microversion: 2.1 time: 0.049880 May 19 05:13:04.928000 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2925/5938] 10.222.0.58 () {58 vars in 1253 bytes} [Thu May 19 05:13:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-819768404 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:13:06.200819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e450f47-4b36-4d8b-9a2a-0397f9a527e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '.version_select at 0x7fd315be8280>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:06.233671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e450f47-4b36-4d8b-9a2a-0397f9a527e9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1753800215" status: 202 len: 0 microversion: 2.1 time: 0.036926 May 19 05:13:06.235220 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3014/5939] 10.222.0.58 () {58 vars in 1283 bytes} [Thu May 19 05:13:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1753800215 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:13:06.264437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-647fdc20-06da-4415-9997-eaee1d048e99 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'create', calling method: .version_select at 0x7fd315a9edc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-604918559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvDpXC9hTDdJbSdNDd0GIAyjoj/qwn26lLzzmL8DeFJTHdxVAzXOJUDp4K7Gd7jesRq4Uxg4xQyRcNlGyrfEbxggu4OoB0ypXpdNbvMfVixH6/v0ABKrzxiHrbR5ELtDg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:06.282982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-647fdc20-06da-4415-9997-eaee1d048e99 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:13:06.290732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-647fdc20-06da-4415-9997-eaee1d048e99 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for user 195b7b4b7d384374ac86bdeaf7568026 and project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:13:06.339666 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-647fdc20-06da-4415-9997-eaee1d048e99 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.080349 May 19 05:13:06.341352 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2926/5940] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:13:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:13:17.724345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:17.725919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:17.730396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-89522937", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "25cb2ec6-bb73-4a53-bf7d-c1ea5c3de648"}], "key_name": "tempest-TestNetworkAdvancedServerOps-604918559", "security_groups": [{"name": "tempest-secgroup-smoke-1916446124"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:18.074022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] validate_networks() for [('25cb2ec6-bb73-4a53-bf7d-c1ea5c3de648', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:13:19.789683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:13:19.790333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:13:19.791032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:13:19.791822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:13:19.792493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:13:19.808840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:19.811571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:19.816045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:19.816864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:19.863351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:13:19.880690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Getting quotas for user 195b7b4b7d384374ac86bdeaf7568026 and project 3105ae3b914f4ac8a2a5466915fba229. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:13:19.908047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:13:19.914315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:13:20.040838 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-36dfcf1b-c185-4680-a181-5be081d0cc0a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.320772 May 19 05:13:20.044892 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3015/5941] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:13:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:13:20.056099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b06e882-a432-406d-a6b1-f97f83cef4a8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:20.057503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b06e882-a432-406d-a6b1-f97f83cef4a8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:20.060520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:20.063481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:20.064873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:20.183922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b06e882-a432-406d-a6b1-f97f83cef4a8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:20.191659 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b06e882-a432-406d-a6b1-f97f83cef4a8 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1264 microversion: 2.1 time: 0.141049 May 19 05:13:20.199172 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2927/5942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:20 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:21.216354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c7661171-8eba-4113-b8ee-1aeb992e62ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:21.217596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c7661171-8eba-4113-b8ee-1aeb992e62ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:21.243780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7661171-8eba-4113-b8ee-1aeb992e62ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:21.244237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7661171-8eba-4113-b8ee-1aeb992e62ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:21.249449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7661171-8eba-4113-b8ee-1aeb992e62ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:21.249903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7661171-8eba-4113-b8ee-1aeb992e62ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:21.275569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-586b44b2-7ac1-48b6-856a-baed0cb8ec17 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Action: 'create', calling method: .version_select at 0x7fd31479dc10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2123729745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFBSqSQRAP747QIkSOOiO7soX+yhFiPCu6b51kDWuOysdHt6IkDF16lEhpl9jhjUaNjN8B6b1mkEk8P6MsDr6bA/YZGi80i5y5mC7Mxo8B/E7t8AoLgRjW9+Cshc9fNng=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:21.337181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-586b44b2-7ac1-48b6-856a-baed0cb8ec17 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for project fc642d868cb74f45b8df137d93a42e07. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:13:21.354296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-586b44b2-7ac1-48b6-856a-baed0cb8ec17 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for user 21be8a1f15ac40c7851356be4dc2ce32 and project fc642d868cb74f45b8df137d93a42e07. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:13:21.374080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c7661171-8eba-4113-b8ee-1aeb992e62ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:21.386740 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c7661171-8eba-4113-b8ee-1aeb992e62ef tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1260 microversion: 2.1 time: 0.174229 May 19 05:13:21.398751 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3016/5943] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:21 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:21.425594 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-586b44b2-7ac1-48b6-856a-baed0cb8ec17 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.154804 May 19 05:13:21.431752 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2928/5944] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:13:21 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:13:22.407496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f7f37eb-568a-4d43-9464-2af6caeb24f9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:22.411029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f7f37eb-568a-4d43-9464-2af6caeb24f9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:22.453988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7f37eb-568a-4d43-9464-2af6caeb24f9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:22.458320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7f37eb-568a-4d43-9464-2af6caeb24f9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:22.462101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7f37eb-568a-4d43-9464-2af6caeb24f9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:22.463428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7f37eb-568a-4d43-9464-2af6caeb24f9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:22.642955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0f7f37eb-568a-4d43-9464-2af6caeb24f9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:22.652254 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f7f37eb-568a-4d43-9464-2af6caeb24f9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1322 microversion: 2.1 time: 0.249233 May 19 05:13:22.657468 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3017/5945] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:22 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:23.676063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5088b785-8828-4bb1-84e4-63e6d6a46bd9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:23.676697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5088b785-8828-4bb1-84e4-63e6d6a46bd9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:23.694975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5088b785-8828-4bb1-84e4-63e6d6a46bd9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:23.695442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5088b785-8828-4bb1-84e4-63e6d6a46bd9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:23.696256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5088b785-8828-4bb1-84e4-63e6d6a46bd9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:23.696699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5088b785-8828-4bb1-84e4-63e6d6a46bd9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:23.921496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5088b785-8828-4bb1-84e4-63e6d6a46bd9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:23.935686 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5088b785-8828-4bb1-84e4-63e6d6a46bd9 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1322 microversion: 2.1 time: 0.264745 May 19 05:13:23.953249 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2929/5946] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:23 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:24.138451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-137746182", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "d139990d-bada-4c3f-8f66-c6f21dbe3869"}], "key_name": "tempest-TestNetworkBasicOps-2123729745", "security_groups": [{"name": "tempest-secgroup-smoke-1927069833"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:24.415466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] validate_networks() for [('d139990d-bada-4c3f-8f66-c6f21dbe3869', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:13:24.951779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-757ea525-6618-4553-8b71-ec76c3fd3fb1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:24.952405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-757ea525-6618-4553-8b71-ec76c3fd3fb1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:24.982718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-757ea525-6618-4553-8b71-ec76c3fd3fb1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:24.983168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-757ea525-6618-4553-8b71-ec76c3fd3fb1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:24.984298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-757ea525-6618-4553-8b71-ec76c3fd3fb1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:24.984734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-757ea525-6618-4553-8b71-ec76c3fd3fb1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:25.386521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-757ea525-6618-4553-8b71-ec76c3fd3fb1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:25.396028 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-757ea525-6618-4553-8b71-ec76c3fd3fb1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1390 microversion: 2.1 time: 0.448101 May 19 05:13:25.402896 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2930/5947] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:24 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1390 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:13:25.767966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:13:25.768995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:13:25.769721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:13:25.770292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:13:25.770885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:13:25.792428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:25.794842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:25.797728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:25.799541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:25.859727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for project fc642d868cb74f45b8df137d93a42e07. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:13:25.875959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Getting quotas for user 21be8a1f15ac40c7851356be4dc2ce32 and project fc642d868cb74f45b8df137d93a42e07. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:13:25.914173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:13:25.916437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:13:26.023447 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47cb5db2-212b-43d7-8742-8e967855d2d0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.886743 May 19 05:13:26.025949 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3018/5948] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:13:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:13:26.034371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9bfe0361-61fe-45b9-b4c2-a6a97694d8e6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:26.035238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9bfe0361-61fe-45b9-b4c2-a6a97694d8e6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:26.421560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8b3a10d-b2fc-4927-be72-e7db04c055c1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:26.422498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8b3a10d-b2fc-4927-be72-e7db04c055c1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:26.439328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8b3a10d-b2fc-4927-be72-e7db04c055c1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:26.440064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8b3a10d-b2fc-4927-be72-e7db04c055c1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:26.443609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8b3a10d-b2fc-4927-be72-e7db04c055c1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:26.445830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8b3a10d-b2fc-4927-be72-e7db04c055c1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:27.164077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9bfe0361-61fe-45b9-b4c2-a6a97694d8e6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:27.177042 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9bfe0361-61fe-45b9-b4c2-a6a97694d8e6 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1248 microversion: 2.1 time: 1.146689 May 19 05:13:27.181268 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2931/5949] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:26 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1248 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:27.433622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8b3a10d-b2fc-4927-be72-e7db04c055c1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:27.447906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8b3a10d-b2fc-4927-be72-e7db04c055c1 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1390 microversion: 2.1 time: 1.031324 May 19 05:13:27.461405 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3019/5950] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:26 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1390 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:13:27.641701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a3276ddf-9fa9-49cd-a12d-ed15b041328a req-02b32136-48e6-4ddc-a1c5-0d8fb8251c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1345188-9717-403c-8337-5fa23c2cbcf2", "tag": "448dce41-f2fc-428b-b3eb-d9445e06f8dd"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:27.657049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a3276ddf-9fa9-49cd-a12d-ed15b041328a req-02b32136-48e6-4ddc-a1c5-0d8fb8251c36 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:27.669842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a3276ddf-9fa9-49cd-a12d-ed15b041328a req-02b32136-48e6-4ddc-a1c5-0d8fb8251c36 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:27.723610 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a3276ddf-9fa9-49cd-a12d-ed15b041328a req-02b32136-48e6-4ddc-a1c5-0d8fb8251c36 service nova] Creating event network-changed:448dce41-f2fc-428b-b3eb-d9445e06f8dd for instance a1345188-9717-403c-8337-5fa23c2cbcf2 on n-h2-766726-30 May 19 05:13:27.751662 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a3276ddf-9fa9-49cd-a12d-ed15b041328a req-02b32136-48e6-4ddc-a1c5-0d8fb8251c36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113499 May 19 05:13:27.758573 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2932/5951] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:13:28.200152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4131d3a1-4e36-4f14-ad5a-e380e6367bc7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:28.201041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4131d3a1-4e36-4f14-ad5a-e380e6367bc7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:28.207949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131d3a1-4e36-4f14-ad5a-e380e6367bc7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:28.208622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131d3a1-4e36-4f14-ad5a-e380e6367bc7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:28.209787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131d3a1-4e36-4f14-ad5a-e380e6367bc7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:28.210938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131d3a1-4e36-4f14-ad5a-e380e6367bc7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:28.342711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4131d3a1-4e36-4f14-ad5a-e380e6367bc7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:28.350894 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4131d3a1-4e36-4f14-ad5a-e380e6367bc7 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1306 microversion: 2.1 time: 0.155460 May 19 05:13:28.351908 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3020/5952] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:28 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1306 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:28.466717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-27264d2f-a7b0-4874-b033-db25b8b8b63d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:28.468565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-27264d2f-a7b0-4874-b033-db25b8b8b63d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:28.481053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27264d2f-a7b0-4874-b033-db25b8b8b63d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:28.481417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27264d2f-a7b0-4874-b033-db25b8b8b63d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:28.483736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27264d2f-a7b0-4874-b033-db25b8b8b63d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:28.485010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-27264d2f-a7b0-4874-b033-db25b8b8b63d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:28.767571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-27264d2f-a7b0-4874-b033-db25b8b8b63d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:28.781958 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-27264d2f-a7b0-4874-b033-db25b8b8b63d tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1390 microversion: 2.1 time: 0.321444 May 19 05:13:28.792203 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2933/5953] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:28 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1390 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:29.368492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-07c49adb-c1bf-4dec-aded-6fe44e4cb0ef tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:29.369141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-07c49adb-c1bf-4dec-aded-6fe44e4cb0ef tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:29.382808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07c49adb-c1bf-4dec-aded-6fe44e4cb0ef tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:29.388698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07c49adb-c1bf-4dec-aded-6fe44e4cb0ef tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:29.389610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07c49adb-c1bf-4dec-aded-6fe44e4cb0ef tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:29.390215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-07c49adb-c1bf-4dec-aded-6fe44e4cb0ef tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:29.799408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-07c49adb-c1bf-4dec-aded-6fe44e4cb0ef tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:29.803480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f861d3e7-ac9f-469c-9fe2-4d8d25bc160e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:29.805359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f861d3e7-ac9f-469c-9fe2-4d8d25bc160e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:29.811218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-07c49adb-c1bf-4dec-aded-6fe44e4cb0ef tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1374 microversion: 2.1 time: 0.447134 May 19 05:13:29.815944 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f861d3e7-ac9f-469c-9fe2-4d8d25bc160e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:29.816697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f861d3e7-ac9f-469c-9fe2-4d8d25bc160e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:29.818641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f861d3e7-ac9f-469c-9fe2-4d8d25bc160e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:29.819322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f861d3e7-ac9f-469c-9fe2-4d8d25bc160e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:29.823993 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3021/5954] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:29 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1374 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:30.421696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f861d3e7-ac9f-469c-9fe2-4d8d25bc160e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:30.434874 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f861d3e7-ac9f-469c-9fe2-4d8d25bc160e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1390 microversion: 2.1 time: 0.638995 May 19 05:13:30.437139 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2934/5955] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:29 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1390 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:30.689163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0c001701-2317-4f6f-8a7c-60613d45837f req-28dbc3c4-e453-479f-b89e-2569b2af698c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c19de9-763d-4364-8d9e-5e17867b03bb", "tag": "d0224c58-58f7-40ac-900f-0923c7da9e2f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:30.706903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0c001701-2317-4f6f-8a7c-60613d45837f req-28dbc3c4-e453-479f-b89e-2569b2af698c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:30.708666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0c001701-2317-4f6f-8a7c-60613d45837f req-28dbc3c4-e453-479f-b89e-2569b2af698c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:30.750968 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0c001701-2317-4f6f-8a7c-60613d45837f req-28dbc3c4-e453-479f-b89e-2569b2af698c service nova] Creating event network-changed:d0224c58-58f7-40ac-900f-0923c7da9e2f for instance 69c19de9-763d-4364-8d9e-5e17867b03bb on n-h1-766726-30 May 19 05:13:30.758748 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0c001701-2317-4f6f-8a7c-60613d45837f req-28dbc3c4-e453-479f-b89e-2569b2af698c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074072 May 19 05:13:30.761818 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3022/5956] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:13:30.828232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-82b20bbc-7521-406d-bd9f-904f3b104ef3 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:30.829560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-82b20bbc-7521-406d-bd9f-904f3b104ef3 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:30.842422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82b20bbc-7521-406d-bd9f-904f3b104ef3 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:30.844123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82b20bbc-7521-406d-bd9f-904f3b104ef3 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:30.848120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82b20bbc-7521-406d-bd9f-904f3b104ef3 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:30.848766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82b20bbc-7521-406d-bd9f-904f3b104ef3 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:31.143942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-82b20bbc-7521-406d-bd9f-904f3b104ef3 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:31.153590 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-82b20bbc-7521-406d-bd9f-904f3b104ef3 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1374 microversion: 2.1 time: 0.329487 May 19 05:13:31.160188 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2935/5957] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:30 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1374 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:31.457111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f91c6812-775e-4d9b-8c69-7c44a849b499 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:31.471033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f91c6812-775e-4d9b-8c69-7c44a849b499 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:31.482575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f91c6812-775e-4d9b-8c69-7c44a849b499 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:31.483441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f91c6812-775e-4d9b-8c69-7c44a849b499 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:31.484523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f91c6812-775e-4d9b-8c69-7c44a849b499 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:31.486327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f91c6812-775e-4d9b-8c69-7c44a849b499 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:31.677140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f91c6812-775e-4d9b-8c69-7c44a849b499 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:31.686028 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f91c6812-775e-4d9b-8c69-7c44a849b499 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1390 microversion: 2.1 time: 0.236942 May 19 05:13:31.686979 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3023/5958] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:31 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1390 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:32.178411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75f2423b-2f7f-4b64-8ce7-c2ee3fefd2a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:32.180782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-75f2423b-2f7f-4b64-8ce7-c2ee3fefd2a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:32.189375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f2423b-2f7f-4b64-8ce7-c2ee3fefd2a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:32.190627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f2423b-2f7f-4b64-8ce7-c2ee3fefd2a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:32.191585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f2423b-2f7f-4b64-8ce7-c2ee3fefd2a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:32.192195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f2423b-2f7f-4b64-8ce7-c2ee3fefd2a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:32.333707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-75f2423b-2f7f-4b64-8ce7-c2ee3fefd2a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:32.341729 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-75f2423b-2f7f-4b64-8ce7-c2ee3fefd2a0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1374 microversion: 2.1 time: 0.167971 May 19 05:13:32.344082 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2936/5959] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:32 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:32.714601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d1d76ee-d8ae-4df3-9447-86b475fe5117 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:32.716002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d1d76ee-d8ae-4df3-9447-86b475fe5117 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:32.740862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d1d76ee-d8ae-4df3-9447-86b475fe5117 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:32.741374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d1d76ee-d8ae-4df3-9447-86b475fe5117 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:32.742226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d1d76ee-d8ae-4df3-9447-86b475fe5117 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:32.742681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d1d76ee-d8ae-4df3-9447-86b475fe5117 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:33.078027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0d1d76ee-d8ae-4df3-9447-86b475fe5117 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:33.089734 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d1d76ee-d8ae-4df3-9447-86b475fe5117 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1390 microversion: 2.1 time: 0.380290 May 19 05:13:33.092240 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3024/5960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:32 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1390 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:33.361562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d36a32dc-0733-4c67-99ce-74ca2581edc5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:33.362871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d36a32dc-0733-4c67-99ce-74ca2581edc5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:33.373497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d36a32dc-0733-4c67-99ce-74ca2581edc5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:33.374213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d36a32dc-0733-4c67-99ce-74ca2581edc5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:33.376193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d36a32dc-0733-4c67-99ce-74ca2581edc5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:33.376891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d36a32dc-0733-4c67-99ce-74ca2581edc5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:33.571747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d36a32dc-0733-4c67-99ce-74ca2581edc5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:33.581283 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d36a32dc-0733-4c67-99ce-74ca2581edc5 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1374 microversion: 2.1 time: 0.224638 May 19 05:13:33.581898 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2937/5961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:33 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1374 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:34.109167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-53d0e35a-842a-40a4-bc29-1140fea67244 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:34.109905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-53d0e35a-842a-40a4-bc29-1140fea67244 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:34.117641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-53d0e35a-842a-40a4-bc29-1140fea67244 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:34.118169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-53d0e35a-842a-40a4-bc29-1140fea67244 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:34.119023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-53d0e35a-842a-40a4-bc29-1140fea67244 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:34.119541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-53d0e35a-842a-40a4-bc29-1140fea67244 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:34.261276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-53d0e35a-842a-40a4-bc29-1140fea67244 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:34.270440 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-53d0e35a-842a-40a4-bc29-1140fea67244 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1390 microversion: 2.1 time: 0.165187 May 19 05:13:34.271026 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3025/5962] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:34 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:13:34.599329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c9639b8-09c8-4815-8e4d-1f9cc24eea5e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:34.600282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c9639b8-09c8-4815-8e4d-1f9cc24eea5e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:34.608303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c9639b8-09c8-4815-8e4d-1f9cc24eea5e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:34.608912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c9639b8-09c8-4815-8e4d-1f9cc24eea5e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:34.609847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c9639b8-09c8-4815-8e4d-1f9cc24eea5e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:34.610433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c9639b8-09c8-4815-8e4d-1f9cc24eea5e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:34.774338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0c9639b8-09c8-4815-8e4d-1f9cc24eea5e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:34.785920 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c9639b8-09c8-4815-8e4d-1f9cc24eea5e tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1374 microversion: 2.1 time: 0.190554 May 19 05:13:34.787795 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2938/5963] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:34 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:35.164867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f45073e3-c69d-4913-aca3-388b6ed11e5f req-348ab16b-515e-4459-bc6a-4470d03c4924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1345188-9717-403c-8337-5fa23c2cbcf2", "name": "network-vif-plugged", "status": "completed", "tag": "448dce41-f2fc-428b-b3eb-d9445e06f8dd"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:35.174867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f45073e3-c69d-4913-aca3-388b6ed11e5f req-348ab16b-515e-4459-bc6a-4470d03c4924 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:35.175590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f45073e3-c69d-4913-aca3-388b6ed11e5f req-348ab16b-515e-4459-bc6a-4470d03c4924 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:35.189781 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f45073e3-c69d-4913-aca3-388b6ed11e5f req-348ab16b-515e-4459-bc6a-4470d03c4924 service nova] Creating event network-vif-plugged:448dce41-f2fc-428b-b3eb-d9445e06f8dd for instance a1345188-9717-403c-8337-5fa23c2cbcf2 on n-h2-766726-30 May 19 05:13:35.197103 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f45073e3-c69d-4913-aca3-388b6ed11e5f req-348ab16b-515e-4459-bc6a-4470d03c4924 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036340 May 19 05:13:35.198183 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3026/5964] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:13:35.287531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-17e751d2-0a01-4418-8be7-1a218a859ae3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:35.288156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-17e751d2-0a01-4418-8be7-1a218a859ae3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:35.295131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17e751d2-0a01-4418-8be7-1a218a859ae3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:35.295595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17e751d2-0a01-4418-8be7-1a218a859ae3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:35.296382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17e751d2-0a01-4418-8be7-1a218a859ae3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:35.296829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-17e751d2-0a01-4418-8be7-1a218a859ae3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:35.589371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-17e751d2-0a01-4418-8be7-1a218a859ae3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:35.597589 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-17e751d2-0a01-4418-8be7-1a218a859ae3 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1390 microversion: 2.1 time: 0.313946 May 19 05:13:35.598663 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2939/5965] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:35 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1390 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:35.804490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6bfbd8a2-b56f-421a-9987-94aa0979ddee tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:35.805571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6bfbd8a2-b56f-421a-9987-94aa0979ddee tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:35.816181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bfbd8a2-b56f-421a-9987-94aa0979ddee tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:35.818845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bfbd8a2-b56f-421a-9987-94aa0979ddee tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:35.822120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bfbd8a2-b56f-421a-9987-94aa0979ddee tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:35.822782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bfbd8a2-b56f-421a-9987-94aa0979ddee tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:35.823525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:35.905065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:36.029169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6bfbd8a2-b56f-421a-9987-94aa0979ddee tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:36.036906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6bfbd8a2-b56f-421a-9987-94aa0979ddee tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1374 microversion: 2.1 time: 0.236680 May 19 05:13:36.037531 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3027/5966] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:35 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1374 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:36.614749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bbcec153-0fc2-4e53-a16c-cb88d3ee477b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:36.615130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bbcec153-0fc2-4e53-a16c-cb88d3ee477b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:36.632803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbcec153-0fc2-4e53-a16c-cb88d3ee477b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:36.633530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbcec153-0fc2-4e53-a16c-cb88d3ee477b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:36.634302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbcec153-0fc2-4e53-a16c-cb88d3ee477b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:36.634783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bbcec153-0fc2-4e53-a16c-cb88d3ee477b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:36.827967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bbcec153-0fc2-4e53-a16c-cb88d3ee477b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:36.836618 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bbcec153-0fc2-4e53-a16c-cb88d3ee477b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1561 microversion: 2.1 time: 0.226094 May 19 05:13:36.841120 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2940/5967] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:36 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:36.855424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-90a4cd48-f3bc-4497-992f-e8c0c2a9c7cb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:36.856082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-90a4cd48-f3bc-4497-992f-e8c0c2a9c7cb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:36.865869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90a4cd48-f3bc-4497-992f-e8c0c2a9c7cb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:36.867304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90a4cd48-f3bc-4497-992f-e8c0c2a9c7cb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:36.868282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90a4cd48-f3bc-4497-992f-e8c0c2a9c7cb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:36.868895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90a4cd48-f3bc-4497-992f-e8c0c2a9c7cb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:37.071583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ef697988-22f9-4c86-9dc4-2e1aa6235887 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:37.072220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ef697988-22f9-4c86-9dc4-2e1aa6235887 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:37.103244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef697988-22f9-4c86-9dc4-2e1aa6235887 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:37.103725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef697988-22f9-4c86-9dc4-2e1aa6235887 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:37.106938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef697988-22f9-4c86-9dc4-2e1aa6235887 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:37.107420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef697988-22f9-4c86-9dc4-2e1aa6235887 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:37.174430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:13:37.180910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-90a4cd48-f3bc-4497-992f-e8c0c2a9c7cb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:37.193513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-90a4cd48-f3bc-4497-992f-e8c0c2a9c7cb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1561 microversion: 2.1 time: 0.343704 May 19 05:13:37.196756 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3028/5968] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:36 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1561 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:37.280326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-de32b569-5c33-412e-8353-cd5a1daf5160 req-ef53b7b9-e490-41ba-8c86-3589955bd618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c19de9-763d-4364-8d9e-5e17867b03bb", "name": "network-vif-plugged", "status": "completed", "tag": "d0224c58-58f7-40ac-900f-0923c7da9e2f"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:37.297680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-de32b569-5c33-412e-8353-cd5a1daf5160 req-ef53b7b9-e490-41ba-8c86-3589955bd618 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:37.298127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-de32b569-5c33-412e-8353-cd5a1daf5160 req-ef53b7b9-e490-41ba-8c86-3589955bd618 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:37.311401 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-de32b569-5c33-412e-8353-cd5a1daf5160 req-ef53b7b9-e490-41ba-8c86-3589955bd618 service nova] Creating event network-vif-plugged:d0224c58-58f7-40ac-900f-0923c7da9e2f for instance 69c19de9-763d-4364-8d9e-5e17867b03bb on n-h1-766726-30 May 19 05:13:37.317446 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-de32b569-5c33-412e-8353-cd5a1daf5160 req-ef53b7b9-e490-41ba-8c86-3589955bd618 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040717 May 19 05:13:37.318623 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3029/5969] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:13:37.371219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ef697988-22f9-4c86-9dc4-2e1aa6235887 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:37.381939 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ef697988-22f9-4c86-9dc4-2e1aa6235887 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1374 microversion: 2.1 time: 0.328490 May 19 05:13:37.383703 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2941/5970] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:37 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1374 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:38.402872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96d8f62a-f35f-421a-a48c-7bc3c92455f2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:38.404313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96d8f62a-f35f-421a-a48c-7bc3c92455f2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:38.411996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96d8f62a-f35f-421a-a48c-7bc3c92455f2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:38.412936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96d8f62a-f35f-421a-a48c-7bc3c92455f2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:38.414562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96d8f62a-f35f-421a-a48c-7bc3c92455f2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:38.415263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96d8f62a-f35f-421a-a48c-7bc3c92455f2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:38.697591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-96d8f62a-f35f-421a-a48c-7bc3c92455f2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:38.708403 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96d8f62a-f35f-421a-a48c-7bc3c92455f2 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1374 microversion: 2.1 time: 0.311950 May 19 05:13:38.709852 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3030/5971] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:38 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1374 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:39.684969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-18e15ec4-43b5-49ea-ad8e-20fed8cfb752 req-12b43e91-8889-42c6-8e4f-f68c5d645ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1345188-9717-403c-8337-5fa23c2cbcf2", "tag": "448dce41-f2fc-428b-b3eb-d9445e06f8dd"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:39.689939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f9481adc-96bd-431e-a8ad-2e07fad22e24 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:39.690807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f9481adc-96bd-431e-a8ad-2e07fad22e24 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:39.708230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-18e15ec4-43b5-49ea-ad8e-20fed8cfb752 req-12b43e91-8889-42c6-8e4f-f68c5d645ce9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:39.708688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-18e15ec4-43b5-49ea-ad8e-20fed8cfb752 req-12b43e91-8889-42c6-8e4f-f68c5d645ce9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:39.711973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9481adc-96bd-431e-a8ad-2e07fad22e24 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:39.712433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9481adc-96bd-431e-a8ad-2e07fad22e24 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:39.713260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9481adc-96bd-431e-a8ad-2e07fad22e24 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:39.713708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f9481adc-96bd-431e-a8ad-2e07fad22e24 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:39.739273 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-18e15ec4-43b5-49ea-ad8e-20fed8cfb752 req-12b43e91-8889-42c6-8e4f-f68c5d645ce9 service nova] Creating event network-changed:448dce41-f2fc-428b-b3eb-d9445e06f8dd for instance a1345188-9717-403c-8337-5fa23c2cbcf2 on n-h2-766726-30 May 19 05:13:39.747171 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-18e15ec4-43b5-49ea-ad8e-20fed8cfb752 req-12b43e91-8889-42c6-8e4f-f68c5d645ce9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071426 May 19 05:13:39.748397 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3031/5972] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:13:39.755036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-705ad488-efab-411f-81f5-062101096f73 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:39.755888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-705ad488-efab-411f-81f5-062101096f73 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:39.762650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-705ad488-efab-411f-81f5-062101096f73 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:39.763335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-705ad488-efab-411f-81f5-062101096f73 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:39.764283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-705ad488-efab-411f-81f5-062101096f73 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:39.764884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-705ad488-efab-411f-81f5-062101096f73 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:40.125086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-705ad488-efab-411f-81f5-062101096f73 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:40.134506 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-705ad488-efab-411f-81f5-062101096f73 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1546 microversion: 2.1 time: 0.384495 May 19 05:13:40.139670 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3032/5973] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:39 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1546 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:40.146371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f9481adc-96bd-431e-a8ad-2e07fad22e24 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:40.155644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-003a0508-52a0-4040-b96b-ba0d32773a7a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:13:40.156651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-003a0508-52a0-4040-b96b-ba0d32773a7a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:13:40.165605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-003a0508-52a0-4040-b96b-ba0d32773a7a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:40.166559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-003a0508-52a0-4040-b96b-ba0d32773a7a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:40.166745 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f9481adc-96bd-431e-a8ad-2e07fad22e24 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1561 microversion: 2.1 time: 0.496501 May 19 05:13:40.181118 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2942/5974] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:39 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1561 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:40.183018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-003a0508-52a0-4040-b96b-ba0d32773a7a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:40.212636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-003a0508-52a0-4040-b96b-ba0d32773a7a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:40.565707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-003a0508-52a0-4040-b96b-ba0d32773a7a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:13:40.578561 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-003a0508-52a0-4040-b96b-ba0d32773a7a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1546 microversion: 2.1 time: 0.427031 May 19 05:13:40.601036 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3033/5975] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:13:40 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1546 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:13:43.225841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2e887a17-524c-4f84-a48f-681a2f68fbbf req-08c1740d-7d9d-40ef-835f-207de80b224a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c19de9-763d-4364-8d9e-5e17867b03bb", "tag": "d0224c58-58f7-40ac-900f-0923c7da9e2f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:13:43.237517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2e887a17-524c-4f84-a48f-681a2f68fbbf req-08c1740d-7d9d-40ef-835f-207de80b224a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:13:43.238237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2e887a17-524c-4f84-a48f-681a2f68fbbf req-08c1740d-7d9d-40ef-835f-207de80b224a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:13:43.251580 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2e887a17-524c-4f84-a48f-681a2f68fbbf req-08c1740d-7d9d-40ef-835f-207de80b224a service nova] Creating event network-changed:d0224c58-58f7-40ac-900f-0923c7da9e2f for instance 69c19de9-763d-4364-8d9e-5e17867b03bb on n-h1-766726-30 May 19 05:13:43.257687 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2e887a17-524c-4f84-a48f-681a2f68fbbf req-08c1740d-7d9d-40ef-835f-207de80b224a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035621 May 19 05:13:43.258846 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2943/5976] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:14:02.703467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2c08c0a-8f2d-4b4b-ac95-939d10a34481 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:02.704435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c2c08c0a-8f2d-4b4b-ac95-939d10a34481 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:02.711530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:02.712172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=90 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:02.714242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2c08c0a-8f2d-4b4b-ac95-939d10a34481 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:02.714979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2c08c0a-8f2d-4b4b-ac95-939d10a34481 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:02.715974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2c08c0a-8f2d-4b4b-ac95-939d10a34481 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:02.716412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2c08c0a-8f2d-4b4b-ac95-939d10a34481 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:02.772980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2c08c0a-8f2d-4b4b-ac95-939d10a34481 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2/action" status: 200 len: 24565 microversion: 2.1 time: 0.073532 May 19 05:14:02.779018 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3034/5977] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:14:02 2022] POST /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2/action => generated 24565 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:14:03.674364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:03.675768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=76 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:03.681800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1816372068", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:03.736173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:14:04.024501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:14:04.024929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:14:04.025461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:14:04.025897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:14:04.026309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:14:04.035342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:04.035799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:04.036606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:04.037047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:04.053606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Getting quotas for project 90f988d8aeac43e08f149e933b56d534. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:14:04.059403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Getting quotas for user 08b4794404e5427d8ae2b65fd46b39e2 and project 90f988d8aeac43e08f149e933b56d534. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:14:04.072508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:14:04.074974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:14:04.119072 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-42113774-de34-43f1-bac5-4172cddc5616 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.446583 May 19 05:14:04.124661 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2944/5978] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:14:04.130570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-364618e7-2e5b-4341-b5e6-9581534ace26 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:04.131279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-364618e7-2e5b-4341-b5e6-9581534ace26 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:04.197513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-364618e7-2e5b-4341-b5e6-9581534ace26 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:04.205046 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-364618e7-2e5b-4341-b5e6-9581534ace26 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1215 microversion: 2.1 time: 0.078804 May 19 05:14:04.205954 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3035/5979] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:04 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:05.223201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-35c6a52e-ff31-4951-8295-0941a382839b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:05.223826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-35c6a52e-ff31-4951-8295-0941a382839b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:05.230779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35c6a52e-ff31-4951-8295-0941a382839b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:05.231300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35c6a52e-ff31-4951-8295-0941a382839b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:05.232259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35c6a52e-ff31-4951-8295-0941a382839b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:05.232713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-35c6a52e-ff31-4951-8295-0941a382839b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:05.310952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-35c6a52e-ff31-4951-8295-0941a382839b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:05.319885 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-35c6a52e-ff31-4951-8295-0941a382839b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1273 microversion: 2.1 time: 0.101830 May 19 05:14:05.329798 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2945/5980] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:05 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:05.723991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7437084-5e66-48d0-b530-883e7abbaf2a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:05.728578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b7437084-5e66-48d0-b530-883e7abbaf2a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:05.735886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7437084-5e66-48d0-b530-883e7abbaf2a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:05.736345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7437084-5e66-48d0-b530-883e7abbaf2a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:05.737170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7437084-5e66-48d0-b530-883e7abbaf2a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:05.737619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7437084-5e66-48d0-b530-883e7abbaf2a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:05.796894 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b7437084-5e66-48d0-b530-883e7abbaf2a tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "POST /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb/action" status: 200 len: 24566 microversion: 2.1 time: 0.079125 May 19 05:14:05.798197 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3036/5981] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:14:05 2022] POST /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb/action => generated 24566 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:14:06.341863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e411b94-8ea0-4d8b-a644-3b42cb345873 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:06.343691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e411b94-8ea0-4d8b-a644-3b42cb345873 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:06.351167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e411b94-8ea0-4d8b-a644-3b42cb345873 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:06.352421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e411b94-8ea0-4d8b-a644-3b42cb345873 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:06.353744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e411b94-8ea0-4d8b-a644-3b42cb345873 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:06.354704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e411b94-8ea0-4d8b-a644-3b42cb345873 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:06.546661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8e411b94-8ea0-4d8b-a644-3b42cb345873 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:06.557803 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e411b94-8ea0-4d8b-a644-3b42cb345873 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1315 microversion: 2.1 time: 0.221724 May 19 05:14:06.558892 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2946/5982] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:06 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:06.713618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-7659a41f-36c7-4527-81fa-c4d405e7bcee req-daa920ab-a0b5-49ff-adb6-0513cfbae00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "788d752a-63e1-4beb-98ba-b3964e2baf0f", "tag": "25dad45c-53dd-4cec-81cc-854981e06a4d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:06.742169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7659a41f-36c7-4527-81fa-c4d405e7bcee req-daa920ab-a0b5-49ff-adb6-0513cfbae00d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:06.742879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-7659a41f-36c7-4527-81fa-c4d405e7bcee req-daa920ab-a0b5-49ff-adb6-0513cfbae00d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:06.758712 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-7659a41f-36c7-4527-81fa-c4d405e7bcee req-daa920ab-a0b5-49ff-adb6-0513cfbae00d service nova] Creating event network-changed:25dad45c-53dd-4cec-81cc-854981e06a4d for instance 788d752a-63e1-4beb-98ba-b3964e2baf0f on n-h2-766726-30 May 19 05:14:06.764238 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-7659a41f-36c7-4527-81fa-c4d405e7bcee req-daa920ab-a0b5-49ff-adb6-0513cfbae00d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062680 May 19 05:14:06.765698 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3037/5983] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:14:07.575498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b48769e2-befd-4315-a625-d0b4949abff0 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:07.576272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b48769e2-befd-4315-a625-d0b4949abff0 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:07.583948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b48769e2-befd-4315-a625-d0b4949abff0 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:07.584400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b48769e2-befd-4315-a625-d0b4949abff0 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:07.585199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b48769e2-befd-4315-a625-d0b4949abff0 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:07.586248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b48769e2-befd-4315-a625-d0b4949abff0 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:07.717449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b48769e2-befd-4315-a625-d0b4949abff0 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:07.725313 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b48769e2-befd-4315-a625-d0b4949abff0 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1315 microversion: 2.1 time: 0.153908 May 19 05:14:07.725897 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2947/5984] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:07 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:14:08.743204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b89b39fb-f6b5-49db-8947-06a8a2bf592d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:08.744132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b89b39fb-f6b5-49db-8947-06a8a2bf592d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:08.751263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b89b39fb-f6b5-49db-8947-06a8a2bf592d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:08.751938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b89b39fb-f6b5-49db-8947-06a8a2bf592d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:08.752771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b89b39fb-f6b5-49db-8947-06a8a2bf592d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:08.753324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b89b39fb-f6b5-49db-8947-06a8a2bf592d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:08.889337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b89b39fb-f6b5-49db-8947-06a8a2bf592d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:08.896927 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b89b39fb-f6b5-49db-8947-06a8a2bf592d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1315 microversion: 2.1 time: 0.158084 May 19 05:14:08.897526 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3038/5985] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:08 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:09.188203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:09.189726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:09.198146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:09.198606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:09.199398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:09.199842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:09.275761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:14:09.276188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:14:09.276664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:14:09.277093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:14:09.277507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:14:09.346129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:09.353172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:09.353172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:09.353935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:09.354382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:09.381867 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-deee8dd5-097b-4574-9f19-af6ab1221701 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2/action" status: 202 len: 1135 microversion: 2.1 time: 0.197758 May 19 05:14:09.389773 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2948/5986] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:14:09 2022] POST /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2/action => generated 1135 bytes in 199 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 19 05:14:09.398050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a45d17be-68d8-4042-93ae-a95d4cfb24ee tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:09.399136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a45d17be-68d8-4042-93ae-a95d4cfb24ee tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:09.406234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a45d17be-68d8-4042-93ae-a95d4cfb24ee tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:09.406935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a45d17be-68d8-4042-93ae-a95d4cfb24ee tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:09.407975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a45d17be-68d8-4042-93ae-a95d4cfb24ee tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:09.408639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a45d17be-68d8-4042-93ae-a95d4cfb24ee tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:09.553404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a45d17be-68d8-4042-93ae-a95d4cfb24ee tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:09.561486 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a45d17be-68d8-4042-93ae-a95d4cfb24ee tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.167960 May 19 05:14:09.562048 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3039/5987] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:09 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:09.913929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5af21122-bcff-40c6-ab23-35dc9cd948fa tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:09.915204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5af21122-bcff-40c6-ab23-35dc9cd948fa tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:09.921802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5af21122-bcff-40c6-ab23-35dc9cd948fa tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:09.922257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5af21122-bcff-40c6-ab23-35dc9cd948fa tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:09.923158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5af21122-bcff-40c6-ab23-35dc9cd948fa tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:09.923600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5af21122-bcff-40c6-ab23-35dc9cd948fa tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:10.062768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5af21122-bcff-40c6-ab23-35dc9cd948fa tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:10.070400 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5af21122-bcff-40c6-ab23-35dc9cd948fa tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1315 microversion: 2.1 time: 0.160460 May 19 05:14:10.070977 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2949/5988] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:09 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:10.578892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-263e310b-df2e-482a-a24b-b93980bc36bf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:10.579422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-263e310b-df2e-482a-a24b-b93980bc36bf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:10.586965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-263e310b-df2e-482a-a24b-b93980bc36bf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:10.587421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-263e310b-df2e-482a-a24b-b93980bc36bf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:10.588184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-263e310b-df2e-482a-a24b-b93980bc36bf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:10.588618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-263e310b-df2e-482a-a24b-b93980bc36bf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:10.719510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-263e310b-df2e-482a-a24b-b93980bc36bf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:10.727954 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-263e310b-df2e-482a-a24b-b93980bc36bf tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.153181 May 19 05:14:10.728532 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3040/5989] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:10 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:11.087135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f07e64d7-d6a0-40db-b1f8-cf83e9addf7b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:11.087762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f07e64d7-d6a0-40db-b1f8-cf83e9addf7b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:11.095624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f07e64d7-d6a0-40db-b1f8-cf83e9addf7b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:11.095877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f07e64d7-d6a0-40db-b1f8-cf83e9addf7b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:11.096498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f07e64d7-d6a0-40db-b1f8-cf83e9addf7b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:11.096943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f07e64d7-d6a0-40db-b1f8-cf83e9addf7b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:11.262665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f07e64d7-d6a0-40db-b1f8-cf83e9addf7b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:11.273995 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f07e64d7-d6a0-40db-b1f8-cf83e9addf7b tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1315 microversion: 2.1 time: 0.190689 May 19 05:14:11.274928 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2950/5990] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:11 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:11.744996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cbd73265-9ffc-4ccd-8288-d3ee0298e82b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:11.745646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cbd73265-9ffc-4ccd-8288-d3ee0298e82b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:11.752518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbd73265-9ffc-4ccd-8288-d3ee0298e82b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:11.753208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbd73265-9ffc-4ccd-8288-d3ee0298e82b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:11.753970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbd73265-9ffc-4ccd-8288-d3ee0298e82b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:11.754406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbd73265-9ffc-4ccd-8288-d3ee0298e82b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:11.898011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cbd73265-9ffc-4ccd-8288-d3ee0298e82b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:11.906686 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cbd73265-9ffc-4ccd-8288-d3ee0298e82b tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.165720 May 19 05:14:11.907271 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3041/5991] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:11 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:12.295021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5566a1cf-791d-41ea-9ada-6cf7ec4c2b45 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:12.295911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5566a1cf-791d-41ea-9ada-6cf7ec4c2b45 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:12.308999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5566a1cf-791d-41ea-9ada-6cf7ec4c2b45 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:12.309505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5566a1cf-791d-41ea-9ada-6cf7ec4c2b45 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:12.310680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5566a1cf-791d-41ea-9ada-6cf7ec4c2b45 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:12.311136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5566a1cf-791d-41ea-9ada-6cf7ec4c2b45 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:12.462327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5566a1cf-791d-41ea-9ada-6cf7ec4c2b45 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:12.470327 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5566a1cf-791d-41ea-9ada-6cf7ec4c2b45 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1315 microversion: 2.1 time: 0.179923 May 19 05:14:12.470996 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2951/5992] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:12 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:14:12.923352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2277b2ec-8b25-4a9b-bbcf-9e4ce3778c77 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:12.924101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2277b2ec-8b25-4a9b-bbcf-9e4ce3778c77 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:12.931693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2277b2ec-8b25-4a9b-bbcf-9e4ce3778c77 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:12.932151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2277b2ec-8b25-4a9b-bbcf-9e4ce3778c77 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:12.932921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2277b2ec-8b25-4a9b-bbcf-9e4ce3778c77 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:12.933391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2277b2ec-8b25-4a9b-bbcf-9e4ce3778c77 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:13.073308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2277b2ec-8b25-4a9b-bbcf-9e4ce3778c77 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:13.080981 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2277b2ec-8b25-4a9b-bbcf-9e4ce3778c77 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.161619 May 19 05:14:13.081581 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3042/5993] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:12 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:13.248975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-279e9e22-7309-4c30-9645-3868a1810b11 req-c85c879a-b586-4e3b-a532-b5e54992275f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "788d752a-63e1-4beb-98ba-b3964e2baf0f", "name": "network-vif-plugged", "status": "completed", "tag": "25dad45c-53dd-4cec-81cc-854981e06a4d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:13.257467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-279e9e22-7309-4c30-9645-3868a1810b11 req-c85c879a-b586-4e3b-a532-b5e54992275f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:13.258000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-279e9e22-7309-4c30-9645-3868a1810b11 req-c85c879a-b586-4e3b-a532-b5e54992275f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:13.273584 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-279e9e22-7309-4c30-9645-3868a1810b11 req-c85c879a-b586-4e3b-a532-b5e54992275f service nova] Creating event network-vif-plugged:25dad45c-53dd-4cec-81cc-854981e06a4d for instance 788d752a-63e1-4beb-98ba-b3964e2baf0f on n-h2-766726-30 May 19 05:14:13.279619 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-279e9e22-7309-4c30-9645-3868a1810b11 req-c85c879a-b586-4e3b-a532-b5e54992275f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034919 May 19 05:14:13.280447 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2952/5994] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:14:13.488400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d1d90391-26fb-4215-8e82-10161a9d1e9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:13.489037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d1d90391-26fb-4215-8e82-10161a9d1e9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:13.496134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1d90391-26fb-4215-8e82-10161a9d1e9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:13.496581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1d90391-26fb-4215-8e82-10161a9d1e9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:13.497483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1d90391-26fb-4215-8e82-10161a9d1e9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:13.497836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1d90391-26fb-4215-8e82-10161a9d1e9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:13.635231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d1d90391-26fb-4215-8e82-10161a9d1e9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:13.643025 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d1d90391-26fb-4215-8e82-10161a9d1e9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1315 microversion: 2.1 time: 0.159160 May 19 05:14:13.643648 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3043/5995] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:13 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:14.096428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:14.097282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:14.102550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-874a1fe4-04e4-4ea2-b3c0-6ffd73636930 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:14.103269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-874a1fe4-04e4-4ea2-b3c0-6ffd73636930 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:14.110386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-874a1fe4-04e4-4ea2-b3c0-6ffd73636930 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:14.110839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-874a1fe4-04e4-4ea2-b3c0-6ffd73636930 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:14.111593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-874a1fe4-04e4-4ea2-b3c0-6ffd73636930 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:14.112030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-874a1fe4-04e4-4ea2-b3c0-6ffd73636930 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:14.244840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-874a1fe4-04e4-4ea2-b3c0-6ffd73636930 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:14.252779 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-874a1fe4-04e4-4ea2-b3c0-6ffd73636930 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.158023 May 19 05:14:14.253388 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2953/5996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:14 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:14.660160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-815c981b-8b10-479c-943b-30191a447bfb tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:14.660901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-815c981b-8b10-479c-943b-30191a447bfb tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:14.663820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:14.669695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-815c981b-8b10-479c-943b-30191a447bfb tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:14.670065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-815c981b-8b10-479c-943b-30191a447bfb tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:14.670893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-815c981b-8b10-479c-943b-30191a447bfb tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:14.671338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-815c981b-8b10-479c-943b-30191a447bfb tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:14.809459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-815c981b-8b10-479c-943b-30191a447bfb tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:14.817116 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-815c981b-8b10-479c-943b-30191a447bfb tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1464 microversion: 2.1 time: 0.161311 May 19 05:14:14.817706 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3044/5997] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:14 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:14.856493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00fa9744-37d2-4f5e-969e-73a982009365 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:14.857014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00fa9744-37d2-4f5e-969e-73a982009365 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:14.863937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00fa9744-37d2-4f5e-969e-73a982009365 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:14.864430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00fa9744-37d2-4f5e-969e-73a982009365 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:14.865249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00fa9744-37d2-4f5e-969e-73a982009365 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:14.865742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00fa9744-37d2-4f5e-969e-73a982009365 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:14.891133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00fa9744-37d2-4f5e-969e-73a982009365 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:14:14.972773 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00fa9744-37d2-4f5e-969e-73a982009365 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "DELETE /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 204 len: 0 microversion: 2.1 time: 0.119555 May 19 05:14:14.974377 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2954/5998] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:14:14 2022] DELETE /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 05:14:14.982915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c5c4d521-82b1-49a8-8a1d-42cbb5a7d140 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:14.983537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c5c4d521-82b1-49a8-8a1d-42cbb5a7d140 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:14.990249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5c4d521-82b1-49a8-8a1d-42cbb5a7d140 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:14.990709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5c4d521-82b1-49a8-8a1d-42cbb5a7d140 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:14.991490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5c4d521-82b1-49a8-8a1d-42cbb5a7d140 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:14.991935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5c4d521-82b1-49a8-8a1d-42cbb5a7d140 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:15.124608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c5c4d521-82b1-49a8-8a1d-42cbb5a7d140 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:15.132385 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c5c4d521-82b1-49a8-8a1d-42cbb5a7d140 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1470 microversion: 2.1 time: 0.153541 May 19 05:14:15.132963 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3045/5999] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:14 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:15.271141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c66a747-d898-4292-b0e3-03ae582f93be tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:15.271796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c66a747-d898-4292-b0e3-03ae582f93be tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:15.278924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c66a747-d898-4292-b0e3-03ae582f93be tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:15.279370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c66a747-d898-4292-b0e3-03ae582f93be tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:15.280128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c66a747-d898-4292-b0e3-03ae582f93be tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:15.280564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c66a747-d898-4292-b0e3-03ae582f93be tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:15.424713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1c66a747-d898-4292-b0e3-03ae582f93be tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:15.432377 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c66a747-d898-4292-b0e3-03ae582f93be tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.165745 May 19 05:14:15.432956 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2955/6000] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:15 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:16.150042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-95c34661-f51c-4212-a833-0c3b47f5ab9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:16.150661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-95c34661-f51c-4212-a833-0c3b47f5ab9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:16.157676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c34661-f51c-4212-a833-0c3b47f5ab9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:16.158129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c34661-f51c-4212-a833-0c3b47f5ab9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:16.158903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c34661-f51c-4212-a833-0c3b47f5ab9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:16.159342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c34661-f51c-4212-a833-0c3b47f5ab9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:16.292759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-95c34661-f51c-4212-a833-0c3b47f5ab9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:16.300574 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-95c34661-f51c-4212-a833-0c3b47f5ab9d tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1470 microversion: 2.1 time: 0.155099 May 19 05:14:16.301617 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3046/6001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:16 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:16.455641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dbe6bb4d-9ca4-48c8-a4bf-f3acaefa1d11 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:16.456250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dbe6bb4d-9ca4-48c8-a4bf-f3acaefa1d11 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:16.466653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbe6bb4d-9ca4-48c8-a4bf-f3acaefa1d11 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:16.467103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbe6bb4d-9ca4-48c8-a4bf-f3acaefa1d11 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:16.468122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbe6bb4d-9ca4-48c8-a4bf-f3acaefa1d11 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:16.468740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbe6bb4d-9ca4-48c8-a4bf-f3acaefa1d11 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:16.674088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dbe6bb4d-9ca4-48c8-a4bf-f3acaefa1d11 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:16.682677 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dbe6bb4d-9ca4-48c8-a4bf-f3acaefa1d11 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.230983 May 19 05:14:16.683610 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2956/6002] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:16 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:16.870936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-65b50f1a-ce07-4c12-b9fc-db3194381afe req-44ab26bb-c39b-4311-8249-293419f7fc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "788d752a-63e1-4beb-98ba-b3964e2baf0f", "name": "network-vif-deleted", "tag": "25dad45c-53dd-4cec-81cc-854981e06a4d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:16.881041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-65b50f1a-ce07-4c12-b9fc-db3194381afe req-44ab26bb-c39b-4311-8249-293419f7fc8a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:16.886587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-65b50f1a-ce07-4c12-b9fc-db3194381afe req-44ab26bb-c39b-4311-8249-293419f7fc8a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:16.902677 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-65b50f1a-ce07-4c12-b9fc-db3194381afe req-44ab26bb-c39b-4311-8249-293419f7fc8a service nova] Creating event network-vif-deleted:25dad45c-53dd-4cec-81cc-854981e06a4d for instance 788d752a-63e1-4beb-98ba-b3964e2baf0f on n-h2-766726-30 May 19 05:14:16.903280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6b41294-8984-4aa8-b830-55e5b253ebc9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:16.904467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6b41294-8984-4aa8-b830-55e5b253ebc9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:16.909640 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-65b50f1a-ce07-4c12-b9fc-db3194381afe req-44ab26bb-c39b-4311-8249-293419f7fc8a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044751 May 19 05:14:16.910332 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3047/6003] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:14:16.911742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6b41294-8984-4aa8-b830-55e5b253ebc9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:16.912205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6b41294-8984-4aa8-b830-55e5b253ebc9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:16.913733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6b41294-8984-4aa8-b830-55e5b253ebc9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:16.914175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6b41294-8984-4aa8-b830-55e5b253ebc9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:16.969509 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6b41294-8984-4aa8-b830-55e5b253ebc9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "POST /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb/action" status: 200 len: 32634 microversion: 2.1 time: 0.072948 May 19 05:14:16.981023 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2957/6004] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:14:16 2022] POST /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb/action => generated 32634 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 05:14:17.322517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:17.336113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:17.348316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:17.349844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:17.350894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:17.352237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:17.399593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:17.400051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:17.400511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lazy-loading 'fault' on Instance uuid 788d752a-63e1-4beb-98ba-b3964e2baf0f {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:14:17.450454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4794404e5427d8ae2b65fd46b39e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f988d8aeac43e08f149e933b56d534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:17.459402 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b0489520-db34-4c87-9040-a31021f28407 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 200 len: 1305 microversion: 2.1 time: 0.143170 May 19 05:14:17.460372 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3048/6005] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:17 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 1305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:14:17.701000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d33aeed6-f402-43fd-9aa0-1d91b90b04af tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:17.702324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d33aeed6-f402-43fd-9aa0-1d91b90b04af tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:17.710305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d33aeed6-f402-43fd-9aa0-1d91b90b04af tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:17.711098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d33aeed6-f402-43fd-9aa0-1d91b90b04af tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:17.712690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d33aeed6-f402-43fd-9aa0-1d91b90b04af tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:17.713338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d33aeed6-f402-43fd-9aa0-1d91b90b04af tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:17.734853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:17.871329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d33aeed6-f402-43fd-9aa0-1d91b90b04af tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:17.880422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d33aeed6-f402-43fd-9aa0-1d91b90b04af tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.184223 May 19 05:14:17.881838 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2958/6006] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:17 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:18.139690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da450a23-274f-4f45-945f-58d53b4107de tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:18.140316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d1b8addb-c038-4105-9659-9e67a7559024 req-7c1e6168-26bb-46ad-873e-54f218452cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c19de9-763d-4364-8d9e-5e17867b03bb", "tag": "d0224c58-58f7-40ac-900f-0923c7da9e2f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:18.141271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da450a23-274f-4f45-945f-58d53b4107de tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:18.149483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d1b8addb-c038-4105-9659-9e67a7559024 req-7c1e6168-26bb-46ad-873e-54f218452cb9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:18.149937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d1b8addb-c038-4105-9659-9e67a7559024 req-7c1e6168-26bb-46ad-873e-54f218452cb9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:18.155522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da450a23-274f-4f45-945f-58d53b4107de tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:18.156257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da450a23-274f-4f45-945f-58d53b4107de tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:18.162009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da450a23-274f-4f45-945f-58d53b4107de tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:18.162817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da450a23-274f-4f45-945f-58d53b4107de tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:18.162953 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d1b8addb-c038-4105-9659-9e67a7559024 req-7c1e6168-26bb-46ad-873e-54f218452cb9 service nova] Creating event network-changed:d0224c58-58f7-40ac-900f-0923c7da9e2f for instance 69c19de9-763d-4364-8d9e-5e17867b03bb on n-h1-766726-30 May 19 05:14:18.168264 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d1b8addb-c038-4105-9659-9e67a7559024 req-7c1e6168-26bb-46ad-873e-54f218452cb9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031471 May 19 05:14:18.172116 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2959/6007] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:14:18.225377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da450a23-274f-4f45-945f-58d53b4107de tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:14:18.407800 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da450a23-274f-4f45-945f-58d53b4107de tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "DELETE /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 204 len: 0 microversion: 2.1 time: 0.274318 May 19 05:14:18.408772 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3049/6008] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:14:18 2022] DELETE /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:14:18.418843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-77b06d69-107e-42f0-81c8-66e7d7aeeadb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:18.419566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-77b06d69-107e-42f0-81c8-66e7d7aeeadb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:18.435248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77b06d69-107e-42f0-81c8-66e7d7aeeadb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:18.435248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77b06d69-107e-42f0-81c8-66e7d7aeeadb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:18.435248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77b06d69-107e-42f0-81c8-66e7d7aeeadb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:18.435248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-77b06d69-107e-42f0-81c8-66e7d7aeeadb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:18.479181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:18.480715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] [instance: 788d752a-63e1-4beb-98ba-b3964e2baf0f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:18.486973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:18.487422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:18.488445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:18.489012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:18.521297 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] HTTP exception thrown: Instance 788d752a-63e1-4beb-98ba-b3964e2baf0f could not be found. May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Request method failure captured: May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f HTTP/1.1 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdIZp_APXF-GL7lwOwE2fYhkpYj5N00lKFH2g2d6d-yfqqPzsmyGWAkpwLuVF4Bt1oPfY-lGmoS5IRNQgqVAVXD6tgWnspV4BLueL-Nu4WMx_enReevrHcCi_LmQybnBxMxTKJplc0vQfoYDWTKuKAERB4uCqALQQs1A4oDk3ejexts May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 90f988d8aeac43e08f149e933b56d534 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-VolumesNegativeTest-2007865263 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/90f988d8aeac43e08f149e933b56d534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90f988d8aeac43e08f149e933b56d534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/90f988d8aeac43e08f149e933b56d534"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_90f988d8aeac43e08f149e933b56d534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-VolumesNegativeTest-2007865263 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 90f988d8aeac43e08f149e933b56d534 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-VolumesNegativeTest-2007865263 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-VolumesNegativeTest-2007865263-project May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 08b4794404e5427d8ae2b65fd46b39e2 May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-VolumesNegativeTest-2007865263-project May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 788d752a-63e1-4beb-98ba-b3964e2baf0f could not be found. May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '788d752a-63e1-4beb-98ba-b3964e2baf0f'} May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 788d752a-63e1-4beb-98ba-b3964e2baf0f could not be found. May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 788d752a-63e1-4beb-98ba-b3964e2baf0f could not be found. May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:14:18.525479 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 788d752a-63e1-4beb-98ba-b3964e2baf0f could not be found. May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] Returning 404 to user: Instance 788d752a-63e1-4beb-98ba-b3964e2baf0f could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39c51095-ee11-4051-af6b-62902ebf3f38 tempest-VolumesNegativeTest-2007865263 tempest-VolumesNegativeTest-2007865263-project] 10.222.0.58 "GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f" status: 404 len: 111 microversion: 2.1 time: 0.053818 May 19 05:14:18.530228 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3050/6009] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:18 2022] GET /compute/v2.1/servers/788d752a-63e1-4beb-98ba-b3964e2baf0f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 05:14:18.643873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-77b06d69-107e-42f0-81c8-66e7d7aeeadb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:18.655136 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-77b06d69-107e-42f0-81c8-66e7d7aeeadb tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1671 microversion: 2.1 time: 0.241297 May 19 05:14:18.656324 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2960/6010] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:18 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1671 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:18.899394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d5f8859a-0c5f-41a1-af87-9a011e2b7f88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:18.900127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d5f8859a-0c5f-41a1-af87-9a011e2b7f88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:18.906761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5f8859a-0c5f-41a1-af87-9a011e2b7f88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:18.913152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5f8859a-0c5f-41a1-af87-9a011e2b7f88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:18.914337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5f8859a-0c5f-41a1-af87-9a011e2b7f88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:18.915381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d5f8859a-0c5f-41a1-af87-9a011e2b7f88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:19.088981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d5f8859a-0c5f-41a1-af87-9a011e2b7f88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:19.097629 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d5f8859a-0c5f-41a1-af87-9a011e2b7f88 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.202852 May 19 05:14:19.098427 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3051/6011] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:18 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:19.677754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be4c815f-20dc-43d8-b1d5-4b0f5e67e2e9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:19.679287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be4c815f-20dc-43d8-b1d5-4b0f5e67e2e9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:19.704477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be4c815f-20dc-43d8-b1d5-4b0f5e67e2e9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:19.705345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be4c815f-20dc-43d8-b1d5-4b0f5e67e2e9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:19.706462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be4c815f-20dc-43d8-b1d5-4b0f5e67e2e9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:19.707096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be4c815f-20dc-43d8-b1d5-4b0f5e67e2e9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:19.935801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-be4c815f-20dc-43d8-b1d5-4b0f5e67e2e9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:19.948581 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be4c815f-20dc-43d8-b1d5-4b0f5e67e2e9 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1671 microversion: 2.1 time: 0.277182 May 19 05:14:19.949819 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2961/6012] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:19 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1671 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:20.115655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a8d86d9c-91df-4e3e-8415-ff7f4e7da15f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:20.117021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a8d86d9c-91df-4e3e-8415-ff7f4e7da15f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:20.126950 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8d86d9c-91df-4e3e-8415-ff7f4e7da15f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:20.127412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8d86d9c-91df-4e3e-8415-ff7f4e7da15f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:20.128187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8d86d9c-91df-4e3e-8415-ff7f4e7da15f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:20.128748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8d86d9c-91df-4e3e-8415-ff7f4e7da15f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:20.160898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:20.294117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a8d86d9c-91df-4e3e-8415-ff7f4e7da15f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:20.302410 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a8d86d9c-91df-4e3e-8415-ff7f4e7da15f tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1689 microversion: 2.1 time: 0.190712 May 19 05:14:20.303584 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3052/6013] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:20 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:20.450748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-afa33c5f-187f-4911-b3e8-ac8bec32bbc6 req-a2858e4b-651d-4bee-b3a9-28847571b45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c19de9-763d-4364-8d9e-5e17867b03bb", "name": "network-vif-deleted", "tag": "d0224c58-58f7-40ac-900f-0923c7da9e2f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:20.460833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-afa33c5f-187f-4911-b3e8-ac8bec32bbc6 req-a2858e4b-651d-4bee-b3a9-28847571b45c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:20.461351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-afa33c5f-187f-4911-b3e8-ac8bec32bbc6 req-a2858e4b-651d-4bee-b3a9-28847571b45c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:20.476762 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-afa33c5f-187f-4911-b3e8-ac8bec32bbc6 req-a2858e4b-651d-4bee-b3a9-28847571b45c service nova] Creating event network-vif-deleted:d0224c58-58f7-40ac-900f-0923c7da9e2f for instance 69c19de9-763d-4364-8d9e-5e17867b03bb on n-h1-766726-30 May 19 05:14:20.482042 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-afa33c5f-187f-4911-b3e8-ac8bec32bbc6 req-a2858e4b-651d-4bee-b3a9-28847571b45c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036144 May 19 05:14:20.482650 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2962/6014] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:14:20.967347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:20.968201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:20.976201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:20.976746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:20.978291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:20.978941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:21.020837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:21.021395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:21.021920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lazy-loading 'fault' on Instance uuid 69c19de9-763d-4364-8d9e-5e17867b03bb {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:14:21.095530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21be8a1f15ac40c7851356be4dc2ce32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc642d868cb74f45b8df137d93a42e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:21.114249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a5068ee1-c941-495d-a1bc-ada1d3f8637c tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 200 len: 1338 microversion: 2.1 time: 0.151842 May 19 05:14:21.117240 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3053/6015] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:20 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 1338 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:21.321194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3a7e37a8-f5ff-4471-afdb-3aecab179169 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:21.321899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3a7e37a8-f5ff-4471-afdb-3aecab179169 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:21.332168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a7e37a8-f5ff-4471-afdb-3aecab179169 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:21.332625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a7e37a8-f5ff-4471-afdb-3aecab179169 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:21.333462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a7e37a8-f5ff-4471-afdb-3aecab179169 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:21.333914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3a7e37a8-f5ff-4471-afdb-3aecab179169 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:21.496131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3a7e37a8-f5ff-4471-afdb-3aecab179169 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:21.504090 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3a7e37a8-f5ff-4471-afdb-3aecab179169 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1695 microversion: 2.1 time: 0.188060 May 19 05:14:21.513555 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2963/6016] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:21 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1695 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:22.134621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:22.136953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] [instance: 69c19de9-763d-4364-8d9e-5e17867b03bb] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:22.144924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:22.145736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:22.146720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:22.147557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:22.162785 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] HTTP exception thrown: Instance 69c19de9-763d-4364-8d9e-5e17867b03bb could not be found. May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Request method failure captured: May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb HTTP/1.1 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdFZR2hH4xVO4SsV0HNaPNxDJTWGLsBVZRFR_0Ye_aCNViAunh1p814jjZ4hiBgPGBF06mgOWY8DyloPd936OL3oVqPPAZi9Yv4i-3nHprpNzBJHwSE4JLhPVAh2Rqt5LIALM5kniW5fq3t5K6Y0wwNLLkrrZM2dO0Q_OLzfFPTT7Vo May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: fc642d868cb74f45b8df137d93a42e07 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestNetworkBasicOps-939864809 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc642d868cb74f45b8df137d93a42e07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestNetworkBasicOps-939864809 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: fc642d868cb74f45b8df137d93a42e07 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestNetworkBasicOps-939864809 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestNetworkBasicOps-939864809-project May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 21be8a1f15ac40c7851356be4dc2ce32 May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestNetworkBasicOps-939864809-project May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 69c19de9-763d-4364-8d9e-5e17867b03bb could not be found. May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '69c19de9-763d-4364-8d9e-5e17867b03bb'} May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c19de9-763d-4364-8d9e-5e17867b03bb could not be found. May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c19de9-763d-4364-8d9e-5e17867b03bb could not be found. May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:14:22.164983 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:22.168821 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:14:22.168821 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:14:22.168821 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:14:22.168821 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:14:22.168821 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:14:22.168821 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c19de9-763d-4364-8d9e-5e17867b03bb could not be found. May 19 05:14:22.168821 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:14:22.171230 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Returning 404 to user: Instance 69c19de9-763d-4364-8d9e-5e17867b03bb could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:14:22.172343 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c6af5e56-2ddd-41b6-88f3-a472f55bfde0 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb" status: 404 len: 111 microversion: 2.1 time: 0.042505 May 19 05:14:22.173613 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3054/6017] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:22 2022] GET /compute/v2.1/servers/69c19de9-763d-4364-8d9e-5e17867b03bb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:14:22.358680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d315274e-4801-430c-abd6-0dde96cc1f24 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] Calling method '.version_select at 0x7fd315b21c10>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:22.379950 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d315274e-4801-430c-abd6-0dde96cc1f24 tempest-TestNetworkBasicOps-939864809 tempest-TestNetworkBasicOps-939864809-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2123729745" status: 202 len: 0 microversion: 2.1 time: 0.026625 May 19 05:14:22.380915 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2964/6018] 10.222.0.58 () {58 vars in 1256 bytes} [Thu May 19 05:14:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2123729745 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:14:22.523697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4bf1e13f-7b56-4b51-b55f-b6f51eb507a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:22.525361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4bf1e13f-7b56-4b51-b55f-b6f51eb507a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:22.534387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bf1e13f-7b56-4b51-b55f-b6f51eb507a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:22.536050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bf1e13f-7b56-4b51-b55f-b6f51eb507a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:22.541867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bf1e13f-7b56-4b51-b55f-b6f51eb507a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:22.542744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4bf1e13f-7b56-4b51-b55f-b6f51eb507a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:22.699685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4bf1e13f-7b56-4b51-b55f-b6f51eb507a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:22.707987 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4bf1e13f-7b56-4b51-b55f-b6f51eb507a2 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1695 microversion: 2.1 time: 0.188933 May 19 05:14:22.709339 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3055/6019] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:22 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:23.727160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a11181c5-b0bf-4d2b-9899-bde3ed91e24a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:14:23.728280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a11181c5-b0bf-4d2b-9899-bde3ed91e24a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:23.744321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a11181c5-b0bf-4d2b-9899-bde3ed91e24a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:23.744790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a11181c5-b0bf-4d2b-9899-bde3ed91e24a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:23.745627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a11181c5-b0bf-4d2b-9899-bde3ed91e24a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:23.746081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a11181c5-b0bf-4d2b-9899-bde3ed91e24a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:23.962233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a11181c5-b0bf-4d2b-9899-bde3ed91e24a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:14:23.974181 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a11181c5-b0bf-4d2b-9899-bde3ed91e24a tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1680 microversion: 2.1 time: 0.251776 May 19 05:14:23.976130 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2965/6020] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:14:23 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1680 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:14:25.724611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-25e01726-6d8c-4ba1-8b05-d127cf93b49e req-27d60fd0-b22c-4a75-87e5-92d06ffd3304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1345188-9717-403c-8337-5fa23c2cbcf2", "name": "network-vif-unplugged", "status": "completed", "tag": "448dce41-f2fc-428b-b3eb-d9445e06f8dd"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:25.736999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-25e01726-6d8c-4ba1-8b05-d127cf93b49e req-27d60fd0-b22c-4a75-87e5-92d06ffd3304 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:25.742896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-25e01726-6d8c-4ba1-8b05-d127cf93b49e req-27d60fd0-b22c-4a75-87e5-92d06ffd3304 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:25.768711 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-25e01726-6d8c-4ba1-8b05-d127cf93b49e req-27d60fd0-b22c-4a75-87e5-92d06ffd3304 service nova] Creating event network-vif-unplugged:448dce41-f2fc-428b-b3eb-d9445e06f8dd for instance a1345188-9717-403c-8337-5fa23c2cbcf2 on n-h2-766726-30 May 19 05:14:25.780732 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-25e01726-6d8c-4ba1-8b05-d127cf93b49e req-27d60fd0-b22c-4a75-87e5-92d06ffd3304 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060175 May 19 05:14:25.781698 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3056/6021] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:14:29.312431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1a1bbb14-d5a5-428e-af7e-ccec9c7059bc req-5132f04f-9cc2-44a6-a930-26da1dd457a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1345188-9717-403c-8337-5fa23c2cbcf2", "name": "network-vif-plugged", "status": "completed", "tag": "448dce41-f2fc-428b-b3eb-d9445e06f8dd"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:29.323031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1a1bbb14-d5a5-428e-af7e-ccec9c7059bc req-5132f04f-9cc2-44a6-a930-26da1dd457a7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:29.323688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1a1bbb14-d5a5-428e-af7e-ccec9c7059bc req-5132f04f-9cc2-44a6-a930-26da1dd457a7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:29.339871 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1a1bbb14-d5a5-428e-af7e-ccec9c7059bc req-5132f04f-9cc2-44a6-a930-26da1dd457a7 service nova] Creating event network-vif-plugged:448dce41-f2fc-428b-b3eb-d9445e06f8dd for instance a1345188-9717-403c-8337-5fa23c2cbcf2 on n-h2-766726-30 May 19 05:14:29.347106 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1a1bbb14-d5a5-428e-af7e-ccec9c7059bc req-5132f04f-9cc2-44a6-a930-26da1dd457a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038605 May 19 05:14:29.347891 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2966/6022] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:14:48.180535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:48.182082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=22 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:14:48.186917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c7eaf8f-59f6-48e1-8493-5eda301c6d2e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:14:48.187943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c7eaf8f-59f6-48e1-8493-5eda301c6d2e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:14:48.195642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf8f-59f6-48e1-8493-5eda301c6d2e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:48.196103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf8f-59f6-48e1-8493-5eda301c6d2e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:48.196858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf8f-59f6-48e1-8493-5eda301c6d2e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:14:48.197344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c7eaf8f-59f6-48e1-8493-5eda301c6d2e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:14:48.244806 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c7eaf8f-59f6-48e1-8493-5eda301c6d2e tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "POST /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2/action" status: 200 len: 24567 microversion: 2.1 time: 0.066146 May 19 05:14:48.246350 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3057/6023] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:14:48 2022] POST /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2/action => generated 24567 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:15:00.139096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c0cf17ea-54e2-45be-8b58-71cb090c3572 req-66ca2dd9-c5ea-4674-bdc3-4688c612565b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1345188-9717-403c-8337-5fa23c2cbcf2", "tag": "448dce41-f2fc-428b-b3eb-d9445e06f8dd"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:15:00.141203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:00.142972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=32 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:00.150743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:00.154090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00490d33-93dd-496f-a7a5-63246d8e8811 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:00.154965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00490d33-93dd-496f-a7a5-63246d8e8811 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:00.158879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:00.172388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00490d33-93dd-496f-a7a5-63246d8e8811 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:00.173212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00490d33-93dd-496f-a7a5-63246d8e8811 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:00.174021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00490d33-93dd-496f-a7a5-63246d8e8811 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:00.174462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00490d33-93dd-496f-a7a5-63246d8e8811 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:00.179123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c0cf17ea-54e2-45be-8b58-71cb090c3572 req-66ca2dd9-c5ea-4674-bdc3-4688c612565b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:00.185802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c0cf17ea-54e2-45be-8b58-71cb090c3572 req-66ca2dd9-c5ea-4674-bdc3-4688c612565b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:00.205113 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c0cf17ea-54e2-45be-8b58-71cb090c3572 req-66ca2dd9-c5ea-4674-bdc3-4688c612565b service nova] Creating event network-changed:448dce41-f2fc-428b-b3eb-d9445e06f8dd for instance a1345188-9717-403c-8337-5fa23c2cbcf2 on n-h2-766726-30 May 19 05:15:00.213715 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c0cf17ea-54e2-45be-8b58-71cb090c3572 req-66ca2dd9-c5ea-4674-bdc3-4688c612565b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078647 May 19 05:15:00.215539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00490d33-93dd-496f-a7a5-63246d8e8811 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:15:00.218599 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3058/6024] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:15:00.314250 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00490d33-93dd-496f-a7a5-63246d8e8811 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 204 len: 0 microversion: 2.1 time: 0.180536 May 19 05:15:00.316179 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2967/6025] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:15:00 2022] DELETE /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:15:00.326564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a1a64e96-66d9-48f6-86da-fd2139bd2496 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:00.327278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a1a64e96-66d9-48f6-86da-fd2139bd2496 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:00.333830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1a64e96-66d9-48f6-86da-fd2139bd2496 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:00.334284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1a64e96-66d9-48f6-86da-fd2139bd2496 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:00.335088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1a64e96-66d9-48f6-86da-fd2139bd2496 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:00.335724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a1a64e96-66d9-48f6-86da-fd2139bd2496 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:00.475065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a1a64e96-66d9-48f6-86da-fd2139bd2496 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:00.483325 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a1a64e96-66d9-48f6-86da-fd2139bd2496 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1686 microversion: 2.1 time: 0.162464 May 19 05:15:00.484053 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3059/6026] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:00 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:01.501735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3a32897-58b1-421f-b25d-621015ea37d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:01.502952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c3a32897-58b1-421f-b25d-621015ea37d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:01.509963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a32897-58b1-421f-b25d-621015ea37d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:01.510528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a32897-58b1-421f-b25d-621015ea37d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:01.511403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a32897-58b1-421f-b25d-621015ea37d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:01.512065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3a32897-58b1-421f-b25d-621015ea37d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:01.822118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c3a32897-58b1-421f-b25d-621015ea37d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:01.830329 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3a32897-58b1-421f-b25d-621015ea37d4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1686 microversion: 2.1 time: 0.333013 May 19 05:15:01.830915 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2968/6027] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:01 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1686 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:02.599889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-49a249f0-eeab-4c37-a383-4cfb7fc2831a req-90a5fe9d-f1f6-4493-b66e-b853c7c4ad2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1345188-9717-403c-8337-5fa23c2cbcf2", "name": "network-vif-deleted", "tag": "448dce41-f2fc-428b-b3eb-d9445e06f8dd"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:15:02.609129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-49a249f0-eeab-4c37-a383-4cfb7fc2831a req-90a5fe9d-f1f6-4493-b66e-b853c7c4ad2d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:02.609578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-49a249f0-eeab-4c37-a383-4cfb7fc2831a req-90a5fe9d-f1f6-4493-b66e-b853c7c4ad2d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:02.621794 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-49a249f0-eeab-4c37-a383-4cfb7fc2831a req-90a5fe9d-f1f6-4493-b66e-b853c7c4ad2d service nova] Creating event network-vif-deleted:448dce41-f2fc-428b-b3eb-d9445e06f8dd for instance a1345188-9717-403c-8337-5fa23c2cbcf2 on n-h2-766726-30 May 19 05:15:02.626603 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-49a249f0-eeab-4c37-a383-4cfb7fc2831a req-90a5fe9d-f1f6-4493-b66e-b853c7c4ad2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 May 19 05:15:02.627204 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3060/6028] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:15:02.848135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:02.848756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:02.855737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:02.856190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:02.856954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:02.857420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:02.892003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:02.892458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:02.892913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lazy-loading 'fault' on Instance uuid a1345188-9717-403c-8337-5fa23c2cbcf2 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:15:02.947554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195b7b4b7d384374ac86bdeaf7568026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3105ae3b914f4ac8a2a5466915fba229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:02.969805 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-75f81493-82ee-4631-9f1b-8256cd662ce5 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 200 len: 1354 microversion: 2.1 time: 0.125252 May 19 05:15:02.982446 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2969/6029] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:02 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 1354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:03.990842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:03.991549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] [instance: a1345188-9717-403c-8337-5fa23c2cbcf2] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:03.998476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:03.998928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:03.999707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:04.000148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:04.014552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] HTTP exception thrown: Instance a1345188-9717-403c-8337-5fa23c2cbcf2 could not be found. May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Request method failure captured: May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 HTTP/1.1 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdBO1QaW5oc4f6Vrz9_NwPhOHXbWiDxmYrQKBdrJO1vjGvboRoh4Us4Qrl0niQvSpcbSKRZNOYd3wYZZ01n2S0A2Bcn-Shs64HIMUTvoCt-SNOaQMD9yf8DNih5M2vO7lT6UGNcxHOrZVfsf9K5fDqo0Bx0-_bGZxsamgPJQjmNVycw May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 3105ae3b914f4ac8a2a5466915fba229 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3105ae3b914f4ac8a2a5466915fba229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 3105ae3b914f4ac8a2a5466915fba229 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1985069588 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestNetworkAdvancedServerOps-1985069588-project May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 195b7b4b7d384374ac86bdeaf7568026 May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1985069588-project May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance a1345188-9717-403c-8337-5fa23c2cbcf2 could not be found. May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'a1345188-9717-403c-8337-5fa23c2cbcf2'} May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1345188-9717-403c-8337-5fa23c2cbcf2 could not be found. May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1345188-9717-403c-8337-5fa23c2cbcf2 could not be found. May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:15:04.016216 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1345188-9717-403c-8337-5fa23c2cbcf2 could not be found. May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Returning 404 to user: Instance a1345188-9717-403c-8337-5fa23c2cbcf2 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1498dc6f-32d1-4215-8037-90a367a0e6fb tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2" status: 404 len: 111 microversion: 2.1 time: 0.031948 May 19 05:15:04.020797 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3061/6030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:03 2022] GET /compute/v2.1/servers/a1345188-9717-403c-8337-5fa23c2cbcf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:15:07.141521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fe819db2-2445-4b29-bb93-2748915ea2a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] Calling method '.version_select at 0x7fd315a660d0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:07.164069 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fe819db2-2445-4b29-bb93-2748915ea2a4 tempest-TestNetworkAdvancedServerOps-1985069588 tempest-TestNetworkAdvancedServerOps-1985069588-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-604918559" status: 202 len: 0 microversion: 2.1 time: 0.026483 May 19 05:15:07.165347 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2970/6031] 10.222.0.58 () {58 vars in 1280 bytes} [Thu May 19 05:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-604918559 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:15:37.010022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4d77dd5c-3ccb-4831-bdbd-4f2098abae2c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Action: 'create', calling method: .version_select at 0x7fd315dd44c0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1034319445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDfWlDhnYmSocYG7R3d2SiySDV/98NUKyJbSgDDLPWLS+VvepY5dM4YlzsQ4+NH66spO4JwCngUCAcbEQOiJ2Hxc3pU5oQ7L+UGsLu4TcZ+WlsCyyrs5jYAG4UwKmT3EA=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:15:37.014490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:37.015150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:37.026859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4d77dd5c-3ccb-4831-bdbd-4f2098abae2c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Getting quotas for project 755eec6c837341719d3c7ba790a970f5. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:15:37.032635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4d77dd5c-3ccb-4831-bdbd-4f2098abae2c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Getting quotas for user f70f65ae6e4c455ca8a7212580704592 and project 755eec6c837341719d3c7ba790a970f5. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:15:37.060526 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4d77dd5c-3ccb-4831-bdbd-4f2098abae2c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054525 May 19 05:15:37.061407 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3062/6032] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:15:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:15:38.004802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:38.005629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:38.010273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1016011585", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "742b27cb-6372-47ee-9d57-7bfc4b417f21", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1034319445", "security_groups": [{"name": "tempest-secgroup-smoke-1833535517"}], "networks": [{"uuid": "bc3ccd4d-46df-48f5-8ecd-6ab440c7734c"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:15:38.124470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] validate_networks() for [('bc3ccd4d-46df-48f5-8ecd-6ab440c7734c', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:15:38.487895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:15:38.488321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:15:38.488794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:15:38.489273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:15:38.489686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:15:38.499410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:38.499859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:38.500661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:38.501107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:38.518166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Getting quotas for project 755eec6c837341719d3c7ba790a970f5. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:15:38.524490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Getting quotas for user f70f65ae6e4c455ca8a7212580704592 and project 755eec6c837341719d3c7ba790a970f5. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:15:38.586701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:15:38.588886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='742b27cb-6372-47ee-9d57-7bfc4b417f21',volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:15:38.718513 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a30c7061-948f-4a70-8c1a-6cf86c21b9c8 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715619 May 19 05:15:38.719269 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2971/6033] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:15:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:15:38.731712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a30eba57-1aee-4df3-81d9-1588ec2e1163 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:38.732333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a30eba57-1aee-4df3-81d9-1588ec2e1163 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:38.787606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a30eba57-1aee-4df3-81d9-1588ec2e1163 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:38.795091 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a30eba57-1aee-4df3-81d9-1588ec2e1163 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1099 microversion: 2.1 time: 0.068748 May 19 05:15:38.795660 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3063/6034] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:38 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1099 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:39.813218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b87f2e3f-171f-430f-b4a3-0c4297ce2a7f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:39.814393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b87f2e3f-171f-430f-b4a3-0c4297ce2a7f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:39.820361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b87f2e3f-171f-430f-b4a3-0c4297ce2a7f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:39.820899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b87f2e3f-171f-430f-b4a3-0c4297ce2a7f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:39.821790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b87f2e3f-171f-430f-b4a3-0c4297ce2a7f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:39.822866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b87f2e3f-171f-430f-b4a3-0c4297ce2a7f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:39.898890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b87f2e3f-171f-430f-b4a3-0c4297ce2a7f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:39.906873 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b87f2e3f-171f-430f-b4a3-0c4297ce2a7f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1215 microversion: 2.1 time: 0.098446 May 19 05:15:39.908043 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2972/6035] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:39 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:40.924997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6bba78de-a332-4004-9839-e63a1897b80c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:40.925656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6bba78de-a332-4004-9839-e63a1897b80c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:40.932961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bba78de-a332-4004-9839-e63a1897b80c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:40.933438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bba78de-a332-4004-9839-e63a1897b80c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:40.934214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bba78de-a332-4004-9839-e63a1897b80c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:40.934650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6bba78de-a332-4004-9839-e63a1897b80c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:41.181037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6bba78de-a332-4004-9839-e63a1897b80c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:41.190346 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6bba78de-a332-4004-9839-e63a1897b80c tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1283 microversion: 2.1 time: 0.269273 May 19 05:15:41.190934 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3064/6036] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:40 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1283 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:41.620156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2fddfdfe-e496-4a2a-96aa-ccbc0fa71ddb req-0178f64e-8a79-450f-9805-36b8aabe7a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2114b932-5ec9-4c08-8255-a736639b727a", "tag": "568d246d-cca4-4464-892b-aed1de082e04"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:15:41.643023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2fddfdfe-e496-4a2a-96aa-ccbc0fa71ddb req-0178f64e-8a79-450f-9805-36b8aabe7a3e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:41.643786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2fddfdfe-e496-4a2a-96aa-ccbc0fa71ddb req-0178f64e-8a79-450f-9805-36b8aabe7a3e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:41.659585 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2fddfdfe-e496-4a2a-96aa-ccbc0fa71ddb req-0178f64e-8a79-450f-9805-36b8aabe7a3e service nova] Creating event network-changed:568d246d-cca4-4464-892b-aed1de082e04 for instance 2114b932-5ec9-4c08-8255-a736639b727a on n-h2-766726-30 May 19 05:15:41.667305 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2fddfdfe-e496-4a2a-96aa-ccbc0fa71ddb req-0178f64e-8a79-450f-9805-36b8aabe7a3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053531 May 19 05:15:41.668360 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2973/6037] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:15:42.207130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b6a0c709-2701-4281-ac27-50d374dc343d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:42.207745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b6a0c709-2701-4281-ac27-50d374dc343d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:42.214977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6a0c709-2701-4281-ac27-50d374dc343d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:42.215644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6a0c709-2701-4281-ac27-50d374dc343d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:42.216412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6a0c709-2701-4281-ac27-50d374dc343d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:42.217022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6a0c709-2701-4281-ac27-50d374dc343d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:42.441501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b6a0c709-2701-4281-ac27-50d374dc343d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:42.449811 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b6a0c709-2701-4281-ac27-50d374dc343d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1283 microversion: 2.1 time: 0.246578 May 19 05:15:42.450386 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3065/6038] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:42 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1283 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:43.468197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3358d5a5-cc8f-43c8-b122-9e5d9c4efc2e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:43.469034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3358d5a5-cc8f-43c8-b122-9e5d9c4efc2e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:43.475705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3358d5a5-cc8f-43c8-b122-9e5d9c4efc2e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:43.476161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3358d5a5-cc8f-43c8-b122-9e5d9c4efc2e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:43.476934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3358d5a5-cc8f-43c8-b122-9e5d9c4efc2e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:43.477400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3358d5a5-cc8f-43c8-b122-9e5d9c4efc2e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:43.615618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3358d5a5-cc8f-43c8-b122-9e5d9c4efc2e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:43.623916 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3358d5a5-cc8f-43c8-b122-9e5d9c4efc2e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1283 microversion: 2.1 time: 0.160940 May 19 05:15:43.624504 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2974/6039] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:43 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:15:44.640418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6acd3275-7cc3-4c21-9be3-4c69e7f07cc7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:44.641060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6acd3275-7cc3-4c21-9be3-4c69e7f07cc7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:44.648078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6acd3275-7cc3-4c21-9be3-4c69e7f07cc7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:44.648526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6acd3275-7cc3-4c21-9be3-4c69e7f07cc7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:44.649317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6acd3275-7cc3-4c21-9be3-4c69e7f07cc7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:44.649752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6acd3275-7cc3-4c21-9be3-4c69e7f07cc7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:44.780240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6acd3275-7cc3-4c21-9be3-4c69e7f07cc7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:44.788045 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6acd3275-7cc3-4c21-9be3-4c69e7f07cc7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1283 microversion: 2.1 time: 0.151584 May 19 05:15:44.788630 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3066/6040] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:44 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1283 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:45.804246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df380a8e-070d-4646-b3d5-989cfc54c690 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:45.805577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-df380a8e-070d-4646-b3d5-989cfc54c690 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:45.815736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df380a8e-070d-4646-b3d5-989cfc54c690 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:45.816230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df380a8e-070d-4646-b3d5-989cfc54c690 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:45.817024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df380a8e-070d-4646-b3d5-989cfc54c690 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:45.818055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df380a8e-070d-4646-b3d5-989cfc54c690 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:45.964304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df380a8e-070d-4646-b3d5-989cfc54c690 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:45.973338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-df380a8e-070d-4646-b3d5-989cfc54c690 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1283 microversion: 2.1 time: 0.172889 May 19 05:15:45.974203 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2975/6041] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:45 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1283 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:15:46.990708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8747377a-5289-4af8-b917-d1f9b6df878f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:46.991361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8747377a-5289-4af8-b917-d1f9b6df878f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:46.998882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8747377a-5289-4af8-b917-d1f9b6df878f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:46.999333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8747377a-5289-4af8-b917-d1f9b6df878f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:47.000098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8747377a-5289-4af8-b917-d1f9b6df878f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:47.000537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8747377a-5289-4af8-b917-d1f9b6df878f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:47.132465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8747377a-5289-4af8-b917-d1f9b6df878f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:47.141600 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8747377a-5289-4af8-b917-d1f9b6df878f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1283 microversion: 2.1 time: 0.154198 May 19 05:15:47.141600 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3067/6042] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:46 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1283 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:48.159140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c3dbdd77-5ff3-440d-a305-18075098d1b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:48.159764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c3dbdd77-5ff3-440d-a305-18075098d1b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:48.167603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3dbdd77-5ff3-440d-a305-18075098d1b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:48.168059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3dbdd77-5ff3-440d-a305-18075098d1b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:48.168842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3dbdd77-5ff3-440d-a305-18075098d1b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:48.169317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c3dbdd77-5ff3-440d-a305-18075098d1b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:48.302073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c3dbdd77-5ff3-440d-a305-18075098d1b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:48.310802 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c3dbdd77-5ff3-440d-a305-18075098d1b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1283 microversion: 2.1 time: 0.155628 May 19 05:15:48.311389 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2976/6043] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:48 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1283 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:49.328110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d77d9668-cb89-4fa4-8a9e-03046110aa6a tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:49.328766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d77d9668-cb89-4fa4-8a9e-03046110aa6a tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:49.332032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:49.337731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d77d9668-cb89-4fa4-8a9e-03046110aa6a tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:49.338190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d77d9668-cb89-4fa4-8a9e-03046110aa6a tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:49.338994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d77d9668-cb89-4fa4-8a9e-03046110aa6a tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:49.339473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d77d9668-cb89-4fa4-8a9e-03046110aa6a tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:49.475040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d77d9668-cb89-4fa4-8a9e-03046110aa6a tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:49.482825 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d77d9668-cb89-4fa4-8a9e-03046110aa6a tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1283 microversion: 2.1 time: 0.158660 May 19 05:15:49.483410 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3068/6044] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:49 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1283 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:50.499535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e8f0e4a-d78c-4121-b922-3fa712e59139 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:50.500145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e8f0e4a-d78c-4121-b922-3fa712e59139 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:50.502171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:50.502848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:15:50.510928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e8f0e4a-d78c-4121-b922-3fa712e59139 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:50.511373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e8f0e4a-d78c-4121-b922-3fa712e59139 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:50.512141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e8f0e4a-d78c-4121-b922-3fa712e59139 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:50.512580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e8f0e4a-d78c-4121-b922-3fa712e59139 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:50.650215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e8f0e4a-d78c-4121-b922-3fa712e59139 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:50.658447 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e8f0e4a-d78c-4121-b922-3fa712e59139 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.162871 May 19 05:15:50.659058 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2977/6045] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:50 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:51.675121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b472f85d-6046-4c19-9708-9b3645977b59 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:51.675736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b472f85d-6046-4c19-9708-9b3645977b59 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:51.682728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b472f85d-6046-4c19-9708-9b3645977b59 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:51.683173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b472f85d-6046-4c19-9708-9b3645977b59 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:51.683957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b472f85d-6046-4c19-9708-9b3645977b59 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:51.684389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b472f85d-6046-4c19-9708-9b3645977b59 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:51.815545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b472f85d-6046-4c19-9708-9b3645977b59 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:51.822984 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b472f85d-6046-4c19-9708-9b3645977b59 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.151891 May 19 05:15:51.823561 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3069/6046] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:51 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:52.839561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6745896e-e741-4f32-8703-322e9c20063e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:52.840181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6745896e-e741-4f32-8703-322e9c20063e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:52.847148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6745896e-e741-4f32-8703-322e9c20063e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:52.847621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6745896e-e741-4f32-8703-322e9c20063e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:52.848642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6745896e-e741-4f32-8703-322e9c20063e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:52.849095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6745896e-e741-4f32-8703-322e9c20063e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:52.976435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6745896e-e741-4f32-8703-322e9c20063e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:52.984507 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6745896e-e741-4f32-8703-322e9c20063e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.148897 May 19 05:15:52.985107 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2978/6047] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:52 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:54.001872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fad157e4-c59b-43bd-b563-47de75318695 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:54.002483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fad157e4-c59b-43bd-b563-47de75318695 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:54.009382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fad157e4-c59b-43bd-b563-47de75318695 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:54.009874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fad157e4-c59b-43bd-b563-47de75318695 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:54.011207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fad157e4-c59b-43bd-b563-47de75318695 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:54.011638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fad157e4-c59b-43bd-b563-47de75318695 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:54.143159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fad157e4-c59b-43bd-b563-47de75318695 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:54.150814 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fad157e4-c59b-43bd-b563-47de75318695 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.152935 May 19 05:15:54.151397 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3070/6048] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:53 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:55.168156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-caac8b22-e896-4233-910b-9b2b8f2dfff2 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:55.168814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-caac8b22-e896-4233-910b-9b2b8f2dfff2 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:55.175817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-caac8b22-e896-4233-910b-9b2b8f2dfff2 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:55.176276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-caac8b22-e896-4233-910b-9b2b8f2dfff2 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:55.177050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-caac8b22-e896-4233-910b-9b2b8f2dfff2 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:55.177520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-caac8b22-e896-4233-910b-9b2b8f2dfff2 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:55.308623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-caac8b22-e896-4233-910b-9b2b8f2dfff2 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:55.316359 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-caac8b22-e896-4233-910b-9b2b8f2dfff2 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.152723 May 19 05:15:55.317005 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2979/6049] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:55 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:56.332946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c29bc0b4-5918-4639-a053-bd623256d7eb tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:56.333637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c29bc0b4-5918-4639-a053-bd623256d7eb tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:56.341298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c29bc0b4-5918-4639-a053-bd623256d7eb tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:56.341749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c29bc0b4-5918-4639-a053-bd623256d7eb tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:56.342509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c29bc0b4-5918-4639-a053-bd623256d7eb tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:56.342946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c29bc0b4-5918-4639-a053-bd623256d7eb tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:56.470257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c29bc0b4-5918-4639-a053-bd623256d7eb tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:56.477990 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c29bc0b4-5918-4639-a053-bd623256d7eb tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.148924 May 19 05:15:56.478566 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3071/6050] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:56 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:57.494833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2393f5b2-c025-4dcf-a5f8-9c255383eba7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:57.495446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2393f5b2-c025-4dcf-a5f8-9c255383eba7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:57.502224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2393f5b2-c025-4dcf-a5f8-9c255383eba7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:57.502674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2393f5b2-c025-4dcf-a5f8-9c255383eba7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:57.503429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2393f5b2-c025-4dcf-a5f8-9c255383eba7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:57.503865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2393f5b2-c025-4dcf-a5f8-9c255383eba7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:57.640979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2393f5b2-c025-4dcf-a5f8-9c255383eba7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:57.648447 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2393f5b2-c025-4dcf-a5f8-9c255383eba7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.157758 May 19 05:15:57.649017 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2980/6051] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:57 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:58.665450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bdfe40f4-8c15-435d-a913-0c9164bd570d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:58.666105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bdfe40f4-8c15-435d-a913-0c9164bd570d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:58.673709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdfe40f4-8c15-435d-a913-0c9164bd570d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:58.674164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdfe40f4-8c15-435d-a913-0c9164bd570d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:58.674934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdfe40f4-8c15-435d-a913-0c9164bd570d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:58.675371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdfe40f4-8c15-435d-a913-0c9164bd570d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:58.804550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bdfe40f4-8c15-435d-a913-0c9164bd570d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:15:58.812145 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bdfe40f4-8c15-435d-a913-0c9164bd570d tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.150710 May 19 05:15:58.812722 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3072/6052] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:58 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:15:59.829031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e275ddd8-c412-4d2a-9bd2-25702ccd45ba tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:15:59.829689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e275ddd8-c412-4d2a-9bd2-25702ccd45ba tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:15:59.836399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e275ddd8-c412-4d2a-9bd2-25702ccd45ba tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:59.836904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e275ddd8-c412-4d2a-9bd2-25702ccd45ba tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:59.837716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e275ddd8-c412-4d2a-9bd2-25702ccd45ba tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:59.838153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e275ddd8-c412-4d2a-9bd2-25702ccd45ba tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:59.877852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e9b0cabf-e4b1-4ee6-8afd-b251b4542aa2 req-5b2bca64-4463-4506-b3a1-5f5194c4aac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2114b932-5ec9-4c08-8255-a736639b727a", "name": "network-vif-plugged", "status": "completed", "tag": "568d246d-cca4-4464-892b-aed1de082e04"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:15:59.887968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e9b0cabf-e4b1-4ee6-8afd-b251b4542aa2 req-5b2bca64-4463-4506-b3a1-5f5194c4aac5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:15:59.888453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e9b0cabf-e4b1-4ee6-8afd-b251b4542aa2 req-5b2bca64-4463-4506-b3a1-5f5194c4aac5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:15:59.902077 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e9b0cabf-e4b1-4ee6-8afd-b251b4542aa2 req-5b2bca64-4463-4506-b3a1-5f5194c4aac5 service nova] Creating event network-vif-plugged:568d246d-cca4-4464-892b-aed1de082e04 for instance 2114b932-5ec9-4c08-8255-a736639b727a on n-h2-766726-30 May 19 05:15:59.907984 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e9b0cabf-e4b1-4ee6-8afd-b251b4542aa2 req-5b2bca64-4463-4506-b3a1-5f5194c4aac5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 May 19 05:15:59.908775 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3073/6053] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:15:59.994871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e275ddd8-c412-4d2a-9bd2-25702ccd45ba tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:00.002953 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e275ddd8-c412-4d2a-9bd2-25702ccd45ba tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.178020 May 19 05:16:00.003723 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2981/6054] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:15:59 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:01.019845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eeae5bef-d008-4aeb-bd5b-7db20d63eab1 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:01.021099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eeae5bef-d008-4aeb-bd5b-7db20d63eab1 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:01.031259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeae5bef-d008-4aeb-bd5b-7db20d63eab1 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:01.031711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeae5bef-d008-4aeb-bd5b-7db20d63eab1 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:01.032497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeae5bef-d008-4aeb-bd5b-7db20d63eab1 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:01.032927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eeae5bef-d008-4aeb-bd5b-7db20d63eab1 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:01.182839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eeae5bef-d008-4aeb-bd5b-7db20d63eab1 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:01.191035 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eeae5bef-d008-4aeb-bd5b-7db20d63eab1 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1271 microversion: 2.1 time: 0.175574 May 19 05:16:01.191624 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3074/6055] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:01 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:02.207895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-beea8416-243a-4baf-a640-1028314e5634 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:02.208437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-beea8416-243a-4baf-a640-1028314e5634 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:02.215578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-beea8416-243a-4baf-a640-1028314e5634 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:02.216020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-beea8416-243a-4baf-a640-1028314e5634 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:02.216778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-beea8416-243a-4baf-a640-1028314e5634 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:02.217247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-beea8416-243a-4baf-a640-1028314e5634 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:02.352069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-beea8416-243a-4baf-a640-1028314e5634 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:02.360362 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-beea8416-243a-4baf-a640-1028314e5634 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1461 microversion: 2.1 time: 0.156531 May 19 05:16:02.360940 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2982/6056] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:02 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1461 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:02.376877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aeb2c7d2-06aa-40c1-b65c-23bd6a9a1d2b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:02.377515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aeb2c7d2-06aa-40c1-b65c-23bd6a9a1d2b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:02.384825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aeb2c7d2-06aa-40c1-b65c-23bd6a9a1d2b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:02.385330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aeb2c7d2-06aa-40c1-b65c-23bd6a9a1d2b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:02.386104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aeb2c7d2-06aa-40c1-b65c-23bd6a9a1d2b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:02.386550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aeb2c7d2-06aa-40c1-b65c-23bd6a9a1d2b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:02.520426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aeb2c7d2-06aa-40c1-b65c-23bd6a9a1d2b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:02.528070 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aeb2c7d2-06aa-40c1-b65c-23bd6a9a1d2b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1461 microversion: 2.1 time: 0.155051 May 19 05:16:02.528647 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3075/6057] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:02 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1461 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:16:04.287260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bb6d7a88-a395-4173-8457-49c2fffb544c req-6a9d39ea-ba0f-438c-a1ad-993163507ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2114b932-5ec9-4c08-8255-a736639b727a", "tag": "568d246d-cca4-4464-892b-aed1de082e04"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:16:04.300454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bb6d7a88-a395-4173-8457-49c2fffb544c req-6a9d39ea-ba0f-438c-a1ad-993163507ba9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:04.300913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bb6d7a88-a395-4173-8457-49c2fffb544c req-6a9d39ea-ba0f-438c-a1ad-993163507ba9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:04.314818 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bb6d7a88-a395-4173-8457-49c2fffb544c req-6a9d39ea-ba0f-438c-a1ad-993163507ba9 service nova] Creating event network-changed:568d246d-cca4-4464-892b-aed1de082e04 for instance 2114b932-5ec9-4c08-8255-a736639b727a on n-h2-766726-30 May 19 05:16:04.322936 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bb6d7a88-a395-4173-8457-49c2fffb544c req-6a9d39ea-ba0f-438c-a1ad-993163507ba9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037681 May 19 05:16:04.322936 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2983/6058] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:16:05.223783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-323ef16a-35ec-4c35-8243-6d9abe9ecc0c req-0c332e1c-0f84-438d-a752-ca2051a254c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2114b932-5ec9-4c08-8255-a736639b727a", "tag": "568d246d-cca4-4464-892b-aed1de082e04"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:16:05.232876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-323ef16a-35ec-4c35-8243-6d9abe9ecc0c req-0c332e1c-0f84-438d-a752-ca2051a254c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:05.233740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-323ef16a-35ec-4c35-8243-6d9abe9ecc0c req-0c332e1c-0f84-438d-a752-ca2051a254c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:05.250462 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-323ef16a-35ec-4c35-8243-6d9abe9ecc0c req-0c332e1c-0f84-438d-a752-ca2051a254c1 service nova] Creating event network-changed:568d246d-cca4-4464-892b-aed1de082e04 for instance 2114b932-5ec9-4c08-8255-a736639b727a on n-h2-766726-30 May 19 05:16:05.256036 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-323ef16a-35ec-4c35-8243-6d9abe9ecc0c req-0c332e1c-0f84-438d-a752-ca2051a254c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036786 May 19 05:16:05.256851 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3076/6059] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:16:07.272175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b8d4628e-ee38-4953-b495-e112978c29e9 req-46437ff2-f99e-409f-917b-4ee69a26f108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2114b932-5ec9-4c08-8255-a736639b727a", "tag": "568d246d-cca4-4464-892b-aed1de082e04"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:16:07.280763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b8d4628e-ee38-4953-b495-e112978c29e9 req-46437ff2-f99e-409f-917b-4ee69a26f108 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:07.281243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b8d4628e-ee38-4953-b495-e112978c29e9 req-46437ff2-f99e-409f-917b-4ee69a26f108 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:07.294602 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b8d4628e-ee38-4953-b495-e112978c29e9 req-46437ff2-f99e-409f-917b-4ee69a26f108 service nova] Creating event network-changed:568d246d-cca4-4464-892b-aed1de082e04 for instance 2114b932-5ec9-4c08-8255-a736639b727a on n-h2-766726-30 May 19 05:16:07.299446 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b8d4628e-ee38-4953-b495-e112978c29e9 req-46437ff2-f99e-409f-917b-4ee69a26f108 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032369 May 19 05:16:07.300046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2984/6060] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:16:30.979030 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:16:30.979609 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:16:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:16:39.155042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:16:39.155879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=70 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:16:39.157502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:16:39.158518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=68 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:16:39.160742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6b02c620-d122-4632-86da-5c3a0fcdd090 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:39.161397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6b02c620-d122-4632-86da-5c3a0fcdd090 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:39.168804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b02c620-d122-4632-86da-5c3a0fcdd090 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:39.169289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b02c620-d122-4632-86da-5c3a0fcdd090 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:39.170289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b02c620-d122-4632-86da-5c3a0fcdd090 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:39.170927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6b02c620-d122-4632-86da-5c3a0fcdd090 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:39.198053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6b02c620-d122-4632-86da-5c3a0fcdd090 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:16:39.282168 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6b02c620-d122-4632-86da-5c3a0fcdd090 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 204 len: 0 microversion: 2.1 time: 0.128925 May 19 05:16:39.282996 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3077/6061] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:16:39 2022] DELETE /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:16:39.292083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9bd4936a-ffd0-4ab4-bb34-5d718dca9082 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:39.292790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9bd4936a-ffd0-4ab4-bb34-5d718dca9082 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:39.299390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd4936a-ffd0-4ab4-bb34-5d718dca9082 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:39.299842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd4936a-ffd0-4ab4-bb34-5d718dca9082 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:39.300670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd4936a-ffd0-4ab4-bb34-5d718dca9082 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:39.301129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd4936a-ffd0-4ab4-bb34-5d718dca9082 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:39.332882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-362321bc-eac9-45ef-be2f-fe1179e430e9 req-e8e583df-182c-44d4-b404-3331225b239c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2114b932-5ec9-4c08-8255-a736639b727a", "tag": "568d246d-cca4-4464-892b-aed1de082e04"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:16:39.341906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-362321bc-eac9-45ef-be2f-fe1179e430e9 req-e8e583df-182c-44d4-b404-3331225b239c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:39.342364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-362321bc-eac9-45ef-be2f-fe1179e430e9 req-e8e583df-182c-44d4-b404-3331225b239c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:39.354866 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-362321bc-eac9-45ef-be2f-fe1179e430e9 req-e8e583df-182c-44d4-b404-3331225b239c service nova] Creating event network-changed:568d246d-cca4-4464-892b-aed1de082e04 for instance 2114b932-5ec9-4c08-8255-a736639b727a on n-h2-766726-30 May 19 05:16:39.360198 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-362321bc-eac9-45ef-be2f-fe1179e430e9 req-e8e583df-182c-44d4-b404-3331225b239c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206113 May 19 05:16:39.361006 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2985/6062] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:16:39.448995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9bd4936a-ffd0-4ab4-bb34-5d718dca9082 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:39.457689 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9bd4936a-ffd0-4ab4-bb34-5d718dca9082 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1586 microversion: 2.1 time: 0.170180 May 19 05:16:39.458309 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3078/6063] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:39 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1586 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:40.477235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-176f541b-b3e0-4f5d-9483-e68662e7d292 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:40.477971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-176f541b-b3e0-4f5d-9483-e68662e7d292 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:40.484316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-176f541b-b3e0-4f5d-9483-e68662e7d292 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:40.484770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-176f541b-b3e0-4f5d-9483-e68662e7d292 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:40.485568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-176f541b-b3e0-4f5d-9483-e68662e7d292 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:40.486008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-176f541b-b3e0-4f5d-9483-e68662e7d292 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:40.616377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-176f541b-b3e0-4f5d-9483-e68662e7d292 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:40.624576 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-176f541b-b3e0-4f5d-9483-e68662e7d292 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1586 microversion: 2.1 time: 0.152804 May 19 05:16:40.625158 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2986/6064] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:40 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1586 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:41.641825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e5d644d-7833-4d75-8f76-ad065d97289f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:41.642449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9e5d644d-7833-4d75-8f76-ad065d97289f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:41.649909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e5d644d-7833-4d75-8f76-ad065d97289f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:41.650447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e5d644d-7833-4d75-8f76-ad065d97289f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:41.651578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e5d644d-7833-4d75-8f76-ad065d97289f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:41.652018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e5d644d-7833-4d75-8f76-ad065d97289f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:41.656870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-edf11664-608c-448b-9d8e-08f58ca51f38 req-62562d2a-679a-4da1-9da4-f6d76e3df7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2114b932-5ec9-4c08-8255-a736639b727a", "name": "network-vif-deleted", "tag": "568d246d-cca4-4464-892b-aed1de082e04"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:16:41.666750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-edf11664-608c-448b-9d8e-08f58ca51f38 req-62562d2a-679a-4da1-9da4-f6d76e3df7fd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:41.667200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-edf11664-608c-448b-9d8e-08f58ca51f38 req-62562d2a-679a-4da1-9da4-f6d76e3df7fd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:41.680409 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-edf11664-608c-448b-9d8e-08f58ca51f38 req-62562d2a-679a-4da1-9da4-f6d76e3df7fd service nova] Creating event network-vif-deleted:568d246d-cca4-4464-892b-aed1de082e04 for instance 2114b932-5ec9-4c08-8255-a736639b727a on n-h2-766726-30 May 19 05:16:41.685768 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-edf11664-608c-448b-9d8e-08f58ca51f38 req-62562d2a-679a-4da1-9da4-f6d76e3df7fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033561 May 19 05:16:41.686460 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2987/6065] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:16:41.720665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9e5d644d-7833-4d75-8f76-ad065d97289f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:41.728850 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e5d644d-7833-4d75-8f76-ad065d97289f tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1399 microversion: 2.1 time: 0.091115 May 19 05:16:41.729473 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3079/6066] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:41 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1399 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:42.748465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d569a202-e214-444d-a77b-59c0b4b94e51 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:42.749221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d569a202-e214-444d-a77b-59c0b4b94e51 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:42.755593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d569a202-e214-444d-a77b-59c0b4b94e51 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:42.756043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d569a202-e214-444d-a77b-59c0b4b94e51 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:42.756816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d569a202-e214-444d-a77b-59c0b4b94e51 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:42.757326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d569a202-e214-444d-a77b-59c0b4b94e51 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:42.819914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d569a202-e214-444d-a77b-59c0b4b94e51 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:42.828155 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d569a202-e214-444d-a77b-59c0b4b94e51 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1230 microversion: 2.1 time: 0.084905 May 19 05:16:42.828733 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2988/6067] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:42 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1230 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:43.845205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-390c15f7-2f8d-4c4e-9303-8adfeac958ea tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:43.845860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-390c15f7-2f8d-4c4e-9303-8adfeac958ea tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:43.852831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-390c15f7-2f8d-4c4e-9303-8adfeac958ea tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:43.853341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-390c15f7-2f8d-4c4e-9303-8adfeac958ea tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:43.854101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-390c15f7-2f8d-4c4e-9303-8adfeac958ea tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:43.854553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-390c15f7-2f8d-4c4e-9303-8adfeac958ea tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:43.922168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-390c15f7-2f8d-4c4e-9303-8adfeac958ea tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:43.929947 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-390c15f7-2f8d-4c4e-9303-8adfeac958ea tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1230 microversion: 2.1 time: 0.088758 May 19 05:16:43.930527 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3080/6068] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:43 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:44.946694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fde39afa-020d-4a88-9585-0c5bdb9395e7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:44.947315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fde39afa-020d-4a88-9585-0c5bdb9395e7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:44.954123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fde39afa-020d-4a88-9585-0c5bdb9395e7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:44.954575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fde39afa-020d-4a88-9585-0c5bdb9395e7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:44.955339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fde39afa-020d-4a88-9585-0c5bdb9395e7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:44.955787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fde39afa-020d-4a88-9585-0c5bdb9395e7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:45.018194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fde39afa-020d-4a88-9585-0c5bdb9395e7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:45.025968 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fde39afa-020d-4a88-9585-0c5bdb9395e7 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1230 microversion: 2.1 time: 0.083229 May 19 05:16:45.026557 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2989/6069] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:44 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1230 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:46.042054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48b6d7a9-31ed-4200-94d2-bb4695f55258 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:46.042679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48b6d7a9-31ed-4200-94d2-bb4695f55258 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:46.050007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48b6d7a9-31ed-4200-94d2-bb4695f55258 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:46.050459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48b6d7a9-31ed-4200-94d2-bb4695f55258 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:46.051256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48b6d7a9-31ed-4200-94d2-bb4695f55258 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:46.051725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48b6d7a9-31ed-4200-94d2-bb4695f55258 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:46.115967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-48b6d7a9-31ed-4200-94d2-bb4695f55258 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:46.127229 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48b6d7a9-31ed-4200-94d2-bb4695f55258 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1230 microversion: 2.1 time: 0.087192 May 19 05:16:46.127803 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3081/6070] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:46 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:47.147314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0dba45a2-5932-44b9-afd3-84c77a5b8313 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:47.148224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0dba45a2-5932-44b9-afd3-84c77a5b8313 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:47.157436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0dba45a2-5932-44b9-afd3-84c77a5b8313 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:47.157892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0dba45a2-5932-44b9-afd3-84c77a5b8313 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:47.158671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0dba45a2-5932-44b9-afd3-84c77a5b8313 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:47.159111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0dba45a2-5932-44b9-afd3-84c77a5b8313 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:47.220756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0dba45a2-5932-44b9-afd3-84c77a5b8313 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:47.229004 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0dba45a2-5932-44b9-afd3-84c77a5b8313 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1230 microversion: 2.1 time: 0.085728 May 19 05:16:47.229858 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2990/6071] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:47 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:48.245947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d35f0c73-e273-40ff-aaa4-ea393f3bb4b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:48.246677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d35f0c73-e273-40ff-aaa4-ea393f3bb4b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:48.254174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d35f0c73-e273-40ff-aaa4-ea393f3bb4b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:48.254626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d35f0c73-e273-40ff-aaa4-ea393f3bb4b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:48.255390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d35f0c73-e273-40ff-aaa4-ea393f3bb4b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:48.255828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d35f0c73-e273-40ff-aaa4-ea393f3bb4b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:48.320241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d35f0c73-e273-40ff-aaa4-ea393f3bb4b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:48.328590 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d35f0c73-e273-40ff-aaa4-ea393f3bb4b4 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1230 microversion: 2.1 time: 0.086639 May 19 05:16:48.337684 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3082/6072] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:48 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:49.345314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6ce50d3-efa1-4f8b-a556-1288f7b5957e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:49.346074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6ce50d3-efa1-4f8b-a556-1288f7b5957e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:49.353689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6ce50d3-efa1-4f8b-a556-1288f7b5957e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:49.354146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6ce50d3-efa1-4f8b-a556-1288f7b5957e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:49.354958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6ce50d3-efa1-4f8b-a556-1288f7b5957e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:49.355405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6ce50d3-efa1-4f8b-a556-1288f7b5957e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:49.421710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d6ce50d3-efa1-4f8b-a556-1288f7b5957e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:49.429359 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6ce50d3-efa1-4f8b-a556-1288f7b5957e tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1230 microversion: 2.1 time: 0.088017 May 19 05:16:49.429970 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2991/6073] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:49 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:50.445776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0ad31f1a-8cdd-4add-86bd-0937639ad569 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:50.446392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0ad31f1a-8cdd-4add-86bd-0937639ad569 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:50.454000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ad31f1a-8cdd-4add-86bd-0937639ad569 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:50.454453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ad31f1a-8cdd-4add-86bd-0937639ad569 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:50.455248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ad31f1a-8cdd-4add-86bd-0937639ad569 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:50.455688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0ad31f1a-8cdd-4add-86bd-0937639ad569 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:50.520793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0ad31f1a-8cdd-4add-86bd-0937639ad569 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70f65ae6e4c455ca8a7212580704592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755eec6c837341719d3c7ba790a970f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:50.528941 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0ad31f1a-8cdd-4add-86bd-0937639ad569 tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 200 len: 1230 microversion: 2.1 time: 0.087184 May 19 05:16:50.529607 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3083/6074] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:50 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:51.547468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:51.548076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] [instance: 2114b932-5ec9-4c08-8255-a736639b727a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:51.555004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:51.555451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:51.556205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:51.556638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:51.570282 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] HTTP exception thrown: Instance 2114b932-5ec9-4c08-8255-a736639b727a could not be found. May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Request method failure captured: May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a HTTP/1.1 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdHO91UmINlfjYYZaKzmZZITB4DcdNdh71TfUCFbgeBlyBPNKyrkjoYQsqiZuW0eNco-5o3FM3cllmGP7Za12j87PWwLDoVdhZtFeyFjCCljZ3OCs160jG9S2-OcXtRd6eB7HmdhaaU7uuVILCZ1d2E43kYj0lm0UrHtmDYkVTY9zvM May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 755eec6c837341719d3c7ba790a970f5 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestVolumeBackupRestore-1958233669 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/755eec6c837341719d3c7ba790a970f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/755eec6c837341719d3c7ba790a970f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/755eec6c837341719d3c7ba790a970f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_755eec6c837341719d3c7ba790a970f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestVolumeBackupRestore-1958233669 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 755eec6c837341719d3c7ba790a970f5 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1958233669 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestVolumeBackupRestore-1958233669-project May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f70f65ae6e4c455ca8a7212580704592 May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestVolumeBackupRestore-1958233669-project May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2114b932-5ec9-4c08-8255-a736639b727a could not be found. May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2114b932-5ec9-4c08-8255-a736639b727a'} May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2114b932-5ec9-4c08-8255-a736639b727a could not be found. May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2114b932-5ec9-4c08-8255-a736639b727a could not be found. May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:16:51.571900 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2114b932-5ec9-4c08-8255-a736639b727a could not be found. May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Returning 404 to user: Instance 2114b932-5ec9-4c08-8255-a736639b727a could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-33911537-8ebb-4882-8ea7-a5e63943f03b tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a" status: 404 len: 111 microversion: 2.1 time: 0.030262 May 19 05:16:51.576995 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2992/6075] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:51 2022] GET /compute/v2.1/servers/2114b932-5ec9-4c08-8255-a736639b727a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:16:51.734664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af4ad9fa-0f44-4e6e-8e9b-71dd969770ee tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] Calling method '.version_select at 0x7fd314b9ee50>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:51.754629 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af4ad9fa-0f44-4e6e-8e9b-71dd969770ee tempest-TestVolumeBackupRestore-1958233669 tempest-TestVolumeBackupRestore-1958233669-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1034319445" status: 202 len: 0 microversion: 2.1 time: 0.024325 May 19 05:16:51.755441 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3084/6076] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 05:16:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1034319445 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:16:55.278791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac838ec0-f606-43c6-9e33-f4f761642701 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:55.280143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ac838ec0-f606-43c6-9e33-f4f761642701 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:55.287017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac838ec0-f606-43c6-9e33-f4f761642701 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:55.287579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac838ec0-f606-43c6-9e33-f4f761642701 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:55.288571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac838ec0-f606-43c6-9e33-f4f761642701 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:55.289117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac838ec0-f606-43c6-9e33-f4f761642701 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:55.316639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ac838ec0-f606-43c6-9e33-f4f761642701 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:16:55.403856 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac838ec0-f606-43c6-9e33-f4f761642701 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 204 len: 0 microversion: 2.1 time: 0.241594 May 19 05:16:55.405154 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2993/6077] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:16:55 2022] DELETE /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:16:55.415395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe1be0c0-f16f-4243-af97-9bc9f4dc78bc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:55.416025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fe1be0c0-f16f-4243-af97-9bc9f4dc78bc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:55.424349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe1be0c0-f16f-4243-af97-9bc9f4dc78bc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:55.424798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe1be0c0-f16f-4243-af97-9bc9f4dc78bc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:55.425633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe1be0c0-f16f-4243-af97-9bc9f4dc78bc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:55.426058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe1be0c0-f16f-4243-af97-9bc9f4dc78bc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:55.580367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fe1be0c0-f16f-4243-af97-9bc9f4dc78bc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:55.588728 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fe1be0c0-f16f-4243-af97-9bc9f4dc78bc tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1732 microversion: 2.1 time: 0.178218 May 19 05:16:55.589409 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3085/6078] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:55 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:56.608085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b183d821-2eb3-4856-a94a-4087bd311cfe tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:56.608830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b183d821-2eb3-4856-a94a-4087bd311cfe tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:56.616263 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b183d821-2eb3-4856-a94a-4087bd311cfe tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:56.616718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b183d821-2eb3-4856-a94a-4087bd311cfe tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:56.617572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b183d821-2eb3-4856-a94a-4087bd311cfe tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:56.618088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b183d821-2eb3-4856-a94a-4087bd311cfe tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:56.837675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b183d821-2eb3-4856-a94a-4087bd311cfe tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:56.846330 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b183d821-2eb3-4856-a94a-4087bd311cfe tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1732 microversion: 2.1 time: 0.243160 May 19 05:16:56.846927 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2994/6079] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:56 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:57.864544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8e824786-c677-4bc7-b08a-2ff3e69eb2c8 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:57.865821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e824786-c677-4bc7-b08a-2ff3e69eb2c8 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:57.873585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e824786-c677-4bc7-b08a-2ff3e69eb2c8 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:57.874904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e824786-c677-4bc7-b08a-2ff3e69eb2c8 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:57.875920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e824786-c677-4bc7-b08a-2ff3e69eb2c8 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:57.876515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e824786-c677-4bc7-b08a-2ff3e69eb2c8 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:57.963040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e824786-c677-4bc7-b08a-2ff3e69eb2c8 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed476fdeb1784b4c9decff54c7196e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05224e9048b3453a9bb767f77165e1ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:16:57.981656 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8e824786-c677-4bc7-b08a-2ff3e69eb2c8 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 200 len: 1665 microversion: 2.1 time: 0.120831 May 19 05:16:57.986477 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3086/6080] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:57 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 1665 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:16:58.213346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-606670ed-4730-4c3e-b707-789b2f098199 req-f3d26241-efea-4707-a37b-aa3d26430ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03c88f4-54ef-4d70-bfb0-a3e26ae78a28", "name": "network-vif-deleted", "tag": "29ea09a9-9f89-4ae9-90df-6a6dba81782d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:16:58.224721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-606670ed-4730-4c3e-b707-789b2f098199 req-f3d26241-efea-4707-a37b-aa3d26430ec9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:58.225859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-606670ed-4730-4c3e-b707-789b2f098199 req-f3d26241-efea-4707-a37b-aa3d26430ec9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:58.240970 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-606670ed-4730-4c3e-b707-789b2f098199 req-f3d26241-efea-4707-a37b-aa3d26430ec9 service nova] Creating event network-vif-deleted:29ea09a9-9f89-4ae9-90df-6a6dba81782d for instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 on n-h1-766726-30 May 19 05:16:58.248821 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-606670ed-4730-4c3e-b707-789b2f098199 req-f3d26241-efea-4707-a37b-aa3d26430ec9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038676 May 19 05:16:58.251214 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2995/6081] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:16:59.010681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:59.011900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:59.020516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:59.021223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:59.022168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:59.022766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:59.038427 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] HTTP exception thrown: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Request method failure captured: May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 HTTP/1.1 May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdGQkjsATSCL5FEZXbpOaZeIcMWsKvoPu45yhQIRwqSwwgy-SiBgfiKvS1Nv_NU2WH7hm2WshPA4qguf63Er2GwmqzMGQkyQHDlt12CU8uGzw2hut_ajVV33MWWB8TUsTkmyvMplBeMMCcSRctpaTvZ4csom_-6Bv1fLY5t4jytb0p8 May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 05224e9048b3453a9bb767f77165e1ed May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestServerBasicOps-1114872303 May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestServerBasicOps-1114872303 May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 05224e9048b3453a9bb767f77165e1ed May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestServerBasicOps-1114872303 May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestServerBasicOps-1114872303-project May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: ed476fdeb1784b4c9decff54c7196e12 May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestServerBasicOps-1114872303-project May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'e03c88f4-54ef-4d70-bfb0-a3e26ae78a28'} May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:16:59.040124 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.044800 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:59.044800 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:16:59.044800 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:16:59.044800 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:16:59.044800 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:16:59.044800 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.044800 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.044800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Returning 404 to user: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:16:59.044800 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d9a5aa6-2be5-4170-bda4-c8c4f585bd1f tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 404 len: 111 microversion: 2.1 time: 0.046357 May 19 05:16:59.049246 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3087/6082] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:58 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 05:16:59.578766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:59.579364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:59.587177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:59.587879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:59.588665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:59.589133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:59.603168 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] HTTP exception thrown: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Request method failure captured: May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 HTTP/1.1 May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdGQkjsATSCL5FEZXbpOaZeIcMWsKvoPu45yhQIRwqSwwgy-SiBgfiKvS1Nv_NU2WH7hm2WshPA4qguf63Er2GwmqzMGQkyQHDlt12CU8uGzw2hut_ajVV33MWWB8TUsTkmyvMplBeMMCcSRctpaTvZ4csom_-6Bv1fLY5t4jytb0p8 May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 05224e9048b3453a9bb767f77165e1ed May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestServerBasicOps-1114872303 May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestServerBasicOps-1114872303 May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 05224e9048b3453a9bb767f77165e1ed May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestServerBasicOps-1114872303 May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestServerBasicOps-1114872303-project May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: ed476fdeb1784b4c9decff54c7196e12 May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestServerBasicOps-1114872303-project May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'e03c88f4-54ef-4d70-bfb0-a3e26ae78a28'} May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:16:59.604885 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Returning 404 to user: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4add384d-60f7-4050-a9c6-bb1bbf029dcf tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 404 len: 111 microversion: 2.1 time: 0.032604 May 19 05:16:59.609308 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2996/6083] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:16:59 2022] DELETE /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:16:59.615991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:59.616695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] [instance: e03c88f4-54ef-4d70-bfb0-a3e26ae78a28] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:16:59.623533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:59.625167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:59.625519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:16:59.626029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:16:59.644295 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] HTTP exception thrown: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Request method failure captured: May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 HTTP/1.1 May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdGQkjsATSCL5FEZXbpOaZeIcMWsKvoPu45yhQIRwqSwwgy-SiBgfiKvS1Nv_NU2WH7hm2WshPA4qguf63Er2GwmqzMGQkyQHDlt12CU8uGzw2hut_ajVV33MWWB8TUsTkmyvMplBeMMCcSRctpaTvZ4csom_-6Bv1fLY5t4jytb0p8 May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 05224e9048b3453a9bb767f77165e1ed May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestServerBasicOps-1114872303 May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05224e9048b3453a9bb767f77165e1ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestServerBasicOps-1114872303 May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 05224e9048b3453a9bb767f77165e1ed May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestServerBasicOps-1114872303 May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestServerBasicOps-1114872303-project May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: ed476fdeb1784b4c9decff54c7196e12 May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestServerBasicOps-1114872303-project May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'e03c88f4-54ef-4d70-bfb0-a3e26ae78a28'} May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:16:59.646019 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.650061 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:16:59.650061 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:16:59.650061 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:16:59.650061 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:16:59.650061 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:16:59.650061 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. May 19 05:16:59.650061 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:16:59.650061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Returning 404 to user: Instance e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:16:59.650061 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1fa9d2fc-50a6-4687-8a96-7fc9b09f7cd0 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28" status: 404 len: 111 microversion: 2.1 time: 0.036918 May 19 05:16:59.665190 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3088/6084] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:16:59 2022] GET /compute/v2.1/servers/e03c88f4-54ef-4d70-bfb0-a3e26ae78a28 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:16:59.843167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d25c821d-b482-45ae-b3b7-5d09412c3bb9 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] Calling method '.version_select at 0x7fd3143f5e50>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:16:59.882477 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d25c821d-b482-45ae-b3b7-5d09412c3bb9 tempest-TestServerBasicOps-1114872303 tempest-TestServerBasicOps-1114872303-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1168433506" status: 202 len: 0 microversion: 2.1 time: 0.042783 May 19 05:16:59.883361 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2997/6085] 10.222.0.58 () {58 vars in 1253 bytes} [Thu May 19 05:16:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1168433506 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:17:23.993049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:23.994032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:23.998674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1678601010", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bd69641d-3be7-4a23-a0b9-b9ceece47d8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94ba7b5a-9245-470a-85b7-9f9506544cde"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:17:24.185343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] validate_networks() for [('94ba7b5a-9245-470a-85b7-9f9506544cde', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:17:24.693246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:17:24.693704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:17:24.694188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:17:24.694639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:17:24.695060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:17:24.705149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:24.705611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:24.706426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:24.706871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:24.726543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:17:24.731960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for user dd4805bce1b245fda6cf7b31ceda6ba3 and project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:17:24.793197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:17:24.795203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd69641d-3be7-4a23-a0b9-b9ceece47d8d',volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:17:24.959487 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5514f594-f3b7-4bcd-8879-e69dd3fc5ac9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967611 May 19 05:17:24.960201 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3089/6086] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:17:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:17:24.969976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:24.970447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:24.977772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0a13094e-1b12-488c-a7b8-c7f9962ee171 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:24.978784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0a13094e-1b12-488c-a7b8-c7f9962ee171 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:25.044411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0a13094e-1b12-488c-a7b8-c7f9962ee171 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:25.056762 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0a13094e-1b12-488c-a7b8-c7f9962ee171 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1057 microversion: 2.1 time: 0.088228 May 19 05:17:25.059523 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2998/6087] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:24 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1057 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:26.074160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e1acfeb3-16e8-44c1-9417-b7637fe1a3f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:26.075397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e1acfeb3-16e8-44c1-9417-b7637fe1a3f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:26.084309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1acfeb3-16e8-44c1-9417-b7637fe1a3f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:26.085002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1acfeb3-16e8-44c1-9417-b7637fe1a3f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:26.085940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1acfeb3-16e8-44c1-9417-b7637fe1a3f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:26.086482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1acfeb3-16e8-44c1-9417-b7637fe1a3f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:26.187319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e1acfeb3-16e8-44c1-9417-b7637fe1a3f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:26.203008 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e1acfeb3-16e8-44c1-9417-b7637fe1a3f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1173 microversion: 2.1 time: 0.132985 May 19 05:17:26.203684 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3090/6088] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:26 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1173 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:27.219934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2248e7bd-ce83-4165-81e8-44e00679e5c6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:27.221282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2248e7bd-ce83-4165-81e8-44e00679e5c6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:27.229248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2248e7bd-ce83-4165-81e8-44e00679e5c6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:27.230008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2248e7bd-ce83-4165-81e8-44e00679e5c6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:27.231052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2248e7bd-ce83-4165-81e8-44e00679e5c6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:27.231565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2248e7bd-ce83-4165-81e8-44e00679e5c6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:27.435473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2248e7bd-ce83-4165-81e8-44e00679e5c6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:27.444679 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2248e7bd-ce83-4165-81e8-44e00679e5c6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1215 microversion: 2.1 time: 0.228638 May 19 05:17:27.445418 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 2999/6089] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:27 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:27.718340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0401433f-29e5-4aab-b565-800f98616664 req-4937a226-e38e-4789-8560-bb33861ef1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b6b50a-6236-4012-97ce-7a16f957f75e", "tag": "f3e16850-f8d0-42d9-897d-6f6c5d7e1710"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:17:27.732450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0401433f-29e5-4aab-b565-800f98616664 req-4937a226-e38e-4789-8560-bb33861ef1b3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:27.733182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0401433f-29e5-4aab-b565-800f98616664 req-4937a226-e38e-4789-8560-bb33861ef1b3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:27.755951 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0401433f-29e5-4aab-b565-800f98616664 req-4937a226-e38e-4789-8560-bb33861ef1b3 service nova] Creating event network-changed:f3e16850-f8d0-42d9-897d-6f6c5d7e1710 for instance 75b6b50a-6236-4012-97ce-7a16f957f75e on n-h2-766726-30 May 19 05:17:27.765034 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0401433f-29e5-4aab-b565-800f98616664 req-4937a226-e38e-4789-8560-bb33861ef1b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050285 May 19 05:17:27.766093 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3091/6090] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:17:28.461786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59ad985c-2912-456e-a4d8-4ebed14e5fb1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:28.463240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-59ad985c-2912-456e-a4d8-4ebed14e5fb1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:28.470407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59ad985c-2912-456e-a4d8-4ebed14e5fb1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:28.470864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59ad985c-2912-456e-a4d8-4ebed14e5fb1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:28.471638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59ad985c-2912-456e-a4d8-4ebed14e5fb1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:28.472076 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59ad985c-2912-456e-a4d8-4ebed14e5fb1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:28.696674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-59ad985c-2912-456e-a4d8-4ebed14e5fb1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:28.706078 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59ad985c-2912-456e-a4d8-4ebed14e5fb1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1215 microversion: 2.1 time: 0.248311 May 19 05:17:28.707089 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3000/6091] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:28 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:29.724296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4f496879-eb74-4c77-82c4-eafe52a08e74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:29.725003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4f496879-eb74-4c77-82c4-eafe52a08e74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:29.731594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f496879-eb74-4c77-82c4-eafe52a08e74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:29.732341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f496879-eb74-4c77-82c4-eafe52a08e74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:29.733104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f496879-eb74-4c77-82c4-eafe52a08e74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:29.733545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f496879-eb74-4c77-82c4-eafe52a08e74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:29.871945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4f496879-eb74-4c77-82c4-eafe52a08e74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:29.880289 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4f496879-eb74-4c77-82c4-eafe52a08e74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1215 microversion: 2.1 time: 0.161128 May 19 05:17:29.880868 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3092/6092] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:29 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:30.897734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ad91708-96f8-41e8-9d92-6758b7d5e853 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:30.898499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ad91708-96f8-41e8-9d92-6758b7d5e853 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:30.905462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ad91708-96f8-41e8-9d92-6758b7d5e853 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:30.906002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ad91708-96f8-41e8-9d92-6758b7d5e853 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:30.906751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ad91708-96f8-41e8-9d92-6758b7d5e853 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:30.907189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ad91708-96f8-41e8-9d92-6758b7d5e853 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:31.050019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5ad91708-96f8-41e8-9d92-6758b7d5e853 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:31.057836 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ad91708-96f8-41e8-9d92-6758b7d5e853 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1215 microversion: 2.1 time: 0.164695 May 19 05:17:31.058682 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3001/6093] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:30 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:32.075273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-36355f2f-6e75-43e0-b5fd-71471cef0eab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:32.075896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-36355f2f-6e75-43e0-b5fd-71471cef0eab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:32.083440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36355f2f-6e75-43e0-b5fd-71471cef0eab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:32.083894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36355f2f-6e75-43e0-b5fd-71471cef0eab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:32.084655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36355f2f-6e75-43e0-b5fd-71471cef0eab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:32.085119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36355f2f-6e75-43e0-b5fd-71471cef0eab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:32.216079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-36355f2f-6e75-43e0-b5fd-71471cef0eab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:32.223895 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-36355f2f-6e75-43e0-b5fd-71471cef0eab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1215 microversion: 2.1 time: 0.152453 May 19 05:17:32.224459 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3093/6094] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:32 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:33.242414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6ef92ce9-ddb1-4136-abe0-b7cc8928e9ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:33.243204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6ef92ce9-ddb1-4136-abe0-b7cc8928e9ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:33.251130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ef92ce9-ddb1-4136-abe0-b7cc8928e9ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:33.251633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ef92ce9-ddb1-4136-abe0-b7cc8928e9ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:33.252444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ef92ce9-ddb1-4136-abe0-b7cc8928e9ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:33.252994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ef92ce9-ddb1-4136-abe0-b7cc8928e9ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:33.390182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6ef92ce9-ddb1-4136-abe0-b7cc8928e9ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:33.399122 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6ef92ce9-ddb1-4136-abe0-b7cc8928e9ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1215 microversion: 2.1 time: 0.161220 May 19 05:17:33.399736 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3002/6095] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:33 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:34.415963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d6181a9c-c370-4805-bf75-3ee8052c2d4f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:34.416491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d6181a9c-c370-4805-bf75-3ee8052c2d4f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:34.423297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6181a9c-c370-4805-bf75-3ee8052c2d4f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:34.423740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6181a9c-c370-4805-bf75-3ee8052c2d4f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:34.424499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6181a9c-c370-4805-bf75-3ee8052c2d4f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:34.425474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6181a9c-c370-4805-bf75-3ee8052c2d4f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:34.563757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d6181a9c-c370-4805-bf75-3ee8052c2d4f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:34.571515 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d6181a9c-c370-4805-bf75-3ee8052c2d4f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1215 microversion: 2.1 time: 0.159596 May 19 05:17:34.572090 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3094/6096] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:34 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:35.587993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9825f781-14f6-4803-a379-e7fb4eeb4d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:35.588540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9825f781-14f6-4803-a379-e7fb4eeb4d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:35.591328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:35.597703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9825f781-14f6-4803-a379-e7fb4eeb4d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:35.598160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9825f781-14f6-4803-a379-e7fb4eeb4d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:35.598970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9825f781-14f6-4803-a379-e7fb4eeb4d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:35.599423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9825f781-14f6-4803-a379-e7fb4eeb4d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:35.734226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9825f781-14f6-4803-a379-e7fb4eeb4d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:35.746301 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9825f781-14f6-4803-a379-e7fb4eeb4d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1215 microversion: 2.1 time: 0.162079 May 19 05:17:35.747216 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3003/6097] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:35 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:36.764853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d9cfef22-7682-411a-983d-beefd3abd664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:36.765505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d9cfef22-7682-411a-983d-beefd3abd664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:36.767476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:36.768150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:36.775177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9cfef22-7682-411a-983d-beefd3abd664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:36.775617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9cfef22-7682-411a-983d-beefd3abd664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:36.776396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9cfef22-7682-411a-983d-beefd3abd664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:36.776850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9cfef22-7682-411a-983d-beefd3abd664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:36.901257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d9cfef22-7682-411a-983d-beefd3abd664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:36.908806 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d9cfef22-7682-411a-983d-beefd3abd664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.147907 May 19 05:17:36.909923 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3095/6098] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:36 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:37.926983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97182a38-3c22-4d44-b77d-208a2ea0a30b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:37.927609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97182a38-3c22-4d44-b77d-208a2ea0a30b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:37.934904 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97182a38-3c22-4d44-b77d-208a2ea0a30b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:37.935357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97182a38-3c22-4d44-b77d-208a2ea0a30b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:37.936118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97182a38-3c22-4d44-b77d-208a2ea0a30b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:37.936582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97182a38-3c22-4d44-b77d-208a2ea0a30b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:38.071525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-97182a38-3c22-4d44-b77d-208a2ea0a30b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:38.079223 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97182a38-3c22-4d44-b77d-208a2ea0a30b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.156748 May 19 05:17:38.079795 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3004/6099] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:37 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:39.097220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e805352-aa6e-48d3-a39f-6e605c17e68c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:39.097862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4e805352-aa6e-48d3-a39f-6e605c17e68c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:39.105629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e805352-aa6e-48d3-a39f-6e605c17e68c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:39.106081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e805352-aa6e-48d3-a39f-6e605c17e68c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:39.106887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e805352-aa6e-48d3-a39f-6e605c17e68c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:39.107326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e805352-aa6e-48d3-a39f-6e605c17e68c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:39.248355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4e805352-aa6e-48d3-a39f-6e605c17e68c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:39.255905 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4e805352-aa6e-48d3-a39f-6e605c17e68c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.163341 May 19 05:17:39.256494 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3096/6100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:39 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:40.272803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7d5d2f20-0d30-40fd-bebf-91d9c2c88490 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:40.273423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7d5d2f20-0d30-40fd-bebf-91d9c2c88490 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:40.280733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d5d2f20-0d30-40fd-bebf-91d9c2c88490 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:40.281214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d5d2f20-0d30-40fd-bebf-91d9c2c88490 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:40.281978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d5d2f20-0d30-40fd-bebf-91d9c2c88490 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:40.282414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7d5d2f20-0d30-40fd-bebf-91d9c2c88490 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:40.418994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7d5d2f20-0d30-40fd-bebf-91d9c2c88490 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:40.427024 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7d5d2f20-0d30-40fd-bebf-91d9c2c88490 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.158221 May 19 05:17:40.427592 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3005/6101] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:40 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:41.444193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-40b34153-7fb6-4f28-a0d3-09b304f38cd2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:41.444801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-40b34153-7fb6-4f28-a0d3-09b304f38cd2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:41.451790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40b34153-7fb6-4f28-a0d3-09b304f38cd2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:41.452235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40b34153-7fb6-4f28-a0d3-09b304f38cd2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:41.452990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40b34153-7fb6-4f28-a0d3-09b304f38cd2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:41.453449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40b34153-7fb6-4f28-a0d3-09b304f38cd2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:41.577389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-40b34153-7fb6-4f28-a0d3-09b304f38cd2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:41.585440 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-40b34153-7fb6-4f28-a0d3-09b304f38cd2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.145606 May 19 05:17:41.585955 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3097/6102] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:41 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:42.602225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5106e221-d276-47d2-9750-f1f1edeb2264 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:42.602838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5106e221-d276-47d2-9750-f1f1edeb2264 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:42.610073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5106e221-d276-47d2-9750-f1f1edeb2264 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:42.610526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5106e221-d276-47d2-9750-f1f1edeb2264 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:42.611294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5106e221-d276-47d2-9750-f1f1edeb2264 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:42.611732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5106e221-d276-47d2-9750-f1f1edeb2264 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:42.740569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5106e221-d276-47d2-9750-f1f1edeb2264 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:42.748170 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5106e221-d276-47d2-9750-f1f1edeb2264 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.150099 May 19 05:17:42.748748 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3006/6103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:42 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:43.765738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-61f8a3e4-91c4-4ec8-a374-f9ac5748f517 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:43.766359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-61f8a3e4-91c4-4ec8-a374-f9ac5748f517 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:43.773194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f8a3e4-91c4-4ec8-a374-f9ac5748f517 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:43.773641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f8a3e4-91c4-4ec8-a374-f9ac5748f517 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:43.774406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f8a3e4-91c4-4ec8-a374-f9ac5748f517 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:43.774847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-61f8a3e4-91c4-4ec8-a374-f9ac5748f517 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:43.905329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-61f8a3e4-91c4-4ec8-a374-f9ac5748f517 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:43.913635 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-61f8a3e4-91c4-4ec8-a374-f9ac5748f517 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.152093 May 19 05:17:43.914235 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3098/6104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:43 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:44.931060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-deea0bd2-715e-42e9-ab10-3e2562d937a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:44.931583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-deea0bd2-715e-42e9-ab10-3e2562d937a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:44.938286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deea0bd2-715e-42e9-ab10-3e2562d937a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:44.938737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deea0bd2-715e-42e9-ab10-3e2562d937a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:44.939500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deea0bd2-715e-42e9-ab10-3e2562d937a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:44.939960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-deea0bd2-715e-42e9-ab10-3e2562d937a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:45.067252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-deea0bd2-715e-42e9-ab10-3e2562d937a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:45.074791 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-deea0bd2-715e-42e9-ab10-3e2562d937a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.147911 May 19 05:17:45.075368 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3007/6105] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:44 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:46.091957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-25e78cd8-48c3-4f99-99ed-faaade99fc89 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:46.092610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-25e78cd8-48c3-4f99-99ed-faaade99fc89 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:46.101366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25e78cd8-48c3-4f99-99ed-faaade99fc89 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:46.101824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25e78cd8-48c3-4f99-99ed-faaade99fc89 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:46.102605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25e78cd8-48c3-4f99-99ed-faaade99fc89 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:46.103050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25e78cd8-48c3-4f99-99ed-faaade99fc89 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:46.234515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-25e78cd8-48c3-4f99-99ed-faaade99fc89 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:46.242313 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-25e78cd8-48c3-4f99-99ed-faaade99fc89 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.154319 May 19 05:17:46.242893 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3099/6106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:46 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:17:46.480483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e6719c4f-c029-4f3e-aa03-6431e1ee4001 req-06d0e10e-663d-452c-9a5f-b0a7b10fb746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b6b50a-6236-4012-97ce-7a16f957f75e", "name": "network-vif-plugged", "status": "completed", "tag": "f3e16850-f8d0-42d9-897d-6f6c5d7e1710"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:17:46.488683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e6719c4f-c029-4f3e-aa03-6431e1ee4001 req-06d0e10e-663d-452c-9a5f-b0a7b10fb746 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:46.489145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e6719c4f-c029-4f3e-aa03-6431e1ee4001 req-06d0e10e-663d-452c-9a5f-b0a7b10fb746 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:46.500261 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e6719c4f-c029-4f3e-aa03-6431e1ee4001 req-06d0e10e-663d-452c-9a5f-b0a7b10fb746 service nova] Creating event network-vif-plugged:f3e16850-f8d0-42d9-897d-6f6c5d7e1710 for instance 75b6b50a-6236-4012-97ce-7a16f957f75e on n-h2-766726-30 May 19 05:17:46.505916 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e6719c4f-c029-4f3e-aa03-6431e1ee4001 req-06d0e10e-663d-452c-9a5f-b0a7b10fb746 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103792 May 19 05:17:46.506502 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3008/6107] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:17:47.259666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-571bb8c2-26fa-401b-868a-e34d23f776da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:47.260281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-571bb8c2-26fa-401b-868a-e34d23f776da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:47.267343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-571bb8c2-26fa-401b-868a-e34d23f776da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:47.267796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-571bb8c2-26fa-401b-868a-e34d23f776da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:47.268566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-571bb8c2-26fa-401b-868a-e34d23f776da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:47.269012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-571bb8c2-26fa-401b-868a-e34d23f776da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:47.399072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-571bb8c2-26fa-401b-868a-e34d23f776da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:47.406682 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-571bb8c2-26fa-401b-868a-e34d23f776da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1203 microversion: 2.1 time: 0.150954 May 19 05:17:47.407265 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3100/6108] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:47 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:48.425912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c502362-1032-4138-a831-dd08db118a1c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:48.426613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c502362-1032-4138-a831-dd08db118a1c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:48.432896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c502362-1032-4138-a831-dd08db118a1c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:48.433390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c502362-1032-4138-a831-dd08db118a1c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:48.434169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c502362-1032-4138-a831-dd08db118a1c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:48.434609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c502362-1032-4138-a831-dd08db118a1c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:48.652701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c502362-1032-4138-a831-dd08db118a1c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:48.660390 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c502362-1032-4138-a831-dd08db118a1c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1390 microversion: 2.1 time: 0.240386 May 19 05:17:48.660968 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3009/6109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:48 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1390 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:48.676587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14c2e2ae-5138-4372-8914-162de1f51920 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:48.677318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14c2e2ae-5138-4372-8914-162de1f51920 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:48.684723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14c2e2ae-5138-4372-8914-162de1f51920 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:48.685205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14c2e2ae-5138-4372-8914-162de1f51920 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:48.685972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14c2e2ae-5138-4372-8914-162de1f51920 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:48.686410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14c2e2ae-5138-4372-8914-162de1f51920 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:48.908050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14c2e2ae-5138-4372-8914-162de1f51920 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:48.916400 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14c2e2ae-5138-4372-8914-162de1f51920 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1390 microversion: 2.1 time: 0.244132 May 19 05:17:48.916986 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3101/6110] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:48 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1390 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:48.932636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-885e36b2-9e75-4275-98b3-ffa90a368e0f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:48.933284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-885e36b2-9e75-4275-98b3-ffa90a368e0f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:48.939294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-885e36b2-9e75-4275-98b3-ffa90a368e0f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:48.939742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-885e36b2-9e75-4275-98b3-ffa90a368e0f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:48.940506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-885e36b2-9e75-4275-98b3-ffa90a368e0f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:48.940942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-885e36b2-9e75-4275-98b3-ffa90a368e0f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:49.128139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-885e36b2-9e75-4275-98b3-ffa90a368e0f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:49.136256 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-885e36b2-9e75-4275-98b3-ffa90a368e0f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1390 microversion: 2.1 time: 0.207490 May 19 05:17:49.136849 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3010/6111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:48 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1390 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:49.152535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-59a3ed11-0330-4339-bdc3-c35fbb229f14 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:49.153034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-59a3ed11-0330-4339-bdc3-c35fbb229f14 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:49.159384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59a3ed11-0330-4339-bdc3-c35fbb229f14 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:49.160402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59a3ed11-0330-4339-bdc3-c35fbb229f14 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:49.161196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59a3ed11-0330-4339-bdc3-c35fbb229f14 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:49.161634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-59a3ed11-0330-4339-bdc3-c35fbb229f14 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:49.188157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-59a3ed11-0330-4339-bdc3-c35fbb229f14 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:17:49.260991 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-59a3ed11-0330-4339-bdc3-c35fbb229f14 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 204 len: 0 microversion: 2.1 time: 0.112058 May 19 05:17:49.261613 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3102/6112] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:17:49 2022] DELETE /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:17:49.270277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d01237ee-32f9-4991-9d1c-4938071eaf99 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:49.270920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d01237ee-32f9-4991-9d1c-4938071eaf99 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:49.277197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d01237ee-32f9-4991-9d1c-4938071eaf99 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:49.277652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d01237ee-32f9-4991-9d1c-4938071eaf99 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:49.278419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d01237ee-32f9-4991-9d1c-4938071eaf99 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:49.278861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d01237ee-32f9-4991-9d1c-4938071eaf99 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:49.411480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d01237ee-32f9-4991-9d1c-4938071eaf99 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:49.419301 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d01237ee-32f9-4991-9d1c-4938071eaf99 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1396 microversion: 2.1 time: 0.153426 May 19 05:17:49.419886 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3011/6113] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:49 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:50.436394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7f45ac83-b826-4042-a84a-f475063b48ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:50.437208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7f45ac83-b826-4042-a84a-f475063b48ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:50.445339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f45ac83-b826-4042-a84a-f475063b48ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:50.445795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f45ac83-b826-4042-a84a-f475063b48ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:50.446559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f45ac83-b826-4042-a84a-f475063b48ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:50.447000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7f45ac83-b826-4042-a84a-f475063b48ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:50.574191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7f45ac83-b826-4042-a84a-f475063b48ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:50.582706 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7f45ac83-b826-4042-a84a-f475063b48ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1396 microversion: 2.1 time: 0.150693 May 19 05:17:50.583273 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3103/6114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:50 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1396 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:51.234166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b49b75f5-3d9c-4048-b5f0-6c372a9e9986 req-be8a9a03-4464-4619-a2f3-f4c4fda235c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b6b50a-6236-4012-97ce-7a16f957f75e", "name": "network-vif-deleted", "tag": "f3e16850-f8d0-42d9-897d-6f6c5d7e1710"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:17:51.243073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b49b75f5-3d9c-4048-b5f0-6c372a9e9986 req-be8a9a03-4464-4619-a2f3-f4c4fda235c7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:51.243529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b49b75f5-3d9c-4048-b5f0-6c372a9e9986 req-be8a9a03-4464-4619-a2f3-f4c4fda235c7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:51.257365 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b49b75f5-3d9c-4048-b5f0-6c372a9e9986 req-be8a9a03-4464-4619-a2f3-f4c4fda235c7 service nova] Creating event network-vif-deleted:f3e16850-f8d0-42d9-897d-6f6c5d7e1710 for instance 75b6b50a-6236-4012-97ce-7a16f957f75e on n-h2-766726-30 May 19 05:17:51.263195 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b49b75f5-3d9c-4048-b5f0-6c372a9e9986 req-be8a9a03-4464-4619-a2f3-f4c4fda235c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112137 May 19 05:17:51.264043 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3012/6115] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:17:51.599573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4aa700fe-bdce-40f6-8386-fbef78171afe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:51.600200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4aa700fe-bdce-40f6-8386-fbef78171afe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:51.607531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aa700fe-bdce-40f6-8386-fbef78171afe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:51.607986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aa700fe-bdce-40f6-8386-fbef78171afe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:51.608752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aa700fe-bdce-40f6-8386-fbef78171afe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:51.609218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aa700fe-bdce-40f6-8386-fbef78171afe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:51.669931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4aa700fe-bdce-40f6-8386-fbef78171afe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:51.678143 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4aa700fe-bdce-40f6-8386-fbef78171afe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1188 microversion: 2.1 time: 0.082534 May 19 05:17:51.678747 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3104/6116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:51 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1188 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:17:52.696663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ec6ad46b-69d0-4cf3-a5c1-d65a4433b255 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:52.697395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ec6ad46b-69d0-4cf3-a5c1-d65a4433b255 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:52.703722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec6ad46b-69d0-4cf3-a5c1-d65a4433b255 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:52.704176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec6ad46b-69d0-4cf3-a5c1-d65a4433b255 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:52.704935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec6ad46b-69d0-4cf3-a5c1-d65a4433b255 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:52.705396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec6ad46b-69d0-4cf3-a5c1-d65a4433b255 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:52.767787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ec6ad46b-69d0-4cf3-a5c1-d65a4433b255 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:52.775575 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ec6ad46b-69d0-4cf3-a5c1-d65a4433b255 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1188 microversion: 2.1 time: 0.084099 May 19 05:17:52.776158 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3013/6117] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:52 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:53.793298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-99461001-6fec-4a70-bf35-a5ee185e9d37 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:53.793912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-99461001-6fec-4a70-bf35-a5ee185e9d37 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:53.801328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99461001-6fec-4a70-bf35-a5ee185e9d37 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:53.801783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99461001-6fec-4a70-bf35-a5ee185e9d37 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:53.802539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99461001-6fec-4a70-bf35-a5ee185e9d37 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:53.802975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-99461001-6fec-4a70-bf35-a5ee185e9d37 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:53.807085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:53.868219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-99461001-6fec-4a70-bf35-a5ee185e9d37 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:53.875952 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-99461001-6fec-4a70-bf35-a5ee185e9d37 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1188 microversion: 2.1 time: 0.086680 May 19 05:17:53.876532 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3105/6118] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:53 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:54.893380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-457d0069-62a7-4124-8725-e29e00fa7334 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:54.894069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-457d0069-62a7-4124-8725-e29e00fa7334 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:54.901610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-457d0069-62a7-4124-8725-e29e00fa7334 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:54.902068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-457d0069-62a7-4124-8725-e29e00fa7334 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:54.902842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-457d0069-62a7-4124-8725-e29e00fa7334 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:54.903284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-457d0069-62a7-4124-8725-e29e00fa7334 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:54.966660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-457d0069-62a7-4124-8725-e29e00fa7334 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:54.974704 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-457d0069-62a7-4124-8725-e29e00fa7334 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1188 microversion: 2.1 time: 0.085310 May 19 05:17:54.975285 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3014/6119] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:54 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:55.991745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-15edb032-c02a-412b-a188-49c824b1dc15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:55.992298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-15edb032-c02a-412b-a188-49c824b1dc15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:55.995126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:56.000591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15edb032-c02a-412b-a188-49c824b1dc15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:56.001044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15edb032-c02a-412b-a188-49c824b1dc15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:56.001838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15edb032-c02a-412b-a188-49c824b1dc15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:56.002280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-15edb032-c02a-412b-a188-49c824b1dc15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:56.063607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-15edb032-c02a-412b-a188-49c824b1dc15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:56.072848 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-15edb032-c02a-412b-a188-49c824b1dc15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1188 microversion: 2.1 time: 0.085586 May 19 05:17:56.073477 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3106/6120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:55 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:57.089958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3d5ab84-413f-457f-91b9-bb2c963e08c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:57.090584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3d5ab84-413f-457f-91b9-bb2c963e08c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:57.093531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=37 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:57.099720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3d5ab84-413f-457f-91b9-bb2c963e08c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:57.100171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3d5ab84-413f-457f-91b9-bb2c963e08c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:57.100956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3d5ab84-413f-457f-91b9-bb2c963e08c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:57.101702 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3d5ab84-413f-457f-91b9-bb2c963e08c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:57.105948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=89 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:17:57.175719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3d5ab84-413f-457f-91b9-bb2c963e08c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:57.183597 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3d5ab84-413f-457f-91b9-bb2c963e08c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1188 microversion: 2.1 time: 0.097608 May 19 05:17:57.184187 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3015/6121] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:57 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:17:58.199974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-370f7560-8bfe-4e64-a18d-82c3ad4a0999 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:58.200583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-370f7560-8bfe-4e64-a18d-82c3ad4a0999 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:58.208676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-370f7560-8bfe-4e64-a18d-82c3ad4a0999 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:58.209146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-370f7560-8bfe-4e64-a18d-82c3ad4a0999 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:58.209940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-370f7560-8bfe-4e64-a18d-82c3ad4a0999 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:58.210400 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-370f7560-8bfe-4e64-a18d-82c3ad4a0999 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:58.274728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-370f7560-8bfe-4e64-a18d-82c3ad4a0999 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:58.282786 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-370f7560-8bfe-4e64-a18d-82c3ad4a0999 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1188 microversion: 2.1 time: 0.086711 May 19 05:17:58.283387 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3107/6122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:58 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:17:59.300065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f923a633-3299-43a5-98f0-3e8de7289340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:17:59.300683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f923a633-3299-43a5-98f0-3e8de7289340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:17:59.307467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f923a633-3299-43a5-98f0-3e8de7289340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:59.307930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f923a633-3299-43a5-98f0-3e8de7289340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:59.308707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f923a633-3299-43a5-98f0-3e8de7289340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:17:59.309180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f923a633-3299-43a5-98f0-3e8de7289340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:17:59.385877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f923a633-3299-43a5-98f0-3e8de7289340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:17:59.393686 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f923a633-3299-43a5-98f0-3e8de7289340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1188 microversion: 2.1 time: 0.097820 May 19 05:17:59.394822 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3016/6123] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:17:59 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:00.411470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:00.412096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:00.419370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:00.419825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:00.420652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:00.421125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:00.456381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:00.456957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:00.457444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lazy-loading 'fault' on Instance uuid 75b6b50a-6236-4012-97ce-7a16f957f75e {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:18:00.501348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:00.509843 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4131ead6-eba6-4220-89b9-01956d8f9135 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 200 len: 1147 microversion: 2.1 time: 0.102617 May 19 05:18:00.510453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3108/6124] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:00 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 1147 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:01.527220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:01.527829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 75b6b50a-6236-4012-97ce-7a16f957f75e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:01.534847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:01.535332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:01.536111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:01.536556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:01.550073 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 75b6b50a-6236-4012-97ce-7a16f957f75e could not be found. May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e HTTP/1.1 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 75b6b50a-6236-4012-97ce-7a16f957f75e could not be found. May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '75b6b50a-6236-4012-97ce-7a16f957f75e'} May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b6b50a-6236-4012-97ce-7a16f957f75e could not be found. May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b6b50a-6236-4012-97ce-7a16f957f75e could not be found. May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:18:01.552333 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b6b50a-6236-4012-97ce-7a16f957f75e could not be found. May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 75b6b50a-6236-4012-97ce-7a16f957f75e could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1af86df8-4ca1-4272-bd3d-6168f13db81d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e" status: 404 len: 111 microversion: 2.1 time: 0.030555 May 19 05:18:01.557270 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3017/6125] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:01 2022] GET /compute/v2.1/servers/75b6b50a-6236-4012-97ce-7a16f957f75e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:18:09.849428 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:18:09.850106 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:18:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:18:29.664108 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-313215921", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1c429bc7-06bd-4d55-8e80-5ca9c0fe6559", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "94ba7b5a-9245-470a-85b7-9f9506544cde"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:18:29.672157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=7 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:18:29.673013 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=24 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:18:29.754737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] validate_networks() for [('94ba7b5a-9245-470a-85b7-9f9506544cde', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:18:30.110448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:18:30.110872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:18:30.111344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:18:30.111750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:18:30.112160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:18:30.124684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:30.125161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:30.125956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:30.126503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:30.144381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:18:30.150291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for user dd4805bce1b245fda6cf7b31ceda6ba3 and project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:18:30.163857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:18:30.165925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1c429bc7-06bd-4d55-8e80-5ca9c0fe6559',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:18:30.235716 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-578903d3-7c7b-41e0-948b-c2b4d9a2355a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575609 May 19 05:18:30.236539 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3109/6126] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:18:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:18:30.247220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-902213b0-6580-4971-a7cb-47e9f8083607 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:30.247839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-902213b0-6580-4971-a7cb-47e9f8083607 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:30.249917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=5 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:18:30.250652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=13 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:18:30.303590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-902213b0-6580-4971-a7cb-47e9f8083607 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:30.310543 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-902213b0-6580-4971-a7cb-47e9f8083607 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1056 microversion: 2.1 time: 0.067762 May 19 05:18:30.311120 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3018/6127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:30 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1056 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:31.330504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eac125af-8a86-440c-bd10-cdddffa837f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:31.332021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eac125af-8a86-440c-bd10-cdddffa837f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:31.340653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eac125af-8a86-440c-bd10-cdddffa837f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:31.341239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eac125af-8a86-440c-bd10-cdddffa837f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:31.342093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eac125af-8a86-440c-bd10-cdddffa837f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:31.342538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eac125af-8a86-440c-bd10-cdddffa837f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:31.456008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eac125af-8a86-440c-bd10-cdddffa837f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:31.466101 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eac125af-8a86-440c-bd10-cdddffa837f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1126 microversion: 2.1 time: 0.139616 May 19 05:18:31.467478 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3110/6128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:31 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1126 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:32.485892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-22bc75ad-87cb-4438-b9d0-e86e9badc9f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:32.487224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-22bc75ad-87cb-4438-b9d0-e86e9badc9f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:32.497235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22bc75ad-87cb-4438-b9d0-e86e9badc9f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:32.498957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22bc75ad-87cb-4438-b9d0-e86e9badc9f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:32.500030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22bc75ad-87cb-4438-b9d0-e86e9badc9f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:32.500589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-22bc75ad-87cb-4438-b9d0-e86e9badc9f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:32.642887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fee7c45a-5ddf-4ace-a544-cd8e75abc876 req-72139777-3e3c-4350-8e93-243e14b9515f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b47bded-2e20-4d0a-8b0d-d926daf299de", "tag": "a768b1bf-5176-4aef-a9f8-2bcfaa4d04c7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:18:32.666789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fee7c45a-5ddf-4ace-a544-cd8e75abc876 req-72139777-3e3c-4350-8e93-243e14b9515f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:32.667438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fee7c45a-5ddf-4ace-a544-cd8e75abc876 req-72139777-3e3c-4350-8e93-243e14b9515f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:32.700562 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fee7c45a-5ddf-4ace-a544-cd8e75abc876 req-72139777-3e3c-4350-8e93-243e14b9515f service nova] Creating event network-changed:a768b1bf-5176-4aef-a9f8-2bcfaa4d04c7 for instance 8b47bded-2e20-4d0a-8b0d-d926daf299de on n-h2-766726-30 May 19 05:18:32.706621 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fee7c45a-5ddf-4ace-a544-cd8e75abc876 req-72139777-3e3c-4350-8e93-243e14b9515f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067506 May 19 05:18:32.707504 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3111/6129] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:18:32.845479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-22bc75ad-87cb-4438-b9d0-e86e9badc9f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:32.855037 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-22bc75ad-87cb-4438-b9d0-e86e9badc9f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.373087 May 19 05:18:32.856921 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3019/6130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:32 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:33.872796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86d38d15-d268-4462-8f75-563434952e57 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:33.874053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86d38d15-d268-4462-8f75-563434952e57 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:33.883212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86d38d15-d268-4462-8f75-563434952e57 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:33.884134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86d38d15-d268-4462-8f75-563434952e57 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:33.885354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86d38d15-d268-4462-8f75-563434952e57 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:33.886125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86d38d15-d268-4462-8f75-563434952e57 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:34.084326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86d38d15-d268-4462-8f75-563434952e57 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:34.094879 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86d38d15-d268-4462-8f75-563434952e57 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.226441 May 19 05:18:34.095497 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3112/6131] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:33 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:35.112505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c05a0b46-90a1-45e7-ba5a-35d64bcc1eb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:35.113831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c05a0b46-90a1-45e7-ba5a-35d64bcc1eb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:35.121617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c05a0b46-90a1-45e7-ba5a-35d64bcc1eb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:35.122815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c05a0b46-90a1-45e7-ba5a-35d64bcc1eb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:35.123730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c05a0b46-90a1-45e7-ba5a-35d64bcc1eb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:35.124360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c05a0b46-90a1-45e7-ba5a-35d64bcc1eb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:35.261491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c05a0b46-90a1-45e7-ba5a-35d64bcc1eb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:35.269484 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c05a0b46-90a1-45e7-ba5a-35d64bcc1eb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.160953 May 19 05:18:35.270089 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3020/6132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:35 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:36.287582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2d22d4a7-1959-4f8e-998d-384eb7b362aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:36.288207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2d22d4a7-1959-4f8e-998d-384eb7b362aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:36.297280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d22d4a7-1959-4f8e-998d-384eb7b362aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:36.298056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d22d4a7-1959-4f8e-998d-384eb7b362aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:36.298845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d22d4a7-1959-4f8e-998d-384eb7b362aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:36.299309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d22d4a7-1959-4f8e-998d-384eb7b362aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:36.431570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2d22d4a7-1959-4f8e-998d-384eb7b362aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:36.439283 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2d22d4a7-1959-4f8e-998d-384eb7b362aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.156295 May 19 05:18:36.439876 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3113/6133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:36 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:37.457099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49dcf44b-32c3-47dc-b762-db5bdb50f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:37.458507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49dcf44b-32c3-47dc-b762-db5bdb50f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:37.466352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49dcf44b-32c3-47dc-b762-db5bdb50f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:37.466969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49dcf44b-32c3-47dc-b762-db5bdb50f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:37.467509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49dcf44b-32c3-47dc-b762-db5bdb50f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:37.467957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49dcf44b-32c3-47dc-b762-db5bdb50f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:37.654989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49dcf44b-32c3-47dc-b762-db5bdb50f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:37.663552 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49dcf44b-32c3-47dc-b762-db5bdb50f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.210989 May 19 05:18:37.673418 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3021/6134] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:37 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:38.682321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ce0e232-21d2-44d2-9931-74205b9af8cb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:38.683164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2ce0e232-21d2-44d2-9931-74205b9af8cb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:38.692156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ce0e232-21d2-44d2-9931-74205b9af8cb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:38.692948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ce0e232-21d2-44d2-9931-74205b9af8cb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:38.694976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ce0e232-21d2-44d2-9931-74205b9af8cb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:38.695422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ce0e232-21d2-44d2-9931-74205b9af8cb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:38.903564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2ce0e232-21d2-44d2-9931-74205b9af8cb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:38.914292 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ce0e232-21d2-44d2-9931-74205b9af8cb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.238063 May 19 05:18:38.916896 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3114/6135] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:38 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:39.937484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d2c79aa1-3b30-496f-a1f5-bde020c3a869 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:39.939867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d2c79aa1-3b30-496f-a1f5-bde020c3a869 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:39.948209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c79aa1-3b30-496f-a1f5-bde020c3a869 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:39.948675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c79aa1-3b30-496f-a1f5-bde020c3a869 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:39.949596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c79aa1-3b30-496f-a1f5-bde020c3a869 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:39.950062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c79aa1-3b30-496f-a1f5-bde020c3a869 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:40.100149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d2c79aa1-3b30-496f-a1f5-bde020c3a869 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:40.108251 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d2c79aa1-3b30-496f-a1f5-bde020c3a869 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.178461 May 19 05:18:40.113112 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3022/6136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:39 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:41.124947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a9a47bd-e76f-4788-aa4d-d181b5ad185c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:41.125619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a9a47bd-e76f-4788-aa4d-d181b5ad185c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:41.128395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:18:41.129060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:18:41.136592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a47bd-e76f-4788-aa4d-d181b5ad185c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:41.137037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a47bd-e76f-4788-aa4d-d181b5ad185c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:41.137839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a47bd-e76f-4788-aa4d-d181b5ad185c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:41.138287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a9a47bd-e76f-4788-aa4d-d181b5ad185c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:41.275876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a9a47bd-e76f-4788-aa4d-d181b5ad185c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:41.284268 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a9a47bd-e76f-4788-aa4d-d181b5ad185c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.163207 May 19 05:18:41.284988 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3115/6137] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:41 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:42.300882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-60714c9b-d4d6-4c51-8cb6-030385ce7094 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:42.301520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60714c9b-d4d6-4c51-8cb6-030385ce7094 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:42.304319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:18:42.311901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60714c9b-d4d6-4c51-8cb6-030385ce7094 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:42.312352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60714c9b-d4d6-4c51-8cb6-030385ce7094 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:42.313602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60714c9b-d4d6-4c51-8cb6-030385ce7094 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:42.314047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60714c9b-d4d6-4c51-8cb6-030385ce7094 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:42.442613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60714c9b-d4d6-4c51-8cb6-030385ce7094 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:42.450601 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-60714c9b-d4d6-4c51-8cb6-030385ce7094 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.153694 May 19 05:18:42.451196 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3023/6138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:42 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:43.467482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b45d85cc-dae9-4557-b6c4-0106bc188e08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:43.467998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b45d85cc-dae9-4557-b6c4-0106bc188e08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:43.475379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b45d85cc-dae9-4557-b6c4-0106bc188e08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:43.475825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b45d85cc-dae9-4557-b6c4-0106bc188e08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:43.476577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b45d85cc-dae9-4557-b6c4-0106bc188e08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:43.477302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b45d85cc-dae9-4557-b6c4-0106bc188e08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:43.605576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b45d85cc-dae9-4557-b6c4-0106bc188e08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:43.613862 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b45d85cc-dae9-4557-b6c4-0106bc188e08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.150407 May 19 05:18:43.614439 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3116/6139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:43 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:44.631779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-06c58459-2eab-4c0a-9d0c-3f831d1b0e1f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:44.632402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-06c58459-2eab-4c0a-9d0c-3f831d1b0e1f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:44.639818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06c58459-2eab-4c0a-9d0c-3f831d1b0e1f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:44.640275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06c58459-2eab-4c0a-9d0c-3f831d1b0e1f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:44.641052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06c58459-2eab-4c0a-9d0c-3f831d1b0e1f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:44.641522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06c58459-2eab-4c0a-9d0c-3f831d1b0e1f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:44.770958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-06c58459-2eab-4c0a-9d0c-3f831d1b0e1f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:44.779008 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-06c58459-2eab-4c0a-9d0c-3f831d1b0e1f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.152246 May 19 05:18:44.779581 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3024/6140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:44 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:45.796271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ab706e65-f722-4e69-8388-9ec8aac86df1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:45.797638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ab706e65-f722-4e69-8388-9ec8aac86df1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:45.805118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab706e65-f722-4e69-8388-9ec8aac86df1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:45.805573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab706e65-f722-4e69-8388-9ec8aac86df1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:45.806347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab706e65-f722-4e69-8388-9ec8aac86df1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:45.806792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab706e65-f722-4e69-8388-9ec8aac86df1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:45.938625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab706e65-f722-4e69-8388-9ec8aac86df1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:45.946351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ab706e65-f722-4e69-8388-9ec8aac86df1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.153986 May 19 05:18:45.946939 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3117/6141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:45 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:46.964137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1800eaad-1835-4dd5-b2d9-acb3ada18571 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:46.964762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1800eaad-1835-4dd5-b2d9-acb3ada18571 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:46.972131 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1800eaad-1835-4dd5-b2d9-acb3ada18571 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:46.972586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1800eaad-1835-4dd5-b2d9-acb3ada18571 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:46.973388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1800eaad-1835-4dd5-b2d9-acb3ada18571 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:46.973830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1800eaad-1835-4dd5-b2d9-acb3ada18571 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:47.103150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1800eaad-1835-4dd5-b2d9-acb3ada18571 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:47.110970 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1800eaad-1835-4dd5-b2d9-acb3ada18571 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.150832 May 19 05:18:47.120558 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3025/6142] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:46 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:48.127905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a6948547-8af1-478d-bdfa-e5f40d131a24 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:48.128561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a6948547-8af1-478d-bdfa-e5f40d131a24 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:48.136206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6948547-8af1-478d-bdfa-e5f40d131a24 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:48.136663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6948547-8af1-478d-bdfa-e5f40d131a24 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:48.137459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6948547-8af1-478d-bdfa-e5f40d131a24 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:48.137906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6948547-8af1-478d-bdfa-e5f40d131a24 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:48.274163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a6948547-8af1-478d-bdfa-e5f40d131a24 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:48.281906 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a6948547-8af1-478d-bdfa-e5f40d131a24 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.157968 May 19 05:18:48.282500 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3118/6143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:48 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:49.299111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3f572cf1-087b-421a-8610-206c1f6b3ccf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:49.299501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3f572cf1-087b-421a-8610-206c1f6b3ccf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:49.307237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f572cf1-087b-421a-8610-206c1f6b3ccf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:49.307687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f572cf1-087b-421a-8610-206c1f6b3ccf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:49.308468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f572cf1-087b-421a-8610-206c1f6b3ccf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:49.308913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3f572cf1-087b-421a-8610-206c1f6b3ccf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:49.440260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3f572cf1-087b-421a-8610-206c1f6b3ccf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:49.449042 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3f572cf1-087b-421a-8610-206c1f6b3ccf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.154057 May 19 05:18:49.449669 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3026/6144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:49 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:50.465748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f66822ac-0946-4896-bb69-8dce18af1c94 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:50.466383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f66822ac-0946-4896-bb69-8dce18af1c94 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:50.473486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f66822ac-0946-4896-bb69-8dce18af1c94 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:50.473934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f66822ac-0946-4896-bb69-8dce18af1c94 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:50.474733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f66822ac-0946-4896-bb69-8dce18af1c94 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:50.475167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f66822ac-0946-4896-bb69-8dce18af1c94 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:50.609138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f66822ac-0946-4896-bb69-8dce18af1c94 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:50.616667 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f66822ac-0946-4896-bb69-8dce18af1c94 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.154941 May 19 05:18:50.617262 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3119/6145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:50 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:51.633207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9770a17d-db25-4353-9929-511f0a86cf7c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:51.633834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9770a17d-db25-4353-9929-511f0a86cf7c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:51.640862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9770a17d-db25-4353-9929-511f0a86cf7c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:51.641353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9770a17d-db25-4353-9929-511f0a86cf7c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:51.642128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9770a17d-db25-4353-9929-511f0a86cf7c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:51.642574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9770a17d-db25-4353-9929-511f0a86cf7c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:51.775372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9770a17d-db25-4353-9929-511f0a86cf7c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:51.783176 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9770a17d-db25-4353-9929-511f0a86cf7c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.154092 May 19 05:18:51.783753 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3027/6146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:51 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:52.799943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-103ff335-c41c-4106-8900-d5ea7a7f8e92 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:52.800570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-103ff335-c41c-4106-8900-d5ea7a7f8e92 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:52.807945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-103ff335-c41c-4106-8900-d5ea7a7f8e92 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:52.808401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-103ff335-c41c-4106-8900-d5ea7a7f8e92 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:52.809203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-103ff335-c41c-4106-8900-d5ea7a7f8e92 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:52.809648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-103ff335-c41c-4106-8900-d5ea7a7f8e92 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:52.937328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-103ff335-c41c-4106-8900-d5ea7a7f8e92 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:52.946406 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-103ff335-c41c-4106-8900-d5ea7a7f8e92 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1168 microversion: 2.1 time: 0.150366 May 19 05:18:52.946997 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3120/6147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:52 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1168 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:53.963798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7615901-92f2-4007-80ef-3c0eaf0d9523 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:53.964426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7615901-92f2-4007-80ef-3c0eaf0d9523 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:53.971706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7615901-92f2-4007-80ef-3c0eaf0d9523 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:53.972344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7615901-92f2-4007-80ef-3c0eaf0d9523 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:53.973153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7615901-92f2-4007-80ef-3c0eaf0d9523 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:53.973649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7615901-92f2-4007-80ef-3c0eaf0d9523 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:54.114366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7615901-92f2-4007-80ef-3c0eaf0d9523 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:54.122088 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7615901-92f2-4007-80ef-3c0eaf0d9523 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1214 microversion: 2.1 time: 0.162357 May 19 05:18:54.122664 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3028/6148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:53 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:55.139365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-53d6d3ae-c730-4f5d-9235-aaa27225f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:55.139919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-53d6d3ae-c730-4f5d-9235-aaa27225f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:55.147461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-53d6d3ae-c730-4f5d-9235-aaa27225f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:55.147907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-53d6d3ae-c730-4f5d-9235-aaa27225f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:55.148677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-53d6d3ae-c730-4f5d-9235-aaa27225f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:55.149132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-53d6d3ae-c730-4f5d-9235-aaa27225f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:55.274284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-53d6d3ae-c730-4f5d-9235-aaa27225f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:55.281794 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-53d6d3ae-c730-4f5d-9235-aaa27225f3ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.146440 May 19 05:18:55.282361 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3121/6149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:55 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:56.299181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6ef9e8a3-a026-42e2-9c73-3638084af4d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:56.299796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6ef9e8a3-a026-42e2-9c73-3638084af4d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:56.306808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ef9e8a3-a026-42e2-9c73-3638084af4d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:56.307256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ef9e8a3-a026-42e2-9c73-3638084af4d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:56.308009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ef9e8a3-a026-42e2-9c73-3638084af4d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:56.308447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6ef9e8a3-a026-42e2-9c73-3638084af4d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:56.437986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6ef9e8a3-a026-42e2-9c73-3638084af4d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:56.445537 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6ef9e8a3-a026-42e2-9c73-3638084af4d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.150227 May 19 05:18:56.446115 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3029/6150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:56 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:57.462798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35ccf7c4-2aa0-4305-a199-9983ff06587b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:57.463412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-35ccf7c4-2aa0-4305-a199-9983ff06587b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:57.470395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35ccf7c4-2aa0-4305-a199-9983ff06587b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:57.470841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35ccf7c4-2aa0-4305-a199-9983ff06587b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:57.471600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35ccf7c4-2aa0-4305-a199-9983ff06587b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:57.472036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35ccf7c4-2aa0-4305-a199-9983ff06587b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:57.606808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-35ccf7c4-2aa0-4305-a199-9983ff06587b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:57.615277 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-35ccf7c4-2aa0-4305-a199-9983ff06587b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.156396 May 19 05:18:57.615869 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3122/6151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:57 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:58.631840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a0f12eb9-f1b4-4634-bb41-840e95f7c787 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:58.632452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a0f12eb9-f1b4-4634-bb41-840e95f7c787 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:58.639420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0f12eb9-f1b4-4634-bb41-840e95f7c787 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:58.639871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0f12eb9-f1b4-4634-bb41-840e95f7c787 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:58.640636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0f12eb9-f1b4-4634-bb41-840e95f7c787 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:58.641087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0f12eb9-f1b4-4634-bb41-840e95f7c787 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:58.778348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a0f12eb9-f1b4-4634-bb41-840e95f7c787 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:58.785975 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a0f12eb9-f1b4-4634-bb41-840e95f7c787 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.158139 May 19 05:18:58.786558 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3030/6152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:58 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:18:59.803833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b558b7d2-91fe-455f-b293-13438aa43da3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:18:59.804373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b558b7d2-91fe-455f-b293-13438aa43da3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:18:59.807165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:18:59.812439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b558b7d2-91fe-455f-b293-13438aa43da3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:59.812895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b558b7d2-91fe-455f-b293-13438aa43da3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:59.813695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b558b7d2-91fe-455f-b293-13438aa43da3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:18:59.814140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b558b7d2-91fe-455f-b293-13438aa43da3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:18:59.817460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=77 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:18:59.944788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b558b7d2-91fe-455f-b293-13438aa43da3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:18:59.952249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b558b7d2-91fe-455f-b293-13438aa43da3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.152463 May 19 05:18:59.952826 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3123/6153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:18:59 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:00.969623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fee01243-92ce-4ace-b3ba-52d156855295 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:00.970167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fee01243-92ce-4ace-b3ba-52d156855295 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:00.972893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=29 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:19:00.979121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fee01243-92ce-4ace-b3ba-52d156855295 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:00.979581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fee01243-92ce-4ace-b3ba-52d156855295 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:00.980362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fee01243-92ce-4ace-b3ba-52d156855295 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:00.980812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fee01243-92ce-4ace-b3ba-52d156855295 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:00.984852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=73 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:19:01.111333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fee01243-92ce-4ace-b3ba-52d156855295 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:01.118909 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fee01243-92ce-4ace-b3ba-52d156855295 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.153237 May 19 05:19:01.119485 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3031/6154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:00 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:02.136428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7469eaa9-46fa-4027-ae4c-6cce7d8494df tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:02.137238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7469eaa9-46fa-4027-ae4c-6cce7d8494df tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:02.144263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7469eaa9-46fa-4027-ae4c-6cce7d8494df tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:02.144654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7469eaa9-46fa-4027-ae4c-6cce7d8494df tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:02.145443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7469eaa9-46fa-4027-ae4c-6cce7d8494df tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:02.146515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7469eaa9-46fa-4027-ae4c-6cce7d8494df tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:02.281929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7469eaa9-46fa-4027-ae4c-6cce7d8494df tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:02.289729 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7469eaa9-46fa-4027-ae4c-6cce7d8494df tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.157470 May 19 05:19:02.290313 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3124/6155] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:02 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:03.307160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ef2e56c8-b287-4aaf-83d2-ca2910c8026c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:03.307779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ef2e56c8-b287-4aaf-83d2-ca2910c8026c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:03.314700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef2e56c8-b287-4aaf-83d2-ca2910c8026c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:03.315147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef2e56c8-b287-4aaf-83d2-ca2910c8026c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:03.315905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef2e56c8-b287-4aaf-83d2-ca2910c8026c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:03.316345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef2e56c8-b287-4aaf-83d2-ca2910c8026c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:03.447529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ef2e56c8-b287-4aaf-83d2-ca2910c8026c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:03.455182 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ef2e56c8-b287-4aaf-83d2-ca2910c8026c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.152137 May 19 05:19:03.455767 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3032/6156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:03 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:04.472671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14ef6f52-95b0-48c8-a770-b0e2cdbc24f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:04.473318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14ef6f52-95b0-48c8-a770-b0e2cdbc24f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:04.480739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14ef6f52-95b0-48c8-a770-b0e2cdbc24f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:04.481227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14ef6f52-95b0-48c8-a770-b0e2cdbc24f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:04.481998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14ef6f52-95b0-48c8-a770-b0e2cdbc24f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:04.482440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14ef6f52-95b0-48c8-a770-b0e2cdbc24f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:04.610726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14ef6f52-95b0-48c8-a770-b0e2cdbc24f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:04.618327 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14ef6f52-95b0-48c8-a770-b0e2cdbc24f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.149709 May 19 05:19:04.619337 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3125/6157] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:04 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:04.763252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-f535271e-cf37-4473-9251-3e75f13e10b8 req-5ea0e31b-e363-439c-81e7-95e9263c50ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b47bded-2e20-4d0a-8b0d-d926daf299de", "name": "network-vif-plugged", "status": "completed", "tag": "a768b1bf-5176-4aef-a9f8-2bcfaa4d04c7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:19:04.774388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f535271e-cf37-4473-9251-3e75f13e10b8 req-5ea0e31b-e363-439c-81e7-95e9263c50ed service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:04.775686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-f535271e-cf37-4473-9251-3e75f13e10b8 req-5ea0e31b-e363-439c-81e7-95e9263c50ed service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:04.789420 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-f535271e-cf37-4473-9251-3e75f13e10b8 req-5ea0e31b-e363-439c-81e7-95e9263c50ed service nova] Creating event network-vif-plugged:a768b1bf-5176-4aef-a9f8-2bcfaa4d04c7 for instance 8b47bded-2e20-4d0a-8b0d-d926daf299de on n-h2-766726-30 May 19 05:19:04.795053 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-f535271e-cf37-4473-9251-3e75f13e10b8 req-5ea0e31b-e363-439c-81e7-95e9263c50ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 May 19 05:19:04.796008 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3033/6158] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:19:05.635549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8ed9f559-aa9c-4bff-a49b-84b9cc136ec3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:05.636169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8ed9f559-aa9c-4bff-a49b-84b9cc136ec3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:05.643153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ed9f559-aa9c-4bff-a49b-84b9cc136ec3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:05.643612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ed9f559-aa9c-4bff-a49b-84b9cc136ec3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:05.644384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ed9f559-aa9c-4bff-a49b-84b9cc136ec3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:05.644829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8ed9f559-aa9c-4bff-a49b-84b9cc136ec3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:05.783977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8ed9f559-aa9c-4bff-a49b-84b9cc136ec3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:05.791595 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8ed9f559-aa9c-4bff-a49b-84b9cc136ec3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1202 microversion: 2.1 time: 0.160050 May 19 05:19:05.792183 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3126/6159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:05 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:06.808942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-28f840b6-7a8c-497f-a8cd-4f773abf94ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:06.809700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-28f840b6-7a8c-497f-a8cd-4f773abf94ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:06.816841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28f840b6-7a8c-497f-a8cd-4f773abf94ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:06.817342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28f840b6-7a8c-497f-a8cd-4f773abf94ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:06.818113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28f840b6-7a8c-497f-a8cd-4f773abf94ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:06.818557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28f840b6-7a8c-497f-a8cd-4f773abf94ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:06.949478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-28f840b6-7a8c-497f-a8cd-4f773abf94ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:06.957490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-28f840b6-7a8c-497f-a8cd-4f773abf94ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1389 microversion: 2.1 time: 0.152889 May 19 05:19:06.958050 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3034/6160] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:06 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:06.974879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-394859e6-cd8c-40ae-8817-4226bca6d1ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:06.975492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-394859e6-cd8c-40ae-8817-4226bca6d1ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:06.982596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-394859e6-cd8c-40ae-8817-4226bca6d1ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:06.983043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-394859e6-cd8c-40ae-8817-4226bca6d1ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:06.983807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-394859e6-cd8c-40ae-8817-4226bca6d1ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:06.984243 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-394859e6-cd8c-40ae-8817-4226bca6d1ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:07.110251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-394859e6-cd8c-40ae-8817-4226bca6d1ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:07.118730 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-394859e6-cd8c-40ae-8817-4226bca6d1ae tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1389 microversion: 2.1 time: 0.148267 May 19 05:19:07.119317 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3127/6161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:06 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:07.134406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-809b6934-b8bf-48de-96e4-1fafd04eeebe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:07.135024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-809b6934-b8bf-48de-96e4-1fafd04eeebe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:07.141007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-809b6934-b8bf-48de-96e4-1fafd04eeebe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:07.141486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-809b6934-b8bf-48de-96e4-1fafd04eeebe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:07.142243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-809b6934-b8bf-48de-96e4-1fafd04eeebe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:07.142680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-809b6934-b8bf-48de-96e4-1fafd04eeebe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:07.268210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-809b6934-b8bf-48de-96e4-1fafd04eeebe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:07.275790 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-809b6934-b8bf-48de-96e4-1fafd04eeebe tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1389 microversion: 2.1 time: 0.145358 May 19 05:19:07.276364 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3035/6162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:07 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1389 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:07.344609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e8ce2431-3a14-48c1-97fe-256bc6fc0bef tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:07.345147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8ce2431-3a14-48c1-97fe-256bc6fc0bef tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:07.351273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ce2431-3a14-48c1-97fe-256bc6fc0bef tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:07.351727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ce2431-3a14-48c1-97fe-256bc6fc0bef tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:07.352753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ce2431-3a14-48c1-97fe-256bc6fc0bef tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:07.353231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e8ce2431-3a14-48c1-97fe-256bc6fc0bef tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:07.379823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e8ce2431-3a14-48c1-97fe-256bc6fc0bef tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:19:07.454173 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e8ce2431-3a14-48c1-97fe-256bc6fc0bef tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 204 len: 0 microversion: 2.1 time: 0.113209 May 19 05:19:07.454934 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3128/6163] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:19:07 2022] DELETE /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:19:07.463630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3e8134e-2962-4547-9e18-b2a764261765 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:07.464241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3e8134e-2962-4547-9e18-b2a764261765 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:07.470283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3e8134e-2962-4547-9e18-b2a764261765 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:07.470732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3e8134e-2962-4547-9e18-b2a764261765 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:07.471484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3e8134e-2962-4547-9e18-b2a764261765 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:07.471923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3e8134e-2962-4547-9e18-b2a764261765 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:07.604950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3e8134e-2962-4547-9e18-b2a764261765 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:07.612557 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3e8134e-2962-4547-9e18-b2a764261765 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1395 microversion: 2.1 time: 0.152822 May 19 05:19:07.613143 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3036/6164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:07 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:19:08.631183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-63a5a544-ee14-4ffa-b948-afeea809a8f2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:08.631897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-63a5a544-ee14-4ffa-b948-afeea809a8f2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:08.638841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63a5a544-ee14-4ffa-b948-afeea809a8f2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:08.639292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63a5a544-ee14-4ffa-b948-afeea809a8f2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:08.640061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63a5a544-ee14-4ffa-b948-afeea809a8f2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:08.640505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63a5a544-ee14-4ffa-b948-afeea809a8f2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:08.769123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-63a5a544-ee14-4ffa-b948-afeea809a8f2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:08.777581 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-63a5a544-ee14-4ffa-b948-afeea809a8f2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1395 microversion: 2.1 time: 0.151225 May 19 05:19:08.778153 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3129/6165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:08 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1395 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:09.314625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-941c8446-396c-4284-839e-77922d01d2a8 req-37a5390a-a034-4cfb-8550-c831496f03e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b47bded-2e20-4d0a-8b0d-d926daf299de", "name": "network-vif-deleted", "tag": "a768b1bf-5176-4aef-a9f8-2bcfaa4d04c7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:19:09.327971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-941c8446-396c-4284-839e-77922d01d2a8 req-37a5390a-a034-4cfb-8550-c831496f03e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:09.328426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-941c8446-396c-4284-839e-77922d01d2a8 req-37a5390a-a034-4cfb-8550-c831496f03e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:09.343437 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-941c8446-396c-4284-839e-77922d01d2a8 req-37a5390a-a034-4cfb-8550-c831496f03e1 service nova] Creating event network-vif-deleted:a768b1bf-5176-4aef-a9f8-2bcfaa4d04c7 for instance 8b47bded-2e20-4d0a-8b0d-d926daf299de on n-h2-766726-30 May 19 05:19:09.348712 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-941c8446-396c-4284-839e-77922d01d2a8 req-37a5390a-a034-4cfb-8550-c831496f03e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038280 May 19 05:19:09.350046 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3037/6166] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:19:09.794444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b9ed877-7bfe-42a4-a456-8e32a770fb0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:09.795143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b9ed877-7bfe-42a4-a456-8e32a770fb0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:09.802136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b9ed877-7bfe-42a4-a456-8e32a770fb0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:09.802593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b9ed877-7bfe-42a4-a456-8e32a770fb0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:09.803365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b9ed877-7bfe-42a4-a456-8e32a770fb0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:09.803809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b9ed877-7bfe-42a4-a456-8e32a770fb0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:09.866313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0b9ed877-7bfe-42a4-a456-8e32a770fb0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:09.873940 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b9ed877-7bfe-42a4-a456-8e32a770fb0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1187 microversion: 2.1 time: 0.083516 May 19 05:19:09.874512 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3130/6167] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:09 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:10.890955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-67bc4f5a-0504-4853-a15f-b86f00fa1cb5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:10.891665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-67bc4f5a-0504-4853-a15f-b86f00fa1cb5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:10.899570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67bc4f5a-0504-4853-a15f-b86f00fa1cb5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:10.900020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67bc4f5a-0504-4853-a15f-b86f00fa1cb5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:10.900792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67bc4f5a-0504-4853-a15f-b86f00fa1cb5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:10.901261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-67bc4f5a-0504-4853-a15f-b86f00fa1cb5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:10.964298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-67bc4f5a-0504-4853-a15f-b86f00fa1cb5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:10.972254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-67bc4f5a-0504-4853-a15f-b86f00fa1cb5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1187 microversion: 2.1 time: 0.085756 May 19 05:19:10.972835 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3038/6168] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:10 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:11.989250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89a8dd4f-e943-42af-8c9e-4257ca3000f6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:11.990430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-89a8dd4f-e943-42af-8c9e-4257ca3000f6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:11.997428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89a8dd4f-e943-42af-8c9e-4257ca3000f6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:11.997879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89a8dd4f-e943-42af-8c9e-4257ca3000f6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:11.998667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89a8dd4f-e943-42af-8c9e-4257ca3000f6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:11.999105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89a8dd4f-e943-42af-8c9e-4257ca3000f6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:12.067034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-89a8dd4f-e943-42af-8c9e-4257ca3000f6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:12.075038 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-89a8dd4f-e943-42af-8c9e-4257ca3000f6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1187 microversion: 2.1 time: 0.089879 May 19 05:19:12.075628 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3131/6169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:11 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:13.092258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0005a89b-6dea-4ce4-8a7e-f1c2b864041d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:13.092883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0005a89b-6dea-4ce4-8a7e-f1c2b864041d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:13.100004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0005a89b-6dea-4ce4-8a7e-f1c2b864041d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:13.100454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0005a89b-6dea-4ce4-8a7e-f1c2b864041d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:13.101281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0005a89b-6dea-4ce4-8a7e-f1c2b864041d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:13.101735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0005a89b-6dea-4ce4-8a7e-f1c2b864041d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:13.165030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0005a89b-6dea-4ce4-8a7e-f1c2b864041d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:13.172971 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0005a89b-6dea-4ce4-8a7e-f1c2b864041d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1187 microversion: 2.1 time: 0.084602 May 19 05:19:13.173604 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3039/6170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:13 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:14.193086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da3491b8-c7da-4cf1-8e81-3319a3ddcbc9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:14.193729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da3491b8-c7da-4cf1-8e81-3319a3ddcbc9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:14.199919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da3491b8-c7da-4cf1-8e81-3319a3ddcbc9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:14.200375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da3491b8-c7da-4cf1-8e81-3319a3ddcbc9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:14.201171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da3491b8-c7da-4cf1-8e81-3319a3ddcbc9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:14.201621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da3491b8-c7da-4cf1-8e81-3319a3ddcbc9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:14.266466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-da3491b8-c7da-4cf1-8e81-3319a3ddcbc9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:14.274839 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da3491b8-c7da-4cf1-8e81-3319a3ddcbc9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1187 microversion: 2.1 time: 0.087307 May 19 05:19:14.275647 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3132/6171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:14 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:15.292060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-45c407bd-7905-4990-a33c-139b17d9baf4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:15.292672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-45c407bd-7905-4990-a33c-139b17d9baf4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:15.299738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45c407bd-7905-4990-a33c-139b17d9baf4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:15.300185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45c407bd-7905-4990-a33c-139b17d9baf4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:15.300949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45c407bd-7905-4990-a33c-139b17d9baf4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:15.301411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45c407bd-7905-4990-a33c-139b17d9baf4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:15.364524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-45c407bd-7905-4990-a33c-139b17d9baf4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:15.372863 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-45c407bd-7905-4990-a33c-139b17d9baf4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1187 microversion: 2.1 time: 0.085679 May 19 05:19:15.373406 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3040/6172] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:15 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:16.390142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a97e2eda-c7d4-4536-901b-e241dc465723 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:16.390758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a97e2eda-c7d4-4536-901b-e241dc465723 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:16.398169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a97e2eda-c7d4-4536-901b-e241dc465723 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:16.398636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a97e2eda-c7d4-4536-901b-e241dc465723 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:16.399452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a97e2eda-c7d4-4536-901b-e241dc465723 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:16.399905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a97e2eda-c7d4-4536-901b-e241dc465723 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:16.473239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a97e2eda-c7d4-4536-901b-e241dc465723 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:16.482247 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a97e2eda-c7d4-4536-901b-e241dc465723 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1187 microversion: 2.1 time: 0.096030 May 19 05:19:16.482853 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3133/6173] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:16 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:17.498800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e2333e5-b990-496b-8168-62e33ffcf7b4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:17.499523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e2333e5-b990-496b-8168-62e33ffcf7b4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:17.507996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e2333e5-b990-496b-8168-62e33ffcf7b4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:17.508265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e2333e5-b990-496b-8168-62e33ffcf7b4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:17.509321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e2333e5-b990-496b-8168-62e33ffcf7b4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:17.509783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e2333e5-b990-496b-8168-62e33ffcf7b4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:17.576313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e2333e5-b990-496b-8168-62e33ffcf7b4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:17.584445 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e2333e5-b990-496b-8168-62e33ffcf7b4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1187 microversion: 2.1 time: 0.089562 May 19 05:19:17.593672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3041/6174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:17 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:18.603005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:18.603718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:18.611287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:18.611732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:18.612681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:18.613154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:18.649366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:18.649710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:18.660819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lazy-loading 'fault' on Instance uuid 8b47bded-2e20-4d0a-8b0d-d926daf299de {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:19:18.715152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:18.727100 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7225a6c5-6e45-4a8d-b8e1-d3edb3e5c447 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 200 len: 1192 microversion: 2.1 time: 0.129512 May 19 05:19:18.729453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3134/6175] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:18 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 1192 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:19.744213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:19.744855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:19.752169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:19.752635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:19.753442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:19.753888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:19.768029 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de HTTP/1.1 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '8b47bded-2e20-4d0a-8b0d-d926daf299de'} May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:19:19.769717 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1fbcfdd8-a53a-49dc-9587-c40954f0ded8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 404 len: 111 microversion: 2.1 time: 0.031366 May 19 05:19:19.774092 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3042/6176] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:19 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:19:24.010982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:24.011486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:24.018358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:24.018809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:24.019592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:24.020030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:24.033972 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de HTTP/1.1 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '8b47bded-2e20-4d0a-8b0d-d926daf299de'} May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:19:24.035622 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c027f62e-7f42-4d71-b2bd-c2dfb8ac09e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 404 len: 111 microversion: 2.1 time: 0.029887 May 19 05:19:24.040249 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3135/6177] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:19:24 2022] DELETE /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:19:24.046012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:24.046634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 8b47bded-2e20-4d0a-8b0d-d926daf299de] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:24.053557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:24.054035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:24.054801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:24.055239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:24.068485 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de HTTP/1.1 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '8b47bded-2e20-4d0a-8b0d-d926daf299de'} May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:19:24.070050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 8b47bded-2e20-4d0a-8b0d-d926daf299de could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed8c4a9d-f3b5-4536-861a-6716ba0cd82c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de" status: 404 len: 111 microversion: 2.1 time: 0.029266 May 19 05:19:24.074338 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3043/6178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:24 2022] GET /compute/v2.1/servers/8b47bded-2e20-4d0a-8b0d-d926daf299de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:19:49.021999 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:19:49.022570 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:19:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:19:49.766321 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:19:49.766937 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:19:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:19:50.984115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-43243994", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "898e862f-6274-4b4e-899d-05238dcf9c9c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "94ba7b5a-9245-470a-85b7-9f9506544cde"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:19:50.994119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:19:50.994764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:19:51.049837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] validate_networks() for [('94ba7b5a-9245-470a-85b7-9f9506544cde', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:19:51.407175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:19:51.407661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:19:51.408146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:19:51.408561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:19:51.408974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:19:51.418870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:51.419324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:51.420129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:51.420576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:51.437421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:19:51.442687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for user dd4805bce1b245fda6cf7b31ceda6ba3 and project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:19:51.500644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:19:51.502765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='898e862f-6274-4b4e-899d-05238dcf9c9c',volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:19:51.623923 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-08ac8901-7b6b-488a-b859-1c112a24b608 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643855 May 19 05:19:51.624559 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3136/6179] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:19:51.635675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-20936834-be87-49cc-a1fc-538d1d494005 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:51.636332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-20936834-be87-49cc-a1fc-538d1d494005 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:51.638348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=25 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:19:51.639001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=61 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:19:51.701964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-20936834-be87-49cc-a1fc-538d1d494005 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:51.709320 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-20936834-be87-49cc-a1fc-538d1d494005 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1069 microversion: 2.1 time: 0.078395 May 19 05:19:51.709962 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3044/6180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:51 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1069 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:52.729326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35fbb641-df7b-45ee-9109-6078b00d1f0b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:52.729948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-35fbb641-df7b-45ee-9109-6078b00d1f0b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:52.738235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35fbb641-df7b-45ee-9109-6078b00d1f0b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:52.738691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35fbb641-df7b-45ee-9109-6078b00d1f0b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:52.739466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35fbb641-df7b-45ee-9109-6078b00d1f0b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:52.739915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35fbb641-df7b-45ee-9109-6078b00d1f0b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:52.798875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-35fbb641-df7b-45ee-9109-6078b00d1f0b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:52.806801 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-35fbb641-df7b-45ee-9109-6078b00d1f0b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1119 microversion: 2.1 time: 0.081775 May 19 05:19:52.807377 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3137/6181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:52 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1119 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:53.823876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-643168d2-f199-44d5-8833-e49f893939ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:53.824536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-643168d2-f199-44d5-8833-e49f893939ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:53.831897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-643168d2-f199-44d5-8833-e49f893939ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:53.832361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-643168d2-f199-44d5-8833-e49f893939ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:53.833324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-643168d2-f199-44d5-8833-e49f893939ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:53.833740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-643168d2-f199-44d5-8833-e49f893939ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:53.935104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-643168d2-f199-44d5-8833-e49f893939ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:53.943078 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-643168d2-f199-44d5-8833-e49f893939ab tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1185 microversion: 2.1 time: 0.123655 May 19 05:19:53.943598 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3045/6182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:53 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:54.962518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d248b42b-ee8d-4180-abfb-14e1d933da63 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:54.963201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d248b42b-ee8d-4180-abfb-14e1d933da63 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:54.973864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d248b42b-ee8d-4180-abfb-14e1d933da63 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:54.985996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d248b42b-ee8d-4180-abfb-14e1d933da63 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:55.003453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d248b42b-ee8d-4180-abfb-14e1d933da63 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:55.003453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d248b42b-ee8d-4180-abfb-14e1d933da63 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:55.044621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-dfcdfb2a-74f9-4f75-affd-9264c8db1784 req-9dd27d48-d7e5-4dcb-b91d-7fb0ad72cfdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d462255-b06d-4830-bee9-412e0758fe17", "tag": "16725cee-221c-461f-9f03-59b14cdb2730"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:19:55.057356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dfcdfb2a-74f9-4f75-affd-9264c8db1784 req-9dd27d48-d7e5-4dcb-b91d-7fb0ad72cfdd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:55.057805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dfcdfb2a-74f9-4f75-affd-9264c8db1784 req-9dd27d48-d7e5-4dcb-b91d-7fb0ad72cfdd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:55.070725 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-dfcdfb2a-74f9-4f75-affd-9264c8db1784 req-9dd27d48-d7e5-4dcb-b91d-7fb0ad72cfdd service nova] Creating event network-changed:16725cee-221c-461f-9f03-59b14cdb2730 for instance 2d462255-b06d-4830-bee9-412e0758fe17 on n-h2-766726-30 May 19 05:19:55.082307 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-dfcdfb2a-74f9-4f75-affd-9264c8db1784 req-9dd27d48-d7e5-4dcb-b91d-7fb0ad72cfdd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043522 May 19 05:19:55.083996 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3046/6183] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:19:55.251540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d248b42b-ee8d-4180-abfb-14e1d933da63 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:55.259844 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d248b42b-ee8d-4180-abfb-14e1d933da63 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1227 microversion: 2.1 time: 0.302525 May 19 05:19:55.261004 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3138/6184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:54 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1227 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:56.277853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4253bd95-d7d1-4d5b-b3e4-c8d2e7f6c58a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:56.278498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4253bd95-d7d1-4d5b-b3e4-c8d2e7f6c58a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:56.284809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4253bd95-d7d1-4d5b-b3e4-c8d2e7f6c58a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:56.285307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4253bd95-d7d1-4d5b-b3e4-c8d2e7f6c58a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:56.286083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4253bd95-d7d1-4d5b-b3e4-c8d2e7f6c58a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:56.286532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4253bd95-d7d1-4d5b-b3e4-c8d2e7f6c58a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:56.419147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4253bd95-d7d1-4d5b-b3e4-c8d2e7f6c58a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:56.426786 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4253bd95-d7d1-4d5b-b3e4-c8d2e7f6c58a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1227 microversion: 2.1 time: 0.154222 May 19 05:19:56.427366 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3047/6185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:56 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1227 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:57.444024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b355285-4634-4138-ab99-eb31c98f646c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:57.444567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8b355285-4634-4138-ab99-eb31c98f646c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:57.451615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b355285-4634-4138-ab99-eb31c98f646c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:57.452075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b355285-4634-4138-ab99-eb31c98f646c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:57.452843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b355285-4634-4138-ab99-eb31c98f646c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:57.453323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b355285-4634-4138-ab99-eb31c98f646c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:57.585359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8b355285-4634-4138-ab99-eb31c98f646c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:57.593113 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b355285-4634-4138-ab99-eb31c98f646c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1227 microversion: 2.1 time: 0.153175 May 19 05:19:57.593716 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3139/6186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:57 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1227 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:58.610973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-11d268dd-baf9-415a-b7d2-8f8311a98309 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:58.611738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-11d268dd-baf9-415a-b7d2-8f8311a98309 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:58.619170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11d268dd-baf9-415a-b7d2-8f8311a98309 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:58.619707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11d268dd-baf9-415a-b7d2-8f8311a98309 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:58.620560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11d268dd-baf9-415a-b7d2-8f8311a98309 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:58.621101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11d268dd-baf9-415a-b7d2-8f8311a98309 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:58.752948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-11d268dd-baf9-415a-b7d2-8f8311a98309 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:58.761729 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-11d268dd-baf9-415a-b7d2-8f8311a98309 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1227 microversion: 2.1 time: 0.154892 May 19 05:19:58.762313 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3048/6187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:58 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1227 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:19:59.779328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-090a6ccf-1390-4385-becc-d5253f4d2352 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:19:59.779952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-090a6ccf-1390-4385-becc-d5253f4d2352 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:19:59.786988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090a6ccf-1390-4385-becc-d5253f4d2352 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:59.787452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090a6ccf-1390-4385-becc-d5253f4d2352 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:59.788225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090a6ccf-1390-4385-becc-d5253f4d2352 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:19:59.788692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090a6ccf-1390-4385-becc-d5253f4d2352 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:19:59.915873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-090a6ccf-1390-4385-becc-d5253f4d2352 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:19:59.923453 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-090a6ccf-1390-4385-becc-d5253f4d2352 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1227 microversion: 2.1 time: 0.148059 May 19 05:19:59.924246 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3140/6188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:19:59 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1227 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:00.940553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3d7378a9-a9e1-4413-b5fa-37a2eef1a929 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:00.941290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3d7378a9-a9e1-4413-b5fa-37a2eef1a929 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:00.948223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d7378a9-a9e1-4413-b5fa-37a2eef1a929 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:00.948949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d7378a9-a9e1-4413-b5fa-37a2eef1a929 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:00.949749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d7378a9-a9e1-4413-b5fa-37a2eef1a929 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:00.950188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3d7378a9-a9e1-4413-b5fa-37a2eef1a929 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:01.078812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3d7378a9-a9e1-4413-b5fa-37a2eef1a929 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:01.087329 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3d7378a9-a9e1-4413-b5fa-37a2eef1a929 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1227 microversion: 2.1 time: 0.150644 May 19 05:20:01.088038 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3049/6189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:00 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1227 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:02.105703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc7708d8-87c6-4ec4-82b6-aa42833452aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:02.106373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bc7708d8-87c6-4ec4-82b6-aa42833452aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:02.110283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:02.110979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:02.114939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc7708d8-87c6-4ec4-82b6-aa42833452aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:02.115433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc7708d8-87c6-4ec4-82b6-aa42833452aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:02.116949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc7708d8-87c6-4ec4-82b6-aa42833452aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:02.117492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc7708d8-87c6-4ec4-82b6-aa42833452aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:02.248390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bc7708d8-87c6-4ec4-82b6-aa42833452aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:02.256129 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bc7708d8-87c6-4ec4-82b6-aa42833452aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1227 microversion: 2.1 time: 0.155382 May 19 05:20:02.256756 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3141/6190] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:02 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1227 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:03.272268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b074a9a-665d-48d1-8e5d-61dde8c0899e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:03.273636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b074a9a-665d-48d1-8e5d-61dde8c0899e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:03.275688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:03.282277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b074a9a-665d-48d1-8e5d-61dde8c0899e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:03.282968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b074a9a-665d-48d1-8e5d-61dde8c0899e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:03.283898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b074a9a-665d-48d1-8e5d-61dde8c0899e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:03.284372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b074a9a-665d-48d1-8e5d-61dde8c0899e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:03.420941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b074a9a-665d-48d1-8e5d-61dde8c0899e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:03.429448 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b074a9a-665d-48d1-8e5d-61dde8c0899e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1227 microversion: 2.1 time: 0.160491 May 19 05:20:03.430232 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3050/6191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:03 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1227 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:04.446467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-76425bec-8fc8-4713-a754-117125f0d93d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:04.447080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-76425bec-8fc8-4713-a754-117125f0d93d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:04.453718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76425bec-8fc8-4713-a754-117125f0d93d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:04.454163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76425bec-8fc8-4713-a754-117125f0d93d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:04.454915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76425bec-8fc8-4713-a754-117125f0d93d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:04.455351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76425bec-8fc8-4713-a754-117125f0d93d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:04.588482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-76425bec-8fc8-4713-a754-117125f0d93d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:04.596161 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-76425bec-8fc8-4713-a754-117125f0d93d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.154190 May 19 05:20:04.596741 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3142/6192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:04 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:05.613527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-39d098f9-2921-4a64-a34c-410b1084b393 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:05.614154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-39d098f9-2921-4a64-a34c-410b1084b393 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:05.621222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39d098f9-2921-4a64-a34c-410b1084b393 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:05.621683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39d098f9-2921-4a64-a34c-410b1084b393 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:05.622454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39d098f9-2921-4a64-a34c-410b1084b393 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:05.622899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-39d098f9-2921-4a64-a34c-410b1084b393 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:05.761267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-39d098f9-2921-4a64-a34c-410b1084b393 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:05.768828 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-39d098f9-2921-4a64-a34c-410b1084b393 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.159337 May 19 05:20:05.769450 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3051/6193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:05 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:06.786176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-544b3a13-112d-4d39-9e56-ca0b523c1d54 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:06.786791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-544b3a13-112d-4d39-9e56-ca0b523c1d54 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:06.793882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-544b3a13-112d-4d39-9e56-ca0b523c1d54 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:06.794336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-544b3a13-112d-4d39-9e56-ca0b523c1d54 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:06.795103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-544b3a13-112d-4d39-9e56-ca0b523c1d54 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:06.795544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-544b3a13-112d-4d39-9e56-ca0b523c1d54 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:06.921497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-544b3a13-112d-4d39-9e56-ca0b523c1d54 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:06.929044 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-544b3a13-112d-4d39-9e56-ca0b523c1d54 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.146834 May 19 05:20:06.930158 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3143/6194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:06 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:07.946902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62ac7687-8479-4e46-9537-8d8b97fc50f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:07.947505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62ac7687-8479-4e46-9537-8d8b97fc50f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:07.954402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62ac7687-8479-4e46-9537-8d8b97fc50f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:07.954849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62ac7687-8479-4e46-9537-8d8b97fc50f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:07.955612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62ac7687-8479-4e46-9537-8d8b97fc50f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:07.956377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62ac7687-8479-4e46-9537-8d8b97fc50f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:08.081703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-62ac7687-8479-4e46-9537-8d8b97fc50f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:08.092367 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-62ac7687-8479-4e46-9537-8d8b97fc50f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.149511 May 19 05:20:08.093473 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3052/6195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:07 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:09.110331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b34e4b1-8046-44bf-b971-438618469320 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:09.110947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b34e4b1-8046-44bf-b971-438618469320 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:09.117963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b34e4b1-8046-44bf-b971-438618469320 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:09.118415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b34e4b1-8046-44bf-b971-438618469320 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:09.119180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b34e4b1-8046-44bf-b971-438618469320 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:09.119618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b34e4b1-8046-44bf-b971-438618469320 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:09.248888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b34e4b1-8046-44bf-b971-438618469320 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:09.256361 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b34e4b1-8046-44bf-b971-438618469320 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.149977 May 19 05:20:09.256930 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3144/6196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:09 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:10.272683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4321fd56-f952-4a59-9eb3-230f9102b397 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:10.273945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4321fd56-f952-4a59-9eb3-230f9102b397 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:10.280785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4321fd56-f952-4a59-9eb3-230f9102b397 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:10.281274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4321fd56-f952-4a59-9eb3-230f9102b397 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:10.282036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4321fd56-f952-4a59-9eb3-230f9102b397 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:10.282471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4321fd56-f952-4a59-9eb3-230f9102b397 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:10.410604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4321fd56-f952-4a59-9eb3-230f9102b397 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:10.418141 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4321fd56-f952-4a59-9eb3-230f9102b397 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.149454 May 19 05:20:10.418715 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3053/6197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:10 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:11.435216 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e9d92ad-047b-4be3-9b7d-40cf5be9f0d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:11.435811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9e9d92ad-047b-4be3-9b7d-40cf5be9f0d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:11.442612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e9d92ad-047b-4be3-9b7d-40cf5be9f0d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:11.443065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e9d92ad-047b-4be3-9b7d-40cf5be9f0d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:11.443831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e9d92ad-047b-4be3-9b7d-40cf5be9f0d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:11.444271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e9d92ad-047b-4be3-9b7d-40cf5be9f0d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:11.572934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9e9d92ad-047b-4be3-9b7d-40cf5be9f0d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:11.580430 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e9d92ad-047b-4be3-9b7d-40cf5be9f0d4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.149241 May 19 05:20:11.581011 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3145/6198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:11 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:12.597155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-78814dcc-e338-4ac0-b335-5dfcb7bb6ef8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:12.597800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-78814dcc-e338-4ac0-b335-5dfcb7bb6ef8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:12.604958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78814dcc-e338-4ac0-b335-5dfcb7bb6ef8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:12.605450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78814dcc-e338-4ac0-b335-5dfcb7bb6ef8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:12.606210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78814dcc-e338-4ac0-b335-5dfcb7bb6ef8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:12.606652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78814dcc-e338-4ac0-b335-5dfcb7bb6ef8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:12.733197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-78814dcc-e338-4ac0-b335-5dfcb7bb6ef8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:12.740704 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-78814dcc-e338-4ac0-b335-5dfcb7bb6ef8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.147506 May 19 05:20:12.741302 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3054/6199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:12 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:13.758711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-52eef5ff-79e4-41d0-a6b8-7c92a0704687 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:13.759324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-52eef5ff-79e4-41d0-a6b8-7c92a0704687 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:13.765954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52eef5ff-79e4-41d0-a6b8-7c92a0704687 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:13.766403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52eef5ff-79e4-41d0-a6b8-7c92a0704687 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:13.767156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52eef5ff-79e4-41d0-a6b8-7c92a0704687 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:13.767589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-52eef5ff-79e4-41d0-a6b8-7c92a0704687 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:13.895149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-52eef5ff-79e4-41d0-a6b8-7c92a0704687 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:13.902688 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-52eef5ff-79e4-41d0-a6b8-7c92a0704687 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.148643 May 19 05:20:13.903260 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3146/6200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:13 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:14.919056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ade68c31-8fd3-4819-861d-44c67fcbd984 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:14.919666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ade68c31-8fd3-4819-861d-44c67fcbd984 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:14.926501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ade68c31-8fd3-4819-861d-44c67fcbd984 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:14.926954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ade68c31-8fd3-4819-861d-44c67fcbd984 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:14.927716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ade68c31-8fd3-4819-861d-44c67fcbd984 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:14.928155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ade68c31-8fd3-4819-861d-44c67fcbd984 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:15.058946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ade68c31-8fd3-4819-861d-44c67fcbd984 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:15.067070 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ade68c31-8fd3-4819-861d-44c67fcbd984 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.151959 May 19 05:20:15.067678 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3055/6201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:14 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:15.142033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-16531db7-f470-4252-8f17-80984b1e276d req-a6fcf1f4-d78d-43d4-9e2a-706c0c7beda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d462255-b06d-4830-bee9-412e0758fe17", "name": "network-vif-plugged", "status": "completed", "tag": "16725cee-221c-461f-9f03-59b14cdb2730"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:20:15.152193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-16531db7-f470-4252-8f17-80984b1e276d req-a6fcf1f4-d78d-43d4-9e2a-706c0c7beda2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:15.152808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-16531db7-f470-4252-8f17-80984b1e276d req-a6fcf1f4-d78d-43d4-9e2a-706c0c7beda2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:15.166492 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-16531db7-f470-4252-8f17-80984b1e276d req-a6fcf1f4-d78d-43d4-9e2a-706c0c7beda2 service nova] Creating event network-vif-plugged:16725cee-221c-461f-9f03-59b14cdb2730 for instance 2d462255-b06d-4830-bee9-412e0758fe17 on n-h2-766726-30 May 19 05:20:15.171543 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-16531db7-f470-4252-8f17-80984b1e276d req-a6fcf1f4-d78d-43d4-9e2a-706c0c7beda2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033339 May 19 05:20:15.172337 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3147/6202] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:20:16.083690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-edf088a0-c7aa-4a11-98bc-2d9155baa8ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:16.084310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-edf088a0-c7aa-4a11-98bc-2d9155baa8ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:16.091814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edf088a0-c7aa-4a11-98bc-2d9155baa8ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:16.092260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edf088a0-c7aa-4a11-98bc-2d9155baa8ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:16.093015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edf088a0-c7aa-4a11-98bc-2d9155baa8ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:16.093476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-edf088a0-c7aa-4a11-98bc-2d9155baa8ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:16.561897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-edf088a0-c7aa-4a11-98bc-2d9155baa8ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:16.569294 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-edf088a0-c7aa-4a11-98bc-2d9155baa8ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1215 microversion: 2.1 time: 0.489450 May 19 05:20:16.570447 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3056/6203] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:16 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1215 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:17.590885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-185670f1-765b-41b4-9cbf-d6fe0ce2748f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:17.591759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-185670f1-765b-41b4-9cbf-d6fe0ce2748f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:17.599136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-185670f1-765b-41b4-9cbf-d6fe0ce2748f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:17.599597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-185670f1-765b-41b4-9cbf-d6fe0ce2748f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:17.600397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-185670f1-765b-41b4-9cbf-d6fe0ce2748f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:17.600824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-185670f1-765b-41b4-9cbf-d6fe0ce2748f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:17.742810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-185670f1-765b-41b4-9cbf-d6fe0ce2748f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:17.750581 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-185670f1-765b-41b4-9cbf-d6fe0ce2748f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1403 microversion: 2.1 time: 0.164042 May 19 05:20:17.751179 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3148/6204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:17 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1403 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:17.766973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87b56a1a-825e-4846-9be2-4d2645cf58ce tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:17.767594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-87b56a1a-825e-4846-9be2-4d2645cf58ce tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:17.774625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87b56a1a-825e-4846-9be2-4d2645cf58ce tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:17.775075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87b56a1a-825e-4846-9be2-4d2645cf58ce tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:17.775833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87b56a1a-825e-4846-9be2-4d2645cf58ce tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:17.776269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87b56a1a-825e-4846-9be2-4d2645cf58ce tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:17.913053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-87b56a1a-825e-4846-9be2-4d2645cf58ce tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:17.921393 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87b56a1a-825e-4846-9be2-4d2645cf58ce tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1403 microversion: 2.1 time: 0.158210 May 19 05:20:17.922010 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3057/6205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:17 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:17.938658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-253313490"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:20:17.939697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:17.946458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:17.946914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:17.947698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:17.948138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:18.039709 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Attempting to quiesce instance before volume snapshot. May 19 05:20:18.098742 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Skipping quiescing instance because the operation is not supported by the underlying compute driver. May 19 05:20:18.175035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Creating snapshot from volume 898e862f-6274-4b4e-899d-05238dcf9c9c. {{(pid=124818) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} May 19 05:20:19.142399 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-afbcd16d-ac5e-4410-b6d1-d1d277ce059f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "POST /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17/action" status: 202 len: 0 microversion: 2.1 time: 1.206456 May 19 05:20:19.142399 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3149/6206] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:20:17 2022] POST /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17/action => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 05:20:21.322237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-832675405", "imageRef": "95c5b02e-c547-4c3d-8513-51cf38df17b7", "flavorRef": "452", "networks": [{"uuid": "94ba7b5a-9245-470a-85b7-9f9506544cde"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:20:21.376153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] validate_networks() for [('94ba7b5a-9245-470a-85b7-9f9506544cde', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:20:21.842202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:20:21.842630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:20:21.843127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:20:21.843561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:20:21.843973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:20:21.846006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=33 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:21.855110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:21.855669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:21.856416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:21.856868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:21.863639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=75 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:21.876111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:20:21.882989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for user dd4805bce1b245fda6cf7b31ceda6ba3 and project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:20:21.895401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:20:21.897999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e63cece3-f009-4b32-a900-72b902972d2d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:20:21.974572 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0ecd2ab9-60fb-4c35-a4a7-c25bdc834826 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656525 May 19 05:20:21.975236 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3058/6207] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:20:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:20:21.986823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82d3f89f-5e03-4e5e-99fc-75c667db2f3d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:21.987558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82d3f89f-5e03-4e5e-99fc-75c667db2f3d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:21.989682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:22.045270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82d3f89f-5e03-4e5e-99fc-75c667db2f3d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:22.053028 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82d3f89f-5e03-4e5e-99fc-75c667db2f3d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1229 microversion: 2.1 time: 0.071253 May 19 05:20:22.053637 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3150/6208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:21 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1229 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:23.071241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d67c20b7-c6c2-447b-82dc-0c5a1559b7dd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:23.071885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d67c20b7-c6c2-447b-82dc-0c5a1559b7dd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:23.080166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d67c20b7-c6c2-447b-82dc-0c5a1559b7dd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:23.080665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d67c20b7-c6c2-447b-82dc-0c5a1559b7dd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:23.081473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d67c20b7-c6c2-447b-82dc-0c5a1559b7dd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:23.082505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d67c20b7-c6c2-447b-82dc-0c5a1559b7dd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:23.150816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d67c20b7-c6c2-447b-82dc-0c5a1559b7dd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:23.158482 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d67c20b7-c6c2-447b-82dc-0c5a1559b7dd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1299 microversion: 2.1 time: 0.091488 May 19 05:20:23.159656 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3059/6209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:23 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:24.180737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b4e2d6d4-df3b-4bf4-a75a-a0ae6fc5f971 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:24.183265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b4e2d6d4-df3b-4bf4-a75a-a0ae6fc5f971 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:24.192267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e2d6d4-df3b-4bf4-a75a-a0ae6fc5f971 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:24.193022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e2d6d4-df3b-4bf4-a75a-a0ae6fc5f971 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:24.193978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e2d6d4-df3b-4bf4-a75a-a0ae6fc5f971 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:24.194538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b4e2d6d4-df3b-4bf4-a75a-a0ae6fc5f971 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:24.213343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:24.340257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b4e2d6d4-df3b-4bf4-a75a-a0ae6fc5f971 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:24.348966 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b4e2d6d4-df3b-4bf4-a75a-a0ae6fc5f971 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.172805 May 19 05:20:24.349672 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3151/6210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:24 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:24.683519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3f5b3ebc-91b2-458e-9b01-69cbe18ffb25 req-a012b5aa-9de0-4817-89ee-5d30ebf90b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9f9af1-45cf-4ca8-bdb8-aa46bb451620", "tag": "96e8e271-70e1-40f6-9abf-ff75ec97b5d6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:20:24.696716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3f5b3ebc-91b2-458e-9b01-69cbe18ffb25 req-a012b5aa-9de0-4817-89ee-5d30ebf90b27 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:24.697623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3f5b3ebc-91b2-458e-9b01-69cbe18ffb25 req-a012b5aa-9de0-4817-89ee-5d30ebf90b27 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:24.713266 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3f5b3ebc-91b2-458e-9b01-69cbe18ffb25 req-a012b5aa-9de0-4817-89ee-5d30ebf90b27 service nova] Creating event network-changed:96e8e271-70e1-40f6-9abf-ff75ec97b5d6 for instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 on n-h1-766726-30 May 19 05:20:24.719313 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3f5b3ebc-91b2-458e-9b01-69cbe18ffb25 req-a012b5aa-9de0-4817-89ee-5d30ebf90b27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041085 May 19 05:20:24.720319 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3060/6211] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:20:25.367391 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-551643b7-ae7d-4ba2-a96b-69c8c90619db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:25.368052 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-551643b7-ae7d-4ba2-a96b-69c8c90619db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:25.375303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-551643b7-ae7d-4ba2-a96b-69c8c90619db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:25.375771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-551643b7-ae7d-4ba2-a96b-69c8c90619db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:25.376558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-551643b7-ae7d-4ba2-a96b-69c8c90619db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:25.377015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-551643b7-ae7d-4ba2-a96b-69c8c90619db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:25.514002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-551643b7-ae7d-4ba2-a96b-69c8c90619db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:25.522049 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-551643b7-ae7d-4ba2-a96b-69c8c90619db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.158563 May 19 05:20:25.522969 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3152/6212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:25 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:26.540979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f592b360-2899-4d38-b5ab-fe6c68ff4ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:26.541706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f592b360-2899-4d38-b5ab-fe6c68ff4ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:26.548004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f592b360-2899-4d38-b5ab-fe6c68ff4ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:26.548452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f592b360-2899-4d38-b5ab-fe6c68ff4ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:26.549236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f592b360-2899-4d38-b5ab-fe6c68ff4ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:26.549675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f592b360-2899-4d38-b5ab-fe6c68ff4ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:26.687890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f592b360-2899-4d38-b5ab-fe6c68ff4ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:26.696694 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f592b360-2899-4d38-b5ab-fe6c68ff4ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.161530 May 19 05:20:26.697321 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3061/6213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:26 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:27.713810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-286d9a38-0e49-4283-b96e-0309c35406a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:27.714468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-286d9a38-0e49-4283-b96e-0309c35406a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:27.721953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-286d9a38-0e49-4283-b96e-0309c35406a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:27.722482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-286d9a38-0e49-4283-b96e-0309c35406a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:27.723287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-286d9a38-0e49-4283-b96e-0309c35406a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:27.723847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-286d9a38-0e49-4283-b96e-0309c35406a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:27.869934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-286d9a38-0e49-4283-b96e-0309c35406a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:27.878356 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-286d9a38-0e49-4283-b96e-0309c35406a9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.168736 May 19 05:20:27.878944 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3153/6214] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:27 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:28.895474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4c4ae27b-a3d0-4dad-977b-7dd5dfc051b6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:28.896098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4c4ae27b-a3d0-4dad-977b-7dd5dfc051b6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:28.903118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4c4ae27b-a3d0-4dad-977b-7dd5dfc051b6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:28.903581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4c4ae27b-a3d0-4dad-977b-7dd5dfc051b6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:28.904397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4c4ae27b-a3d0-4dad-977b-7dd5dfc051b6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:28.904870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4c4ae27b-a3d0-4dad-977b-7dd5dfc051b6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:29.034454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4c4ae27b-a3d0-4dad-977b-7dd5dfc051b6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:29.043105 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4c4ae27b-a3d0-4dad-977b-7dd5dfc051b6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.151504 May 19 05:20:29.043711 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3062/6215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:28 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:30.067565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-20a54f6e-21a4-4945-b5cc-dc949c73045f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:30.070101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-20a54f6e-21a4-4945-b5cc-dc949c73045f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:30.088628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20a54f6e-21a4-4945-b5cc-dc949c73045f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:30.089098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20a54f6e-21a4-4945-b5cc-dc949c73045f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:30.089884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20a54f6e-21a4-4945-b5cc-dc949c73045f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:30.090342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-20a54f6e-21a4-4945-b5cc-dc949c73045f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:30.345303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-20a54f6e-21a4-4945-b5cc-dc949c73045f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:30.354190 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-20a54f6e-21a4-4945-b5cc-dc949c73045f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.296238 May 19 05:20:30.355251 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3154/6216] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:30 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:31.374253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ec00799f-ec81-4b09-b837-6c2f80363e26 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:31.374854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ec00799f-ec81-4b09-b837-6c2f80363e26 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:31.383273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec00799f-ec81-4b09-b837-6c2f80363e26 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:31.384413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec00799f-ec81-4b09-b837-6c2f80363e26 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:31.385372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec00799f-ec81-4b09-b837-6c2f80363e26 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:31.386216 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec00799f-ec81-4b09-b837-6c2f80363e26 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:31.540034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ec00799f-ec81-4b09-b837-6c2f80363e26 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:31.547717 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ec00799f-ec81-4b09-b837-6c2f80363e26 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.179832 May 19 05:20:31.548658 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3063/6217] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:31 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:32.563939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-06467975-ce30-409c-890d-433ceaa3123d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:32.564625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-06467975-ce30-409c-890d-433ceaa3123d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:32.567535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:32.573285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06467975-ce30-409c-890d-433ceaa3123d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:32.573756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06467975-ce30-409c-890d-433ceaa3123d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:32.574518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06467975-ce30-409c-890d-433ceaa3123d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:32.574971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06467975-ce30-409c-890d-433ceaa3123d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:32.721103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-06467975-ce30-409c-890d-433ceaa3123d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:32.735270 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-06467975-ce30-409c-890d-433ceaa3123d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.175148 May 19 05:20:32.736257 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3155/6218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:32 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:33.752065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa6a0412-5edb-4cbd-a5a1-fec686c473bf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:33.752749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aa6a0412-5edb-4cbd-a5a1-fec686c473bf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:33.754773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:33.755992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:33.762791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa6a0412-5edb-4cbd-a5a1-fec686c473bf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:33.763162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa6a0412-5edb-4cbd-a5a1-fec686c473bf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:33.763959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa6a0412-5edb-4cbd-a5a1-fec686c473bf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:33.764398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa6a0412-5edb-4cbd-a5a1-fec686c473bf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:33.917289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aa6a0412-5edb-4cbd-a5a1-fec686c473bf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:33.925271 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aa6a0412-5edb-4cbd-a5a1-fec686c473bf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.177231 May 19 05:20:33.926501 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3064/6219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:33 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:34.942844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a7b5a3d-df40-4fec-8c0b-8f9cbe66db6e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:34.943487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a7b5a3d-df40-4fec-8c0b-8f9cbe66db6e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:34.950509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a7b5a3d-df40-4fec-8c0b-8f9cbe66db6e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:34.950985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a7b5a3d-df40-4fec-8c0b-8f9cbe66db6e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:34.951768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a7b5a3d-df40-4fec-8c0b-8f9cbe66db6e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:34.952225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a7b5a3d-df40-4fec-8c0b-8f9cbe66db6e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:35.079937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0a7b5a3d-df40-4fec-8c0b-8f9cbe66db6e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:35.087623 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a7b5a3d-df40-4fec-8c0b-8f9cbe66db6e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.148716 May 19 05:20:35.088200 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3156/6220] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:34 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:36.104040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e802541-9431-4da9-8cb0-ef6b650d7ddd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:36.104811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e802541-9431-4da9-8cb0-ef6b650d7ddd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:36.112132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e802541-9431-4da9-8cb0-ef6b650d7ddd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:36.112654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e802541-9431-4da9-8cb0-ef6b650d7ddd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:36.113514 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e802541-9431-4da9-8cb0-ef6b650d7ddd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:36.114023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e802541-9431-4da9-8cb0-ef6b650d7ddd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:36.248619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8e802541-9431-4da9-8cb0-ef6b650d7ddd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:36.256444 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e802541-9431-4da9-8cb0-ef6b650d7ddd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.156575 May 19 05:20:36.257016 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3065/6221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:36 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:37.274963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d89231bb-3261-482c-965d-36e2a436929a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:37.275603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d89231bb-3261-482c-965d-36e2a436929a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:37.282747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d89231bb-3261-482c-965d-36e2a436929a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:37.283366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d89231bb-3261-482c-965d-36e2a436929a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:37.284096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d89231bb-3261-482c-965d-36e2a436929a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:37.284783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d89231bb-3261-482c-965d-36e2a436929a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:37.428210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d89231bb-3261-482c-965d-36e2a436929a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:37.437595 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d89231bb-3261-482c-965d-36e2a436929a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.167475 May 19 05:20:37.438180 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3157/6222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:37 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:38.455761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-120b77b6-58d2-43bf-9aa7-bd943d1a56cc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:38.456374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-120b77b6-58d2-43bf-9aa7-bd943d1a56cc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:38.463397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-120b77b6-58d2-43bf-9aa7-bd943d1a56cc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:38.463837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-120b77b6-58d2-43bf-9aa7-bd943d1a56cc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:38.464601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-120b77b6-58d2-43bf-9aa7-bd943d1a56cc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:38.465043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-120b77b6-58d2-43bf-9aa7-bd943d1a56cc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:38.616660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-120b77b6-58d2-43bf-9aa7-bd943d1a56cc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:38.624804 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-120b77b6-58d2-43bf-9aa7-bd943d1a56cc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.173021 May 19 05:20:38.625409 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3066/6223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:38 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:39.642809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ec0a490c-865a-4673-a922-a26dfd643be0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:39.643467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ec0a490c-865a-4673-a922-a26dfd643be0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:39.650512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec0a490c-865a-4673-a922-a26dfd643be0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:39.650974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec0a490c-865a-4673-a922-a26dfd643be0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:39.651866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec0a490c-865a-4673-a922-a26dfd643be0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:39.652319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec0a490c-865a-4673-a922-a26dfd643be0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:39.796978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ec0a490c-865a-4673-a922-a26dfd643be0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:39.804774 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ec0a490c-865a-4673-a922-a26dfd643be0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.166217 May 19 05:20:39.805450 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3158/6224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:39 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:40.822242 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-58adad4e-6ac3-4731-a1cc-e8f6d66746a0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:40.822981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-58adad4e-6ac3-4731-a1cc-e8f6d66746a0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:40.830330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58adad4e-6ac3-4731-a1cc-e8f6d66746a0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:40.830764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58adad4e-6ac3-4731-a1cc-e8f6d66746a0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:40.832192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58adad4e-6ac3-4731-a1cc-e8f6d66746a0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:40.832192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58adad4e-6ac3-4731-a1cc-e8f6d66746a0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:40.973325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-58adad4e-6ac3-4731-a1cc-e8f6d66746a0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:40.981759 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-58adad4e-6ac3-4731-a1cc-e8f6d66746a0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.163541 May 19 05:20:40.982387 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3067/6225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:40 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:41.998830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-385559a1-4ce1-466f-8475-9612d896a3bd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:41.999497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-385559a1-4ce1-466f-8475-9612d896a3bd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:42.006361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-385559a1-4ce1-466f-8475-9612d896a3bd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:42.006831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-385559a1-4ce1-466f-8475-9612d896a3bd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:42.008268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-385559a1-4ce1-466f-8475-9612d896a3bd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:42.008734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-385559a1-4ce1-466f-8475-9612d896a3bd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:42.140550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-385559a1-4ce1-466f-8475-9612d896a3bd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:42.148218 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-385559a1-4ce1-466f-8475-9612d896a3bd tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.153387 May 19 05:20:42.148827 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3159/6226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:41 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:43.166910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e92d0fed-e40b-47d6-bdb1-e697fd16d2de tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:43.167567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e92d0fed-e40b-47d6-bdb1-e697fd16d2de tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:43.174434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e92d0fed-e40b-47d6-bdb1-e697fd16d2de tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:43.174891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e92d0fed-e40b-47d6-bdb1-e697fd16d2de tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:43.175668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e92d0fed-e40b-47d6-bdb1-e697fd16d2de tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:43.176115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e92d0fed-e40b-47d6-bdb1-e697fd16d2de tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:43.307338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e92d0fed-e40b-47d6-bdb1-e697fd16d2de tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:43.315008 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e92d0fed-e40b-47d6-bdb1-e697fd16d2de tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.152560 May 19 05:20:43.315587 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3068/6227] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:43 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:44.336592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d2fb65c4-aa84-4f0e-a631-8ab7764a795b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:44.338283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d2fb65c4-aa84-4f0e-a631-8ab7764a795b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:44.346665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2fb65c4-aa84-4f0e-a631-8ab7764a795b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:44.347317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2fb65c4-aa84-4f0e-a631-8ab7764a795b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:44.348223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2fb65c4-aa84-4f0e-a631-8ab7764a795b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:44.348704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d2fb65c4-aa84-4f0e-a631-8ab7764a795b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:44.499580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d2fb65c4-aa84-4f0e-a631-8ab7764a795b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:44.509262 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d2fb65c4-aa84-4f0e-a631-8ab7764a795b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.180888 May 19 05:20:44.509858 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3160/6228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:44 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:45.527011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b75eb74c-5424-402e-9714-af9ac5b26e0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:45.527674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b75eb74c-5424-402e-9714-af9ac5b26e0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:45.534849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b75eb74c-5424-402e-9714-af9ac5b26e0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:45.535357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b75eb74c-5424-402e-9714-af9ac5b26e0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:45.536192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b75eb74c-5424-402e-9714-af9ac5b26e0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:45.536617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b75eb74c-5424-402e-9714-af9ac5b26e0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:45.678473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b75eb74c-5424-402e-9714-af9ac5b26e0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:45.687965 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b75eb74c-5424-402e-9714-af9ac5b26e0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1341 microversion: 2.1 time: 0.164955 May 19 05:20:45.688605 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3069/6229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:45 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:46.705138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aa94ab37-5336-45b8-b5f0-8ed4d590ec15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:46.705741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aa94ab37-5336-45b8-b5f0-8ed4d590ec15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:46.714585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa94ab37-5336-45b8-b5f0-8ed4d590ec15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:46.715140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa94ab37-5336-45b8-b5f0-8ed4d590ec15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:46.716201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa94ab37-5336-45b8-b5f0-8ed4d590ec15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:46.716659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aa94ab37-5336-45b8-b5f0-8ed4d590ec15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:46.858207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aa94ab37-5336-45b8-b5f0-8ed4d590ec15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:46.867592 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aa94ab37-5336-45b8-b5f0-8ed4d590ec15 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1387 microversion: 2.1 time: 0.165859 May 19 05:20:46.868198 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3161/6230] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:46 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1387 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:47.889059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5001343d-65cf-4970-bf9d-6ea73646ee3f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:47.889875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5001343d-65cf-4970-bf9d-6ea73646ee3f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:47.897299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5001343d-65cf-4970-bf9d-6ea73646ee3f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:47.897761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5001343d-65cf-4970-bf9d-6ea73646ee3f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:47.899041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5001343d-65cf-4970-bf9d-6ea73646ee3f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:47.899611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5001343d-65cf-4970-bf9d-6ea73646ee3f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:48.032950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5001343d-65cf-4970-bf9d-6ea73646ee3f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:48.042749 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5001343d-65cf-4970-bf9d-6ea73646ee3f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1375 microversion: 2.1 time: 0.158372 May 19 05:20:48.043328 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3070/6231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:47 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:20:49.061510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-311b640a-a848-448e-b478-afbafbbae2b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:49.062147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-311b640a-a848-448e-b478-afbafbbae2b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:49.069330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-311b640a-a848-448e-b478-afbafbbae2b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:49.069801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-311b640a-a848-448e-b478-afbafbbae2b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:49.070617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-311b640a-a848-448e-b478-afbafbbae2b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:49.071079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-311b640a-a848-448e-b478-afbafbbae2b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:49.197626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-311b640a-a848-448e-b478-afbafbbae2b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:49.205062 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-311b640a-a848-448e-b478-afbafbbae2b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1375 microversion: 2.1 time: 0.147563 May 19 05:20:49.205654 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3162/6232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:49 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1375 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:50.221952 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4ed0c4ca-6c7d-48db-a28d-74bf0e714f88 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:50.222630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4ed0c4ca-6c7d-48db-a28d-74bf0e714f88 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:50.230809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ed0c4ca-6c7d-48db-a28d-74bf0e714f88 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:50.231261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ed0c4ca-6c7d-48db-a28d-74bf0e714f88 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:50.232073 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ed0c4ca-6c7d-48db-a28d-74bf0e714f88 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:50.232516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4ed0c4ca-6c7d-48db-a28d-74bf0e714f88 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:50.380122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4ed0c4ca-6c7d-48db-a28d-74bf0e714f88 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:50.387902 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4ed0c4ca-6c7d-48db-a28d-74bf0e714f88 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1375 microversion: 2.1 time: 0.170000 May 19 05:20:50.388501 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3071/6233] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:50 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:51.404829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-57c7f644-a021-4830-90c8-9ba2ead88be3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:51.405482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-57c7f644-a021-4830-90c8-9ba2ead88be3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:51.412604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c7f644-a021-4830-90c8-9ba2ead88be3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:51.413070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c7f644-a021-4830-90c8-9ba2ead88be3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:51.414381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c7f644-a021-4830-90c8-9ba2ead88be3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:51.414825 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57c7f644-a021-4830-90c8-9ba2ead88be3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:51.546372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-57c7f644-a021-4830-90c8-9ba2ead88be3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:51.553977 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-57c7f644-a021-4830-90c8-9ba2ead88be3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1375 microversion: 2.1 time: 0.153096 May 19 05:20:51.555162 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3163/6234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:51 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:52.572320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0f7f87f2-936a-4b7d-b475-5fe69f7f0362 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:52.572941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0f7f87f2-936a-4b7d-b475-5fe69f7f0362 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:52.575634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:52.581340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f7f87f2-936a-4b7d-b475-5fe69f7f0362 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:52.581739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f7f87f2-936a-4b7d-b475-5fe69f7f0362 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:52.582501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f7f87f2-936a-4b7d-b475-5fe69f7f0362 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:52.582941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f7f87f2-936a-4b7d-b475-5fe69f7f0362 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:52.587407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=76 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:52.717672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0f7f87f2-936a-4b7d-b475-5fe69f7f0362 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:52.725495 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0f7f87f2-936a-4b7d-b475-5fe69f7f0362 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1375 microversion: 2.1 time: 0.157827 May 19 05:20:52.726084 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3072/6235] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:52 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:53.742983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e3ed70d5-7bce-4a9f-a013-4cca1b2660b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:53.743698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e3ed70d5-7bce-4a9f-a013-4cca1b2660b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:53.746606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=30 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:53.752129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3ed70d5-7bce-4a9f-a013-4cca1b2660b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:53.752609 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3ed70d5-7bce-4a9f-a013-4cca1b2660b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:53.753393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3ed70d5-7bce-4a9f-a013-4cca1b2660b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:53.753843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e3ed70d5-7bce-4a9f-a013-4cca1b2660b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:53.884070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e3ed70d5-7bce-4a9f-a013-4cca1b2660b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:53.892427 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e3ed70d5-7bce-4a9f-a013-4cca1b2660b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1375 microversion: 2.1 time: 0.153757 May 19 05:20:53.893019 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3164/6236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:53 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:54.910582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1cfad7f5-083c-420a-840f-c4dd246cd648 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:54.911447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1cfad7f5-083c-420a-840f-c4dd246cd648 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:54.921539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1cfad7f5-083c-420a-840f-c4dd246cd648 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:54.921991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1cfad7f5-083c-420a-840f-c4dd246cd648 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:54.923204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1cfad7f5-083c-420a-840f-c4dd246cd648 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:54.923204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1cfad7f5-083c-420a-840f-c4dd246cd648 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:55.066028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1cfad7f5-083c-420a-840f-c4dd246cd648 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:55.074163 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1cfad7f5-083c-420a-840f-c4dd246cd648 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1375 microversion: 2.1 time: 0.168369 May 19 05:20:55.074788 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3073/6237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:54 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:56.091600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0bddf433-19c8-4762-bec5-f3c00650c68d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:56.092284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0bddf433-19c8-4762-bec5-f3c00650c68d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:56.098410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bddf433-19c8-4762-bec5-f3c00650c68d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:56.098874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bddf433-19c8-4762-bec5-f3c00650c68d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:56.099649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bddf433-19c8-4762-bec5-f3c00650c68d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:56.100106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bddf433-19c8-4762-bec5-f3c00650c68d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:56.102704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=84 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:20:56.243593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0bddf433-19c8-4762-bec5-f3c00650c68d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:56.252800 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0bddf433-19c8-4762-bec5-f3c00650c68d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1375 microversion: 2.1 time: 0.166205 May 19 05:20:56.253451 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3165/6238] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:56 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:56.972570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e001811c-0701-4c2b-86eb-45c2dec5f3d2 req-938a3d03-8fff-466e-84f2-f4abb41e5989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9f9af1-45cf-4ca8-bdb8-aa46bb451620", "name": "network-vif-plugged", "status": "completed", "tag": "96e8e271-70e1-40f6-9abf-ff75ec97b5d6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:20:56.988083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e001811c-0701-4c2b-86eb-45c2dec5f3d2 req-938a3d03-8fff-466e-84f2-f4abb41e5989 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:56.988796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e001811c-0701-4c2b-86eb-45c2dec5f3d2 req-938a3d03-8fff-466e-84f2-f4abb41e5989 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:57.003785 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e001811c-0701-4c2b-86eb-45c2dec5f3d2 req-938a3d03-8fff-466e-84f2-f4abb41e5989 service nova] Creating event network-vif-plugged:96e8e271-70e1-40f6-9abf-ff75ec97b5d6 for instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 on n-h1-766726-30 May 19 05:20:57.012532 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e001811c-0701-4c2b-86eb-45c2dec5f3d2 req-938a3d03-8fff-466e-84f2-f4abb41e5989 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045161 May 19 05:20:57.013230 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3074/6239] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:20:57.273111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2582b3a0-f01b-4213-9b5d-b6c9dd573666 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:57.273749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2582b3a0-f01b-4213-9b5d-b6c9dd573666 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:57.281487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2582b3a0-f01b-4213-9b5d-b6c9dd573666 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:57.282071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2582b3a0-f01b-4213-9b5d-b6c9dd573666 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:57.282818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2582b3a0-f01b-4213-9b5d-b6c9dd573666 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:57.284083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2582b3a0-f01b-4213-9b5d-b6c9dd573666 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:57.417536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2582b3a0-f01b-4213-9b5d-b6c9dd573666 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:57.425870 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2582b3a0-f01b-4213-9b5d-b6c9dd573666 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1375 microversion: 2.1 time: 0.159273 May 19 05:20:57.426461 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3166/6240] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:57 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:58.443846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8caa3130-799e-464d-96e7-2696f71b23f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:58.444463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8caa3130-799e-464d-96e7-2696f71b23f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:58.451371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8caa3130-799e-464d-96e7-2696f71b23f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:58.451816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8caa3130-799e-464d-96e7-2696f71b23f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:58.452579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8caa3130-799e-464d-96e7-2696f71b23f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:58.453009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8caa3130-799e-464d-96e7-2696f71b23f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:58.580190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8caa3130-799e-464d-96e7-2696f71b23f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:58.587896 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8caa3130-799e-464d-96e7-2696f71b23f1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1563 microversion: 2.1 time: 0.148350 May 19 05:20:58.588494 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3075/6241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:58 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:58.605854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-54442b43-0b0e-4384-bb13-2032069f2937 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:58.606487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-54442b43-0b0e-4384-bb13-2032069f2937 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:58.613476 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54442b43-0b0e-4384-bb13-2032069f2937 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:58.613945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54442b43-0b0e-4384-bb13-2032069f2937 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:58.614755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54442b43-0b0e-4384-bb13-2032069f2937 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:58.615210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-54442b43-0b0e-4384-bb13-2032069f2937 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:58.746089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-54442b43-0b0e-4384-bb13-2032069f2937 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:58.753897 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-54442b43-0b0e-4384-bb13-2032069f2937 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1563 microversion: 2.1 time: 0.152838 May 19 05:20:58.754694 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3167/6242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:58 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:20:58.822836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1583cf6b-f3b8-4043-87a2-00da3a8d4664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:58.823353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1583cf6b-f3b8-4043-87a2-00da3a8d4664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:58.829957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1583cf6b-f3b8-4043-87a2-00da3a8d4664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:58.830414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1583cf6b-f3b8-4043-87a2-00da3a8d4664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:58.831188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1583cf6b-f3b8-4043-87a2-00da3a8d4664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:58.831635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1583cf6b-f3b8-4043-87a2-00da3a8d4664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:58.860371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1583cf6b-f3b8-4043-87a2-00da3a8d4664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:20:58.936297 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1583cf6b-f3b8-4043-87a2-00da3a8d4664 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 204 len: 0 microversion: 2.1 time: 0.116956 May 19 05:20:58.937267 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3076/6243] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:20:58 2022] DELETE /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:20:58.945857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b5d53785-46db-4500-a15e-01961912f17f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:20:58.946419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b5d53785-46db-4500-a15e-01961912f17f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:20:58.953114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5d53785-46db-4500-a15e-01961912f17f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:58.953585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5d53785-46db-4500-a15e-01961912f17f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:58.954362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5d53785-46db-4500-a15e-01961912f17f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:20:58.954814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5d53785-46db-4500-a15e-01961912f17f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:20:59.085809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5d53785-46db-4500-a15e-01961912f17f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:20:59.093467 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b5d53785-46db-4500-a15e-01961912f17f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1569 microversion: 2.1 time: 0.151565 May 19 05:20:59.094050 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3168/6244] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:20:58 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:00.111016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-89eb9889-5f98-4156-ae60-470e2f2768c0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:00.111726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-89eb9889-5f98-4156-ae60-470e2f2768c0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:00.118659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89eb9889-5f98-4156-ae60-470e2f2768c0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:00.119111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89eb9889-5f98-4156-ae60-470e2f2768c0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:00.119879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89eb9889-5f98-4156-ae60-470e2f2768c0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:00.120322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-89eb9889-5f98-4156-ae60-470e2f2768c0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:00.248246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-89eb9889-5f98-4156-ae60-470e2f2768c0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:00.255823 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-89eb9889-5f98-4156-ae60-470e2f2768c0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1569 microversion: 2.1 time: 0.149151 May 19 05:21:00.261262 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3077/6245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:00 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:01.091563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b783023c-d256-46cc-820c-a60bd97bba61 req-1908f971-a52a-4a25-a3cf-67544862e1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9f9af1-45cf-4ca8-bdb8-aa46bb451620", "name": "network-vif-deleted", "tag": "96e8e271-70e1-40f6-9abf-ff75ec97b5d6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:21:01.104988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b783023c-d256-46cc-820c-a60bd97bba61 req-1908f971-a52a-4a25-a3cf-67544862e1a1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:01.106465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b783023c-d256-46cc-820c-a60bd97bba61 req-1908f971-a52a-4a25-a3cf-67544862e1a1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:01.125581 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b783023c-d256-46cc-820c-a60bd97bba61 req-1908f971-a52a-4a25-a3cf-67544862e1a1 service nova] Creating event network-vif-deleted:96e8e271-70e1-40f6-9abf-ff75ec97b5d6 for instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 on n-h1-766726-30 May 19 05:21:01.131943 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b783023c-d256-46cc-820c-a60bd97bba61 req-1908f971-a52a-4a25-a3cf-67544862e1a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044783 May 19 05:21:01.133242 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3169/6246] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:21:01.273046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2b088a0a-2982-42b0-80e6-03d170d76bc3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:01.274335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2b088a0a-2982-42b0-80e6-03d170d76bc3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:01.282010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b088a0a-2982-42b0-80e6-03d170d76bc3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:01.282463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b088a0a-2982-42b0-80e6-03d170d76bc3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:01.283235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b088a0a-2982-42b0-80e6-03d170d76bc3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:01.283675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2b088a0a-2982-42b0-80e6-03d170d76bc3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:01.349025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2b088a0a-2982-42b0-80e6-03d170d76bc3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:01.357707 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2b088a0a-2982-42b0-80e6-03d170d76bc3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1360 microversion: 2.1 time: 0.089789 May 19 05:21:01.358379 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3078/6247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:01 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:02.376856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14bc83cc-818c-45fc-a9d6-53a22272427e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:02.377607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14bc83cc-818c-45fc-a9d6-53a22272427e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:02.383978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14bc83cc-818c-45fc-a9d6-53a22272427e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:02.384474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14bc83cc-818c-45fc-a9d6-53a22272427e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:02.385282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14bc83cc-818c-45fc-a9d6-53a22272427e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:02.385740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14bc83cc-818c-45fc-a9d6-53a22272427e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:02.452064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14bc83cc-818c-45fc-a9d6-53a22272427e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:02.459832 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14bc83cc-818c-45fc-a9d6-53a22272427e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1360 microversion: 2.1 time: 0.088894 May 19 05:21:02.460408 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3170/6248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:02 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1360 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:03.476069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ed5f3a60-c2d3-4a20-82ab-8daac956ad0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:03.476721 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ed5f3a60-c2d3-4a20-82ab-8daac956ad0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:03.484127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5f3a60-c2d3-4a20-82ab-8daac956ad0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:03.484584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5f3a60-c2d3-4a20-82ab-8daac956ad0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:03.485384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5f3a60-c2d3-4a20-82ab-8daac956ad0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:03.485829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ed5f3a60-c2d3-4a20-82ab-8daac956ad0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:03.548456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ed5f3a60-c2d3-4a20-82ab-8daac956ad0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:03.556761 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ed5f3a60-c2d3-4a20-82ab-8daac956ad0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1360 microversion: 2.1 time: 0.084636 May 19 05:21:03.557568 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3079/6249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:03 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1360 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:04.574443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c050ab9a-9e87-4609-9c4e-908ccbf9e1c1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:04.575083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c050ab9a-9e87-4609-9c4e-908ccbf9e1c1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:04.582263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c050ab9a-9e87-4609-9c4e-908ccbf9e1c1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:04.582655 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c050ab9a-9e87-4609-9c4e-908ccbf9e1c1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:04.583468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c050ab9a-9e87-4609-9c4e-908ccbf9e1c1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:04.583929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c050ab9a-9e87-4609-9c4e-908ccbf9e1c1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:04.650132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c050ab9a-9e87-4609-9c4e-908ccbf9e1c1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:04.658688 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c050ab9a-9e87-4609-9c4e-908ccbf9e1c1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1360 microversion: 2.1 time: 0.088138 May 19 05:21:04.659291 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3171/6250] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:04 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1360 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:05.675562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5944f93f-d23b-4a4f-a14d-67454d078867 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:05.676186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5944f93f-d23b-4a4f-a14d-67454d078867 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:05.683416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5944f93f-d23b-4a4f-a14d-67454d078867 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:05.684046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5944f93f-d23b-4a4f-a14d-67454d078867 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:05.684896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5944f93f-d23b-4a4f-a14d-67454d078867 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:05.685438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5944f93f-d23b-4a4f-a14d-67454d078867 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:05.765438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5944f93f-d23b-4a4f-a14d-67454d078867 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:05.774035 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5944f93f-d23b-4a4f-a14d-67454d078867 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1360 microversion: 2.1 time: 0.102369 May 19 05:21:05.775079 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3080/6251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:05 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1360 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:06.791826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c7eab8db-59d2-4cfb-bf82-0a202cb8655a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:06.792367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c7eab8db-59d2-4cfb-bf82-0a202cb8655a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:06.800450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7eab8db-59d2-4cfb-bf82-0a202cb8655a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:06.800914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7eab8db-59d2-4cfb-bf82-0a202cb8655a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:06.801728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7eab8db-59d2-4cfb-bf82-0a202cb8655a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:06.802176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c7eab8db-59d2-4cfb-bf82-0a202cb8655a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:06.874649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c7eab8db-59d2-4cfb-bf82-0a202cb8655a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:06.882435 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c7eab8db-59d2-4cfb-bf82-0a202cb8655a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1360 microversion: 2.1 time: 0.094624 May 19 05:21:06.883225 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3172/6252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:06 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1360 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:07.899276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d677c6d6-8ad8-4004-8621-d144a1f1c03e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:07.900070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d677c6d6-8ad8-4004-8621-d144a1f1c03e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:07.907273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d677c6d6-8ad8-4004-8621-d144a1f1c03e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:07.907725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d677c6d6-8ad8-4004-8621-d144a1f1c03e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:07.908502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d677c6d6-8ad8-4004-8621-d144a1f1c03e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:07.908951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d677c6d6-8ad8-4004-8621-d144a1f1c03e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:07.971072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d677c6d6-8ad8-4004-8621-d144a1f1c03e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:07.979072 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d677c6d6-8ad8-4004-8621-d144a1f1c03e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1360 microversion: 2.1 time: 0.083799 May 19 05:21:07.979658 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3081/6253] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:07 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1360 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:08.995812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2d14bfae-10d6-48e8-b930-20d49232238c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:08.996953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2d14bfae-10d6-48e8-b930-20d49232238c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:09.004062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d14bfae-10d6-48e8-b930-20d49232238c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:09.004532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d14bfae-10d6-48e8-b930-20d49232238c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:09.005337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d14bfae-10d6-48e8-b930-20d49232238c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:09.005793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d14bfae-10d6-48e8-b930-20d49232238c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:09.068872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2d14bfae-10d6-48e8-b930-20d49232238c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:09.077494 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2d14bfae-10d6-48e8-b930-20d49232238c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1360 microversion: 2.1 time: 0.085606 May 19 05:21:09.078079 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3173/6254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:08 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1360 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:10.094577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-201bece4-31ba-49ed-ae99-7579912e248b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:10.095206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-201bece4-31ba-49ed-ae99-7579912e248b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:10.102886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-201bece4-31ba-49ed-ae99-7579912e248b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:10.102886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-201bece4-31ba-49ed-ae99-7579912e248b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:10.103926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-201bece4-31ba-49ed-ae99-7579912e248b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:10.104367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-201bece4-31ba-49ed-ae99-7579912e248b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:10.180877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-201bece4-31ba-49ed-ae99-7579912e248b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:10.188801 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-201bece4-31ba-49ed-ae99-7579912e248b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 200 len: 1360 microversion: 2.1 time: 0.099074 May 19 05:21:10.189440 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3082/6255] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:10 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 1360 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:21:11.205521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:11.206191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:11.213282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:11.213756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:11.214546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:11.215527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:11.229291 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 HTTP/1.1 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '0a9f9af1-45cf-4ca8-bdb8-aa46bb451620'} May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:11.231533 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b6aef9d2-0bf9-437b-916e-d16e54864570 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 404 len: 111 microversion: 2.1 time: 0.031425 May 19 05:21:11.236706 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3174/6256] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:11 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:21:18.626230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0cac6462-297d-483a-a61a-4f1a09cf7b61 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:18.626788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0cac6462-297d-483a-a61a-4f1a09cf7b61 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:18.633543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cac6462-297d-483a-a61a-4f1a09cf7b61 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:18.634006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cac6462-297d-483a-a61a-4f1a09cf7b61 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:18.634783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cac6462-297d-483a-a61a-4f1a09cf7b61 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:18.635231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0cac6462-297d-483a-a61a-4f1a09cf7b61 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:18.660471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0cac6462-297d-483a-a61a-4f1a09cf7b61 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:21:18.741176 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0cac6462-297d-483a-a61a-4f1a09cf7b61 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 204 len: 0 microversion: 2.1 time: 0.118549 May 19 05:21:18.741724 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3083/6257] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:21:18 2022] DELETE /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:21:18.753240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-330ff905-c667-4b6e-bda0-5746fdafa189 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:18.754229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-330ff905-c667-4b6e-bda0-5746fdafa189 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:18.762035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-330ff905-c667-4b6e-bda0-5746fdafa189 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:18.762492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-330ff905-c667-4b6e-bda0-5746fdafa189 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:18.763266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-330ff905-c667-4b6e-bda0-5746fdafa189 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:18.763713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-330ff905-c667-4b6e-bda0-5746fdafa189 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:18.896916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-330ff905-c667-4b6e-bda0-5746fdafa189 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:18.906540 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-330ff905-c667-4b6e-bda0-5746fdafa189 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1409 microversion: 2.1 time: 0.160003 May 19 05:21:18.907123 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3175/6258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:18 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:19.924050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b4e5f898-cf34-4d9b-b69c-514a6e0a906f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:19.924752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b4e5f898-cf34-4d9b-b69c-514a6e0a906f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:19.931738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b4e5f898-cf34-4d9b-b69c-514a6e0a906f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:19.932184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b4e5f898-cf34-4d9b-b69c-514a6e0a906f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:19.932943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b4e5f898-cf34-4d9b-b69c-514a6e0a906f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:19.933411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b4e5f898-cf34-4d9b-b69c-514a6e0a906f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:20.059604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b4e5f898-cf34-4d9b-b69c-514a6e0a906f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:20.067244 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b4e5f898-cf34-4d9b-b69c-514a6e0a906f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1409 microversion: 2.1 time: 0.147584 May 19 05:21:20.067832 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3084/6259] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:19 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:20.664745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f8462c1e-bc45-435a-8e6b-54451e0ab2c9 req-cf091109-9b38-4a51-8302-6e095e1fb997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d462255-b06d-4830-bee9-412e0758fe17", "name": "network-vif-deleted", "tag": "16725cee-221c-461f-9f03-59b14cdb2730"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:21:20.674270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f8462c1e-bc45-435a-8e6b-54451e0ab2c9 req-cf091109-9b38-4a51-8302-6e095e1fb997 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:20.674662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f8462c1e-bc45-435a-8e6b-54451e0ab2c9 req-cf091109-9b38-4a51-8302-6e095e1fb997 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:20.685967 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f8462c1e-bc45-435a-8e6b-54451e0ab2c9 req-cf091109-9b38-4a51-8302-6e095e1fb997 service nova] Creating event network-vif-deleted:16725cee-221c-461f-9f03-59b14cdb2730 for instance 2d462255-b06d-4830-bee9-412e0758fe17 on n-h2-766726-30 May 19 05:21:20.691481 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f8462c1e-bc45-435a-8e6b-54451e0ab2c9 req-cf091109-9b38-4a51-8302-6e095e1fb997 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030472 May 19 05:21:20.692165 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3176/6260] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:21:21.084168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c04dfb7-b48b-41f8-b62f-ee611af7e16a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:21.085218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c04dfb7-b48b-41f8-b62f-ee611af7e16a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:21.092240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c04dfb7-b48b-41f8-b62f-ee611af7e16a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:21.092703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c04dfb7-b48b-41f8-b62f-ee611af7e16a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:21.093498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c04dfb7-b48b-41f8-b62f-ee611af7e16a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:21.093943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c04dfb7-b48b-41f8-b62f-ee611af7e16a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:21.155367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c04dfb7-b48b-41f8-b62f-ee611af7e16a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:21.163170 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c04dfb7-b48b-41f8-b62f-ee611af7e16a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1200 microversion: 2.1 time: 0.083028 May 19 05:21:21.163749 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3085/6261] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:21 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:22.181546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a38337dc-840d-40e7-a147-daf2e7b77efc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:22.182262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a38337dc-840d-40e7-a147-daf2e7b77efc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:22.189306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a38337dc-840d-40e7-a147-daf2e7b77efc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:22.189769 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a38337dc-840d-40e7-a147-daf2e7b77efc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:22.190550 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a38337dc-840d-40e7-a147-daf2e7b77efc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:22.191002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a38337dc-840d-40e7-a147-daf2e7b77efc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:22.257364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a38337dc-840d-40e7-a147-daf2e7b77efc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:22.265124 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a38337dc-840d-40e7-a147-daf2e7b77efc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1200 microversion: 2.1 time: 0.088724 May 19 05:21:22.265701 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3177/6262] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:22 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1200 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:23.281901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1296b7e5-ff10-462a-bfff-cacc8238817f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:23.282551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1296b7e5-ff10-462a-bfff-cacc8238817f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:23.285374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:21:23.290775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1296b7e5-ff10-462a-bfff-cacc8238817f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:23.291229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1296b7e5-ff10-462a-bfff-cacc8238817f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:23.291999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1296b7e5-ff10-462a-bfff-cacc8238817f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:23.292441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1296b7e5-ff10-462a-bfff-cacc8238817f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:23.295906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:21:23.363386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1296b7e5-ff10-462a-bfff-cacc8238817f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:23.371956 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1296b7e5-ff10-462a-bfff-cacc8238817f tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1200 microversion: 2.1 time: 0.093528 May 19 05:21:23.372539 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3086/6263] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:23 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:24.388592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2f50e4c0-f247-4d2c-873f-c6c785774bba tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:24.389253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2f50e4c0-f247-4d2c-873f-c6c785774bba tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:24.392028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=28 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:21:24.397723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f50e4c0-f247-4d2c-873f-c6c785774bba tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:24.398184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f50e4c0-f247-4d2c-873f-c6c785774bba tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:24.398964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f50e4c0-f247-4d2c-873f-c6c785774bba tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:24.399411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f50e4c0-f247-4d2c-873f-c6c785774bba tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:24.459928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f50e4c0-f247-4d2c-873f-c6c785774bba tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:24.468207 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2f50e4c0-f247-4d2c-873f-c6c785774bba tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1200 microversion: 2.1 time: 0.084105 May 19 05:21:24.468782 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3178/6264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:24 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:25.485310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e88cceae-ac02-47f7-b79f-a1be3f1df899 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:25.485865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e88cceae-ac02-47f7-b79f-a1be3f1df899 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:25.492873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e88cceae-ac02-47f7-b79f-a1be3f1df899 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:25.493367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e88cceae-ac02-47f7-b79f-a1be3f1df899 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:25.494142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e88cceae-ac02-47f7-b79f-a1be3f1df899 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:25.494588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e88cceae-ac02-47f7-b79f-a1be3f1df899 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:25.555506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e88cceae-ac02-47f7-b79f-a1be3f1df899 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:25.563736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e88cceae-ac02-47f7-b79f-a1be3f1df899 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1200 microversion: 2.1 time: 0.082592 May 19 05:21:25.564320 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3087/6265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:25 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:26.579780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b80b8e34-4879-44c5-8f5b-c5231517f060 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:26.580305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b80b8e34-4879-44c5-8f5b-c5231517f060 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:26.587318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b80b8e34-4879-44c5-8f5b-c5231517f060 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:26.587788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b80b8e34-4879-44c5-8f5b-c5231517f060 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:26.588573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b80b8e34-4879-44c5-8f5b-c5231517f060 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:26.589032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b80b8e34-4879-44c5-8f5b-c5231517f060 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:26.593101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=72 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:21:26.655259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b80b8e34-4879-44c5-8f5b-c5231517f060 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:26.662994 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b80b8e34-4879-44c5-8f5b-c5231517f060 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1200 microversion: 2.1 time: 0.087214 May 19 05:21:26.663717 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3179/6266] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:26 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:27.679998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6f7a3a5b-f6f9-49d2-8b26-c83c04fd1aeb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:27.680632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6f7a3a5b-f6f9-49d2-8b26-c83c04fd1aeb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:27.687317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f7a3a5b-f6f9-49d2-8b26-c83c04fd1aeb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:27.687780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f7a3a5b-f6f9-49d2-8b26-c83c04fd1aeb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:27.688557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f7a3a5b-f6f9-49d2-8b26-c83c04fd1aeb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:27.689005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6f7a3a5b-f6f9-49d2-8b26-c83c04fd1aeb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:27.758443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6f7a3a5b-f6f9-49d2-8b26-c83c04fd1aeb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:27.766513 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6f7a3a5b-f6f9-49d2-8b26-c83c04fd1aeb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1200 microversion: 2.1 time: 0.090518 May 19 05:21:27.767132 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3088/6267] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:27 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:28.783353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ef8b79d5-7c14-4ea2-b153-3c93b1ce66e3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:28.784016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ef8b79d5-7c14-4ea2-b153-3c93b1ce66e3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:28.791151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef8b79d5-7c14-4ea2-b153-3c93b1ce66e3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:28.791631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef8b79d5-7c14-4ea2-b153-3c93b1ce66e3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:28.792417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef8b79d5-7c14-4ea2-b153-3c93b1ce66e3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:28.792874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ef8b79d5-7c14-4ea2-b153-3c93b1ce66e3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:28.859364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ef8b79d5-7c14-4ea2-b153-3c93b1ce66e3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:28.867190 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ef8b79d5-7c14-4ea2-b153-3c93b1ce66e3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1200 microversion: 2.1 time: 0.087780 May 19 05:21:28.867708 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3180/6268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:28 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:29.883959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:29.884494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:29.891726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:29.892188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:29.892964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:29.893432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:29.925448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:29.925898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:29.926347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lazy-loading 'fault' on Instance uuid 2d462255-b06d-4830-bee9-412e0758fe17 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:21:29.969130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:29.976731 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-960c9e59-8274-418e-ab1e-b11490d4a405 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 200 len: 1205 microversion: 2.1 time: 0.096973 May 19 05:21:29.977326 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3089/6269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:29 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 1205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:21:30.994364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:30.995333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:31.003026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:31.003494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:31.004277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:31.004730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:31.018241 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 HTTP/1.1 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2d462255-b06d-4830-bee9-412e0758fe17'} May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:31.019929 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-690085e6-9790-4871-808b-13ff44fe470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 404 len: 111 microversion: 2.1 time: 0.031028 May 19 05:21:31.024546 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3181/6270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:30 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:21:35.262590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:35.263129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:35.269997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:35.270447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:35.271208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:35.271649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:35.287597 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 HTTP/1.1 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '0a9f9af1-45cf-4ca8-bdb8-aa46bb451620'} May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:21:35.289289 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:21:35.293814 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d1e2f3ea-cbac-4c6b-959b-18d81ac3f8ca tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 404 len: 111 microversion: 2.1 time: 0.035212 May 19 05:21:35.296442 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3090/6271] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:21:35 2022] DELETE /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:21:35.301248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:35.301973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:35.309597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:35.310147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:35.311038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:35.311571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:35.334268 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 HTTP/1.1 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '0a9f9af1-45cf-4ca8-bdb8-aa46bb451620'} May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:35.335858 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ed50a56e-c724-4a96-8150-546f29f3f85b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620" status: 404 len: 111 microversion: 2.1 time: 0.040752 May 19 05:21:35.339943 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3182/6272] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:35 2022] GET /compute/v2.1/servers/0a9f9af1-45cf-4ca8-bdb8-aa46bb451620 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:21:35.791344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:35.791946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:35.798836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:35.799365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:35.800202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:35.800711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:35.815339 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 HTTP/1.1 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2d462255-b06d-4830-bee9-412e0758fe17'} May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:21:35.816946 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4c8ef40-d258-4a7e-8b7a-89032c24f704 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 404 len: 111 microversion: 2.1 time: 0.030917 May 19 05:21:35.821460 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3091/6273] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:21:35 2022] DELETE /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:21:35.827490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:35.828128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 2d462255-b06d-4830-bee9-412e0758fe17] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:35.834382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:35.835024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:35.835814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:35.836273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:35.850320 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 HTTP/1.1 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2d462255-b06d-4830-bee9-412e0758fe17'} May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:21:35.851867 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 2d462255-b06d-4830-bee9-412e0758fe17 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18d22a8b-2fca-4c15-a262-2ce6c42c7100 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17" status: 404 len: 111 microversion: 2.1 time: 0.029961 May 19 05:21:35.857249 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3183/6274] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:35 2022] GET /compute/v2.1/servers/2d462255-b06d-4830-bee9-412e0758fe17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:21:35.933014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-067d26fd-3780-4334-958d-96993cd996e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Action: 'create', calling method: .version_select at 0x7fd31b782af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-379217399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuR0FWHxiJFI30qWaLMo40cAkVDqNAGtNk/4kFnEKFL2qHrSJ/ez6XLXI+dCA07akzvnygY9+/WoCrmjK1CrBJBtD0dKrJgMmx1qgsaRO+6TlCdl1tKQ6fPAIjj2XYdww=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:21:35.948114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-067d26fd-3780-4334-958d-96993cd996e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for project ea0ad6203d98403b94501c6d008954e3. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:21:35.953658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-067d26fd-3780-4334-958d-96993cd996e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for user dd4805bce1b245fda6cf7b31ceda6ba3 and project ea0ad6203d98403b94501c6d008954e3. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:21:35.983333 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-067d26fd-3780-4334-958d-96993cd996e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.054281 May 19 05:21:35.983968 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3092/6275] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:21:35 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:21:56.327160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1388981444", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-379217399", "security_groups": [{"name": "tempest-secgroup-smoke-1810502798"}], "block_device_mapping_v2": [{"uuid": "c57f3754-659d-46dd-96d4-bcca24aaf5a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94ba7b5a-9245-470a-85b7-9f9506544cde"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:21:56.337500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=11 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:21:56.338369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=17 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:21:56.440853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] validate_networks() for [('94ba7b5a-9245-470a-85b7-9f9506544cde', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:21:56.814898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:21:56.815368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:21:56.815873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:21:56.816300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:21:56.816730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:21:56.826183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:56.826651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:56.827473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:56.827927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:56.845201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:21:56.850503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for user dd4805bce1b245fda6cf7b31ceda6ba3 and project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:21:56.914346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:21:56.916504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c57f3754-659d-46dd-96d4-bcca24aaf5a6',volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:21:57.042266 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a6518de6-ce57-48fe-b994-8a235a1e987d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.719564 May 19 05:21:57.043530 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3184/6276] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:21:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:21:57.054204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-005069e2-e183-4445-afe5-8871abfedaff tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:57.054817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-005069e2-e183-4445-afe5-8871abfedaff tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:57.057268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=29 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:21:57.058250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:21:57.058975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:21:57.206670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-005069e2-e183-4445-afe5-8871abfedaff tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:57.213525 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-005069e2-e183-4445-afe5-8871abfedaff tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1094 microversion: 2.1 time: 0.163539 May 19 05:21:57.214263 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3093/6277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:57 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1094 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:58.232848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dd88f057-846b-45ba-98e5-0da2ec086477 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:58.234202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dd88f057-846b-45ba-98e5-0da2ec086477 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:58.242507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd88f057-846b-45ba-98e5-0da2ec086477 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:58.243304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd88f057-846b-45ba-98e5-0da2ec086477 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:58.244330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd88f057-846b-45ba-98e5-0da2ec086477 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:58.245009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dd88f057-846b-45ba-98e5-0da2ec086477 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:58.337984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dd88f057-846b-45ba-98e5-0da2ec086477 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:58.349379 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dd88f057-846b-45ba-98e5-0da2ec086477 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1210 microversion: 2.1 time: 0.121441 May 19 05:21:58.350088 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3185/6278] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:58 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:21:59.322576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bc15af05-737d-4f1d-9696-fdc0760bca62 req-dd732e22-4edb-440c-ae05-ff4435caddf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6291b82c-6ff3-41ed-b74f-788b13f48793", "tag": "c7615ffc-8fb7-423a-b306-ea1ddf1753d5"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:21:59.341654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bc15af05-737d-4f1d-9696-fdc0760bca62 req-dd732e22-4edb-440c-ae05-ff4435caddf3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:59.342363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bc15af05-737d-4f1d-9696-fdc0760bca62 req-dd732e22-4edb-440c-ae05-ff4435caddf3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:59.369999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4fdab6dc-83fb-466b-940e-5d6360c75e2c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:21:59.370567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4fdab6dc-83fb-466b-940e-5d6360c75e2c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:21:59.386737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-83fb-466b-940e-5d6360c75e2c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:59.387248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-83fb-466b-940e-5d6360c75e2c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:59.388061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-83fb-466b-940e-5d6360c75e2c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:21:59.390402 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bc15af05-737d-4f1d-9696-fdc0760bca62 req-dd732e22-4edb-440c-ae05-ff4435caddf3 service nova] Creating event network-changed:c7615ffc-8fb7-423a-b306-ea1ddf1753d5 for instance 6291b82c-6ff3-41ed-b74f-788b13f48793 on n-h2-766726-30 May 19 05:21:59.393467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4fdab6dc-83fb-466b-940e-5d6360c75e2c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:21:59.397525 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bc15af05-737d-4f1d-9696-fdc0760bca62 req-dd732e22-4edb-440c-ae05-ff4435caddf3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078697 May 19 05:21:59.398823 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3094/6279] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:21:59.629301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4fdab6dc-83fb-466b-940e-5d6360c75e2c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:21:59.639525 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4fdab6dc-83fb-466b-940e-5d6360c75e2c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1278 microversion: 2.1 time: 0.275397 May 19 05:21:59.640242 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3186/6280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:21:59 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:22:00.657835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-999404d0-6d71-4d67-b1d0-5f6cf7c8e7da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:00.658652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-999404d0-6d71-4d67-b1d0-5f6cf7c8e7da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:00.665059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-999404d0-6d71-4d67-b1d0-5f6cf7c8e7da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:00.665602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-999404d0-6d71-4d67-b1d0-5f6cf7c8e7da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:00.666454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-999404d0-6d71-4d67-b1d0-5f6cf7c8e7da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:00.666956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-999404d0-6d71-4d67-b1d0-5f6cf7c8e7da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:00.804541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-999404d0-6d71-4d67-b1d0-5f6cf7c8e7da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:00.817903 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-999404d0-6d71-4d67-b1d0-5f6cf7c8e7da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1278 microversion: 2.1 time: 0.165710 May 19 05:22:00.818721 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3095/6281] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:00 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:01.834738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7685c8c5-8e93-4ce7-a62e-c7b1a387a274 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:01.835407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7685c8c5-8e93-4ce7-a62e-c7b1a387a274 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:01.843128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7685c8c5-8e93-4ce7-a62e-c7b1a387a274 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:01.843601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7685c8c5-8e93-4ce7-a62e-c7b1a387a274 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:01.844394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7685c8c5-8e93-4ce7-a62e-c7b1a387a274 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:01.844860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7685c8c5-8e93-4ce7-a62e-c7b1a387a274 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:01.982345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7685c8c5-8e93-4ce7-a62e-c7b1a387a274 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:01.990468 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7685c8c5-8e93-4ce7-a62e-c7b1a387a274 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1278 microversion: 2.1 time: 0.159675 May 19 05:22:01.991053 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3187/6282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:01 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:03.007284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-05d60aea-b1bd-48b1-92b3-4ba8f019dc55 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:03.007897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-05d60aea-b1bd-48b1-92b3-4ba8f019dc55 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:03.015394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05d60aea-b1bd-48b1-92b3-4ba8f019dc55 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:03.015846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05d60aea-b1bd-48b1-92b3-4ba8f019dc55 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:03.016609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05d60aea-b1bd-48b1-92b3-4ba8f019dc55 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:03.017044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05d60aea-b1bd-48b1-92b3-4ba8f019dc55 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:03.157559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-05d60aea-b1bd-48b1-92b3-4ba8f019dc55 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:03.165634 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-05d60aea-b1bd-48b1-92b3-4ba8f019dc55 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1278 microversion: 2.1 time: 0.162288 May 19 05:22:03.166208 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3096/6283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:03 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:04.184500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4cc819a7-08e9-4d4a-a11d-150938316318 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:04.185184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4cc819a7-08e9-4d4a-a11d-150938316318 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:04.191941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cc819a7-08e9-4d4a-a11d-150938316318 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:04.192411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cc819a7-08e9-4d4a-a11d-150938316318 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:04.193228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cc819a7-08e9-4d4a-a11d-150938316318 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:04.193694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4cc819a7-08e9-4d4a-a11d-150938316318 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:04.324512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4cc819a7-08e9-4d4a-a11d-150938316318 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:04.334925 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4cc819a7-08e9-4d4a-a11d-150938316318 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1278 microversion: 2.1 time: 0.154830 May 19 05:22:04.335850 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3188/6284] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:04 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:05.352105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8ac047a-e97a-4f6d-a0a6-5063bcc76e27 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:05.353231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8ac047a-e97a-4f6d-a0a6-5063bcc76e27 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:05.363994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8ac047a-e97a-4f6d-a0a6-5063bcc76e27 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:05.364565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8ac047a-e97a-4f6d-a0a6-5063bcc76e27 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:05.365459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8ac047a-e97a-4f6d-a0a6-5063bcc76e27 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:05.365975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8ac047a-e97a-4f6d-a0a6-5063bcc76e27 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:05.502763 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8ac047a-e97a-4f6d-a0a6-5063bcc76e27 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:05.510503 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8ac047a-e97a-4f6d-a0a6-5063bcc76e27 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1278 microversion: 2.1 time: 0.162503 May 19 05:22:05.511088 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3097/6285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:05 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:06.527697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48d7e6b2-d457-47f5-a6e3-146a54501268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:06.528851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48d7e6b2-d457-47f5-a6e3-146a54501268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:06.535902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d7e6b2-d457-47f5-a6e3-146a54501268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:06.536375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d7e6b2-d457-47f5-a6e3-146a54501268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:06.537183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d7e6b2-d457-47f5-a6e3-146a54501268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:06.537648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d7e6b2-d457-47f5-a6e3-146a54501268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:06.666062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-48d7e6b2-d457-47f5-a6e3-146a54501268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:06.673714 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48d7e6b2-d457-47f5-a6e3-146a54501268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1278 microversion: 2.1 time: 0.150032 May 19 05:22:06.674294 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3189/6286] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:06 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:07.690426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cae0223f-6487-4a3e-94e5-2e7bc4f71d36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:07.691080 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cae0223f-6487-4a3e-94e5-2e7bc4f71d36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:07.694040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:22:07.700641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cae0223f-6487-4a3e-94e5-2e7bc4f71d36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:07.701207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cae0223f-6487-4a3e-94e5-2e7bc4f71d36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:07.702028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cae0223f-6487-4a3e-94e5-2e7bc4f71d36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:07.702469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cae0223f-6487-4a3e-94e5-2e7bc4f71d36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:07.832181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cae0223f-6487-4a3e-94e5-2e7bc4f71d36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:07.839933 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cae0223f-6487-4a3e-94e5-2e7bc4f71d36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1278 microversion: 2.1 time: 0.153490 May 19 05:22:07.841252 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3098/6287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:07 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:08.859146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0bfe16c4-a2fb-4b27-8488-7ff3fbbf6aa4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:08.859826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0bfe16c4-a2fb-4b27-8488-7ff3fbbf6aa4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:08.863608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:22:08.864279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:22:08.870994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bfe16c4-a2fb-4b27-8488-7ff3fbbf6aa4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:08.871956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bfe16c4-a2fb-4b27-8488-7ff3fbbf6aa4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:08.872738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bfe16c4-a2fb-4b27-8488-7ff3fbbf6aa4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:08.873211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bfe16c4-a2fb-4b27-8488-7ff3fbbf6aa4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:09.004479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0bfe16c4-a2fb-4b27-8488-7ff3fbbf6aa4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:09.012725 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0bfe16c4-a2fb-4b27-8488-7ff3fbbf6aa4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1266 microversion: 2.1 time: 0.158532 May 19 05:22:09.013331 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3190/6288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:08 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:10.030275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3225329-d770-4bce-8ba5-250c6b8faaad tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:10.030889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3225329-d770-4bce-8ba5-250c6b8faaad tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:10.038030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3225329-d770-4bce-8ba5-250c6b8faaad tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:10.038493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3225329-d770-4bce-8ba5-250c6b8faaad tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:10.039300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3225329-d770-4bce-8ba5-250c6b8faaad tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:10.039749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3225329-d770-4bce-8ba5-250c6b8faaad tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:10.167315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d3225329-d770-4bce-8ba5-250c6b8faaad tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:10.175219 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d3225329-d770-4bce-8ba5-250c6b8faaad tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1266 microversion: 2.1 time: 0.149400 May 19 05:22:10.175820 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3099/6289] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:10 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:11.191837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dde598c3-d0d9-442c-8152-3abe30fdc84e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:11.192454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dde598c3-d0d9-442c-8152-3abe30fdc84e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:11.199536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dde598c3-d0d9-442c-8152-3abe30fdc84e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:11.200004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dde598c3-d0d9-442c-8152-3abe30fdc84e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:11.200788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dde598c3-d0d9-442c-8152-3abe30fdc84e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:11.201274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dde598c3-d0d9-442c-8152-3abe30fdc84e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:11.342058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dde598c3-d0d9-442c-8152-3abe30fdc84e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:11.349650 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dde598c3-d0d9-442c-8152-3abe30fdc84e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1266 microversion: 2.1 time: 0.161764 May 19 05:22:11.350427 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3191/6290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:11 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:12.366408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c0a3a03-9b5f-4bc2-ac3b-3787ef79a0b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:12.367030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c0a3a03-9b5f-4bc2-ac3b-3787ef79a0b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:12.373998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a03-9b5f-4bc2-ac3b-3787ef79a0b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:12.374451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a03-9b5f-4bc2-ac3b-3787ef79a0b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:12.375218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a03-9b5f-4bc2-ac3b-3787ef79a0b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:12.375663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a03-9b5f-4bc2-ac3b-3787ef79a0b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:12.501181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c0a3a03-9b5f-4bc2-ac3b-3787ef79a0b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:12.508707 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c0a3a03-9b5f-4bc2-ac3b-3787ef79a0b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1266 microversion: 2.1 time: 0.146238 May 19 05:22:12.509323 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3100/6291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:12 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:13.526323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a8ed496c-2d7d-4efc-b625-88daa7f86f9c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:13.526864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a8ed496c-2d7d-4efc-b625-88daa7f86f9c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:13.533473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8ed496c-2d7d-4efc-b625-88daa7f86f9c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:13.533937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8ed496c-2d7d-4efc-b625-88daa7f86f9c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:13.534710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8ed496c-2d7d-4efc-b625-88daa7f86f9c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:13.535163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a8ed496c-2d7d-4efc-b625-88daa7f86f9c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:13.664807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a8ed496c-2d7d-4efc-b625-88daa7f86f9c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:13.672805 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a8ed496c-2d7d-4efc-b625-88daa7f86f9c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1266 microversion: 2.1 time: 0.150675 May 19 05:22:13.673454 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3192/6292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:13 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:14.690653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d15d805-8e3a-459e-8842-61da39895c78 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:14.691283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5d15d805-8e3a-459e-8842-61da39895c78 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:14.698064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d15d805-8e3a-459e-8842-61da39895c78 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:14.698522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d15d805-8e3a-459e-8842-61da39895c78 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:14.699305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d15d805-8e3a-459e-8842-61da39895c78 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:14.699758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d15d805-8e3a-459e-8842-61da39895c78 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:14.837181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5d15d805-8e3a-459e-8842-61da39895c78 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:14.845295 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5d15d805-8e3a-459e-8842-61da39895c78 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1266 microversion: 2.1 time: 0.158612 May 19 05:22:14.845871 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3101/6293] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:14 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:22:15.862835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27856f94-944d-46eb-86e3-c6a835109a4c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:15.863470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27856f94-944d-46eb-86e3-c6a835109a4c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:15.870390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27856f94-944d-46eb-86e3-c6a835109a4c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:15.870859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27856f94-944d-46eb-86e3-c6a835109a4c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:15.871646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27856f94-944d-46eb-86e3-c6a835109a4c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:15.872095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27856f94-944d-46eb-86e3-c6a835109a4c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:16.005247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-27856f94-944d-46eb-86e3-c6a835109a4c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:16.013222 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27856f94-944d-46eb-86e3-c6a835109a4c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1266 microversion: 2.1 time: 0.154284 May 19 05:22:16.013790 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3193/6294] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:15 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:17.030650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a02f28f-c255-44e4-8c3d-55f00214d027 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:17.031792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2a02f28f-c255-44e4-8c3d-55f00214d027 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:17.038492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a02f28f-c255-44e4-8c3d-55f00214d027 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:17.038949 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a02f28f-c255-44e4-8c3d-55f00214d027 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:17.039730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a02f28f-c255-44e4-8c3d-55f00214d027 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:17.040181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a02f28f-c255-44e4-8c3d-55f00214d027 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:17.175355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2a02f28f-c255-44e4-8c3d-55f00214d027 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:17.183343 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a02f28f-c255-44e4-8c3d-55f00214d027 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1266 microversion: 2.1 time: 0.157228 May 19 05:22:17.183998 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3102/6295] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:17 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:17.922506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2da85af6-e5ad-4094-84db-a2b9364fb1e2 req-cff6f963-65a4-4d86-a3cf-87f32acf8f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6291b82c-6ff3-41ed-b74f-788b13f48793", "name": "network-vif-plugged", "status": "completed", "tag": "c7615ffc-8fb7-423a-b306-ea1ddf1753d5"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:22:17.934677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2da85af6-e5ad-4094-84db-a2b9364fb1e2 req-cff6f963-65a4-4d86-a3cf-87f32acf8f0a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:17.935145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2da85af6-e5ad-4094-84db-a2b9364fb1e2 req-cff6f963-65a4-4d86-a3cf-87f32acf8f0a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:17.947697 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2da85af6-e5ad-4094-84db-a2b9364fb1e2 req-cff6f963-65a4-4d86-a3cf-87f32acf8f0a service nova] Creating event network-vif-plugged:c7615ffc-8fb7-423a-b306-ea1ddf1753d5 for instance 6291b82c-6ff3-41ed-b74f-788b13f48793 on n-h2-766726-30 May 19 05:22:17.953839 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2da85af6-e5ad-4094-84db-a2b9364fb1e2 req-cff6f963-65a4-4d86-a3cf-87f32acf8f0a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035552 May 19 05:22:17.954453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3194/6296] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:22:18.199827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cd86cdfb-47f2-433a-ae14-211bcddd757a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:18.200451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cd86cdfb-47f2-433a-ae14-211bcddd757a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:18.207778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd86cdfb-47f2-433a-ae14-211bcddd757a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:18.208228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd86cdfb-47f2-433a-ae14-211bcddd757a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:18.209023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd86cdfb-47f2-433a-ae14-211bcddd757a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:18.209537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cd86cdfb-47f2-433a-ae14-211bcddd757a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:18.346821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cd86cdfb-47f2-433a-ae14-211bcddd757a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:18.354769 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cd86cdfb-47f2-433a-ae14-211bcddd757a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1266 microversion: 2.1 time: 0.158874 May 19 05:22:18.355377 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3103/6297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:18 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:19.373021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7ffb8827-b0f1-4e4c-b17d-1c6850955fb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:19.373772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7ffb8827-b0f1-4e4c-b17d-1c6850955fb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:19.381034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ffb8827-b0f1-4e4c-b17d-1c6850955fb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:19.381817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ffb8827-b0f1-4e4c-b17d-1c6850955fb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:19.383443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ffb8827-b0f1-4e4c-b17d-1c6850955fb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:19.383443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ffb8827-b0f1-4e4c-b17d-1c6850955fb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:19.512530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7ffb8827-b0f1-4e4c-b17d-1c6850955fb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:19.520107 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7ffb8827-b0f1-4e4c-b17d-1c6850955fb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1453 microversion: 2.1 time: 0.151833 May 19 05:22:19.520678 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3195/6298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:19 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:19.536194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bd3a4e70-3448-4155-be22-698edde01ae5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:22:19.536814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bd3a4e70-3448-4155-be22-698edde01ae5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:22:19.543619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd3a4e70-3448-4155-be22-698edde01ae5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:19.544062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd3a4e70-3448-4155-be22-698edde01ae5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:19.544818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd3a4e70-3448-4155-be22-698edde01ae5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:19.545288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bd3a4e70-3448-4155-be22-698edde01ae5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:19.672318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bd3a4e70-3448-4155-be22-698edde01ae5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:22:19.679881 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bd3a4e70-3448-4155-be22-698edde01ae5 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1453 microversion: 2.1 time: 0.147549 May 19 05:22:19.680458 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3104/6299] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:22:19 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:22:21.328741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-dbb47579-1b49-4c12-a0a3-2b2e1d3b7a86 req-df2de63d-5464-4f36-b27f-30b8f50757f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6291b82c-6ff3-41ed-b74f-788b13f48793", "tag": "c7615ffc-8fb7-423a-b306-ea1ddf1753d5"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:22:21.338570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dbb47579-1b49-4c12-a0a3-2b2e1d3b7a86 req-df2de63d-5464-4f36-b27f-30b8f50757f7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:22:21.339029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dbb47579-1b49-4c12-a0a3-2b2e1d3b7a86 req-df2de63d-5464-4f36-b27f-30b8f50757f7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:22:21.350801 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-dbb47579-1b49-4c12-a0a3-2b2e1d3b7a86 req-df2de63d-5464-4f36-b27f-30b8f50757f7 service nova] Creating event network-changed:c7615ffc-8fb7-423a-b306-ea1ddf1753d5 for instance 6291b82c-6ff3-41ed-b74f-788b13f48793 on n-h2-766726-30 May 19 05:22:21.356723 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-dbb47579-1b49-4c12-a0a3-2b2e1d3b7a86 req-df2de63d-5464-4f36-b27f-30b8f50757f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032514 May 19 05:22:21.357467 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3196/6300] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:23:09.031821 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:23:09.032617 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:23:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:23:09.860416 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:23:09.861000 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:23:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:24:18.517066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=26 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:18.518043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=62 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:18.575624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0b82683-90a0-4ecf-9892-05a2fd06d1b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:18.576140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b0b82683-90a0-4ecf-9892-05a2fd06d1b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:18.582412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0b82683-90a0-4ecf-9892-05a2fd06d1b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:18.582816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0b82683-90a0-4ecf-9892-05a2fd06d1b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:18.583594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0b82683-90a0-4ecf-9892-05a2fd06d1b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:18.584044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0b82683-90a0-4ecf-9892-05a2fd06d1b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:18.610190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b0b82683-90a0-4ecf-9892-05a2fd06d1b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:24:18.688360 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0b82683-90a0-4ecf-9892-05a2fd06d1b8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 204 len: 0 microversion: 2.1 time: 0.173064 May 19 05:24:18.688942 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3105/6301] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:24:18 2022] DELETE /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:24:18.696840 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2869c6-282b-4cce-84de-e63fb06fc5d4] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 19 05:24:18.697726 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [01022541-891f-4ef1-a973-f7b4510bbfd8] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 19 05:24:18.698673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:18.699436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=66 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:18.703875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-33f47db8-e676-40ed-a037-914bff96f6b7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:18.704602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-33f47db8-e676-40ed-a037-914bff96f6b7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:18.713106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f47db8-e676-40ed-a037-914bff96f6b7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:18.713595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f47db8-e676-40ed-a037-914bff96f6b7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:18.714395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f47db8-e676-40ed-a037-914bff96f6b7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:18.718235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-33f47db8-e676-40ed-a037-914bff96f6b7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:18.905181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-33f47db8-e676-40ed-a037-914bff96f6b7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:18.913481 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-33f47db8-e676-40ed-a037-914bff96f6b7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1578 microversion: 2.1 time: 0.219216 May 19 05:24:18.914073 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3197/6302] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:18 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:24:19.931930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b23e3283-359b-47cf-9634-f7b1fd8f3c04 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:19.932627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b23e3283-359b-47cf-9634-f7b1fd8f3c04 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:19.940236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b23e3283-359b-47cf-9634-f7b1fd8f3c04 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:19.940687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b23e3283-359b-47cf-9634-f7b1fd8f3c04 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:19.941476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b23e3283-359b-47cf-9634-f7b1fd8f3c04 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:19.941910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b23e3283-359b-47cf-9634-f7b1fd8f3c04 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:20.074062 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b23e3283-359b-47cf-9634-f7b1fd8f3c04 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:20.081695 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b23e3283-359b-47cf-9634-f7b1fd8f3c04 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1578 microversion: 2.1 time: 0.154502 May 19 05:24:20.082270 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3106/6303] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:19 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:21.066497 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2869c6-282b-4cce-84de-e63fb06fc5d4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55182. May 19 05:24:21.067275 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] [01022541-891f-4ef1-a973-f7b4510bbfd8] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55184. May 19 05:24:21.106971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-07c8bd81-fbe1-4695-8b3b-20b88cc6f268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:21.107732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-07c8bd81-fbe1-4695-8b3b-20b88cc6f268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:21.124142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07c8bd81-fbe1-4695-8b3b-20b88cc6f268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:21.125148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07c8bd81-fbe1-4695-8b3b-20b88cc6f268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:21.129370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07c8bd81-fbe1-4695-8b3b-20b88cc6f268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:21.129370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07c8bd81-fbe1-4695-8b3b-20b88cc6f268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:21.184910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6e86c437-abf2-4c58-83ed-ce8942eefa8c req-1c329e28-6c54-426d-9528-346de089fb11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6291b82c-6ff3-41ed-b74f-788b13f48793", "name": "network-vif-deleted", "tag": "c7615ffc-8fb7-423a-b306-ea1ddf1753d5"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:24:21.193633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6e86c437-abf2-4c58-83ed-ce8942eefa8c req-1c329e28-6c54-426d-9528-346de089fb11 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:21.194641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6e86c437-abf2-4c58-83ed-ce8942eefa8c req-1c329e28-6c54-426d-9528-346de089fb11 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:21.216278 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6e86c437-abf2-4c58-83ed-ce8942eefa8c req-1c329e28-6c54-426d-9528-346de089fb11 service nova] Creating event network-vif-deleted:c7615ffc-8fb7-423a-b306-ea1ddf1753d5 for instance 6291b82c-6ff3-41ed-b74f-788b13f48793 on n-h2-766726-30 May 19 05:24:21.222311 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6e86c437-abf2-4c58-83ed-ce8942eefa8c req-1c329e28-6c54-426d-9528-346de089fb11 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170258 May 19 05:24:21.223569 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3198/6304] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:24:21.288148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-07c8bd81-fbe1-4695-8b3b-20b88cc6f268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:21.301736 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-07c8bd81-fbe1-4695-8b3b-20b88cc6f268 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1225 microversion: 2.1 time: 0.205790 May 19 05:24:21.311858 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3107/6305] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:21 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1225 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:22.320148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-14fd2f3d-7689-4692-98c4-09bfe7cd3296 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:22.320987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-14fd2f3d-7689-4692-98c4-09bfe7cd3296 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:22.327645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14fd2f3d-7689-4692-98c4-09bfe7cd3296 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:22.328165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14fd2f3d-7689-4692-98c4-09bfe7cd3296 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:22.329165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14fd2f3d-7689-4692-98c4-09bfe7cd3296 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:22.329785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-14fd2f3d-7689-4692-98c4-09bfe7cd3296 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:22.392549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-14fd2f3d-7689-4692-98c4-09bfe7cd3296 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:22.400827 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-14fd2f3d-7689-4692-98c4-09bfe7cd3296 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1225 microversion: 2.1 time: 0.085882 May 19 05:24:22.401433 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3199/6306] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:22 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:23.418196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-195bf475-2ce0-46d7-a44a-0c62dd6f2166 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:23.418821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-195bf475-2ce0-46d7-a44a-0c62dd6f2166 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:23.426533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-195bf475-2ce0-46d7-a44a-0c62dd6f2166 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:23.426983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-195bf475-2ce0-46d7-a44a-0c62dd6f2166 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:23.427778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-195bf475-2ce0-46d7-a44a-0c62dd6f2166 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:23.428217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-195bf475-2ce0-46d7-a44a-0c62dd6f2166 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:23.489058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-195bf475-2ce0-46d7-a44a-0c62dd6f2166 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:23.496893 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-195bf475-2ce0-46d7-a44a-0c62dd6f2166 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1225 microversion: 2.1 time: 0.082635 May 19 05:24:23.497518 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3108/6307] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:23 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:24.513811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad0f92bb-ec9d-407e-b047-0c591ecbb48e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:24.514438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ad0f92bb-ec9d-407e-b047-0c591ecbb48e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:24.521651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad0f92bb-ec9d-407e-b047-0c591ecbb48e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:24.522111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad0f92bb-ec9d-407e-b047-0c591ecbb48e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:24.523449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad0f92bb-ec9d-407e-b047-0c591ecbb48e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:24.523898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad0f92bb-ec9d-407e-b047-0c591ecbb48e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:24.587672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ad0f92bb-ec9d-407e-b047-0c591ecbb48e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:24.596020 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad0f92bb-ec9d-407e-b047-0c591ecbb48e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1225 microversion: 2.1 time: 0.086042 May 19 05:24:24.596742 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3200/6308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:24 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:25.613431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7fdfd83b-8645-4815-81cd-6258c362254d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:25.614055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7fdfd83b-8645-4815-81cd-6258c362254d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:25.621562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fdfd83b-8645-4815-81cd-6258c362254d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:25.622022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fdfd83b-8645-4815-81cd-6258c362254d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:25.622793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fdfd83b-8645-4815-81cd-6258c362254d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:25.623234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7fdfd83b-8645-4815-81cd-6258c362254d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:25.696542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7fdfd83b-8645-4815-81cd-6258c362254d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:25.704338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7fdfd83b-8645-4815-81cd-6258c362254d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1225 microversion: 2.1 time: 0.094950 May 19 05:24:25.705136 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3109/6309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:25 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:26.720771 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9083a203-2169-4449-9bbb-30f00abdf31e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:26.721440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9083a203-2169-4449-9bbb-30f00abdf31e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:26.728471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9083a203-2169-4449-9bbb-30f00abdf31e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:26.729206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9083a203-2169-4449-9bbb-30f00abdf31e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:26.730033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9083a203-2169-4449-9bbb-30f00abdf31e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:26.730486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9083a203-2169-4449-9bbb-30f00abdf31e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:26.791781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9083a203-2169-4449-9bbb-30f00abdf31e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:26.799398 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9083a203-2169-4449-9bbb-30f00abdf31e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1225 microversion: 2.1 time: 0.082632 May 19 05:24:26.799968 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3201/6310] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:26 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:27.815940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6606bebe-29e5-4d25-a12f-544b25789340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:27.816575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6606bebe-29e5-4d25-a12f-544b25789340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:27.823791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6606bebe-29e5-4d25-a12f-544b25789340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:27.824236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6606bebe-29e5-4d25-a12f-544b25789340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:27.825020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6606bebe-29e5-4d25-a12f-544b25789340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:27.825487 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6606bebe-29e5-4d25-a12f-544b25789340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:27.886055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6606bebe-29e5-4d25-a12f-544b25789340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:27.893852 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6606bebe-29e5-4d25-a12f-544b25789340 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1225 microversion: 2.1 time: 0.081849 May 19 05:24:27.894427 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3110/6311] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:27 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:28.910620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1dd6e59-f23e-45f8-858c-dc7798635550 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:28.911262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1dd6e59-f23e-45f8-858c-dc7798635550 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:28.919070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1dd6e59-f23e-45f8-858c-dc7798635550 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:28.920053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1dd6e59-f23e-45f8-858c-dc7798635550 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:28.920339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1dd6e59-f23e-45f8-858c-dc7798635550 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:28.920802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1dd6e59-f23e-45f8-858c-dc7798635550 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:28.982551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1dd6e59-f23e-45f8-858c-dc7798635550 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:28.990353 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1dd6e59-f23e-45f8-858c-dc7798635550 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1225 microversion: 2.1 time: 0.083668 May 19 05:24:28.990939 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3202/6312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:28 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:30.008497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3e260a39-f85e-44d1-93bf-f1742812d7db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:30.009217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3e260a39-f85e-44d1-93bf-f1742812d7db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:30.016814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e260a39-f85e-44d1-93bf-f1742812d7db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:30.017301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e260a39-f85e-44d1-93bf-f1742812d7db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:30.018106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e260a39-f85e-44d1-93bf-f1742812d7db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:30.018544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e260a39-f85e-44d1-93bf-f1742812d7db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:30.086624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3e260a39-f85e-44d1-93bf-f1742812d7db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:30.094732 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3e260a39-f85e-44d1-93bf-f1742812d7db tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 200 len: 1225 microversion: 2.1 time: 0.090809 May 19 05:24:30.095333 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3111/6313] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:30 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:31.111755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:31.112394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:31.119313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:31.119773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:31.120554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:31.121005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:31.134928 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 HTTP/1.1 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '6291b82c-6ff3-41ed-b74f-788b13f48793'} May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:24:31.136587 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7b9ae8c0-bd80-414f-ac9f-4dc2766972b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 404 len: 111 microversion: 2.1 time: 0.030238 May 19 05:24:31.141447 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3203/6314] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:31 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:24:31.187234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1403450621", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-379217399", "security_groups": [{"name": "tempest-secgroup-smoke-1810502798"}], "block_device_mapping_v2": [{"uuid": "c57f3754-659d-46dd-96d4-bcca24aaf5a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94ba7b5a-9245-470a-85b7-9f9506544cde"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:24:31.298926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] validate_networks() for [('94ba7b5a-9245-470a-85b7-9f9506544cde', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:24:31.656152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:24:31.656587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:24:31.657122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:24:31.657544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:24:31.657968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:24:31.667840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:31.668318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:31.669144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:31.669612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:31.686002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:24:31.691230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for user dd4805bce1b245fda6cf7b31ceda6ba3 and project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:24:31.749314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:24:31.751410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c57f3754-659d-46dd-96d4-bcca24aaf5a6',volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:24:31.878574 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-52dd6094-a027-4bff-b632-4eda17c0f595 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695191 May 19 05:24:31.879228 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3112/6315] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:24:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:24:31.890403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5ad58ebf-6719-45f6-91cc-53c44b3a983e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:31.891075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5ad58ebf-6719-45f6-91cc-53c44b3a983e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:31.945335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5ad58ebf-6719-45f6-91cc-53c44b3a983e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:31.952335 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5ad58ebf-6719-45f6-91cc-53c44b3a983e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1094 microversion: 2.1 time: 0.066344 May 19 05:24:31.952919 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3204/6316] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:31 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:32.970884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd8b021d-5ddc-46de-ab25-58ce6fd0d06e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:32.971510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fd8b021d-5ddc-46de-ab25-58ce6fd0d06e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:32.978510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd8b021d-5ddc-46de-ab25-58ce6fd0d06e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:32.979222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd8b021d-5ddc-46de-ab25-58ce6fd0d06e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:32.980009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd8b021d-5ddc-46de-ab25-58ce6fd0d06e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:32.980618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd8b021d-5ddc-46de-ab25-58ce6fd0d06e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:33.048804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd8b021d-5ddc-46de-ab25-58ce6fd0d06e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:33.057739 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd8b021d-5ddc-46de-ab25-58ce6fd0d06e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1210 microversion: 2.1 time: 0.091950 May 19 05:24:33.058420 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3113/6317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:32 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:34.075150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d74e2650-c21a-4f04-8018-3b28b1d17ae1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:34.075799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d74e2650-c21a-4f04-8018-3b28b1d17ae1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:34.084412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d74e2650-c21a-4f04-8018-3b28b1d17ae1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:34.085040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d74e2650-c21a-4f04-8018-3b28b1d17ae1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:34.085944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d74e2650-c21a-4f04-8018-3b28b1d17ae1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:34.086462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d74e2650-c21a-4f04-8018-3b28b1d17ae1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:34.638137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d74e2650-c21a-4f04-8018-3b28b1d17ae1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:34.652683 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d74e2650-c21a-4f04-8018-3b28b1d17ae1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1278 microversion: 2.1 time: 0.581503 May 19 05:24:34.662773 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3205/6318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:34 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1278 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:34.800870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1e597381-36e3-44ee-b082-330a22678c6a req-918eb3eb-e478-4876-80c5-00e81337ddbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b2f12f-bbb3-4c11-9e4b-eec60603dc33", "tag": "a0601901-dc65-463c-b725-68bddd1c4be7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:24:34.811719 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1e597381-36e3-44ee-b082-330a22678c6a req-918eb3eb-e478-4876-80c5-00e81337ddbd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:34.812497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1e597381-36e3-44ee-b082-330a22678c6a req-918eb3eb-e478-4876-80c5-00e81337ddbd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:34.836751 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1e597381-36e3-44ee-b082-330a22678c6a req-918eb3eb-e478-4876-80c5-00e81337ddbd service nova] Creating event network-changed:a0601901-dc65-463c-b725-68bddd1c4be7 for instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 on n-h1-766726-30 May 19 05:24:34.843365 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1e597381-36e3-44ee-b082-330a22678c6a req-918eb3eb-e478-4876-80c5-00e81337ddbd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191840 May 19 05:24:34.847857 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3114/6319] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:24:35.678172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-08197b3d-2d24-4b3e-a20d-8725c1c21702 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:35.678794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-08197b3d-2d24-4b3e-a20d-8725c1c21702 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:35.686066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08197b3d-2d24-4b3e-a20d-8725c1c21702 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:35.686530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08197b3d-2d24-4b3e-a20d-8725c1c21702 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:35.687306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08197b3d-2d24-4b3e-a20d-8725c1c21702 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:35.687756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08197b3d-2d24-4b3e-a20d-8725c1c21702 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:35.824418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08197b3d-2d24-4b3e-a20d-8725c1c21702 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:35.832249 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-08197b3d-2d24-4b3e-a20d-8725c1c21702 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1278 microversion: 2.1 time: 0.157996 May 19 05:24:35.832821 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3206/6320] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:35 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:36.851517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00d98b8a-1883-4172-8499-76c8559f8d08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:36.852255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00d98b8a-1883-4172-8499-76c8559f8d08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:36.858887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00d98b8a-1883-4172-8499-76c8559f8d08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:36.859347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00d98b8a-1883-4172-8499-76c8559f8d08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:36.860121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00d98b8a-1883-4172-8499-76c8559f8d08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:36.860566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00d98b8a-1883-4172-8499-76c8559f8d08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:36.996931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-00d98b8a-1883-4172-8499-76c8559f8d08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:37.004901 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00d98b8a-1883-4172-8499-76c8559f8d08 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1278 microversion: 2.1 time: 0.159213 May 19 05:24:37.005555 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3115/6321] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:36 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:38.021968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9cd0fad4-ed6c-4e5c-a033-eef0b61978f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:38.022604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9cd0fad4-ed6c-4e5c-a033-eef0b61978f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:38.029855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd0fad4-ed6c-4e5c-a033-eef0b61978f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:38.030323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd0fad4-ed6c-4e5c-a033-eef0b61978f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:38.031093 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd0fad4-ed6c-4e5c-a033-eef0b61978f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:38.031544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd0fad4-ed6c-4e5c-a033-eef0b61978f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:38.163784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9cd0fad4-ed6c-4e5c-a033-eef0b61978f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:38.171480 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9cd0fad4-ed6c-4e5c-a033-eef0b61978f3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1278 microversion: 2.1 time: 0.153481 May 19 05:24:38.172067 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3207/6322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:38 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:39.187781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be46817d-9470-4380-8103-b6c32c608fb7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:39.188521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be46817d-9470-4380-8103-b6c32c608fb7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:39.196173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be46817d-9470-4380-8103-b6c32c608fb7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:39.196628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be46817d-9470-4380-8103-b6c32c608fb7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:39.197429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be46817d-9470-4380-8103-b6c32c608fb7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:39.197866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be46817d-9470-4380-8103-b6c32c608fb7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:39.336668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-be46817d-9470-4380-8103-b6c32c608fb7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:39.344394 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be46817d-9470-4380-8103-b6c32c608fb7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1278 microversion: 2.1 time: 0.160512 May 19 05:24:39.345088 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3116/6323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:39 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:40.362532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e2128fe-6ca9-47d5-860f-3c5a20116e25 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:40.363262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3e2128fe-6ca9-47d5-860f-3c5a20116e25 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:40.370916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e2128fe-6ca9-47d5-860f-3c5a20116e25 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:40.371453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e2128fe-6ca9-47d5-860f-3c5a20116e25 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:40.372246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e2128fe-6ca9-47d5-860f-3c5a20116e25 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:40.372700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e2128fe-6ca9-47d5-860f-3c5a20116e25 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:40.511563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3e2128fe-6ca9-47d5-860f-3c5a20116e25 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:40.519229 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3e2128fe-6ca9-47d5-860f-3c5a20116e25 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1278 microversion: 2.1 time: 0.160764 May 19 05:24:40.519808 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3208/6324] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:40 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:41.536022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7b7c440-3888-4662-8135-2fa22f717ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:41.536549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7b7c440-3888-4662-8135-2fa22f717ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:41.544117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7b7c440-3888-4662-8135-2fa22f717ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:41.544578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7b7c440-3888-4662-8135-2fa22f717ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:41.545376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7b7c440-3888-4662-8135-2fa22f717ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:41.545824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7b7c440-3888-4662-8135-2fa22f717ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:41.676022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7b7c440-3888-4662-8135-2fa22f717ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:41.678432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:41.685724 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7b7c440-3888-4662-8135-2fa22f717ac0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1278 microversion: 2.1 time: 0.153807 May 19 05:24:41.686310 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3117/6325] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:41 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:42.701719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-84720578-9cdc-4917-b0c5-a5d0ddfdeed6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:42.702342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-84720578-9cdc-4917-b0c5-a5d0ddfdeed6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:42.705190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:42.712748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84720578-9cdc-4917-b0c5-a5d0ddfdeed6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:42.713807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84720578-9cdc-4917-b0c5-a5d0ddfdeed6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:42.714783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84720578-9cdc-4917-b0c5-a5d0ddfdeed6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:42.715392 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-84720578-9cdc-4917-b0c5-a5d0ddfdeed6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:42.850129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-84720578-9cdc-4917-b0c5-a5d0ddfdeed6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:42.858171 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-84720578-9cdc-4917-b0c5-a5d0ddfdeed6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1278 microversion: 2.1 time: 0.160365 May 19 05:24:42.858744 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3209/6326] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:42 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:43.876035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-03a5f267-8417-4d96-8053-11ac4c34abb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:43.876656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-03a5f267-8417-4d96-8053-11ac4c34abb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:43.878577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:43.884660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03a5f267-8417-4d96-8053-11ac4c34abb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:43.885148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03a5f267-8417-4d96-8053-11ac4c34abb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:43.886339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03a5f267-8417-4d96-8053-11ac4c34abb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:43.886796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03a5f267-8417-4d96-8053-11ac4c34abb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:44.014197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-03a5f267-8417-4d96-8053-11ac4c34abb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:44.021783 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-03a5f267-8417-4d96-8053-11ac4c34abb2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1266 microversion: 2.1 time: 0.149904 May 19 05:24:44.022364 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3118/6327] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:43 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:45.038909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a9b85629-6323-4f2b-94d3-2fcc141689e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:45.039485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a9b85629-6323-4f2b-94d3-2fcc141689e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:45.046635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9b85629-6323-4f2b-94d3-2fcc141689e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:45.047100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9b85629-6323-4f2b-94d3-2fcc141689e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:45.047873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9b85629-6323-4f2b-94d3-2fcc141689e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:45.048323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a9b85629-6323-4f2b-94d3-2fcc141689e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:45.178774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a9b85629-6323-4f2b-94d3-2fcc141689e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:45.186940 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a9b85629-6323-4f2b-94d3-2fcc141689e8 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1266 microversion: 2.1 time: 0.152027 May 19 05:24:45.187515 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3210/6328] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:45 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:46.204020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aadfd4d4-1b99-4060-be0e-0a6e74e630e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:46.204670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aadfd4d4-1b99-4060-be0e-0a6e74e630e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:46.211610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aadfd4d4-1b99-4060-be0e-0a6e74e630e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:46.212064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aadfd4d4-1b99-4060-be0e-0a6e74e630e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:46.212833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aadfd4d4-1b99-4060-be0e-0a6e74e630e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:46.213317 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aadfd4d4-1b99-4060-be0e-0a6e74e630e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:46.341893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aadfd4d4-1b99-4060-be0e-0a6e74e630e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:46.349434 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aadfd4d4-1b99-4060-be0e-0a6e74e630e6 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1266 microversion: 2.1 time: 0.149375 May 19 05:24:46.350007 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3119/6329] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:46 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:47.366624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d3301bb1-9461-427f-8db5-de5aa7df0030 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:47.367265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d3301bb1-9461-427f-8db5-de5aa7df0030 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:47.374175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3301bb1-9461-427f-8db5-de5aa7df0030 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:47.374645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3301bb1-9461-427f-8db5-de5aa7df0030 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:47.375420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3301bb1-9461-427f-8db5-de5aa7df0030 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:47.375879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3301bb1-9461-427f-8db5-de5aa7df0030 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:47.505345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d3301bb1-9461-427f-8db5-de5aa7df0030 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:47.513420 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d3301bb1-9461-427f-8db5-de5aa7df0030 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1266 microversion: 2.1 time: 0.150681 May 19 05:24:47.513995 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3211/6330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:47 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:48.530203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5efb293c-08c4-4b54-adbc-ff496584b37c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:48.530807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5efb293c-08c4-4b54-adbc-ff496584b37c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:48.533471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:48.538866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5efb293c-08c4-4b54-adbc-ff496584b37c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:48.539316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5efb293c-08c4-4b54-adbc-ff496584b37c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:48.540066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5efb293c-08c4-4b54-adbc-ff496584b37c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:48.540502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5efb293c-08c4-4b54-adbc-ff496584b37c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:48.543734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:48.676412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5efb293c-08c4-4b54-adbc-ff496584b37c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:48.684510 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5efb293c-08c4-4b54-adbc-ff496584b37c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1266 microversion: 2.1 time: 0.158235 May 19 05:24:48.685096 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3120/6331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:48 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:49.702069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c50e6fa-9066-4a2e-b715-9fdf1ae23762 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:49.703327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2c50e6fa-9066-4a2e-b715-9fdf1ae23762 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:49.709423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=33 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:49.711317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c50e6fa-9066-4a2e-b715-9fdf1ae23762 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:49.711786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c50e6fa-9066-4a2e-b715-9fdf1ae23762 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:49.712568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c50e6fa-9066-4a2e-b715-9fdf1ae23762 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:49.713020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c50e6fa-9066-4a2e-b715-9fdf1ae23762 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:49.716210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=77 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:24:49.778455 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:24:49.779040 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:24:49.848744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2c50e6fa-9066-4a2e-b715-9fdf1ae23762 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:49.857133 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c50e6fa-9066-4a2e-b715-9fdf1ae23762 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1266 microversion: 2.1 time: 0.159013 May 19 05:24:49.857709 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3212/6332] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:49 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:50.873342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-993b8f2c-f9c9-4afa-a433-e24836697429 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:50.873960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-993b8f2c-f9c9-4afa-a433-e24836697429 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:50.880770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-993b8f2c-f9c9-4afa-a433-e24836697429 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:50.881252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-993b8f2c-f9c9-4afa-a433-e24836697429 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:50.882013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-993b8f2c-f9c9-4afa-a433-e24836697429 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:50.882452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-993b8f2c-f9c9-4afa-a433-e24836697429 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:51.000194 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:24:51.000735 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:24:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:24:51.016587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-993b8f2c-f9c9-4afa-a433-e24836697429 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:51.028628 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-993b8f2c-f9c9-4afa-a433-e24836697429 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1266 microversion: 2.1 time: 0.159178 May 19 05:24:51.029240 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3121/6333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:50 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:52.046538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bb1718a3-50d4-4dab-ba08-841432ff74c4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:52.047163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bb1718a3-50d4-4dab-ba08-841432ff74c4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:52.053317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bb1718a3-50d4-4dab-ba08-841432ff74c4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:52.053778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bb1718a3-50d4-4dab-ba08-841432ff74c4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:52.055597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bb1718a3-50d4-4dab-ba08-841432ff74c4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:52.056053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bb1718a3-50d4-4dab-ba08-841432ff74c4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:52.178099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2401522d-6522-4814-8950-5737dc5d2b54 req-5cb681e7-e67b-4a0a-9793-312e66fea4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b2f12f-bbb3-4c11-9e4b-eec60603dc33", "name": "network-vif-plugged", "status": "completed", "tag": "a0601901-dc65-463c-b725-68bddd1c4be7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:24:52.187149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2401522d-6522-4814-8950-5737dc5d2b54 req-5cb681e7-e67b-4a0a-9793-312e66fea4be service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:52.187591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2401522d-6522-4814-8950-5737dc5d2b54 req-5cb681e7-e67b-4a0a-9793-312e66fea4be service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:52.203404 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2401522d-6522-4814-8950-5737dc5d2b54 req-5cb681e7-e67b-4a0a-9793-312e66fea4be service nova] Creating event network-vif-plugged:a0601901-dc65-463c-b725-68bddd1c4be7 for instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 on n-h1-766726-30 May 19 05:24:52.203688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bb1718a3-50d4-4dab-ba08-841432ff74c4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:52.210206 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2401522d-6522-4814-8950-5737dc5d2b54 req-5cb681e7-e67b-4a0a-9793-312e66fea4be service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113573 May 19 05:24:52.211061 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3122/6334] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:24:52.211327 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bb1718a3-50d4-4dab-ba08-841432ff74c4 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1266 microversion: 2.1 time: 0.169308 May 19 05:24:52.211892 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3213/6335] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:52 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:53.228300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f1853ef7-6672-45d6-8881-ce072e4f3d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:53.229292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f1853ef7-6672-45d6-8881-ce072e4f3d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:53.236316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1853ef7-6672-45d6-8881-ce072e4f3d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:53.236774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1853ef7-6672-45d6-8881-ce072e4f3d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:53.237643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1853ef7-6672-45d6-8881-ce072e4f3d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:53.238087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f1853ef7-6672-45d6-8881-ce072e4f3d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:53.368901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f1853ef7-6672-45d6-8881-ce072e4f3d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:53.376605 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f1853ef7-6672-45d6-8881-ce072e4f3d5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1266 microversion: 2.1 time: 0.152599 May 19 05:24:53.377204 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3123/6336] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:53 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:54.393993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5d572911-1156-49ab-9743-7fd37be8ed75 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:54.394623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5d572911-1156-49ab-9743-7fd37be8ed75 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:54.402410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d572911-1156-49ab-9743-7fd37be8ed75 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:54.402875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d572911-1156-49ab-9743-7fd37be8ed75 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:54.403656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d572911-1156-49ab-9743-7fd37be8ed75 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:54.404106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d572911-1156-49ab-9743-7fd37be8ed75 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:54.535399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d572911-1156-49ab-9743-7fd37be8ed75 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:54.543042 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5d572911-1156-49ab-9743-7fd37be8ed75 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1453 microversion: 2.1 time: 0.152972 May 19 05:24:54.543641 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3214/6337] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:54 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:54.559741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-15e9639f-7c75-439e-8d1d-b8d64d384b79 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:24:54.560365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-15e9639f-7c75-439e-8d1d-b8d64d384b79 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:24:54.567359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15e9639f-7c75-439e-8d1d-b8d64d384b79 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:54.567816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15e9639f-7c75-439e-8d1d-b8d64d384b79 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:54.568586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15e9639f-7c75-439e-8d1d-b8d64d384b79 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:54.569035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-15e9639f-7c75-439e-8d1d-b8d64d384b79 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:54.697214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-15e9639f-7c75-439e-8d1d-b8d64d384b79 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:24:54.705596 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-15e9639f-7c75-439e-8d1d-b8d64d384b79 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1453 microversion: 2.1 time: 0.149719 May 19 05:24:54.706366 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3124/6338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:24:54 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:24:56.321580 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0cefc42d-dcfb-4ebb-bd43-64b35ec58f53 req-d278a0e6-f7be-4705-85f7-beb3fe54912e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b2f12f-bbb3-4c11-9e4b-eec60603dc33", "tag": "a0601901-dc65-463c-b725-68bddd1c4be7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:24:56.333437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0cefc42d-dcfb-4ebb-bd43-64b35ec58f53 req-d278a0e6-f7be-4705-85f7-beb3fe54912e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:24:56.333437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0cefc42d-dcfb-4ebb-bd43-64b35ec58f53 req-d278a0e6-f7be-4705-85f7-beb3fe54912e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:24:56.343164 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0cefc42d-dcfb-4ebb-bd43-64b35ec58f53 req-d278a0e6-f7be-4705-85f7-beb3fe54912e service nova] Creating event network-changed:a0601901-dc65-463c-b725-68bddd1c4be7 for instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 on n-h1-766726-30 May 19 05:24:56.348552 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0cefc42d-dcfb-4ebb-bd43-64b35ec58f53 req-d278a0e6-f7be-4705-85f7-beb3fe54912e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031937 May 19 05:24:56.349197 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3215/6339] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:26:29.039931 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:26:29.040669 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:26:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:26:50.368768 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11f4aea6-c176-403c-9633-d60098efd474] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 05:26:50.369792 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99e79aa7-a0e7-43bd-8544-8a0b9dce8b08] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 05:26:50.370351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=9 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:26:50.371106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=25 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:26:50.375742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-317653556", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-379217399", "security_groups": [{"name": "tempest-secgroup-smoke-1810502798"}], "block_device_mapping_v2": [{"uuid": "1a09843c-8d0b-4dc3-b4e8-8ef8f6db6e62", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94ba7b5a-9245-470a-85b7-9f9506544cde"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:26:50.485097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] validate_networks() for [('94ba7b5a-9245-470a-85b7-9f9506544cde', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:26:50.887340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:26:50.887766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:26:50.888248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:26:50.888657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:26:50.889098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:26:50.898304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:50.898751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:50.899547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:50.899981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:50.917606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:26:50.922797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Getting quotas for user dd4805bce1b245fda6cf7b31ceda6ba3 and project ea0ad6203d98403b94501c6d008954e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:26:50.980581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:26:50.982744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a09843c-8d0b-4dc3-b4e8-8ef8f6db6e62',volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:26:51.104816 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-abf00784-1883-4f21-a258-d974ccd6591e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.738118 May 19 05:26:51.105504 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3125/6340] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:26:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:26:51.114898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=7 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:26:51.115845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=19 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:26:51.122903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b86759f1-43bf-4135-8d22-2c64f4153b70 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:26:51.123648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b86759f1-43bf-4135-8d22-2c64f4153b70 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:26:51.178827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b86759f1-43bf-4135-8d22-2c64f4153b70 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:26:51.186475 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b86759f1-43bf-4135-8d22-2c64f4153b70 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1093 microversion: 2.1 time: 0.074599 May 19 05:26:51.187022 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3216/6341] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:26:51 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:26:52.208751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd1de23d-313e-4f7f-ad1d-d31f16fbe04e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:26:52.209403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fd1de23d-313e-4f7f-ad1d-d31f16fbe04e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:26:52.221417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd1de23d-313e-4f7f-ad1d-d31f16fbe04e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:52.222016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd1de23d-313e-4f7f-ad1d-d31f16fbe04e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:52.222692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd1de23d-313e-4f7f-ad1d-d31f16fbe04e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:52.223143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd1de23d-313e-4f7f-ad1d-d31f16fbe04e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:52.247794 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] [11f4aea6-c176-403c-9633-d60098efd474] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55408. May 19 05:26:52.251447 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] [99e79aa7-a0e7-43bd-8544-8a0b9dce8b08] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55410. May 19 05:26:52.312267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd1de23d-313e-4f7f-ad1d-d31f16fbe04e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:26:52.320367 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd1de23d-313e-4f7f-ad1d-d31f16fbe04e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1209 microversion: 2.1 time: 0.117925 May 19 05:26:52.321064 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3126/6342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:26:52 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:26:53.338813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd52b8df-3c94-486a-a03f-470f44656eb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:26:53.339458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cd52b8df-3c94-486a-a03f-470f44656eb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:26:53.365944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd52b8df-3c94-486a-a03f-470f44656eb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:53.366661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd52b8df-3c94-486a-a03f-470f44656eb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:53.368279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd52b8df-3c94-486a-a03f-470f44656eb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:53.369117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd52b8df-3c94-486a-a03f-470f44656eb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:53.604427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ef80a2db-5fb0-4645-bfa7-8f776e8fe6c4 req-50400194-7589-4ca6-8bf7-bfa67015b9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec59cda5-263b-47ff-b905-171770942a34", "tag": "8482545f-c8fd-4444-a2ec-83189ee08381"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:26:53.625269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ef80a2db-5fb0-4645-bfa7-8f776e8fe6c4 req-50400194-7589-4ca6-8bf7-bfa67015b9e0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:53.626050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ef80a2db-5fb0-4645-bfa7-8f776e8fe6c4 req-50400194-7589-4ca6-8bf7-bfa67015b9e0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:53.635891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cd52b8df-3c94-486a-a03f-470f44656eb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:26:53.638955 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ef80a2db-5fb0-4645-bfa7-8f776e8fe6c4 req-50400194-7589-4ca6-8bf7-bfa67015b9e0 service nova] Creating event network-changed:8482545f-c8fd-4444-a2ec-83189ee08381 for instance ec59cda5-263b-47ff-b905-171770942a34 on n-h2-766726-30 May 19 05:26:53.645795 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ef80a2db-5fb0-4645-bfa7-8f776e8fe6c4 req-50400194-7589-4ca6-8bf7-bfa67015b9e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045686 May 19 05:26:53.647061 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3127/6343] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:26:53.656894 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd52b8df-3c94-486a-a03f-470f44656eb3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1277 microversion: 2.1 time: 0.321869 May 19 05:26:53.658882 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3217/6344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:26:53 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:26:54.677637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bff543ea-77f2-4096-8b10-9505fee3bdf3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:26:54.678361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bff543ea-77f2-4096-8b10-9505fee3bdf3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:26:54.685395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bff543ea-77f2-4096-8b10-9505fee3bdf3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:54.686385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bff543ea-77f2-4096-8b10-9505fee3bdf3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:54.687170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bff543ea-77f2-4096-8b10-9505fee3bdf3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:54.687615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bff543ea-77f2-4096-8b10-9505fee3bdf3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:54.823103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bff543ea-77f2-4096-8b10-9505fee3bdf3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:26:54.831345 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bff543ea-77f2-4096-8b10-9505fee3bdf3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1277 microversion: 2.1 time: 0.159681 May 19 05:26:54.831873 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3128/6345] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:26:54 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:26:55.848499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e4cd80e7-2e38-4cd9-a015-839590114596 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:26:55.849144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e4cd80e7-2e38-4cd9-a015-839590114596 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:26:55.856433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4cd80e7-2e38-4cd9-a015-839590114596 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:55.856892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4cd80e7-2e38-4cd9-a015-839590114596 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:55.857694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4cd80e7-2e38-4cd9-a015-839590114596 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:55.858137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e4cd80e7-2e38-4cd9-a015-839590114596 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:56.340417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e4cd80e7-2e38-4cd9-a015-839590114596 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:26:56.347980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e4cd80e7-2e38-4cd9-a015-839590114596 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1277 microversion: 2.1 time: 0.504050 May 19 05:26:56.348558 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3218/6346] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:26:55 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1277 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:26:57.365967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8c646295-995b-48b1-9fc9-9fb0fda625cf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:26:57.367081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8c646295-995b-48b1-9fc9-9fb0fda625cf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:26:57.375460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c646295-995b-48b1-9fc9-9fb0fda625cf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:57.375967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c646295-995b-48b1-9fc9-9fb0fda625cf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:57.376981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c646295-995b-48b1-9fc9-9fb0fda625cf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:57.377546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8c646295-995b-48b1-9fc9-9fb0fda625cf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:57.605993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8c646295-995b-48b1-9fc9-9fb0fda625cf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:26:57.614299 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8c646295-995b-48b1-9fc9-9fb0fda625cf tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1277 microversion: 2.1 time: 0.252699 May 19 05:26:57.614892 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3129/6347] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:26:57 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:26:58.631351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8b4fc537-cb9d-410f-afca-5f1c893ee063 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:26:58.631986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8b4fc537-cb9d-410f-afca-5f1c893ee063 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:26:58.639470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b4fc537-cb9d-410f-afca-5f1c893ee063 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:58.639954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b4fc537-cb9d-410f-afca-5f1c893ee063 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:58.640816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b4fc537-cb9d-410f-afca-5f1c893ee063 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:58.641311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8b4fc537-cb9d-410f-afca-5f1c893ee063 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:58.787669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8b4fc537-cb9d-410f-afca-5f1c893ee063 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:26:58.796734 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8b4fc537-cb9d-410f-afca-5f1c893ee063 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1277 microversion: 2.1 time: 0.169217 May 19 05:26:58.806756 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3219/6348] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:26:58 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:26:59.815327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-11192f2a-ba72-40ab-98e1-2770d4bb41c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:26:59.815941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-11192f2a-ba72-40ab-98e1-2770d4bb41c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:26:59.823478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11192f2a-ba72-40ab-98e1-2770d4bb41c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:59.823937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11192f2a-ba72-40ab-98e1-2770d4bb41c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:59.824694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11192f2a-ba72-40ab-98e1-2770d4bb41c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:26:59.825176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11192f2a-ba72-40ab-98e1-2770d4bb41c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:26:59.959916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-11192f2a-ba72-40ab-98e1-2770d4bb41c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:26:59.968080 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-11192f2a-ba72-40ab-98e1-2770d4bb41c7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1277 microversion: 2.1 time: 0.157104 May 19 05:26:59.969138 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3130/6349] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:26:59 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:00.987418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac0b2cb9-eacd-460e-b9eb-2fc990e8c521 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:00.988057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac0b2cb9-eacd-460e-b9eb-2fc990e8c521 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:00.995070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0b2cb9-eacd-460e-b9eb-2fc990e8c521 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:00.995543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0b2cb9-eacd-460e-b9eb-2fc990e8c521 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:00.996336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0b2cb9-eacd-460e-b9eb-2fc990e8c521 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:00.996790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac0b2cb9-eacd-460e-b9eb-2fc990e8c521 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:01.127566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac0b2cb9-eacd-460e-b9eb-2fc990e8c521 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:01.135145 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac0b2cb9-eacd-460e-b9eb-2fc990e8c521 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1277 microversion: 2.1 time: 0.152288 May 19 05:27:01.135729 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3220/6350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:00 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:02.152379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c581ddf-b86b-4db2-a736-546d4ae8c2d2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:02.152927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c581ddf-b86b-4db2-a736-546d4ae8c2d2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:02.155789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:27:02.156604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:27:02.162558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c581ddf-b86b-4db2-a736-546d4ae8c2d2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:02.163011 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c581ddf-b86b-4db2-a736-546d4ae8c2d2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:02.163787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c581ddf-b86b-4db2-a736-546d4ae8c2d2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:02.164231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c581ddf-b86b-4db2-a736-546d4ae8c2d2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:02.307362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c581ddf-b86b-4db2-a736-546d4ae8c2d2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:02.315249 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c581ddf-b86b-4db2-a736-546d4ae8c2d2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1277 microversion: 2.1 time: 0.167301 May 19 05:27:02.315829 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3131/6351] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:02 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:03.332632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-19545623-29fa-4db1-9dfb-0ae4ec03a2eb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:03.333497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-19545623-29fa-4db1-9dfb-0ae4ec03a2eb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:03.336188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:27:03.345470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19545623-29fa-4db1-9dfb-0ae4ec03a2eb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:03.346163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19545623-29fa-4db1-9dfb-0ae4ec03a2eb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:03.347338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19545623-29fa-4db1-9dfb-0ae4ec03a2eb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:03.348012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-19545623-29fa-4db1-9dfb-0ae4ec03a2eb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:03.489907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-19545623-29fa-4db1-9dfb-0ae4ec03a2eb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:03.497491 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-19545623-29fa-4db1-9dfb-0ae4ec03a2eb tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.169533 May 19 05:27:03.498066 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3221/6352] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:03 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:04.515096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-827ca29d-6852-43e9-b595-60bba046100d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:04.515736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-827ca29d-6852-43e9-b595-60bba046100d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:04.522741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-827ca29d-6852-43e9-b595-60bba046100d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:04.523187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-827ca29d-6852-43e9-b595-60bba046100d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:04.523943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-827ca29d-6852-43e9-b595-60bba046100d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:04.524381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-827ca29d-6852-43e9-b595-60bba046100d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:04.654543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-827ca29d-6852-43e9-b595-60bba046100d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:04.663495 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-827ca29d-6852-43e9-b595-60bba046100d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.152249 May 19 05:27:04.664075 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3132/6353] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:04 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:05.680999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc278e05-5d49-4497-bb11-be296078eccc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:05.681717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bc278e05-5d49-4497-bb11-be296078eccc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:05.688852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc278e05-5d49-4497-bb11-be296078eccc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:05.689348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc278e05-5d49-4497-bb11-be296078eccc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:05.690143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc278e05-5d49-4497-bb11-be296078eccc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:05.690602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc278e05-5d49-4497-bb11-be296078eccc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:05.818874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bc278e05-5d49-4497-bb11-be296078eccc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:05.826475 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bc278e05-5d49-4497-bb11-be296078eccc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.149430 May 19 05:27:05.827046 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3222/6354] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:05 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:06.843573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5a4ae1c-7213-4b99-9c02-2a02539f8e06 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:06.844194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b5a4ae1c-7213-4b99-9c02-2a02539f8e06 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:06.851720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5a4ae1c-7213-4b99-9c02-2a02539f8e06 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:06.852178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5a4ae1c-7213-4b99-9c02-2a02539f8e06 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:06.852956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5a4ae1c-7213-4b99-9c02-2a02539f8e06 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:06.853429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5a4ae1c-7213-4b99-9c02-2a02539f8e06 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:06.984099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b5a4ae1c-7213-4b99-9c02-2a02539f8e06 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:06.992256 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5a4ae1c-7213-4b99-9c02-2a02539f8e06 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.152600 May 19 05:27:06.992832 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3133/6355] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:06 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:08.009309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-77fd9cd1-9d61-4566-8758-350fc1865a74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:08.009949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-77fd9cd1-9d61-4566-8758-350fc1865a74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:08.017006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77fd9cd1-9d61-4566-8758-350fc1865a74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:08.017501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77fd9cd1-9d61-4566-8758-350fc1865a74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:08.018284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77fd9cd1-9d61-4566-8758-350fc1865a74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:08.018737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77fd9cd1-9d61-4566-8758-350fc1865a74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:08.153032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-77fd9cd1-9d61-4566-8758-350fc1865a74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:08.160629 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-77fd9cd1-9d61-4566-8758-350fc1865a74 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.155328 May 19 05:27:08.161229 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3223/6356] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:08 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:09.177901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a84d37d-361b-4391-81c5-dfe96f4787a7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:09.178546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4a84d37d-361b-4391-81c5-dfe96f4787a7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:09.185600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a84d37d-361b-4391-81c5-dfe96f4787a7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:09.186053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a84d37d-361b-4391-81c5-dfe96f4787a7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:09.186820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a84d37d-361b-4391-81c5-dfe96f4787a7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:09.187264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a84d37d-361b-4391-81c5-dfe96f4787a7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:09.312930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4a84d37d-361b-4391-81c5-dfe96f4787a7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:09.320995 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4a84d37d-361b-4391-81c5-dfe96f4787a7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.147082 May 19 05:27:09.321598 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3134/6357] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:09 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:10.338329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73d4773f-d45b-457b-9dc4-f5f5ef1fab3e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:10.338970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73d4773f-d45b-457b-9dc4-f5f5ef1fab3e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:10.346061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d4773f-d45b-457b-9dc4-f5f5ef1fab3e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:10.346529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d4773f-d45b-457b-9dc4-f5f5ef1fab3e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:10.347307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d4773f-d45b-457b-9dc4-f5f5ef1fab3e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:10.347765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73d4773f-d45b-457b-9dc4-f5f5ef1fab3e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:10.486356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73d4773f-d45b-457b-9dc4-f5f5ef1fab3e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:10.494099 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73d4773f-d45b-457b-9dc4-f5f5ef1fab3e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.159674 May 19 05:27:10.494666 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3224/6358] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:10 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:11.510943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f3da7dda-b914-4816-8b6d-8dd50bf3dc31 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:11.511711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f3da7dda-b914-4816-8b6d-8dd50bf3dc31 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:11.520058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3da7dda-b914-4816-8b6d-8dd50bf3dc31 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:11.520507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3da7dda-b914-4816-8b6d-8dd50bf3dc31 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:11.521302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3da7dda-b914-4816-8b6d-8dd50bf3dc31 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:11.521742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3da7dda-b914-4816-8b6d-8dd50bf3dc31 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:11.658804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f3da7dda-b914-4816-8b6d-8dd50bf3dc31 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:11.666273 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f3da7dda-b914-4816-8b6d-8dd50bf3dc31 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.159343 May 19 05:27:11.666859 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3135/6359] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:11 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:12.683729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c8e2661-ff14-4820-bb8b-f6d0eec7d936 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:12.684386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1c8e2661-ff14-4820-bb8b-f6d0eec7d936 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:12.692070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c8e2661-ff14-4820-bb8b-f6d0eec7d936 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:12.692534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c8e2661-ff14-4820-bb8b-f6d0eec7d936 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:12.693628 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c8e2661-ff14-4820-bb8b-f6d0eec7d936 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:12.694083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c8e2661-ff14-4820-bb8b-f6d0eec7d936 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:12.829921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1c8e2661-ff14-4820-bb8b-f6d0eec7d936 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:12.837549 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1c8e2661-ff14-4820-bb8b-f6d0eec7d936 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.157769 May 19 05:27:12.838127 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3225/6360] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:12 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:13.428623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-83e4ae1c-fcfb-405e-99cf-427a13a61b92 req-8dbab8e0-163b-4f50-b947-7c017f561525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec59cda5-263b-47ff-b905-171770942a34", "name": "network-vif-plugged", "status": "completed", "tag": "8482545f-c8fd-4444-a2ec-83189ee08381"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:27:13.438626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-83e4ae1c-fcfb-405e-99cf-427a13a61b92 req-8dbab8e0-163b-4f50-b947-7c017f561525 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:13.439093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-83e4ae1c-fcfb-405e-99cf-427a13a61b92 req-8dbab8e0-163b-4f50-b947-7c017f561525 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:13.450504 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-83e4ae1c-fcfb-405e-99cf-427a13a61b92 req-8dbab8e0-163b-4f50-b947-7c017f561525 service nova] Creating event network-vif-plugged:8482545f-c8fd-4444-a2ec-83189ee08381 for instance ec59cda5-263b-47ff-b905-171770942a34 on n-h2-766726-30 May 19 05:27:13.455495 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-83e4ae1c-fcfb-405e-99cf-427a13a61b92 req-8dbab8e0-163b-4f50-b947-7c017f561525 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030588 May 19 05:27:13.456264 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3136/6361] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:27:13.854729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6323bf35-9b51-4a27-8bcd-2b28e2c94ee0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:13.855357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6323bf35-9b51-4a27-8bcd-2b28e2c94ee0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:13.862317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6323bf35-9b51-4a27-8bcd-2b28e2c94ee0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:13.862775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6323bf35-9b51-4a27-8bcd-2b28e2c94ee0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:13.863541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6323bf35-9b51-4a27-8bcd-2b28e2c94ee0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:13.863990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6323bf35-9b51-4a27-8bcd-2b28e2c94ee0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:13.994701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6323bf35-9b51-4a27-8bcd-2b28e2c94ee0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:14.002170 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6323bf35-9b51-4a27-8bcd-2b28e2c94ee0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1265 microversion: 2.1 time: 0.151576 May 19 05:27:14.002750 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3226/6362] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:13 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:27:15.020991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b97429fc-6fe1-48f5-b740-4acde37f35da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:15.021675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b97429fc-6fe1-48f5-b740-4acde37f35da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:15.028001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b97429fc-6fe1-48f5-b740-4acde37f35da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:15.028458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b97429fc-6fe1-48f5-b740-4acde37f35da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:15.029273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b97429fc-6fe1-48f5-b740-4acde37f35da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:15.029701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b97429fc-6fe1-48f5-b740-4acde37f35da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:15.161066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b97429fc-6fe1-48f5-b740-4acde37f35da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:15.168652 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b97429fc-6fe1-48f5-b740-4acde37f35da tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1452 microversion: 2.1 time: 0.153540 May 19 05:27:15.169249 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3137/6363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:15 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:15.184572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-548cf425-25c7-4c5e-9014-cdea10bb23ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:27:15.185280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-548cf425-25c7-4c5e-9014-cdea10bb23ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:27:15.192629 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-548cf425-25c7-4c5e-9014-cdea10bb23ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:15.193106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-548cf425-25c7-4c5e-9014-cdea10bb23ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:15.193905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-548cf425-25c7-4c5e-9014-cdea10bb23ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:15.194357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-548cf425-25c7-4c5e-9014-cdea10bb23ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:15.321890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-548cf425-25c7-4c5e-9014-cdea10bb23ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:27:15.330032 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-548cf425-25c7-4c5e-9014-cdea10bb23ac tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1452 microversion: 2.1 time: 0.149299 May 19 05:27:15.330627 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3227/6364] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:27:15 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:27:16.905186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-93e8a3fc-90d5-477b-a9c5-e040d85c33b4 req-3cab1c8a-9c0a-419d-a02e-a4c4ac79edfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec59cda5-263b-47ff-b905-171770942a34", "tag": "8482545f-c8fd-4444-a2ec-83189ee08381"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:27:16.914809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-93e8a3fc-90d5-477b-a9c5-e040d85c33b4 req-3cab1c8a-9c0a-419d-a02e-a4c4ac79edfc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:27:16.915256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-93e8a3fc-90d5-477b-a9c5-e040d85c33b4 req-3cab1c8a-9c0a-419d-a02e-a4c4ac79edfc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:27:16.926957 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-93e8a3fc-90d5-477b-a9c5-e040d85c33b4 req-3cab1c8a-9c0a-419d-a02e-a4c4ac79edfc service nova] Creating event network-changed:8482545f-c8fd-4444-a2ec-83189ee08381 for instance ec59cda5-263b-47ff-b905-171770942a34 on n-h2-766726-30 May 19 05:27:16.932064 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-93e8a3fc-90d5-477b-a9c5-e040d85c33b4 req-3cab1c8a-9c0a-419d-a02e-a4c4ac79edfc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030636 May 19 05:27:16.932751 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3138/6365] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:28:09.786734 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:28:09.787435 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:28:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:28:11.009676 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:28:11.010173 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:28:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:28:46.543250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=26 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:28:46.544032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=66 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:28:46.548444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:28:46.548918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b8574289-e70d-4625-aa7c-e7dd854627b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:46.549207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=68 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:28:46.550008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b8574289-e70d-4625-aa7c-e7dd854627b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:46.554136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d70be53a-b4d2-4f66-b47f-82af60cedf28 req-b90dd169-71e9-4cf6-b38f-dfde40fe7a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec59cda5-263b-47ff-b905-171770942a34", "tag": "8482545f-c8fd-4444-a2ec-83189ee08381"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:28:46.557341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8574289-e70d-4625-aa7c-e7dd854627b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:46.557813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8574289-e70d-4625-aa7c-e7dd854627b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:46.558612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8574289-e70d-4625-aa7c-e7dd854627b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:46.559071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b8574289-e70d-4625-aa7c-e7dd854627b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:46.564050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d70be53a-b4d2-4f66-b47f-82af60cedf28 req-b90dd169-71e9-4cf6-b38f-dfde40fe7a72 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:46.564501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d70be53a-b4d2-4f66-b47f-82af60cedf28 req-b90dd169-71e9-4cf6-b38f-dfde40fe7a72 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:46.575570 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d70be53a-b4d2-4f66-b47f-82af60cedf28 req-b90dd169-71e9-4cf6-b38f-dfde40fe7a72 service nova] Creating event network-changed:8482545f-c8fd-4444-a2ec-83189ee08381 for instance ec59cda5-263b-47ff-b905-171770942a34 on n-h2-766726-30 May 19 05:28:46.581597 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d70be53a-b4d2-4f66-b47f-82af60cedf28 req-b90dd169-71e9-4cf6-b38f-dfde40fe7a72 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036438 May 19 05:28:46.582205 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3139/6366] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:28:46.586344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b8574289-e70d-4625-aa7c-e7dd854627b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:28:46.673442 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b8574289-e70d-4625-aa7c-e7dd854627b0 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 204 len: 0 microversion: 2.1 time: 0.131874 May 19 05:28:46.674185 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3228/6367] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:28:46 2022] DELETE /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:28:46.684822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e4db9624-c47c-4cde-86dd-370ddc6428aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:46.686379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e4db9624-c47c-4cde-86dd-370ddc6428aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:46.693321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4db9624-c47c-4cde-86dd-370ddc6428aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:46.693972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4db9624-c47c-4cde-86dd-370ddc6428aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:46.694749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4db9624-c47c-4cde-86dd-370ddc6428aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:46.695191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4db9624-c47c-4cde-86dd-370ddc6428aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:46.845401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4db9624-c47c-4cde-86dd-370ddc6428aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:46.853338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e4db9624-c47c-4cde-86dd-370ddc6428aa tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1576 microversion: 2.1 time: 0.174143 May 19 05:28:46.853925 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3140/6368] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:46 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:47.872488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b7d12494-4a3e-4703-8a75-24522f4960b1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:47.874061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b7d12494-4a3e-4703-8a75-24522f4960b1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:47.881413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7d12494-4a3e-4703-8a75-24522f4960b1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:47.881962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7d12494-4a3e-4703-8a75-24522f4960b1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:47.882840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7d12494-4a3e-4703-8a75-24522f4960b1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:47.883326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b7d12494-4a3e-4703-8a75-24522f4960b1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:48.011245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b7d12494-4a3e-4703-8a75-24522f4960b1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:48.018869 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b7d12494-4a3e-4703-8a75-24522f4960b1 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1576 microversion: 2.1 time: 0.150694 May 19 05:28:48.019439 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3229/6369] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:47 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:48.596669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3a534697-c6fe-4d38-80dc-6f3ae2b866ce req-b6b5ae5d-22d6-4f72-bb4c-60dcd5a763cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec59cda5-263b-47ff-b905-171770942a34", "name": "network-vif-deleted", "tag": "8482545f-c8fd-4444-a2ec-83189ee08381"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:28:48.607906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3a534697-c6fe-4d38-80dc-6f3ae2b866ce req-b6b5ae5d-22d6-4f72-bb4c-60dcd5a763cc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:48.608358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3a534697-c6fe-4d38-80dc-6f3ae2b866ce req-b6b5ae5d-22d6-4f72-bb4c-60dcd5a763cc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:48.621342 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3a534697-c6fe-4d38-80dc-6f3ae2b866ce req-b6b5ae5d-22d6-4f72-bb4c-60dcd5a763cc service nova] Creating event network-vif-deleted:8482545f-c8fd-4444-a2ec-83189ee08381 for instance ec59cda5-263b-47ff-b905-171770942a34 on n-h2-766726-30 May 19 05:28:48.626820 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3a534697-c6fe-4d38-80dc-6f3ae2b866ce req-b6b5ae5d-22d6-4f72-bb4c-60dcd5a763cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 May 19 05:28:48.627412 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3141/6370] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:28:49.035876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f52902a4-a97d-4e49-943d-d69e69b0a304 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:49.036517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f52902a4-a97d-4e49-943d-d69e69b0a304 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:49.043556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f52902a4-a97d-4e49-943d-d69e69b0a304 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:49.044036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f52902a4-a97d-4e49-943d-d69e69b0a304 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:49.044820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f52902a4-a97d-4e49-943d-d69e69b0a304 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:49.045342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f52902a4-a97d-4e49-943d-d69e69b0a304 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:49.451960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f52902a4-a97d-4e49-943d-d69e69b0a304 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:49.459943 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f52902a4-a97d-4e49-943d-d69e69b0a304 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1224 microversion: 2.1 time: 0.428008 May 19 05:28:49.460580 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3230/6371] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:49 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1224 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:50.478292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1017442b-4eaf-467e-a6b4-3f30d203a2b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:50.479032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1017442b-4eaf-467e-a6b4-3f30d203a2b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:50.486912 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1017442b-4eaf-467e-a6b4-3f30d203a2b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:50.487363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1017442b-4eaf-467e-a6b4-3f30d203a2b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:50.488228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1017442b-4eaf-467e-a6b4-3f30d203a2b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:50.488672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1017442b-4eaf-467e-a6b4-3f30d203a2b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:50.550403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1017442b-4eaf-467e-a6b4-3f30d203a2b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:50.558297 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1017442b-4eaf-467e-a6b4-3f30d203a2b9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1224 microversion: 2.1 time: 0.084594 May 19 05:28:50.558875 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3142/6372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:50 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:51.575431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ae0e21fb-256f-4281-83af-4a0f96250946 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:51.576067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ae0e21fb-256f-4281-83af-4a0f96250946 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:51.582965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae0e21fb-256f-4281-83af-4a0f96250946 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:51.583370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae0e21fb-256f-4281-83af-4a0f96250946 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:51.584148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae0e21fb-256f-4281-83af-4a0f96250946 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:51.584602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae0e21fb-256f-4281-83af-4a0f96250946 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:51.647761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ae0e21fb-256f-4281-83af-4a0f96250946 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:51.655718 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ae0e21fb-256f-4281-83af-4a0f96250946 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1224 microversion: 2.1 time: 0.084358 May 19 05:28:51.656283 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3231/6373] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:51 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:52.672806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d7206b1-1555-4d99-8029-c6de381eeabc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:52.673454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d7206b1-1555-4d99-8029-c6de381eeabc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:52.679872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7206b1-1555-4d99-8029-c6de381eeabc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:52.680327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7206b1-1555-4d99-8029-c6de381eeabc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:52.681127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7206b1-1555-4d99-8029-c6de381eeabc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:52.681570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7206b1-1555-4d99-8029-c6de381eeabc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:52.744195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6d7206b1-1555-4d99-8029-c6de381eeabc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:52.752473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d7206b1-1555-4d99-8029-c6de381eeabc tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1224 microversion: 2.1 time: 0.083799 May 19 05:28:52.753059 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3143/6374] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:52 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:53.769301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73384f04-0633-499c-9c49-ccb6b2ecee02 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:53.769936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73384f04-0633-499c-9c49-ccb6b2ecee02 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:53.776966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73384f04-0633-499c-9c49-ccb6b2ecee02 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:53.777464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73384f04-0633-499c-9c49-ccb6b2ecee02 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:53.778242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73384f04-0633-499c-9c49-ccb6b2ecee02 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:53.778695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73384f04-0633-499c-9c49-ccb6b2ecee02 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:53.842918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73384f04-0633-499c-9c49-ccb6b2ecee02 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:53.850617 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73384f04-0633-499c-9c49-ccb6b2ecee02 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1224 microversion: 2.1 time: 0.085286 May 19 05:28:53.851202 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3232/6375] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:53 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:54.867575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-169bb65c-2e45-475a-9d04-061c1c887e58 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:54.868190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-169bb65c-2e45-475a-9d04-061c1c887e58 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:54.875681 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-169bb65c-2e45-475a-9d04-061c1c887e58 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:54.876137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-169bb65c-2e45-475a-9d04-061c1c887e58 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:54.876909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-169bb65c-2e45-475a-9d04-061c1c887e58 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:54.877389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-169bb65c-2e45-475a-9d04-061c1c887e58 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:54.943016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-169bb65c-2e45-475a-9d04-061c1c887e58 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:54.951027 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-169bb65c-2e45-475a-9d04-061c1c887e58 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1224 microversion: 2.1 time: 0.087339 May 19 05:28:54.952203 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3144/6376] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:54 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:55.968593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ffbf8e4c-e790-4a45-ae9a-e0acb0e9a6e7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:55.969266 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ffbf8e4c-e790-4a45-ae9a-e0acb0e9a6e7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:55.976261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ffbf8e4c-e790-4a45-ae9a-e0acb0e9a6e7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:55.976719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ffbf8e4c-e790-4a45-ae9a-e0acb0e9a6e7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:55.977521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ffbf8e4c-e790-4a45-ae9a-e0acb0e9a6e7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:55.978233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ffbf8e4c-e790-4a45-ae9a-e0acb0e9a6e7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:56.041711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ffbf8e4c-e790-4a45-ae9a-e0acb0e9a6e7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:56.049469 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ffbf8e4c-e790-4a45-ae9a-e0acb0e9a6e7 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1224 microversion: 2.1 time: 0.085550 May 19 05:28:56.050054 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3233/6377] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:55 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:57.066723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d14e7e4a-c262-4ef0-ac05-486ef9c8470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:57.067349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d14e7e4a-c262-4ef0-ac05-486ef9c8470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:57.074559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d14e7e4a-c262-4ef0-ac05-486ef9c8470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:57.075020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d14e7e4a-c262-4ef0-ac05-486ef9c8470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:57.075787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d14e7e4a-c262-4ef0-ac05-486ef9c8470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:57.076860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d14e7e4a-c262-4ef0-ac05-486ef9c8470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:57.136901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d14e7e4a-c262-4ef0-ac05-486ef9c8470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:28:57.145153 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d14e7e4a-c262-4ef0-ac05-486ef9c8470c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 200 len: 1224 microversion: 2.1 time: 0.082334 May 19 05:28:57.145729 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3145/6378] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:57 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:28:58.162165 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:28:58.162725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: ec59cda5-263b-47ff-b905-171770942a34] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:28:58.169830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:58.170326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:58.171136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:28:58.171595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:28:58.184862 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance ec59cda5-263b-47ff-b905-171770942a34 could not be found. May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 HTTP/1.1 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance ec59cda5-263b-47ff-b905-171770942a34 could not be found. May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'ec59cda5-263b-47ff-b905-171770942a34'} May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec59cda5-263b-47ff-b905-171770942a34 could not be found. May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec59cda5-263b-47ff-b905-171770942a34 could not be found. May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:28:58.186573 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec59cda5-263b-47ff-b905-171770942a34 could not be found. May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance ec59cda5-263b-47ff-b905-171770942a34 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5badd5b4-3a9e-4908-a7da-6d520dadbb98 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34" status: 404 len: 111 microversion: 2.1 time: 0.029862 May 19 05:28:58.191820 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3234/6379] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:28:58 2022] GET /compute/v2.1/servers/ec59cda5-263b-47ff-b905-171770942a34 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:29:07.820950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b38b97dd-8df2-4ae4-9f90-900b1b6ec9d3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:07.821611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b38b97dd-8df2-4ae4-9f90-900b1b6ec9d3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:07.823317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9014822d-81a1-481e-970f-6f2efd481414 req-1c881a1d-dc13-426e-a7c4-3279c546a06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b2f12f-bbb3-4c11-9e4b-eec60603dc33", "tag": "a0601901-dc65-463c-b725-68bddd1c4be7"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:29:07.824738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=14 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:07.825634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=34 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:07.832828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b38b97dd-8df2-4ae4-9f90-900b1b6ec9d3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:07.833319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b38b97dd-8df2-4ae4-9f90-900b1b6ec9d3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:07.834106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b38b97dd-8df2-4ae4-9f90-900b1b6ec9d3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:07.834522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9014822d-81a1-481e-970f-6f2efd481414 req-1c881a1d-dc13-426e-a7c4-3279c546a06a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:07.834737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b38b97dd-8df2-4ae4-9f90-900b1b6ec9d3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:07.835143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9014822d-81a1-481e-970f-6f2efd481414 req-1c881a1d-dc13-426e-a7c4-3279c546a06a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:07.848199 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9014822d-81a1-481e-970f-6f2efd481414 req-1c881a1d-dc13-426e-a7c4-3279c546a06a service nova] Creating event network-changed:a0601901-dc65-463c-b725-68bddd1c4be7 for instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 on n-h1-766726-30 May 19 05:29:07.853960 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9014822d-81a1-481e-970f-6f2efd481414 req-1c881a1d-dc13-426e-a7c4-3279c546a06a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034650 May 19 05:29:07.854643 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3235/6380] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:29:07.861578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b38b97dd-8df2-4ae4-9f90-900b1b6ec9d3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:29:07.945437 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b38b97dd-8df2-4ae4-9f90-900b1b6ec9d3 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 204 len: 0 microversion: 2.1 time: 0.128541 May 19 05:29:07.946075 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3146/6381] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:29:07 2022] DELETE /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:29:07.955371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-807dc46a-2a72-49fd-adcd-7ecc2d7d5f36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:07.956314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-807dc46a-2a72-49fd-adcd-7ecc2d7d5f36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:07.963158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-807dc46a-2a72-49fd-adcd-7ecc2d7d5f36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:07.963780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-807dc46a-2a72-49fd-adcd-7ecc2d7d5f36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:07.964651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-807dc46a-2a72-49fd-adcd-7ecc2d7d5f36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:07.965218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-807dc46a-2a72-49fd-adcd-7ecc2d7d5f36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:08.110882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-807dc46a-2a72-49fd-adcd-7ecc2d7d5f36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:08.118832 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-807dc46a-2a72-49fd-adcd-7ecc2d7d5f36 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1577 microversion: 2.1 time: 0.168038 May 19 05:29:08.119528 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3236/6382] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:07 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:09.137825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-246fea5e-005b-499c-80f4-4f24c832098b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:09.139125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-246fea5e-005b-499c-80f4-4f24c832098b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:09.146210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-246fea5e-005b-499c-80f4-4f24c832098b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:09.146668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-246fea5e-005b-499c-80f4-4f24c832098b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:09.147444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-246fea5e-005b-499c-80f4-4f24c832098b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:09.147888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-246fea5e-005b-499c-80f4-4f24c832098b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:09.275760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-246fea5e-005b-499c-80f4-4f24c832098b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:09.283510 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-246fea5e-005b-499c-80f4-4f24c832098b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1577 microversion: 2.1 time: 0.150010 May 19 05:29:09.284314 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3147/6383] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:09 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:10.300246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5293d899-19bb-47c9-8a9c-998e93ef5560 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:10.301017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5293d899-19bb-47c9-8a9c-998e93ef5560 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:10.308217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5293d899-19bb-47c9-8a9c-998e93ef5560 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:10.308693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5293d899-19bb-47c9-8a9c-998e93ef5560 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:10.309577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5293d899-19bb-47c9-8a9c-998e93ef5560 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:10.310038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5293d899-19bb-47c9-8a9c-998e93ef5560 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:10.339914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-08f361b7-4c31-4bf7-979e-7074a936eb3c req-6d20d681-c3cb-4c31-8898-a3abc73d30d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b2f12f-bbb3-4c11-9e4b-eec60603dc33", "name": "network-vif-deleted", "tag": "a0601901-dc65-463c-b725-68bddd1c4be7"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:29:10.349955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-08f361b7-4c31-4bf7-979e-7074a936eb3c req-6d20d681-c3cb-4c31-8898-a3abc73d30d4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:10.350488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-08f361b7-4c31-4bf7-979e-7074a936eb3c req-6d20d681-c3cb-4c31-8898-a3abc73d30d4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:10.362218 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-08f361b7-4c31-4bf7-979e-7074a936eb3c req-6d20d681-c3cb-4c31-8898-a3abc73d30d4 service nova] Creating event network-vif-deleted:a0601901-dc65-463c-b725-68bddd1c4be7 for instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 on n-h1-766726-30 May 19 05:29:10.372991 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-08f361b7-4c31-4bf7-979e-7074a936eb3c req-6d20d681-c3cb-4c31-8898-a3abc73d30d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036590 May 19 05:29:10.374043 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3148/6384] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:29:10.381797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5293d899-19bb-47c9-8a9c-998e93ef5560 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:10.391464 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5293d899-19bb-47c9-8a9c-998e93ef5560 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1391 microversion: 2.1 time: 0.095508 May 19 05:29:10.392057 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3237/6385] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:10 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1391 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:11.410120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66ccc02e-7fb9-4764-ba92-ccc96ed86877 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:11.410826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-66ccc02e-7fb9-4764-ba92-ccc96ed86877 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:11.417064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66ccc02e-7fb9-4764-ba92-ccc96ed86877 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:11.417665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66ccc02e-7fb9-4764-ba92-ccc96ed86877 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:11.418326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66ccc02e-7fb9-4764-ba92-ccc96ed86877 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:11.418782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66ccc02e-7fb9-4764-ba92-ccc96ed86877 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:11.481358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-66ccc02e-7fb9-4764-ba92-ccc96ed86877 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:11.489664 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-66ccc02e-7fb9-4764-ba92-ccc96ed86877 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1225 microversion: 2.1 time: 0.085542 May 19 05:29:11.490240 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3149/6386] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:11 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:12.507563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2e332920-6ada-4d1c-bdd4-bdfa9bb3b91d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:12.508229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2e332920-6ada-4d1c-bdd4-bdfa9bb3b91d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:12.515572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e332920-6ada-4d1c-bdd4-bdfa9bb3b91d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:12.516036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e332920-6ada-4d1c-bdd4-bdfa9bb3b91d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:12.516802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e332920-6ada-4d1c-bdd4-bdfa9bb3b91d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:12.517285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e332920-6ada-4d1c-bdd4-bdfa9bb3b91d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:12.577567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2e332920-6ada-4d1c-bdd4-bdfa9bb3b91d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:12.584955 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2e332920-6ada-4d1c-bdd4-bdfa9bb3b91d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1225 microversion: 2.1 time: 0.081873 May 19 05:29:12.585496 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3238/6387] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:12 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:13.601046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-758e75e9-b258-411f-82e7-5548ade35d0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:13.601688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-758e75e9-b258-411f-82e7-5548ade35d0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:13.609692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-758e75e9-b258-411f-82e7-5548ade35d0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:13.610147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-758e75e9-b258-411f-82e7-5548ade35d0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:13.610919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-758e75e9-b258-411f-82e7-5548ade35d0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:13.611360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-758e75e9-b258-411f-82e7-5548ade35d0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:13.675794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-758e75e9-b258-411f-82e7-5548ade35d0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:13.683495 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-758e75e9-b258-411f-82e7-5548ade35d0e tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1225 microversion: 2.1 time: 0.086346 May 19 05:29:13.684083 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3150/6388] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:13 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:14.700463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ab6d7625-2e78-4cde-b9d3-12a77e102fed tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:14.701236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ab6d7625-2e78-4cde-b9d3-12a77e102fed tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:14.708244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab6d7625-2e78-4cde-b9d3-12a77e102fed tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:14.708734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab6d7625-2e78-4cde-b9d3-12a77e102fed tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:14.709601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab6d7625-2e78-4cde-b9d3-12a77e102fed tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:14.710062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab6d7625-2e78-4cde-b9d3-12a77e102fed tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:14.773949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab6d7625-2e78-4cde-b9d3-12a77e102fed tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:14.782065 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ab6d7625-2e78-4cde-b9d3-12a77e102fed tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1225 microversion: 2.1 time: 0.085374 May 19 05:29:14.782672 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3239/6389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:14 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:15.798046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24683361-a4e9-4187-8d3d-33139e5f1f0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:15.798658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-24683361-a4e9-4187-8d3d-33139e5f1f0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:15.805527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24683361-a4e9-4187-8d3d-33139e5f1f0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:15.805973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24683361-a4e9-4187-8d3d-33139e5f1f0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:15.806731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24683361-a4e9-4187-8d3d-33139e5f1f0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:15.807164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24683361-a4e9-4187-8d3d-33139e5f1f0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:15.868624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-24683361-a4e9-4187-8d3d-33139e5f1f0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:15.877059 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-24683361-a4e9-4187-8d3d-33139e5f1f0c tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1225 microversion: 2.1 time: 0.082955 May 19 05:29:15.877652 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3151/6390] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:15 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:16.894071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1bdb1e07-bfb4-49d0-9cd5-df63e8087e8a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:16.894933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1bdb1e07-bfb4-49d0-9cd5-df63e8087e8a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:16.897773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:16.903092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bdb1e07-bfb4-49d0-9cd5-df63e8087e8a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:16.903557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bdb1e07-bfb4-49d0-9cd5-df63e8087e8a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:16.905092 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bdb1e07-bfb4-49d0-9cd5-df63e8087e8a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:16.905637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1bdb1e07-bfb4-49d0-9cd5-df63e8087e8a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:16.910277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:16.971321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1bdb1e07-bfb4-49d0-9cd5-df63e8087e8a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:16.979294 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1bdb1e07-bfb4-49d0-9cd5-df63e8087e8a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1225 microversion: 2.1 time: 0.089213 May 19 05:29:16.979914 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3240/6391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:16 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:17.996475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ccb8e19f-e9e0-4d51-b3d2-075e376dc8e9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:17.997208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ccb8e19f-e9e0-4d51-b3d2-075e376dc8e9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:18.004416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccb8e19f-e9e0-4d51-b3d2-075e376dc8e9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:18.004877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccb8e19f-e9e0-4d51-b3d2-075e376dc8e9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:18.005693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccb8e19f-e9e0-4d51-b3d2-075e376dc8e9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:18.006123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccb8e19f-e9e0-4d51-b3d2-075e376dc8e9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:18.075127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ccb8e19f-e9e0-4d51-b3d2-075e376dc8e9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:18.084318 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ccb8e19f-e9e0-4d51-b3d2-075e376dc8e9 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1225 microversion: 2.1 time: 0.091913 May 19 05:29:18.086227 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3152/6392] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:17 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:19.325317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8d301b49-2798-4965-9121-8d775eaf9a66 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:19.325992 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8d301b49-2798-4965-9121-8d775eaf9a66 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:19.332616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d301b49-2798-4965-9121-8d775eaf9a66 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:19.333102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d301b49-2798-4965-9121-8d775eaf9a66 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:19.333900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d301b49-2798-4965-9121-8d775eaf9a66 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:19.334355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8d301b49-2798-4965-9121-8d775eaf9a66 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:19.455494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8d301b49-2798-4965-9121-8d775eaf9a66 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4805bce1b245fda6cf7b31ceda6ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0ad6203d98403b94501c6d008954e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:19.463222 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8d301b49-2798-4965-9121-8d775eaf9a66 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 200 len: 1225 microversion: 2.1 time: 0.365375 May 19 05:29:19.463725 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3241/6393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:19 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 1225 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:20.480689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:20.481372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: e9b2f12f-bbb3-4c11-9e4b-eec60603dc33] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:20.488359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:20.488809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:20.489609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:20.490049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:20.503649 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 could not be found. May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 HTTP/1.1 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 could not be found. May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'e9b2f12f-bbb3-4c11-9e4b-eec60603dc33'} May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 could not be found. May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 could not be found. May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:29:20.505337 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 could not be found. May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c39a84b3-4e78-454a-8547-8a80387473b2 tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33" status: 404 len: 111 microversion: 2.1 time: 0.030221 May 19 05:29:20.510299 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3153/6394] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:20 2022] GET /compute/v2.1/servers/e9b2f12f-bbb3-4c11-9e4b-eec60603dc33 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:29:20.937671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:20.938201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:20.945239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:20.945716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:20.946500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:20.946958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:20.960914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 HTTP/1.1 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '6291b82c-6ff3-41ed-b74f-788b13f48793'} May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:29:20.962620 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2d69e0c7-570e-48de-bd5f-bc37787b7e5b tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 404 len: 111 microversion: 2.1 time: 0.030998 May 19 05:29:20.967487 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3242/6395] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:29:20 2022] DELETE /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:29:20.976703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:20.979135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] [instance: 6291b82c-6ff3-41ed-b74f-788b13f48793] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:20.987204 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:20.987665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:20.988445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:20.988892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:21.002777 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] HTTP exception thrown: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Request method failure captured: May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 HTTP/1.1 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdLbBnsS6oElLpsJQ-dNGVYqjyo-vLzEZc05P7hNubH4MAnEus0SKVbZM6xX8nascy2bukujAowStqLPfhpS0yezZs8g_U6d9Xnmdg0dDbYunUSkIU3ed7oev_eKAl7pvWxovoSslUtz_rvJZfMsByFYECGwyMFpfrH8Ii_IvANnimM May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea0ad6203d98403b94501c6d008954e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestVolumeBootPattern-898007977 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ea0ad6203d98403b94501c6d008954e3 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestVolumeBootPattern-898007977 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestVolumeBootPattern-898007977-project May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: dd4805bce1b245fda6cf7b31ceda6ba3 May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestVolumeBootPattern-898007977-project May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '6291b82c-6ff3-41ed-b74f-788b13f48793'} May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:29:21.004350 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Returning 404 to user: Instance 6291b82c-6ff3-41ed-b74f-788b13f48793 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-24af46d5-2f99-4f00-9e98-3d68f521769a tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793" status: 404 len: 111 microversion: 2.1 time: 0.035352 May 19 05:29:21.008978 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3154/6396] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:20 2022] GET /compute/v2.1/servers/6291b82c-6ff3-41ed-b74f-788b13f48793 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:29:26.511657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c303cb2a-ba30-4829-82ed-657354d7501d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] Calling method '.version_select at 0x7fd314ac0820>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:26.552789 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c303cb2a-ba30-4829-82ed-657354d7501d tempest-TestVolumeBootPattern-898007977 tempest-TestVolumeBootPattern-898007977-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-379217399" status: 202 len: 0 microversion: 2.1 time: 0.045005 May 19 05:29:26.553415 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3243/6397] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 19 05:29:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-379217399 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:29:44.151947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:44.152686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:44.313745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1165133663", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:29:44.562979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] validate_networks() for None {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:29:44.747355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:29:44.747920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:29:44.748405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:29:44.748936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:29:44.749433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:29:44.759008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:44.759466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:44.760277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:44.760723 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:44.778195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Getting quotas for project ffaeedb467784152ab9d468f7ee242bb. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:29:44.783455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Getting quotas for user 1cce87f71d714bf19b6cafb45e64717d and project ffaeedb467784152ab9d468f7ee242bb. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:29:44.795900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:29:44.798703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:29:44.839443 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [60b054fc-875c-4035-941a-ea23b453aade] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 05:29:45.847506 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [60b054fc-875c-4035-941a-ea23b453aade] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55722. May 19 05:29:45.851407 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-73c4fe0c-38fd-43d9-acab-9f9c9b210b79 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703429 May 19 05:29:45.852103 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3155/6398] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:29:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:29:45.862584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-083a7146-0cc5-43b3-8508-3cf81f2dd1b7 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:45.863210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-083a7146-0cc5-43b3-8508-3cf81f2dd1b7 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:45.866000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=13 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:45.867061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:46.091438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-083a7146-0cc5-43b3-8508-3cf81f2dd1b7 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:46.098330 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-083a7146-0cc5-43b3-8508-3cf81f2dd1b7 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1222 microversion: 2.1 time: 0.239668 May 19 05:29:46.098836 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3244/6399] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:45 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1222 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:47.116774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4ac71e8-f701-43c4-9683-af3a5e47aae9 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:47.117422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f4ac71e8-f701-43c4-9683-af3a5e47aae9 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:47.168802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4ac71e8-f701-43c4-9683-af3a5e47aae9 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:47.176110 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4ac71e8-f701-43c4-9683-af3a5e47aae9 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1222 microversion: 2.1 time: 0.064063 May 19 05:29:47.176674 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3156/6400] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:47 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1222 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:48.192820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72099b16-4870-4a93-96ef-7f679fd57dc2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:48.193478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72099b16-4870-4a93-96ef-7f679fd57dc2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:48.248422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-72099b16-4870-4a93-96ef-7f679fd57dc2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:48.255155 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72099b16-4870-4a93-96ef-7f679fd57dc2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1222 microversion: 2.1 time: 0.066299 May 19 05:29:48.255730 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3245/6401] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:48 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:49.271775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1e28c084-43ac-4f84-8345-4ff547b5b577 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:49.272433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1e28c084-43ac-4f84-8345-4ff547b5b577 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:49.335894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1e28c084-43ac-4f84-8345-4ff547b5b577 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:49.342477 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1e28c084-43ac-4f84-8345-4ff547b5b577 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1222 microversion: 2.1 time: 0.074659 May 19 05:29:49.343047 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3157/6402] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:49 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:50.359431 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c95a90e-24a3-4763-8f2c-fa5ae46f65da tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:50.360066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9c95a90e-24a3-4763-8f2c-fa5ae46f65da tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:50.367847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c95a90e-24a3-4763-8f2c-fa5ae46f65da tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:50.368317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c95a90e-24a3-4763-8f2c-fa5ae46f65da tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:50.369115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c95a90e-24a3-4763-8f2c-fa5ae46f65da tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:50.369574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c95a90e-24a3-4763-8f2c-fa5ae46f65da tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:50.433103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c95a90e-24a3-4763-8f2c-fa5ae46f65da tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:50.441535 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c95a90e-24a3-4763-8f2c-fa5ae46f65da tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1226 microversion: 2.1 time: 0.085975 May 19 05:29:50.442121 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3246/6403] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:50 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:51.458036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5f2cdc26-43de-4cef-847b-f4167a49988a tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:51.459102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5f2cdc26-43de-4cef-847b-f4167a49988a tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:51.466746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f2cdc26-43de-4cef-847b-f4167a49988a tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:51.467269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f2cdc26-43de-4cef-847b-f4167a49988a tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:51.468109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f2cdc26-43de-4cef-847b-f4167a49988a tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:51.468616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5f2cdc26-43de-4cef-847b-f4167a49988a tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:51.879498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5f2cdc26-43de-4cef-847b-f4167a49988a tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:51.887714 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5f2cdc26-43de-4cef-847b-f4167a49988a tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1280 microversion: 2.1 time: 0.433713 May 19 05:29:51.888346 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3158/6404] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:51 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1280 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:52.906492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-164c21ef-9020-443a-9859-c3265165f425 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:52.909529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-164c21ef-9020-443a-9859-c3265165f425 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:52.916745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-164c21ef-9020-443a-9859-c3265165f425 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:52.917329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-164c21ef-9020-443a-9859-c3265165f425 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:52.918352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-164c21ef-9020-443a-9859-c3265165f425 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:52.918865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-164c21ef-9020-443a-9859-c3265165f425 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:52.965892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6d8a7d5d-4562-47db-91d6-5166f29a19a6 req-6494f9d4-5947-4860-933b-d5ffdca749dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3142b6d-2976-483a-a7e8-294f5979d89e", "tag": "009de1e0-7fdc-4ae5-9fcf-6d8ed19b31d0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:29:52.974917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6d8a7d5d-4562-47db-91d6-5166f29a19a6 req-6494f9d4-5947-4860-933b-d5ffdca749dc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:52.975777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6d8a7d5d-4562-47db-91d6-5166f29a19a6 req-6494f9d4-5947-4860-933b-d5ffdca749dc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:52.991884 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6d8a7d5d-4562-47db-91d6-5166f29a19a6 req-6494f9d4-5947-4860-933b-d5ffdca749dc service nova] Creating event network-changed:009de1e0-7fdc-4ae5-9fcf-6d8ed19b31d0 for instance b3142b6d-2976-483a-a7e8-294f5979d89e on n-h2-766726-30 May 19 05:29:52.997743 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6d8a7d5d-4562-47db-91d6-5166f29a19a6 req-6494f9d4-5947-4860-933b-d5ffdca749dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101406 May 19 05:29:52.998507 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3247/6405] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:29:53.157556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-164c21ef-9020-443a-9859-c3265165f425 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:53.165345 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-164c21ef-9020-443a-9859-c3265165f425 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1322 microversion: 2.1 time: 0.263982 May 19 05:29:53.165934 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3159/6406] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:52 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:54.184035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f589e7cd-4e29-4808-bf18-314839ab094e tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:54.184841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f589e7cd-4e29-4808-bf18-314839ab094e tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:54.191277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f589e7cd-4e29-4808-bf18-314839ab094e tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:54.191744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f589e7cd-4e29-4808-bf18-314839ab094e tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:54.192535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f589e7cd-4e29-4808-bf18-314839ab094e tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:54.193022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f589e7cd-4e29-4808-bf18-314839ab094e tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:54.409691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f589e7cd-4e29-4808-bf18-314839ab094e tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:54.417295 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f589e7cd-4e29-4808-bf18-314839ab094e tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1322 microversion: 2.1 time: 0.238686 May 19 05:29:54.417879 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3248/6407] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:54 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:55.434807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ffd4915e-7905-4e6c-9e65-7f806a3fa22d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:55.435427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ffd4915e-7905-4e6c-9e65-7f806a3fa22d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:55.438658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:55.444383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffd4915e-7905-4e6c-9e65-7f806a3fa22d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:55.444838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffd4915e-7905-4e6c-9e65-7f806a3fa22d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:55.445704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffd4915e-7905-4e6c-9e65-7f806a3fa22d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:55.446141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ffd4915e-7905-4e6c-9e65-7f806a3fa22d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:55.582163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ffd4915e-7905-4e6c-9e65-7f806a3fa22d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:55.590093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ffd4915e-7905-4e6c-9e65-7f806a3fa22d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1322 microversion: 2.1 time: 0.159128 May 19 05:29:55.590786 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3160/6408] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:55 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:56.607460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-575a3b8c-e004-47b1-8329-208110547d4c tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:56.608090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-575a3b8c-e004-47b1-8329-208110547d4c tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:56.615419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-575a3b8c-e004-47b1-8329-208110547d4c tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:56.615880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-575a3b8c-e004-47b1-8329-208110547d4c tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:56.616688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-575a3b8c-e004-47b1-8329-208110547d4c tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:56.617164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-575a3b8c-e004-47b1-8329-208110547d4c tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:56.750841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-575a3b8c-e004-47b1-8329-208110547d4c tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:56.758293 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-575a3b8c-e004-47b1-8329-208110547d4c tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1322 microversion: 2.1 time: 0.154746 May 19 05:29:56.758872 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3249/6409] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:56 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:57.775534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5e9bf103-4027-4c47-9f30-20bff72a680d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:57.776178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5e9bf103-4027-4c47-9f30-20bff72a680d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:57.783154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e9bf103-4027-4c47-9f30-20bff72a680d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:57.783612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e9bf103-4027-4c47-9f30-20bff72a680d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:57.784382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e9bf103-4027-4c47-9f30-20bff72a680d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:57.784833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5e9bf103-4027-4c47-9f30-20bff72a680d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:57.914833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5e9bf103-4027-4c47-9f30-20bff72a680d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:57.922480 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5e9bf103-4027-4c47-9f30-20bff72a680d tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1322 microversion: 2.1 time: 0.150827 May 19 05:29:57.923060 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3161/6410] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:57 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:29:58.343355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:29:58.392511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-addbd32f-b9f2-4731-877c-344c267bd773 req-ca28fbb7-c83c-4e98-86de-ab258dbb578c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3142b6d-2976-483a-a7e8-294f5979d89e", "name": "network-vif-plugged", "status": "completed", "tag": "009de1e0-7fdc-4ae5-9fcf-6d8ed19b31d0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:29:58.400449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-addbd32f-b9f2-4731-877c-344c267bd773 req-ca28fbb7-c83c-4e98-86de-ab258dbb578c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:58.400897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-addbd32f-b9f2-4731-877c-344c267bd773 req-ca28fbb7-c83c-4e98-86de-ab258dbb578c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:58.412191 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-addbd32f-b9f2-4731-877c-344c267bd773 req-ca28fbb7-c83c-4e98-86de-ab258dbb578c service nova] Creating event network-vif-plugged:009de1e0-7fdc-4ae5-9fcf-6d8ed19b31d0 for instance b3142b6d-2976-483a-a7e8-294f5979d89e on n-h2-766726-30 May 19 05:29:58.417196 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-addbd32f-b9f2-4731-877c-344c267bd773 req-ca28fbb7-c83c-4e98-86de-ab258dbb578c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079617 May 19 05:29:58.417773 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3250/6411] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:29:58.939066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1163ee45-3393-4b04-b987-95b961c2d5b2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:29:58.939687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1163ee45-3393-4b04-b987-95b961c2d5b2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:29:58.946660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1163ee45-3393-4b04-b987-95b961c2d5b2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:58.947117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1163ee45-3393-4b04-b987-95b961c2d5b2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:58.947887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1163ee45-3393-4b04-b987-95b961c2d5b2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:29:58.948335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1163ee45-3393-4b04-b987-95b961c2d5b2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:29:59.080544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1163ee45-3393-4b04-b987-95b961c2d5b2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:29:59.088075 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1163ee45-3393-4b04-b987-95b961c2d5b2 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1322 microversion: 2.1 time: 0.153052 May 19 05:29:59.088650 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3162/6412] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:29:58 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:00.107084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7c9449d1-eed4-405c-92a0-9c896a6aea0f tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:00.107803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7c9449d1-eed4-405c-92a0-9c896a6aea0f tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:00.114718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c9449d1-eed4-405c-92a0-9c896a6aea0f tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.115183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c9449d1-eed4-405c-92a0-9c896a6aea0f tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.115958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c9449d1-eed4-405c-92a0-9c896a6aea0f tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.116418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7c9449d1-eed4-405c-92a0-9c896a6aea0f tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.243110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7c9449d1-eed4-405c-92a0-9c896a6aea0f tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:00.250861 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7c9449d1-eed4-405c-92a0-9c896a6aea0f tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1471 microversion: 2.1 time: 0.149078 May 19 05:30:00.251435 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3251/6413] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:00 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:00.269512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=10 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:00.316331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e096581c-dfff-4649-9112-f17090a3e1f2 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Calling method '.version_select at 0x7fd314474dc0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:00.380845 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e096581c-dfff-4649-9112-f17090a3e1f2 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/5d1229605bfd4d6aa7cae7a7e1be157a" status: 200 len: 371 microversion: 2.1 time: 0.115728 May 19 05:30:00.381570 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3163/6414] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 05:30:00 2022] GET /compute/v2.1/os-quota-sets/5d1229605bfd4d6aa7cae7a7e1be157a => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:00.392590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7ec7616b-1f2e-472a-bec8-92bc044fe353 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1898031596", "id": 1691123900, "os-flavor-access:is_public": "True"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:00.394206 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:30:00.394206 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:30:00.409104 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7ec7616b-1f2e-472a-bec8-92bc044fe353 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.020970 May 19 05:30:00.409712 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3252/6415] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:30:00 2022] POST /compute/v2.1/flavors => generated 438 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:00.420346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1691123900"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:00.421384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:00.427816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.428272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.429039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.429508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.517790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2b86cd9e7e9c47298ba65ce1f7ebf0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1229605bfd4d6aa7cae7a7e1be157a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:00.523914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1898031596 {{(pid=124819) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:30:00.530149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.530597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.531391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.531829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.554017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Getting quotas for project ffaeedb467784152ab9d468f7ee242bb. Resources: {'ram', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:30:00.559034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Getting quotas for user 1cce87f71d714bf19b6cafb45e64717d and project ffaeedb467784152ab9d468f7ee242bb. Resources: {'ram', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:30:00.572540 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.compute.api [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] ram quota exceeded for 5d1229605bfd4d6aa7cae7a7e1be157a, tried to resize instance. May 19 05:30:00.573099 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Request method failure captured: May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e/action HTTP/1.1 May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 39 May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdXHcEINENwar9x4ytfHxZLew3gyeiWLETDkIrTjlcnzCkUfgmNlSVG8kM6A9bgHj1vgQ5-tcj_oQ3IR89Uy2QHx8K2MUJxzaxslEsF-LUkllA6gB-aW8pu-CKLmh_MgkdjATwtR_jDEx1DAF3W-jmEw0aqo6iOFAuBSF1qd6XZwfec May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 5d1229605bfd4d6aa7cae7a7e1be157a May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1565241459 May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member,admin May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member,admin May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d1229605bfd4d6aa7cae7a7e1be157a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d1229605bfd4d6aa7cae7a7e1be157a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d1229605bfd4d6aa7cae7a7e1be157a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d1229605bfd4d6aa7cae7a7e1be157a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1565241459 May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 5d1229605bfd4d6aa7cae7a7e1be157a May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1565241459 May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersAdminNegativeTestJSON-1565241459-project-admin May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 2b86cd9e7e9c47298ba65ce1f7ebf0c8 May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1565241459-project-admin May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: {"resize": {"flavorRef": "1691123900"}} May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b3142b6d-2976-483a-a7e8-294f5979d89e', 'body': {'resize': {'flavorRef': '1691123900'}}} May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1055, in _resize May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:30:00.575366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1058, in _resize May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-896f8e91-5621-48ef-aa28-1f1571b27596 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e/action" status: 403 len: 118 microversion: 2.1 time: 0.160404 May 19 05:30:00.580948 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3164/6416] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:30:00 2022] POST /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e/action => generated 118 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 05:30:00.586055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ea7c1683-716e-445f-987a-8d4a603a333b tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:00.586862 n-d-766726-30 devstack@n-api.service[124818]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:30:00.586862 n-d-766726-30 devstack@n-api.service[124818]: warnings.warn(msg) May 19 05:30:00.603692 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ea7c1683-716e-445f-987a-8d4a603a333b tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1691123900" status: 202 len: 0 microversion: 2.1 time: 0.021244 May 19 05:30:00.604240 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3253/6417] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 05:30:00 2022] DELETE /compute/v2.1/flavors/1691123900 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:30:00.611980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4438ee3e-f803-444a-b983-c0890c1391f0 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:00.630798 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4438ee3e-f803-444a-b983-c0890c1391f0 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022440 May 19 05:30:00.631381 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3165/6418] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 05:30:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:00.648242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d20a5a3e-a9dd-4a2d-92dc-eb2486cec676 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Calling method '.version_select at 0x7fd314a74c10>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:00.712376 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d20a5a3e-a9dd-4a2d-92dc-eb2486cec676 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/5d1229605bfd4d6aa7cae7a7e1be157a" status: 200 len: 371 microversion: 2.1 time: 0.067904 May 19 05:30:00.712938 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3254/6419] 10.222.0.58 () {58 vars in 1241 bytes} [Thu May 19 05:30:00 2022] GET /compute/v2.1/os-quota-sets/5d1229605bfd4d6aa7cae7a7e1be157a => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:00.722906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5c9961ba-b7fd-4992-b9bf-e9e41b54c2cd tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-568053842", "id": 1607252086, "os-flavor-access:is_public": "True"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:00.724486 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:30:00.724486 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 05:30:00.739252 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5c9961ba-b7fd-4992-b9bf-e9e41b54c2cd tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.020092 May 19 05:30:00.739829 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3166/6420] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:30:00 2022] POST /compute/v2.1/flavors => generated 436 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:00.750182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1607252086"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:00.751795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:00.758005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.758464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.759239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.759688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.917651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2b86cd9e7e9c47298ba65ce1f7ebf0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1229605bfd4d6aa7cae7a7e1be157a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:00.924373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-568053842 {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:30:00.930861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.931323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.932147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:00.932600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:00.953406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Getting quotas for project ffaeedb467784152ab9d468f7ee242bb. Resources: {'ram', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:30:00.959051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Getting quotas for user 1cce87f71d714bf19b6cafb45e64717d and project ffaeedb467784152ab9d468f7ee242bb. Resources: {'ram', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:30:00.971266 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] cores quota exceeded for 5d1229605bfd4d6aa7cae7a7e1be157a, tried to resize instance. May 19 05:30:00.971827 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Request method failure captured: May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e/action HTTP/1.1 May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 39 May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdXHcEINENwar9x4ytfHxZLew3gyeiWLETDkIrTjlcnzCkUfgmNlSVG8kM6A9bgHj1vgQ5-tcj_oQ3IR89Uy2QHx8K2MUJxzaxslEsF-LUkllA6gB-aW8pu-CKLmh_MgkdjATwtR_jDEx1DAF3W-jmEw0aqo6iOFAuBSF1qd6XZwfec May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 5d1229605bfd4d6aa7cae7a7e1be157a May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1565241459 May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member,admin May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member,admin May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d1229605bfd4d6aa7cae7a7e1be157a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d1229605bfd4d6aa7cae7a7e1be157a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d1229605bfd4d6aa7cae7a7e1be157a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d1229605bfd4d6aa7cae7a7e1be157a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1565241459 May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 5d1229605bfd4d6aa7cae7a7e1be157a May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1565241459 May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersAdminNegativeTestJSON-1565241459-project-admin May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 2b86cd9e7e9c47298ba65ce1f7ebf0c8 May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1565241459-project-admin May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: {"resize": {"flavorRef": "1607252086"}} May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'b3142b6d-2976-483a-a7e8-294f5979d89e', 'body': {'resize': {'flavorRef': '1607252086'}}} May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1055, in _resize May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:30:00.973932 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1058, in _resize May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ea08019-dac4-4311-b54c-f5a9f844dfec tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e/action" status: 403 len: 113 microversion: 2.1 time: 0.229271 May 19 05:30:00.982076 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3255/6421] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:30:00 2022] POST /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e/action => generated 113 bytes in 230 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 05:30:00.985661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-991cd1df-d08b-48c8-bb7c-f613fae565e9 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:00.985661 n-d-766726-30 devstack@n-api.service[124819]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 05:30:00.985661 n-d-766726-30 devstack@n-api.service[124819]: warnings.warn(msg) May 19 05:30:01.001885 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-991cd1df-d08b-48c8-bb7c-f613fae565e9 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1607252086" status: 202 len: 0 microversion: 2.1 time: 0.021286 May 19 05:30:01.002465 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3167/6422] 10.222.0.58 () {58 vars in 1160 bytes} [Thu May 19 05:30:00 2022] DELETE /compute/v2.1/flavors/1607252086 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:30:01.010429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a6bda92e-05f9-4ce3-8a46-8079aa8cf9e8 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:01.029706 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a6bda92e-05f9-4ce3-8a46-8079aa8cf9e8 tempest-ServersAdminNegativeTestJSON-1565241459 tempest-ServersAdminNegativeTestJSON-1565241459-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023025 May 19 05:30:01.030266 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3256/6423] 10.222.0.58 () {58 vars in 1145 bytes} [Thu May 19 05:30:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:01.047019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1dd0341c-01c5-461d-a4f6-06d6f931bd68 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:01.047019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1dd0341c-01c5-461d-a4f6-06d6f931bd68 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:01.053572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dd0341c-01c5-461d-a4f6-06d6f931bd68 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:01.054034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dd0341c-01c5-461d-a4f6-06d6f931bd68 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:01.054797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dd0341c-01c5-461d-a4f6-06d6f931bd68 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:01.055239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1dd0341c-01c5-461d-a4f6-06d6f931bd68 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:01.083542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1dd0341c-01c5-461d-a4f6-06d6f931bd68 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:30:01.157947 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1dd0341c-01c5-461d-a4f6-06d6f931bd68 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 204 len: 0 microversion: 2.1 time: 0.114994 May 19 05:30:01.158459 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3168/6424] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:30:01 2022] DELETE /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:30:01.167669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d999d720-cf22-455a-9ee8-3a98246da571 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:01.168384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d999d720-cf22-455a-9ee8-3a98246da571 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:01.176984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d999d720-cf22-455a-9ee8-3a98246da571 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:01.177457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d999d720-cf22-455a-9ee8-3a98246da571 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:01.178238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d999d720-cf22-455a-9ee8-3a98246da571 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:01.178687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d999d720-cf22-455a-9ee8-3a98246da571 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:01.311562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d999d720-cf22-455a-9ee8-3a98246da571 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:01.320075 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d999d720-cf22-455a-9ee8-3a98246da571 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1477 microversion: 2.1 time: 0.157182 May 19 05:30:01.320624 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3257/6425] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:01 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:02.337790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ecfc9814-c0a7-49dd-9763-5634ef3b6b71 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:02.338499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ecfc9814-c0a7-49dd-9763-5634ef3b6b71 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:02.345460 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ecfc9814-c0a7-49dd-9763-5634ef3b6b71 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:02.345914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ecfc9814-c0a7-49dd-9763-5634ef3b6b71 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:02.346677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ecfc9814-c0a7-49dd-9763-5634ef3b6b71 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:02.347118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ecfc9814-c0a7-49dd-9763-5634ef3b6b71 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:02.540147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ecfc9814-c0a7-49dd-9763-5634ef3b6b71 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cce87f71d714bf19b6cafb45e64717d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaeedb467784152ab9d468f7ee242bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:02.548341 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ecfc9814-c0a7-49dd-9763-5634ef3b6b71 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 200 len: 1477 microversion: 2.1 time: 0.214356 May 19 05:30:02.548934 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3169/6426] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:02 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:02.905901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3e02b888-c25e-455a-8cfa-094d7bbb7f72 req-47f55fb0-cf20-4be2-a64c-2e59947fbf03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3142b6d-2976-483a-a7e8-294f5979d89e", "name": "network-vif-deleted", "tag": "009de1e0-7fdc-4ae5-9fcf-6d8ed19b31d0"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:02.918481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3e02b888-c25e-455a-8cfa-094d7bbb7f72 req-47f55fb0-cf20-4be2-a64c-2e59947fbf03 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:02.918941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3e02b888-c25e-455a-8cfa-094d7bbb7f72 req-47f55fb0-cf20-4be2-a64c-2e59947fbf03 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:02.938719 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3e02b888-c25e-455a-8cfa-094d7bbb7f72 req-47f55fb0-cf20-4be2-a64c-2e59947fbf03 service nova] Creating event network-vif-deleted:009de1e0-7fdc-4ae5-9fcf-6d8ed19b31d0 for instance b3142b6d-2976-483a-a7e8-294f5979d89e on n-h2-766726-30 May 19 05:30:02.944720 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3e02b888-c25e-455a-8cfa-094d7bbb7f72 req-47f55fb0-cf20-4be2-a64c-2e59947fbf03 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042812 May 19 05:30:02.945673 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3258/6427] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:03.565540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:03.566164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] [instance: b3142b6d-2976-483a-a7e8-294f5979d89e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:03.573469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:03.577117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:03.577117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:03.577117 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:03.591241 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] HTTP exception thrown: Instance b3142b6d-2976-483a-a7e8-294f5979d89e could not be found. May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Request method failure captured: May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e HTTP/1.1 May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdXHgPl6cN-NzcYFxWhz-bA27TH6sebngsrtAuYCAfvam9qZ-h0doWPT27xGcRv8-aapXtH_a1mhx5pLGBMzOI2eKSKzmkLR1pdF1bJurErg9QIhTugw4VF6FS0GjXxLKo3yNxMgT3yImxZ9kA-A3p8xFVMaqcy7D2cpl0kweI9NIQQ May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: ffaeedb467784152ab9d468f7ee242bb May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1941133375 May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ffaeedb467784152ab9d468f7ee242bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ffaeedb467784152ab9d468f7ee242bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ffaeedb467784152ab9d468f7ee242bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ffaeedb467784152ab9d468f7ee242bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1941133375 May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: ffaeedb467784152ab9d468f7ee242bb May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1941133375 May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersAdminNegativeTestJSON-1941133375-project May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 1cce87f71d714bf19b6cafb45e64717d May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1941133375-project May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance b3142b6d-2976-483a-a7e8-294f5979d89e could not be found. May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b3142b6d-2976-483a-a7e8-294f5979d89e'} May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3142b6d-2976-483a-a7e8-294f5979d89e could not be found. May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3142b6d-2976-483a-a7e8-294f5979d89e could not be found. May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:03.592942 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3142b6d-2976-483a-a7e8-294f5979d89e could not be found. May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] Returning 404 to user: Instance b3142b6d-2976-483a-a7e8-294f5979d89e could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5d7af1a2-ac1e-4679-a93d-a85762383816 tempest-ServersAdminNegativeTestJSON-1941133375 tempest-ServersAdminNegativeTestJSON-1941133375-project] 10.222.0.58 "GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e" status: 404 len: 111 microversion: 2.1 time: 0.032964 May 19 05:30:03.598734 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3170/6428] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:03 2022] GET /compute/v2.1/servers/b3142b6d-2976-483a-a7e8-294f5979d89e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:30:06.512599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-933461635", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "9c479269-9f8a-4e0d-b4fc-534cff957f27"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:06.562858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] validate_networks() for [('9c479269-9f8a-4e0d-b4fc-534cff957f27', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:30:06.915862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:30:06.916301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:30:06.916786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:30:06.917249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:30:06.917675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:30:06.926801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:06.927204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:06.928048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:06.928501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:06.945703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Getting quotas for project 79c94b5abcd5417fb8ca4acfa594668e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:30:06.950937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Getting quotas for user 425e0ef5a34c4dbebd4e19b19b338d89 and project 79c94b5abcd5417fb8ca4acfa594668e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:30:06.963895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:30:06.966286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:30:07.011078 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-828bbea7-08a0-477f-a723-2c9abaa7bf42 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614178 May 19 05:30:07.011723 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3259/6429] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:30:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:30:07.022254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7b95c3fd-2bd0-4cac-b944-c3820511990c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:07.022871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7b95c3fd-2bd0-4cac-b944-c3820511990c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:07.080756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7b95c3fd-2bd0-4cac-b944-c3820511990c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:07.088871 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7b95c3fd-2bd0-4cac-b944-c3820511990c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1214 microversion: 2.1 time: 0.071005 May 19 05:30:07.089550 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3171/6430] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:07 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:08.108014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d3c39e9-4411-4ae5-b6db-a7ffda6bcef6 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:08.108636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7d3c39e9-4411-4ae5-b6db-a7ffda6bcef6 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:08.115780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d3c39e9-4411-4ae5-b6db-a7ffda6bcef6 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:08.116242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d3c39e9-4411-4ae5-b6db-a7ffda6bcef6 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:08.117043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d3c39e9-4411-4ae5-b6db-a7ffda6bcef6 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:08.117549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d3c39e9-4411-4ae5-b6db-a7ffda6bcef6 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:08.208756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7d3c39e9-4411-4ae5-b6db-a7ffda6bcef6 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:08.216597 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d3c39e9-4411-4ae5-b6db-a7ffda6bcef6 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1272 microversion: 2.1 time: 0.113332 May 19 05:30:08.217352 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3260/6431] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:08 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:09.208137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e1d89571-42ea-405c-a08e-a97dcc9838fc req-a8b6750b-0d68-4def-84d1-8492b96ef36d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b63e7f9e-1e9a-4530-b9ad-e3c15beff906", "tag": "f06ce3f8-b683-4870-8c96-5825bad8d69e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:09.218395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e1d89571-42ea-405c-a08e-a97dcc9838fc req-a8b6750b-0d68-4def-84d1-8492b96ef36d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:09.219688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e1d89571-42ea-405c-a08e-a97dcc9838fc req-a8b6750b-0d68-4def-84d1-8492b96ef36d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:09.234105 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e1d89571-42ea-405c-a08e-a97dcc9838fc req-a8b6750b-0d68-4def-84d1-8492b96ef36d service nova] Creating event network-changed:f06ce3f8-b683-4870-8c96-5825bad8d69e for instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 on n-h2-766726-30 May 19 05:30:09.234694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-28b50308-1484-46cd-811f-e6a6d4fd168f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:09.235337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-28b50308-1484-46cd-811f-e6a6d4fd168f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:09.241064 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e1d89571-42ea-405c-a08e-a97dcc9838fc req-a8b6750b-0d68-4def-84d1-8492b96ef36d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037736 May 19 05:30:09.241714 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3172/6432] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:09.245062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28b50308-1484-46cd-811f-e6a6d4fd168f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:09.245565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28b50308-1484-46cd-811f-e6a6d4fd168f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:09.246557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28b50308-1484-46cd-811f-e6a6d4fd168f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:09.247072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28b50308-1484-46cd-811f-e6a6d4fd168f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:09.463112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-28b50308-1484-46cd-811f-e6a6d4fd168f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:09.470670 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-28b50308-1484-46cd-811f-e6a6d4fd168f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1314 microversion: 2.1 time: 0.240148 May 19 05:30:09.471256 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3261/6433] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:09 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:10.492161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-175ac438-3636-4960-a350-f2631f7face8 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:10.493344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-175ac438-3636-4960-a350-f2631f7face8 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:10.500602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-175ac438-3636-4960-a350-f2631f7face8 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:10.501063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-175ac438-3636-4960-a350-f2631f7face8 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:10.502385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-175ac438-3636-4960-a350-f2631f7face8 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:10.502832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-175ac438-3636-4960-a350-f2631f7face8 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:10.541531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:10.719817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-175ac438-3636-4960-a350-f2631f7face8 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:10.727722 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-175ac438-3636-4960-a350-f2631f7face8 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1314 microversion: 2.1 time: 0.243581 May 19 05:30:10.728309 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3173/6434] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:10 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:11.744696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96f2d5e4-9543-4388-a708-bd34881688e9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:11.745351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96f2d5e4-9543-4388-a708-bd34881688e9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:11.752418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f2d5e4-9543-4388-a708-bd34881688e9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:11.752883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f2d5e4-9543-4388-a708-bd34881688e9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:11.753698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f2d5e4-9543-4388-a708-bd34881688e9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:11.754152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f2d5e4-9543-4388-a708-bd34881688e9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:11.884096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-96f2d5e4-9543-4388-a708-bd34881688e9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:11.891592 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96f2d5e4-9543-4388-a708-bd34881688e9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1314 microversion: 2.1 time: 0.150883 May 19 05:30:11.892167 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3262/6435] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:11 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:12.909268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f8728e3c-deb0-4919-a2cb-4b0623bc6289 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:12.909882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f8728e3c-deb0-4919-a2cb-4b0623bc6289 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:12.916825 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8728e3c-deb0-4919-a2cb-4b0623bc6289 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:12.917377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8728e3c-deb0-4919-a2cb-4b0623bc6289 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:12.918144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8728e3c-deb0-4919-a2cb-4b0623bc6289 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:12.918581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f8728e3c-deb0-4919-a2cb-4b0623bc6289 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:13.044679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f8728e3c-deb0-4919-a2cb-4b0623bc6289 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:13.052245 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f8728e3c-deb0-4919-a2cb-4b0623bc6289 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1314 microversion: 2.1 time: 0.147499 May 19 05:30:13.052824 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3174/6436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:12 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:14.069639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-01dc893a-86f1-4cd3-85f2-0643965c8987 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:14.070268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-01dc893a-86f1-4cd3-85f2-0643965c8987 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:14.077195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01dc893a-86f1-4cd3-85f2-0643965c8987 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:14.077662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01dc893a-86f1-4cd3-85f2-0643965c8987 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:14.078439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01dc893a-86f1-4cd3-85f2-0643965c8987 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:14.078892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01dc893a-86f1-4cd3-85f2-0643965c8987 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:14.207293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-01dc893a-86f1-4cd3-85f2-0643965c8987 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:14.214443 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-01dc893a-86f1-4cd3-85f2-0643965c8987 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1314 microversion: 2.1 time: 0.148673 May 19 05:30:14.215011 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3263/6437] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:14 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:14.515037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5710cc5e-8cfc-4ab1-8bfc-90f195f65d71 req-155a1aeb-9162-414c-ac9e-8ae3d54566a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63e7f9e-1e9a-4530-b9ad-e3c15beff906", "name": "network-vif-plugged", "status": "completed", "tag": "f06ce3f8-b683-4870-8c96-5825bad8d69e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:14.520043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:14.526427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5710cc5e-8cfc-4ab1-8bfc-90f195f65d71 req-155a1aeb-9162-414c-ac9e-8ae3d54566a7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:14.526880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5710cc5e-8cfc-4ab1-8bfc-90f195f65d71 req-155a1aeb-9162-414c-ac9e-8ae3d54566a7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:14.534649 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:14.542413 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5710cc5e-8cfc-4ab1-8bfc-90f195f65d71 req-155a1aeb-9162-414c-ac9e-8ae3d54566a7 service nova] Creating event network-vif-plugged:f06ce3f8-b683-4870-8c96-5825bad8d69e for instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 on n-h2-766726-30 May 19 05:30:14.547684 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5710cc5e-8cfc-4ab1-8bfc-90f195f65d71 req-155a1aeb-9162-414c-ac9e-8ae3d54566a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036459 May 19 05:30:14.548306 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3175/6438] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:15.232119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c13ca55e-ffb0-48e2-85cd-7e50d0fe5912 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:15.232739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c13ca55e-ffb0-48e2-85cd-7e50d0fe5912 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:15.240337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c13ca55e-ffb0-48e2-85cd-7e50d0fe5912 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:15.240797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c13ca55e-ffb0-48e2-85cd-7e50d0fe5912 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:15.241637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c13ca55e-ffb0-48e2-85cd-7e50d0fe5912 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:15.242084 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c13ca55e-ffb0-48e2-85cd-7e50d0fe5912 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:15.372213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c13ca55e-ffb0-48e2-85cd-7e50d0fe5912 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:15.379911 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c13ca55e-ffb0-48e2-85cd-7e50d0fe5912 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1314 microversion: 2.1 time: 0.151734 May 19 05:30:15.380498 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3264/6439] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:15 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:16.398324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4f3c807a-c2d4-47a8-a263-fd0f88aca706 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:16.399020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4f3c807a-c2d4-47a8-a263-fd0f88aca706 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:16.406909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f3c807a-c2d4-47a8-a263-fd0f88aca706 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:16.407354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f3c807a-c2d4-47a8-a263-fd0f88aca706 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:16.408225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f3c807a-c2d4-47a8-a263-fd0f88aca706 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:16.409248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f3c807a-c2d4-47a8-a263-fd0f88aca706 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:16.535815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4f3c807a-c2d4-47a8-a263-fd0f88aca706 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:16.543566 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4f3c807a-c2d4-47a8-a263-fd0f88aca706 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1501 microversion: 2.1 time: 0.151492 May 19 05:30:16.544150 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3176/6440] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:16 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:16.560487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:16.561562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:16.564369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:16.570710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:16.571171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:16.571946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:16.572396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:16.610895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=82 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:16.649953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:16.655643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Old instance type m1.heat2, new instance type m1.heat {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:30:16.662227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:30:16.662658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:30:16.663142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:30:16.663561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:30:16.663982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:30:16.775842 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-41743d79-f496-4c49-82ba-0a483479142b tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "POST /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906/action" status: 202 len: 0 microversion: 2.1 time: 0.219213 May 19 05:30:16.776518 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3265/6441] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:30:16 2022] POST /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:30:16.785414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1bd1fc0c-2d54-439b-9c7d-a6aabb9d3765 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:16.786037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1bd1fc0c-2d54-439b-9c7d-a6aabb9d3765 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:16.792086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bd1fc0c-2d54-439b-9c7d-a6aabb9d3765 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:16.792551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bd1fc0c-2d54-439b-9c7d-a6aabb9d3765 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:16.793354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bd1fc0c-2d54-439b-9c7d-a6aabb9d3765 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:16.793806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1bd1fc0c-2d54-439b-9c7d-a6aabb9d3765 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:16.958488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1bd1fc0c-2d54-439b-9c7d-a6aabb9d3765 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:16.967165 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1bd1fc0c-2d54-439b-9c7d-a6aabb9d3765 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1510 microversion: 2.1 time: 0.186356 May 19 05:30:16.967763 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3177/6442] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:16 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:17.982160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=5 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:17.982941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:17.988158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96b59320-31c4-44bb-b106-7b03ce388a37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:17.988776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96b59320-31c4-44bb-b106-7b03ce388a37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:17.996772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96b59320-31c4-44bb-b106-7b03ce388a37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:17.997278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96b59320-31c4-44bb-b106-7b03ce388a37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:17.998057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96b59320-31c4-44bb-b106-7b03ce388a37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:17.998514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96b59320-31c4-44bb-b106-7b03ce388a37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:18.131279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-96b59320-31c4-44bb-b106-7b03ce388a37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:18.139283 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96b59320-31c4-44bb-b106-7b03ce388a37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1510 microversion: 2.1 time: 0.157907 May 19 05:30:18.139886 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3266/6443] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:17 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:19.157714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6239baca-d7a3-4dff-8f44-0aa6131cbcbf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:19.159044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6239baca-d7a3-4dff-8f44-0aa6131cbcbf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:19.162102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:19.167066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6239baca-d7a3-4dff-8f44-0aa6131cbcbf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:19.167583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6239baca-d7a3-4dff-8f44-0aa6131cbcbf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:19.168358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6239baca-d7a3-4dff-8f44-0aa6131cbcbf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:19.168797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6239baca-d7a3-4dff-8f44-0aa6131cbcbf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:19.309796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6239baca-d7a3-4dff-8f44-0aa6131cbcbf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:19.317384 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6239baca-d7a3-4dff-8f44-0aa6131cbcbf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.164085 May 19 05:30:19.317958 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3178/6444] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:19 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:20.334949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bdc9dbd0-05c8-4eae-a18e-590d1a9a0220 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:20.335581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bdc9dbd0-05c8-4eae-a18e-590d1a9a0220 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:20.342522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdc9dbd0-05c8-4eae-a18e-590d1a9a0220 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:20.342973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdc9dbd0-05c8-4eae-a18e-590d1a9a0220 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:20.343753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdc9dbd0-05c8-4eae-a18e-590d1a9a0220 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:20.344205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bdc9dbd0-05c8-4eae-a18e-590d1a9a0220 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:20.472674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bdc9dbd0-05c8-4eae-a18e-590d1a9a0220 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:20.480528 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bdc9dbd0-05c8-4eae-a18e-590d1a9a0220 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.149495 May 19 05:30:20.481116 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3267/6445] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:20 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:21.497503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3ba3e96-dc16-462d-9282-f9eddb6e1c74 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:21.498118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3ba3e96-dc16-462d-9282-f9eddb6e1c74 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:21.505094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e96-dc16-462d-9282-f9eddb6e1c74 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:21.505555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e96-dc16-462d-9282-f9eddb6e1c74 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:21.506312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e96-dc16-462d-9282-f9eddb6e1c74 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:21.506749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3ba3e96-dc16-462d-9282-f9eddb6e1c74 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:21.635778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3ba3e96-dc16-462d-9282-f9eddb6e1c74 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:21.643351 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3ba3e96-dc16-462d-9282-f9eddb6e1c74 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.149887 May 19 05:30:21.644544 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3179/6446] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:21 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:22.661302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bf61f511-3705-44cc-a8e9-6c90f685b012 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:22.661956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bf61f511-3705-44cc-a8e9-6c90f685b012 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:22.668039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf61f511-3705-44cc-a8e9-6c90f685b012 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:22.668501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf61f511-3705-44cc-a8e9-6c90f685b012 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:22.669301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf61f511-3705-44cc-a8e9-6c90f685b012 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:22.669752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bf61f511-3705-44cc-a8e9-6c90f685b012 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:23.070590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bf61f511-3705-44cc-a8e9-6c90f685b012 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:23.078192 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bf61f511-3705-44cc-a8e9-6c90f685b012 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.421216 May 19 05:30:23.078765 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3268/6447] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:22 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:24.095240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8d487bd-6e01-4d68-8cd7-8de43c95d06f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:24.095867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8d487bd-6e01-4d68-8cd7-8de43c95d06f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:24.103167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8d487bd-6e01-4d68-8cd7-8de43c95d06f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:24.103623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8d487bd-6e01-4d68-8cd7-8de43c95d06f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:24.104396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8d487bd-6e01-4d68-8cd7-8de43c95d06f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:24.104841 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8d487bd-6e01-4d68-8cd7-8de43c95d06f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:24.230053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8d487bd-6e01-4d68-8cd7-8de43c95d06f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:24.237653 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8d487bd-6e01-4d68-8cd7-8de43c95d06f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.146424 May 19 05:30:24.238251 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3180/6448] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:24 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:25.255521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cfd233ea-8dad-4cba-b3d1-08cb1e34391e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:25.256088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cfd233ea-8dad-4cba-b3d1-08cb1e34391e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:25.263142 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cfd233ea-8dad-4cba-b3d1-08cb1e34391e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:25.263612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cfd233ea-8dad-4cba-b3d1-08cb1e34391e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:25.264401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cfd233ea-8dad-4cba-b3d1-08cb1e34391e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:25.264850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cfd233ea-8dad-4cba-b3d1-08cb1e34391e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:25.411077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cfd233ea-8dad-4cba-b3d1-08cb1e34391e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:25.418682 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cfd233ea-8dad-4cba-b3d1-08cb1e34391e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.168060 May 19 05:30:25.419236 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3269/6449] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:25 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:26.436587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f76bd879-db8a-4cf4-b920-ba819cb68f9f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:26.437255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f76bd879-db8a-4cf4-b920-ba819cb68f9f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:26.444138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f76bd879-db8a-4cf4-b920-ba819cb68f9f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:26.444581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f76bd879-db8a-4cf4-b920-ba819cb68f9f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:26.445362 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f76bd879-db8a-4cf4-b920-ba819cb68f9f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:26.445805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f76bd879-db8a-4cf4-b920-ba819cb68f9f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:26.575807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f76bd879-db8a-4cf4-b920-ba819cb68f9f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:26.583954 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f76bd879-db8a-4cf4-b920-ba819cb68f9f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.151282 May 19 05:30:26.584483 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3181/6450] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:26 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:27.601162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b19bb6d3-2de6-49a7-b717-7a698bec826a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:27.601809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b19bb6d3-2de6-49a7-b717-7a698bec826a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:27.609214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b19bb6d3-2de6-49a7-b717-7a698bec826a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:27.609679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b19bb6d3-2de6-49a7-b717-7a698bec826a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:27.610455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b19bb6d3-2de6-49a7-b717-7a698bec826a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:27.610906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b19bb6d3-2de6-49a7-b717-7a698bec826a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:27.744258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b19bb6d3-2de6-49a7-b717-7a698bec826a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:27.752598 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b19bb6d3-2de6-49a7-b717-7a698bec826a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.155879 May 19 05:30:27.753184 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3270/6451] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:27 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:28.769718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-52422c85-84f4-4a27-8165-e5a8c2bc0c6e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:28.770389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-52422c85-84f4-4a27-8165-e5a8c2bc0c6e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:28.777322 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52422c85-84f4-4a27-8165-e5a8c2bc0c6e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:28.777774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52422c85-84f4-4a27-8165-e5a8c2bc0c6e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:28.778531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52422c85-84f4-4a27-8165-e5a8c2bc0c6e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:28.778965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-52422c85-84f4-4a27-8165-e5a8c2bc0c6e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:28.909450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-52422c85-84f4-4a27-8165-e5a8c2bc0c6e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:28.916947 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-52422c85-84f4-4a27-8165-e5a8c2bc0c6e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.151175 May 19 05:30:28.917632 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3182/6452] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:28 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:29.934269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d3556dfd-bd4e-4012-bcbe-e05fa65b082c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:29.934898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d3556dfd-bd4e-4012-bcbe-e05fa65b082c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:29.942560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3556dfd-bd4e-4012-bcbe-e05fa65b082c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:29.943027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3556dfd-bd4e-4012-bcbe-e05fa65b082c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:29.943804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3556dfd-bd4e-4012-bcbe-e05fa65b082c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:29.944258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3556dfd-bd4e-4012-bcbe-e05fa65b082c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:30.074024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d3556dfd-bd4e-4012-bcbe-e05fa65b082c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:30.081574 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d3556dfd-bd4e-4012-bcbe-e05fa65b082c tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.151259 May 19 05:30:30.082166 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3271/6453] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:29 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:31.099024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e3dfbb45-62a1-4234-b6cd-e23f1d363704 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:31.099672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e3dfbb45-62a1-4234-b6cd-e23f1d363704 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:31.107148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3dfbb45-62a1-4234-b6cd-e23f1d363704 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:31.107604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3dfbb45-62a1-4234-b6cd-e23f1d363704 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:31.108371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3dfbb45-62a1-4234-b6cd-e23f1d363704 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:31.108813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e3dfbb45-62a1-4234-b6cd-e23f1d363704 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:31.236943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e3dfbb45-62a1-4234-b6cd-e23f1d363704 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:31.246301 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e3dfbb45-62a1-4234-b6cd-e23f1d363704 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.150803 May 19 05:30:31.247078 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3183/6454] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:31 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:32.263761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4df7b519-020d-492d-880c-d3bb458e3c5f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:32.264394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4df7b519-020d-492d-880c-d3bb458e3c5f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:32.271296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4df7b519-020d-492d-880c-d3bb458e3c5f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:32.271765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4df7b519-020d-492d-880c-d3bb458e3c5f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:32.272544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4df7b519-020d-492d-880c-d3bb458e3c5f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:32.272995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4df7b519-020d-492d-880c-d3bb458e3c5f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:32.399928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4df7b519-020d-492d-880c-d3bb458e3c5f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:32.407428 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4df7b519-020d-492d-880c-d3bb458e3c5f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.147590 May 19 05:30:32.408006 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3272/6455] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:32 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:33.424724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5ced1b42-0909-4eac-86ce-eba3fdfca100 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:33.425378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5ced1b42-0909-4eac-86ce-eba3fdfca100 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:33.432340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ced1b42-0909-4eac-86ce-eba3fdfca100 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:33.432796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ced1b42-0909-4eac-86ce-eba3fdfca100 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:33.433604 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ced1b42-0909-4eac-86ce-eba3fdfca100 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:33.434046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5ced1b42-0909-4eac-86ce-eba3fdfca100 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:33.567791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5ced1b42-0909-4eac-86ce-eba3fdfca100 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:33.575309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5ced1b42-0909-4eac-86ce-eba3fdfca100 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.155447 May 19 05:30:33.575890 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3184/6456] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:33 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:34.592020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-858fff57-84d0-4a81-9a02-9dc4e093bbb1 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:34.592652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-858fff57-84d0-4a81-9a02-9dc4e093bbb1 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:34.599658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-858fff57-84d0-4a81-9a02-9dc4e093bbb1 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:34.600119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-858fff57-84d0-4a81-9a02-9dc4e093bbb1 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:34.600895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-858fff57-84d0-4a81-9a02-9dc4e093bbb1 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:34.601376 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-858fff57-84d0-4a81-9a02-9dc4e093bbb1 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:34.731894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-858fff57-84d0-4a81-9a02-9dc4e093bbb1 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:34.739404 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-858fff57-84d0-4a81-9a02-9dc4e093bbb1 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.151309 May 19 05:30:34.739977 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3273/6457] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:34 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:35.756919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1c4611e2-750c-4f75-93cb-d80f6395228a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:35.757559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1c4611e2-750c-4f75-93cb-d80f6395228a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:35.764553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c4611e2-750c-4f75-93cb-d80f6395228a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:35.765001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c4611e2-750c-4f75-93cb-d80f6395228a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:35.765786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c4611e2-750c-4f75-93cb-d80f6395228a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:35.766224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1c4611e2-750c-4f75-93cb-d80f6395228a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:35.901476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1c4611e2-750c-4f75-93cb-d80f6395228a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:35.908876 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1c4611e2-750c-4f75-93cb-d80f6395228a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.155858 May 19 05:30:35.909478 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3185/6458] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:35 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:36.925861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a4df1cfb-bc28-4b3e-aa99-536bbf3c5f1e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:36.926489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a4df1cfb-bc28-4b3e-aa99-536bbf3c5f1e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:36.934382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4df1cfb-bc28-4b3e-aa99-536bbf3c5f1e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:36.934857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4df1cfb-bc28-4b3e-aa99-536bbf3c5f1e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:36.935639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4df1cfb-bc28-4b3e-aa99-536bbf3c5f1e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:36.936096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4df1cfb-bc28-4b3e-aa99-536bbf3c5f1e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:37.065039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a4df1cfb-bc28-4b3e-aa99-536bbf3c5f1e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:37.072598 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a4df1cfb-bc28-4b3e-aa99-536bbf3c5f1e tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.150681 May 19 05:30:37.073194 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3274/6459] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:36 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:38.090371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-102ef5ff-f6be-43f0-b469-f194509dbbb3 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:38.090942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-102ef5ff-f6be-43f0-b469-f194509dbbb3 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:38.097938 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-102ef5ff-f6be-43f0-b469-f194509dbbb3 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:38.098400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-102ef5ff-f6be-43f0-b469-f194509dbbb3 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:38.099174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-102ef5ff-f6be-43f0-b469-f194509dbbb3 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:38.099617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-102ef5ff-f6be-43f0-b469-f194509dbbb3 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:38.226882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-102ef5ff-f6be-43f0-b469-f194509dbbb3 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:38.234705 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-102ef5ff-f6be-43f0-b469-f194509dbbb3 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.148379 May 19 05:30:38.235285 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3186/6460] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:38 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:39.251792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc9431be-fec2-4cbb-b1f0-d20c48216dcf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:39.252477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bc9431be-fec2-4cbb-b1f0-d20c48216dcf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:39.259444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc9431be-fec2-4cbb-b1f0-d20c48216dcf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:39.259907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc9431be-fec2-4cbb-b1f0-d20c48216dcf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:39.260687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc9431be-fec2-4cbb-b1f0-d20c48216dcf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:39.261164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc9431be-fec2-4cbb-b1f0-d20c48216dcf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:39.398558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bc9431be-fec2-4cbb-b1f0-d20c48216dcf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:39.406144 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bc9431be-fec2-4cbb-b1f0-d20c48216dcf tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.158359 May 19 05:30:39.406720 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3275/6461] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:39 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:40.423188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9354428c-125a-489e-98f5-1135f9ad3ac9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:40.423793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9354428c-125a-489e-98f5-1135f9ad3ac9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:40.430760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9354428c-125a-489e-98f5-1135f9ad3ac9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:40.431207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9354428c-125a-489e-98f5-1135f9ad3ac9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:40.431965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9354428c-125a-489e-98f5-1135f9ad3ac9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:40.432402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9354428c-125a-489e-98f5-1135f9ad3ac9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:40.557969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9354428c-125a-489e-98f5-1135f9ad3ac9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:40.568573 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9354428c-125a-489e-98f5-1135f9ad3ac9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.149245 May 19 05:30:40.569181 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3187/6462] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:40 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:41.586171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bd7b7eb3-1723-4013-a1e3-81dd91f4ea82 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:41.586728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bd7b7eb3-1723-4013-a1e3-81dd91f4ea82 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:41.596036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd7b7eb3-1723-4013-a1e3-81dd91f4ea82 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:41.596500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd7b7eb3-1723-4013-a1e3-81dd91f4ea82 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:41.597314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd7b7eb3-1723-4013-a1e3-81dd91f4ea82 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:41.598417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bd7b7eb3-1723-4013-a1e3-81dd91f4ea82 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:41.731781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bd7b7eb3-1723-4013-a1e3-81dd91f4ea82 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:41.739444 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bd7b7eb3-1723-4013-a1e3-81dd91f4ea82 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.157886 May 19 05:30:41.740007 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3276/6463] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:41 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:42.755885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4cc90b4-be2d-4e1f-a773-f45172118794 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:42.756541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f4cc90b4-be2d-4e1f-a773-f45172118794 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:42.763737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4cc90b4-be2d-4e1f-a773-f45172118794 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:42.764185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4cc90b4-be2d-4e1f-a773-f45172118794 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:42.764950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4cc90b4-be2d-4e1f-a773-f45172118794 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:42.765427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4cc90b4-be2d-4e1f-a773-f45172118794 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:42.900889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4cc90b4-be2d-4e1f-a773-f45172118794 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:42.908527 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4cc90b4-be2d-4e1f-a773-f45172118794 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.156596 May 19 05:30:42.909139 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3188/6464] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:42 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:43.926279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d1d09f5b-f914-441f-a1bc-400479c5c496 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:43.926960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d1d09f5b-f914-441f-a1bc-400479c5c496 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:43.934176 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1d09f5b-f914-441f-a1bc-400479c5c496 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:43.934638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1d09f5b-f914-441f-a1bc-400479c5c496 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:43.935412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1d09f5b-f914-441f-a1bc-400479c5c496 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:43.935865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1d09f5b-f914-441f-a1bc-400479c5c496 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:44.064925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d1d09f5b-f914-441f-a1bc-400479c5c496 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:44.072970 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d1d09f5b-f914-441f-a1bc-400479c5c496 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.150720 May 19 05:30:44.073565 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3277/6465] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:43 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:45.089844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-19eeee7f-11a9-4862-b096-9323448ba305 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:45.090498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-19eeee7f-11a9-4862-b096-9323448ba305 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:45.099734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19eeee7f-11a9-4862-b096-9323448ba305 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:45.100196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19eeee7f-11a9-4862-b096-9323448ba305 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:45.100971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19eeee7f-11a9-4862-b096-9323448ba305 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:45.101441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-19eeee7f-11a9-4862-b096-9323448ba305 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:45.228476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-19eeee7f-11a9-4862-b096-9323448ba305 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:45.236002 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-19eeee7f-11a9-4862-b096-9323448ba305 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1515 microversion: 2.1 time: 0.150107 May 19 05:30:45.236616 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3189/6466] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:45 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:46.253098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da574702-e15c-4dc1-a0e6-e39a0644bd2f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:46.253819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da574702-e15c-4dc1-a0e6-e39a0644bd2f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:46.260664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da574702-e15c-4dc1-a0e6-e39a0644bd2f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:46.261161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da574702-e15c-4dc1-a0e6-e39a0644bd2f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:46.261946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da574702-e15c-4dc1-a0e6-e39a0644bd2f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:46.262396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da574702-e15c-4dc1-a0e6-e39a0644bd2f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:46.401280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-da574702-e15c-4dc1-a0e6-e39a0644bd2f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:46.414441 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da574702-e15c-4dc1-a0e6-e39a0644bd2f tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1514 microversion: 2.1 time: 0.165094 May 19 05:30:46.415418 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3278/6467] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:46 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:46.770227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8a2e36ee-8a46-453e-bca1-5188ce22198c req-5da4954f-3cb9-4c0a-8c00-55f9faa91781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63e7f9e-1e9a-4530-b9ad-e3c15beff906", "name": "network-vif-unplugged", "status": "completed", "tag": "f06ce3f8-b683-4870-8c96-5825bad8d69e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:46.773772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=30 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:46.779821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8a2e36ee-8a46-453e-bca1-5188ce22198c req-5da4954f-3cb9-4c0a-8c00-55f9faa91781 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:46.780271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8a2e36ee-8a46-453e-bca1-5188ce22198c req-5da4954f-3cb9-4c0a-8c00-55f9faa91781 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:46.784218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=86 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:46.792975 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8a2e36ee-8a46-453e-bca1-5188ce22198c req-5da4954f-3cb9-4c0a-8c00-55f9faa91781 service nova] Creating event network-vif-unplugged:f06ce3f8-b683-4870-8c96-5825bad8d69e for instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 on n-h1-766726-30 May 19 05:30:46.798814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-8a2e36ee-8a46-453e-bca1-5188ce22198c req-5da4954f-3cb9-4c0a-8c00-55f9faa91781 service nova] Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:30:46.810226 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8a2e36ee-8a46-453e-bca1-5188ce22198c req-5da4954f-3cb9-4c0a-8c00-55f9faa91781 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119971 May 19 05:30:46.810854 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3190/6468] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:47.432348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03d074f3-ed9c-4a0c-8eb1-0a879b6046cb tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:47.432983 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-03d074f3-ed9c-4a0c-8eb1-0a879b6046cb tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:47.435713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=32 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:47.441777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03d074f3-ed9c-4a0c-8eb1-0a879b6046cb tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:47.442175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03d074f3-ed9c-4a0c-8eb1-0a879b6046cb tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:47.442960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03d074f3-ed9c-4a0c-8eb1-0a879b6046cb tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:47.443411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03d074f3-ed9c-4a0c-8eb1-0a879b6046cb tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:47.447773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:30:47.578261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03d074f3-ed9c-4a0c-8eb1-0a879b6046cb tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:47.586416 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-03d074f3-ed9c-4a0c-8eb1-0a879b6046cb tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1514 microversion: 2.1 time: 0.158055 May 19 05:30:47.586993 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3279/6469] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:47 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:30:48.604970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48c8f380-5e71-47cc-ade4-79541d875c37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:48.605705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-48c8f380-5e71-47cc-ade4-79541d875c37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:48.611928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48c8f380-5e71-47cc-ade4-79541d875c37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:48.612377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48c8f380-5e71-47cc-ade4-79541d875c37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:48.613765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48c8f380-5e71-47cc-ade4-79541d875c37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:48.614215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48c8f380-5e71-47cc-ade4-79541d875c37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:48.751789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-48c8f380-5e71-47cc-ade4-79541d875c37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:48.759471 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-48c8f380-5e71-47cc-ade4-79541d875c37 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1512 microversion: 2.1 time: 0.159917 May 19 05:30:48.760053 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3191/6470] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:48 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:48.825199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b8fda346-5cfc-4492-9e68-57608743d03b req-6bd4aa4f-4647-4490-9986-5f0b1f09f1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b63e7f9e-1e9a-4530-b9ad-e3c15beff906", "tag": "f06ce3f8-b683-4870-8c96-5825bad8d69e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:48.834206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b8fda346-5cfc-4492-9e68-57608743d03b req-6bd4aa4f-4647-4490-9986-5f0b1f09f1c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:48.834670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b8fda346-5cfc-4492-9e68-57608743d03b req-6bd4aa4f-4647-4490-9986-5f0b1f09f1c1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:48.849741 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b8fda346-5cfc-4492-9e68-57608743d03b req-6bd4aa4f-4647-4490-9986-5f0b1f09f1c1 service nova] Creating event network-changed:f06ce3f8-b683-4870-8c96-5825bad8d69e for instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 on n-h1-766726-30 May 19 05:30:48.855596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-b8fda346-5cfc-4492-9e68-57608743d03b req-6bd4aa4f-4647-4490-9986-5f0b1f09f1c1 service nova] Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:30:48.866767 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b8fda346-5cfc-4492-9e68-57608743d03b req-6bd4aa4f-4647-4490-9986-5f0b1f09f1c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045380 May 19 05:30:48.867385 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3280/6471] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:49.775873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1061b0b-29cd-4bee-bbd2-df5614d3d103 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:49.776502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1061b0b-29cd-4bee-bbd2-df5614d3d103 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:49.783709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1061b0b-29cd-4bee-bbd2-df5614d3d103 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:49.784170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1061b0b-29cd-4bee-bbd2-df5614d3d103 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:49.784982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1061b0b-29cd-4bee-bbd2-df5614d3d103 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:49.785454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1061b0b-29cd-4bee-bbd2-df5614d3d103 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:49.917829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1061b0b-29cd-4bee-bbd2-df5614d3d103 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:49.925391 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1061b0b-29cd-4bee-bbd2-df5614d3d103 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1509 microversion: 2.1 time: 0.153471 May 19 05:30:49.926484 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3192/6472] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:49 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:49.944121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a435a49-d551-4577-a41c-06e3a318261a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:49.944726 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1a435a49-d551-4577-a41c-06e3a318261a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:49.951139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a435a49-d551-4577-a41c-06e3a318261a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:49.951611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a435a49-d551-4577-a41c-06e3a318261a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:49.952401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a435a49-d551-4577-a41c-06e3a318261a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:49.952859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a435a49-d551-4577-a41c-06e3a318261a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:49.978282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1a435a49-d551-4577-a41c-06e3a318261a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:30:50.028292 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-1a435a49-d551-4577-a41c-06e3a318261a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Found an unconfirmed migration during delete, id: 16, status: finished May 19 05:30:51.268446 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1a435a49-d551-4577-a41c-06e3a318261a tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 204 len: 0 microversion: 2.1 time: 1.329719 May 19 05:30:51.269756 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3281/6473] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:30:49 2022] DELETE /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 0 bytes in 1331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:30:51.277859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d3ee343b-5f33-4bf6-bbd5-8ca410794a66 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:51.278475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d3ee343b-5f33-4bf6-bbd5-8ca410794a66 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:51.285969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3ee343b-5f33-4bf6-bbd5-8ca410794a66 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:51.286418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3ee343b-5f33-4bf6-bbd5-8ca410794a66 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:51.287176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3ee343b-5f33-4bf6-bbd5-8ca410794a66 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:51.287641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d3ee343b-5f33-4bf6-bbd5-8ca410794a66 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:51.418918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d3ee343b-5f33-4bf6-bbd5-8ca410794a66 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:51.426731 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d3ee343b-5f33-4bf6-bbd5-8ca410794a66 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1501 microversion: 2.1 time: 0.152817 May 19 05:30:51.427421 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3193/6474] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:51 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:51.758126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0ed0ea40-7869-41c4-9a2c-8b7cfc497361 req-c8e4ba86-9e55-4dcb-8174-3193c64b2113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63e7f9e-1e9a-4530-b9ad-e3c15beff906", "name": "network-vif-plugged", "status": "completed", "tag": "f06ce3f8-b683-4870-8c96-5825bad8d69e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:51.766665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0ed0ea40-7869-41c4-9a2c-8b7cfc497361 req-c8e4ba86-9e55-4dcb-8174-3193c64b2113 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:51.768011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0ed0ea40-7869-41c4-9a2c-8b7cfc497361 req-c8e4ba86-9e55-4dcb-8174-3193c64b2113 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:51.780170 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0ed0ea40-7869-41c4-9a2c-8b7cfc497361 req-c8e4ba86-9e55-4dcb-8174-3193c64b2113 service nova] Creating event network-vif-plugged:f06ce3f8-b683-4870-8c96-5825bad8d69e for instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 on n-h1-766726-30 May 19 05:30:51.785241 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0ed0ea40-7869-41c4-9a2c-8b7cfc497361 req-c8e4ba86-9e55-4dcb-8174-3193c64b2113 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 May 19 05:30:51.785860 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3282/6475] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:52.443773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0fb61bd4-2869-40cb-a9a4-f1891da5ed17 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:52.444401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0fb61bd4-2869-40cb-a9a4-f1891da5ed17 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:52.450781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fb61bd4-2869-40cb-a9a4-f1891da5ed17 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:52.451235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fb61bd4-2869-40cb-a9a4-f1891da5ed17 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:52.451996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fb61bd4-2869-40cb-a9a4-f1891da5ed17 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:52.452444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fb61bd4-2869-40cb-a9a4-f1891da5ed17 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:52.585684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0fb61bd4-2869-40cb-a9a4-f1891da5ed17 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425e0ef5a34c4dbebd4e19b19b338d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c94b5abcd5417fb8ca4acfa594668e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:52.593422 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0fb61bd4-2869-40cb-a9a4-f1891da5ed17 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 200 len: 1501 microversion: 2.1 time: 0.153495 May 19 05:30:52.594004 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3194/6476] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:52 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:53.151752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5698b933-c110-47a1-b5f1-cd24dfb76015 req-96728ab3-6197-4250-9cb9-b2a99c542832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63e7f9e-1e9a-4530-b9ad-e3c15beff906", "name": "network-vif-deleted", "tag": "f06ce3f8-b683-4870-8c96-5825bad8d69e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:53.160733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5698b933-c110-47a1-b5f1-cd24dfb76015 req-96728ab3-6197-4250-9cb9-b2a99c542832 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:53.161227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5698b933-c110-47a1-b5f1-cd24dfb76015 req-96728ab3-6197-4250-9cb9-b2a99c542832 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:53.173089 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5698b933-c110-47a1-b5f1-cd24dfb76015 req-96728ab3-6197-4250-9cb9-b2a99c542832 service nova] Creating event network-vif-deleted:f06ce3f8-b683-4870-8c96-5825bad8d69e for instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 on n-h1-766726-30 May 19 05:30:53.178308 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5698b933-c110-47a1-b5f1-cd24dfb76015 req-96728ab3-6197-4250-9cb9-b2a99c542832 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031784 May 19 05:30:53.178952 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3283/6477] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:30:53.611042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:53.611668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:53.619555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:53.620012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:53.620782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:53.621257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:53.638106 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] HTTP exception thrown: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Request method failure captured: May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 HTTP/1.1 May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdXeoblwWf4TZEsoJlg_5GszdEK5OL4kJDYeZrExEdBuGxUPRMJPCfokhcedgw_2e8nSHOYUvHeFYFYC9oNUykOt6sdw2-09M50ZkPwmBTD9HvyKrOhM3fDNbSleAI42I76XsByi23P6r2hg1TLCxJIXfbnPMtcTicPwMh3McHfCKeU May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 79c94b5abcd5417fb8ca4acfa594668e May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-663395461 May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-663395461 May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 79c94b5abcd5417fb8ca4acfa594668e May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-663395461 May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-663395461-project May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 425e0ef5a34c4dbebd4e19b19b338d89 May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-663395461-project May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b63e7f9e-1e9a-4530-b9ad-e3c15beff906'} May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:53.639767 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Returning 404 to user: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-40d78c0c-a8bc-4c43-8db0-f6d16f48d207 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 404 len: 111 microversion: 2.1 time: 0.034096 May 19 05:30:53.644928 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3195/6478] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:53 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 05:30:53.658846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:53.659448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:53.666129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:53.666591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:53.667360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:53.667810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:53.681389 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] HTTP exception thrown: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Request method failure captured: May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 HTTP/1.1 May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdXeoblwWf4TZEsoJlg_5GszdEK5OL4kJDYeZrExEdBuGxUPRMJPCfokhcedgw_2e8nSHOYUvHeFYFYC9oNUykOt6sdw2-09M50ZkPwmBTD9HvyKrOhM3fDNbSleAI42I76XsByi23P6r2hg1TLCxJIXfbnPMtcTicPwMh3McHfCKeU May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 79c94b5abcd5417fb8ca4acfa594668e May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-DeleteServersTestJSON-663395461 May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-DeleteServersTestJSON-663395461 May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 79c94b5abcd5417fb8ca4acfa594668e May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-DeleteServersTestJSON-663395461 May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-DeleteServersTestJSON-663395461-project May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 425e0ef5a34c4dbebd4e19b19b338d89 May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-DeleteServersTestJSON-663395461-project May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'b63e7f9e-1e9a-4530-b9ad-e3c15beff906'} May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:30:53.683026 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Returning 404 to user: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b9b66691-1d1c-4be1-b358-1ae550f5d4a9 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 404 len: 111 microversion: 2.1 time: 0.031599 May 19 05:30:53.688193 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3284/6479] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:30:53 2022] DELETE /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:30:53.693608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:53.694228 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] [instance: b63e7f9e-1e9a-4530-b9ad-e3c15beff906] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:53.700345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:53.700809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:53.701588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:53.702038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:53.715333 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] HTTP exception thrown: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Request method failure captured: May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 HTTP/1.1 May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdXeoblwWf4TZEsoJlg_5GszdEK5OL4kJDYeZrExEdBuGxUPRMJPCfokhcedgw_2e8nSHOYUvHeFYFYC9oNUykOt6sdw2-09M50ZkPwmBTD9HvyKrOhM3fDNbSleAI42I76XsByi23P6r2hg1TLCxJIXfbnPMtcTicPwMh3McHfCKeU May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 79c94b5abcd5417fb8ca4acfa594668e May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-DeleteServersTestJSON-663395461 May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79c94b5abcd5417fb8ca4acfa594668e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-DeleteServersTestJSON-663395461 May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 79c94b5abcd5417fb8ca4acfa594668e May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-DeleteServersTestJSON-663395461 May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-DeleteServersTestJSON-663395461-project May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 425e0ef5a34c4dbebd4e19b19b338d89 May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-DeleteServersTestJSON-663395461-project May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'b63e7f9e-1e9a-4530-b9ad-e3c15beff906'} May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:30:53.716815 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] Returning 404 to user: Instance b63e7f9e-1e9a-4530-b9ad-e3c15beff906 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ee69419c-026e-423a-8dcc-ed6eb9f8d940 tempest-DeleteServersTestJSON-663395461 tempest-DeleteServersTestJSON-663395461-project] 10.222.0.58 "GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906" status: 404 len: 111 microversion: 2.1 time: 0.029210 May 19 05:30:53.721095 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3196/6480] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:53 2022] GET /compute/v2.1/servers/b63e7f9e-1e9a-4530-b9ad-e3c15beff906 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:30:56.209811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1516902980", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "617e30ab-42ec-42bd-84f5-6d9db9c56f0d"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:56.261314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] validate_networks() for [('617e30ab-42ec-42bd-84f5-6d9db9c56f0d', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:30:56.606065 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:30:56.606507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:30:56.607006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:30:56.607430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:30:56.607857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:30:56.620126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:56.620590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:56.621481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:56.621933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:56.641449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Getting quotas for project d7eb6e516fb642ad905fa2d3078bb18d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:30:56.647239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Getting quotas for user f54b4e32337742298147bb652c0b01ed and project d7eb6e516fb642ad905fa2d3078bb18d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:30:56.659586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:30:56.662190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:30:56.707133 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a756d393-6e86-4e95-8a70-14ac85d654c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612105 May 19 05:30:56.707786 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3285/6481] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:30:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:30:56.718024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ea13c7e8-e0eb-4c1d-94d0-91e3dc7d1d95 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:56.718661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ea13c7e8-e0eb-4c1d-94d0-91e3dc7d1d95 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:56.777886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ea13c7e8-e0eb-4c1d-94d0-91e3dc7d1d95 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:56.789398 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ea13c7e8-e0eb-4c1d-94d0-91e3dc7d1d95 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1218 microversion: 2.1 time: 0.075246 May 19 05:30:56.789986 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3197/6482] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:56 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:57.807070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8517f904-d067-4266-bc8d-a3645e56ba66 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:57.807732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8517f904-d067-4266-bc8d-a3645e56ba66 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:57.813879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8517f904-d067-4266-bc8d-a3645e56ba66 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:57.814346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8517f904-d067-4266-bc8d-a3645e56ba66 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:57.815127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8517f904-d067-4266-bc8d-a3645e56ba66 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:57.815592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8517f904-d067-4266-bc8d-a3645e56ba66 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:57.877847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8517f904-d067-4266-bc8d-a3645e56ba66 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:57.886107 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8517f904-d067-4266-bc8d-a3645e56ba66 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1214 microversion: 2.1 time: 0.083910 May 19 05:30:57.886684 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3286/6483] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:57 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:58.902988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00100c12-68ab-446e-a840-8253cade3d58 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:30:58.903694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00100c12-68ab-446e-a840-8253cade3d58 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:30:58.912821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00100c12-68ab-446e-a840-8253cade3d58 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:58.913343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00100c12-68ab-446e-a840-8253cade3d58 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:58.914141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00100c12-68ab-446e-a840-8253cade3d58 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:58.914592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00100c12-68ab-446e-a840-8253cade3d58 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:59.048484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-00100c12-68ab-446e-a840-8253cade3d58 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:30:59.056837 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00100c12-68ab-446e-a840-8253cade3d58 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1318 microversion: 2.1 time: 0.158040 May 19 05:30:59.057447 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3198/6484] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:30:58 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:30:59.589469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-ad057ede-201c-4f13-bbb9-c225411678d1 req-e45c0909-668c-4de8-ad5e-461504579cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94b9ce6d-c236-477e-9d86-ee7619dc334e", "tag": "e9e78586-10b6-46b4-9f4b-b9e121935c3e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:30:59.600858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ad057ede-201c-4f13-bbb9-c225411678d1 req-e45c0909-668c-4de8-ad5e-461504579cb0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:30:59.601474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-ad057ede-201c-4f13-bbb9-c225411678d1 req-e45c0909-668c-4de8-ad5e-461504579cb0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:30:59.618406 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-ad057ede-201c-4f13-bbb9-c225411678d1 req-e45c0909-668c-4de8-ad5e-461504579cb0 service nova] Creating event network-changed:e9e78586-10b6-46b4-9f4b-b9e121935c3e for instance 94b9ce6d-c236-477e-9d86-ee7619dc334e on n-h1-766726-30 May 19 05:30:59.623320 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-ad057ede-201c-4f13-bbb9-c225411678d1 req-e45c0909-668c-4de8-ad5e-461504579cb0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039327 May 19 05:30:59.623947 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3287/6485] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:31:00.074399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3e1aa1bd-7b1a-42d5-bc65-438562125444 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:00.075013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3e1aa1bd-7b1a-42d5-bc65-438562125444 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:00.082345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e1aa1bd-7b1a-42d5-bc65-438562125444 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:00.083022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e1aa1bd-7b1a-42d5-bc65-438562125444 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:00.084136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e1aa1bd-7b1a-42d5-bc65-438562125444 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:00.084585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e1aa1bd-7b1a-42d5-bc65-438562125444 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:00.215115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3e1aa1bd-7b1a-42d5-bc65-438562125444 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:00.223348 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3e1aa1bd-7b1a-42d5-bc65-438562125444 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1318 microversion: 2.1 time: 0.152918 May 19 05:31:00.223919 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3199/6486] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:00 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:01.242398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-67ba70a7-275a-4a82-8972-b12e418ea01b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:01.243150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-67ba70a7-275a-4a82-8972-b12e418ea01b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:01.249493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67ba70a7-275a-4a82-8972-b12e418ea01b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:01.249959 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67ba70a7-275a-4a82-8972-b12e418ea01b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:01.250742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67ba70a7-275a-4a82-8972-b12e418ea01b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:01.251195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-67ba70a7-275a-4a82-8972-b12e418ea01b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:01.397896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-67ba70a7-275a-4a82-8972-b12e418ea01b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:01.405840 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-67ba70a7-275a-4a82-8972-b12e418ea01b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1318 microversion: 2.1 time: 0.169106 May 19 05:31:01.406435 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3288/6487] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:01 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:02.423382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69d4e350-bf75-4bd3-9c08-5ba20a73676c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:02.424007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-69d4e350-bf75-4bd3-9c08-5ba20a73676c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:02.431441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69d4e350-bf75-4bd3-9c08-5ba20a73676c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:02.431898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69d4e350-bf75-4bd3-9c08-5ba20a73676c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:02.432666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69d4e350-bf75-4bd3-9c08-5ba20a73676c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:02.433136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69d4e350-bf75-4bd3-9c08-5ba20a73676c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:02.559846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69d4e350-bf75-4bd3-9c08-5ba20a73676c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:02.568083 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69d4e350-bf75-4bd3-9c08-5ba20a73676c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1318 microversion: 2.1 time: 0.148594 May 19 05:31:02.568668 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3200/6488] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:02 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:03.585801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3d553977-25a8-4b1e-b191-c3f0e3132039 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:03.586454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3d553977-25a8-4b1e-b191-c3f0e3132039 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:03.593437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d553977-25a8-4b1e-b191-c3f0e3132039 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:03.593903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d553977-25a8-4b1e-b191-c3f0e3132039 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:03.594683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d553977-25a8-4b1e-b191-c3f0e3132039 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:03.595134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d553977-25a8-4b1e-b191-c3f0e3132039 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:03.732648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3d553977-25a8-4b1e-b191-c3f0e3132039 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:03.741876 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3d553977-25a8-4b1e-b191-c3f0e3132039 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1318 microversion: 2.1 time: 0.160549 May 19 05:31:03.745136 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3289/6489] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:03 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:03.814477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-09a3bf4a-3adc-4168-a0a3-6f5524fe1acf req-dca2ecbd-e001-4ce8-bfc8-98fd9d3680f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b9ce6d-c236-477e-9d86-ee7619dc334e", "name": "network-vif-plugged", "status": "completed", "tag": "e9e78586-10b6-46b4-9f4b-b9e121935c3e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:03.824294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-09a3bf4a-3adc-4168-a0a3-6f5524fe1acf req-dca2ecbd-e001-4ce8-bfc8-98fd9d3680f8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:03.824947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-09a3bf4a-3adc-4168-a0a3-6f5524fe1acf req-dca2ecbd-e001-4ce8-bfc8-98fd9d3680f8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:03.836996 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-09a3bf4a-3adc-4168-a0a3-6f5524fe1acf req-dca2ecbd-e001-4ce8-bfc8-98fd9d3680f8 service nova] Creating event network-vif-plugged:e9e78586-10b6-46b4-9f4b-b9e121935c3e for instance 94b9ce6d-c236-477e-9d86-ee7619dc334e on n-h1-766726-30 May 19 05:31:03.841971 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-09a3bf4a-3adc-4168-a0a3-6f5524fe1acf req-dca2ecbd-e001-4ce8-bfc8-98fd9d3680f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031244 May 19 05:31:03.842571 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3201/6490] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:31:04.759722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dee13afe-1c0c-4765-906b-7bafd383d14e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:04.760358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dee13afe-1c0c-4765-906b-7bafd383d14e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:04.767279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dee13afe-1c0c-4765-906b-7bafd383d14e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:04.767744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dee13afe-1c0c-4765-906b-7bafd383d14e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:04.768527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dee13afe-1c0c-4765-906b-7bafd383d14e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:04.768984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dee13afe-1c0c-4765-906b-7bafd383d14e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:04.894461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dee13afe-1c0c-4765-906b-7bafd383d14e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:04.902104 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dee13afe-1c0c-4765-906b-7bafd383d14e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1318 microversion: 2.1 time: 0.146386 May 19 05:31:04.902677 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3290/6491] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:04 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:05.920099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f70080f-7076-4e2b-8b6c-966ca9598827 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:05.920816 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7f70080f-7076-4e2b-8b6c-966ca9598827 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:05.927126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f70080f-7076-4e2b-8b6c-966ca9598827 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:05.927518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f70080f-7076-4e2b-8b6c-966ca9598827 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:05.928274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f70080f-7076-4e2b-8b6c-966ca9598827 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:05.928710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f70080f-7076-4e2b-8b6c-966ca9598827 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.058389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7f70080f-7076-4e2b-8b6c-966ca9598827 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:06.066416 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7f70080f-7076-4e2b-8b6c-966ca9598827 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1508 microversion: 2.1 time: 0.150860 May 19 05:31:06.066988 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3202/6492] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:05 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:06.083492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2e3ae82c-fc34-4df5-b404-5574aad65601 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:06.084160 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2e3ae82c-fc34-4df5-b404-5574aad65601 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:06.091071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e3ae82c-fc34-4df5-b404-5574aad65601 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.091540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e3ae82c-fc34-4df5-b404-5574aad65601 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.092330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e3ae82c-fc34-4df5-b404-5574aad65601 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.092786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e3ae82c-fc34-4df5-b404-5574aad65601 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.220611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2e3ae82c-fc34-4df5-b404-5574aad65601 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:06.228403 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2e3ae82c-fc34-4df5-b404-5574aad65601 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1508 microversion: 2.1 time: 0.149917 May 19 05:31:06.228982 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3291/6493] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:06 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:06.244766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-58122e0d-ba23-4b4a-a4f0-82cdf3d0c47c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:06.246031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-58122e0d-ba23-4b4a-a4f0-82cdf3d0c47c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:06.252130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58122e0d-ba23-4b4a-a4f0-82cdf3d0c47c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.252581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58122e0d-ba23-4b4a-a4f0-82cdf3d0c47c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.254000 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58122e0d-ba23-4b4a-a4f0-82cdf3d0c47c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.254452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-58122e0d-ba23-4b4a-a4f0-82cdf3d0c47c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.324194 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-58122e0d-ba23-4b4a-a4f0-82cdf3d0c47c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "PUT /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1080 microversion: 2.1 time: 0.083541 May 19 05:31:06.333228 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3203/6494] 10.222.0.58 () {60 vars in 1255 bytes} [Thu May 19 05:31:06 2022] PUT /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1080 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:06.338547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a2d024d-b70e-4309-8830-fc6daa0b6037 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:06.339182 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a2d024d-b70e-4309-8830-fc6daa0b6037 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:06.345660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a2d024d-b70e-4309-8830-fc6daa0b6037 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.346134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a2d024d-b70e-4309-8830-fc6daa0b6037 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.346918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a2d024d-b70e-4309-8830-fc6daa0b6037 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.347373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a2d024d-b70e-4309-8830-fc6daa0b6037 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.478723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a2d024d-b70e-4309-8830-fc6daa0b6037 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:06.486246 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a2d024d-b70e-4309-8830-fc6daa0b6037 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1506 microversion: 2.1 time: 0.151615 May 19 05:31:06.486822 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3292/6495] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:06 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:06.502379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1a2d0926-bab6-46a2-9ca4-bc8c38ee84ba tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:06.502992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1a2d0926-bab6-46a2-9ca4-bc8c38ee84ba tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:06.509626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a2d0926-bab6-46a2-9ca4-bc8c38ee84ba tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.510083 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a2d0926-bab6-46a2-9ca4-bc8c38ee84ba tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.510852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a2d0926-bab6-46a2-9ca4-bc8c38ee84ba tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.511298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1a2d0926-bab6-46a2-9ca4-bc8c38ee84ba tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.635522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1a2d0926-bab6-46a2-9ca4-bc8c38ee84ba tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:06.643101 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1a2d0926-bab6-46a2-9ca4-bc8c38ee84ba tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1506 microversion: 2.1 time: 0.144602 May 19 05:31:06.643688 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3204/6496] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:06 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1506 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:31:06.658970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:06.660519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:06.662548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:06.663338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:06.669770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.670239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.671012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.671464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.699910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:06.706146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Old instance type m1.heat2, new instance type m1.heat {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:31:06.712336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:31:06.712811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:31:06.713336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:31:06.713763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:31:06.714188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:31:06.779594 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ddf882fd-763b-45e1-ba5c-39363df23740 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "POST /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e/action" status: 202 len: 0 microversion: 2.1 time: 0.124475 May 19 05:31:06.780118 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3293/6497] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:31:06 2022] POST /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:31:06.788742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3735130-0709-4d00-a8f8-b52721b15a28 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:06.789394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3735130-0709-4d00-a8f8-b52721b15a28 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:06.792013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:06.797223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3735130-0709-4d00-a8f8-b52721b15a28 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.797678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3735130-0709-4d00-a8f8-b52721b15a28 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.798458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3735130-0709-4d00-a8f8-b52721b15a28 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:06.798901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3735130-0709-4d00-a8f8-b52721b15a28 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:06.954137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3735130-0709-4d00-a8f8-b52721b15a28 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:06.963272 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3735130-0709-4d00-a8f8-b52721b15a28 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1517 microversion: 2.1 time: 0.178903 May 19 05:31:06.963992 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3205/6498] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:06 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:31:07.982942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-23309c71-0ffb-40d8-9b69-9ce36fe24353 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:07.983485 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-23309c71-0ffb-40d8-9b69-9ce36fe24353 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:07.989667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23309c71-0ffb-40d8-9b69-9ce36fe24353 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:07.990130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23309c71-0ffb-40d8-9b69-9ce36fe24353 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:07.990914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23309c71-0ffb-40d8-9b69-9ce36fe24353 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:07.991370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23309c71-0ffb-40d8-9b69-9ce36fe24353 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:08.122607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23309c71-0ffb-40d8-9b69-9ce36fe24353 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:08.130805 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-23309c71-0ffb-40d8-9b69-9ce36fe24353 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1517 microversion: 2.1 time: 0.152730 May 19 05:31:08.131385 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3294/6499] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:07 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:09.148056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-388176cd-72ac-4c3a-b64f-7c64c11dbd56 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:09.148679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-388176cd-72ac-4c3a-b64f-7c64c11dbd56 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:09.155743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388176cd-72ac-4c3a-b64f-7c64c11dbd56 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:09.156200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388176cd-72ac-4c3a-b64f-7c64c11dbd56 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:09.156969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388176cd-72ac-4c3a-b64f-7c64c11dbd56 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:09.157441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-388176cd-72ac-4c3a-b64f-7c64c11dbd56 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:09.287932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-388176cd-72ac-4c3a-b64f-7c64c11dbd56 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:09.295577 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-388176cd-72ac-4c3a-b64f-7c64c11dbd56 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.152149 May 19 05:31:09.296160 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3206/6500] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:09 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:31:10.312632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-42eafd1f-0f6c-4c28-bee4-7d30e78908f3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:10.313298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-42eafd1f-0f6c-4c28-bee4-7d30e78908f3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:10.320952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42eafd1f-0f6c-4c28-bee4-7d30e78908f3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:10.321458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42eafd1f-0f6c-4c28-bee4-7d30e78908f3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:10.322245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42eafd1f-0f6c-4c28-bee4-7d30e78908f3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:10.322706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42eafd1f-0f6c-4c28-bee4-7d30e78908f3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:10.449908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-42eafd1f-0f6c-4c28-bee4-7d30e78908f3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:10.452143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:10.459907 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-42eafd1f-0f6c-4c28-bee4-7d30e78908f3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.151295 May 19 05:31:10.460479 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3295/6501] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:10 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:11.477295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d9bd26d-528b-42ff-9226-d763f73a0344 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:11.477918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1d9bd26d-528b-42ff-9226-d763f73a0344 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:11.484862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d9bd26d-528b-42ff-9226-d763f73a0344 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:11.485356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d9bd26d-528b-42ff-9226-d763f73a0344 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:11.486121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d9bd26d-528b-42ff-9226-d763f73a0344 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:11.486563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d9bd26d-528b-42ff-9226-d763f73a0344 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:11.618047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1d9bd26d-528b-42ff-9226-d763f73a0344 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:11.625716 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d9bd26d-528b-42ff-9226-d763f73a0344 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.152658 May 19 05:31:11.626292 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3207/6502] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:11 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:12.643172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1abcd05-3ba3-46d3-93b8-3abd4b730c6d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:12.644432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1abcd05-3ba3-46d3-93b8-3abd4b730c6d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:12.652249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1abcd05-3ba3-46d3-93b8-3abd4b730c6d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:12.652714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1abcd05-3ba3-46d3-93b8-3abd4b730c6d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:12.653532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1abcd05-3ba3-46d3-93b8-3abd4b730c6d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:12.653986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1abcd05-3ba3-46d3-93b8-3abd4b730c6d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:12.785157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1abcd05-3ba3-46d3-93b8-3abd4b730c6d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:12.792710 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1abcd05-3ba3-46d3-93b8-3abd4b730c6d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.153874 May 19 05:31:12.793312 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3296/6503] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:12 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:13.809630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3f620a2-84b9-4ea8-83e7-38dc0bb4722e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:13.810250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3f620a2-84b9-4ea8-83e7-38dc0bb4722e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:13.817217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3f620a2-84b9-4ea8-83e7-38dc0bb4722e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:13.817670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3f620a2-84b9-4ea8-83e7-38dc0bb4722e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:13.818437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3f620a2-84b9-4ea8-83e7-38dc0bb4722e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:13.818879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3f620a2-84b9-4ea8-83e7-38dc0bb4722e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:13.944522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3f620a2-84b9-4ea8-83e7-38dc0bb4722e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:13.952136 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3f620a2-84b9-4ea8-83e7-38dc0bb4722e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.146395 May 19 05:31:13.952723 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3208/6504] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:13 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:14.969770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66acdd0f-140c-4f89-8213-74c4473b67ae tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:14.970401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66acdd0f-140c-4f89-8213-74c4473b67ae tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:14.977587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66acdd0f-140c-4f89-8213-74c4473b67ae tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:14.978051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66acdd0f-140c-4f89-8213-74c4473b67ae tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:14.978827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66acdd0f-140c-4f89-8213-74c4473b67ae tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:14.979281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66acdd0f-140c-4f89-8213-74c4473b67ae tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:15.107478 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-66acdd0f-140c-4f89-8213-74c4473b67ae tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:15.115019 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66acdd0f-140c-4f89-8213-74c4473b67ae tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.149200 May 19 05:31:15.115598 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3297/6505] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:14 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:16.131716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c1907fd-4608-4129-b9be-5877b04238c9 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:16.132347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c1907fd-4608-4129-b9be-5877b04238c9 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:16.139308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c1907fd-4608-4129-b9be-5877b04238c9 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:16.139764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c1907fd-4608-4129-b9be-5877b04238c9 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:16.140536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c1907fd-4608-4129-b9be-5877b04238c9 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:16.140980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c1907fd-4608-4129-b9be-5877b04238c9 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:16.155850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:16.267485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c1907fd-4608-4129-b9be-5877b04238c9 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:16.275605 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c1907fd-4608-4129-b9be-5877b04238c9 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.147808 May 19 05:31:16.276182 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3209/6506] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:16 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:17.292743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-723a75d5-2dbc-4fcf-af1a-ec3e4f1f3d5b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:17.293334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-723a75d5-2dbc-4fcf-af1a-ec3e4f1f3d5b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:17.301200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-723a75d5-2dbc-4fcf-af1a-ec3e4f1f3d5b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:17.301694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-723a75d5-2dbc-4fcf-af1a-ec3e4f1f3d5b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:17.302474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-723a75d5-2dbc-4fcf-af1a-ec3e4f1f3d5b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:17.302956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-723a75d5-2dbc-4fcf-af1a-ec3e4f1f3d5b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:17.436073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-723a75d5-2dbc-4fcf-af1a-ec3e4f1f3d5b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:17.443723 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-723a75d5-2dbc-4fcf-af1a-ec3e4f1f3d5b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.155013 May 19 05:31:17.444300 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3298/6507] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:17 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:18.460786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eaaf233d-13b2-4193-b317-9cd464e55af7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:18.461356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eaaf233d-13b2-4193-b317-9cd464e55af7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:18.464118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=42 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:18.469916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eaaf233d-13b2-4193-b317-9cd464e55af7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:18.470426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eaaf233d-13b2-4193-b317-9cd464e55af7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:18.471254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eaaf233d-13b2-4193-b317-9cd464e55af7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:18.472318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eaaf233d-13b2-4193-b317-9cd464e55af7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:18.603451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eaaf233d-13b2-4193-b317-9cd464e55af7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:18.611147 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eaaf233d-13b2-4193-b317-9cd464e55af7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.154941 May 19 05:31:18.611757 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3210/6508] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:18 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:19.628718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-555162ac-330a-41e1-ab1a-39b3a356eed7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:19.629372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-555162ac-330a-41e1-ab1a-39b3a356eed7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:19.632036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:19.637357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-555162ac-330a-41e1-ab1a-39b3a356eed7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:19.637817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-555162ac-330a-41e1-ab1a-39b3a356eed7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:19.638588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-555162ac-330a-41e1-ab1a-39b3a356eed7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:19.639036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-555162ac-330a-41e1-ab1a-39b3a356eed7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:19.772605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-555162ac-330a-41e1-ab1a-39b3a356eed7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:19.780089 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-555162ac-330a-41e1-ab1a-39b3a356eed7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.155778 May 19 05:31:19.780667 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3299/6509] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:19 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:20.796891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7ac4c727-c604-4f27-89a8-07134fd3893e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:20.797549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7ac4c727-c604-4f27-89a8-07134fd3893e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:20.804482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ac4c727-c604-4f27-89a8-07134fd3893e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:20.804934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ac4c727-c604-4f27-89a8-07134fd3893e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:20.805731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ac4c727-c604-4f27-89a8-07134fd3893e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:20.806172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ac4c727-c604-4f27-89a8-07134fd3893e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:20.931790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7ac4c727-c604-4f27-89a8-07134fd3893e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:20.939379 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7ac4c727-c604-4f27-89a8-07134fd3893e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.146356 May 19 05:31:20.939951 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3211/6510] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:20 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:21.956598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7e4d5929-c66b-465c-9483-c08e64d0853f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:21.957259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7e4d5929-c66b-465c-9483-c08e64d0853f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:21.964000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e4d5929-c66b-465c-9483-c08e64d0853f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:21.964458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e4d5929-c66b-465c-9483-c08e64d0853f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:21.965263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e4d5929-c66b-465c-9483-c08e64d0853f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:21.965803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7e4d5929-c66b-465c-9483-c08e64d0853f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:22.093148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7e4d5929-c66b-465c-9483-c08e64d0853f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:22.101279 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7e4d5929-c66b-465c-9483-c08e64d0853f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.149464 May 19 05:31:22.102105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3300/6511] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:21 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:23.118678 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6e3c6935-9734-4ac3-8f6b-3f86b6aea168 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:23.119294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6e3c6935-9734-4ac3-8f6b-3f86b6aea168 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:23.125505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e3c6935-9734-4ac3-8f6b-3f86b6aea168 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:23.125951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e3c6935-9734-4ac3-8f6b-3f86b6aea168 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:23.126707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e3c6935-9734-4ac3-8f6b-3f86b6aea168 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:23.127139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e3c6935-9734-4ac3-8f6b-3f86b6aea168 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:23.257016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6e3c6935-9734-4ac3-8f6b-3f86b6aea168 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:23.264675 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6e3c6935-9734-4ac3-8f6b-3f86b6aea168 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.150077 May 19 05:31:23.265284 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3212/6512] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:23 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:24.282389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-45187bbb-cd43-4b17-927a-bf778bf8a085 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:24.283010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-45187bbb-cd43-4b17-927a-bf778bf8a085 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:24.290596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45187bbb-cd43-4b17-927a-bf778bf8a085 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:24.291055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45187bbb-cd43-4b17-927a-bf778bf8a085 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:24.291827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45187bbb-cd43-4b17-927a-bf778bf8a085 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:24.292272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45187bbb-cd43-4b17-927a-bf778bf8a085 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:24.418379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-45187bbb-cd43-4b17-927a-bf778bf8a085 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:24.425943 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-45187bbb-cd43-4b17-927a-bf778bf8a085 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.147484 May 19 05:31:24.426528 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3301/6513] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:24 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:25.444789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e72882d2-f7a9-4208-b1e1-c489a9f77e27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:25.445429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e72882d2-f7a9-4208-b1e1-c489a9f77e27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:25.452306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e72882d2-f7a9-4208-b1e1-c489a9f77e27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:25.452753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e72882d2-f7a9-4208-b1e1-c489a9f77e27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:25.453535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e72882d2-f7a9-4208-b1e1-c489a9f77e27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:25.453973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e72882d2-f7a9-4208-b1e1-c489a9f77e27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:25.582737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e72882d2-f7a9-4208-b1e1-c489a9f77e27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:25.590445 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e72882d2-f7a9-4208-b1e1-c489a9f77e27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.150100 May 19 05:31:25.591035 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3213/6514] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:25 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:26.607852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8bd2a517-c27d-4e14-ace6-14f11a003e3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:26.608491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8bd2a517-c27d-4e14-ace6-14f11a003e3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:26.615722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bd2a517-c27d-4e14-ace6-14f11a003e3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:26.616198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bd2a517-c27d-4e14-ace6-14f11a003e3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:26.616981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bd2a517-c27d-4e14-ace6-14f11a003e3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:26.617466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bd2a517-c27d-4e14-ace6-14f11a003e3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:26.756924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8bd2a517-c27d-4e14-ace6-14f11a003e3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:26.764565 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8bd2a517-c27d-4e14-ace6-14f11a003e3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.160685 May 19 05:31:26.765183 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3302/6515] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:26 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:27.781928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-909e7f4d-8e64-4844-a24f-358b1c12ce86 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:27.782567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-909e7f4d-8e64-4844-a24f-358b1c12ce86 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:27.789940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-909e7f4d-8e64-4844-a24f-358b1c12ce86 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:27.790386 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-909e7f4d-8e64-4844-a24f-358b1c12ce86 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:27.791150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-909e7f4d-8e64-4844-a24f-358b1c12ce86 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:27.791584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-909e7f4d-8e64-4844-a24f-358b1c12ce86 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:27.916503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-909e7f4d-8e64-4844-a24f-358b1c12ce86 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:27.924064 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-909e7f4d-8e64-4844-a24f-358b1c12ce86 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.146088 May 19 05:31:27.925264 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3214/6516] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:27 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:28.940753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5df21559-1d0e-4fc6-9365-6a7ce424e607 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:28.941411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5df21559-1d0e-4fc6-9365-6a7ce424e607 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:28.948534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5df21559-1d0e-4fc6-9365-6a7ce424e607 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:28.948996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5df21559-1d0e-4fc6-9365-6a7ce424e607 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:28.949844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5df21559-1d0e-4fc6-9365-6a7ce424e607 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:28.950286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5df21559-1d0e-4fc6-9365-6a7ce424e607 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:29.049607 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:31:29.049811 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:31:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e (ip 10.222.0.58) !!! May 19 05:31:29.083553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5df21559-1d0e-4fc6-9365-6a7ce424e607 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:29.091050 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5df21559-1d0e-4fc6-9365-6a7ce424e607 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.154282 May 19 05:31:29.091621 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3303/6517] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:28 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:29.795515 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:31:29.796064 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:31:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:31:30.108039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-895eb31f-b8aa-4f34-898f-a1fcaf3adf33 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:30.108659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-895eb31f-b8aa-4f34-898f-a1fcaf3adf33 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:30.115773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-895eb31f-b8aa-4f34-898f-a1fcaf3adf33 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:30.116223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-895eb31f-b8aa-4f34-898f-a1fcaf3adf33 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:30.116994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-895eb31f-b8aa-4f34-898f-a1fcaf3adf33 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:30.117464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-895eb31f-b8aa-4f34-898f-a1fcaf3adf33 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:30.243540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-895eb31f-b8aa-4f34-898f-a1fcaf3adf33 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:30.251199 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-895eb31f-b8aa-4f34-898f-a1fcaf3adf33 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.147179 May 19 05:31:30.251768 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3215/6518] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:30 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:31.267804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-116d5487-cf61-48ab-9058-78aa1e0a3a22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:31.269006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-116d5487-cf61-48ab-9058-78aa1e0a3a22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:31.275963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-116d5487-cf61-48ab-9058-78aa1e0a3a22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:31.276433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-116d5487-cf61-48ab-9058-78aa1e0a3a22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:31.277255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-116d5487-cf61-48ab-9058-78aa1e0a3a22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:31.277715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-116d5487-cf61-48ab-9058-78aa1e0a3a22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:31.407593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-116d5487-cf61-48ab-9058-78aa1e0a3a22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:31.415300 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-116d5487-cf61-48ab-9058-78aa1e0a3a22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.151498 May 19 05:31:31.415983 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3304/6519] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:31 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:31:32.432356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-02f0189c-7c14-49ae-99a9-74bfa589e42d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:32.433002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-02f0189c-7c14-49ae-99a9-74bfa589e42d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:32.439829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02f0189c-7c14-49ae-99a9-74bfa589e42d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:32.440937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02f0189c-7c14-49ae-99a9-74bfa589e42d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:32.441759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02f0189c-7c14-49ae-99a9-74bfa589e42d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:32.442195 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02f0189c-7c14-49ae-99a9-74bfa589e42d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:32.571390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02f0189c-7c14-49ae-99a9-74bfa589e42d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:32.578925 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-02f0189c-7c14-49ae-99a9-74bfa589e42d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.150500 May 19 05:31:32.579665 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3216/6520] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:32 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:33.596845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4618c177-07f7-4ed5-aea4-594259f3b289 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:33.597541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4618c177-07f7-4ed5-aea4-594259f3b289 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:33.607348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4618c177-07f7-4ed5-aea4-594259f3b289 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:33.607814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4618c177-07f7-4ed5-aea4-594259f3b289 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:33.608597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4618c177-07f7-4ed5-aea4-594259f3b289 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:33.609049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4618c177-07f7-4ed5-aea4-594259f3b289 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:33.755481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4618c177-07f7-4ed5-aea4-594259f3b289 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:33.762983 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4618c177-07f7-4ed5-aea4-594259f3b289 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.170629 May 19 05:31:33.763564 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3305/6521] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:33 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:34.779992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-55d20f4a-34b6-48ec-b24b-687a653316a1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:34.780641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-55d20f4a-34b6-48ec-b24b-687a653316a1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:34.790170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-55d20f4a-34b6-48ec-b24b-687a653316a1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:34.790620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-55d20f4a-34b6-48ec-b24b-687a653316a1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:34.791377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-55d20f4a-34b6-48ec-b24b-687a653316a1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:34.791811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-55d20f4a-34b6-48ec-b24b-687a653316a1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:34.921139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-55d20f4a-34b6-48ec-b24b-687a653316a1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:34.928702 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-55d20f4a-34b6-48ec-b24b-687a653316a1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1522 microversion: 2.1 time: 0.152638 May 19 05:31:34.929292 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3217/6522] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:34 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:35.945053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5252ed01-1c4d-44fd-82d2-e54d42a19d59 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:35.945719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5252ed01-1c4d-44fd-82d2-e54d42a19d59 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:35.952851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5252ed01-1c4d-44fd-82d2-e54d42a19d59 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:35.953345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5252ed01-1c4d-44fd-82d2-e54d42a19d59 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:35.954140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5252ed01-1c4d-44fd-82d2-e54d42a19d59 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:35.954595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5252ed01-1c4d-44fd-82d2-e54d42a19d59 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:36.180918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5252ed01-1c4d-44fd-82d2-e54d42a19d59 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:36.188628 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5252ed01-1c4d-44fd-82d2-e54d42a19d59 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1521 microversion: 2.1 time: 0.247591 May 19 05:31:36.189326 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3306/6523] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:35 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:36.266594 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bd14bd1a-3ed0-47d5-a075-0155877eea21 req-b7a437f8-0b08-4f03-ac61-03e84670c1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b9ce6d-c236-477e-9d86-ee7619dc334e", "name": "network-vif-unplugged", "status": "completed", "tag": "e9e78586-10b6-46b4-9f4b-b9e121935c3e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:36.276240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bd14bd1a-3ed0-47d5-a075-0155877eea21 req-b7a437f8-0b08-4f03-ac61-03e84670c1f5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:36.276694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bd14bd1a-3ed0-47d5-a075-0155877eea21 req-b7a437f8-0b08-4f03-ac61-03e84670c1f5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:36.289759 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bd14bd1a-3ed0-47d5-a075-0155877eea21 req-b7a437f8-0b08-4f03-ac61-03e84670c1f5 service nova] Creating event network-vif-unplugged:e9e78586-10b6-46b4-9f4b-b9e121935c3e for instance 94b9ce6d-c236-477e-9d86-ee7619dc334e on n-h2-766726-30 May 19 05:31:36.295365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-bd14bd1a-3ed0-47d5-a075-0155877eea21 req-b7a437f8-0b08-4f03-ac61-03e84670c1f5 service nova] Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:31:36.306783 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bd14bd1a-3ed0-47d5-a075-0155877eea21 req-b7a437f8-0b08-4f03-ac61-03e84670c1f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044116 May 19 05:31:36.308367 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3218/6524] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:31:37.206163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-508e8dd6-a74a-4961-8753-8d99f41f513d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:37.206932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-508e8dd6-a74a-4961-8753-8d99f41f513d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:37.213841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-508e8dd6-a74a-4961-8753-8d99f41f513d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:37.214314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-508e8dd6-a74a-4961-8753-8d99f41f513d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:37.215106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-508e8dd6-a74a-4961-8753-8d99f41f513d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:37.215594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-508e8dd6-a74a-4961-8753-8d99f41f513d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:37.404565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-508e8dd6-a74a-4961-8753-8d99f41f513d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:37.412280 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-508e8dd6-a74a-4961-8753-8d99f41f513d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1521 microversion: 2.1 time: 0.210323 May 19 05:31:37.412862 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3307/6525] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:37 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:31:38.322918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a63cb95c-814a-4f89-891e-7110602f623d req-ac098d67-8920-4c78-b98a-12dc0a46ea84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94b9ce6d-c236-477e-9d86-ee7619dc334e", "tag": "e9e78586-10b6-46b4-9f4b-b9e121935c3e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:38.332331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a63cb95c-814a-4f89-891e-7110602f623d req-ac098d67-8920-4c78-b98a-12dc0a46ea84 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:38.332785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a63cb95c-814a-4f89-891e-7110602f623d req-ac098d67-8920-4c78-b98a-12dc0a46ea84 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:38.344339 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a63cb95c-814a-4f89-891e-7110602f623d req-ac098d67-8920-4c78-b98a-12dc0a46ea84 service nova] Creating event network-changed:e9e78586-10b6-46b4-9f4b-b9e121935c3e for instance 94b9ce6d-c236-477e-9d86-ee7619dc334e on n-h2-766726-30 May 19 05:31:38.350106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-a63cb95c-814a-4f89-891e-7110602f623d req-ac098d67-8920-4c78-b98a-12dc0a46ea84 service nova] Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:31:38.361262 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a63cb95c-814a-4f89-891e-7110602f623d req-ac098d67-8920-4c78-b98a-12dc0a46ea84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042399 May 19 05:31:38.362492 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3219/6526] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:31:38.430348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-69c49ad9-4bf3-4a64-83d1-21e2f1d7b533 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:38.430980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-69c49ad9-4bf3-4a64-83d1-21e2f1d7b533 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:38.437943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69c49ad9-4bf3-4a64-83d1-21e2f1d7b533 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:38.438405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69c49ad9-4bf3-4a64-83d1-21e2f1d7b533 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:38.439282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69c49ad9-4bf3-4a64-83d1-21e2f1d7b533 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:38.439762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69c49ad9-4bf3-4a64-83d1-21e2f1d7b533 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:38.575900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-69c49ad9-4bf3-4a64-83d1-21e2f1d7b533 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:38.584006 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-69c49ad9-4bf3-4a64-83d1-21e2f1d7b533 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1519 microversion: 2.1 time: 0.157615 May 19 05:31:38.584598 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3308/6527] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:38 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:39.602287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-64b7e262-b552-40d7-8c0a-a78ca4e9e155 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:39.603003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-64b7e262-b552-40d7-8c0a-a78ca4e9e155 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:39.610164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64b7e262-b552-40d7-8c0a-a78ca4e9e155 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:39.610621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64b7e262-b552-40d7-8c0a-a78ca4e9e155 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:39.611399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64b7e262-b552-40d7-8c0a-a78ca4e9e155 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:39.611843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-64b7e262-b552-40d7-8c0a-a78ca4e9e155 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:39.738770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-64b7e262-b552-40d7-8c0a-a78ca4e9e155 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:39.746378 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-64b7e262-b552-40d7-8c0a-a78ca4e9e155 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1516 microversion: 2.1 time: 0.148670 May 19 05:31:39.746908 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3220/6528] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:39 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:39.763373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3844a229-2f25-4009-b2bd-bceaf6dd45c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:39.763980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3844a229-2f25-4009-b2bd-bceaf6dd45c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:39.771521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3844a229-2f25-4009-b2bd-bceaf6dd45c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:39.771981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3844a229-2f25-4009-b2bd-bceaf6dd45c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:39.772747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3844a229-2f25-4009-b2bd-bceaf6dd45c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:39.773234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3844a229-2f25-4009-b2bd-bceaf6dd45c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:39.829832 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3844a229-2f25-4009-b2bd-bceaf6dd45c1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "POST /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e/action" status: 204 len: 0 microversion: 2.1 time: 0.070270 May 19 05:31:39.831083 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3309/6529] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:31:39 2022] POST /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:31:39.840227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-20484b36-1935-40f3-adb0-06a1711dd8dd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:39.840928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-20484b36-1935-40f3-adb0-06a1711dd8dd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:39.847749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-20484b36-1935-40f3-adb0-06a1711dd8dd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:39.848334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-20484b36-1935-40f3-adb0-06a1711dd8dd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:39.849309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-20484b36-1935-40f3-adb0-06a1711dd8dd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:39.850205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-20484b36-1935-40f3-adb0-06a1711dd8dd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:39.992551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-20484b36-1935-40f3-adb0-06a1711dd8dd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:40.000248 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-20484b36-1935-40f3-adb0-06a1711dd8dd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1516 microversion: 2.1 time: 0.163841 May 19 05:31:40.000767 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3221/6530] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:39 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:41.020791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a611cbd-f7c7-4819-9a2a-f2c222fd5077 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:41.022335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a611cbd-f7c7-4819-9a2a-f2c222fd5077 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:41.029608 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a611cbd-f7c7-4819-9a2a-f2c222fd5077 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:41.030407 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a611cbd-f7c7-4819-9a2a-f2c222fd5077 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:41.031365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a611cbd-f7c7-4819-9a2a-f2c222fd5077 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:41.031824 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a611cbd-f7c7-4819-9a2a-f2c222fd5077 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:41.184903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a611cbd-f7c7-4819-9a2a-f2c222fd5077 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:41.192631 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a611cbd-f7c7-4819-9a2a-f2c222fd5077 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1508 microversion: 2.1 time: 0.178068 May 19 05:31:41.193294 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3310/6531] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:41 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:41.209706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-80c97118-aa5d-4a42-9023-29f9de3344da tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:41.210369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-80c97118-aa5d-4a42-9023-29f9de3344da tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:41.217543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80c97118-aa5d-4a42-9023-29f9de3344da tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:41.218070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80c97118-aa5d-4a42-9023-29f9de3344da tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:41.218779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80c97118-aa5d-4a42-9023-29f9de3344da tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:41.219392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80c97118-aa5d-4a42-9023-29f9de3344da tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:41.353209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-80c97118-aa5d-4a42-9023-29f9de3344da tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:41.361165 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-80c97118-aa5d-4a42-9023-29f9de3344da tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1508 microversion: 2.1 time: 0.155002 May 19 05:31:41.362376 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3222/6532] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:41 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:41.377690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-962affe4-e009-413c-b1c6-9984ee5d7d69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:41.378326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-962affe4-e009-413c-b1c6-9984ee5d7d69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:41.384308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-962affe4-e009-413c-b1c6-9984ee5d7d69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:41.384773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-962affe4-e009-413c-b1c6-9984ee5d7d69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:41.385573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-962affe4-e009-413c-b1c6-9984ee5d7d69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:41.386031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-962affe4-e009-413c-b1c6-9984ee5d7d69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:41.390100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:41.525378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-962affe4-e009-413c-b1c6-9984ee5d7d69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:41.532804 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-962affe4-e009-413c-b1c6-9984ee5d7d69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 200 len: 1508 microversion: 2.1 time: 0.158992 May 19 05:31:41.533400 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3311/6533] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:41 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:41.548976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a48d9101-0ca7-4ad9-abff-affdaf1e7a64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:41.549531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a48d9101-0ca7-4ad9-abff-affdaf1e7a64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:41.555432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a48d9101-0ca7-4ad9-abff-affdaf1e7a64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:41.555881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a48d9101-0ca7-4ad9-abff-affdaf1e7a64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:41.556634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a48d9101-0ca7-4ad9-abff-affdaf1e7a64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:41.557086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a48d9101-0ca7-4ad9-abff-affdaf1e7a64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:41.582295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a48d9101-0ca7-4ad9-abff-affdaf1e7a64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:31:41.659428 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a48d9101-0ca7-4ad9-abff-affdaf1e7a64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 204 len: 0 microversion: 2.1 time: 0.113390 May 19 05:31:41.661123 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3223/6534] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:31:41 2022] DELETE /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:31:41.710936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-788275834", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "617e30ab-42ec-42bd-84f5-6d9db9c56f0d"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:41.766836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] validate_networks() for [('617e30ab-42ec-42bd-84f5-6d9db9c56f0d', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:31:42.136926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:31:42.137474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:31:42.137881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:31:42.138307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:31:42.138735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:31:42.149393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:42.149861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:42.150681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:42.151134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:42.167862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Getting quotas for project d7eb6e516fb642ad905fa2d3078bb18d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:31:42.173179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Getting quotas for user f54b4e32337742298147bb652c0b01ed and project d7eb6e516fb642ad905fa2d3078bb18d. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:31:42.186333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:31:42.188638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:31:42.233234 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96f32e65-7e89-4f26-b519-a609506bef68 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526166 May 19 05:31:42.233890 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3312/6535] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:31:42.245151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cd1d0e42-3281-4384-adae-2fa7dec9247f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:42.245871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cd1d0e42-3281-4384-adae-2fa7dec9247f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:42.299885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cd1d0e42-3281-4384-adae-2fa7dec9247f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:42.309817 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cd1d0e42-3281-4384-adae-2fa7dec9247f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1217 microversion: 2.1 time: 0.068944 May 19 05:31:42.310397 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3224/6536] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:42 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:42.745251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-07aca702-d933-40b9-a9ce-ea1d958784a1 req-5f442a00-ae1b-44f6-a2f9-b4fb03dc78f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b9ce6d-c236-477e-9d86-ee7619dc334e", "name": "network-vif-plugged", "status": "completed", "tag": "e9e78586-10b6-46b4-9f4b-b9e121935c3e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:42.754623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-07aca702-d933-40b9-a9ce-ea1d958784a1 req-5f442a00-ae1b-44f6-a2f9-b4fb03dc78f3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:42.755312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-07aca702-d933-40b9-a9ce-ea1d958784a1 req-5f442a00-ae1b-44f6-a2f9-b4fb03dc78f3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:42.768376 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-07aca702-d933-40b9-a9ce-ea1d958784a1 req-5f442a00-ae1b-44f6-a2f9-b4fb03dc78f3 service nova] Creating event network-vif-plugged:e9e78586-10b6-46b4-9f4b-b9e121935c3e for instance 94b9ce6d-c236-477e-9d86-ee7619dc334e on n-h2-766726-30 May 19 05:31:42.774324 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-07aca702-d933-40b9-a9ce-ea1d958784a1 req-5f442a00-ae1b-44f6-a2f9-b4fb03dc78f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033126 May 19 05:31:42.775383 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3313/6537] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:31:43.337622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa89bdd5-89b4-44e8-b607-9a3c15d92d3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:43.338403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aa89bdd5-89b4-44e8-b607-9a3c15d92d3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:43.347222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa89bdd5-89b4-44e8-b607-9a3c15d92d3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:43.347676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa89bdd5-89b4-44e8-b607-9a3c15d92d3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:43.348641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa89bdd5-89b4-44e8-b607-9a3c15d92d3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:43.349101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa89bdd5-89b4-44e8-b607-9a3c15d92d3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:43.482183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-aa89bdd5-89b4-44e8-b607-9a3c15d92d3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:43.490053 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aa89bdd5-89b4-44e8-b607-9a3c15d92d3d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1275 microversion: 2.1 time: 0.166116 May 19 05:31:43.499515 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3225/6538] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:43 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:43.511080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-cca3c8a8-55e2-4d76-bb9d-7b3b134cb1ee req-49ea6707-fbd1-4ebc-8232-19961f90e335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b9ce6d-c236-477e-9d86-ee7619dc334e", "name": "network-vif-deleted", "tag": "e9e78586-10b6-46b4-9f4b-b9e121935c3e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:43.528038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-cca3c8a8-55e2-4d76-bb9d-7b3b134cb1ee req-49ea6707-fbd1-4ebc-8232-19961f90e335 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:43.528700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-cca3c8a8-55e2-4d76-bb9d-7b3b134cb1ee req-49ea6707-fbd1-4ebc-8232-19961f90e335 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:43.541058 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-cca3c8a8-55e2-4d76-bb9d-7b3b134cb1ee req-49ea6707-fbd1-4ebc-8232-19961f90e335 service nova] Creating event network-vif-deleted:e9e78586-10b6-46b4-9f4b-b9e121935c3e for instance 94b9ce6d-c236-477e-9d86-ee7619dc334e on n-h2-766726-30 May 19 05:31:43.547041 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-cca3c8a8-55e2-4d76-bb9d-7b3b134cb1ee req-49ea6707-fbd1-4ebc-8232-19961f90e335 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049884 May 19 05:31:43.547745 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3314/6539] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:31:44.507449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0f114a7d-0dd5-4653-9bf2-4aa345d85c69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:44.508729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0f114a7d-0dd5-4653-9bf2-4aa345d85c69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:44.515539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f114a7d-0dd5-4653-9bf2-4aa345d85c69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:44.515996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f114a7d-0dd5-4653-9bf2-4aa345d85c69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:44.516760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f114a7d-0dd5-4653-9bf2-4aa345d85c69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:44.517257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f114a7d-0dd5-4653-9bf2-4aa345d85c69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:44.521306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:44.722546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0f114a7d-0dd5-4653-9bf2-4aa345d85c69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:44.734759 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0f114a7d-0dd5-4653-9bf2-4aa345d85c69 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1317 microversion: 2.1 time: 0.231149 May 19 05:31:44.735360 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3226/6540] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:44 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:45.562537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b9b7a7c4-82d6-4f4c-9b09-041c10b90dac req-1fde6c2a-f003-4720-8180-5dd13564fddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4491a97f-7aaf-4a00-82c8-533fd6c6cb4a", "tag": "89ab2362-6308-4f72-abf3-d3445821da13"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:45.572287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b9b7a7c4-82d6-4f4c-9b09-041c10b90dac req-1fde6c2a-f003-4720-8180-5dd13564fddf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:45.572746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b9b7a7c4-82d6-4f4c-9b09-041c10b90dac req-1fde6c2a-f003-4720-8180-5dd13564fddf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:45.583399 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b9b7a7c4-82d6-4f4c-9b09-041c10b90dac req-1fde6c2a-f003-4720-8180-5dd13564fddf service nova] Creating event network-changed:89ab2362-6308-4f72-abf3-d3445821da13 for instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a on n-h2-766726-30 May 19 05:31:45.588025 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b9b7a7c4-82d6-4f4c-9b09-041c10b90dac req-1fde6c2a-f003-4720-8180-5dd13564fddf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029579 May 19 05:31:45.588592 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3315/6541] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:31:45.751336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33bf7297-48ce-4e2d-b1e6-22f0446ba701 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:45.752096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33bf7297-48ce-4e2d-b1e6-22f0446ba701 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:45.759136 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33bf7297-48ce-4e2d-b1e6-22f0446ba701 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:45.759588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33bf7297-48ce-4e2d-b1e6-22f0446ba701 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:45.760355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33bf7297-48ce-4e2d-b1e6-22f0446ba701 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:45.760797 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33bf7297-48ce-4e2d-b1e6-22f0446ba701 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:45.894010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-33bf7297-48ce-4e2d-b1e6-22f0446ba701 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:45.901499 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-33bf7297-48ce-4e2d-b1e6-22f0446ba701 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1317 microversion: 2.1 time: 0.154038 May 19 05:31:45.902417 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3227/6542] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:45 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:46.920201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5d91a5eb-97cd-44d5-af55-e3a91a16e2a6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:46.920924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5d91a5eb-97cd-44d5-af55-e3a91a16e2a6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:46.927708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d91a5eb-97cd-44d5-af55-e3a91a16e2a6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:46.928169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d91a5eb-97cd-44d5-af55-e3a91a16e2a6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:46.928946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d91a5eb-97cd-44d5-af55-e3a91a16e2a6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:46.929420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d91a5eb-97cd-44d5-af55-e3a91a16e2a6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:47.060195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d91a5eb-97cd-44d5-af55-e3a91a16e2a6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:47.068239 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5d91a5eb-97cd-44d5-af55-e3a91a16e2a6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1317 microversion: 2.1 time: 0.153166 May 19 05:31:47.068801 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3316/6543] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:46 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:48.085686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-69efa8ca-ba5e-4d60-ae9b-44087e5a21ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:48.086309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-69efa8ca-ba5e-4d60-ae9b-44087e5a21ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:48.093300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69efa8ca-ba5e-4d60-ae9b-44087e5a21ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:48.093756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69efa8ca-ba5e-4d60-ae9b-44087e5a21ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:48.094518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69efa8ca-ba5e-4d60-ae9b-44087e5a21ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:48.094959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-69efa8ca-ba5e-4d60-ae9b-44087e5a21ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:48.220399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-69efa8ca-ba5e-4d60-ae9b-44087e5a21ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:48.228206 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-69efa8ca-ba5e-4d60-ae9b-44087e5a21ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1317 microversion: 2.1 time: 0.146470 May 19 05:31:48.228789 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3228/6544] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:48 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:48.762039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5e9fa4b7-e101-44b8-925c-ad1b67880da3 req-113098c9-fc41-4825-bf3f-c6f7cdee41a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4491a97f-7aaf-4a00-82c8-533fd6c6cb4a", "name": "network-vif-plugged", "status": "completed", "tag": "89ab2362-6308-4f72-abf3-d3445821da13"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:48.771499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5e9fa4b7-e101-44b8-925c-ad1b67880da3 req-113098c9-fc41-4825-bf3f-c6f7cdee41a0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:48.771895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5e9fa4b7-e101-44b8-925c-ad1b67880da3 req-113098c9-fc41-4825-bf3f-c6f7cdee41a0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:48.783679 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5e9fa4b7-e101-44b8-925c-ad1b67880da3 req-113098c9-fc41-4825-bf3f-c6f7cdee41a0 service nova] Creating event network-vif-plugged:89ab2362-6308-4f72-abf3-d3445821da13 for instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a on n-h2-766726-30 May 19 05:31:48.788786 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5e9fa4b7-e101-44b8-925c-ad1b67880da3 req-113098c9-fc41-4825-bf3f-c6f7cdee41a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030484 May 19 05:31:48.789429 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3317/6545] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:31:49.245581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e964844-e9c4-4307-80ef-9554c987938f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:49.246163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e964844-e9c4-4307-80ef-9554c987938f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:49.248813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:49.255339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e964844-e9c4-4307-80ef-9554c987938f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:49.255791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e964844-e9c4-4307-80ef-9554c987938f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:49.256542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e964844-e9c4-4307-80ef-9554c987938f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:49.257022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e964844-e9c4-4307-80ef-9554c987938f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:49.383353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9e964844-e9c4-4307-80ef-9554c987938f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:49.390918 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e964844-e9c4-4307-80ef-9554c987938f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1317 microversion: 2.1 time: 0.149340 May 19 05:31:49.391490 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3229/6546] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:49 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:50.409172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47850447-33e5-424b-9d57-f29a5f27ab85 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:50.409896 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47850447-33e5-424b-9d57-f29a5f27ab85 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:50.411848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:50.417474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47850447-33e5-424b-9d57-f29a5f27ab85 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:50.417944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47850447-33e5-424b-9d57-f29a5f27ab85 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:50.418725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47850447-33e5-424b-9d57-f29a5f27ab85 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:50.419177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47850447-33e5-424b-9d57-f29a5f27ab85 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:50.552625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47850447-33e5-424b-9d57-f29a5f27ab85 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:50.560657 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47850447-33e5-424b-9d57-f29a5f27ab85 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1507 microversion: 2.1 time: 0.156672 May 19 05:31:50.561275 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3318/6547] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:50 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:50.576963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-42695806-5b88-416c-9e81-f7af8732f4ce tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:50.577610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-42695806-5b88-416c-9e81-f7af8732f4ce tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:50.584488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42695806-5b88-416c-9e81-f7af8732f4ce tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:50.584873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42695806-5b88-416c-9e81-f7af8732f4ce tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:50.585665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42695806-5b88-416c-9e81-f7af8732f4ce tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:50.586104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42695806-5b88-416c-9e81-f7af8732f4ce tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:50.714108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-42695806-5b88-416c-9e81-f7af8732f4ce tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:50.721610 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-42695806-5b88-416c-9e81-f7af8732f4ce tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1507 microversion: 2.1 time: 0.148440 May 19 05:31:50.722193 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3230/6548] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:50 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:50.738324 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:31:50.739342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:50.745743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:50.746278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:50.747344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:50.747937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:50.775782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:50.781514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Old instance type m1.heat2, new instance type m1.heat {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:31:50.787676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:31:50.788111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:31:50.788601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:31:50.789055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:31:50.789513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:31:50.855626 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-96c4bb4f-d3a8-4bef-86b5-b8807e911891 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "POST /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a/action" status: 202 len: 0 microversion: 2.1 time: 0.121795 May 19 05:31:50.856369 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3319/6549] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:31:50 2022] POST /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:31:50.865342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-06469738-6d4c-471a-97ae-0c6aa81f0d22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:50.866286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-06469738-6d4c-471a-97ae-0c6aa81f0d22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:50.872541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06469738-6d4c-471a-97ae-0c6aa81f0d22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:50.873212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06469738-6d4c-471a-97ae-0c6aa81f0d22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:50.873995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06469738-6d4c-471a-97ae-0c6aa81f0d22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:50.874445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-06469738-6d4c-471a-97ae-0c6aa81f0d22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:51.046747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-06469738-6d4c-471a-97ae-0c6aa81f0d22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:51.055009 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-06469738-6d4c-471a-97ae-0c6aa81f0d22 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1514 microversion: 2.1 time: 0.194188 May 19 05:31:51.055593 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3231/6550] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:50 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:52.073677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-114e17d2-2c2e-4c63-af21-5ffcbd2bcc0e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:52.074228 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-114e17d2-2c2e-4c63-af21-5ffcbd2bcc0e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:52.080338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-114e17d2-2c2e-4c63-af21-5ffcbd2bcc0e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:52.080809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-114e17d2-2c2e-4c63-af21-5ffcbd2bcc0e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:52.081624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-114e17d2-2c2e-4c63-af21-5ffcbd2bcc0e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:52.082087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-114e17d2-2c2e-4c63-af21-5ffcbd2bcc0e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:52.158663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:52.180845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:52.250507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-114e17d2-2c2e-4c63-af21-5ffcbd2bcc0e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:52.258847 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-114e17d2-2c2e-4c63-af21-5ffcbd2bcc0e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1514 microversion: 2.1 time: 0.190566 May 19 05:31:52.259439 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3320/6551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:52 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:53.276465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dcba7ef3-762b-4877-9d59-9d9ace094d45 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:53.277099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dcba7ef3-762b-4877-9d59-9d9ace094d45 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:53.279100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:31:53.284896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dcba7ef3-762b-4877-9d59-9d9ace094d45 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:53.285389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dcba7ef3-762b-4877-9d59-9d9ace094d45 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:53.286191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dcba7ef3-762b-4877-9d59-9d9ace094d45 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:53.286653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dcba7ef3-762b-4877-9d59-9d9ace094d45 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:53.416405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dcba7ef3-762b-4877-9d59-9d9ace094d45 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:53.423953 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dcba7ef3-762b-4877-9d59-9d9ace094d45 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.151780 May 19 05:31:53.425030 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3232/6552] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:53 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:54.442787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-58477e08-2f8d-42dc-80f7-ed6f3c7e10fa tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:54.443414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-58477e08-2f8d-42dc-80f7-ed6f3c7e10fa tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:54.450305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58477e08-2f8d-42dc-80f7-ed6f3c7e10fa tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:54.450761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58477e08-2f8d-42dc-80f7-ed6f3c7e10fa tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:54.451526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58477e08-2f8d-42dc-80f7-ed6f3c7e10fa tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:54.451974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-58477e08-2f8d-42dc-80f7-ed6f3c7e10fa tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:54.578119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-58477e08-2f8d-42dc-80f7-ed6f3c7e10fa tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:54.586031 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-58477e08-2f8d-42dc-80f7-ed6f3c7e10fa tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.147767 May 19 05:31:54.586542 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3321/6553] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:54 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:55.602693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-62380bdb-0acd-4ded-b662-14fc0efa554b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:55.603349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-62380bdb-0acd-4ded-b662-14fc0efa554b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:55.610350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62380bdb-0acd-4ded-b662-14fc0efa554b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:55.610801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62380bdb-0acd-4ded-b662-14fc0efa554b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:55.611568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62380bdb-0acd-4ded-b662-14fc0efa554b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:55.612013 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-62380bdb-0acd-4ded-b662-14fc0efa554b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:55.742820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-62380bdb-0acd-4ded-b662-14fc0efa554b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:55.750534 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-62380bdb-0acd-4ded-b662-14fc0efa554b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.152106 May 19 05:31:55.751114 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3233/6554] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:55 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:56.767703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c2fe2f26-e4a6-465d-8668-761665d05ee1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:56.768866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c2fe2f26-e4a6-465d-8668-761665d05ee1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:56.775856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2fe2f26-e4a6-465d-8668-761665d05ee1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:56.776318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2fe2f26-e4a6-465d-8668-761665d05ee1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:56.777115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2fe2f26-e4a6-465d-8668-761665d05ee1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:56.777574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c2fe2f26-e4a6-465d-8668-761665d05ee1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:56.913489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c2fe2f26-e4a6-465d-8668-761665d05ee1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:56.921044 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c2fe2f26-e4a6-465d-8668-761665d05ee1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.157381 May 19 05:31:56.921644 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3322/6555] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:56 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:57.938150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-730cd665-4612-468a-b382-e9c3f1e699c6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:57.938775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-730cd665-4612-468a-b382-e9c3f1e699c6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:57.945991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-730cd665-4612-468a-b382-e9c3f1e699c6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:57.946444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-730cd665-4612-468a-b382-e9c3f1e699c6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:57.947205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-730cd665-4612-468a-b382-e9c3f1e699c6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:57.947645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-730cd665-4612-468a-b382-e9c3f1e699c6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:58.073799 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-730cd665-4612-468a-b382-e9c3f1e699c6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:58.081822 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-730cd665-4612-468a-b382-e9c3f1e699c6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.147646 May 19 05:31:58.082401 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3234/6556] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:57 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:31:59.098410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-108b43ec-2570-4747-9980-01868966ec27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:31:59.099033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-108b43ec-2570-4747-9980-01868966ec27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:31:59.106424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-108b43ec-2570-4747-9980-01868966ec27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:59.106899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-108b43ec-2570-4747-9980-01868966ec27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:59.107913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-108b43ec-2570-4747-9980-01868966ec27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:31:59.108393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-108b43ec-2570-4747-9980-01868966ec27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:31:59.238147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-108b43ec-2570-4747-9980-01868966ec27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:31:59.245695 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-108b43ec-2570-4747-9980-01868966ec27 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.151286 May 19 05:31:59.246278 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3323/6557] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:31:59 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:00.263272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3951a4ab-70e7-47c1-86d3-94f7ae754c04 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:00.263892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3951a4ab-70e7-47c1-86d3-94f7ae754c04 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:00.270889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3951a4ab-70e7-47c1-86d3-94f7ae754c04 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:00.271374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3951a4ab-70e7-47c1-86d3-94f7ae754c04 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:00.272137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3951a4ab-70e7-47c1-86d3-94f7ae754c04 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:00.272575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3951a4ab-70e7-47c1-86d3-94f7ae754c04 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:00.399433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3951a4ab-70e7-47c1-86d3-94f7ae754c04 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:00.407028 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3951a4ab-70e7-47c1-86d3-94f7ae754c04 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.147727 May 19 05:32:00.407609 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3235/6558] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:00 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:01.423938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4d6045c8-803d-482c-b35b-07a55c90e8b2 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:01.424510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4d6045c8-803d-482c-b35b-07a55c90e8b2 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:01.431572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d6045c8-803d-482c-b35b-07a55c90e8b2 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:01.432039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d6045c8-803d-482c-b35b-07a55c90e8b2 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:01.432816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d6045c8-803d-482c-b35b-07a55c90e8b2 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:01.433305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4d6045c8-803d-482c-b35b-07a55c90e8b2 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:01.563612 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4d6045c8-803d-482c-b35b-07a55c90e8b2 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:01.571664 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4d6045c8-803d-482c-b35b-07a55c90e8b2 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.151788 May 19 05:32:01.572252 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3324/6559] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:01 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:02.588556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dc3067f5-98fd-408d-b8c9-f05bb3c36144 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:02.589119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dc3067f5-98fd-408d-b8c9-f05bb3c36144 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:02.596203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc3067f5-98fd-408d-b8c9-f05bb3c36144 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:02.596651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc3067f5-98fd-408d-b8c9-f05bb3c36144 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:02.597438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc3067f5-98fd-408d-b8c9-f05bb3c36144 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:02.597875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dc3067f5-98fd-408d-b8c9-f05bb3c36144 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:02.725623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dc3067f5-98fd-408d-b8c9-f05bb3c36144 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:02.733312 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dc3067f5-98fd-408d-b8c9-f05bb3c36144 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.148692 May 19 05:32:02.733920 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3236/6560] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:02 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:03.750700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-97b5a27b-0860-4993-9406-329076e6950e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:03.751329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-97b5a27b-0860-4993-9406-329076e6950e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:03.758952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97b5a27b-0860-4993-9406-329076e6950e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:03.759408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97b5a27b-0860-4993-9406-329076e6950e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:03.760178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97b5a27b-0860-4993-9406-329076e6950e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:03.760624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-97b5a27b-0860-4993-9406-329076e6950e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:03.894973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-97b5a27b-0860-4993-9406-329076e6950e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:03.902449 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-97b5a27b-0860-4993-9406-329076e6950e tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.156244 May 19 05:32:03.903044 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3325/6561] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:03 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:04.919441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1f1abd81-4d83-426c-b8ec-3999702834d0 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:04.920043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1f1abd81-4d83-426c-b8ec-3999702834d0 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:04.927086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f1abd81-4d83-426c-b8ec-3999702834d0 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:04.927533 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f1abd81-4d83-426c-b8ec-3999702834d0 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:04.928294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f1abd81-4d83-426c-b8ec-3999702834d0 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:04.928727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1f1abd81-4d83-426c-b8ec-3999702834d0 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:05.405655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1f1abd81-4d83-426c-b8ec-3999702834d0 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:05.413093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1f1abd81-4d83-426c-b8ec-3999702834d0 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.497571 May 19 05:32:05.413686 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3237/6562] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:04 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:06.430499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ae9ebbd4-46a3-406a-9b95-93a3c0b037e4 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:06.431129 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ae9ebbd4-46a3-406a-9b95-93a3c0b037e4 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:06.438095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae9ebbd4-46a3-406a-9b95-93a3c0b037e4 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:06.438558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae9ebbd4-46a3-406a-9b95-93a3c0b037e4 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:06.439325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae9ebbd4-46a3-406a-9b95-93a3c0b037e4 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:06.439773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ae9ebbd4-46a3-406a-9b95-93a3c0b037e4 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:06.566166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ae9ebbd4-46a3-406a-9b95-93a3c0b037e4 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:06.573648 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ae9ebbd4-46a3-406a-9b95-93a3c0b037e4 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.147115 May 19 05:32:06.574221 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3326/6563] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:06 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:07.590504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-951dbf26-cc6a-4135-a3a3-d310ccc88635 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:07.591116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-951dbf26-cc6a-4135-a3a3-d310ccc88635 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:07.598551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-951dbf26-cc6a-4135-a3a3-d310ccc88635 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:07.598997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-951dbf26-cc6a-4135-a3a3-d310ccc88635 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:07.599759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-951dbf26-cc6a-4135-a3a3-d310ccc88635 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:07.600196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-951dbf26-cc6a-4135-a3a3-d310ccc88635 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:07.837500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-951dbf26-cc6a-4135-a3a3-d310ccc88635 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:07.845117 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-951dbf26-cc6a-4135-a3a3-d310ccc88635 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.258451 May 19 05:32:07.845700 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3238/6564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:07 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:08.863651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5d043bf4-a633-4924-b828-bbf17f560c0b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:08.864223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5d043bf4-a633-4924-b828-bbf17f560c0b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:08.875755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d043bf4-a633-4924-b828-bbf17f560c0b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:08.876224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d043bf4-a633-4924-b828-bbf17f560c0b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:08.877020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d043bf4-a633-4924-b828-bbf17f560c0b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:08.877500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d043bf4-a633-4924-b828-bbf17f560c0b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:09.006787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d043bf4-a633-4924-b828-bbf17f560c0b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:09.014537 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5d043bf4-a633-4924-b828-bbf17f560c0b tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.156132 May 19 05:32:09.015123 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3327/6565] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:08 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:10.031872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-79ed7d44-15f1-4b24-8fd4-6b2e7e0f1350 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:10.032474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-79ed7d44-15f1-4b24-8fd4-6b2e7e0f1350 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:10.039986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79ed7d44-15f1-4b24-8fd4-6b2e7e0f1350 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:10.040431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79ed7d44-15f1-4b24-8fd4-6b2e7e0f1350 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:10.041224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79ed7d44-15f1-4b24-8fd4-6b2e7e0f1350 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:10.041661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-79ed7d44-15f1-4b24-8fd4-6b2e7e0f1350 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:10.173804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-79ed7d44-15f1-4b24-8fd4-6b2e7e0f1350 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:10.181300 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-79ed7d44-15f1-4b24-8fd4-6b2e7e0f1350 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.153322 May 19 05:32:10.181871 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3239/6566] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:10 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:11.198297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be0f8de0-25aa-4c8d-b02a-e4ad949ea1b8 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:11.200322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be0f8de0-25aa-4c8d-b02a-e4ad949ea1b8 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:11.206089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0f8de0-25aa-4c8d-b02a-e4ad949ea1b8 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:11.206556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0f8de0-25aa-4c8d-b02a-e4ad949ea1b8 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:11.207342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0f8de0-25aa-4c8d-b02a-e4ad949ea1b8 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:11.207796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be0f8de0-25aa-4c8d-b02a-e4ad949ea1b8 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:11.335463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be0f8de0-25aa-4c8d-b02a-e4ad949ea1b8 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:11.343207 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be0f8de0-25aa-4c8d-b02a-e4ad949ea1b8 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.148898 May 19 05:32:11.343783 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3328/6567] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:11 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:32:12.361037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-56ff6d39-b380-4ca6-b0f6-81d6469c0f64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:12.361676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-56ff6d39-b380-4ca6-b0f6-81d6469c0f64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:12.368790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56ff6d39-b380-4ca6-b0f6-81d6469c0f64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:12.369274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56ff6d39-b380-4ca6-b0f6-81d6469c0f64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:12.370042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56ff6d39-b380-4ca6-b0f6-81d6469c0f64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:12.370482 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56ff6d39-b380-4ca6-b0f6-81d6469c0f64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:12.506993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-56ff6d39-b380-4ca6-b0f6-81d6469c0f64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:12.514636 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-56ff6d39-b380-4ca6-b0f6-81d6469c0f64 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.157464 May 19 05:32:12.515223 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3240/6568] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:12 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:13.532310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1af7771-4375-45f8-bc85-b82acfea4698 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:13.532938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1af7771-4375-45f8-bc85-b82acfea4698 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:13.540436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1af7771-4375-45f8-bc85-b82acfea4698 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:13.540893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1af7771-4375-45f8-bc85-b82acfea4698 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:13.541693 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1af7771-4375-45f8-bc85-b82acfea4698 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:13.542145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1af7771-4375-45f8-bc85-b82acfea4698 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:13.546061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:13.670454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1af7771-4375-45f8-bc85-b82acfea4698 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:13.677959 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1af7771-4375-45f8-bc85-b82acfea4698 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.149930 May 19 05:32:13.678532 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3329/6569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:13 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:14.695637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2e5f00bc-34dd-4111-bdb7-6177565daa8c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:14.696259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2e5f00bc-34dd-4111-bdb7-6177565daa8c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:14.703519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e5f00bc-34dd-4111-bdb7-6177565daa8c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:14.703997 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e5f00bc-34dd-4111-bdb7-6177565daa8c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:14.704767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e5f00bc-34dd-4111-bdb7-6177565daa8c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:14.705238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2e5f00bc-34dd-4111-bdb7-6177565daa8c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:14.707765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=90 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:14.838107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2e5f00bc-34dd-4111-bdb7-6177565daa8c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:14.845627 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2e5f00bc-34dd-4111-bdb7-6177565daa8c tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.153952 May 19 05:32:14.846205 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3241/6570] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:14 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:15.863360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ab06e6a5-07f4-4337-97d9-cf78b9b1c89d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:15.863988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ab06e6a5-07f4-4337-97d9-cf78b9b1c89d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:15.871032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab06e6a5-07f4-4337-97d9-cf78b9b1c89d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:15.871518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab06e6a5-07f4-4337-97d9-cf78b9b1c89d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:15.872290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab06e6a5-07f4-4337-97d9-cf78b9b1c89d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:15.872740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab06e6a5-07f4-4337-97d9-cf78b9b1c89d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:16.004853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab06e6a5-07f4-4337-97d9-cf78b9b1c89d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:16.012820 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ab06e6a5-07f4-4337-97d9-cf78b9b1c89d tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.153431 May 19 05:32:16.013439 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3330/6571] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:15 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:17.029769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0b3efaea-4fe9-4e87-8fe1-e39efd8b2edd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:17.030389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0b3efaea-4fe9-4e87-8fe1-e39efd8b2edd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:17.038110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b3efaea-4fe9-4e87-8fe1-e39efd8b2edd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:17.038561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b3efaea-4fe9-4e87-8fe1-e39efd8b2edd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:17.039337 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b3efaea-4fe9-4e87-8fe1-e39efd8b2edd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:17.039780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0b3efaea-4fe9-4e87-8fe1-e39efd8b2edd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:17.168199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0b3efaea-4fe9-4e87-8fe1-e39efd8b2edd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:17.176484 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0b3efaea-4fe9-4e87-8fe1-e39efd8b2edd tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.150600 May 19 05:32:17.177068 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3242/6572] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:17 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:18.194359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f4ee7dc3-79be-4a74-8abd-200ed3fc2040 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:18.195617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f4ee7dc3-79be-4a74-8abd-200ed3fc2040 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:18.204654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4ee7dc3-79be-4a74-8abd-200ed3fc2040 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:18.205149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4ee7dc3-79be-4a74-8abd-200ed3fc2040 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:18.205967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4ee7dc3-79be-4a74-8abd-200ed3fc2040 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:18.206419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f4ee7dc3-79be-4a74-8abd-200ed3fc2040 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:18.345898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f4ee7dc3-79be-4a74-8abd-200ed3fc2040 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:18.353940 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f4ee7dc3-79be-4a74-8abd-200ed3fc2040 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.164092 May 19 05:32:18.354526 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3331/6573] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:18 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:19.371223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3824bc5c-3f4d-4607-986a-b3062061b460 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:19.371843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3824bc5c-3f4d-4607-986a-b3062061b460 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:19.374639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=28 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:19.380469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3824bc5c-3f4d-4607-986a-b3062061b460 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:19.380929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3824bc5c-3f4d-4607-986a-b3062061b460 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:19.381732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3824bc5c-3f4d-4607-986a-b3062061b460 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:19.382175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3824bc5c-3f4d-4607-986a-b3062061b460 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:19.528470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3824bc5c-3f4d-4607-986a-b3062061b460 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:19.536665 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3824bc5c-3f4d-4607-986a-b3062061b460 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1519 microversion: 2.1 time: 0.169264 May 19 05:32:19.537313 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3243/6574] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:19 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:19.954468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-0cd44d4b-f831-47db-8ae1-c00aad59f78d req-b89a4ee6-ec2a-476d-afa4-2e1b9136e54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4491a97f-7aaf-4a00-82c8-533fd6c6cb4a", "name": "network-vif-unplugged", "status": "completed", "tag": "89ab2362-6308-4f72-abf3-d3445821da13"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:19.963927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0cd44d4b-f831-47db-8ae1-c00aad59f78d req-b89a4ee6-ec2a-476d-afa4-2e1b9136e54e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:19.964383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-0cd44d4b-f831-47db-8ae1-c00aad59f78d req-b89a4ee6-ec2a-476d-afa4-2e1b9136e54e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:19.976760 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-0cd44d4b-f831-47db-8ae1-c00aad59f78d req-b89a4ee6-ec2a-476d-afa4-2e1b9136e54e service nova] Creating event network-vif-unplugged:89ab2362-6308-4f72-abf3-d3445821da13 for instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a on n-h1-766726-30 May 19 05:32:19.982367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-0cd44d4b-f831-47db-8ae1-c00aad59f78d req-b89a4ee6-ec2a-476d-afa4-2e1b9136e54e service nova] Instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:32:19.994174 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-0cd44d4b-f831-47db-8ae1-c00aad59f78d req-b89a4ee6-ec2a-476d-afa4-2e1b9136e54e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043609 May 19 05:32:19.994898 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3332/6575] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:32:20.554887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86cd2958-7251-40bf-a2b0-4a4d51bbc430 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:20.555506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-86cd2958-7251-40bf-a2b0-4a4d51bbc430 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:20.562449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86cd2958-7251-40bf-a2b0-4a4d51bbc430 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:20.562899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86cd2958-7251-40bf-a2b0-4a4d51bbc430 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:20.563657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86cd2958-7251-40bf-a2b0-4a4d51bbc430 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:20.564092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86cd2958-7251-40bf-a2b0-4a4d51bbc430 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:20.698979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-86cd2958-7251-40bf-a2b0-4a4d51bbc430 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:20.706867 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-86cd2958-7251-40bf-a2b0-4a4d51bbc430 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1518 microversion: 2.1 time: 0.155805 May 19 05:32:20.707469 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3244/6576] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:20 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:21.727381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86e6312d-396a-49b5-886a-2d7e4dd58bf7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:21.728121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86e6312d-396a-49b5-886a-2d7e4dd58bf7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:21.730106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=34 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:21.735637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86e6312d-396a-49b5-886a-2d7e4dd58bf7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:21.736101 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86e6312d-396a-49b5-886a-2d7e4dd58bf7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:21.736874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86e6312d-396a-49b5-886a-2d7e4dd58bf7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:21.737931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86e6312d-396a-49b5-886a-2d7e4dd58bf7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:21.867873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86e6312d-396a-49b5-886a-2d7e4dd58bf7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:21.875477 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86e6312d-396a-49b5-886a-2d7e4dd58bf7 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1516 microversion: 2.1 time: 0.154283 May 19 05:32:21.876057 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3333/6577] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:21 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:22.009296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1b19b2fe-1b13-4a0a-a309-a457dc677727 req-0b3528ff-879f-4cca-a9e7-60d6864f668a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4491a97f-7aaf-4a00-82c8-533fd6c6cb4a", "tag": "89ab2362-6308-4f72-abf3-d3445821da13"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:22.018209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1b19b2fe-1b13-4a0a-a309-a457dc677727 req-0b3528ff-879f-4cca-a9e7-60d6864f668a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:22.019160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1b19b2fe-1b13-4a0a-a309-a457dc677727 req-0b3528ff-879f-4cca-a9e7-60d6864f668a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:22.030550 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1b19b2fe-1b13-4a0a-a309-a457dc677727 req-0b3528ff-879f-4cca-a9e7-60d6864f668a service nova] Creating event network-changed:89ab2362-6308-4f72-abf3-d3445821da13 for instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a on n-h1-766726-30 May 19 05:32:22.036760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-1b19b2fe-1b13-4a0a-a309-a457dc677727 req-0b3528ff-879f-4cca-a9e7-60d6864f668a service nova] Instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:32:22.047830 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1b19b2fe-1b13-4a0a-a309-a457dc677727 req-0b3528ff-879f-4cca-a9e7-60d6864f668a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042190 May 19 05:32:22.048534 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3245/6578] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:32:22.892757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc34ac9f-4a8f-4019-9467-3998b27109af tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:22.893462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bc34ac9f-4a8f-4019-9467-3998b27109af tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:22.900382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc34ac9f-4a8f-4019-9467-3998b27109af tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:22.900852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc34ac9f-4a8f-4019-9467-3998b27109af tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:22.901670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc34ac9f-4a8f-4019-9467-3998b27109af tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:22.902127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc34ac9f-4a8f-4019-9467-3998b27109af tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:23.030761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bc34ac9f-4a8f-4019-9467-3998b27109af tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:23.038924 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bc34ac9f-4a8f-4019-9467-3998b27109af tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1513 microversion: 2.1 time: 0.150076 May 19 05:32:23.039446 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3334/6579] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:22 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:23.057001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13356db8-2fa4-46b0-844e-daf57e4f6fa3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:23.057663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13356db8-2fa4-46b0-844e-daf57e4f6fa3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:23.063884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13356db8-2fa4-46b0-844e-daf57e4f6fa3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:23.064333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13356db8-2fa4-46b0-844e-daf57e4f6fa3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:23.065115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13356db8-2fa4-46b0-844e-daf57e4f6fa3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:23.065560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13356db8-2fa4-46b0-844e-daf57e4f6fa3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:23.121397 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13356db8-2fa4-46b0-844e-daf57e4f6fa3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "POST /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a/action" status: 204 len: 0 microversion: 2.1 time: 0.069469 May 19 05:32:23.122017 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3246/6580] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:32:23 2022] POST /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:32:23.130136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b312fc8-0f9f-40c2-9308-5c8896474d9a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:23.130795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b312fc8-0f9f-40c2-9308-5c8896474d9a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:23.136782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b312fc8-0f9f-40c2-9308-5c8896474d9a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:23.137227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b312fc8-0f9f-40c2-9308-5c8896474d9a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:23.138019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b312fc8-0f9f-40c2-9308-5c8896474d9a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:23.138668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1b312fc8-0f9f-40c2-9308-5c8896474d9a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:23.352151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b312fc8-0f9f-40c2-9308-5c8896474d9a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:23.359819 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b312fc8-0f9f-40c2-9308-5c8896474d9a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1513 microversion: 2.1 time: 0.233605 May 19 05:32:23.360402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3335/6581] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:23 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:24.155163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-dab84dbf-9f06-40b5-a133-77ac8b14882b req-7fc6d1e4-0286-44ed-acce-b45bde222060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4491a97f-7aaf-4a00-82c8-533fd6c6cb4a", "name": "network-vif-plugged", "status": "completed", "tag": "89ab2362-6308-4f72-abf3-d3445821da13"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:24.164775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dab84dbf-9f06-40b5-a133-77ac8b14882b req-7fc6d1e4-0286-44ed-acce-b45bde222060 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:24.165591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-dab84dbf-9f06-40b5-a133-77ac8b14882b req-7fc6d1e4-0286-44ed-acce-b45bde222060 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:24.177859 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-dab84dbf-9f06-40b5-a133-77ac8b14882b req-7fc6d1e4-0286-44ed-acce-b45bde222060 service nova] Creating event network-vif-plugged:89ab2362-6308-4f72-abf3-d3445821da13 for instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a on n-h1-766726-30 May 19 05:32:24.191062 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-dab84dbf-9f06-40b5-a133-77ac8b14882b req-7fc6d1e4-0286-44ed-acce-b45bde222060 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040175 May 19 05:32:24.192370 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3247/6582] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:32:24.377038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b2f8f73b-1006-441c-9ce3-45e0435d66fb tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:24.377689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b2f8f73b-1006-441c-9ce3-45e0435d66fb tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:24.386048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2f8f73b-1006-441c-9ce3-45e0435d66fb tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:24.386507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2f8f73b-1006-441c-9ce3-45e0435d66fb tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:24.387282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2f8f73b-1006-441c-9ce3-45e0435d66fb tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:24.387733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b2f8f73b-1006-441c-9ce3-45e0435d66fb tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:24.518618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b2f8f73b-1006-441c-9ce3-45e0435d66fb tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:24.526297 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b2f8f73b-1006-441c-9ce3-45e0435d66fb tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1505 microversion: 2.1 time: 0.153181 May 19 05:32:24.526810 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3336/6583] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:24 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:24.543342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fba121e4-c6dd-461f-aef4-72d3990a43ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:24.544055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fba121e4-c6dd-461f-aef4-72d3990a43ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:24.551009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fba121e4-c6dd-461f-aef4-72d3990a43ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:24.551486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fba121e4-c6dd-461f-aef4-72d3990a43ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:24.552253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fba121e4-c6dd-461f-aef4-72d3990a43ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:24.552698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fba121e4-c6dd-461f-aef4-72d3990a43ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:24.678947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fba121e4-c6dd-461f-aef4-72d3990a43ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:24.686447 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fba121e4-c6dd-461f-aef4-72d3990a43ca tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1505 microversion: 2.1 time: 0.147364 May 19 05:32:24.687026 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3248/6584] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:24 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:24.707472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-626f1019-e48a-4814-8a72-0c2aa23103e3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:24.708102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-626f1019-e48a-4814-8a72-0c2aa23103e3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:24.714200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-626f1019-e48a-4814-8a72-0c2aa23103e3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:24.714667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-626f1019-e48a-4814-8a72-0c2aa23103e3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:24.715435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-626f1019-e48a-4814-8a72-0c2aa23103e3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:24.715888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-626f1019-e48a-4814-8a72-0c2aa23103e3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:24.844488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-626f1019-e48a-4814-8a72-0c2aa23103e3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:24.852203 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-626f1019-e48a-4814-8a72-0c2aa23103e3 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1505 microversion: 2.1 time: 0.149302 May 19 05:32:24.852771 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3337/6585] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:24 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:24.867643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-28cd3da1-2e62-4e8d-abd0-4641e06c5632 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:24.868146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-28cd3da1-2e62-4e8d-abd0-4641e06c5632 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:24.874065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28cd3da1-2e62-4e8d-abd0-4641e06c5632 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:24.874512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28cd3da1-2e62-4e8d-abd0-4641e06c5632 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:24.875270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28cd3da1-2e62-4e8d-abd0-4641e06c5632 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:24.875701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28cd3da1-2e62-4e8d-abd0-4641e06c5632 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:24.900358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-28cd3da1-2e62-4e8d-abd0-4641e06c5632 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:32:24.979785 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-28cd3da1-2e62-4e8d-abd0-4641e06c5632 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 204 len: 0 microversion: 2.1 time: 0.115528 May 19 05:32:24.980473 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3249/6586] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:32:24 2022] DELETE /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:32:24.996398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-870cb692-bf1b-4f69-b7fc-e0c86c9326ed tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:24.996943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-870cb692-bf1b-4f69-b7fc-e0c86c9326ed tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:25.003724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-870cb692-bf1b-4f69-b7fc-e0c86c9326ed tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:25.004188 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-870cb692-bf1b-4f69-b7fc-e0c86c9326ed tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:25.004971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-870cb692-bf1b-4f69-b7fc-e0c86c9326ed tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:25.005450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-870cb692-bf1b-4f69-b7fc-e0c86c9326ed tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:25.032513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-870cb692-bf1b-4f69-b7fc-e0c86c9326ed tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:32:25.076866 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.compute.api [None req-870cb692-bf1b-4f69-b7fc-e0c86c9326ed tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Instance is already in deleting state, ignoring this request May 19 05:32:25.077678 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-870cb692-bf1b-4f69-b7fc-e0c86c9326ed tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 204 len: 0 microversion: 2.1 time: 0.085325 May 19 05:32:25.078232 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3338/6587] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:32:24 2022] DELETE /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:32:25.086762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a10056fe-8805-4d4c-84ca-5ac735cad93f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:25.087504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a10056fe-8805-4d4c-84ca-5ac735cad93f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:25.093629 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a10056fe-8805-4d4c-84ca-5ac735cad93f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:25.094087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a10056fe-8805-4d4c-84ca-5ac735cad93f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:25.094886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a10056fe-8805-4d4c-84ca-5ac735cad93f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:25.095330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a10056fe-8805-4d4c-84ca-5ac735cad93f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:25.223935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a10056fe-8805-4d4c-84ca-5ac735cad93f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:25.231821 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a10056fe-8805-4d4c-84ca-5ac735cad93f tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1511 microversion: 2.1 time: 0.149376 May 19 05:32:25.232391 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3250/6588] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:25 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:26.249233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-609b6184-2547-4487-99ef-e5be0a06634a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:26.249861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-609b6184-2547-4487-99ef-e5be0a06634a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:26.257419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-609b6184-2547-4487-99ef-e5be0a06634a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:26.257886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-609b6184-2547-4487-99ef-e5be0a06634a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:26.258661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-609b6184-2547-4487-99ef-e5be0a06634a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:26.259112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-609b6184-2547-4487-99ef-e5be0a06634a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:26.387523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-609b6184-2547-4487-99ef-e5be0a06634a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54b4e32337742298147bb652c0b01ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7eb6e516fb642ad905fa2d3078bb18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:26.395748 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-609b6184-2547-4487-99ef-e5be0a06634a tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 200 len: 1511 microversion: 2.1 time: 0.150522 May 19 05:32:26.396340 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3339/6589] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:26 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:26.803405 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-debb1eb4-0598-4514-bb1a-2c399f030d28 req-00065c77-155a-4003-877a-6dba63671131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4491a97f-7aaf-4a00-82c8-533fd6c6cb4a", "name": "network-vif-deleted", "tag": "89ab2362-6308-4f72-abf3-d3445821da13"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:26.812657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-debb1eb4-0598-4514-bb1a-2c399f030d28 req-00065c77-155a-4003-877a-6dba63671131 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:26.813119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-debb1eb4-0598-4514-bb1a-2c399f030d28 req-00065c77-155a-4003-877a-6dba63671131 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:26.824987 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-debb1eb4-0598-4514-bb1a-2c399f030d28 req-00065c77-155a-4003-877a-6dba63671131 service nova] Creating event network-vif-deleted:89ab2362-6308-4f72-abf3-d3445821da13 for instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a on n-h1-766726-30 May 19 05:32:26.832657 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-debb1eb4-0598-4514-bb1a-2c399f030d28 req-00065c77-155a-4003-877a-6dba63671131 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032754 May 19 05:32:26.833304 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3251/6590] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:32:27.412720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:27.413403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:27.420395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:27.420864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:27.421689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:27.422151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:27.436655 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] HTTP exception thrown: Instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a could not be found. May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Request method failure captured: May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a HTTP/1.1 May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdYPO_KbD0NSH0V9owd_DJFfci4w9HegLOxWFAVzglIvRFpPSnl5pHM0ntwrwE12TxYXFh_go5xN77VZxhQdRlfT7beoCJD7TbCaKkqyglxuyTPtIjm3vjoyWVyoZfimhqqaAvJWghVT277Mvb0NmfcZYEwtAL0uljm2VxLI3tuUx8Q May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: d7eb6e516fb642ad905fa2d3078bb18d May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerDiskConfigTestJSON-918236341 May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerDiskConfigTestJSON-918236341 May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: d7eb6e516fb642ad905fa2d3078bb18d May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-918236341 May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerDiskConfigTestJSON-918236341-project May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: f54b4e32337742298147bb652c0b01ed May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerDiskConfigTestJSON-918236341-project May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a could not be found. May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '4491a97f-7aaf-4a00-82c8-533fd6c6cb4a'} May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a could not be found. May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a could not be found. May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:32:27.438410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a could not be found. May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Returning 404 to user: Instance 4491a97f-7aaf-4a00-82c8-533fd6c6cb4a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1915aed0-6b27-49d8-8f4e-5f8b9384efc6 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a" status: 404 len: 111 microversion: 2.1 time: 0.031814 May 19 05:32:27.443566 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3340/6591] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:27 2022] GET /compute/v2.1/servers/4491a97f-7aaf-4a00-82c8-533fd6c6cb4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:32:27.451254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:27.451839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:27.458633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:27.459097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:27.459835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:27.460270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:27.475312 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] HTTP exception thrown: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Request method failure captured: May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e HTTP/1.1 May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdYPO_KbD0NSH0V9owd_DJFfci4w9HegLOxWFAVzglIvRFpPSnl5pHM0ntwrwE12TxYXFh_go5xN77VZxhQdRlfT7beoCJD7TbCaKkqyglxuyTPtIjm3vjoyWVyoZfimhqqaAvJWghVT277Mvb0NmfcZYEwtAL0uljm2VxLI3tuUx8Q May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: d7eb6e516fb642ad905fa2d3078bb18d May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerDiskConfigTestJSON-918236341 May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerDiskConfigTestJSON-918236341 May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: d7eb6e516fb642ad905fa2d3078bb18d May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-918236341 May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerDiskConfigTestJSON-918236341-project May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f54b4e32337742298147bb652c0b01ed May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerDiskConfigTestJSON-918236341-project May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '94b9ce6d-c236-477e-9d86-ee7619dc334e'} May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:32:27.477396 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Returning 404 to user: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87f9d580-b2d2-41f5-b091-570439636545 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "DELETE /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 404 len: 111 microversion: 2.1 time: 0.032024 May 19 05:32:27.482157 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3252/6592] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:32:27 2022] DELETE /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:32:27.488972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:27.489923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] [instance: 94b9ce6d-c236-477e-9d86-ee7619dc334e] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:27.496736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:27.497250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:27.498783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:27.498783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:27.514321 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] HTTP exception thrown: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Request method failure captured: May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e HTTP/1.1 May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdYPO_KbD0NSH0V9owd_DJFfci4w9HegLOxWFAVzglIvRFpPSnl5pHM0ntwrwE12TxYXFh_go5xN77VZxhQdRlfT7beoCJD7TbCaKkqyglxuyTPtIjm3vjoyWVyoZfimhqqaAvJWghVT277Mvb0NmfcZYEwtAL0uljm2VxLI3tuUx8Q May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: d7eb6e516fb642ad905fa2d3078bb18d May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerDiskConfigTestJSON-918236341 May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d7eb6e516fb642ad905fa2d3078bb18d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerDiskConfigTestJSON-918236341 May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: d7eb6e516fb642ad905fa2d3078bb18d May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-918236341 May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerDiskConfigTestJSON-918236341-project May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: f54b4e32337742298147bb652c0b01ed May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerDiskConfigTestJSON-918236341-project May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '94b9ce6d-c236-477e-9d86-ee7619dc334e'} May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:32:27.516066 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.521973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:32:27.521973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:32:27.521973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:32:27.521973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:32:27.521973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:32:27.521973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. May 19 05:32:27.521973 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:32:27.521973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] Returning 404 to user: Instance 94b9ce6d-c236-477e-9d86-ee7619dc334e could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:32:27.521973 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-69894c23-f62e-42df-ab98-f3a0dc8612d1 tempest-ServerDiskConfigTestJSON-918236341 tempest-ServerDiskConfigTestJSON-918236341-project] 10.222.0.58 "GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e" status: 404 len: 111 microversion: 2.1 time: 0.033153 May 19 05:32:27.523512 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3341/6593] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:27 2022] GET /compute/v2.1/servers/94b9ce6d-c236-477e-9d86-ee7619dc334e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:32:33.457132 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ef28d0c-592c-45d6-a8f7-956f6d4bb968 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'create', calling method: .version_select at 0x7fd3144ff670>, body: {"keypair": {"name": "tempest-keypair-1240287522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObpVH1ANoFXBk3RfAvp0H0ung/D8Cz65IrjLGPPXMhGi+A0Qx+MFb/Ft6ddjRgcqEj57EkcdGKKqhM6Ef3LthaT88jskXplp+nHDBSimDh2QP2cO0RIaTg9Y2AlZb1OQg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:33.477563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-2ef28d0c-592c-45d6-a8f7-956f6d4bb968 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for project 61f9a405a6b347678b031acfa4e56717. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:32:33.484214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-2ef28d0c-592c-45d6-a8f7-956f6d4bb968 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for user 804f458dff054b0db747dd434a73fcc5 and project 61f9a405a6b347678b031acfa4e56717. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:32:33.515160 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ef28d0c-592c-45d6-a8f7-956f6d4bb968 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.187119 May 19 05:32:33.515774 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3253/6594] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:32:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:32:34.829525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2062660323", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5e4b2f1-a2a4-4049-8b40-f59ae16473b6"}], "security_groups": [{"name": "tempest-securitygroup--469202799"}], "key_name": "tempest-keypair-1240287522", "user_data": "}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:34.946623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] validate_networks() for [('e5e4b2f1-a2a4-4049-8b40-f59ae16473b6', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:32:35.327749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:32:35.328465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:32:35.328963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:32:35.329416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:32:35.330189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:32:35.339882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:35.340359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:35.341222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:35.341681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:35.358811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:32:35.364225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for user 804f458dff054b0db747dd434a73fcc5 and project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:32:35.378186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:32:35.380559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:32:35.431136 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d586289a-ee78-48fd-97ce-01fcff0b2c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.605967 May 19 05:32:35.432404 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3342/6595] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:32:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:32:35.442671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8a8a1e48-7df2-45d4-969f-ab50e707e354 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:35.446336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8a8a1e48-7df2-45d4-969f-ab50e707e354 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:35.530633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8a8a1e48-7df2-45d4-969f-ab50e707e354 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:35.542289 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8a8a1e48-7df2-45d4-969f-ab50e707e354 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1239 microversion: 2.1 time: 0.104001 May 19 05:32:35.554891 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3254/6596] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:35 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1239 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:36.568345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8ea5f93-0a01-412a-ae09-3ef96b36392e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:36.570316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8ea5f93-0a01-412a-ae09-3ef96b36392e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:36.580083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8ea5f93-0a01-412a-ae09-3ef96b36392e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:36.581722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8ea5f93-0a01-412a-ae09-3ef96b36392e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:36.582566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8ea5f93-0a01-412a-ae09-3ef96b36392e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:36.583151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8ea5f93-0a01-412a-ae09-3ef96b36392e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:36.661039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8ea5f93-0a01-412a-ae09-3ef96b36392e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:36.672795 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8ea5f93-0a01-412a-ae09-3ef96b36392e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1291 microversion: 2.1 time: 0.115052 May 19 05:32:36.677201 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3343/6597] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:36 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1291 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:37.691325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a643198c-be1d-4613-a9bd-d8d86f1e892a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:37.692754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a643198c-be1d-4613-a9bd-d8d86f1e892a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:37.699711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:37.701779 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a643198c-be1d-4613-a9bd-d8d86f1e892a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:37.702540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a643198c-be1d-4613-a9bd-d8d86f1e892a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:37.703622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a643198c-be1d-4613-a9bd-d8d86f1e892a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:37.704447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a643198c-be1d-4613-a9bd-d8d86f1e892a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:38.208345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2e9554c6-d287-47d8-bba8-42cee01d9139 req-fc05d6a3-11dd-494d-9b13-818f7ae3529b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc9c9e7-c052-43da-9736-de63bc9dcd98", "tag": "f5147fe3-feea-44f2-90cb-5908d065ddfc"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:38.216435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a643198c-be1d-4613-a9bd-d8d86f1e892a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:38.225537 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a643198c-be1d-4613-a9bd-d8d86f1e892a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1364 microversion: 2.1 time: 0.539738 May 19 05:32:38.226380 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3255/6598] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:37 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1364 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:38.238651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2e9554c6-d287-47d8-bba8-42cee01d9139 req-fc05d6a3-11dd-494d-9b13-818f7ae3529b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:38.239356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2e9554c6-d287-47d8-bba8-42cee01d9139 req-fc05d6a3-11dd-494d-9b13-818f7ae3529b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:38.255565 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2e9554c6-d287-47d8-bba8-42cee01d9139 req-fc05d6a3-11dd-494d-9b13-818f7ae3529b service nova] Creating event network-changed:f5147fe3-feea-44f2-90cb-5908d065ddfc for instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 on n-h1-766726-30 May 19 05:32:38.261790 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2e9554c6-d287-47d8-bba8-42cee01d9139 req-fc05d6a3-11dd-494d-9b13-818f7ae3529b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056484 May 19 05:32:38.263466 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3344/6599] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:32:39.243143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7ee32b69-3b22-4f35-bde9-08758a8b6cb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:39.243696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7ee32b69-3b22-4f35-bde9-08758a8b6cb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:39.250660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ee32b69-3b22-4f35-bde9-08758a8b6cb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:39.251119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ee32b69-3b22-4f35-bde9-08758a8b6cb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:39.251889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ee32b69-3b22-4f35-bde9-08758a8b6cb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:39.252336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ee32b69-3b22-4f35-bde9-08758a8b6cb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:39.383246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7ee32b69-3b22-4f35-bde9-08758a8b6cb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:39.390724 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7ee32b69-3b22-4f35-bde9-08758a8b6cb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1364 microversion: 2.1 time: 0.151675 May 19 05:32:39.391304 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3256/6600] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:39 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:40.409271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-043724b4-6643-487a-ab8d-8361de1014b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:40.410003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-043724b4-6643-487a-ab8d-8361de1014b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:40.417463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-043724b4-6643-487a-ab8d-8361de1014b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:40.417939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-043724b4-6643-487a-ab8d-8361de1014b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:40.418729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-043724b4-6643-487a-ab8d-8361de1014b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:40.419187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-043724b4-6643-487a-ab8d-8361de1014b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:40.550854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-043724b4-6643-487a-ab8d-8361de1014b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:40.558591 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-043724b4-6643-487a-ab8d-8361de1014b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1364 microversion: 2.1 time: 0.154213 May 19 05:32:40.559179 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3345/6601] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:40 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:41.574807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a161567c-2c4d-4e9b-8cf9-5d72e674c25d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:41.575424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a161567c-2c4d-4e9b-8cf9-5d72e674c25d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:41.582627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a161567c-2c4d-4e9b-8cf9-5d72e674c25d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:41.583012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a161567c-2c4d-4e9b-8cf9-5d72e674c25d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:41.583767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a161567c-2c4d-4e9b-8cf9-5d72e674c25d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:41.584212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a161567c-2c4d-4e9b-8cf9-5d72e674c25d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:41.709110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a161567c-2c4d-4e9b-8cf9-5d72e674c25d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:41.716644 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a161567c-2c4d-4e9b-8cf9-5d72e674c25d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1364 microversion: 2.1 time: 0.145687 May 19 05:32:41.717237 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3257/6602] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:41 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:42.259541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-61469818-e584-459c-95d5-c83fbb3c6a5e req-f569449b-a1ba-4591-894a-72c3f842d76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc9c9e7-c052-43da-9736-de63bc9dcd98", "name": "network-vif-plugged", "status": "completed", "tag": "f5147fe3-feea-44f2-90cb-5908d065ddfc"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:42.270196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-61469818-e584-459c-95d5-c83fbb3c6a5e req-f569449b-a1ba-4591-894a-72c3f842d76d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:42.270651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-61469818-e584-459c-95d5-c83fbb3c6a5e req-f569449b-a1ba-4591-894a-72c3f842d76d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:42.286828 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-61469818-e584-459c-95d5-c83fbb3c6a5e req-f569449b-a1ba-4591-894a-72c3f842d76d service nova] Creating event network-vif-plugged:f5147fe3-feea-44f2-90cb-5908d065ddfc for instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 on n-h1-766726-30 May 19 05:32:42.292840 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-61469818-e584-459c-95d5-c83fbb3c6a5e req-f569449b-a1ba-4591-894a-72c3f842d76d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037854 May 19 05:32:42.293493 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3346/6603] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:32:42.732976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9831e3be-350f-4790-9da6-e264cb5e520e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:42.733563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9831e3be-350f-4790-9da6-e264cb5e520e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:42.740503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9831e3be-350f-4790-9da6-e264cb5e520e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:42.740962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9831e3be-350f-4790-9da6-e264cb5e520e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:42.741829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9831e3be-350f-4790-9da6-e264cb5e520e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:42.742280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9831e3be-350f-4790-9da6-e264cb5e520e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:42.868336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9831e3be-350f-4790-9da6-e264cb5e520e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:42.875857 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9831e3be-350f-4790-9da6-e264cb5e520e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1364 microversion: 2.1 time: 0.146897 May 19 05:32:42.876435 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3258/6604] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:42 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:43.894081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7d4779e3-a566-4767-b969-6e3525d91b4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:43.894805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7d4779e3-a566-4767-b969-6e3525d91b4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:43.901938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d4779e3-a566-4767-b969-6e3525d91b4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:43.902405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d4779e3-a566-4767-b969-6e3525d91b4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:43.903183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d4779e3-a566-4767-b969-6e3525d91b4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:43.903636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7d4779e3-a566-4767-b969-6e3525d91b4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:43.910029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:44.054444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7d4779e3-a566-4767-b969-6e3525d91b4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:44.062115 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7d4779e3-a566-4767-b969-6e3525d91b4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1551 microversion: 2.1 time: 0.172641 May 19 05:32:44.062706 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3347/6605] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:43 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:44.078182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-329770ed-e0c0-4953-89ff-3bc81530bb72 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:44.078691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-329770ed-e0c0-4953-89ff-3bc81530bb72 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:44.085539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-329770ed-e0c0-4953-89ff-3bc81530bb72 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:44.085986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-329770ed-e0c0-4953-89ff-3bc81530bb72 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:44.086738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-329770ed-e0c0-4953-89ff-3bc81530bb72 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:44.087172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-329770ed-e0c0-4953-89ff-3bc81530bb72 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:44.164556 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-329770ed-e0c0-4953-89ff-3bc81530bb72 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090170 May 19 05:32:44.165195 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3259/6606] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 05:32:44 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:32:45.076506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-39ca2d06-9440-4878-ad8b-7328e8a7de0f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:45.077174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-39ca2d06-9440-4878-ad8b-7328e8a7de0f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:45.079084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e1e04151-35c5-44e5-a824-4adfc9ff2b8a req-3fee089c-9d64-4b34-8ab5-71c3a7624372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc9c9e7-c052-43da-9736-de63bc9dcd98", "tag": "f5147fe3-feea-44f2-90cb-5908d065ddfc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:45.084332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39ca2d06-9440-4878-ad8b-7328e8a7de0f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:45.084804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39ca2d06-9440-4878-ad8b-7328e8a7de0f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:45.085633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39ca2d06-9440-4878-ad8b-7328e8a7de0f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:45.086095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-39ca2d06-9440-4878-ad8b-7328e8a7de0f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:45.089924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e1e04151-35c5-44e5-a824-4adfc9ff2b8a req-3fee089c-9d64-4b34-8ab5-71c3a7624372 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:45.090856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e1e04151-35c5-44e5-a824-4adfc9ff2b8a req-3fee089c-9d64-4b34-8ab5-71c3a7624372 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:45.103962 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e1e04151-35c5-44e5-a824-4adfc9ff2b8a req-3fee089c-9d64-4b34-8ab5-71c3a7624372 service nova] Creating event network-changed:f5147fe3-feea-44f2-90cb-5908d065ddfc for instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 on n-h1-766726-30 May 19 05:32:45.109935 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e1e04151-35c5-44e5-a824-4adfc9ff2b8a req-3fee089c-9d64-4b34-8ab5-71c3a7624372 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035175 May 19 05:32:45.110879 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3260/6607] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:32:45.223184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-39ca2d06-9440-4878-ad8b-7328e8a7de0f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:45.232380 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-39ca2d06-9440-4878-ad8b-7328e8a7de0f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1551 microversion: 2.1 time: 0.160227 May 19 05:32:45.243457 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3348/6608] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:45 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:45.249684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e8944cb-6061-4e00-b9ba-8b7af982f8b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:45.250634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e8944cb-6061-4e00-b9ba-8b7af982f8b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:45.259385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8944cb-6061-4e00-b9ba-8b7af982f8b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:45.260106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8944cb-6061-4e00-b9ba-8b7af982f8b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:45.261089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8944cb-6061-4e00-b9ba-8b7af982f8b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:45.261859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e8944cb-6061-4e00-b9ba-8b7af982f8b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:45.404206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8e8944cb-6061-4e00-b9ba-8b7af982f8b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:45.413239 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e8944cb-6061-4e00-b9ba-8b7af982f8b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1551 microversion: 2.1 time: 0.167760 May 19 05:32:45.413831 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3261/6609] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:45 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1551 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:46.430903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-638a1a10-a097-45ca-aaab-08a62761e770 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:46.431588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-638a1a10-a097-45ca-aaab-08a62761e770 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:46.433507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:46.434199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:46.441282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638a1a10-a097-45ca-aaab-08a62761e770 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:46.441753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638a1a10-a097-45ca-aaab-08a62761e770 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:46.442523 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638a1a10-a097-45ca-aaab-08a62761e770 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:46.442972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-638a1a10-a097-45ca-aaab-08a62761e770 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:46.571091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-638a1a10-a097-45ca-aaab-08a62761e770 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:46.578560 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-638a1a10-a097-45ca-aaab-08a62761e770 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1669 microversion: 2.1 time: 0.151692 May 19 05:32:46.579137 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3349/6610] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:46 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:46.594766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c98f3112-8ec8-420a-9ac5-f40c4241e495 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:46.595393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c98f3112-8ec8-420a-9ac5-f40c4241e495 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:46.597395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:46.603802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c98f3112-8ec8-420a-9ac5-f40c4241e495 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:46.604257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c98f3112-8ec8-420a-9ac5-f40c4241e495 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:46.605028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c98f3112-8ec8-420a-9ac5-f40c4241e495 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:46.605501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c98f3112-8ec8-420a-9ac5-f40c4241e495 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:46.731461 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c98f3112-8ec8-420a-9ac5-f40c4241e495 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:46.739523 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c98f3112-8ec8-420a-9ac5-f40c4241e495 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1669 microversion: 2.1 time: 0.148615 May 19 05:32:46.740102 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3262/6611] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:46 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:46.756868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:32:46.757877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:46.763877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:46.764334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:46.765127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:46.765576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:46.792804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:46.798440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Old instance type m1.heat2, new instance type m1.heat {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:32:46.805149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:32:46.805650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:32:46.806134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:32:46.806554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:32:46.806973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:32:46.868715 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c15b6d64-2991-4cc5-b1da-b2c46866c118 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98/action" status: 202 len: 0 microversion: 2.1 time: 0.116755 May 19 05:32:46.869578 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3350/6612] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:32:46 2022] POST /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:32:46.881534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-309cef3a-f1d9-4983-9bd0-4425ece7e8e1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:46.882159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-309cef3a-f1d9-4983-9bd0-4425ece7e8e1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:46.888196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-309cef3a-f1d9-4983-9bd0-4425ece7e8e1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:46.888655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-309cef3a-f1d9-4983-9bd0-4425ece7e8e1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:46.889560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-309cef3a-f1d9-4983-9bd0-4425ece7e8e1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:46.889939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-309cef3a-f1d9-4983-9bd0-4425ece7e8e1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:47.046659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-309cef3a-f1d9-4983-9bd0-4425ece7e8e1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:47.054527 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-309cef3a-f1d9-4983-9bd0-4425ece7e8e1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1678 microversion: 2.1 time: 0.177425 May 19 05:32:47.055428 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3263/6613] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:46 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:48.073953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9236cd89-acc1-4768-9bd9-db91e3e2a59f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:48.074586 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9236cd89-acc1-4768-9bd9-db91e3e2a59f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:48.081731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9236cd89-acc1-4768-9bd9-db91e3e2a59f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:48.082196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9236cd89-acc1-4768-9bd9-db91e3e2a59f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:48.082976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9236cd89-acc1-4768-9bd9-db91e3e2a59f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:48.083419 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9236cd89-acc1-4768-9bd9-db91e3e2a59f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:48.219689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9236cd89-acc1-4768-9bd9-db91e3e2a59f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:48.228522 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9236cd89-acc1-4768-9bd9-db91e3e2a59f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1678 microversion: 2.1 time: 0.160290 May 19 05:32:48.229145 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3351/6614] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:48 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:49.246351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-01e3b0b7-72c8-4a4a-937e-1945871c960f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:49.246884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-01e3b0b7-72c8-4a4a-937e-1945871c960f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:49.254624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01e3b0b7-72c8-4a4a-937e-1945871c960f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:49.255070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01e3b0b7-72c8-4a4a-937e-1945871c960f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:49.255826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01e3b0b7-72c8-4a4a-937e-1945871c960f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:49.256262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-01e3b0b7-72c8-4a4a-937e-1945871c960f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:49.384500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-01e3b0b7-72c8-4a4a-937e-1945871c960f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:49.392138 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-01e3b0b7-72c8-4a4a-937e-1945871c960f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.150119 May 19 05:32:49.392714 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3264/6615] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:49 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:50.409255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9f2311fe-ebd4-45f5-82ac-e8f97016dee7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:50.410458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9f2311fe-ebd4-45f5-82ac-e8f97016dee7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:50.417353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f2311fe-ebd4-45f5-82ac-e8f97016dee7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:50.417813 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f2311fe-ebd4-45f5-82ac-e8f97016dee7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:50.418582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f2311fe-ebd4-45f5-82ac-e8f97016dee7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:50.419028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f2311fe-ebd4-45f5-82ac-e8f97016dee7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:50.552940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9f2311fe-ebd4-45f5-82ac-e8f97016dee7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:50.560671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9f2311fe-ebd4-45f5-82ac-e8f97016dee7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.155392 May 19 05:32:50.561275 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3352/6616] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:50 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:51.577802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e774e7ba-b044-418c-a711-734d2e9d77b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:51.578428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e774e7ba-b044-418c-a711-734d2e9d77b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:51.581111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:51.587343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e774e7ba-b044-418c-a711-734d2e9d77b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:51.587796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e774e7ba-b044-418c-a711-734d2e9d77b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:51.588562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e774e7ba-b044-418c-a711-734d2e9d77b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:51.589005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e774e7ba-b044-418c-a711-734d2e9d77b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:51.716472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e774e7ba-b044-418c-a711-734d2e9d77b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:51.724009 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e774e7ba-b044-418c-a711-734d2e9d77b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.150154 May 19 05:32:51.724588 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3265/6617] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:51 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:52.742117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e0c133a4-5429-4e2d-ae43-0a70748012ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:52.742778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e0c133a4-5429-4e2d-ae43-0a70748012ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:52.744865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:32:52.751352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0c133a4-5429-4e2d-ae43-0a70748012ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:52.752213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0c133a4-5429-4e2d-ae43-0a70748012ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:52.754017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0c133a4-5429-4e2d-ae43-0a70748012ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:52.754487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e0c133a4-5429-4e2d-ae43-0a70748012ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:52.885647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e0c133a4-5429-4e2d-ae43-0a70748012ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:52.893304 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e0c133a4-5429-4e2d-ae43-0a70748012ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.155896 May 19 05:32:52.893873 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3353/6618] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:52 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:53.910918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a2fc694-2169-4f79-b7a9-79cf947d688e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:53.911538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4a2fc694-2169-4f79-b7a9-79cf947d688e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:53.918104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a2fc694-2169-4f79-b7a9-79cf947d688e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:53.918561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a2fc694-2169-4f79-b7a9-79cf947d688e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:53.919333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a2fc694-2169-4f79-b7a9-79cf947d688e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:53.919776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a2fc694-2169-4f79-b7a9-79cf947d688e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:54.053544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4a2fc694-2169-4f79-b7a9-79cf947d688e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:54.061041 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4a2fc694-2169-4f79-b7a9-79cf947d688e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.154601 May 19 05:32:54.061649 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3266/6619] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:53 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:55.078306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-093e8593-5f63-44fb-8067-6c603b55a28d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:55.078943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-093e8593-5f63-44fb-8067-6c603b55a28d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:55.087029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-093e8593-5f63-44fb-8067-6c603b55a28d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:55.087500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-093e8593-5f63-44fb-8067-6c603b55a28d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:55.088290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-093e8593-5f63-44fb-8067-6c603b55a28d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:55.088745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-093e8593-5f63-44fb-8067-6c603b55a28d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:55.218010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-093e8593-5f63-44fb-8067-6c603b55a28d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:55.226421 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-093e8593-5f63-44fb-8067-6c603b55a28d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.152071 May 19 05:32:55.227006 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3354/6620] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:55 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:56.244102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a94cc0ca-c1a8-4985-93ee-307cecb25237 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:56.244722 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a94cc0ca-c1a8-4985-93ee-307cecb25237 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:56.251707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a94cc0ca-c1a8-4985-93ee-307cecb25237 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:56.252159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a94cc0ca-c1a8-4985-93ee-307cecb25237 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:56.252924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a94cc0ca-c1a8-4985-93ee-307cecb25237 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:56.253401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a94cc0ca-c1a8-4985-93ee-307cecb25237 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:56.383930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a94cc0ca-c1a8-4985-93ee-307cecb25237 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:56.391425 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a94cc0ca-c1a8-4985-93ee-307cecb25237 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.151262 May 19 05:32:56.392006 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3267/6621] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:56 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:57.408872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fc60f958-fe78-4990-bf96-2e5f279eea08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:57.409568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fc60f958-fe78-4990-bf96-2e5f279eea08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:57.416558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc60f958-fe78-4990-bf96-2e5f279eea08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:57.417039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc60f958-fe78-4990-bf96-2e5f279eea08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:57.417844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc60f958-fe78-4990-bf96-2e5f279eea08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:57.418293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc60f958-fe78-4990-bf96-2e5f279eea08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:57.548365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fc60f958-fe78-4990-bf96-2e5f279eea08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:57.556652 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fc60f958-fe78-4990-bf96-2e5f279eea08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.152054 May 19 05:32:57.557690 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3355/6622] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:57 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:58.573873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87e294a1-054c-4bd3-9b17-b4df204df413 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:58.574437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-87e294a1-054c-4bd3-9b17-b4df204df413 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:58.582194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87e294a1-054c-4bd3-9b17-b4df204df413 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:58.582641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87e294a1-054c-4bd3-9b17-b4df204df413 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:58.583400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87e294a1-054c-4bd3-9b17-b4df204df413 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:58.583834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87e294a1-054c-4bd3-9b17-b4df204df413 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:58.723310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-87e294a1-054c-4bd3-9b17-b4df204df413 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:58.731093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87e294a1-054c-4bd3-9b17-b4df204df413 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.161173 May 19 05:32:58.731672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3268/6623] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:58 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:32:59.749408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66a1a7e7-84d6-4e34-a8f3-3611d794db2f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:32:59.749973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66a1a7e7-84d6-4e34-a8f3-3611d794db2f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:32:59.758318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66a1a7e7-84d6-4e34-a8f3-3611d794db2f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:59.758786 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66a1a7e7-84d6-4e34-a8f3-3611d794db2f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:59.759567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66a1a7e7-84d6-4e34-a8f3-3611d794db2f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:32:59.760024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66a1a7e7-84d6-4e34-a8f3-3611d794db2f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:32:59.896785 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-66a1a7e7-84d6-4e34-a8f3-3611d794db2f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:32:59.904430 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66a1a7e7-84d6-4e34-a8f3-3611d794db2f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.159127 May 19 05:32:59.905010 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3356/6624] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:32:59 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:00.921326 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6cc6a78-82fc-461e-b12f-46995178d3ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:00.921975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6cc6a78-82fc-461e-b12f-46995178d3ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:00.929210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6cc6a78-82fc-461e-b12f-46995178d3ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:00.929668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6cc6a78-82fc-461e-b12f-46995178d3ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:00.930441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6cc6a78-82fc-461e-b12f-46995178d3ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:00.930884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6cc6a78-82fc-461e-b12f-46995178d3ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:01.061346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d6cc6a78-82fc-461e-b12f-46995178d3ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:01.068874 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6cc6a78-82fc-461e-b12f-46995178d3ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.151574 May 19 05:33:01.069502 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3269/6625] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:00 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:02.085892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9992e13c-d482-4489-b21f-2a4acfd6c93e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:02.086543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9992e13c-d482-4489-b21f-2a4acfd6c93e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:02.093683 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9992e13c-d482-4489-b21f-2a4acfd6c93e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:02.094161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9992e13c-d482-4489-b21f-2a4acfd6c93e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:02.094953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9992e13c-d482-4489-b21f-2a4acfd6c93e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:02.095411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9992e13c-d482-4489-b21f-2a4acfd6c93e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:02.229711 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9992e13c-d482-4489-b21f-2a4acfd6c93e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:02.238035 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9992e13c-d482-4489-b21f-2a4acfd6c93e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.155517 May 19 05:33:02.238752 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3357/6626] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:02 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:03.255457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-445b605d-6b61-4b8d-b285-8246872a3f13 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:03.256078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-445b605d-6b61-4b8d-b285-8246872a3f13 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:03.263041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-445b605d-6b61-4b8d-b285-8246872a3f13 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:03.263490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-445b605d-6b61-4b8d-b285-8246872a3f13 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:03.264265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-445b605d-6b61-4b8d-b285-8246872a3f13 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:03.264707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-445b605d-6b61-4b8d-b285-8246872a3f13 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:03.395147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-445b605d-6b61-4b8d-b285-8246872a3f13 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:03.402867 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-445b605d-6b61-4b8d-b285-8246872a3f13 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.151386 May 19 05:33:03.403453 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3270/6627] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:03 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:33:04.419919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-415f5a4b-fedd-43bb-af0c-e0af3700463d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:04.420558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-415f5a4b-fedd-43bb-af0c-e0af3700463d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:04.428187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-415f5a4b-fedd-43bb-af0c-e0af3700463d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:04.428661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-415f5a4b-fedd-43bb-af0c-e0af3700463d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:04.429480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-415f5a4b-fedd-43bb-af0c-e0af3700463d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:04.429947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-415f5a4b-fedd-43bb-af0c-e0af3700463d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:04.562557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-415f5a4b-fedd-43bb-af0c-e0af3700463d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:04.570216 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-415f5a4b-fedd-43bb-af0c-e0af3700463d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.154332 May 19 05:33:04.570850 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3358/6628] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:04 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:05.587491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-95d3940b-e0f3-4d51-a8d6-55ac42ca1e89 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:05.588052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-95d3940b-e0f3-4d51-a8d6-55ac42ca1e89 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:05.595064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95d3940b-e0f3-4d51-a8d6-55ac42ca1e89 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:05.595518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95d3940b-e0f3-4d51-a8d6-55ac42ca1e89 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:05.596288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95d3940b-e0f3-4d51-a8d6-55ac42ca1e89 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:05.597358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-95d3940b-e0f3-4d51-a8d6-55ac42ca1e89 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:05.727413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-95d3940b-e0f3-4d51-a8d6-55ac42ca1e89 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:05.735053 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-95d3940b-e0f3-4d51-a8d6-55ac42ca1e89 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.151514 May 19 05:33:05.735672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3271/6629] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:05 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:06.752196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7b66130b-3515-498f-9276-ec94de24bb5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:06.753537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7b66130b-3515-498f-9276-ec94de24bb5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:06.760481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b66130b-3515-498f-9276-ec94de24bb5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:06.760946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b66130b-3515-498f-9276-ec94de24bb5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:06.761760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b66130b-3515-498f-9276-ec94de24bb5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:06.762212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7b66130b-3515-498f-9276-ec94de24bb5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:06.887399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7b66130b-3515-498f-9276-ec94de24bb5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:06.894901 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7b66130b-3515-498f-9276-ec94de24bb5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.147011 May 19 05:33:06.895482 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3359/6630] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:06 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:07.912716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0f0be11-a608-450f-8153-f52f3bdbd35d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:07.913479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b0f0be11-a608-450f-8153-f52f3bdbd35d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:07.920365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0f0be11-a608-450f-8153-f52f3bdbd35d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:07.920819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0f0be11-a608-450f-8153-f52f3bdbd35d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:07.921609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0f0be11-a608-450f-8153-f52f3bdbd35d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:07.922051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0f0be11-a608-450f-8153-f52f3bdbd35d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:07.924559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:33:08.055571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b0f0be11-a608-450f-8153-f52f3bdbd35d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:08.063166 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0f0be11-a608-450f-8153-f52f3bdbd35d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.154999 May 19 05:33:08.063757 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3272/6631] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:07 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:09.080746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-869cf61d-d4ee-4a35-b2c0-b9a0af23c902 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:09.081406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-869cf61d-d4ee-4a35-b2c0-b9a0af23c902 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:09.088508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869cf61d-d4ee-4a35-b2c0-b9a0af23c902 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:09.088972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869cf61d-d4ee-4a35-b2c0-b9a0af23c902 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:09.089765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869cf61d-d4ee-4a35-b2c0-b9a0af23c902 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:09.090215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-869cf61d-d4ee-4a35-b2c0-b9a0af23c902 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:09.219803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-869cf61d-d4ee-4a35-b2c0-b9a0af23c902 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:09.229069 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-869cf61d-d4ee-4a35-b2c0-b9a0af23c902 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.152149 May 19 05:33:09.229684 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3360/6632] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:09 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:10.246086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-21aff981-8c50-4275-970d-52b859e751aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:10.246695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-21aff981-8c50-4275-970d-52b859e751aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:10.254301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21aff981-8c50-4275-970d-52b859e751aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:10.254744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21aff981-8c50-4275-970d-52b859e751aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:10.255497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21aff981-8c50-4275-970d-52b859e751aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:10.255948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-21aff981-8c50-4275-970d-52b859e751aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:10.385837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-21aff981-8c50-4275-970d-52b859e751aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:10.393331 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-21aff981-8c50-4275-970d-52b859e751aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.151090 May 19 05:33:10.393906 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3273/6633] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:10 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:11.411234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f749744e-e3f3-407f-949c-44ffea469e76 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:11.411864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f749744e-e3f3-407f-949c-44ffea469e76 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:11.418812 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f749744e-e3f3-407f-949c-44ffea469e76 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:11.419278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f749744e-e3f3-407f-949c-44ffea469e76 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:11.420059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f749744e-e3f3-407f-949c-44ffea469e76 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:11.420516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f749744e-e3f3-407f-949c-44ffea469e76 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:11.546918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f749744e-e3f3-407f-949c-44ffea469e76 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:11.555394 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f749744e-e3f3-407f-949c-44ffea469e76 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.148805 May 19 05:33:11.555975 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3361/6634] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:11 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:12.573914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0124e95a-75dc-4544-9d33-16477ec36b08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:12.574559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0124e95a-75dc-4544-9d33-16477ec36b08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:12.582334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0124e95a-75dc-4544-9d33-16477ec36b08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:12.582716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0124e95a-75dc-4544-9d33-16477ec36b08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:12.583506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0124e95a-75dc-4544-9d33-16477ec36b08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:12.583942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0124e95a-75dc-4544-9d33-16477ec36b08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:12.715528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0124e95a-75dc-4544-9d33-16477ec36b08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:12.723123 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0124e95a-75dc-4544-9d33-16477ec36b08 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.153095 May 19 05:33:12.723704 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3274/6635] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:12 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:13.740975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-da54d59f-8b23-4317-bdb9-b7a82db27cfc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:13.741647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-da54d59f-8b23-4317-bdb9-b7a82db27cfc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:13.748626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da54d59f-8b23-4317-bdb9-b7a82db27cfc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:13.749126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da54d59f-8b23-4317-bdb9-b7a82db27cfc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:13.749965 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da54d59f-8b23-4317-bdb9-b7a82db27cfc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:13.750424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-da54d59f-8b23-4317-bdb9-b7a82db27cfc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:13.765696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:33:13.880282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-da54d59f-8b23-4317-bdb9-b7a82db27cfc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:13.887872 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-da54d59f-8b23-4317-bdb9-b7a82db27cfc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.151062 May 19 05:33:13.888454 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3362/6636] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:13 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:14.905360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e4f35750-1302-4cfc-9010-5b6c3a756582 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:14.905987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e4f35750-1302-4cfc-9010-5b6c3a756582 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:14.913414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4f35750-1302-4cfc-9010-5b6c3a756582 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:14.913871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4f35750-1302-4cfc-9010-5b6c3a756582 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:14.914643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4f35750-1302-4cfc-9010-5b6c3a756582 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:14.915087 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4f35750-1302-4cfc-9010-5b6c3a756582 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:15.051615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4f35750-1302-4cfc-9010-5b6c3a756582 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:15.059269 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e4f35750-1302-4cfc-9010-5b6c3a756582 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1683 microversion: 2.1 time: 0.157856 May 19 05:33:15.059856 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3275/6637] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:14 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:16.076321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e22b1ed3-f22f-454d-bc0a-7bd3ffd73c59 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:16.076969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e22b1ed3-f22f-454d-bc0a-7bd3ffd73c59 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:16.084947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e22b1ed3-f22f-454d-bc0a-7bd3ffd73c59 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:16.085440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e22b1ed3-f22f-454d-bc0a-7bd3ffd73c59 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:16.086217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e22b1ed3-f22f-454d-bc0a-7bd3ffd73c59 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:16.086666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e22b1ed3-f22f-454d-bc0a-7bd3ffd73c59 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:16.288050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e22b1ed3-f22f-454d-bc0a-7bd3ffd73c59 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:16.295696 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e22b1ed3-f22f-454d-bc0a-7bd3ffd73c59 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1682 microversion: 2.1 time: 0.223349 May 19 05:33:16.296316 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3363/6638] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:16 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:16.621486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d3edae91-c8c9-4589-a314-f1ccb3513664 req-29a29686-4ac9-4c31-bcff-fefed5ce2bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc9c9e7-c052-43da-9736-de63bc9dcd98", "name": "network-vif-unplugged", "status": "completed", "tag": "f5147fe3-feea-44f2-90cb-5908d065ddfc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:33:16.631551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d3edae91-c8c9-4589-a314-f1ccb3513664 req-29a29686-4ac9-4c31-bcff-fefed5ce2bd6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:16.632017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d3edae91-c8c9-4589-a314-f1ccb3513664 req-29a29686-4ac9-4c31-bcff-fefed5ce2bd6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:16.644357 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d3edae91-c8c9-4589-a314-f1ccb3513664 req-29a29686-4ac9-4c31-bcff-fefed5ce2bd6 service nova] Creating event network-vif-unplugged:f5147fe3-feea-44f2-90cb-5908d065ddfc for instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 on n-h2-766726-30 May 19 05:33:16.649900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-d3edae91-c8c9-4589-a314-f1ccb3513664 req-29a29686-4ac9-4c31-bcff-fefed5ce2bd6 service nova] Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:33:16.660760 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d3edae91-c8c9-4589-a314-f1ccb3513664 req-29a29686-4ac9-4c31-bcff-fefed5ce2bd6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043292 May 19 05:33:16.661568 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3276/6639] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:33:17.313508 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d663de27-546b-407b-b8d6-0aaa3c5a2532 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:17.314046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d663de27-546b-407b-b8d6-0aaa3c5a2532 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:17.321183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d663de27-546b-407b-b8d6-0aaa3c5a2532 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:17.321718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d663de27-546b-407b-b8d6-0aaa3c5a2532 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:17.322581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d663de27-546b-407b-b8d6-0aaa3c5a2532 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:17.323634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d663de27-546b-407b-b8d6-0aaa3c5a2532 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:17.564355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d663de27-546b-407b-b8d6-0aaa3c5a2532 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:17.577631 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d663de27-546b-407b-b8d6-0aaa3c5a2532 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1682 microversion: 2.1 time: 0.268231 May 19 05:33:17.578534 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3364/6640] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:17 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1682 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:18.597269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e4f74311-8ecf-4bee-81cb-996400ecedaf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:18.598004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e4f74311-8ecf-4bee-81cb-996400ecedaf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:18.604430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4f74311-8ecf-4bee-81cb-996400ecedaf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:18.604875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4f74311-8ecf-4bee-81cb-996400ecedaf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:18.605660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4f74311-8ecf-4bee-81cb-996400ecedaf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:18.606090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e4f74311-8ecf-4bee-81cb-996400ecedaf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:18.679598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-00a19daa-0649-41ac-9bcf-b7c90654ea2f req-daa146a4-334d-41e8-a798-5fed4b8aa8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc9c9e7-c052-43da-9736-de63bc9dcd98", "tag": "f5147fe3-feea-44f2-90cb-5908d065ddfc"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:33:18.688509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-00a19daa-0649-41ac-9bcf-b7c90654ea2f req-daa146a4-334d-41e8-a798-5fed4b8aa8c9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:18.688966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-00a19daa-0649-41ac-9bcf-b7c90654ea2f req-daa146a4-334d-41e8-a798-5fed4b8aa8c9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:18.701820 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-00a19daa-0649-41ac-9bcf-b7c90654ea2f req-daa146a4-334d-41e8-a798-5fed4b8aa8c9 service nova] Creating event network-changed:f5147fe3-feea-44f2-90cb-5908d065ddfc for instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 on n-h2-766726-30 May 19 05:33:18.709447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-00a19daa-0649-41ac-9bcf-b7c90654ea2f req-daa146a4-334d-41e8-a798-5fed4b8aa8c9 service nova] Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:33:18.720674 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-00a19daa-0649-41ac-9bcf-b7c90654ea2f req-daa146a4-334d-41e8-a798-5fed4b8aa8c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045459 May 19 05:33:18.722173 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3365/6641] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:33:18.752905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e4f74311-8ecf-4bee-81cb-996400ecedaf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:18.762880 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e4f74311-8ecf-4bee-81cb-996400ecedaf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1680 microversion: 2.1 time: 0.170739 May 19 05:33:18.763474 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3277/6642] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:18 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:19.782511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cad00919-956b-4e03-a013-e5bf316b9466 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:19.783227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cad00919-956b-4e03-a013-e5bf316b9466 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:19.790110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad00919-956b-4e03-a013-e5bf316b9466 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:19.790575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad00919-956b-4e03-a013-e5bf316b9466 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:19.791343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad00919-956b-4e03-a013-e5bf316b9466 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:19.791792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cad00919-956b-4e03-a013-e5bf316b9466 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:19.921153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cad00919-956b-4e03-a013-e5bf316b9466 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:19.928777 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cad00919-956b-4e03-a013-e5bf316b9466 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1677 microversion: 2.1 time: 0.151578 May 19 05:33:19.929420 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3366/6643] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:19 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:19.945442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-432162b9-010c-459b-9e81-0f5416123cf0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:33:19.946665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-432162b9-010c-459b-9e81-0f5416123cf0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:19.953941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432162b9-010c-459b-9e81-0f5416123cf0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:19.954421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432162b9-010c-459b-9e81-0f5416123cf0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:19.955194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432162b9-010c-459b-9e81-0f5416123cf0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:19.956218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-432162b9-010c-459b-9e81-0f5416123cf0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:20.012999 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-432162b9-010c-459b-9e81-0f5416123cf0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98/action" status: 204 len: 0 microversion: 2.1 time: 0.071568 May 19 05:33:20.013688 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3278/6644] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:33:19 2022] POST /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:33:20.022702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48df1892-03c5-4981-9b30-2b550a17fd8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:20.023340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48df1892-03c5-4981-9b30-2b550a17fd8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:20.029513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48df1892-03c5-4981-9b30-2b550a17fd8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:20.029974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48df1892-03c5-4981-9b30-2b550a17fd8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:20.030757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48df1892-03c5-4981-9b30-2b550a17fd8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:20.031214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48df1892-03c5-4981-9b30-2b550a17fd8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:20.169917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-48df1892-03c5-4981-9b30-2b550a17fd8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:20.178030 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48df1892-03c5-4981-9b30-2b550a17fd8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1677 microversion: 2.1 time: 0.160121 May 19 05:33:20.178719 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3367/6645] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:20 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:21.197726 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4eec5e9c-43ed-43f1-8be9-bb99909541c7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:21.199223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4eec5e9c-43ed-43f1-8be9-bb99909541c7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:21.205960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4eec5e9c-43ed-43f1-8be9-bb99909541c7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.206757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4eec5e9c-43ed-43f1-8be9-bb99909541c7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.207898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4eec5e9c-43ed-43f1-8be9-bb99909541c7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.208589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4eec5e9c-43ed-43f1-8be9-bb99909541c7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.354057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4eec5e9c-43ed-43f1-8be9-bb99909541c7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:21.362456 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4eec5e9c-43ed-43f1-8be9-bb99909541c7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1669 microversion: 2.1 time: 0.169540 May 19 05:33:21.363058 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3279/6646] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:21 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:21.379593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ab2cebb8-4e21-46d9-8087-0e50659725f0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:21.380745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ab2cebb8-4e21-46d9-8087-0e50659725f0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:21.387620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab2cebb8-4e21-46d9-8087-0e50659725f0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.388300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab2cebb8-4e21-46d9-8087-0e50659725f0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.389437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab2cebb8-4e21-46d9-8087-0e50659725f0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.389932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab2cebb8-4e21-46d9-8087-0e50659725f0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.527986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab2cebb8-4e21-46d9-8087-0e50659725f0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:21.536369 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ab2cebb8-4e21-46d9-8087-0e50659725f0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1669 microversion: 2.1 time: 0.161296 May 19 05:33:21.536942 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3368/6647] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:21 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:21.552687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd94eac0-611d-4f56-9953-d70da832410b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:21.553323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fd94eac0-611d-4f56-9953-d70da832410b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:21.559351 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd94eac0-611d-4f56-9953-d70da832410b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.559796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd94eac0-611d-4f56-9953-d70da832410b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.560550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd94eac0-611d-4f56-9953-d70da832410b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.560988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd94eac0-611d-4f56-9953-d70da832410b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.686070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fd94eac0-611d-4f56-9953-d70da832410b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:21.693537 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd94eac0-611d-4f56-9953-d70da832410b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1669 microversion: 2.1 time: 0.145258 May 19 05:33:21.694101 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3280/6648] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:21 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1669 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:21.709415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dc151568-3f98-4e74-957d-3788ce8b5018 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:21.709929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dc151568-3f98-4e74-957d-3788ce8b5018 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:21.715921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc151568-3f98-4e74-957d-3788ce8b5018 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.716377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc151568-3f98-4e74-957d-3788ce8b5018 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.717568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc151568-3f98-4e74-957d-3788ce8b5018 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.718014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc151568-3f98-4e74-957d-3788ce8b5018 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.743618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dc151568-3f98-4e74-957d-3788ce8b5018 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:33:21.815412 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dc151568-3f98-4e74-957d-3788ce8b5018 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 204 len: 0 microversion: 2.1 time: 0.109525 May 19 05:33:21.815985 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3369/6649] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:33:21 2022] DELETE /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:33:21.824202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ca1f0c5-f9af-43c3-bdc4-9f6eedb4ae4d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:21.824820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9ca1f0c5-f9af-43c3-bdc4-9f6eedb4ae4d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:21.826803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=32 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:33:21.832035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ca1f0c5-f9af-43c3-bdc4-9f6eedb4ae4d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.832479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ca1f0c5-f9af-43c3-bdc4-9f6eedb4ae4d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.833279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ca1f0c5-f9af-43c3-bdc4-9f6eedb4ae4d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:21.833716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ca1f0c5-f9af-43c3-bdc4-9f6eedb4ae4d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:21.962835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9ca1f0c5-f9af-43c3-bdc4-9f6eedb4ae4d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:21.970400 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ca1f0c5-f9af-43c3-bdc4-9f6eedb4ae4d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1675 microversion: 2.1 time: 0.150096 May 19 05:33:21.970978 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3281/6650] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:21 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:22.988298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-80601514-c6f0-408f-9dd0-7cfe6ff27ff9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:22.989019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-80601514-c6f0-408f-9dd0-7cfe6ff27ff9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:22.991788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:33:22.998264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80601514-c6f0-408f-9dd0-7cfe6ff27ff9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:22.998728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80601514-c6f0-408f-9dd0-7cfe6ff27ff9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:22.999510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80601514-c6f0-408f-9dd0-7cfe6ff27ff9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:22.999956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80601514-c6f0-408f-9dd0-7cfe6ff27ff9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:23.140525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-7a837279-8ee5-4b21-b7d8-9a2e2b6a9573 req-e7d680f1-b2a3-4d95-af49-70a26e85104d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc9c9e7-c052-43da-9736-de63bc9dcd98", "name": "network-vif-plugged", "status": "completed", "tag": "f5147fe3-feea-44f2-90cb-5908d065ddfc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:33:23.150891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7a837279-8ee5-4b21-b7d8-9a2e2b6a9573 req-e7d680f1-b2a3-4d95-af49-70a26e85104d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:23.151313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7a837279-8ee5-4b21-b7d8-9a2e2b6a9573 req-e7d680f1-b2a3-4d95-af49-70a26e85104d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:23.163395 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-7a837279-8ee5-4b21-b7d8-9a2e2b6a9573 req-e7d680f1-b2a3-4d95-af49-70a26e85104d service nova] Creating event network-vif-plugged:f5147fe3-feea-44f2-90cb-5908d065ddfc for instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 on n-h2-766726-30 May 19 05:33:23.168814 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-7a837279-8ee5-4b21-b7d8-9a2e2b6a9573 req-e7d680f1-b2a3-4d95-af49-70a26e85104d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 May 19 05:33:23.169482 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3282/6651] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:33:23.185754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-80601514-c6f0-408f-9dd0-7cfe6ff27ff9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:23.196777 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-80601514-c6f0-408f-9dd0-7cfe6ff27ff9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 200 len: 1675 microversion: 2.1 time: 0.212541 May 19 05:33:23.199568 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3370/6652] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:22 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:23.949509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5ddb3d30-32cc-4847-b343-35ea4727ead4 req-78927b56-f237-4236-93ae-583508ad4f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc9c9e7-c052-43da-9736-de63bc9dcd98", "name": "network-vif-deleted", "tag": "f5147fe3-feea-44f2-90cb-5908d065ddfc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:33:23.959129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5ddb3d30-32cc-4847-b343-35ea4727ead4 req-78927b56-f237-4236-93ae-583508ad4f6a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:23.959668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5ddb3d30-32cc-4847-b343-35ea4727ead4 req-78927b56-f237-4236-93ae-583508ad4f6a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:23.971513 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5ddb3d30-32cc-4847-b343-35ea4727ead4 req-78927b56-f237-4236-93ae-583508ad4f6a service nova] Creating event network-vif-deleted:f5147fe3-feea-44f2-90cb-5908d065ddfc for instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 on n-h2-766726-30 May 19 05:33:23.977267 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5ddb3d30-32cc-4847-b343-35ea4727ead4 req-78927b56-f237-4236-93ae-583508ad4f6a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032160 May 19 05:33:23.978093 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3283/6653] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:33:24.216382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:24.217030 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:24.224034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:24.224503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:24.225657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:24.226361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:24.240637 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 HTTP/1.1 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '7bc9c9e7-c052-43da-9736-de63bc9dcd98'} May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:33:24.242365 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e06157d-8ec8-4e13-8e08-d49569e49089 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 404 len: 111 microversion: 2.1 time: 0.031432 May 19 05:33:24.250709 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3371/6654] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:24 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:33:24.259254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:24.260230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:24.266371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:24.266675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:24.267448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:24.267919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:24.281187 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 HTTP/1.1 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '7bc9c9e7-c052-43da-9736-de63bc9dcd98'} May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:33:24.283028 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fb1e1e7f-2f96-45a8-b9e7-febe950f4a8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 404 len: 111 microversion: 2.1 time: 0.030522 May 19 05:33:24.288254 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3284/6655] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:24 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:33:24.333042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-152609025", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "e5e4b2f1-a2a4-4049-8b40-f59ae16473b6"}], "security_groups": [{"name": "tempest-securitygroup--469202799"}], "key_name": "tempest-keypair-1240287522", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:33:24.440990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] validate_networks() for [('e5e4b2f1-a2a4-4049-8b40-f59ae16473b6', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:33:24.818087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:33:24.818531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:33:24.819055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:33:24.819482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:33:24.819913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:33:24.828966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:24.829465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:24.830283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:24.830770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:24.848418 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:33:24.854115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for user 804f458dff054b0db747dd434a73fcc5 and project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:33:24.867046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:33:24.869383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:33:24.918200 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-66b239da-4eef-4a74-841d-5b399d946493 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.589081 May 19 05:33:24.919042 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3372/6656] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:33:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:33:24.929880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f685950-e861-4f8b-8fcd-9071a914fc0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:24.930874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7f685950-e861-4f8b-8fcd-9071a914fc0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:25.020240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7f685950-e861-4f8b-8fcd-9071a914fc0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:25.028701 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7f685950-e861-4f8b-8fcd-9071a914fc0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1238 microversion: 2.1 time: 0.103405 May 19 05:33:25.029300 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3285/6657] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:24 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1238 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:26.047784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-720857ba-b97c-4a34-a28b-bf38af4a47d5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:26.048611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-720857ba-b97c-4a34-a28b-bf38af4a47d5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:26.055388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-720857ba-b97c-4a34-a28b-bf38af4a47d5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:26.055858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-720857ba-b97c-4a34-a28b-bf38af4a47d5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:26.056644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-720857ba-b97c-4a34-a28b-bf38af4a47d5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:26.057309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-720857ba-b97c-4a34-a28b-bf38af4a47d5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:26.134897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-720857ba-b97c-4a34-a28b-bf38af4a47d5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:26.142575 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-720857ba-b97c-4a34-a28b-bf38af4a47d5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1296 microversion: 2.1 time: 0.099636 May 19 05:33:26.143543 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3373/6658] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:26 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:27.164985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eb8b6c1e-38f5-410f-8eeb-5103eea779fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:27.168745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eb8b6c1e-38f5-410f-8eeb-5103eea779fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:27.179498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb8b6c1e-38f5-410f-8eeb-5103eea779fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:27.180166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb8b6c1e-38f5-410f-8eeb-5103eea779fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:27.181401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb8b6c1e-38f5-410f-8eeb-5103eea779fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:27.181850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb8b6c1e-38f5-410f-8eeb-5103eea779fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:27.253816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-77ee1287-e645-42e4-a332-0bdc8769ebf5 req-d5b10d60-311e-4e02-9c84-a861513ce79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f8e102-bafb-40c8-9e47-ddc9f280781f", "tag": "5c206b05-0f75-4017-9a45-2af3f8fc8ff6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:33:27.265871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-77ee1287-e645-42e4-a332-0bdc8769ebf5 req-d5b10d60-311e-4e02-9c84-a861513ce79a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:27.266881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-77ee1287-e645-42e4-a332-0bdc8769ebf5 req-d5b10d60-311e-4e02-9c84-a861513ce79a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:27.295903 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-77ee1287-e645-42e4-a332-0bdc8769ebf5 req-d5b10d60-311e-4e02-9c84-a861513ce79a service nova] Creating event network-changed:5c206b05-0f75-4017-9a45-2af3f8fc8ff6 for instance 04f8e102-bafb-40c8-9e47-ddc9f280781f on n-h2-766726-30 May 19 05:33:27.307505 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-77ee1287-e645-42e4-a332-0bdc8769ebf5 req-d5b10d60-311e-4e02-9c84-a861513ce79a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056204 May 19 05:33:27.308633 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3374/6659] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:33:27.465815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eb8b6c1e-38f5-410f-8eeb-5103eea779fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:27.473342 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eb8b6c1e-38f5-410f-8eeb-5103eea779fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1363 microversion: 2.1 time: 0.314413 May 19 05:33:27.473925 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3286/6660] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:27 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:28.492744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a8ccf9e-2eaf-4bf6-a044-1784cd73229e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:28.493401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a8ccf9e-2eaf-4bf6-a044-1784cd73229e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:28.500091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a8ccf9e-2eaf-4bf6-a044-1784cd73229e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:28.500552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a8ccf9e-2eaf-4bf6-a044-1784cd73229e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:28.501737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a8ccf9e-2eaf-4bf6-a044-1784cd73229e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:28.501883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a8ccf9e-2eaf-4bf6-a044-1784cd73229e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:28.702171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a8ccf9e-2eaf-4bf6-a044-1784cd73229e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:28.710563 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a8ccf9e-2eaf-4bf6-a044-1784cd73229e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1363 microversion: 2.1 time: 0.223380 May 19 05:33:28.711453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3375/6661] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:28 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:29.727535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-268944ea-0592-4461-a68c-11a9bd26518c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:29.728150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-268944ea-0592-4461-a68c-11a9bd26518c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:29.735144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-268944ea-0592-4461-a68c-11a9bd26518c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:29.735600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-268944ea-0592-4461-a68c-11a9bd26518c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:29.736370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-268944ea-0592-4461-a68c-11a9bd26518c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:29.736817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-268944ea-0592-4461-a68c-11a9bd26518c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:29.881929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-268944ea-0592-4461-a68c-11a9bd26518c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:29.889374 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-268944ea-0592-4461-a68c-11a9bd26518c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1363 microversion: 2.1 time: 0.166035 May 19 05:33:29.889949 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3287/6662] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:29 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:30.906859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5d4c57a5-ce48-4bfa-8e27-f689084ae942 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:30.907490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5d4c57a5-ce48-4bfa-8e27-f689084ae942 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:30.914398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d4c57a5-ce48-4bfa-8e27-f689084ae942 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:30.914861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d4c57a5-ce48-4bfa-8e27-f689084ae942 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:30.915630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d4c57a5-ce48-4bfa-8e27-f689084ae942 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:30.916078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5d4c57a5-ce48-4bfa-8e27-f689084ae942 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:31.043600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5d4c57a5-ce48-4bfa-8e27-f689084ae942 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:31.051421 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5d4c57a5-ce48-4bfa-8e27-f689084ae942 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1363 microversion: 2.1 time: 0.148623 May 19 05:33:31.052010 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3376/6663] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:30 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:31.200990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e91d02c5-41c0-4d39-afd5-9bc42ae711ae req-d78df94d-df89-486e-a893-3d34eb788dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f8e102-bafb-40c8-9e47-ddc9f280781f", "name": "network-vif-plugged", "status": "completed", "tag": "5c206b05-0f75-4017-9a45-2af3f8fc8ff6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:33:31.211112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e91d02c5-41c0-4d39-afd5-9bc42ae711ae req-d78df94d-df89-486e-a893-3d34eb788dd4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:31.211581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e91d02c5-41c0-4d39-afd5-9bc42ae711ae req-d78df94d-df89-486e-a893-3d34eb788dd4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:31.222419 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e91d02c5-41c0-4d39-afd5-9bc42ae711ae req-d78df94d-df89-486e-a893-3d34eb788dd4 service nova] Creating event network-vif-plugged:5c206b05-0f75-4017-9a45-2af3f8fc8ff6 for instance 04f8e102-bafb-40c8-9e47-ddc9f280781f on n-h2-766726-30 May 19 05:33:31.227614 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e91d02c5-41c0-4d39-afd5-9bc42ae711ae req-d78df94d-df89-486e-a893-3d34eb788dd4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033052 May 19 05:33:31.228212 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3288/6664] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:33:32.067903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-06431cbf-b4ee-4916-a447-b2b9b40d9926 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:32.068532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-06431cbf-b4ee-4916-a447-b2b9b40d9926 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:32.075556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06431cbf-b4ee-4916-a447-b2b9b40d9926 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:32.076019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06431cbf-b4ee-4916-a447-b2b9b40d9926 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:32.077253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06431cbf-b4ee-4916-a447-b2b9b40d9926 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:32.078036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06431cbf-b4ee-4916-a447-b2b9b40d9926 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:32.207314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-06431cbf-b4ee-4916-a447-b2b9b40d9926 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:32.214835 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-06431cbf-b4ee-4916-a447-b2b9b40d9926 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1363 microversion: 2.1 time: 0.150936 May 19 05:33:32.215403 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3377/6665] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:32 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:33.233679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3dbe902d-e4a7-4043-bc1d-6029a566aead tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:33.234372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3dbe902d-e4a7-4043-bc1d-6029a566aead tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:33.241598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dbe902d-e4a7-4043-bc1d-6029a566aead tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:33.242054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dbe902d-e4a7-4043-bc1d-6029a566aead tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:33.242836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dbe902d-e4a7-4043-bc1d-6029a566aead tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:33.243279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3dbe902d-e4a7-4043-bc1d-6029a566aead tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:33.372096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3dbe902d-e4a7-4043-bc1d-6029a566aead tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:33:33.379779 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3dbe902d-e4a7-4043-bc1d-6029a566aead tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1550 microversion: 2.1 time: 0.151514 May 19 05:33:33.380363 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3289/6666] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:33:33 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:33:33.396421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f92c8324-b4a9-46bd-b4ce-4476c56ecd7f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:33:33.396952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f92c8324-b4a9-46bd-b4ce-4476c56ecd7f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:33:33.403868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f92c8324-b4a9-46bd-b4ce-4476c56ecd7f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:33.404338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f92c8324-b4a9-46bd-b4ce-4476c56ecd7f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:33.405148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f92c8324-b4a9-46bd-b4ce-4476c56ecd7f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:33.405788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f92c8324-b4a9-46bd-b4ce-4476c56ecd7f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:33.494663 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f92c8324-b4a9-46bd-b4ce-4476c56ecd7f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102096 May 19 05:33:33.495304 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3378/6667] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 05:33:33 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:33:34.380858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-e204af3f-48f2-4e6e-a828-1e5f88d2b482 req-da652cba-bb2c-41c6-be0e-a40c49d74efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f8e102-bafb-40c8-9e47-ddc9f280781f", "tag": "5c206b05-0f75-4017-9a45-2af3f8fc8ff6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:33:34.389793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e204af3f-48f2-4e6e-a828-1e5f88d2b482 req-da652cba-bb2c-41c6-be0e-a40c49d74efe service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:33:34.390244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-e204af3f-48f2-4e6e-a828-1e5f88d2b482 req-da652cba-bb2c-41c6-be0e-a40c49d74efe service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:33:34.401186 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-e204af3f-48f2-4e6e-a828-1e5f88d2b482 req-da652cba-bb2c-41c6-be0e-a40c49d74efe service nova] Creating event network-changed:5c206b05-0f75-4017-9a45-2af3f8fc8ff6 for instance 04f8e102-bafb-40c8-9e47-ddc9f280781f on n-h2-766726-30 May 19 05:33:34.406027 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-e204af3f-48f2-4e6e-a828-1e5f88d2b482 req-da652cba-bb2c-41c6-be0e-a40c49d74efe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029404 May 19 05:33:34.406838 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3290/6668] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:34:09.329631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:09.330673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:09.331498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:09.332521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:09.338803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0c33618-b4dd-41e1-a660-a3a25df9b61d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:09.347255 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0c33618-b4dd-41e1-a660-a3a25df9b61d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:09.347937 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0c33618-b4dd-41e1-a660-a3a25df9b61d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:09.374522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f0c33618-b4dd-41e1-a660-a3a25df9b61d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Going to try to stop instance {{(pid=124818) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 05:34:09.415447 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0c33618-b4dd-41e1-a660-a3a25df9b61d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/action" status: 202 len: 0 microversion: 2.1 time: 0.087903 May 19 05:34:09.416101 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3379/6669] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:34:09 2022] POST /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:34:09.421527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:09.423517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=21 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:09.424288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:09.428931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b071639-a40a-4bef-bbb2-7f28bcfc9ac2 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:09.429683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b071639-a40a-4bef-bbb2-7f28bcfc9ac2 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:09.438133 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b071639-a40a-4bef-bbb2-7f28bcfc9ac2 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:09.438591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b071639-a40a-4bef-bbb2-7f28bcfc9ac2 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:09.439365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b071639-a40a-4bef-bbb2-7f28bcfc9ac2 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:09.439802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b071639-a40a-4bef-bbb2-7f28bcfc9ac2 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:09.578008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b071639-a40a-4bef-bbb2-7f28bcfc9ac2 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:09.586320 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b071639-a40a-4bef-bbb2-7f28bcfc9ac2 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.165680 May 19 05:34:09.586830 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3291/6670] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:09 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:34:10.606311 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be7f0e06-22af-4f3b-9036-ace150157dda tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:10.606987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be7f0e06-22af-4f3b-9036-ace150157dda tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:10.613287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be7f0e06-22af-4f3b-9036-ace150157dda tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:10.613746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be7f0e06-22af-4f3b-9036-ace150157dda tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:10.614541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be7f0e06-22af-4f3b-9036-ace150157dda tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:10.614976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be7f0e06-22af-4f3b-9036-ace150157dda tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:10.820859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be7f0e06-22af-4f3b-9036-ace150157dda tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:10.828773 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be7f0e06-22af-4f3b-9036-ace150157dda tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.228039 May 19 05:34:10.829381 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3380/6671] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:10 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:11.846887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-02eb6724-ede4-4743-97ed-401c722a8d0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:11.847506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-02eb6724-ede4-4743-97ed-401c722a8d0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:11.856438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02eb6724-ede4-4743-97ed-401c722a8d0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:11.857005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02eb6724-ede4-4743-97ed-401c722a8d0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:11.857804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02eb6724-ede4-4743-97ed-401c722a8d0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:11.858245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-02eb6724-ede4-4743-97ed-401c722a8d0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:11.993266 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-02eb6724-ede4-4743-97ed-401c722a8d0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:12.000743 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-02eb6724-ede4-4743-97ed-401c722a8d0a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.157807 May 19 05:34:12.001366 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3292/6672] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:11 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:13.017946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2ad5e7c-dd10-4868-9bc2-73f87b4fd796 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:13.018581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2ad5e7c-dd10-4868-9bc2-73f87b4fd796 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:13.025522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2ad5e7c-dd10-4868-9bc2-73f87b4fd796 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:13.025986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2ad5e7c-dd10-4868-9bc2-73f87b4fd796 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:13.026757 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2ad5e7c-dd10-4868-9bc2-73f87b4fd796 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:13.027208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2ad5e7c-dd10-4868-9bc2-73f87b4fd796 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:13.154094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e2ad5e7c-dd10-4868-9bc2-73f87b4fd796 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:13.161695 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2ad5e7c-dd10-4868-9bc2-73f87b4fd796 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.147668 May 19 05:34:13.162271 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3381/6673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:13 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:14.178773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-72ecfccc-e0f4-42e6-99c4-e383b752a59e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:14.179417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72ecfccc-e0f4-42e6-99c4-e383b752a59e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:14.186388 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72ecfccc-e0f4-42e6-99c4-e383b752a59e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:14.186845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72ecfccc-e0f4-42e6-99c4-e383b752a59e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:14.187617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72ecfccc-e0f4-42e6-99c4-e383b752a59e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:14.188061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72ecfccc-e0f4-42e6-99c4-e383b752a59e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:14.324786 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-72ecfccc-e0f4-42e6-99c4-e383b752a59e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:14.332612 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-72ecfccc-e0f4-42e6-99c4-e383b752a59e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.157768 May 19 05:34:14.333269 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3293/6674] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:14 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:15.351276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9cd3ba86-5300-4127-b5aa-0bc249c57a5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:15.351960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9cd3ba86-5300-4127-b5aa-0bc249c57a5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:15.358881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd3ba86-5300-4127-b5aa-0bc249c57a5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:15.359342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd3ba86-5300-4127-b5aa-0bc249c57a5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:15.360111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd3ba86-5300-4127-b5aa-0bc249c57a5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:15.360560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd3ba86-5300-4127-b5aa-0bc249c57a5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:15.492574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9cd3ba86-5300-4127-b5aa-0bc249c57a5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:15.500203 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9cd3ba86-5300-4127-b5aa-0bc249c57a5a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.153834 May 19 05:34:15.500783 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3382/6675] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:15 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:16.517410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4e10d7d-e524-49b7-bdfc-ce3af0ce0bfe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:16.518031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4e10d7d-e524-49b7-bdfc-ce3af0ce0bfe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:16.525660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e10d7d-e524-49b7-bdfc-ce3af0ce0bfe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:16.526106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e10d7d-e524-49b7-bdfc-ce3af0ce0bfe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:16.526870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e10d7d-e524-49b7-bdfc-ce3af0ce0bfe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:16.527304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4e10d7d-e524-49b7-bdfc-ce3af0ce0bfe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:16.651143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a4e10d7d-e524-49b7-bdfc-ce3af0ce0bfe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:16.658628 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4e10d7d-e524-49b7-bdfc-ce3af0ce0bfe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.145188 May 19 05:34:16.659197 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3294/6676] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:16 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:17.675510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fef44519-bcf6-4a71-8fb1-fed3b31b46f6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:17.676143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fef44519-bcf6-4a71-8fb1-fed3b31b46f6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:17.683333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fef44519-bcf6-4a71-8fb1-fed3b31b46f6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:17.683801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fef44519-bcf6-4a71-8fb1-fed3b31b46f6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:17.684589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fef44519-bcf6-4a71-8fb1-fed3b31b46f6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:17.685043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fef44519-bcf6-4a71-8fb1-fed3b31b46f6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:17.825339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fef44519-bcf6-4a71-8fb1-fed3b31b46f6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:17.833794 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fef44519-bcf6-4a71-8fb1-fed3b31b46f6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.162529 May 19 05:34:17.834376 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3383/6677] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:17 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:18.851666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99dd5dff-c53a-4629-af73-859f50441a51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:18.852296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99dd5dff-c53a-4629-af73-859f50441a51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:18.859769 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99dd5dff-c53a-4629-af73-859f50441a51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:18.860219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99dd5dff-c53a-4629-af73-859f50441a51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:18.860994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99dd5dff-c53a-4629-af73-859f50441a51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:18.861459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99dd5dff-c53a-4629-af73-859f50441a51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:18.995680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99dd5dff-c53a-4629-af73-859f50441a51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:19.003305 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99dd5dff-c53a-4629-af73-859f50441a51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.155965 May 19 05:34:19.003889 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3295/6678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:18 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:20.021098 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c3a1d79e-47ec-429c-abf0-986231f061a5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:20.021739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c3a1d79e-47ec-429c-abf0-986231f061a5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:20.028702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3a1d79e-47ec-429c-abf0-986231f061a5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:20.029212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3a1d79e-47ec-429c-abf0-986231f061a5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:20.029997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3a1d79e-47ec-429c-abf0-986231f061a5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:20.030457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c3a1d79e-47ec-429c-abf0-986231f061a5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:20.160561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c3a1d79e-47ec-429c-abf0-986231f061a5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:20.168282 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c3a1d79e-47ec-429c-abf0-986231f061a5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.151723 May 19 05:34:20.168867 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3384/6679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:20 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:21.185617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-acb8637d-9e89-462a-9921-84645d3c07d7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:21.186236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-acb8637d-9e89-462a-9921-84645d3c07d7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:21.193915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-acb8637d-9e89-462a-9921-84645d3c07d7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:21.194363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-acb8637d-9e89-462a-9921-84645d3c07d7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:21.195127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-acb8637d-9e89-462a-9921-84645d3c07d7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:21.195569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-acb8637d-9e89-462a-9921-84645d3c07d7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:21.323214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-acb8637d-9e89-462a-9921-84645d3c07d7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:21.330897 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-acb8637d-9e89-462a-9921-84645d3c07d7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.149191 May 19 05:34:21.331477 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3296/6680] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:21 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:22.348823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f0bd048f-2b25-431c-9eb0-4e69a5252728 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:22.349492 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f0bd048f-2b25-431c-9eb0-4e69a5252728 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:22.357056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0bd048f-2b25-431c-9eb0-4e69a5252728 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:22.357554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0bd048f-2b25-431c-9eb0-4e69a5252728 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:22.358332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0bd048f-2b25-431c-9eb0-4e69a5252728 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:22.358782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f0bd048f-2b25-431c-9eb0-4e69a5252728 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:22.493924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f0bd048f-2b25-431c-9eb0-4e69a5252728 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:22.501490 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f0bd048f-2b25-431c-9eb0-4e69a5252728 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.157470 May 19 05:34:22.502059 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3385/6681] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:22 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:23.518653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-00be1cac-baae-48f8-adcc-c66e37ee72b8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:23.519194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-00be1cac-baae-48f8-adcc-c66e37ee72b8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:23.525645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00be1cac-baae-48f8-adcc-c66e37ee72b8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:23.526104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00be1cac-baae-48f8-adcc-c66e37ee72b8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:23.526873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00be1cac-baae-48f8-adcc-c66e37ee72b8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:23.527319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-00be1cac-baae-48f8-adcc-c66e37ee72b8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:23.653860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-00be1cac-baae-48f8-adcc-c66e37ee72b8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:23.661427 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-00be1cac-baae-48f8-adcc-c66e37ee72b8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.146824 May 19 05:34:23.662009 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3297/6682] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:23 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:24.677621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-551bff8d-0825-46a6-8f84-925c8a79fca7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:24.678339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-551bff8d-0825-46a6-8f84-925c8a79fca7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:24.686221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-551bff8d-0825-46a6-8f84-925c8a79fca7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:24.686709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-551bff8d-0825-46a6-8f84-925c8a79fca7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:24.687692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-551bff8d-0825-46a6-8f84-925c8a79fca7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:24.688338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-551bff8d-0825-46a6-8f84-925c8a79fca7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:24.824276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-551bff8d-0825-46a6-8f84-925c8a79fca7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:24.831954 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-551bff8d-0825-46a6-8f84-925c8a79fca7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.158290 May 19 05:34:24.832538 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3386/6683] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:24 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:25.850538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-28f02c8c-dcef-48bc-a13f-8fdaf667d59c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:25.851157 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-28f02c8c-dcef-48bc-a13f-8fdaf667d59c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:25.858019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28f02c8c-dcef-48bc-a13f-8fdaf667d59c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:25.858474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28f02c8c-dcef-48bc-a13f-8fdaf667d59c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:25.859267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28f02c8c-dcef-48bc-a13f-8fdaf667d59c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:25.859707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28f02c8c-dcef-48bc-a13f-8fdaf667d59c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:25.990254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-28f02c8c-dcef-48bc-a13f-8fdaf667d59c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:25.997760 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-28f02c8c-dcef-48bc-a13f-8fdaf667d59c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1655 microversion: 2.1 time: 0.152040 May 19 05:34:25.998335 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3298/6684] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:25 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:26.014641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:26.015642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:26.023207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:26.023677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:26.024460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:26.024916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:26.052134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:26.057858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Old instance type m1.heat2, new instance type m1.heat {{(pid=124818) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:34:26.064078 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:34:26.064518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:34:26.065014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:34:26.065473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:34:26.065902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:34:26.128161 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-57855e8d-9bfa-4c08-b765-52cfa8c22ebb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/action" status: 202 len: 0 microversion: 2.1 time: 0.117501 May 19 05:34:26.131218 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3387/6685] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:34:26 2022] POST /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:34:26.137361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-85e7ab49-bf36-422d-b704-ebd540451647 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:26.137978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-85e7ab49-bf36-422d-b704-ebd540451647 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:26.143956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85e7ab49-bf36-422d-b704-ebd540451647 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:26.144401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85e7ab49-bf36-422d-b704-ebd540451647 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:26.146016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85e7ab49-bf36-422d-b704-ebd540451647 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:26.146456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85e7ab49-bf36-422d-b704-ebd540451647 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:26.303901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-85e7ab49-bf36-422d-b704-ebd540451647 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:26.312228 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-85e7ab49-bf36-422d-b704-ebd540451647 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.178768 May 19 05:34:26.312955 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3299/6686] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:26 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:27.331350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-92021fd4-cc1c-4960-b325-f749fabfc944 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:27.331995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-92021fd4-cc1c-4960-b325-f749fabfc944 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:27.340039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92021fd4-cc1c-4960-b325-f749fabfc944 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:27.340577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92021fd4-cc1c-4960-b325-f749fabfc944 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:27.341397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92021fd4-cc1c-4960-b325-f749fabfc944 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:27.341849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92021fd4-cc1c-4960-b325-f749fabfc944 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:27.568378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-92021fd4-cc1c-4960-b325-f749fabfc944 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:27.575946 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-92021fd4-cc1c-4960-b325-f749fabfc944 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1678 microversion: 2.1 time: 0.249774 May 19 05:34:27.576540 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3388/6687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:27 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:28.593457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c9aa7e6-ceff-494b-968a-26401f8732e6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:28.594111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c9aa7e6-ceff-494b-968a-26401f8732e6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:28.601920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c9aa7e6-ceff-494b-968a-26401f8732e6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:28.602371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c9aa7e6-ceff-494b-968a-26401f8732e6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:28.603130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c9aa7e6-ceff-494b-968a-26401f8732e6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:28.603574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c9aa7e6-ceff-494b-968a-26401f8732e6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:28.734293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c9aa7e6-ceff-494b-968a-26401f8732e6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:28.742057 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c9aa7e6-ceff-494b-968a-26401f8732e6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1683 microversion: 2.1 time: 0.152464 May 19 05:34:28.742641 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3300/6688] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:28 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:29.761796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2129c748-5f57-4bcc-baf8-39ffad717757 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:29.762729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2129c748-5f57-4bcc-baf8-39ffad717757 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:29.772195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2129c748-5f57-4bcc-baf8-39ffad717757 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:29.772673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2129c748-5f57-4bcc-baf8-39ffad717757 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:29.773496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2129c748-5f57-4bcc-baf8-39ffad717757 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:29.773964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2129c748-5f57-4bcc-baf8-39ffad717757 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:29.916976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2129c748-5f57-4bcc-baf8-39ffad717757 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:29.924860 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2129c748-5f57-4bcc-baf8-39ffad717757 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1682 microversion: 2.1 time: 0.168791 May 19 05:34:29.925475 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3389/6689] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:29 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:30.232561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-01fa1380-755d-43c9-9ac9-ed8f3495c359 req-23498f73-9de5-41b7-9af0-0045d58cc3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f8e102-bafb-40c8-9e47-ddc9f280781f", "name": "network-vif-unplugged", "status": "completed", "tag": "5c206b05-0f75-4017-9a45-2af3f8fc8ff6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:30.241925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-01fa1380-755d-43c9-9ac9-ed8f3495c359 req-23498f73-9de5-41b7-9af0-0045d58cc3c2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:30.242371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-01fa1380-755d-43c9-9ac9-ed8f3495c359 req-23498f73-9de5-41b7-9af0-0045d58cc3c2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:30.254158 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-01fa1380-755d-43c9-9ac9-ed8f3495c359 req-23498f73-9de5-41b7-9af0-0045d58cc3c2 service nova] Creating event network-vif-unplugged:5c206b05-0f75-4017-9a45-2af3f8fc8ff6 for instance 04f8e102-bafb-40c8-9e47-ddc9f280781f on n-h1-766726-30 May 19 05:34:30.259879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-01fa1380-755d-43c9-9ac9-ed8f3495c359 req-23498f73-9de5-41b7-9af0-0045d58cc3c2 service nova] Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:34:30.274375 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-01fa1380-755d-43c9-9ac9-ed8f3495c359 req-23498f73-9de5-41b7-9af0-0045d58cc3c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045450 May 19 05:34:30.275311 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3301/6690] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:34:30.942919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b516d4f8-143d-4df6-a77a-2f46526327cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:30.943603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b516d4f8-143d-4df6-a77a-2f46526327cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:30.950699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b516d4f8-143d-4df6-a77a-2f46526327cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:30.951169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b516d4f8-143d-4df6-a77a-2f46526327cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:30.951969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b516d4f8-143d-4df6-a77a-2f46526327cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:30.952430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b516d4f8-143d-4df6-a77a-2f46526327cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:31.087656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b516d4f8-143d-4df6-a77a-2f46526327cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:31.095508 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b516d4f8-143d-4df6-a77a-2f46526327cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1682 microversion: 2.1 time: 0.156601 May 19 05:34:31.096094 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3390/6691] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:30 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:32.114058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b49808ad-209c-4fa2-8b95-3f6af3277c9c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:32.115290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b49808ad-209c-4fa2-8b95-3f6af3277c9c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:32.122539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b49808ad-209c-4fa2-8b95-3f6af3277c9c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:32.122993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b49808ad-209c-4fa2-8b95-3f6af3277c9c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:32.123760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b49808ad-209c-4fa2-8b95-3f6af3277c9c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:32.124200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b49808ad-209c-4fa2-8b95-3f6af3277c9c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:32.252015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b49808ad-209c-4fa2-8b95-3f6af3277c9c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:32.259594 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b49808ad-209c-4fa2-8b95-3f6af3277c9c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1680 microversion: 2.1 time: 0.149888 May 19 05:34:32.260171 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3302/6692] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:32 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:32.290406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-57b1bcbc-fc22-4651-be74-a7789ac383d5 req-940b1e65-b6c1-4226-ade1-bee66d34978e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f8e102-bafb-40c8-9e47-ddc9f280781f", "tag": "5c206b05-0f75-4017-9a45-2af3f8fc8ff6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:32.299329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-57b1bcbc-fc22-4651-be74-a7789ac383d5 req-940b1e65-b6c1-4226-ade1-bee66d34978e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:32.299780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-57b1bcbc-fc22-4651-be74-a7789ac383d5 req-940b1e65-b6c1-4226-ade1-bee66d34978e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:32.315155 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-57b1bcbc-fc22-4651-be74-a7789ac383d5 req-940b1e65-b6c1-4226-ade1-bee66d34978e service nova] Creating event network-changed:5c206b05-0f75-4017-9a45-2af3f8fc8ff6 for instance 04f8e102-bafb-40c8-9e47-ddc9f280781f on n-h1-766726-30 May 19 05:34:32.320370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-57b1bcbc-fc22-4651-be74-a7789ac383d5 req-940b1e65-b6c1-4226-ade1-bee66d34978e service nova] Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:34:32.334161 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-57b1bcbc-fc22-4651-be74-a7789ac383d5 req-940b1e65-b6c1-4226-ade1-bee66d34978e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047305 May 19 05:34:32.334795 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3391/6693] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:34:33.278260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90f8a73a-8239-4c08-9e1e-d635be7edf53 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:33.278909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-90f8a73a-8239-4c08-9e1e-d635be7edf53 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:33.286044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90f8a73a-8239-4c08-9e1e-d635be7edf53 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:33.287078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90f8a73a-8239-4c08-9e1e-d635be7edf53 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:33.287850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90f8a73a-8239-4c08-9e1e-d635be7edf53 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:33.288282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90f8a73a-8239-4c08-9e1e-d635be7edf53 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:33.422341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-90f8a73a-8239-4c08-9e1e-d635be7edf53 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:33.436933 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-90f8a73a-8239-4c08-9e1e-d635be7edf53 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1676 microversion: 2.1 time: 0.163839 May 19 05:34:33.437546 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3303/6694] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:33 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:33.456242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6f1dd42b-2ab1-4b49-8f5b-046233f92f27 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:33.456904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6f1dd42b-2ab1-4b49-8f5b-046233f92f27 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:33.463245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f1dd42b-2ab1-4b49-8f5b-046233f92f27 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:33.463699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f1dd42b-2ab1-4b49-8f5b-046233f92f27 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:33.465474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f1dd42b-2ab1-4b49-8f5b-046233f92f27 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:33.465946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f1dd42b-2ab1-4b49-8f5b-046233f92f27 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:33.511424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:33.532835 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6f1dd42b-2ab1-4b49-8f5b-046233f92f27 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/action" status: 204 len: 0 microversion: 2.1 time: 0.081576 May 19 05:34:33.533787 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3392/6695] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:34:33 2022] POST /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:34:33.546663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c80dc417-47c6-4417-8965-71f45d35a8af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:33.547435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c80dc417-47c6-4417-8965-71f45d35a8af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:33.554390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c80dc417-47c6-4417-8965-71f45d35a8af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:33.554920 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c80dc417-47c6-4417-8965-71f45d35a8af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:33.555774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c80dc417-47c6-4417-8965-71f45d35a8af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:33.556221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c80dc417-47c6-4417-8965-71f45d35a8af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:33.763368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c80dc417-47c6-4417-8965-71f45d35a8af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:33.771205 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c80dc417-47c6-4417-8965-71f45d35a8af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1676 microversion: 2.1 time: 0.232319 May 19 05:34:33.771862 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3304/6696] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:33 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:34.791841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-45fb518e-ed2a-400f-9faf-7ceec74be2aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:34.792790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-45fb518e-ed2a-400f-9faf-7ceec74be2aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:34.801547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45fb518e-ed2a-400f-9faf-7ceec74be2aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:34.802614 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45fb518e-ed2a-400f-9faf-7ceec74be2aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:34.803414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45fb518e-ed2a-400f-9faf-7ceec74be2aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:34.803845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-45fb518e-ed2a-400f-9faf-7ceec74be2aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:34.934356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-45fb518e-ed2a-400f-9faf-7ceec74be2aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:34.942428 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-45fb518e-ed2a-400f-9faf-7ceec74be2aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1655 microversion: 2.1 time: 0.157847 May 19 05:34:34.943578 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3393/6697] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:34 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:34.959167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d4ec8547-ebb5-4d13-815d-5f8c25a298fe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:34.959787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d4ec8547-ebb5-4d13-815d-5f8c25a298fe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:34.966929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4ec8547-ebb5-4d13-815d-5f8c25a298fe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:34.967389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4ec8547-ebb5-4d13-815d-5f8c25a298fe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:34.968166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4ec8547-ebb5-4d13-815d-5f8c25a298fe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:34.968607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d4ec8547-ebb5-4d13-815d-5f8c25a298fe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:35.103311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d4ec8547-ebb5-4d13-815d-5f8c25a298fe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:35.111288 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d4ec8547-ebb5-4d13-815d-5f8c25a298fe tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1655 microversion: 2.1 time: 0.156058 May 19 05:34:35.111878 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3305/6698] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:34 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:35.128276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-340d21b2-1409-4096-8526-ac717d24890e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:35.134440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-340d21b2-1409-4096-8526-ac717d24890e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:35.134835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-340d21b2-1409-4096-8526-ac717d24890e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:35.156694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-340d21b2-1409-4096-8526-ac717d24890e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Going to try to start instance {{(pid=124818) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 05:34:35.197688 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-340d21b2-1409-4096-8526-ac717d24890e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/action" status: 202 len: 0 microversion: 2.1 time: 0.073155 May 19 05:34:35.198294 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3394/6699] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:34:35 2022] POST /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:34:35.206716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce4346a7-92a1-4a0f-8207-fdb93547d11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:35.207371 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ce4346a7-92a1-4a0f-8207-fdb93547d11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:35.213527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce4346a7-92a1-4a0f-8207-fdb93547d11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:35.213977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce4346a7-92a1-4a0f-8207-fdb93547d11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:35.214738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce4346a7-92a1-4a0f-8207-fdb93547d11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:35.215172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce4346a7-92a1-4a0f-8207-fdb93547d11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:35.346781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ce4346a7-92a1-4a0f-8207-fdb93547d11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:35.355290 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce4346a7-92a1-4a0f-8207-fdb93547d11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1664 microversion: 2.1 time: 0.152510 May 19 05:34:35.355866 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3306/6700] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:35 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:34:36.373256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e38cefbf-7467-476e-a3f0-3b8164056324 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:36.374001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e38cefbf-7467-476e-a3f0-3b8164056324 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:36.381701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e38cefbf-7467-476e-a3f0-3b8164056324 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:36.382168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e38cefbf-7467-476e-a3f0-3b8164056324 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:36.382942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e38cefbf-7467-476e-a3f0-3b8164056324 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:36.383393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e38cefbf-7467-476e-a3f0-3b8164056324 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:36.530529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e38cefbf-7467-476e-a3f0-3b8164056324 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:36.546633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e38cefbf-7467-476e-a3f0-3b8164056324 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1664 microversion: 2.1 time: 0.178497 May 19 05:34:36.547480 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3395/6701] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:36 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:36.688457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8c4d54ad-89be-4b58-a33d-a6af4a5e5b29 req-6c7f8f53-75ba-4a51-894e-d4b155664f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f8e102-bafb-40c8-9e47-ddc9f280781f", "name": "network-vif-plugged", "status": "completed", "tag": "5c206b05-0f75-4017-9a45-2af3f8fc8ff6"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:36.697572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8c4d54ad-89be-4b58-a33d-a6af4a5e5b29 req-6c7f8f53-75ba-4a51-894e-d4b155664f84 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:36.698017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8c4d54ad-89be-4b58-a33d-a6af4a5e5b29 req-6c7f8f53-75ba-4a51-894e-d4b155664f84 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:36.709701 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8c4d54ad-89be-4b58-a33d-a6af4a5e5b29 req-6c7f8f53-75ba-4a51-894e-d4b155664f84 service nova] Creating event network-vif-plugged:5c206b05-0f75-4017-9a45-2af3f8fc8ff6 for instance 04f8e102-bafb-40c8-9e47-ddc9f280781f on n-h1-766726-30 May 19 05:34:36.714613 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8c4d54ad-89be-4b58-a33d-a6af4a5e5b29 req-6c7f8f53-75ba-4a51-894e-d4b155664f84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029847 May 19 05:34:36.715505 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3307/6702] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:34:37.563847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-740ab8f5-94fc-4bac-b629-89af5f0afd0d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:37.564511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-740ab8f5-94fc-4bac-b629-89af5f0afd0d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:37.571836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-740ab8f5-94fc-4bac-b629-89af5f0afd0d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:37.572298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-740ab8f5-94fc-4bac-b629-89af5f0afd0d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:37.573112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-740ab8f5-94fc-4bac-b629-89af5f0afd0d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:37.573565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-740ab8f5-94fc-4bac-b629-89af5f0afd0d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:37.701504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-740ab8f5-94fc-4bac-b629-89af5f0afd0d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:37.709566 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-740ab8f5-94fc-4bac-b629-89af5f0afd0d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1668 microversion: 2.1 time: 0.149684 May 19 05:34:37.710218 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3396/6703] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:37 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:37.728058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-db1cb344-c023-4603-bd4e-3db4ad40ff0b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:37.728665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-db1cb344-c023-4603-bd4e-3db4ad40ff0b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:37.734909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db1cb344-c023-4603-bd4e-3db4ad40ff0b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:37.735361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db1cb344-c023-4603-bd4e-3db4ad40ff0b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:37.736124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db1cb344-c023-4603-bd4e-3db4ad40ff0b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:37.736565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db1cb344-c023-4603-bd4e-3db4ad40ff0b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:37.754479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=100 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:37.762040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-db1cb344-c023-4603-bd4e-3db4ad40ff0b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:34:37.836476 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-db1cb344-c023-4603-bd4e-3db4ad40ff0b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "DELETE /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 204 len: 0 microversion: 2.1 time: 0.113838 May 19 05:34:37.837018 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3308/6704] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:34:37 2022] DELETE /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:34:37.846212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-025fb30c-c026-4a67-8077-9b17069f71cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:37.846865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-025fb30c-c026-4a67-8077-9b17069f71cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:37.853980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-025fb30c-c026-4a67-8077-9b17069f71cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:37.854471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-025fb30c-c026-4a67-8077-9b17069f71cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:37.855279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-025fb30c-c026-4a67-8077-9b17069f71cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:37.855732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-025fb30c-c026-4a67-8077-9b17069f71cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:37.981414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-025fb30c-c026-4a67-8077-9b17069f71cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:37.989011 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-025fb30c-c026-4a67-8077-9b17069f71cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1674 microversion: 2.1 time: 0.146884 May 19 05:34:37.989634 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3397/6705] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:37 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:39.006279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-80a28a65-248a-4bc5-8dd6-9ef98b677802 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:39.006988 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-80a28a65-248a-4bc5-8dd6-9ef98b677802 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:39.013844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80a28a65-248a-4bc5-8dd6-9ef98b677802 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:39.014300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80a28a65-248a-4bc5-8dd6-9ef98b677802 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:39.015065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80a28a65-248a-4bc5-8dd6-9ef98b677802 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:39.015508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80a28a65-248a-4bc5-8dd6-9ef98b677802 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:39.147730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-80a28a65-248a-4bc5-8dd6-9ef98b677802 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:39.155254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-80a28a65-248a-4bc5-8dd6-9ef98b677802 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1674 microversion: 2.1 time: 0.153311 May 19 05:34:39.155831 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3309/6706] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:39 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:40.106209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-1bda2dd8-a613-43da-9421-412fd273ed39 req-f5bd3189-c80b-405d-8596-4dafab45fda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f8e102-bafb-40c8-9e47-ddc9f280781f", "name": "network-vif-deleted", "tag": "5c206b05-0f75-4017-9a45-2af3f8fc8ff6"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:40.117990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=43 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:40.124012 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1bda2dd8-a613-43da-9421-412fd273ed39 req-f5bd3189-c80b-405d-8596-4dafab45fda0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:40.124474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-1bda2dd8-a613-43da-9421-412fd273ed39 req-f5bd3189-c80b-405d-8596-4dafab45fda0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:40.142225 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-1bda2dd8-a613-43da-9421-412fd273ed39 req-f5bd3189-c80b-405d-8596-4dafab45fda0 service nova] Creating event network-vif-deleted:5c206b05-0f75-4017-9a45-2af3f8fc8ff6 for instance 04f8e102-bafb-40c8-9e47-ddc9f280781f on n-h1-766726-30 May 19 05:34:40.148156 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-1bda2dd8-a613-43da-9421-412fd273ed39 req-f5bd3189-c80b-405d-8596-4dafab45fda0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045598 May 19 05:34:40.149108 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3398/6707] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:34:40.173196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-df490c94-5fed-4d2d-96f8-df1c7c16f053 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:40.174440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-df490c94-5fed-4d2d-96f8-df1c7c16f053 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:40.178429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:40.182129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df490c94-5fed-4d2d-96f8-df1c7c16f053 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:40.182580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df490c94-5fed-4d2d-96f8-df1c7c16f053 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:40.183634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df490c94-5fed-4d2d-96f8-df1c7c16f053 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:40.184258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-df490c94-5fed-4d2d-96f8-df1c7c16f053 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:40.258638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-df490c94-5fed-4d2d-96f8-df1c7c16f053 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:40.267740 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-df490c94-5fed-4d2d-96f8-df1c7c16f053 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 200 len: 1323 microversion: 2.1 time: 0.098486 May 19 05:34:40.268334 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3310/6708] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:40 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:41.286183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:41.286943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:41.293267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:41.293731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:41.294499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:41.294951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:41.308637 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f HTTP/1.1 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '04f8e102-bafb-40c8-9e47-ddc9f280781f'} May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:34:41.310269 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48dccf70-79c0-43ac-8875-3d61672367d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 404 len: 111 microversion: 2.1 time: 0.031007 May 19 05:34:41.315549 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3399/6709] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:41 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:34:41.329058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:41.330042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:41.336929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:41.337413 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:41.338176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:41.338610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:41.352015 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f HTTP/1.1 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '04f8e102-bafb-40c8-9e47-ddc9f280781f'} May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:34:41.353641 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-109d0274-6fa2-4ba0-865e-7cb029a4ecb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 404 len: 111 microversion: 2.1 time: 0.029896 May 19 05:34:41.358665 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3311/6710] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:41 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:34:41.402427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-793376240", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "e5e4b2f1-a2a4-4049-8b40-f59ae16473b6"}], "security_groups": [{"name": "tempest-securitygroup--469202799"}], "key_name": "tempest-keypair-1240287522", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:41.508606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] validate_networks() for [('e5e4b2f1-a2a4-4049-8b40-f59ae16473b6', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:34:41.867911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:34:41.868286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:34:41.868881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:34:41.869357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:34:41.869781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:34:41.878621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:41.879080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:41.879887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:41.880336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:41.896604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:34:41.901789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for user 804f458dff054b0db747dd434a73fcc5 and project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:34:41.914567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:34:41.916879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:34:41.964831 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18f0bd8f-343c-4e1e-aaa4-7c899a0d17d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.566318 May 19 05:34:41.965566 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3400/6711] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:34:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:34:41.976289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-73aad38c-6ba2-4e75-b505-4fe39ec77074 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:41.976901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-73aad38c-6ba2-4e75-b505-4fe39ec77074 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:42.032336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-73aad38c-6ba2-4e75-b505-4fe39ec77074 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:42.039482 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-73aad38c-6ba2-4e75-b505-4fe39ec77074 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1238 microversion: 2.1 time: 0.067795 May 19 05:34:42.040047 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3312/6712] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:41 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:43.058522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6832d42e-5318-4b34-9342-559ff2a96fc4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:43.059192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6832d42e-5318-4b34-9342-559ff2a96fc4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:43.066194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6832d42e-5318-4b34-9342-559ff2a96fc4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:43.066668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6832d42e-5318-4b34-9342-559ff2a96fc4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:43.068088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6832d42e-5318-4b34-9342-559ff2a96fc4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:43.068553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6832d42e-5318-4b34-9342-559ff2a96fc4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:43.141796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6832d42e-5318-4b34-9342-559ff2a96fc4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:43.149492 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6832d42e-5318-4b34-9342-559ff2a96fc4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1296 microversion: 2.1 time: 0.095785 May 19 05:34:43.150074 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3401/6713] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:43 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:44.167596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29a8bcdd-d4c2-48c0-925d-48e057c0fe6d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:44.168511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-29a8bcdd-d4c2-48c0-925d-48e057c0fe6d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:44.177507 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29a8bcdd-d4c2-48c0-925d-48e057c0fe6d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:44.178650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29a8bcdd-d4c2-48c0-925d-48e057c0fe6d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:44.179378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29a8bcdd-d4c2-48c0-925d-48e057c0fe6d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:44.180126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29a8bcdd-d4c2-48c0-925d-48e057c0fe6d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:44.248566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8f12ad25-fc46-4f59-a06e-e5dfcb5e8cff req-e48c6a13-2a34-4073-be52-c393e2c09ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:44.263334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8f12ad25-fc46-4f59-a06e-e5dfcb5e8cff req-e48c6a13-2a34-4073-be52-c393e2c09ed1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:44.264112 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8f12ad25-fc46-4f59-a06e-e5dfcb5e8cff req-e48c6a13-2a34-4073-be52-c393e2c09ed1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:44.289114 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8f12ad25-fc46-4f59-a06e-e5dfcb5e8cff req-e48c6a13-2a34-4073-be52-c393e2c09ed1 service nova] Creating event network-changed:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h2-766726-30 May 19 05:34:44.297525 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8f12ad25-fc46-4f59-a06e-e5dfcb5e8cff req-e48c6a13-2a34-4073-be52-c393e2c09ed1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053284 May 19 05:34:44.298797 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3402/6714] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:34:44.506378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-29a8bcdd-d4c2-48c0-925d-48e057c0fe6d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:44.514284 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29a8bcdd-d4c2-48c0-925d-48e057c0fe6d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1363 microversion: 2.1 time: 0.350981 May 19 05:34:44.514866 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3313/6715] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:44 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:45.532345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-73cb0257-4b6a-4e2d-8c14-e880a64a9574 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:45.533066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-73cb0257-4b6a-4e2d-8c14-e880a64a9574 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:45.539568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73cb0257-4b6a-4e2d-8c14-e880a64a9574 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:45.540035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73cb0257-4b6a-4e2d-8c14-e880a64a9574 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:45.540814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73cb0257-4b6a-4e2d-8c14-e880a64a9574 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:45.541298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-73cb0257-4b6a-4e2d-8c14-e880a64a9574 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:45.721852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-73cb0257-4b6a-4e2d-8c14-e880a64a9574 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:45.729882 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-73cb0257-4b6a-4e2d-8c14-e880a64a9574 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1363 microversion: 2.1 time: 0.202763 May 19 05:34:45.730465 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3403/6716] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:45 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:46.747254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e536fb8d-b2ab-49f7-bf81-7997c0c29093 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:46.747930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e536fb8d-b2ab-49f7-bf81-7997c0c29093 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:46.754957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e536fb8d-b2ab-49f7-bf81-7997c0c29093 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:46.755415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e536fb8d-b2ab-49f7-bf81-7997c0c29093 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:46.756181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e536fb8d-b2ab-49f7-bf81-7997c0c29093 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:46.756626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e536fb8d-b2ab-49f7-bf81-7997c0c29093 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:46.889093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e536fb8d-b2ab-49f7-bf81-7997c0c29093 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:46.897824 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e536fb8d-b2ab-49f7-bf81-7997c0c29093 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1363 microversion: 2.1 time: 0.154491 May 19 05:34:46.898399 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3314/6717] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:46 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:47.915796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5a902a74-f103-42ad-98ee-d46e6c49feb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:47.916465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5a902a74-f103-42ad-98ee-d46e6c49feb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:47.923512 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a902a74-f103-42ad-98ee-d46e6c49feb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:47.923984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a902a74-f103-42ad-98ee-d46e6c49feb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:47.924775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a902a74-f103-42ad-98ee-d46e6c49feb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:47.925270 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5a902a74-f103-42ad-98ee-d46e6c49feb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:48.054801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5a902a74-f103-42ad-98ee-d46e6c49feb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:48.062365 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5a902a74-f103-42ad-98ee-d46e6c49feb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1363 microversion: 2.1 time: 0.151102 May 19 05:34:48.062948 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3404/6718] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:47 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:49.058723 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:34:49.059417 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:34:49.079497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-709e9afa-485a-4628-a420-70f7f67887f3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:49.080135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-709e9afa-485a-4628-a420-70f7f67887f3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:49.087564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-709e9afa-485a-4628-a420-70f7f67887f3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:49.088016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-709e9afa-485a-4628-a420-70f7f67887f3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:49.088775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-709e9afa-485a-4628-a420-70f7f67887f3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:49.089247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-709e9afa-485a-4628-a420-70f7f67887f3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:49.216208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-709e9afa-485a-4628-a420-70f7f67887f3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:49.223594 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-709e9afa-485a-4628-a420-70f7f67887f3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1363 microversion: 2.1 time: 0.148033 May 19 05:34:49.224167 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3315/6719] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:49 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:49.539179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e6231133-7004-4c8e-a180-1e79a46961ce req-ba450214-ab44-4f20-8be5-4c45d9a413a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "name": "network-vif-plugged", "status": "completed", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:49.548903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e6231133-7004-4c8e-a180-1e79a46961ce req-ba450214-ab44-4f20-8be5-4c45d9a413a9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:49.549385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e6231133-7004-4c8e-a180-1e79a46961ce req-ba450214-ab44-4f20-8be5-4c45d9a413a9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:49.560542 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e6231133-7004-4c8e-a180-1e79a46961ce req-ba450214-ab44-4f20-8be5-4c45d9a413a9 service nova] Creating event network-vif-plugged:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h2-766726-30 May 19 05:34:49.565499 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e6231133-7004-4c8e-a180-1e79a46961ce req-ba450214-ab44-4f20-8be5-4c45d9a413a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030091 May 19 05:34:49.566154 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3405/6720] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:34:49.875924 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:34:49.876247 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:34:50.240826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7b456738-9509-405a-aacd-d9adeab42060 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:50.241476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7b456738-9509-405a-aacd-d9adeab42060 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:50.248033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b456738-9509-405a-aacd-d9adeab42060 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:50.248477 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b456738-9509-405a-aacd-d9adeab42060 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:50.249270 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b456738-9509-405a-aacd-d9adeab42060 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:50.249709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b456738-9509-405a-aacd-d9adeab42060 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:50.381505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7b456738-9509-405a-aacd-d9adeab42060 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:50.389025 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7b456738-9509-405a-aacd-d9adeab42060 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1363 microversion: 2.1 time: 0.152805 May 19 05:34:50.389768 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3316/6721] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:50 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:51.408189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d63ce00-a1c7-4d20-a8d6-dcd9f8a687af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:51.409027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d63ce00-a1c7-4d20-a8d6-dcd9f8a687af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:51.415429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d63ce00-a1c7-4d20-a8d6-dcd9f8a687af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:51.415895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d63ce00-a1c7-4d20-a8d6-dcd9f8a687af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:51.416671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d63ce00-a1c7-4d20-a8d6-dcd9f8a687af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:51.417151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d63ce00-a1c7-4d20-a8d6-dcd9f8a687af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:51.548344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d63ce00-a1c7-4d20-a8d6-dcd9f8a687af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:34:51.556572 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d63ce00-a1c7-4d20-a8d6-dcd9f8a687af tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1551 microversion: 2.1 time: 0.153713 May 19 05:34:51.557173 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3406/6722] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:34:51 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:34:51.573061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e294b0f-e33a-4a71-9a7f-fdbc9a9b0c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:34:51.573713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e294b0f-e33a-4a71-9a7f-fdbc9a9b0c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:34:51.580375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e294b0f-e33a-4a71-9a7f-fdbc9a9b0c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:51.580757 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e294b0f-e33a-4a71-9a7f-fdbc9a9b0c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:51.581544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e294b0f-e33a-4a71-9a7f-fdbc9a9b0c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:51.581979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e294b0f-e33a-4a71-9a7f-fdbc9a9b0c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:51.668779 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e294b0f-e33a-4a71-9a7f-fdbc9a9b0c4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099514 May 19 05:34:51.669441 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3317/6723] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 05:34:51 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:34:52.590231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:52.591568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:34:52.650856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f55f76d7-89c8-423b-9af6-86711847cba2 req-8616f6d1-cc33-409e-a371-d9fc5c3efc7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:34:52.658829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f55f76d7-89c8-423b-9af6-86711847cba2 req-8616f6d1-cc33-409e-a371-d9fc5c3efc7a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:34:52.659322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f55f76d7-89c8-423b-9af6-86711847cba2 req-8616f6d1-cc33-409e-a371-d9fc5c3efc7a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:34:52.670724 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f55f76d7-89c8-423b-9af6-86711847cba2 req-8616f6d1-cc33-409e-a371-d9fc5c3efc7a service nova] Creating event network-changed:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h2-766726-30 May 19 05:34:52.675978 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f55f76d7-89c8-423b-9af6-86711847cba2 req-8616f6d1-cc33-409e-a371-d9fc5c3efc7a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090229 May 19 05:34:52.677120 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3407/6724] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:35:25.395619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:25.398039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=17 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:25.398675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:25.403819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:25.404791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:25.412502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:25.412956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:25.413750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:25.414193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:25.442170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:25.448605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Old instance type m1.heat2, new instance type m1.heat {{(pid=124819) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:35:25.454781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:35:25.455203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:35:25.455679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:35:25.456092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:35:25.456512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:35:25.519684 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b3ea1b01-c171-48ec-b518-89a3c6aeda06 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5/action" status: 202 len: 0 microversion: 2.1 time: 0.124708 May 19 05:35:25.520290 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3318/6725] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:35:25 2022] POST /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:35:25.526862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:25.527789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=71,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:25.532001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-16758220-8c45-4584-bb06-4a9898c0471d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:25.532728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-16758220-8c45-4584-bb06-4a9898c0471d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:25.540318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16758220-8c45-4584-bb06-4a9898c0471d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:25.540730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16758220-8c45-4584-bb06-4a9898c0471d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:25.541565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16758220-8c45-4584-bb06-4a9898c0471d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:25.541988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-16758220-8c45-4584-bb06-4a9898c0471d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:25.697519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-16758220-8c45-4584-bb06-4a9898c0471d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:25.705289 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-16758220-8c45-4584-bb06-4a9898c0471d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1678 microversion: 2.1 time: 0.180606 May 19 05:35:25.705882 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3408/6726] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:25 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:26.724858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bb0a14c4-a78e-4b06-b69d-864f8c3633fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:26.725453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bb0a14c4-a78e-4b06-b69d-864f8c3633fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:26.732014 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb0a14c4-a78e-4b06-b69d-864f8c3633fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:26.732462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb0a14c4-a78e-4b06-b69d-864f8c3633fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:26.733248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb0a14c4-a78e-4b06-b69d-864f8c3633fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:26.733684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb0a14c4-a78e-4b06-b69d-864f8c3633fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:26.860406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb0a14c4-a78e-4b06-b69d-864f8c3633fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:26.869942 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bb0a14c4-a78e-4b06-b69d-864f8c3633fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1678 microversion: 2.1 time: 0.150033 May 19 05:35:26.870578 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3319/6727] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:26 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:27.887947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-719b00b3-2f84-4645-945b-f9b90172d38a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:27.888489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-719b00b3-2f84-4645-945b-f9b90172d38a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:27.895502 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-719b00b3-2f84-4645-945b-f9b90172d38a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:27.895971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-719b00b3-2f84-4645-945b-f9b90172d38a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:27.896777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-719b00b3-2f84-4645-945b-f9b90172d38a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:27.897261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-719b00b3-2f84-4645-945b-f9b90172d38a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:28.022932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-719b00b3-2f84-4645-945b-f9b90172d38a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:28.030982 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-719b00b3-2f84-4645-945b-f9b90172d38a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.147150 May 19 05:35:28.031561 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3409/6728] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:27 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:29.048837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13c41aaa-0755-4d5b-b6ee-15c1b2f1998d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:29.049505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13c41aaa-0755-4d5b-b6ee-15c1b2f1998d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:29.056712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c41aaa-0755-4d5b-b6ee-15c1b2f1998d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:29.057192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c41aaa-0755-4d5b-b6ee-15c1b2f1998d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:29.057995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c41aaa-0755-4d5b-b6ee-15c1b2f1998d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:29.058429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c41aaa-0755-4d5b-b6ee-15c1b2f1998d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:29.207273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-13c41aaa-0755-4d5b-b6ee-15c1b2f1998d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:29.215508 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13c41aaa-0755-4d5b-b6ee-15c1b2f1998d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.170578 May 19 05:35:29.216083 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3320/6729] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:29 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:30.233154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-991d067e-a984-4fb3-8356-0cd377cf66fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:30.233791 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-991d067e-a984-4fb3-8356-0cd377cf66fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:30.240734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-991d067e-a984-4fb3-8356-0cd377cf66fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:30.241232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-991d067e-a984-4fb3-8356-0cd377cf66fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:30.242006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-991d067e-a984-4fb3-8356-0cd377cf66fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:30.242962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-991d067e-a984-4fb3-8356-0cd377cf66fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:30.374603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-991d067e-a984-4fb3-8356-0cd377cf66fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:30.382229 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-991d067e-a984-4fb3-8356-0cd377cf66fd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.153073 May 19 05:35:30.382806 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3410/6730] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:30 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:31.398484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-adf67ab4-98e7-4d9d-b7d2-63c709e7574d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:31.399694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-adf67ab4-98e7-4d9d-b7d2-63c709e7574d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:31.406179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adf67ab4-98e7-4d9d-b7d2-63c709e7574d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:31.406625 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adf67ab4-98e7-4d9d-b7d2-63c709e7574d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:31.407384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adf67ab4-98e7-4d9d-b7d2-63c709e7574d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:31.407821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adf67ab4-98e7-4d9d-b7d2-63c709e7574d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:31.536788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-adf67ab4-98e7-4d9d-b7d2-63c709e7574d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:31.544586 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-adf67ab4-98e7-4d9d-b7d2-63c709e7574d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.149913 May 19 05:35:31.545101 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3321/6731] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:31 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:32.562301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b413d54-d3cf-4596-af50-7a5e0e134cb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:32.562935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b413d54-d3cf-4596-af50-7a5e0e134cb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:32.569923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b413d54-d3cf-4596-af50-7a5e0e134cb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:32.570393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b413d54-d3cf-4596-af50-7a5e0e134cb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:32.571743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b413d54-d3cf-4596-af50-7a5e0e134cb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:32.572202 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b413d54-d3cf-4596-af50-7a5e0e134cb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:32.708461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0b413d54-d3cf-4596-af50-7a5e0e134cb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:32.716181 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b413d54-d3cf-4596-af50-7a5e0e134cb3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.157925 May 19 05:35:32.716752 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3411/6732] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:32 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:33.734090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b51cdbcb-30c3-4df4-8339-3f8b764adaf8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:33.734703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b51cdbcb-30c3-4df4-8339-3f8b764adaf8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:33.741665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b51cdbcb-30c3-4df4-8339-3f8b764adaf8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:33.742120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b51cdbcb-30c3-4df4-8339-3f8b764adaf8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:33.742911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b51cdbcb-30c3-4df4-8339-3f8b764adaf8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:33.743381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b51cdbcb-30c3-4df4-8339-3f8b764adaf8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:33.870934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b51cdbcb-30c3-4df4-8339-3f8b764adaf8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:33.881470 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b51cdbcb-30c3-4df4-8339-3f8b764adaf8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.151141 May 19 05:35:33.882055 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3322/6733] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:33 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:34.898641 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0da3db93-cbc3-4022-bf0a-097f798d595b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:34.899267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0da3db93-cbc3-4022-bf0a-097f798d595b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:34.906192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0da3db93-cbc3-4022-bf0a-097f798d595b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:34.906904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0da3db93-cbc3-4022-bf0a-097f798d595b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:34.907686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0da3db93-cbc3-4022-bf0a-097f798d595b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:34.908137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0da3db93-cbc3-4022-bf0a-097f798d595b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:35.053482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0da3db93-cbc3-4022-bf0a-097f798d595b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:35.061866 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0da3db93-cbc3-4022-bf0a-097f798d595b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.167227 May 19 05:35:35.062440 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3412/6734] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:34 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:36.078874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0fcf3644-7b53-4ce1-8120-3320e6c4635e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:36.079519 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0fcf3644-7b53-4ce1-8120-3320e6c4635e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:36.087416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fcf3644-7b53-4ce1-8120-3320e6c4635e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:36.087861 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fcf3644-7b53-4ce1-8120-3320e6c4635e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:36.088654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fcf3644-7b53-4ce1-8120-3320e6c4635e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:36.089100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0fcf3644-7b53-4ce1-8120-3320e6c4635e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:36.217166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0fcf3644-7b53-4ce1-8120-3320e6c4635e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:36.224835 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0fcf3644-7b53-4ce1-8120-3320e6c4635e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.149893 May 19 05:35:36.225448 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3323/6735] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:36 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:37.242369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e83bab76-49c8-471e-b299-61aac37fb717 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:37.242994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e83bab76-49c8-471e-b299-61aac37fb717 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:37.250029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e83bab76-49c8-471e-b299-61aac37fb717 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:37.250490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e83bab76-49c8-471e-b299-61aac37fb717 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:37.251262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e83bab76-49c8-471e-b299-61aac37fb717 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:37.251707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e83bab76-49c8-471e-b299-61aac37fb717 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:37.386424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e83bab76-49c8-471e-b299-61aac37fb717 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:37.394172 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e83bab76-49c8-471e-b299-61aac37fb717 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.156070 May 19 05:35:37.394761 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3413/6736] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:37 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:38.412059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ba0c2260-5ce4-40a0-b6fe-1d200a096746 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:38.412665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ba0c2260-5ce4-40a0-b6fe-1d200a096746 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:38.419811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba0c2260-5ce4-40a0-b6fe-1d200a096746 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:38.420258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba0c2260-5ce4-40a0-b6fe-1d200a096746 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:38.421009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba0c2260-5ce4-40a0-b6fe-1d200a096746 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:38.421469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ba0c2260-5ce4-40a0-b6fe-1d200a096746 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:38.546178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ba0c2260-5ce4-40a0-b6fe-1d200a096746 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:38.553926 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ba0c2260-5ce4-40a0-b6fe-1d200a096746 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.145752 May 19 05:35:38.554502 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3324/6737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:38 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:39.571575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b5d13125-b784-43a3-a015-354cd9e4ab8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:39.572239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b5d13125-b784-43a3-a015-354cd9e4ab8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:39.579193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5d13125-b784-43a3-a015-354cd9e4ab8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:39.579700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5d13125-b784-43a3-a015-354cd9e4ab8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:39.580449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5d13125-b784-43a3-a015-354cd9e4ab8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:39.580900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b5d13125-b784-43a3-a015-354cd9e4ab8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:39.715345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b5d13125-b784-43a3-a015-354cd9e4ab8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:39.722857 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b5d13125-b784-43a3-a015-354cd9e4ab8b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.155200 May 19 05:35:39.723432 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3414/6738] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:39 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:40.740781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7b512c86-63ce-414a-8ff6-726afc2baea1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:40.741451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7b512c86-63ce-414a-8ff6-726afc2baea1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:40.748778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b512c86-63ce-414a-8ff6-726afc2baea1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:40.749271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b512c86-63ce-414a-8ff6-726afc2baea1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:40.750037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b512c86-63ce-414a-8ff6-726afc2baea1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:40.750479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b512c86-63ce-414a-8ff6-726afc2baea1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:40.881774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7b512c86-63ce-414a-8ff6-726afc2baea1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:40.889253 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7b512c86-63ce-414a-8ff6-726afc2baea1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.152387 May 19 05:35:40.889832 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3325/6739] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:40 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:35:41.906565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8a0a7a6b-146d-4596-9a63-c9012b3ca577 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:41.907123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8a0a7a6b-146d-4596-9a63-c9012b3ca577 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:41.914691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a0a7a6b-146d-4596-9a63-c9012b3ca577 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:41.915170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a0a7a6b-146d-4596-9a63-c9012b3ca577 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:41.915956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a0a7a6b-146d-4596-9a63-c9012b3ca577 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:41.916529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a0a7a6b-146d-4596-9a63-c9012b3ca577 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:42.045218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8a0a7a6b-146d-4596-9a63-c9012b3ca577 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:42.052814 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8a0a7a6b-146d-4596-9a63-c9012b3ca577 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.150308 May 19 05:35:42.053430 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3415/6740] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:41 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:43.072057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c00b901f-8a10-41ac-bd56-913359d59869 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:43.072676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c00b901f-8a10-41ac-bd56-913359d59869 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:43.079688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c00b901f-8a10-41ac-bd56-913359d59869 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:43.080141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c00b901f-8a10-41ac-bd56-913359d59869 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:43.080907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c00b901f-8a10-41ac-bd56-913359d59869 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:43.081379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c00b901f-8a10-41ac-bd56-913359d59869 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:43.211450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c00b901f-8a10-41ac-bd56-913359d59869 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:43.219004 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c00b901f-8a10-41ac-bd56-913359d59869 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.151503 May 19 05:35:43.219579 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3326/6741] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:43 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:44.235856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ede03848-e68c-400c-9aa5-ef1eb7da10f1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:44.236501 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ede03848-e68c-400c-9aa5-ef1eb7da10f1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:44.244971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ede03848-e68c-400c-9aa5-ef1eb7da10f1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:44.245578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ede03848-e68c-400c-9aa5-ef1eb7da10f1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:44.246379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ede03848-e68c-400c-9aa5-ef1eb7da10f1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:44.246836 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ede03848-e68c-400c-9aa5-ef1eb7da10f1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:44.391581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ede03848-e68c-400c-9aa5-ef1eb7da10f1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:44.399408 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ede03848-e68c-400c-9aa5-ef1eb7da10f1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1683 microversion: 2.1 time: 0.167521 May 19 05:35:44.400706 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3416/6742] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:44 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:44.780592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-cb48f512-9d1d-4a69-a011-9d6acc10ca0b req-4a1a22f1-3398-4cde-86b1-154b69482cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "name": "network-vif-unplugged", "status": "completed", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:44.790607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cb48f512-9d1d-4a69-a011-9d6acc10ca0b req-4a1a22f1-3398-4cde-86b1-154b69482cf5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:44.791091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cb48f512-9d1d-4a69-a011-9d6acc10ca0b req-4a1a22f1-3398-4cde-86b1-154b69482cf5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:44.803179 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cb48f512-9d1d-4a69-a011-9d6acc10ca0b req-4a1a22f1-3398-4cde-86b1-154b69482cf5 service nova] Creating event network-vif-unplugged:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h1-766726-30 May 19 05:35:44.809193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-cb48f512-9d1d-4a69-a011-9d6acc10ca0b req-4a1a22f1-3398-4cde-86b1-154b69482cf5 service nova] Instance 2823047e-70d6-431e-a010-a27e65f61ec5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:35:44.821404 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-cb48f512-9d1d-4a69-a011-9d6acc10ca0b req-4a1a22f1-3398-4cde-86b1-154b69482cf5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044406 May 19 05:35:44.822953 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3327/6743] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:35:45.415835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-788f43f5-c69c-4f9d-8aff-c94b89a4f527 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:45.416578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-788f43f5-c69c-4f9d-8aff-c94b89a4f527 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:45.423553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-788f43f5-c69c-4f9d-8aff-c94b89a4f527 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:45.424017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-788f43f5-c69c-4f9d-8aff-c94b89a4f527 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:45.425035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-788f43f5-c69c-4f9d-8aff-c94b89a4f527 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:45.425521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-788f43f5-c69c-4f9d-8aff-c94b89a4f527 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:45.558721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-788f43f5-c69c-4f9d-8aff-c94b89a4f527 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:45.566406 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-788f43f5-c69c-4f9d-8aff-c94b89a4f527 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1682 microversion: 2.1 time: 0.154511 May 19 05:35:45.567004 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3417/6744] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:45 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:46.586042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3e3d719d-6ce3-464d-a402-07c71dae9181 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:46.586690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3e3d719d-6ce3-464d-a402-07c71dae9181 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:46.593583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e3d719d-6ce3-464d-a402-07c71dae9181 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:46.594037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e3d719d-6ce3-464d-a402-07c71dae9181 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:46.594807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e3d719d-6ce3-464d-a402-07c71dae9181 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:46.595250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e3d719d-6ce3-464d-a402-07c71dae9181 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:46.721592 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3e3d719d-6ce3-464d-a402-07c71dae9181 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:46.729949 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3e3d719d-6ce3-464d-a402-07c71dae9181 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1680 microversion: 2.1 time: 0.149233 May 19 05:35:46.730533 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3328/6745] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:46 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:35:46.892425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6670e4f1-69aa-4658-bd7d-fff8ed6325ac req-cb2225d3-0775-4065-b0c1-681bc5e35471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:46.901020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6670e4f1-69aa-4658-bd7d-fff8ed6325ac req-cb2225d3-0775-4065-b0c1-681bc5e35471 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:46.901490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6670e4f1-69aa-4658-bd7d-fff8ed6325ac req-cb2225d3-0775-4065-b0c1-681bc5e35471 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:46.912797 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6670e4f1-69aa-4658-bd7d-fff8ed6325ac req-cb2225d3-0775-4065-b0c1-681bc5e35471 service nova] Creating event network-changed:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h1-766726-30 May 19 05:35:46.918310 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-6670e4f1-69aa-4658-bd7d-fff8ed6325ac req-cb2225d3-0775-4065-b0c1-681bc5e35471 service nova] Instance 2823047e-70d6-431e-a010-a27e65f61ec5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:35:46.929157 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6670e4f1-69aa-4658-bd7d-fff8ed6325ac req-cb2225d3-0775-4065-b0c1-681bc5e35471 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092426 May 19 05:35:46.929753 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3418/6746] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:35:47.746974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be5ead17-a4e6-4e8b-993d-0d2aa15fc632 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:47.748248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be5ead17-a4e6-4e8b-993d-0d2aa15fc632 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:47.755465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be5ead17-a4e6-4e8b-993d-0d2aa15fc632 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:47.755921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be5ead17-a4e6-4e8b-993d-0d2aa15fc632 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:47.756699 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be5ead17-a4e6-4e8b-993d-0d2aa15fc632 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:47.757378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-be5ead17-a4e6-4e8b-993d-0d2aa15fc632 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:47.895835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-be5ead17-a4e6-4e8b-993d-0d2aa15fc632 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:47.905116 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be5ead17-a4e6-4e8b-993d-0d2aa15fc632 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1677 microversion: 2.1 time: 0.161800 May 19 05:35:47.905817 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3329/6747] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:47 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:47.933382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:47.934018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:47.940575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:47.941039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:47.941848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:47.942317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:47.994920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:47.995298 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:47.996118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:47.996573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:48.017545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:35:48.022802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for user 804f458dff054b0db747dd434a73fcc5 and project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:35:48.122061 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-090524b2-b1a2-4202-a68c-661516637ad7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5/action" status: 202 len: 0 microversion: 2.1 time: 0.204394 May 19 05:35:48.122682 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3419/6748] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:35:47 2022] POST /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:35:48.131005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9168ad54-45b5-4813-bc81-8a4a317f5f4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:48.131638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9168ad54-45b5-4813-bc81-8a4a317f5f4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:48.138282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9168ad54-45b5-4813-bc81-8a4a317f5f4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:48.138738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9168ad54-45b5-4813-bc81-8a4a317f5f4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:48.139517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9168ad54-45b5-4813-bc81-8a4a317f5f4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:48.140194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9168ad54-45b5-4813-bc81-8a4a317f5f4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:48.270103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9168ad54-45b5-4813-bc81-8a4a317f5f4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:48.278327 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9168ad54-45b5-4813-bc81-8a4a317f5f4c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1676 microversion: 2.1 time: 0.151422 May 19 05:35:48.278918 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3330/6749] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:48 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:49.296618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9930e808-22c3-4b89-bd15-148c3b04eab0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:49.297399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9930e808-22c3-4b89-bd15-148c3b04eab0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:49.303962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9930e808-22c3-4b89-bd15-148c3b04eab0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:49.304437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9930e808-22c3-4b89-bd15-148c3b04eab0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:49.305249 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9930e808-22c3-4b89-bd15-148c3b04eab0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:49.305706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9930e808-22c3-4b89-bd15-148c3b04eab0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:49.437138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9930e808-22c3-4b89-bd15-148c3b04eab0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:49.444713 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9930e808-22c3-4b89-bd15-148c3b04eab0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1676 microversion: 2.1 time: 0.153258 May 19 05:35:49.445317 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3420/6750] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:49 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:50.463101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae448b7a-dc94-41d1-a1b2-99ae45a07f39 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:50.463746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ae448b7a-dc94-41d1-a1b2-99ae45a07f39 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:50.470652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae448b7a-dc94-41d1-a1b2-99ae45a07f39 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:50.471103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae448b7a-dc94-41d1-a1b2-99ae45a07f39 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:50.471865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae448b7a-dc94-41d1-a1b2-99ae45a07f39 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:50.472301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae448b7a-dc94-41d1-a1b2-99ae45a07f39 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:50.616670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae448b7a-dc94-41d1-a1b2-99ae45a07f39 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:50.624464 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae448b7a-dc94-41d1-a1b2-99ae45a07f39 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1676 microversion: 2.1 time: 0.165739 May 19 05:35:50.625035 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3331/6751] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:50 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:50.976199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8ef71a94-a56f-4bac-9fd5-907b0fa4020a req-cca7eda0-b121-41cd-9a04-e9237aa18c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "name": "network-vif-plugged", "status": "completed", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:50.986332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8ef71a94-a56f-4bac-9fd5-907b0fa4020a req-cca7eda0-b121-41cd-9a04-e9237aa18c02 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:50.987015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8ef71a94-a56f-4bac-9fd5-907b0fa4020a req-cca7eda0-b121-41cd-9a04-e9237aa18c02 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:51.000399 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8ef71a94-a56f-4bac-9fd5-907b0fa4020a req-cca7eda0-b121-41cd-9a04-e9237aa18c02 service nova] Creating event network-vif-plugged:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h2-766726-30 May 19 05:35:51.006674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-8ef71a94-a56f-4bac-9fd5-907b0fa4020a req-cca7eda0-b121-41cd-9a04-e9237aa18c02 service nova] Instance 2823047e-70d6-431e-a010-a27e65f61ec5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:35:51.018004 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8ef71a94-a56f-4bac-9fd5-907b0fa4020a req-cca7eda0-b121-41cd-9a04-e9237aa18c02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109445 May 19 05:35:51.018650 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3421/6752] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:35:51.580815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1a379629-477f-4887-a95f-2a43fd4f3b4f req-6803da15-6e9e-4aab-badc-8c81bffa81d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "name": "network-vif-unplugged", "status": "completed", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:51.590153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1a379629-477f-4887-a95f-2a43fd4f3b4f req-6803da15-6e9e-4aab-badc-8c81bffa81d6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:51.590602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1a379629-477f-4887-a95f-2a43fd4f3b4f req-6803da15-6e9e-4aab-badc-8c81bffa81d6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:51.603449 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1a379629-477f-4887-a95f-2a43fd4f3b4f req-6803da15-6e9e-4aab-badc-8c81bffa81d6 service nova] Creating event network-vif-unplugged:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h2-766726-30 May 19 05:35:51.608987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-1a379629-477f-4887-a95f-2a43fd4f3b4f req-6803da15-6e9e-4aab-badc-8c81bffa81d6 service nova] Instance 2823047e-70d6-431e-a010-a27e65f61ec5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:35:51.620371 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1a379629-477f-4887-a95f-2a43fd4f3b4f req-6803da15-6e9e-4aab-badc-8c81bffa81d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043278 May 19 05:35:51.620984 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3332/6753] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:35:51.644317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f33bfef7-61b7-484c-931d-83646ea3060f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:51.645050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f33bfef7-61b7-484c-931d-83646ea3060f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:51.651875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f33bfef7-61b7-484c-931d-83646ea3060f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:51.652343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f33bfef7-61b7-484c-931d-83646ea3060f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:51.653535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f33bfef7-61b7-484c-931d-83646ea3060f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:51.653652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f33bfef7-61b7-484c-931d-83646ea3060f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:51.658045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:51.900483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f33bfef7-61b7-484c-931d-83646ea3060f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:51.908388 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f33bfef7-61b7-484c-931d-83646ea3060f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1676 microversion: 2.1 time: 0.269185 May 19 05:35:51.908922 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3422/6754] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:51 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1676 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:52.927756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7dd30874-9ff9-4f95-92f0-65e9ea4ac3b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:52.928450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7dd30874-9ff9-4f95-92f0-65e9ea4ac3b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:52.935511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dd30874-9ff9-4f95-92f0-65e9ea4ac3b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:52.935965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dd30874-9ff9-4f95-92f0-65e9ea4ac3b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:52.936739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dd30874-9ff9-4f95-92f0-65e9ea4ac3b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:52.937214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dd30874-9ff9-4f95-92f0-65e9ea4ac3b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:53.069004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7dd30874-9ff9-4f95-92f0-65e9ea4ac3b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:53.072589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:53.077513 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7dd30874-9ff9-4f95-92f0-65e9ea4ac3b9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1676 microversion: 2.1 time: 0.154899 May 19 05:35:53.078099 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3333/6755] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:52 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:53.638828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-2d168b44-44dc-4190-a2c0-2b40dea2ea7d req-75551886-ae59-45b3-b691-ebe6d6cc559f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:53.647844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2d168b44-44dc-4190-a2c0-2b40dea2ea7d req-75551886-ae59-45b3-b691-ebe6d6cc559f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:53.648302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-2d168b44-44dc-4190-a2c0-2b40dea2ea7d req-75551886-ae59-45b3-b691-ebe6d6cc559f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:53.660714 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-2d168b44-44dc-4190-a2c0-2b40dea2ea7d req-75551886-ae59-45b3-b691-ebe6d6cc559f service nova] Creating event network-changed:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h2-766726-30 May 19 05:35:53.666045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-2d168b44-44dc-4190-a2c0-2b40dea2ea7d req-75551886-ae59-45b3-b691-ebe6d6cc559f service nova] Instance 2823047e-70d6-431e-a010-a27e65f61ec5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:35:53.677791 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-2d168b44-44dc-4190-a2c0-2b40dea2ea7d req-75551886-ae59-45b3-b691-ebe6d6cc559f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042578 May 19 05:35:53.678410 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3423/6756] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:35:54.095440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8939d2d3-8e7c-46e0-b487-ee249a4ca309 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:54.097634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8939d2d3-8e7c-46e0-b487-ee249a4ca309 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:54.111444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8939d2d3-8e7c-46e0-b487-ee249a4ca309 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:54.113026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8939d2d3-8e7c-46e0-b487-ee249a4ca309 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:54.116520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8939d2d3-8e7c-46e0-b487-ee249a4ca309 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:54.117411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8939d2d3-8e7c-46e0-b487-ee249a4ca309 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:54.425680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8939d2d3-8e7c-46e0-b487-ee249a4ca309 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:54.434504 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8939d2d3-8e7c-46e0-b487-ee249a4ca309 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1676 microversion: 2.1 time: 0.343976 May 19 05:35:54.435090 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3334/6757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:54 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1676 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:55.453674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e99e4172-0ef8-4ae3-bc09-ab7ff947f723 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:55.454398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e99e4172-0ef8-4ae3-bc09-ab7ff947f723 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:55.460773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e99e4172-0ef8-4ae3-bc09-ab7ff947f723 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:55.461279 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e99e4172-0ef8-4ae3-bc09-ab7ff947f723 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:55.462062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e99e4172-0ef8-4ae3-bc09-ab7ff947f723 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:55.462515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e99e4172-0ef8-4ae3-bc09-ab7ff947f723 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:55.592699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e99e4172-0ef8-4ae3-bc09-ab7ff947f723 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:55.600557 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e99e4172-0ef8-4ae3-bc09-ab7ff947f723 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1669 microversion: 2.1 time: 0.152085 May 19 05:35:55.601144 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3424/6758] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:55 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:55.616624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-46423727-28d2-493b-bcca-291e38a9308d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:55.617280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-46423727-28d2-493b-bcca-291e38a9308d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:55.620451 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=39 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:55.626282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46423727-28d2-493b-bcca-291e38a9308d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:55.626738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46423727-28d2-493b-bcca-291e38a9308d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:55.627508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46423727-28d2-493b-bcca-291e38a9308d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:55.627946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-46423727-28d2-493b-bcca-291e38a9308d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:55.757835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-46423727-28d2-493b-bcca-291e38a9308d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:55.766156 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-46423727-28d2-493b-bcca-291e38a9308d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1669 microversion: 2.1 time: 0.153380 May 19 05:35:55.766745 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3335/6759] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:55 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:55.782254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fc421a6a-7c6b-4531-9740-6c16694150eb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:55.782893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fc421a6a-7c6b-4531-9740-6c16694150eb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:55.784887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:55.791251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc421a6a-7c6b-4531-9740-6c16694150eb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:55.791710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc421a6a-7c6b-4531-9740-6c16694150eb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:55.792487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc421a6a-7c6b-4531-9740-6c16694150eb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:55.792933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc421a6a-7c6b-4531-9740-6c16694150eb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:55.909009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3a3306a8-7027-4639-b8c2-3dd50a6b1399 req-1857d184-0c56-4633-bfa7-e318fb8632c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "name": "network-vif-plugged", "status": "completed", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:55.919778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3a3306a8-7027-4639-b8c2-3dd50a6b1399 req-1857d184-0c56-4633-bfa7-e318fb8632c0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:55.920762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3a3306a8-7027-4639-b8c2-3dd50a6b1399 req-1857d184-0c56-4633-bfa7-e318fb8632c0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:55.932215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fc421a6a-7c6b-4531-9740-6c16694150eb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:55.933433 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3a3306a8-7027-4639-b8c2-3dd50a6b1399 req-1857d184-0c56-4633-bfa7-e318fb8632c0 service nova] Creating event network-vif-plugged:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h2-766726-30 May 19 05:35:55.938557 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3a3306a8-7027-4639-b8c2-3dd50a6b1399 req-1857d184-0c56-4633-bfa7-e318fb8632c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033414 May 19 05:35:55.939647 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3336/6760] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:35:55.942370 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fc421a6a-7c6b-4531-9740-6c16694150eb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1669 microversion: 2.1 time: 0.163913 May 19 05:35:55.944214 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3425/6761] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:55 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:55.959235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31524912-6854-46e9-a79f-1574313fcb51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:55.959833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31524912-6854-46e9-a79f-1574313fcb51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:55.966289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31524912-6854-46e9-a79f-1574313fcb51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:55.966748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31524912-6854-46e9-a79f-1574313fcb51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:55.967567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31524912-6854-46e9-a79f-1574313fcb51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:55.967963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31524912-6854-46e9-a79f-1574313fcb51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:55.997280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31524912-6854-46e9-a79f-1574313fcb51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:35:56.070877 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31524912-6854-46e9-a79f-1574313fcb51 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 204 len: 0 microversion: 2.1 time: 0.115625 May 19 05:35:56.071653 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3337/6762] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:35:55 2022] DELETE /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:35:56.079738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-90ebf413-0fce-403b-aca0-057f7277c296 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:56.080369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-90ebf413-0fce-403b-aca0-057f7277c296 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:56.086381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90ebf413-0fce-403b-aca0-057f7277c296 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:56.086894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90ebf413-0fce-403b-aca0-057f7277c296 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:56.087663 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90ebf413-0fce-403b-aca0-057f7277c296 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:56.088109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-90ebf413-0fce-403b-aca0-057f7277c296 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:56.217985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-90ebf413-0fce-403b-aca0-057f7277c296 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:56.225768 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-90ebf413-0fce-403b-aca0-057f7277c296 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1675 microversion: 2.1 time: 0.150007 May 19 05:35:56.226337 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3426/6763] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:56 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:57.244390 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-65d5cd9e-0d53-4fad-b7de-3f1980bb56ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:57.245128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-65d5cd9e-0d53-4fad-b7de-3f1980bb56ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:57.252142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65d5cd9e-0d53-4fad-b7de-3f1980bb56ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:57.252590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65d5cd9e-0d53-4fad-b7de-3f1980bb56ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:57.253376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65d5cd9e-0d53-4fad-b7de-3f1980bb56ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:57.253811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-65d5cd9e-0d53-4fad-b7de-3f1980bb56ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:57.467272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-65d5cd9e-0d53-4fad-b7de-3f1980bb56ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:57.475513 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-65d5cd9e-0d53-4fad-b7de-3f1980bb56ec tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1675 microversion: 2.1 time: 0.235435 May 19 05:35:57.476092 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3338/6764] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:57 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1675 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:58.176287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9cc2922b-14d5-41c1-86af-943543f82f27 req-c83b41fa-ee1f-46df-9c53-5690c6726fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2823047e-70d6-431e-a010-a27e65f61ec5", "name": "network-vif-deleted", "tag": "206565b6-9191-43e4-9371-c727feb70278"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:58.186141 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:35:58.188163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9cc2922b-14d5-41c1-86af-943543f82f27 req-c83b41fa-ee1f-46df-9c53-5690c6726fc2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:58.188826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9cc2922b-14d5-41c1-86af-943543f82f27 req-c83b41fa-ee1f-46df-9c53-5690c6726fc2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:58.201386 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9cc2922b-14d5-41c1-86af-943543f82f27 req-c83b41fa-ee1f-46df-9c53-5690c6726fc2 service nova] Creating event network-vif-deleted:206565b6-9191-43e4-9371-c727feb70278 for instance 2823047e-70d6-431e-a010-a27e65f61ec5 on n-h2-766726-30 May 19 05:35:58.206521 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9cc2922b-14d5-41c1-86af-943543f82f27 req-c83b41fa-ee1f-46df-9c53-5690c6726fc2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034408 May 19 05:35:58.207135 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3427/6765] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:35:58.491924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:58.492539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:58.500495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:58.500942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:58.501748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:58.502188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:58.535770 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:58.536279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:58.536698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lazy-loading 'fault' on Instance uuid 2823047e-70d6-431e-a010-a27e65f61ec5 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:35:58.587088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:35:58.596172 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ef0178c4-eee5-462d-baa8-8f7fdd34d9d4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 200 len: 1328 microversion: 2.1 time: 0.107976 May 19 05:35:58.597544 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3339/6766] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:58 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:35:59.616412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:59.617155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:59.624002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:59.624462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:59.625263 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:59.625709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:59.638844 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 HTTP/1.1 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2823047e-70d6-431e-a010-a27e65f61ec5'} May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:35:59.640466 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4e0ad6ca-8209-4e63-8783-35a7cd9be11a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 404 len: 111 microversion: 2.1 time: 0.030685 May 19 05:35:59.645975 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3428/6767] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:59 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:35:59.658040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:35:59.658661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:35:59.668027 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:59.668907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:59.669859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:35:59.671275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:35:59.686269 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 HTTP/1.1 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2823047e-70d6-431e-a010-a27e65f61ec5'} May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:35:59.687908 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8763e05-e5a3-47c0-bd2f-5984a76420ff tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 404 len: 111 microversion: 2.1 time: 0.035170 May 19 05:35:59.693203 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3340/6768] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:35:59 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:35:59.735879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1982534675", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "e5e4b2f1-a2a4-4049-8b40-f59ae16473b6"}], "security_groups": [{"name": "tempest-securitygroup--469202799"}], "key_name": "tempest-keypair-1240287522", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:35:59.837401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] validate_networks() for [('e5e4b2f1-a2a4-4049-8b40-f59ae16473b6', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:36:00.237921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:36:00.238357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:36:00.238845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:36:00.239265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:36:00.239685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:36:00.248562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:00.249024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:00.249856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:00.250302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:00.266828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:36:00.273811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for user 804f458dff054b0db747dd434a73fcc5 and project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:36:00.287963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:36:00.290917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:36:00.335753 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-81d318d6-d7a3-490c-bcc9-d38ed2b594ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.603785 May 19 05:36:00.336393 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3429/6769] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:35:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:36:00.347020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3e225de6-dfa5-44f3-b85d-6208a19ebee8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:00.347639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3e225de6-dfa5-44f3-b85d-6208a19ebee8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:00.399974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3e225de6-dfa5-44f3-b85d-6208a19ebee8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:00.408282 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3e225de6-dfa5-44f3-b85d-6208a19ebee8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1239 microversion: 2.1 time: 0.065151 May 19 05:36:00.408857 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3341/6770] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:00 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:01.427469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2e19cea7-7ad5-4b7e-bbc6-29212a7755a0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:01.428252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2e19cea7-7ad5-4b7e-bbc6-29212a7755a0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:01.436530 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e19cea7-7ad5-4b7e-bbc6-29212a7755a0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:01.437522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e19cea7-7ad5-4b7e-bbc6-29212a7755a0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:01.438385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e19cea7-7ad5-4b7e-bbc6-29212a7755a0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:01.439294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2e19cea7-7ad5-4b7e-bbc6-29212a7755a0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:01.500576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2e19cea7-7ad5-4b7e-bbc6-29212a7755a0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:01.508094 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2e19cea7-7ad5-4b7e-bbc6-29212a7755a0 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1297 microversion: 2.1 time: 0.086397 May 19 05:36:01.508668 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3430/6771] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:01 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:02.525563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b5af7072-8fae-462a-b325-fc3cbe3cf0d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:02.526196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b5af7072-8fae-462a-b325-fc3cbe3cf0d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:02.533927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5af7072-8fae-462a-b325-fc3cbe3cf0d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:02.534385 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5af7072-8fae-462a-b325-fc3cbe3cf0d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:02.535162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5af7072-8fae-462a-b325-fc3cbe3cf0d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:02.535632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b5af7072-8fae-462a-b325-fc3cbe3cf0d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:02.693774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b5af7072-8fae-462a-b325-fc3cbe3cf0d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:02.706897 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b5af7072-8fae-462a-b325-fc3cbe3cf0d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1364 microversion: 2.1 time: 0.185265 May 19 05:36:02.707529 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3342/6772] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:02 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:02.740977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-dcf8fa43-1dc2-403d-9ac3-c8fae9696531 req-854a2269-c069-4b0c-b18c-cd0192b3c961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:36:02.757716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dcf8fa43-1dc2-403d-9ac3-c8fae9696531 req-854a2269-c069-4b0c-b18c-cd0192b3c961 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:02.758481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-dcf8fa43-1dc2-403d-9ac3-c8fae9696531 req-854a2269-c069-4b0c-b18c-cd0192b3c961 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:02.791220 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-dcf8fa43-1dc2-403d-9ac3-c8fae9696531 req-854a2269-c069-4b0c-b18c-cd0192b3c961 service nova] Creating event network-changed:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h1-766726-30 May 19 05:36:02.800326 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-dcf8fa43-1dc2-403d-9ac3-c8fae9696531 req-854a2269-c069-4b0c-b18c-cd0192b3c961 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066984 May 19 05:36:02.801199 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3431/6773] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:36:03.725666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7807214-8dfd-40d9-a4c3-eaf5917a575a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:03.726404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7807214-8dfd-40d9-a4c3-eaf5917a575a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:03.733787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7807214-8dfd-40d9-a4c3-eaf5917a575a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:03.734238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7807214-8dfd-40d9-a4c3-eaf5917a575a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:03.735331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7807214-8dfd-40d9-a4c3-eaf5917a575a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:03.735772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7807214-8dfd-40d9-a4c3-eaf5917a575a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:03.864430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7807214-8dfd-40d9-a4c3-eaf5917a575a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:03.871918 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7807214-8dfd-40d9-a4c3-eaf5917a575a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1364 microversion: 2.1 time: 0.150443 May 19 05:36:03.872484 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3343/6774] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:03 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:04.891843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d6fea56b-f65b-47f0-a040-519295ea4216 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:04.892710 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d6fea56b-f65b-47f0-a040-519295ea4216 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:04.898987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6fea56b-f65b-47f0-a040-519295ea4216 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:04.899479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6fea56b-f65b-47f0-a040-519295ea4216 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:04.900251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6fea56b-f65b-47f0-a040-519295ea4216 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:04.901644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6fea56b-f65b-47f0-a040-519295ea4216 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:05.034366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d6fea56b-f65b-47f0-a040-519295ea4216 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:05.042167 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d6fea56b-f65b-47f0-a040-519295ea4216 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1364 microversion: 2.1 time: 0.155668 May 19 05:36:05.042752 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3432/6775] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:04 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:06.059972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f3fb5df6-f2b2-4b4c-8be5-235909051e5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:06.060540 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f3fb5df6-f2b2-4b4c-8be5-235909051e5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:06.067555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3fb5df6-f2b2-4b4c-8be5-235909051e5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:06.068015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3fb5df6-f2b2-4b4c-8be5-235909051e5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:06.068785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3fb5df6-f2b2-4b4c-8be5-235909051e5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:06.069260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f3fb5df6-f2b2-4b4c-8be5-235909051e5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:06.201977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f3fb5df6-f2b2-4b4c-8be5-235909051e5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:06.209458 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f3fb5df6-f2b2-4b4c-8be5-235909051e5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1364 microversion: 2.1 time: 0.154061 May 19 05:36:06.210051 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3344/6776] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:06 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:07.226989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7a0a0a38-250b-4cfd-bbef-1ede723ba48a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:07.227617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7a0a0a38-250b-4cfd-bbef-1ede723ba48a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:07.235280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a0a0a38-250b-4cfd-bbef-1ede723ba48a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:07.235741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a0a0a38-250b-4cfd-bbef-1ede723ba48a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:07.237333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a0a0a38-250b-4cfd-bbef-1ede723ba48a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:07.238138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7a0a0a38-250b-4cfd-bbef-1ede723ba48a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:07.370767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7a0a0a38-250b-4cfd-bbef-1ede723ba48a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:07.378682 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7a0a0a38-250b-4cfd-bbef-1ede723ba48a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1364 microversion: 2.1 time: 0.155883 May 19 05:36:07.379259 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3433/6777] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:07 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:08.395791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2ccf405f-c22c-4f90-bafe-31e33799d41e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:08.396407 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2ccf405f-c22c-4f90-bafe-31e33799d41e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:08.403958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ccf405f-c22c-4f90-bafe-31e33799d41e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:08.404411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ccf405f-c22c-4f90-bafe-31e33799d41e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:08.405205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ccf405f-c22c-4f90-bafe-31e33799d41e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:08.405653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2ccf405f-c22c-4f90-bafe-31e33799d41e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:08.534990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2ccf405f-c22c-4f90-bafe-31e33799d41e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:08.542519 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2ccf405f-c22c-4f90-bafe-31e33799d41e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1364 microversion: 2.1 time: 0.150597 May 19 05:36:08.543098 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3345/6778] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:08 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:08.998410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b4ab3414-4f0c-4018-8912-29a79a2c11a1 req-cf2f11d1-fa02-48bd-84e1-038689c61790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "name": "network-vif-plugged", "status": "completed", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:36:09.014545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b4ab3414-4f0c-4018-8912-29a79a2c11a1 req-cf2f11d1-fa02-48bd-84e1-038689c61790 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:09.016077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b4ab3414-4f0c-4018-8912-29a79a2c11a1 req-cf2f11d1-fa02-48bd-84e1-038689c61790 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:09.032514 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b4ab3414-4f0c-4018-8912-29a79a2c11a1 req-cf2f11d1-fa02-48bd-84e1-038689c61790 service nova] Creating event network-vif-plugged:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h1-766726-30 May 19 05:36:09.041520 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b4ab3414-4f0c-4018-8912-29a79a2c11a1 req-cf2f11d1-fa02-48bd-84e1-038689c61790 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047330 May 19 05:36:09.042255 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3434/6779] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:36:09.560343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ac3ab1a5-e9f2-45f9-8887-0eb219f7520b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:09.560902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ac3ab1a5-e9f2-45f9-8887-0eb219f7520b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:09.567815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac3ab1a5-e9f2-45f9-8887-0eb219f7520b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:09.568259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac3ab1a5-e9f2-45f9-8887-0eb219f7520b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:09.569018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac3ab1a5-e9f2-45f9-8887-0eb219f7520b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:09.569479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ac3ab1a5-e9f2-45f9-8887-0eb219f7520b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:09.694919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ac3ab1a5-e9f2-45f9-8887-0eb219f7520b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:09.702562 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ac3ab1a5-e9f2-45f9-8887-0eb219f7520b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1364 microversion: 2.1 time: 0.146834 May 19 05:36:09.703140 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3346/6780] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:09 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:10.717932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:36:10.718735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:36:10.722792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d1cc4493-de17-46c3-bc16-90137dc616a1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:10.723783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d1cc4493-de17-46c3-bc16-90137dc616a1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:10.730987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1cc4493-de17-46c3-bc16-90137dc616a1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:10.731446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1cc4493-de17-46c3-bc16-90137dc616a1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:10.732212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1cc4493-de17-46c3-bc16-90137dc616a1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:10.732660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1cc4493-de17-46c3-bc16-90137dc616a1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:10.865639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d1cc4493-de17-46c3-bc16-90137dc616a1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:10.874077 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d1cc4493-de17-46c3-bc16-90137dc616a1 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1551 microversion: 2.1 time: 0.157946 May 19 05:36:10.874681 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3435/6781] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:10 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:10.890703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-086a3615-41fb-4d7f-89b8-caffb69cf0cd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:10.891183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-086a3615-41fb-4d7f-89b8-caffb69cf0cd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:10.893101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:36:10.899375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-086a3615-41fb-4d7f-89b8-caffb69cf0cd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:10.899826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-086a3615-41fb-4d7f-89b8-caffb69cf0cd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:10.900622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-086a3615-41fb-4d7f-89b8-caffb69cf0cd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:10.901061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-086a3615-41fb-4d7f-89b8-caffb69cf0cd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:10.976754 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-086a3615-41fb-4d7f-89b8-caffb69cf0cd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089944 May 19 05:36:10.977389 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3347/6782] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 05:36:10 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:36:12.218723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f46acd5d-c27d-4609-b46b-5f6e5d5dfeef req-1bec520c-9af2-44cf-95fc-c8b6ba8e4b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:36:12.227860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f46acd5d-c27d-4609-b46b-5f6e5d5dfeef req-1bec520c-9af2-44cf-95fc-c8b6ba8e4b09 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:12.228325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f46acd5d-c27d-4609-b46b-5f6e5d5dfeef req-1bec520c-9af2-44cf-95fc-c8b6ba8e4b09 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:12.239332 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f46acd5d-c27d-4609-b46b-5f6e5d5dfeef req-1bec520c-9af2-44cf-95fc-c8b6ba8e4b09 service nova] Creating event network-changed:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h1-766726-30 May 19 05:36:12.244669 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f46acd5d-c27d-4609-b46b-5f6e5d5dfeef req-1bec520c-9af2-44cf-95fc-c8b6ba8e4b09 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029169 May 19 05:36:12.245493 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3436/6783] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:36:47.842286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:36:47.843090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:36:47.846899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5698c2a8-a740-46d9-b1e1-022ae69432aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:36:47.847508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5698c2a8-a740-46d9-b1e1-022ae69432aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:47.855537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5698c2a8-a740-46d9-b1e1-022ae69432aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:47.855981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5698c2a8-a740-46d9-b1e1-022ae69432aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:47.856739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5698c2a8-a740-46d9-b1e1-022ae69432aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:47.857206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5698c2a8-a740-46d9-b1e1-022ae69432aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:47.984200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5698c2a8-a740-46d9-b1e1-022ae69432aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:36:47.991824 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5698c2a8-a740-46d9-b1e1-022ae69432aa tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1669 microversion: 2.1 time: 0.151539 May 19 05:36:47.992397 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3348/6784] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:36:47 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:36:48.007434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:36:48.008181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=62 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:36:48.013459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0d1a897f-9e4b-4736-8b4e-0f657fe581db tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6077ca1a-3b5f-4984-ab30-157e76ca1964"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:36:48.014620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0d1a897f-9e4b-4736-8b4e-0f657fe581db tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:36:48.022110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d1a897f-9e4b-4736-8b4e-0f657fe581db tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:48.022571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d1a897f-9e4b-4736-8b4e-0f657fe581db tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:48.023347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d1a897f-9e4b-4736-8b4e-0f657fe581db tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:36:48.023793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0d1a897f-9e4b-4736-8b4e-0f657fe581db tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:36:48.255329 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0d1a897f-9e4b-4736-8b4e-0f657fe581db tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250418 May 19 05:36:48.255966 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3437/6785] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 05:36:48 2022] POST /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:37:04.178730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:37:04.179743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:04.181942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:37:04.182812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:37:04.188546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:04.189015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:04.189813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:04.190252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:04.218962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:04.225044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Old instance type m1.heat2, new instance type m1.heat {{(pid=124819) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:37:04.231679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:37:04.232102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:37:04.232579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:37:04.232990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:37:04.233443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:37:04.294652 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a4a0d7b1-a846-4dd9-a465-9f369c580810 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/action" status: 202 len: 0 microversion: 2.1 time: 0.120003 May 19 05:37:04.295259 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3349/6786] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:37:04 2022] POST /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:37:04.301524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:37:04.302307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:37:04.306384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d4a476e-5092-47c2-9138-9b68fe17bdd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:04.307180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d4a476e-5092-47c2-9138-9b68fe17bdd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:04.314695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d4a476e-5092-47c2-9138-9b68fe17bdd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:04.315150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d4a476e-5092-47c2-9138-9b68fe17bdd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:04.315914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d4a476e-5092-47c2-9138-9b68fe17bdd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:04.316362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d4a476e-5092-47c2-9138-9b68fe17bdd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:04.488988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d4a476e-5092-47c2-9138-9b68fe17bdd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:04.498974 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d4a476e-5092-47c2-9138-9b68fe17bdd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1724 microversion: 2.1 time: 0.199328 May 19 05:37:04.500000 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3438/6787] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:04 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:05.517047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74b4e4bf-a703-4ab4-8e29-fca7ccc5b57c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:05.517646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74b4e4bf-a703-4ab4-8e29-fca7ccc5b57c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:05.524631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b4e4bf-a703-4ab4-8e29-fca7ccc5b57c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:05.525101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b4e4bf-a703-4ab4-8e29-fca7ccc5b57c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:05.525856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b4e4bf-a703-4ab4-8e29-fca7ccc5b57c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:05.526293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74b4e4bf-a703-4ab4-8e29-fca7ccc5b57c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:05.674693 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74b4e4bf-a703-4ab4-8e29-fca7ccc5b57c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:05.687649 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74b4e4bf-a703-4ab4-8e29-fca7ccc5b57c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1724 microversion: 2.1 time: 0.171587 May 19 05:37:05.687649 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3350/6788] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:05 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:06.702024 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-127a3201-b549-44da-88e1-59c5cdf73aa3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:06.702880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-127a3201-b549-44da-88e1-59c5cdf73aa3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:06.709904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-127a3201-b549-44da-88e1-59c5cdf73aa3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:06.710367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-127a3201-b549-44da-88e1-59c5cdf73aa3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:06.711148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-127a3201-b549-44da-88e1-59c5cdf73aa3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:06.711601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-127a3201-b549-44da-88e1-59c5cdf73aa3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:06.844192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-127a3201-b549-44da-88e1-59c5cdf73aa3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:06.852707 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-127a3201-b549-44da-88e1-59c5cdf73aa3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.155271 May 19 05:37:06.853315 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3439/6789] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:06 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:07.870729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8a621ded-3b12-45d4-9400-0c609f39048d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:07.871332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8a621ded-3b12-45d4-9400-0c609f39048d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:07.878149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a621ded-3b12-45d4-9400-0c609f39048d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:07.878597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a621ded-3b12-45d4-9400-0c609f39048d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:07.879350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a621ded-3b12-45d4-9400-0c609f39048d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:07.879787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a621ded-3b12-45d4-9400-0c609f39048d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:08.005937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8a621ded-3b12-45d4-9400-0c609f39048d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:08.013860 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8a621ded-3b12-45d4-9400-0c609f39048d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.147654 May 19 05:37:08.014442 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3351/6790] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:07 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:09.030075 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f8e330db-db44-4ed1-a6c1-84ec76b11c48 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:09.030706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f8e330db-db44-4ed1-a6c1-84ec76b11c48 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:09.037536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8e330db-db44-4ed1-a6c1-84ec76b11c48 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:09.037998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8e330db-db44-4ed1-a6c1-84ec76b11c48 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:09.038767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8e330db-db44-4ed1-a6c1-84ec76b11c48 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:09.039217 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f8e330db-db44-4ed1-a6c1-84ec76b11c48 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:09.170716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f8e330db-db44-4ed1-a6c1-84ec76b11c48 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:09.178772 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f8e330db-db44-4ed1-a6c1-84ec76b11c48 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.152619 May 19 05:37:09.179384 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3440/6791] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:09 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:10.197040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9db4e737-dfc8-4455-843e-daf4e3f76f62 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:10.197715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9db4e737-dfc8-4455-843e-daf4e3f76f62 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:10.204674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9db4e737-dfc8-4455-843e-daf4e3f76f62 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:10.205159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9db4e737-dfc8-4455-843e-daf4e3f76f62 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:10.205930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9db4e737-dfc8-4455-843e-daf4e3f76f62 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:10.206404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9db4e737-dfc8-4455-843e-daf4e3f76f62 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:10.332942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9db4e737-dfc8-4455-843e-daf4e3f76f62 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:10.341665 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9db4e737-dfc8-4455-843e-daf4e3f76f62 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.148583 May 19 05:37:10.342272 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3352/6792] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:10 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:11.359864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-50b0937f-d813-4665-ba4a-a4926562e429 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:11.360511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-50b0937f-d813-4665-ba4a-a4926562e429 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:11.367477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50b0937f-d813-4665-ba4a-a4926562e429 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:11.367944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50b0937f-d813-4665-ba4a-a4926562e429 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:11.368720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50b0937f-d813-4665-ba4a-a4926562e429 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:11.369199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-50b0937f-d813-4665-ba4a-a4926562e429 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:11.502300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-50b0937f-d813-4665-ba4a-a4926562e429 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:11.510890 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-50b0937f-d813-4665-ba4a-a4926562e429 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.154396 May 19 05:37:11.511466 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3441/6793] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:11 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:12.528343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-97ae2f35-0cb2-4a09-9521-623a9b17b133 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:12.528883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-97ae2f35-0cb2-4a09-9521-623a9b17b133 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:12.536023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97ae2f35-0cb2-4a09-9521-623a9b17b133 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:12.536473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97ae2f35-0cb2-4a09-9521-623a9b17b133 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:12.537294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97ae2f35-0cb2-4a09-9521-623a9b17b133 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:12.537731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-97ae2f35-0cb2-4a09-9521-623a9b17b133 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:12.663545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-97ae2f35-0cb2-4a09-9521-623a9b17b133 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:12.671678 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-97ae2f35-0cb2-4a09-9521-623a9b17b133 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.147876 May 19 05:37:12.672248 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3353/6794] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:12 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:13.688206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94089d27-d8ea-4b6d-b677-f285c7199c38 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:13.688864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-94089d27-d8ea-4b6d-b677-f285c7199c38 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:13.695964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94089d27-d8ea-4b6d-b677-f285c7199c38 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:13.696435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94089d27-d8ea-4b6d-b677-f285c7199c38 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:13.697286 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94089d27-d8ea-4b6d-b677-f285c7199c38 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:13.697772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94089d27-d8ea-4b6d-b677-f285c7199c38 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:13.828942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94089d27-d8ea-4b6d-b677-f285c7199c38 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:13.836909 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94089d27-d8ea-4b6d-b677-f285c7199c38 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.152615 May 19 05:37:13.837509 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3442/6795] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:13 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:14.853714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-836897c4-7602-4e88-9ba4-c9b33151af4e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:14.855472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-836897c4-7602-4e88-9ba4-c9b33151af4e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:14.862867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-836897c4-7602-4e88-9ba4-c9b33151af4e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:14.863315 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-836897c4-7602-4e88-9ba4-c9b33151af4e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:14.864081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-836897c4-7602-4e88-9ba4-c9b33151af4e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:14.864515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-836897c4-7602-4e88-9ba4-c9b33151af4e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:14.991336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-836897c4-7602-4e88-9ba4-c9b33151af4e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:14.999365 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-836897c4-7602-4e88-9ba4-c9b33151af4e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.149527 May 19 05:37:14.999941 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3354/6796] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:14 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:16.017126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9cd4b86d-e5b8-4f1b-9743-a806d416920a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:16.017699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9cd4b86d-e5b8-4f1b-9743-a806d416920a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:16.024760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd4b86d-e5b8-4f1b-9743-a806d416920a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:16.025277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd4b86d-e5b8-4f1b-9743-a806d416920a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:16.026050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd4b86d-e5b8-4f1b-9743-a806d416920a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:16.026500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9cd4b86d-e5b8-4f1b-9743-a806d416920a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:16.155265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9cd4b86d-e5b8-4f1b-9743-a806d416920a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:16.163315 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9cd4b86d-e5b8-4f1b-9743-a806d416920a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.150279 May 19 05:37:16.163890 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3443/6797] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:16 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:17.179732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-db60ac56-bdb2-4b8f-8d7f-81e3f15ebdb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:17.180450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-db60ac56-bdb2-4b8f-8d7f-81e3f15ebdb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:17.187502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db60ac56-bdb2-4b8f-8d7f-81e3f15ebdb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:17.187958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db60ac56-bdb2-4b8f-8d7f-81e3f15ebdb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:17.188733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db60ac56-bdb2-4b8f-8d7f-81e3f15ebdb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:17.189208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db60ac56-bdb2-4b8f-8d7f-81e3f15ebdb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:17.320059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-db60ac56-bdb2-4b8f-8d7f-81e3f15ebdb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:17.328842 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-db60ac56-bdb2-4b8f-8d7f-81e3f15ebdb6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.152976 May 19 05:37:17.339714 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3355/6798] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:17 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:18.347662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-187ab39b-44ae-4ede-abfc-f3f644bd04ca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:18.348287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-187ab39b-44ae-4ede-abfc-f3f644bd04ca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:18.356044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-187ab39b-44ae-4ede-abfc-f3f644bd04ca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:18.356506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-187ab39b-44ae-4ede-abfc-f3f644bd04ca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:18.357302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-187ab39b-44ae-4ede-abfc-f3f644bd04ca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:18.357754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-187ab39b-44ae-4ede-abfc-f3f644bd04ca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:18.484866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-187ab39b-44ae-4ede-abfc-f3f644bd04ca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:18.492970 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-187ab39b-44ae-4ede-abfc-f3f644bd04ca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.149587 May 19 05:37:18.493572 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3444/6799] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:18 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:19.515047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4298bf37-ca05-492f-839d-775f64bbc2bf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:19.515610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4298bf37-ca05-492f-839d-775f64bbc2bf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:19.522891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4298bf37-ca05-492f-839d-775f64bbc2bf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:19.523342 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4298bf37-ca05-492f-839d-775f64bbc2bf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:19.524113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4298bf37-ca05-492f-839d-775f64bbc2bf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:19.524553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4298bf37-ca05-492f-839d-775f64bbc2bf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:19.655950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4298bf37-ca05-492f-839d-775f64bbc2bf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:19.663978 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4298bf37-ca05-492f-839d-775f64bbc2bf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.157575 May 19 05:37:19.664598 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3356/6800] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:19 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:20.681742 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f60ecfd-eaca-4741-b748-b4a744fd7bad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:20.682899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f60ecfd-eaca-4741-b748-b4a744fd7bad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:20.689854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f60ecfd-eaca-4741-b748-b4a744fd7bad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:20.690314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f60ecfd-eaca-4741-b748-b4a744fd7bad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:20.691087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f60ecfd-eaca-4741-b748-b4a744fd7bad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:20.691535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f60ecfd-eaca-4741-b748-b4a744fd7bad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:20.825676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0f60ecfd-eaca-4741-b748-b4a744fd7bad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:20.833839 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f60ecfd-eaca-4741-b748-b4a744fd7bad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.156011 May 19 05:37:20.834431 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3445/6801] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:20 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:21.851184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-789287c9-625f-45ce-a40a-cdafb95aa422 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:21.851802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-789287c9-625f-45ce-a40a-cdafb95aa422 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:21.858835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-789287c9-625f-45ce-a40a-cdafb95aa422 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:21.859286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-789287c9-625f-45ce-a40a-cdafb95aa422 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:21.860052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-789287c9-625f-45ce-a40a-cdafb95aa422 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:21.860495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-789287c9-625f-45ce-a40a-cdafb95aa422 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:21.988882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-789287c9-625f-45ce-a40a-cdafb95aa422 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:21.997499 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-789287c9-625f-45ce-a40a-cdafb95aa422 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.150444 May 19 05:37:21.998076 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3357/6802] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:21 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:23.014457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-308ff97d-404c-43d9-87f7-45f4b7521cca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:23.015094 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-308ff97d-404c-43d9-87f7-45f4b7521cca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:23.021667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-308ff97d-404c-43d9-87f7-45f4b7521cca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:23.022139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-308ff97d-404c-43d9-87f7-45f4b7521cca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:23.022921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-308ff97d-404c-43d9-87f7-45f4b7521cca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:23.023375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-308ff97d-404c-43d9-87f7-45f4b7521cca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:23.153627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-308ff97d-404c-43d9-87f7-45f4b7521cca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:23.161715 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-308ff97d-404c-43d9-87f7-45f4b7521cca tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.151247 May 19 05:37:23.162299 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3446/6803] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:23 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:24.178268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cad14cc2-63d1-4098-9646-9e8658f4ed25 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:24.178834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cad14cc2-63d1-4098-9646-9e8658f4ed25 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:24.186104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cad14cc2-63d1-4098-9646-9e8658f4ed25 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:24.186561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cad14cc2-63d1-4098-9646-9e8658f4ed25 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:24.187332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cad14cc2-63d1-4098-9646-9e8658f4ed25 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:24.187803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cad14cc2-63d1-4098-9646-9e8658f4ed25 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:24.315565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cad14cc2-63d1-4098-9646-9e8658f4ed25 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:24.323863 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cad14cc2-63d1-4098-9646-9e8658f4ed25 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.149576 May 19 05:37:24.324651 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3358/6804] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:24 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:25.341746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c038c0e8-5a81-40fb-b224-3bea1056839b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:25.342559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c038c0e8-5a81-40fb-b224-3bea1056839b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:25.349891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c038c0e8-5a81-40fb-b224-3bea1056839b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:25.350361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c038c0e8-5a81-40fb-b224-3bea1056839b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:25.351144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c038c0e8-5a81-40fb-b224-3bea1056839b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:25.351598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c038c0e8-5a81-40fb-b224-3bea1056839b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:25.488106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c038c0e8-5a81-40fb-b224-3bea1056839b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:25.496296 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c038c0e8-5a81-40fb-b224-3bea1056839b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.159156 May 19 05:37:25.497157 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3447/6805] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:25 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:26.513703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eb91cbcd-1af9-4b80-a6c0-537f664c4788 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:26.514311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eb91cbcd-1af9-4b80-a6c0-537f664c4788 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:26.521902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb91cbcd-1af9-4b80-a6c0-537f664c4788 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:26.522353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb91cbcd-1af9-4b80-a6c0-537f664c4788 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:26.523143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb91cbcd-1af9-4b80-a6c0-537f664c4788 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:26.523585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eb91cbcd-1af9-4b80-a6c0-537f664c4788 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:26.655370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eb91cbcd-1af9-4b80-a6c0-537f664c4788 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:26.663473 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eb91cbcd-1af9-4b80-a6c0-537f664c4788 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1729 microversion: 2.1 time: 0.153822 May 19 05:37:26.664041 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3359/6806] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:26 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:27.358302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-27194219-8961-4a21-8a1c-31eac8e7da5d req-5d2ad7ad-c0f6-4b79-912f-84831b69824c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:37:27.368488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-27194219-8961-4a21-8a1c-31eac8e7da5d req-5d2ad7ad-c0f6-4b79-912f-84831b69824c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:27.368906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-27194219-8961-4a21-8a1c-31eac8e7da5d req-5d2ad7ad-c0f6-4b79-912f-84831b69824c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:27.382343 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-27194219-8961-4a21-8a1c-31eac8e7da5d req-5d2ad7ad-c0f6-4b79-912f-84831b69824c service nova] Creating event network-vif-unplugged:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h1-766726-30 May 19 05:37:27.388668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-27194219-8961-4a21-8a1c-31eac8e7da5d req-5d2ad7ad-c0f6-4b79-912f-84831b69824c service nova] Instance 3c79496d-375b-4c48-9572-dbd916435bb5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:37:27.400442 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-27194219-8961-4a21-8a1c-31eac8e7da5d req-5d2ad7ad-c0f6-4b79-912f-84831b69824c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046394 May 19 05:37:27.401317 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3448/6807] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:37:27.681254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-767a3cd0-e52a-4d35-bd04-a88b52dd7105 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:27.681881 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-767a3cd0-e52a-4d35-bd04-a88b52dd7105 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:27.689652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-767a3cd0-e52a-4d35-bd04-a88b52dd7105 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:27.690213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-767a3cd0-e52a-4d35-bd04-a88b52dd7105 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:27.691123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-767a3cd0-e52a-4d35-bd04-a88b52dd7105 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:27.691571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-767a3cd0-e52a-4d35-bd04-a88b52dd7105 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:27.892992 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-767a3cd0-e52a-4d35-bd04-a88b52dd7105 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:27.901158 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-767a3cd0-e52a-4d35-bd04-a88b52dd7105 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1728 microversion: 2.1 time: 0.223848 May 19 05:37:27.901824 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3360/6808] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:27 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:28.641386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fe1c4f89-a5cb-437b-a68e-6ba0ab713f19 req-cd415cd3-aacb-4da2-8e8b-ed9ec48d5a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:37:28.649732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fe1c4f89-a5cb-437b-a68e-6ba0ab713f19 req-cd415cd3-aacb-4da2-8e8b-ed9ec48d5a7d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:28.650195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fe1c4f89-a5cb-437b-a68e-6ba0ab713f19 req-cd415cd3-aacb-4da2-8e8b-ed9ec48d5a7d service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:28.663471 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fe1c4f89-a5cb-437b-a68e-6ba0ab713f19 req-cd415cd3-aacb-4da2-8e8b-ed9ec48d5a7d service nova] Creating event network-changed:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h2-766726-30 May 19 05:37:28.669703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-fe1c4f89-a5cb-437b-a68e-6ba0ab713f19 req-cd415cd3-aacb-4da2-8e8b-ed9ec48d5a7d service nova] Instance 3c79496d-375b-4c48-9572-dbd916435bb5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:37:28.683868 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fe1c4f89-a5cb-437b-a68e-6ba0ab713f19 req-cd415cd3-aacb-4da2-8e8b-ed9ec48d5a7d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046986 May 19 05:37:28.684621 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3449/6809] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:37:28.919094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-33acf504-81b2-4ab8-b661-0efdbc499517 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:28.919731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-33acf504-81b2-4ab8-b661-0efdbc499517 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:28.926903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33acf504-81b2-4ab8-b661-0efdbc499517 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:28.927668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33acf504-81b2-4ab8-b661-0efdbc499517 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:28.928522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33acf504-81b2-4ab8-b661-0efdbc499517 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:28.929034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-33acf504-81b2-4ab8-b661-0efdbc499517 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:29.149410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-33acf504-81b2-4ab8-b661-0efdbc499517 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:29.157858 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-33acf504-81b2-4ab8-b661-0efdbc499517 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1728 microversion: 2.1 time: 0.243106 May 19 05:37:29.158530 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3361/6810] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:28 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:30.177314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-25a0ac8d-4a66-42a8-b5d6-f26db34dbbcc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:30.178033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-25a0ac8d-4a66-42a8-b5d6-f26db34dbbcc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:30.185016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25a0ac8d-4a66-42a8-b5d6-f26db34dbbcc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:30.185506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25a0ac8d-4a66-42a8-b5d6-f26db34dbbcc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:30.186291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25a0ac8d-4a66-42a8-b5d6-f26db34dbbcc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:30.186743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-25a0ac8d-4a66-42a8-b5d6-f26db34dbbcc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:30.323032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-25a0ac8d-4a66-42a8-b5d6-f26db34dbbcc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:30.335464 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-25a0ac8d-4a66-42a8-b5d6-f26db34dbbcc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.163346 May 19 05:37:30.336052 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3450/6811] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:30 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:31.353957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e9091ee-6b84-4e93-ad9b-eaff3449029c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:31.354602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e9091ee-6b84-4e93-ad9b-eaff3449029c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:31.362265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e9091ee-6b84-4e93-ad9b-eaff3449029c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:31.362830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e9091ee-6b84-4e93-ad9b-eaff3449029c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:31.363621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e9091ee-6b84-4e93-ad9b-eaff3449029c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:31.364065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e9091ee-6b84-4e93-ad9b-eaff3449029c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:31.508198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8e9091ee-6b84-4e93-ad9b-eaff3449029c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:31.517611 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e9091ee-6b84-4e93-ad9b-eaff3449029c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.167657 May 19 05:37:31.518208 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3362/6812] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:31 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:32.536197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2dce870a-f56f-4665-baf4-6f9f1f6fefdf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:32.536750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2dce870a-f56f-4665-baf4-6f9f1f6fefdf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:32.544613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dce870a-f56f-4665-baf4-6f9f1f6fefdf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:32.545103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dce870a-f56f-4665-baf4-6f9f1f6fefdf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:32.545903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dce870a-f56f-4665-baf4-6f9f1f6fefdf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:32.546482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2dce870a-f56f-4665-baf4-6f9f1f6fefdf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:32.674809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2dce870a-f56f-4665-baf4-6f9f1f6fefdf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:32.682980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2dce870a-f56f-4665-baf4-6f9f1f6fefdf tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.151163 May 19 05:37:32.683570 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3451/6813] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:32 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:33.745406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99f10dcd-999d-4cff-8d58-9b1fec8407fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:33.746022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99f10dcd-999d-4cff-8d58-9b1fec8407fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:33.752070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99f10dcd-999d-4cff-8d58-9b1fec8407fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:33.752520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99f10dcd-999d-4cff-8d58-9b1fec8407fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:33.753311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99f10dcd-999d-4cff-8d58-9b1fec8407fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:33.753753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99f10dcd-999d-4cff-8d58-9b1fec8407fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:34.192084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-99f10dcd-999d-4cff-8d58-9b1fec8407fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:34.194383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:37:34.202161 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99f10dcd-999d-4cff-8d58-9b1fec8407fc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.506333 May 19 05:37:34.202770 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3363/6814] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:33 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:35.220613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-38f3db92-8bb2-4b6a-92e1-2afc7c61fde6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:35.221297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-38f3db92-8bb2-4b6a-92e1-2afc7c61fde6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:35.224439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=29 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:37:35.229943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38f3db92-8bb2-4b6a-92e1-2afc7c61fde6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:35.230411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38f3db92-8bb2-4b6a-92e1-2afc7c61fde6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:35.231194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38f3db92-8bb2-4b6a-92e1-2afc7c61fde6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:35.231649 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38f3db92-8bb2-4b6a-92e1-2afc7c61fde6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:35.234541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=81 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:37:35.364162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-38f3db92-8bb2-4b6a-92e1-2afc7c61fde6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:35.373046 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-38f3db92-8bb2-4b6a-92e1-2afc7c61fde6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.157055 May 19 05:37:35.373840 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3452/6815] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:35 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:36.391034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-87878463-0f1f-4abe-9c4e-1f9ef60f781b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:36.391653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-87878463-0f1f-4abe-9c4e-1f9ef60f781b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:36.394268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=35 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:37:36.400520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87878463-0f1f-4abe-9c4e-1f9ef60f781b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:36.400970 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87878463-0f1f-4abe-9c4e-1f9ef60f781b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:36.402278 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87878463-0f1f-4abe-9c4e-1f9ef60f781b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:36.402725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-87878463-0f1f-4abe-9c4e-1f9ef60f781b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:36.532545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-87878463-0f1f-4abe-9c4e-1f9ef60f781b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:36.540908 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-87878463-0f1f-4abe-9c4e-1f9ef60f781b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.154573 May 19 05:37:36.541589 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3364/6816] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:36 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:37.560326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ea04574-7ef5-40af-8ad2-8456331f59ad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:37.560977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2ea04574-7ef5-40af-8ad2-8456331f59ad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:37.568471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ea04574-7ef5-40af-8ad2-8456331f59ad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:37.568929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ea04574-7ef5-40af-8ad2-8456331f59ad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:37.569750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ea04574-7ef5-40af-8ad2-8456331f59ad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:37.570205 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ea04574-7ef5-40af-8ad2-8456331f59ad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:37.724017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2ea04574-7ef5-40af-8ad2-8456331f59ad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:37.732811 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ea04574-7ef5-40af-8ad2-8456331f59ad tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.177935 May 19 05:37:37.733377 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3453/6817] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:37 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:38.750637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ccf6d35f-e939-440b-8c94-509a3ffc7dd6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:38.751287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ccf6d35f-e939-440b-8c94-509a3ffc7dd6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:38.758292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccf6d35f-e939-440b-8c94-509a3ffc7dd6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:38.758746 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccf6d35f-e939-440b-8c94-509a3ffc7dd6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:38.759517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccf6d35f-e939-440b-8c94-509a3ffc7dd6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:38.759954 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ccf6d35f-e939-440b-8c94-509a3ffc7dd6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:38.887780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ccf6d35f-e939-440b-8c94-509a3ffc7dd6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:38.895800 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ccf6d35f-e939-440b-8c94-509a3ffc7dd6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.149047 May 19 05:37:38.896382 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3365/6818] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:38 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:39.913676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-70253beb-484f-4c44-8b13-23a879c1bfa6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:39.914306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-70253beb-484f-4c44-8b13-23a879c1bfa6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:39.922021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70253beb-484f-4c44-8b13-23a879c1bfa6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:39.922489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70253beb-484f-4c44-8b13-23a879c1bfa6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:39.923264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70253beb-484f-4c44-8b13-23a879c1bfa6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:39.923747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70253beb-484f-4c44-8b13-23a879c1bfa6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:40.062395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-70253beb-484f-4c44-8b13-23a879c1bfa6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:40.070521 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-70253beb-484f-4c44-8b13-23a879c1bfa6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.160844 May 19 05:37:40.071105 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3454/6819] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:39 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:41.087796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4be434c4-361f-4b73-b654-2f71065ba3cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:41.088361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4be434c4-361f-4b73-b654-2f71065ba3cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:41.095907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be434c4-361f-4b73-b654-2f71065ba3cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:41.096354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be434c4-361f-4b73-b654-2f71065ba3cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:41.097392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be434c4-361f-4b73-b654-2f71065ba3cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:41.097831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4be434c4-361f-4b73-b654-2f71065ba3cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:41.236789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4be434c4-361f-4b73-b654-2f71065ba3cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:41.244809 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4be434c4-361f-4b73-b654-2f71065ba3cc tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.161124 May 19 05:37:41.245415 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3366/6820] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:41 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:42.261790 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-992112af-ee7a-4821-9b07-6b1fff035efb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:42.262457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-992112af-ee7a-4821-9b07-6b1fff035efb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:42.269480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-992112af-ee7a-4821-9b07-6b1fff035efb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:42.269969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-992112af-ee7a-4821-9b07-6b1fff035efb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:42.270746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-992112af-ee7a-4821-9b07-6b1fff035efb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:42.271200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-992112af-ee7a-4821-9b07-6b1fff035efb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:42.399599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-992112af-ee7a-4821-9b07-6b1fff035efb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:42.407671 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-992112af-ee7a-4821-9b07-6b1fff035efb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.150403 May 19 05:37:42.408259 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3455/6821] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:42 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:43.424690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-96392935-3d15-4088-a75a-5858f9cf4d9d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:43.425329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-96392935-3d15-4088-a75a-5858f9cf4d9d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:43.432106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96392935-3d15-4088-a75a-5858f9cf4d9d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:43.432552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96392935-3d15-4088-a75a-5858f9cf4d9d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:43.433335 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96392935-3d15-4088-a75a-5858f9cf4d9d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:43.433772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-96392935-3d15-4088-a75a-5858f9cf4d9d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:43.564998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-96392935-3d15-4088-a75a-5858f9cf4d9d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:43.572904 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-96392935-3d15-4088-a75a-5858f9cf4d9d tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.152075 May 19 05:37:43.574008 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3367/6822] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:43 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:44.590355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d9d57e81-172b-4e95-86e3-3d13cdcb3cab tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:44.590916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d9d57e81-172b-4e95-86e3-3d13cdcb3cab tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:44.598113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9d57e81-172b-4e95-86e3-3d13cdcb3cab tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:44.598600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9d57e81-172b-4e95-86e3-3d13cdcb3cab tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:44.599371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9d57e81-172b-4e95-86e3-3d13cdcb3cab tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:44.599819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d9d57e81-172b-4e95-86e3-3d13cdcb3cab tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:44.727356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d9d57e81-172b-4e95-86e3-3d13cdcb3cab tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:44.735601 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d9d57e81-172b-4e95-86e3-3d13cdcb3cab tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.149229 May 19 05:37:44.736178 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3456/6823] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:44 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:45.751744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6640276-e381-4d74-9eb3-b82856e8f5b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:45.752358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6640276-e381-4d74-9eb3-b82856e8f5b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:45.759214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6640276-e381-4d74-9eb3-b82856e8f5b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:45.759668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6640276-e381-4d74-9eb3-b82856e8f5b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:45.760439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6640276-e381-4d74-9eb3-b82856e8f5b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:45.760876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6640276-e381-4d74-9eb3-b82856e8f5b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:45.892589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d6640276-e381-4d74-9eb3-b82856e8f5b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:45.900657 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6640276-e381-4d74-9eb3-b82856e8f5b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1726 microversion: 2.1 time: 0.152805 May 19 05:37:45.901259 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3368/6824] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:45 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:46.918905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3d20ad6f-d15e-4505-9807-ae3ab44ced1b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:46.919537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3d20ad6f-d15e-4505-9807-ae3ab44ced1b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:46.926426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d20ad6f-d15e-4505-9807-ae3ab44ced1b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:46.926890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d20ad6f-d15e-4505-9807-ae3ab44ced1b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:46.927669 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d20ad6f-d15e-4505-9807-ae3ab44ced1b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:46.928126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3d20ad6f-d15e-4505-9807-ae3ab44ced1b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:47.076978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3d20ad6f-d15e-4505-9807-ae3ab44ced1b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:47.084955 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3d20ad6f-d15e-4505-9807-ae3ab44ced1b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1723 microversion: 2.1 time: 0.170614 May 19 05:37:47.085556 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3457/6825] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:46 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:47.102054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:37:47.102707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:47.109745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:47.110197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:47.110962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:47.111403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:47.149798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:47.150248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:47.151047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:47.151485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:47.174844 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:37:47.180005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Getting quotas for user 804f458dff054b0db747dd434a73fcc5 and project 61f9a405a6b347678b031acfa4e56717. Resources: {'ram', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:37:47.281971 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d28536df-d005-404f-bc0c-f5b2df84b1cb tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "POST /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/action" status: 202 len: 0 microversion: 2.1 time: 0.183607 May 19 05:37:47.282600 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3369/6826] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:37:47 2022] POST /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:37:47.290981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e24dc36e-a83b-4933-aba4-b4c60d770dd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:47.291697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e24dc36e-a83b-4933-aba4-b4c60d770dd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:47.297969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e24dc36e-a83b-4933-aba4-b4c60d770dd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:47.298437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e24dc36e-a83b-4933-aba4-b4c60d770dd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:47.299219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e24dc36e-a83b-4933-aba4-b4c60d770dd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:47.299674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e24dc36e-a83b-4933-aba4-b4c60d770dd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:47.494246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e24dc36e-a83b-4933-aba4-b4c60d770dd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:47.503513 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e24dc36e-a83b-4933-aba4-b4c60d770dd3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.216501 May 19 05:37:47.504412 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3458/6827] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:47 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:48.523463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dd7d092c-b9b3-45e1-8c82-33231ff4c6ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:48.524314 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dd7d092c-b9b3-45e1-8c82-33231ff4c6ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:48.531946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd7d092c-b9b3-45e1-8c82-33231ff4c6ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:48.532398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd7d092c-b9b3-45e1-8c82-33231ff4c6ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:48.533198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd7d092c-b9b3-45e1-8c82-33231ff4c6ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:48.533661 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dd7d092c-b9b3-45e1-8c82-33231ff4c6ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:48.547077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-facdb7eb-3bec-48d5-a0de-23da358399f0 req-0cce7367-f7d9-4b2f-9d3d-b3910015bb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "name": "network-vif-plugged", "status": "completed", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:37:48.557741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-facdb7eb-3bec-48d5-a0de-23da358399f0 req-0cce7367-f7d9-4b2f-9d3d-b3910015bb52 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:48.558303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-facdb7eb-3bec-48d5-a0de-23da358399f0 req-0cce7367-f7d9-4b2f-9d3d-b3910015bb52 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:48.571786 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-facdb7eb-3bec-48d5-a0de-23da358399f0 req-0cce7367-f7d9-4b2f-9d3d-b3910015bb52 service nova] Creating event network-vif-plugged:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h2-766726-30 May 19 05:37:48.580622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-facdb7eb-3bec-48d5-a0de-23da358399f0 req-0cce7367-f7d9-4b2f-9d3d-b3910015bb52 service nova] Instance 3c79496d-375b-4c48-9572-dbd916435bb5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:37:48.590208 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-facdb7eb-3bec-48d5-a0de-23da358399f0 req-0cce7367-f7d9-4b2f-9d3d-b3910015bb52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047340 May 19 05:37:48.591000 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3459/6828] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:37:48.679694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dd7d092c-b9b3-45e1-8c82-33231ff4c6ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:48.687774 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dd7d092c-b9b3-45e1-8c82-33231ff4c6ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.169543 May 19 05:37:48.688551 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3370/6829] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:48 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:49.705155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b78ef419-f67a-48a8-a8c2-dd84d0171306 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:49.705768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b78ef419-f67a-48a8-a8c2-dd84d0171306 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:49.714900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b78ef419-f67a-48a8-a8c2-dd84d0171306 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:49.715615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b78ef419-f67a-48a8-a8c2-dd84d0171306 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:49.716401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b78ef419-f67a-48a8-a8c2-dd84d0171306 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:49.716850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b78ef419-f67a-48a8-a8c2-dd84d0171306 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:49.852439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b78ef419-f67a-48a8-a8c2-dd84d0171306 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:49.861448 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b78ef419-f67a-48a8-a8c2-dd84d0171306 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.160572 May 19 05:37:49.862037 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3460/6830] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:49 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:50.879238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2f349205-0dab-4423-bdf4-5270c59a87ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:50.879885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2f349205-0dab-4423-bdf4-5270c59a87ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:50.886893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f349205-0dab-4423-bdf4-5270c59a87ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:50.887344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f349205-0dab-4423-bdf4-5270c59a87ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:50.888110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f349205-0dab-4423-bdf4-5270c59a87ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:50.888551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f349205-0dab-4423-bdf4-5270c59a87ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:51.038504 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2f349205-0dab-4423-bdf4-5270c59a87ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:51.047053 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2f349205-0dab-4423-bdf4-5270c59a87ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.171803 May 19 05:37:51.047632 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3371/6831] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:50 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:52.064851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9093a197-add0-408b-b115-a240386910ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:52.065422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9093a197-add0-408b-b115-a240386910ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:52.072175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9093a197-add0-408b-b115-a240386910ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:52.072645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9093a197-add0-408b-b115-a240386910ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:52.074068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9093a197-add0-408b-b115-a240386910ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:52.074528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9093a197-add0-408b-b115-a240386910ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:52.208645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9093a197-add0-408b-b115-a240386910ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:52.216821 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9093a197-add0-408b-b115-a240386910ee tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.156182 May 19 05:37:52.217584 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3461/6832] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:52 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:52.546148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-00cd20b9-799b-43fa-94e0-bef64cebceb8 req-f12f15b0-41fb-4732-a770-fec202afeedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:37:52.555365 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-00cd20b9-799b-43fa-94e0-bef64cebceb8 req-f12f15b0-41fb-4732-a770-fec202afeedd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:52.555852 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-00cd20b9-799b-43fa-94e0-bef64cebceb8 req-f12f15b0-41fb-4732-a770-fec202afeedd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:52.569679 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-00cd20b9-799b-43fa-94e0-bef64cebceb8 req-f12f15b0-41fb-4732-a770-fec202afeedd service nova] Creating event network-vif-unplugged:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h2-766726-30 May 19 05:37:52.575296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-00cd20b9-799b-43fa-94e0-bef64cebceb8 req-f12f15b0-41fb-4732-a770-fec202afeedd service nova] Instance 3c79496d-375b-4c48-9572-dbd916435bb5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:37:52.587131 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-00cd20b9-799b-43fa-94e0-bef64cebceb8 req-f12f15b0-41fb-4732-a770-fec202afeedd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045038 May 19 05:37:52.588068 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3372/6833] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:37:53.234457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-40354d5e-b50a-4a55-84d2-ff33e4e131ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:53.235113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-40354d5e-b50a-4a55-84d2-ff33e4e131ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:53.242450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40354d5e-b50a-4a55-84d2-ff33e4e131ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:53.242918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40354d5e-b50a-4a55-84d2-ff33e4e131ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:53.243716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40354d5e-b50a-4a55-84d2-ff33e4e131ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:53.244172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-40354d5e-b50a-4a55-84d2-ff33e4e131ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:53.382132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-40354d5e-b50a-4a55-84d2-ff33e4e131ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:53.391791 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-40354d5e-b50a-4a55-84d2-ff33e4e131ce tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.161292 May 19 05:37:53.392378 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3462/6834] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:53 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:54.410782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-253bd89b-0e16-4578-9008-0830519f0b5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:54.411675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-253bd89b-0e16-4578-9008-0830519f0b5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:54.419574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-253bd89b-0e16-4578-9008-0830519f0b5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:54.420024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-253bd89b-0e16-4578-9008-0830519f0b5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:54.420792 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-253bd89b-0e16-4578-9008-0830519f0b5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:54.421493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-253bd89b-0e16-4578-9008-0830519f0b5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:54.570158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-253bd89b-0e16-4578-9008-0830519f0b5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:54.579166 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-253bd89b-0e16-4578-9008-0830519f0b5e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.173436 May 19 05:37:54.579966 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3373/6835] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:54 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:54.810820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-848cbd18-0124-4805-ac3c-0c07fa049c2d req-71e11f8a-98d9-4500-8422-6f14d6654486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:37:54.820731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-848cbd18-0124-4805-ac3c-0c07fa049c2d req-71e11f8a-98d9-4500-8422-6f14d6654486 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:54.821227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-848cbd18-0124-4805-ac3c-0c07fa049c2d req-71e11f8a-98d9-4500-8422-6f14d6654486 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:54.836784 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-848cbd18-0124-4805-ac3c-0c07fa049c2d req-71e11f8a-98d9-4500-8422-6f14d6654486 service nova] Creating event network-changed:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h1-766726-30 May 19 05:37:54.853433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-848cbd18-0124-4805-ac3c-0c07fa049c2d req-71e11f8a-98d9-4500-8422-6f14d6654486 service nova] Instance 3c79496d-375b-4c48-9572-dbd916435bb5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:37:54.865413 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-848cbd18-0124-4805-ac3c-0c07fa049c2d req-71e11f8a-98d9-4500-8422-6f14d6654486 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059258 May 19 05:37:54.866406 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3463/6836] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:37:55.596227 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d1d35816-6495-42a6-bd64-a2c8fa53d4ae tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:55.597747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d1d35816-6495-42a6-bd64-a2c8fa53d4ae tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:55.605667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1d35816-6495-42a6-bd64-a2c8fa53d4ae tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:55.606331 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1d35816-6495-42a6-bd64-a2c8fa53d4ae tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:55.607305 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1d35816-6495-42a6-bd64-a2c8fa53d4ae tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:55.607917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d1d35816-6495-42a6-bd64-a2c8fa53d4ae tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:55.836928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d1d35816-6495-42a6-bd64-a2c8fa53d4ae tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:55.864821 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d1d35816-6495-42a6-bd64-a2c8fa53d4ae tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.272281 May 19 05:37:55.871750 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3374/6837] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:55 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:56.890091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8a1c3345-2b92-40de-85f4-8e9fb5e8c848 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:56.890708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8a1c3345-2b92-40de-85f4-8e9fb5e8c848 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:56.897015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a1c3345-2b92-40de-85f4-8e9fb5e8c848 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:56.897516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a1c3345-2b92-40de-85f4-8e9fb5e8c848 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:56.899585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a1c3345-2b92-40de-85f4-8e9fb5e8c848 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:56.900053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8a1c3345-2b92-40de-85f4-8e9fb5e8c848 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:57.042864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8a1c3345-2b92-40de-85f4-8e9fb5e8c848 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:57.051063 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8a1c3345-2b92-40de-85f4-8e9fb5e8c848 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.166543 May 19 05:37:57.051639 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3464/6838] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:56 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:58.068868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7ab3aeb0-3bea-49dc-985e-f37575d5b694 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:58.069523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7ab3aeb0-3bea-49dc-985e-f37575d5b694 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:58.072414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:37:58.078125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ab3aeb0-3bea-49dc-985e-f37575d5b694 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:58.078575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ab3aeb0-3bea-49dc-985e-f37575d5b694 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:58.079345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ab3aeb0-3bea-49dc-985e-f37575d5b694 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:58.079793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7ab3aeb0-3bea-49dc-985e-f37575d5b694 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:58.217039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7ab3aeb0-3bea-49dc-985e-f37575d5b694 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:58.225595 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7ab3aeb0-3bea-49dc-985e-f37575d5b694 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.160648 May 19 05:37:58.226174 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3375/6839] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:58 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:37:59.243592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b66638c9-b740-45f0-9d4a-97e86c002cfd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:37:59.244220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b66638c9-b740-45f0-9d4a-97e86c002cfd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:37:59.251882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b66638c9-b740-45f0-9d4a-97e86c002cfd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:59.252336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b66638c9-b740-45f0-9d4a-97e86c002cfd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:59.253127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b66638c9-b740-45f0-9d4a-97e86c002cfd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:37:59.253584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b66638c9-b740-45f0-9d4a-97e86c002cfd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:37:59.386876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b66638c9-b740-45f0-9d4a-97e86c002cfd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:37:59.395127 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b66638c9-b740-45f0-9d4a-97e86c002cfd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.155532 May 19 05:37:59.395705 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3465/6840] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:37:59 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:00.412003 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d2c36c9e-c89e-41db-916d-6a37401639d3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:00.412621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d2c36c9e-c89e-41db-916d-6a37401639d3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:00.419646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c36c9e-c89e-41db-916d-6a37401639d3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:00.420096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c36c9e-c89e-41db-916d-6a37401639d3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:00.420860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c36c9e-c89e-41db-916d-6a37401639d3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:00.421339 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d2c36c9e-c89e-41db-916d-6a37401639d3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:00.548111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d2c36c9e-c89e-41db-916d-6a37401639d3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:00.556150 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d2c36c9e-c89e-41db-916d-6a37401639d3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.148221 May 19 05:38:00.556719 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3376/6841] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:00 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:01.574245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c0c576c-d549-4334-98fb-088922642df4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:01.575314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9c0c576c-d549-4334-98fb-088922642df4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:01.583380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c0c576c-d549-4334-98fb-088922642df4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:01.583784 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c0c576c-d549-4334-98fb-088922642df4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:01.584646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c0c576c-d549-4334-98fb-088922642df4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:01.585159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c0c576c-d549-4334-98fb-088922642df4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:01.716946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c0c576c-d549-4334-98fb-088922642df4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:01.726060 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c0c576c-d549-4334-98fb-088922642df4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.156020 May 19 05:38:01.726685 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3466/6842] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:01 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:02.743859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d70694c6-64bc-428a-9c6b-4655628f6fb4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:02.744498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d70694c6-64bc-428a-9c6b-4655628f6fb4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:02.751442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d70694c6-64bc-428a-9c6b-4655628f6fb4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:02.751892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d70694c6-64bc-428a-9c6b-4655628f6fb4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:02.752667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d70694c6-64bc-428a-9c6b-4655628f6fb4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:02.753126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d70694c6-64bc-428a-9c6b-4655628f6fb4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:02.887840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d70694c6-64bc-428a-9c6b-4655628f6fb4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:02.890142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:02.897239 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d70694c6-64bc-428a-9c6b-4655628f6fb4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.157417 May 19 05:38:02.897823 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3377/6843] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:02 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:03.915390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-786d640f-cf3a-4457-9783-77105d5cb758 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:03.915904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-786d640f-cf3a-4457-9783-77105d5cb758 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:03.923855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-786d640f-cf3a-4457-9783-77105d5cb758 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:03.924326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-786d640f-cf3a-4457-9783-77105d5cb758 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:03.925169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-786d640f-cf3a-4457-9783-77105d5cb758 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:03.925640 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-786d640f-cf3a-4457-9783-77105d5cb758 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:04.058457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-786d640f-cf3a-4457-9783-77105d5cb758 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:04.066977 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-786d640f-cf3a-4457-9783-77105d5cb758 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.155693 May 19 05:38:04.067572 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3467/6844] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:03 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:38:05.084332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-10123b4e-7e66-40a1-9add-1a1a36ac0ec4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:05.084966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-10123b4e-7e66-40a1-9add-1a1a36ac0ec4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:05.093048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10123b4e-7e66-40a1-9add-1a1a36ac0ec4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:05.093508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10123b4e-7e66-40a1-9add-1a1a36ac0ec4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:05.094276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10123b4e-7e66-40a1-9add-1a1a36ac0ec4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:05.094709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-10123b4e-7e66-40a1-9add-1a1a36ac0ec4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:05.231513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-10123b4e-7e66-40a1-9add-1a1a36ac0ec4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:05.241641 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-10123b4e-7e66-40a1-9add-1a1a36ac0ec4 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.161313 May 19 05:38:05.242182 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3378/6845] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:05 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:06.258973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ce8928a7-5efe-4328-b9ea-dc14259e3110 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:06.259639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ce8928a7-5efe-4328-b9ea-dc14259e3110 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:06.262521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=32 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:06.267868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce8928a7-5efe-4328-b9ea-dc14259e3110 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:06.268339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce8928a7-5efe-4328-b9ea-dc14259e3110 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:06.270131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce8928a7-5efe-4328-b9ea-dc14259e3110 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:06.270616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ce8928a7-5efe-4328-b9ea-dc14259e3110 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:06.274978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=92 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:06.410583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ce8928a7-5efe-4328-b9ea-dc14259e3110 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:06.419391 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ce8928a7-5efe-4328-b9ea-dc14259e3110 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.164354 May 19 05:38:06.419972 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3468/6846] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:06 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:07.436376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3597eeb3-51ec-4c85-9753-081178435637 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:07.436991 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3597eeb3-51ec-4c85-9753-081178435637 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:07.439893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:07.445343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3597eeb3-51ec-4c85-9753-081178435637 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:07.445795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3597eeb3-51ec-4c85-9753-081178435637 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:07.446564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3597eeb3-51ec-4c85-9753-081178435637 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:07.447007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3597eeb3-51ec-4c85-9753-081178435637 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:07.573596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3597eeb3-51ec-4c85-9753-081178435637 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:07.582046 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3597eeb3-51ec-4c85-9753-081178435637 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.150217 May 19 05:38:07.582551 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3379/6847] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:07 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:08.600083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a79eab0-73c7-4b7d-b482-e3d1c47cb8b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:08.600751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a79eab0-73c7-4b7d-b482-e3d1c47cb8b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:08.608504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a79eab0-73c7-4b7d-b482-e3d1c47cb8b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:08.609123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a79eab0-73c7-4b7d-b482-e3d1c47cb8b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:08.609909 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a79eab0-73c7-4b7d-b482-e3d1c47cb8b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:08.610358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a79eab0-73c7-4b7d-b482-e3d1c47cb8b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:08.749706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a79eab0-73c7-4b7d-b482-e3d1c47cb8b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:08.758662 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a79eab0-73c7-4b7d-b482-e3d1c47cb8b7 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.162838 May 19 05:38:08.759249 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3469/6848] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:08 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:09.066482 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:38:09.066687 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:38:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:38:09.775745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1062c72a-b27b-4938-b015-2f023debd41c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:09.776561 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1062c72a-b27b-4938-b015-2f023debd41c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:09.783696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1062c72a-b27b-4938-b015-2f023debd41c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:09.784150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1062c72a-b27b-4938-b015-2f023debd41c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:09.784921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1062c72a-b27b-4938-b015-2f023debd41c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:09.785454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1062c72a-b27b-4938-b015-2f023debd41c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:09.807136 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:38:09.810855 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:38:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 (ip 10.222.0.58) !!! May 19 05:38:09.915200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1062c72a-b27b-4938-b015-2f023debd41c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:09.923758 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1062c72a-b27b-4938-b015-2f023debd41c tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.151982 May 19 05:38:09.924333 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3380/6849] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:09 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:10.940055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af171711-861e-442b-bc97-97c5c385c965 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:10.940686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af171711-861e-442b-bc97-97c5c385c965 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:10.947782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af171711-861e-442b-bc97-97c5c385c965 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:10.948254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af171711-861e-442b-bc97-97c5c385c965 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:10.949657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af171711-861e-442b-bc97-97c5c385c965 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:10.950111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af171711-861e-442b-bc97-97c5c385c965 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:11.025636 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:38:11.025869 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:38:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 (ip 10.222.0.58) !!! May 19 05:38:11.084746 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-af171711-861e-442b-bc97-97c5c385c965 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:11.092787 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af171711-861e-442b-bc97-97c5c385c965 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.156750 May 19 05:38:11.093402 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3470/6850] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:10 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:12.110173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-74dcee57-0c41-4610-8497-9d7fed7d6649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:12.110795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-74dcee57-0c41-4610-8497-9d7fed7d6649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:12.117601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74dcee57-0c41-4610-8497-9d7fed7d6649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:12.118049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74dcee57-0c41-4610-8497-9d7fed7d6649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:12.118811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74dcee57-0c41-4610-8497-9d7fed7d6649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:12.119247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-74dcee57-0c41-4610-8497-9d7fed7d6649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:12.247602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-74dcee57-0c41-4610-8497-9d7fed7d6649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:12.255879 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-74dcee57-0c41-4610-8497-9d7fed7d6649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1722 microversion: 2.1 time: 0.149594 May 19 05:38:12.256474 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3381/6851] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:12 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:13.279145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df7de8dd-41d4-446a-af87-33c9bcd6f3f5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:13.279705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df7de8dd-41d4-446a-af87-33c9bcd6f3f5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:13.286589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df7de8dd-41d4-446a-af87-33c9bcd6f3f5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.287053 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df7de8dd-41d4-446a-af87-33c9bcd6f3f5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:13.287827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df7de8dd-41d4-446a-af87-33c9bcd6f3f5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.288278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df7de8dd-41d4-446a-af87-33c9bcd6f3f5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:13.423021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-df7de8dd-41d4-446a-af87-33c9bcd6f3f5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:13.431237 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df7de8dd-41d4-446a-af87-33c9bcd6f3f5 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1715 microversion: 2.1 time: 0.156721 May 19 05:38:13.431808 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3471/6852] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:13 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:13.447883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-83c36f33-903a-4208-aa65-48c2c3372813 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:13.448524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-83c36f33-903a-4208-aa65-48c2c3372813 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:13.455360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83c36f33-903a-4208-aa65-48c2c3372813 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.455804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83c36f33-903a-4208-aa65-48c2c3372813 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:13.456570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83c36f33-903a-4208-aa65-48c2c3372813 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.457007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-83c36f33-903a-4208-aa65-48c2c3372813 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:13.584714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-83c36f33-903a-4208-aa65-48c2c3372813 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:13.592789 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-83c36f33-903a-4208-aa65-48c2c3372813 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1715 microversion: 2.1 time: 0.148795 May 19 05:38:13.593606 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3382/6853] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:13 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:13.609477 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e1bf4444-d345-4647-b6ee-3d045fb4b96f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:13.610119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e1bf4444-d345-4647-b6ee-3d045fb4b96f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:13.616432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1bf4444-d345-4647-b6ee-3d045fb4b96f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.616929 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1bf4444-d345-4647-b6ee-3d045fb4b96f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:13.617879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1bf4444-d345-4647-b6ee-3d045fb4b96f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.618338 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e1bf4444-d345-4647-b6ee-3d045fb4b96f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:13.749543 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e1bf4444-d345-4647-b6ee-3d045fb4b96f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:13.757564 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e1bf4444-d345-4647-b6ee-3d045fb4b96f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1715 microversion: 2.1 time: 0.152059 May 19 05:38:13.758140 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3472/6854] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:13 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:13.775220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5a4f95a4-3d70-43f5-976c-bdb4a43cdf22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:13.775793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5a4f95a4-3d70-43f5-976c-bdb4a43cdf22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:13.782312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a4f95a4-3d70-43f5-976c-bdb4a43cdf22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.782759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a4f95a4-3d70-43f5-976c-bdb4a43cdf22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:13.783602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a4f95a4-3d70-43f5-976c-bdb4a43cdf22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.783961 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5a4f95a4-3d70-43f5-976c-bdb4a43cdf22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:13.810868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5a4f95a4-3d70-43f5-976c-bdb4a43cdf22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:38:13.885624 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5a4f95a4-3d70-43f5-976c-bdb4a43cdf22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 204 len: 0 microversion: 2.1 time: 0.113842 May 19 05:38:13.886610 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3383/6855] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:38:13 2022] DELETE /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:38:13.896126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f5a03a0b-c3d9-4e62-9bc5-aeb61d0c5c7b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:13.896792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f5a03a0b-c3d9-4e62-9bc5-aeb61d0c5c7b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:13.903294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5a03a0b-c3d9-4e62-9bc5-aeb61d0c5c7b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.903951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5a03a0b-c3d9-4e62-9bc5-aeb61d0c5c7b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:13.904795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5a03a0b-c3d9-4e62-9bc5-aeb61d0c5c7b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:13.905289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5a03a0b-c3d9-4e62-9bc5-aeb61d0c5c7b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:14.044380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f5a03a0b-c3d9-4e62-9bc5-aeb61d0c5c7b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:14.052417 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f5a03a0b-c3d9-4e62-9bc5-aeb61d0c5c7b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1721 microversion: 2.1 time: 0.161166 May 19 05:38:14.053008 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3473/6856] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:13 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:15.070983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9b4d859e-e9c7-4b45-8be2-6893dc905d4a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:15.071731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9b4d859e-e9c7-4b45-8be2-6893dc905d4a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:15.079142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b4d859e-e9c7-4b45-8be2-6893dc905d4a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:15.079601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b4d859e-e9c7-4b45-8be2-6893dc905d4a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:15.080375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b4d859e-e9c7-4b45-8be2-6893dc905d4a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:15.080822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9b4d859e-e9c7-4b45-8be2-6893dc905d4a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:15.208849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9b4d859e-e9c7-4b45-8be2-6893dc905d4a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:15.216960 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9b4d859e-e9c7-4b45-8be2-6893dc905d4a tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1721 microversion: 2.1 time: 0.150340 May 19 05:38:15.217587 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3384/6857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:15 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:15.616994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a7d76ad0-492c-414d-a826-17a6ded3cad5 req-35461d7c-1148-4532-ae0f-f8fe59fe74f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "name": "network-vif-plugged", "status": "completed", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:38:15.627300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a7d76ad0-492c-414d-a826-17a6ded3cad5 req-35461d7c-1148-4532-ae0f-f8fe59fe74f2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:15.627603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a7d76ad0-492c-414d-a826-17a6ded3cad5 req-35461d7c-1148-4532-ae0f-f8fe59fe74f2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:15.640527 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a7d76ad0-492c-414d-a826-17a6ded3cad5 req-35461d7c-1148-4532-ae0f-f8fe59fe74f2 service nova] Creating event network-vif-plugged:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h1-766726-30 May 19 05:38:15.646384 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a7d76ad0-492c-414d-a826-17a6ded3cad5 req-35461d7c-1148-4532-ae0f-f8fe59fe74f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033328 May 19 05:38:15.647056 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3474/6858] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:38:16.236058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-54e3a3b1-42ae-4d88-8941-d8c6a97285d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:16.236762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-54e3a3b1-42ae-4d88-8941-d8c6a97285d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:16.244469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54e3a3b1-42ae-4d88-8941-d8c6a97285d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:16.245060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54e3a3b1-42ae-4d88-8941-d8c6a97285d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:16.246016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54e3a3b1-42ae-4d88-8941-d8c6a97285d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:16.246536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-54e3a3b1-42ae-4d88-8941-d8c6a97285d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:16.315761 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-54e3a3b1-42ae-4d88-8941-d8c6a97285d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:16.325717 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-54e3a3b1-42ae-4d88-8941-d8c6a97285d9 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1654 microversion: 2.1 time: 0.093606 May 19 05:38:16.342199 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3385/6859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:16 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1654 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:16.712810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fc5d59d7-0a77-4757-93d6-4c121467925a req-d2a6c741-e686-4bd5-9268-12f1da3f0ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c79496d-375b-4c48-9572-dbd916435bb5", "name": "network-vif-deleted", "tag": "4b93574c-370b-4a9b-8d1d-cd39a55ba430"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:38:16.722578 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fc5d59d7-0a77-4757-93d6-4c121467925a req-d2a6c741-e686-4bd5-9268-12f1da3f0ad5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:16.723037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fc5d59d7-0a77-4757-93d6-4c121467925a req-d2a6c741-e686-4bd5-9268-12f1da3f0ad5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:16.734908 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fc5d59d7-0a77-4757-93d6-4c121467925a req-d2a6c741-e686-4bd5-9268-12f1da3f0ad5 service nova] Creating event network-vif-deleted:4b93574c-370b-4a9b-8d1d-cd39a55ba430 for instance 3c79496d-375b-4c48-9572-dbd916435bb5 on n-h1-766726-30 May 19 05:38:16.740041 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fc5d59d7-0a77-4757-93d6-4c121467925a req-d2a6c741-e686-4bd5-9268-12f1da3f0ad5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032437 May 19 05:38:16.740647 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3475/6860] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:38:17.345108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31dc4845-fa31-45b1-b127-6e341301be18 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:17.348211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31dc4845-fa31-45b1-b127-6e341301be18 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:17.355891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31dc4845-fa31-45b1-b127-6e341301be18 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:17.356580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31dc4845-fa31-45b1-b127-6e341301be18 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:17.357554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31dc4845-fa31-45b1-b127-6e341301be18 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:17.358158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31dc4845-fa31-45b1-b127-6e341301be18 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:17.427299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31dc4845-fa31-45b1-b127-6e341301be18 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:17.437042 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31dc4845-fa31-45b1-b127-6e341301be18 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1370 microversion: 2.1 time: 0.097587 May 19 05:38:17.448956 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3386/6861] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:17 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:18.456379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-225e70a2-4ee4-48ae-86ee-974e88b7ea4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:18.457244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-225e70a2-4ee4-48ae-86ee-974e88b7ea4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:18.463718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-225e70a2-4ee4-48ae-86ee-974e88b7ea4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:18.464283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-225e70a2-4ee4-48ae-86ee-974e88b7ea4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:18.465187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-225e70a2-4ee4-48ae-86ee-974e88b7ea4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:18.465766 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-225e70a2-4ee4-48ae-86ee-974e88b7ea4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:18.533962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-225e70a2-4ee4-48ae-86ee-974e88b7ea4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:18.543429 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-225e70a2-4ee4-48ae-86ee-974e88b7ea4f tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1370 microversion: 2.1 time: 0.092770 May 19 05:38:18.544170 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3476/6862] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:18 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:19.560105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5bb7c842-1ed2-4f4c-a353-909cbdd5a3e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:19.560828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5bb7c842-1ed2-4f4c-a353-909cbdd5a3e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:19.568074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bb7c842-1ed2-4f4c-a353-909cbdd5a3e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:19.568535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bb7c842-1ed2-4f4c-a353-909cbdd5a3e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:19.569343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bb7c842-1ed2-4f4c-a353-909cbdd5a3e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:19.569793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5bb7c842-1ed2-4f4c-a353-909cbdd5a3e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:19.634100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5bb7c842-1ed2-4f4c-a353-909cbdd5a3e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:19.642775 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5bb7c842-1ed2-4f4c-a353-909cbdd5a3e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1370 microversion: 2.1 time: 0.086817 May 19 05:38:19.643354 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3387/6863] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:19 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:20.660102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d232a14f-e50f-430f-8164-1c26912f61e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:20.660680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d232a14f-e50f-430f-8164-1c26912f61e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:20.668616 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d232a14f-e50f-430f-8164-1c26912f61e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:20.669113 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d232a14f-e50f-430f-8164-1c26912f61e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:20.669915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d232a14f-e50f-430f-8164-1c26912f61e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:20.670358 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d232a14f-e50f-430f-8164-1c26912f61e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:20.741366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d232a14f-e50f-430f-8164-1c26912f61e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:20.749502 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d232a14f-e50f-430f-8164-1c26912f61e8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1370 microversion: 2.1 time: 0.093532 May 19 05:38:20.750078 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3477/6864] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:20 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:21.767807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a294fdff-cf4d-4c08-ac67-d74b56e2b879 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:21.768423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a294fdff-cf4d-4c08-ac67-d74b56e2b879 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:21.776081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a294fdff-cf4d-4c08-ac67-d74b56e2b879 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:21.776712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a294fdff-cf4d-4c08-ac67-d74b56e2b879 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:21.777550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a294fdff-cf4d-4c08-ac67-d74b56e2b879 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:21.778031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a294fdff-cf4d-4c08-ac67-d74b56e2b879 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:21.843582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a294fdff-cf4d-4c08-ac67-d74b56e2b879 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:21.851944 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a294fdff-cf4d-4c08-ac67-d74b56e2b879 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1370 microversion: 2.1 time: 0.088116 May 19 05:38:21.852518 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3388/6865] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:21 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:22.871474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1f590055-e3b7-4f06-b8e3-7133df7ade22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:22.872119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1f590055-e3b7-4f06-b8e3-7133df7ade22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:22.878605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f590055-e3b7-4f06-b8e3-7133df7ade22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:22.879079 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f590055-e3b7-4f06-b8e3-7133df7ade22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:22.879865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f590055-e3b7-4f06-b8e3-7133df7ade22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:22.880321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1f590055-e3b7-4f06-b8e3-7133df7ade22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:22.942023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1f590055-e3b7-4f06-b8e3-7133df7ade22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:22.950980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1f590055-e3b7-4f06-b8e3-7133df7ade22 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1370 microversion: 2.1 time: 0.084177 May 19 05:38:22.960285 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3478/6866] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:22 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:23.968834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8244492c-92a8-40be-9a4e-0ba26975cb8e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:23.970045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8244492c-92a8-40be-9a4e-0ba26975cb8e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:23.977807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8244492c-92a8-40be-9a4e-0ba26975cb8e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:23.978261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8244492c-92a8-40be-9a4e-0ba26975cb8e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:23.979042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8244492c-92a8-40be-9a4e-0ba26975cb8e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:23.979612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8244492c-92a8-40be-9a4e-0ba26975cb8e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:24.041495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8244492c-92a8-40be-9a4e-0ba26975cb8e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:24.058672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8244492c-92a8-40be-9a4e-0ba26975cb8e tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1370 microversion: 2.1 time: 0.093751 May 19 05:38:24.059537 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3389/6867] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:23 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:25.076765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a9d4985-00bf-4252-9159-b4afb5653f47 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:25.077675 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a9d4985-00bf-4252-9159-b4afb5653f47 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:25.091371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a9d4985-00bf-4252-9159-b4afb5653f47 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:25.091932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a9d4985-00bf-4252-9159-b4afb5653f47 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:25.092735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a9d4985-00bf-4252-9159-b4afb5653f47 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:25.093214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a9d4985-00bf-4252-9159-b4afb5653f47 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:25.155538 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0a9d4985-00bf-4252-9159-b4afb5653f47 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:25.163748 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a9d4985-00bf-4252-9159-b4afb5653f47 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1370 microversion: 2.1 time: 0.091659 May 19 05:38:25.164331 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3479/6868] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:25 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:26.180433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:26.181043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:26.188135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:26.188589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:26.189397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:26.189842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:26.224531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:26.224957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:26.225449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lazy-loading 'fault' on Instance uuid 3c79496d-375b-4c48-9572-dbd916435bb5 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:38:26.276925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804f458dff054b0db747dd434a73fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9a405a6b347678b031acfa4e56717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:26.283906 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0525bd5e-2e1a-495b-9a28-0e1525914eba tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 200 len: 1329 microversion: 2.1 time: 0.107560 May 19 05:38:26.284488 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3390/6869] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:26 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 1329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:27.301267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:27.301951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:27.309388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:27.309855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:27.310635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:27.311088 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:27.324933 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 HTTP/1.1 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '3c79496d-375b-4c48-9572-dbd916435bb5'} May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:27.326631 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-919f67fa-1e73-4d63-9986-a76115036313 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 404 len: 111 microversion: 2.1 time: 0.030899 May 19 05:38:27.332329 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3480/6870] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:27 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:38:27.384055 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:27.384999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:27.392548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:27.393001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:27.393802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:27.394246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:27.408529 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/os-volume_attachments HTTP/1.1 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'server_id': '3c79496d-375b-4c48-9572-dbd916435bb5'} May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:27.408742 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-99a793e6-697d-4dea-a129-e8250f5c9649 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030190 May 19 05:38:27.414366 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3391/6871] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:38:27 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:38:32.808213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:32.808739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:32.815820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.816308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.817175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.817626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.831025 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 HTTP/1.1 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '3c79496d-375b-4c48-9572-dbd916435bb5'} May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:32.832607 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-03c997b9-f4c8-4b61-ba7a-186380289e35 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 404 len: 111 microversion: 2.1 time: 0.030656 May 19 05:38:32.836984 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3481/6872] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:38:32 2022] DELETE /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:38:32.842827 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:32.843440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 3c79496d-375b-4c48-9572-dbd916435bb5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:32.851187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.851637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.852394 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.852829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.866958 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 HTTP/1.1 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '3c79496d-375b-4c48-9572-dbd916435bb5'} May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.868442 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 3c79496d-375b-4c48-9572-dbd916435bb5 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d114ca32-5d41-424c-b73b-0dc10708509b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5" status: 404 len: 111 microversion: 2.1 time: 0.030990 May 19 05:38:32.875809 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3392/6873] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:32 2022] GET /compute/v2.1/servers/3c79496d-375b-4c48-9572-dbd916435bb5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:38:32.880183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:32.881399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:32.887413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.887870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.888921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.889408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.906738 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 HTTP/1.1 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2823047e-70d6-431e-a010-a27e65f61ec5'} May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:32.908433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-76f9d324-9415-43c8-891c-4256c8db07d6 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 404 len: 111 microversion: 2.1 time: 0.036123 May 19 05:38:32.913643 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3482/6874] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:38:32 2022] DELETE /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:38:32.920633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:32.921510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 2823047e-70d6-431e-a010-a27e65f61ec5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:32.927669 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.928192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.929021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.929546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.943946 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 HTTP/1.1 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2823047e-70d6-431e-a010-a27e65f61ec5'} May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.945595 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 2823047e-70d6-431e-a010-a27e65f61ec5 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6cbb28e2-2424-46ea-8b20-0a2f2d1e05c8 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5" status: 404 len: 111 microversion: 2.1 time: 0.031316 May 19 05:38:32.950155 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3393/6875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:32 2022] GET /compute/v2.1/servers/2823047e-70d6-431e-a010-a27e65f61ec5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:38:32.956581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:32.957114 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:32.963379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.963844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.964617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.965064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.978693 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f HTTP/1.1 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '04f8e102-bafb-40c8-9e47-ddc9f280781f'} May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:32.980832 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1095e8f8-98e3-414b-96da-9bacc485b5e3 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "DELETE /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 404 len: 111 microversion: 2.1 time: 0.030050 May 19 05:38:32.986127 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3483/6876] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:38:32 2022] DELETE /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 05:38:32.991111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:32.991730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 04f8e102-bafb-40c8-9e47-ddc9f280781f] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:32.998399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:32.998848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:32.999605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:33.000047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:33.013268 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f HTTP/1.1 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '04f8e102-bafb-40c8-9e47-ddc9f280781f'} May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:33.014778 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 04f8e102-bafb-40c8-9e47-ddc9f280781f could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c169c120-4fcf-41dc-b6e0-981ab09a2c3b tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f" status: 404 len: 111 microversion: 2.1 time: 0.029141 May 19 05:38:33.020672 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3394/6877] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:32 2022] GET /compute/v2.1/servers/04f8e102-bafb-40c8-9e47-ddc9f280781f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:38:33.025582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:33.026136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:33.032415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:33.032885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:33.033702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:33.034162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:33.048179 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 HTTP/1.1 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '7bc9c9e7-c052-43da-9736-de63bc9dcd98'} May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:33.049778 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bda14087-13fe-4f0c-8655-195d1efd1d40 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 404 len: 111 microversion: 2.1 time: 0.029606 May 19 05:38:33.054980 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3484/6878] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:38:33 2022] DELETE /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:38:33.061284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:33.061901 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] [instance: 7bc9c9e7-c052-43da-9736-de63bc9dcd98] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:33.067977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:33.068423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:33.069207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:33.069645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:33.072229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:33.084636 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] HTTP exception thrown: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Request method failure captured: May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 HTTP/1.1 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdZxV0itHgwWf5QCFzTGqhjEM0YRWAIo3zoSV8BAMfa2JQp2s7YVQ5bVFaVbl2QAlgLgrK4ZP1UoORiTJHgbO-FjIokOgBlVJ8eNhQPlEH4THbLqjheKrNfnNSh3kKw_q5CiqAKmt4mEzfM1MShGBQSpU9hw914REfxdJMUX2ZBhynk May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/61f9a405a6b347678b031acfa4e56717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_61f9a405a6b347678b031acfa4e56717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 61f9a405a6b347678b031acfa4e56717 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServerActionsTestJSON-1257789180 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 804f458dff054b0db747dd434a73fcc5 May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServerActionsTestJSON-1257789180-project May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '7bc9c9e7-c052-43da-9736-de63bc9dcd98'} May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:38:33.086324 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.091633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:38:33.091633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:38:33.091633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:38:33.091633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:38:33.091633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:38:33.091633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. May 19 05:38:33.091633 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:38:33.091633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Returning 404 to user: Instance 7bc9c9e7-c052-43da-9736-de63bc9dcd98 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:38:33.091633 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-810af5e1-9bb9-4df0-8ac2-0ff401765056 tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98" status: 404 len: 111 microversion: 2.1 time: 0.031136 May 19 05:38:33.092417 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3395/6879] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:33 2022] GET /compute/v2.1/servers/7bc9c9e7-c052-43da-9736-de63bc9dcd98 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:38:33.098354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a2187bf-5177-4432-9c4d-64034668b1bd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] Calling method '.version_select at 0x7fd31b671670>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:33.121859 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1a2187bf-5177-4432-9c4d-64034668b1bd tempest-ServerActionsTestJSON-1257789180 tempest-ServerActionsTestJSON-1257789180-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240287522" status: 202 len: 0 microversion: 2.1 time: 0.027766 May 19 05:38:33.122569 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3485/6880] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 19 05:38:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240287522 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:38:38.689581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-816597073", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "7dd3f14d-2f33-4df0-a2c5-e22639af20d0"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:38:38.696238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:38.743009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] validate_networks() for [('7dd3f14d-2f33-4df0-a2c5-e22639af20d0', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:38:39.167620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:38:39.168086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:38:39.168611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:38:39.169284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:38:39.169716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:38:39.178871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:39.179332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:39.180185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:39.180632 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:39.199347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Getting quotas for project bcb0f3823fd34fe08b498f0fe550fe89. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:38:39.204750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Getting quotas for user d972c1be122e47279db1b24f641a6047 and project bcb0f3823fd34fe08b498f0fe550fe89. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:38:39.217217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:38:39.219565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:38:39.265133 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d7809f3-d5fd-4ed0-9fb2-7397beaee393 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690438 May 19 05:38:39.265787 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3396/6881] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:38:39.275776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-554075ce-d8e7-43e6-9f11-425bdde6437f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:39.276409 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-554075ce-d8e7-43e6-9f11-425bdde6437f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:39.279283 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:39.337068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-554075ce-d8e7-43e6-9f11-425bdde6437f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:39.344431 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-554075ce-d8e7-43e6-9f11-425bdde6437f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1216 microversion: 2.1 time: 0.072680 May 19 05:38:39.345024 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3486/6882] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:39 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:40.363323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ab96b407-2c37-444f-b986-45a6f13beb3f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:40.364008 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ab96b407-2c37-444f-b986-45a6f13beb3f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:40.373415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab96b407-2c37-444f-b986-45a6f13beb3f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:40.373876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab96b407-2c37-444f-b986-45a6f13beb3f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:40.374673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab96b407-2c37-444f-b986-45a6f13beb3f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:40.375264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ab96b407-2c37-444f-b986-45a6f13beb3f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:40.467051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ab96b407-2c37-444f-b986-45a6f13beb3f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:40.475109 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ab96b407-2c37-444f-b986-45a6f13beb3f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1286 microversion: 2.1 time: 0.116929 May 19 05:38:40.475704 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3397/6883] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:40 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:41.496119 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-696f3e38-34c8-4717-8346-e4bb721d7f54 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:41.496749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-696f3e38-34c8-4717-8346-e4bb721d7f54 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:41.503577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-696f3e38-34c8-4717-8346-e4bb721d7f54 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:41.504040 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-696f3e38-34c8-4717-8346-e4bb721d7f54 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:41.504818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-696f3e38-34c8-4717-8346-e4bb721d7f54 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:41.505326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-696f3e38-34c8-4717-8346-e4bb721d7f54 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:41.509326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=74 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:41.604588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a98a8267-a55b-467c-9c44-0c78dd9757b2 req-4dd4e9f2-362e-4e84-8299-894870f075bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbecc2ce-e2df-49b0-95b4-01b1392617b6", "tag": "3a9b01b9-7991-47d0-8a3b-26c74dbace50"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:38:41.614523 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a98a8267-a55b-467c-9c44-0c78dd9757b2 req-4dd4e9f2-362e-4e84-8299-894870f075bb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:41.614967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a98a8267-a55b-467c-9c44-0c78dd9757b2 req-4dd4e9f2-362e-4e84-8299-894870f075bb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:41.627244 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a98a8267-a55b-467c-9c44-0c78dd9757b2 req-4dd4e9f2-362e-4e84-8299-894870f075bb service nova] Creating event network-changed:3a9b01b9-7991-47d0-8a3b-26c74dbace50 for instance fbecc2ce-e2df-49b0-95b4-01b1392617b6 on n-h2-766726-30 May 19 05:38:41.632289 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a98a8267-a55b-467c-9c44-0c78dd9757b2 req-4dd4e9f2-362e-4e84-8299-894870f075bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034145 May 19 05:38:41.633044 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3398/6884] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:38:41.743051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-696f3e38-34c8-4717-8346-e4bb721d7f54 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:41.751297 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-696f3e38-34c8-4717-8346-e4bb721d7f54 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1316 microversion: 2.1 time: 0.259858 May 19 05:38:41.751881 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3487/6885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:41 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:42.770356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5635ce92-9f1e-4d24-9c93-00b00110bb7e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:42.771066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5635ce92-9f1e-4d24-9c93-00b00110bb7e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:42.777515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5635ce92-9f1e-4d24-9c93-00b00110bb7e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:42.778114 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5635ce92-9f1e-4d24-9c93-00b00110bb7e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:42.778967 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5635ce92-9f1e-4d24-9c93-00b00110bb7e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:42.779588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5635ce92-9f1e-4d24-9c93-00b00110bb7e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:42.991496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5635ce92-9f1e-4d24-9c93-00b00110bb7e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:42.999222 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5635ce92-9f1e-4d24-9c93-00b00110bb7e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1316 microversion: 2.1 time: 0.233975 May 19 05:38:42.999786 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3399/6886] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:42 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:44.016460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-71a7fa42-2cb9-4b88-9ccb-d8f67f342327 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:44.016997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-71a7fa42-2cb9-4b88-9ccb-d8f67f342327 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:44.024139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71a7fa42-2cb9-4b88-9ccb-d8f67f342327 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:44.024604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71a7fa42-2cb9-4b88-9ccb-d8f67f342327 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:44.025393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71a7fa42-2cb9-4b88-9ccb-d8f67f342327 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:44.026480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-71a7fa42-2cb9-4b88-9ccb-d8f67f342327 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:44.157505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-71a7fa42-2cb9-4b88-9ccb-d8f67f342327 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:44.165041 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-71a7fa42-2cb9-4b88-9ccb-d8f67f342327 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1316 microversion: 2.1 time: 0.152653 May 19 05:38:44.165651 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3488/6887] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:44 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:45.180996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f21740b0-4687-4c6e-905f-65ee37a823af tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:45.181584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f21740b0-4687-4c6e-905f-65ee37a823af tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:45.188538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f21740b0-4687-4c6e-905f-65ee37a823af tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:45.188993 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f21740b0-4687-4c6e-905f-65ee37a823af tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:45.189802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f21740b0-4687-4c6e-905f-65ee37a823af tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:45.190241 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f21740b0-4687-4c6e-905f-65ee37a823af tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:45.319277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f21740b0-4687-4c6e-905f-65ee37a823af tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:45.326948 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f21740b0-4687-4c6e-905f-65ee37a823af tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1316 microversion: 2.1 time: 0.149941 May 19 05:38:45.327707 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3400/6888] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:45 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:46.344238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1e16a678-f789-4d4c-9bd9-4efeaecd94b6 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:46.344876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1e16a678-f789-4d4c-9bd9-4efeaecd94b6 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:46.352080 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e16a678-f789-4d4c-9bd9-4efeaecd94b6 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:46.352544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e16a678-f789-4d4c-9bd9-4efeaecd94b6 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:46.353356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e16a678-f789-4d4c-9bd9-4efeaecd94b6 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:46.353816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e16a678-f789-4d4c-9bd9-4efeaecd94b6 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:46.479181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1e16a678-f789-4d4c-9bd9-4efeaecd94b6 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:46.486718 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1e16a678-f789-4d4c-9bd9-4efeaecd94b6 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1316 microversion: 2.1 time: 0.146432 May 19 05:38:46.487301 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3489/6889] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:46 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1316 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:46.842273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-32012454-3e4c-4630-b6cd-d7af0fd08dc7 req-f7e9d8a6-9185-4729-86c0-b3a4ab4e32a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbecc2ce-e2df-49b0-95b4-01b1392617b6", "name": "network-vif-plugged", "status": "completed", "tag": "3a9b01b9-7991-47d0-8a3b-26c74dbace50"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:38:46.851716 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-32012454-3e4c-4630-b6cd-d7af0fd08dc7 req-f7e9d8a6-9185-4729-86c0-b3a4ab4e32a3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:46.852172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-32012454-3e4c-4630-b6cd-d7af0fd08dc7 req-f7e9d8a6-9185-4729-86c0-b3a4ab4e32a3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:46.864184 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-32012454-3e4c-4630-b6cd-d7af0fd08dc7 req-f7e9d8a6-9185-4729-86c0-b3a4ab4e32a3 service nova] Creating event network-vif-plugged:3a9b01b9-7991-47d0-8a3b-26c74dbace50 for instance fbecc2ce-e2df-49b0-95b4-01b1392617b6 on n-h2-766726-30 May 19 05:38:46.869129 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-32012454-3e4c-4630-b6cd-d7af0fd08dc7 req-f7e9d8a6-9185-4729-86c0-b3a4ab4e32a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031246 May 19 05:38:46.869736 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3401/6890] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:38:47.503773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-417fa5aa-63e7-4c92-a21f-502a65283ccb tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:47.504425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-417fa5aa-63e7-4c92-a21f-502a65283ccb tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:47.512064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-417fa5aa-63e7-4c92-a21f-502a65283ccb tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:47.512531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-417fa5aa-63e7-4c92-a21f-502a65283ccb tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:47.513352 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-417fa5aa-63e7-4c92-a21f-502a65283ccb tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:47.513806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-417fa5aa-63e7-4c92-a21f-502a65283ccb tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:47.640524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-417fa5aa-63e7-4c92-a21f-502a65283ccb tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:47.648032 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-417fa5aa-63e7-4c92-a21f-502a65283ccb tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1316 microversion: 2.1 time: 0.148255 May 19 05:38:47.648613 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3490/6891] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:47 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:48.666783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bdcae12a-2716-435a-aa21-52c83758d29d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:48.667485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bdcae12a-2716-435a-aa21-52c83758d29d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:48.673833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdcae12a-2716-435a-aa21-52c83758d29d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:48.674286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdcae12a-2716-435a-aa21-52c83758d29d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:48.675052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdcae12a-2716-435a-aa21-52c83758d29d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:48.675495 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bdcae12a-2716-435a-aa21-52c83758d29d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:48.805620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bdcae12a-2716-435a-aa21-52c83758d29d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:48.813179 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bdcae12a-2716-435a-aa21-52c83758d29d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1506 microversion: 2.1 time: 0.151541 May 19 05:38:48.813762 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3402/6892] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:48 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:48.866689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-122338930", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "7dd3f14d-2f33-4df0-a2c5-e22639af20d0"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:38:48.920806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] validate_networks() for [('7dd3f14d-2f33-4df0-a2c5-e22639af20d0', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:38:49.274223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:38:49.274665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:38:49.275161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:38:49.275626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:38:49.276045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:38:49.285213 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:49.285677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:49.286487 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:49.286933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:49.303892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Getting quotas for project bcb0f3823fd34fe08b498f0fe550fe89. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:38:49.310681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Getting quotas for user d972c1be122e47279db1b24f641a6047 and project bcb0f3823fd34fe08b498f0fe550fe89. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:38:49.322977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:38:49.325309 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:38:49.371625 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2caf3580-c19a-4453-9de8-0fa3c436b646 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508797 May 19 05:38:49.372296 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3491/6893] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:38:49.382341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-026a1be0-f4d3-4725-a848-c31e409b5429 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:49.382971 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-026a1be0-f4d3-4725-a848-c31e409b5429 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:49.384965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:49.386124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:49.439469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-026a1be0-f4d3-4725-a848-c31e409b5429 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:49.446546 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-026a1be0-f4d3-4725-a848-c31e409b5429 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1216 microversion: 2.1 time: 0.068127 May 19 05:38:49.447132 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3403/6894] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:49 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:50.463479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eebcd433-45b7-4664-a5d5-120fed1a34c3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:50.464120 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eebcd433-45b7-4664-a5d5-120fed1a34c3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:50.472552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eebcd433-45b7-4664-a5d5-120fed1a34c3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:50.473019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eebcd433-45b7-4664-a5d5-120fed1a34c3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:50.473852 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eebcd433-45b7-4664-a5d5-120fed1a34c3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:50.474308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eebcd433-45b7-4664-a5d5-120fed1a34c3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:50.538315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eebcd433-45b7-4664-a5d5-120fed1a34c3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:50.546405 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eebcd433-45b7-4664-a5d5-120fed1a34c3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1274 microversion: 2.1 time: 0.086903 May 19 05:38:50.547012 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3492/6895] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:50 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:51.563928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-05924493-037d-4745-898c-5533bf636129 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:51.564674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-05924493-037d-4745-898c-5533bf636129 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:51.573251 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05924493-037d-4745-898c-5533bf636129 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:51.573712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05924493-037d-4745-898c-5533bf636129 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:51.574500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05924493-037d-4745-898c-5533bf636129 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:51.574941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-05924493-037d-4745-898c-5533bf636129 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:51.708081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-05924493-037d-4745-898c-5533bf636129 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:51.719371 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-05924493-037d-4745-898c-5533bf636129 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1316 microversion: 2.1 time: 0.159299 May 19 05:38:51.720280 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3404/6896] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:51 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:51.921219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-f31c3486-a67f-461a-93e0-0a2324757f76 req-505dfec4-9f99-4df5-8fa5-ebb55e4668c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abda7ed-cb0f-4872-8b1e-afc2f7f0828b", "tag": "d38cd909-e5af-4126-ac90-3a00c76d0fe3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:38:51.930840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f31c3486-a67f-461a-93e0-0a2324757f76 req-505dfec4-9f99-4df5-8fa5-ebb55e4668c8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:51.931597 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-f31c3486-a67f-461a-93e0-0a2324757f76 req-505dfec4-9f99-4df5-8fa5-ebb55e4668c8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:51.945850 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-f31c3486-a67f-461a-93e0-0a2324757f76 req-505dfec4-9f99-4df5-8fa5-ebb55e4668c8 service nova] Creating event network-changed:d38cd909-e5af-4126-ac90-3a00c76d0fe3 for instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b on n-h1-766726-30 May 19 05:38:51.952345 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-f31c3486-a67f-461a-93e0-0a2324757f76 req-505dfec4-9f99-4df5-8fa5-ebb55e4668c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035092 May 19 05:38:51.953025 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3493/6897] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:38:52.736918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4f578a61-1204-4919-b329-aaf595ca1e94 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:52.737584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4f578a61-1204-4919-b329-aaf595ca1e94 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:52.743744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f578a61-1204-4919-b329-aaf595ca1e94 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:52.744197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f578a61-1204-4919-b329-aaf595ca1e94 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:52.745518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f578a61-1204-4919-b329-aaf595ca1e94 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:52.745989 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4f578a61-1204-4919-b329-aaf595ca1e94 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:52.874445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4f578a61-1204-4919-b329-aaf595ca1e94 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:52.882175 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4f578a61-1204-4919-b329-aaf595ca1e94 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1316 microversion: 2.1 time: 0.149476 May 19 05:38:52.882792 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3405/6898] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:52 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:53.901522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fbbd9001-51a0-40d8-bd35-8156f3466fc7 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:53.902238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fbbd9001-51a0-40d8-bd35-8156f3466fc7 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:53.908524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbbd9001-51a0-40d8-bd35-8156f3466fc7 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:53.908984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbbd9001-51a0-40d8-bd35-8156f3466fc7 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:53.909774 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbbd9001-51a0-40d8-bd35-8156f3466fc7 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:53.910227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fbbd9001-51a0-40d8-bd35-8156f3466fc7 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:54.042639 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fbbd9001-51a0-40d8-bd35-8156f3466fc7 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:54.050229 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fbbd9001-51a0-40d8-bd35-8156f3466fc7 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1316 microversion: 2.1 time: 0.154387 May 19 05:38:54.050806 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3494/6899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:53 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:55.066762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0d7c54d8-17df-4b6d-bbd8-05c31e40de6a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:55.067382 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0d7c54d8-17df-4b6d-bbd8-05c31e40de6a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:55.074281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d7c54d8-17df-4b6d-bbd8-05c31e40de6a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:55.074731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d7c54d8-17df-4b6d-bbd8-05c31e40de6a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:55.075498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d7c54d8-17df-4b6d-bbd8-05c31e40de6a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:55.075941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0d7c54d8-17df-4b6d-bbd8-05c31e40de6a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:55.214191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0d7c54d8-17df-4b6d-bbd8-05c31e40de6a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:55.222311 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0d7c54d8-17df-4b6d-bbd8-05c31e40de6a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1316 microversion: 2.1 time: 0.159447 May 19 05:38:55.222900 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3406/6900] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:55 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:56.239831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-26cc01b1-82e1-4571-b9d7-f485fb3d42cf tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:56.240430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-26cc01b1-82e1-4571-b9d7-f485fb3d42cf tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:56.247276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26cc01b1-82e1-4571-b9d7-f485fb3d42cf tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:56.247741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26cc01b1-82e1-4571-b9d7-f485fb3d42cf tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:56.248515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26cc01b1-82e1-4571-b9d7-f485fb3d42cf tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:56.248964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26cc01b1-82e1-4571-b9d7-f485fb3d42cf tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:56.376839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-26cc01b1-82e1-4571-b9d7-f485fb3d42cf tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:56.384366 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-26cc01b1-82e1-4571-b9d7-f485fb3d42cf tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1316 microversion: 2.1 time: 0.148611 May 19 05:38:56.384964 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3495/6901] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:56 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:57.401743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0999716e-07d4-43b4-8dce-3ba43b402103 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:57.402368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0999716e-07d4-43b4-8dce-3ba43b402103 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:57.409279 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0999716e-07d4-43b4-8dce-3ba43b402103 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:57.409730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0999716e-07d4-43b4-8dce-3ba43b402103 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:57.410486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0999716e-07d4-43b4-8dce-3ba43b402103 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:57.410918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0999716e-07d4-43b4-8dce-3ba43b402103 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:57.541558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0999716e-07d4-43b4-8dce-3ba43b402103 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:57.548947 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0999716e-07d4-43b4-8dce-3ba43b402103 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1316 microversion: 2.1 time: 0.151733 May 19 05:38:57.549561 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3407/6902] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:57 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:57.791510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c21051a5-fc54-4332-8a37-258b3f21280a req-7a55d163-6712-43cb-870d-9bb54dfebdd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abda7ed-cb0f-4872-8b1e-afc2f7f0828b", "name": "network-vif-plugged", "status": "completed", "tag": "d38cd909-e5af-4126-ac90-3a00c76d0fe3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:38:57.800689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c21051a5-fc54-4332-8a37-258b3f21280a req-7a55d163-6712-43cb-870d-9bb54dfebdd0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:57.801261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c21051a5-fc54-4332-8a37-258b3f21280a req-7a55d163-6712-43cb-870d-9bb54dfebdd0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:57.813956 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c21051a5-fc54-4332-8a37-258b3f21280a req-7a55d163-6712-43cb-870d-9bb54dfebdd0 service nova] Creating event network-vif-plugged:d38cd909-e5af-4126-ac90-3a00c76d0fe3 for instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b on n-h1-766726-30 May 19 05:38:57.818843 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c21051a5-fc54-4332-8a37-258b3f21280a req-7a55d163-6712-43cb-870d-9bb54dfebdd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031622 May 19 05:38:57.819876 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3496/6903] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:38:58.566053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d6150d24-193f-48b2-b5c8-acce412a3ea8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:58.566596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d6150d24-193f-48b2-b5c8-acce412a3ea8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:58.573485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6150d24-193f-48b2-b5c8-acce412a3ea8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:58.573940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6150d24-193f-48b2-b5c8-acce412a3ea8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:58.574705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6150d24-193f-48b2-b5c8-acce412a3ea8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:58.575148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d6150d24-193f-48b2-b5c8-acce412a3ea8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:58.699848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d6150d24-193f-48b2-b5c8-acce412a3ea8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:58.707490 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d6150d24-193f-48b2-b5c8-acce412a3ea8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1316 microversion: 2.1 time: 0.145523 May 19 05:38:58.708080 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3408/6904] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:58 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:59.723222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:59.723994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:59.728780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e452c609-f658-4d27-b15b-e82f032754a3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:59.729583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e452c609-f658-4d27-b15b-e82f032754a3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:59.737186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e452c609-f658-4d27-b15b-e82f032754a3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:59.737661 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e452c609-f658-4d27-b15b-e82f032754a3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:59.738443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e452c609-f658-4d27-b15b-e82f032754a3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:59.738936 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e452c609-f658-4d27-b15b-e82f032754a3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:59.869483 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e452c609-f658-4d27-b15b-e82f032754a3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:38:59.877748 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e452c609-f658-4d27-b15b-e82f032754a3 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1506 microversion: 2.1 time: 0.156624 May 19 05:38:59.878331 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3497/6905] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:38:59 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:38:59.893576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-042eb677-b663-454d-aec9-d8c5267cf9ff tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:38:59.894082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-042eb677-b663-454d-aec9-d8c5267cf9ff tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:38:59.895969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:38:59.902229 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-042eb677-b663-454d-aec9-d8c5267cf9ff tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:59.902673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-042eb677-b663-454d-aec9-d8c5267cf9ff tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:59.903430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-042eb677-b663-454d-aec9-d8c5267cf9ff tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:38:59.903868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-042eb677-b663-454d-aec9-d8c5267cf9ff tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:38:59.929169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-042eb677-b663-454d-aec9-d8c5267cf9ff tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:39:00.002337 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-042eb677-b663-454d-aec9-d8c5267cf9ff tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 204 len: 0 microversion: 2.1 time: 0.112242 May 19 05:39:00.002863 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3409/6906] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:38:59 2022] DELETE /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:39:00.011379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-05ee61f4-48ec-4050-8f21-16641b906f47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:00.012032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-05ee61f4-48ec-4050-8f21-16641b906f47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:00.018206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05ee61f4-48ec-4050-8f21-16641b906f47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:00.018677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05ee61f4-48ec-4050-8f21-16641b906f47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:00.019466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05ee61f4-48ec-4050-8f21-16641b906f47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:00.019927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05ee61f4-48ec-4050-8f21-16641b906f47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:00.147562 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-05ee61f4-48ec-4050-8f21-16641b906f47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:00.155718 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-05ee61f4-48ec-4050-8f21-16641b906f47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1512 microversion: 2.1 time: 0.148540 May 19 05:39:00.156296 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3498/6907] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:00 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:01.172517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-81914499-b294-4c7f-b372-5b16fae6ef2f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:01.173202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-81914499-b294-4c7f-b372-5b16fae6ef2f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:01.180162 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81914499-b294-4c7f-b372-5b16fae6ef2f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:01.180619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81914499-b294-4c7f-b372-5b16fae6ef2f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:01.181424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81914499-b294-4c7f-b372-5b16fae6ef2f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:01.181866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-81914499-b294-4c7f-b372-5b16fae6ef2f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:01.311193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-81914499-b294-4c7f-b372-5b16fae6ef2f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:01.318706 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-81914499-b294-4c7f-b372-5b16fae6ef2f tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1512 microversion: 2.1 time: 0.150635 May 19 05:39:01.319285 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3410/6908] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:01 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:01.863920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a01a9d71-496b-46c5-ab7e-811e4da25ca4 req-6b8e295e-7c2f-4d26-9f40-8b51a8de2e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abda7ed-cb0f-4872-8b1e-afc2f7f0828b", "name": "network-vif-deleted", "tag": "d38cd909-e5af-4126-ac90-3a00c76d0fe3"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:01.874573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a01a9d71-496b-46c5-ab7e-811e4da25ca4 req-6b8e295e-7c2f-4d26-9f40-8b51a8de2e1b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:01.875057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a01a9d71-496b-46c5-ab7e-811e4da25ca4 req-6b8e295e-7c2f-4d26-9f40-8b51a8de2e1b service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:01.900551 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a01a9d71-496b-46c5-ab7e-811e4da25ca4 req-6b8e295e-7c2f-4d26-9f40-8b51a8de2e1b service nova] Creating event network-vif-deleted:d38cd909-e5af-4126-ac90-3a00c76d0fe3 for instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b on n-h1-766726-30 May 19 05:39:01.906973 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a01a9d71-496b-46c5-ab7e-811e4da25ca4 req-6b8e295e-7c2f-4d26-9f40-8b51a8de2e1b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053301 May 19 05:39:01.907600 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3499/6909] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:39:02.335773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:02.336399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:02.344122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:02.344568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:02.345773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:02.346190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:02.383892 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:02.384489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:02.385098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lazy-loading 'fault' on Instance uuid 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:39:02.434089 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:02.441046 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f97ed1b9-efb9-4529-a13d-a19935de581e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 200 len: 1306 microversion: 2.1 time: 0.109371 May 19 05:39:02.441661 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3411/6910] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:02 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:03.459520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:03.460271 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:03.466581 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:03.467047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:03.467822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:03.468273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:03.481902 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] HTTP exception thrown: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Request method failure captured: May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b HTTP/1.1 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdfejAfQ2StN2mvd-Mt5sTbTS4zPbysrfzAFyO9jS8vOWxbMQTv0Vf2U1ZQDrpzLi1_xd_CrDxsAjCeO6PgxOmKu10US8Xt1hmwfsByWoFjsqWcQcFOeonXdovUcvA2I2yf2SBbdqrlT5aBBhfAwtEfieXPYdFTm_xtw2MZwFffX5Fg May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d972c1be122e47279db1b24f641a6047 May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2abda7ed-cb0f-4872-8b1e-afc2f7f0828b'} May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:03.483528 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Returning 404 to user: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f08e9a3b-174f-4235-9cbb-227030e04ab1 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 404 len: 111 microversion: 2.1 time: 0.030604 May 19 05:39:03.492300 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3500/6911] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:03 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:39:03.493929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a750de57-db55-467f-b651-a2bb85983e26 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:03.494609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a750de57-db55-467f-b651-a2bb85983e26 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:03.502072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a750de57-db55-467f-b651-a2bb85983e26 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:03.502526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a750de57-db55-467f-b651-a2bb85983e26 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:03.503291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a750de57-db55-467f-b651-a2bb85983e26 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:03.503732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a750de57-db55-467f-b651-a2bb85983e26 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:03.638735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a750de57-db55-467f-b651-a2bb85983e26 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:03.646488 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a750de57-db55-467f-b651-a2bb85983e26 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1506 microversion: 2.1 time: 0.156440 May 19 05:39:03.647082 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3412/6912] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:03 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:03.663246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0886f00e-41e4-4947-af95-c7fff86b3ae8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:03.664244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0886f00e-41e4-4947-af95-c7fff86b3ae8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: aa2318ad-314a-428d-a93e-51cb63ac1f86] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:03.670465 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-0886f00e-41e4-4947-af95-c7fff86b3ae8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] HTTP exception thrown: Instance aa2318ad-314a-428d-a93e-51cb63ac1f86 could not be found. May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0886f00e-41e4-4947-af95-c7fff86b3ae8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Request method failure captured: May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/aa2318ad-314a-428d-a93e-51cb63ac1f86/action HTTP/1.1 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 32 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdfejAfQ2StN2mvd-Mt5sTbTS4zPbysrfzAFyO9jS8vOWxbMQTv0Vf2U1ZQDrpzLi1_xd_CrDxsAjCeO6PgxOmKu10US8Xt1hmwfsByWoFjsqWcQcFOeonXdovUcvA2I2yf2SBbdqrlT5aBBhfAwtEfieXPYdFTm_xtw2MZwFffX5Fg May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d972c1be122e47279db1b24f641a6047 May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: {"resize": {"flavorRef": "452"}} May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance aa2318ad-314a-428d-a93e-51cb63ac1f86 could not be found. May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'aa2318ad-314a-428d-a93e-51cb63ac1f86', 'body': {'resize': {'flavorRef': '452'}}} May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2318ad-314a-428d-a93e-51cb63ac1f86 could not be found. May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1048, in _resize May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:39:03.672045 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2318ad-314a-428d-a93e-51cb63ac1f86 could not be found. May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2318ad-314a-428d-a93e-51cb63ac1f86 could not be found. May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0886f00e-41e4-4947-af95-c7fff86b3ae8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Returning 404 to user: Instance aa2318ad-314a-428d-a93e-51cb63ac1f86 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0886f00e-41e4-4947-af95-c7fff86b3ae8 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "POST /compute/v2.1/servers/aa2318ad-314a-428d-a93e-51cb63ac1f86/action" status: 404 len: 111 microversion: 2.1 time: 0.014230 May 19 05:39:03.677410 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3501/6913] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:39:03 2022] POST /compute/v2.1/servers/aa2318ad-314a-428d-a93e-51cb63ac1f86/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:39:03.682043 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a000de0f-12f3-4d0b-b29d-55b43827444b tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:03.683243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a000de0f-12f3-4d0b-b29d-55b43827444b tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:03.689347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a000de0f-12f3-4d0b-b29d-55b43827444b tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:03.689803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a000de0f-12f3-4d0b-b29d-55b43827444b tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:03.690581 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a000de0f-12f3-4d0b-b29d-55b43827444b tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:03.691022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a000de0f-12f3-4d0b-b29d-55b43827444b tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:03.705635 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:39:03.820299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a000de0f-12f3-4d0b-b29d-55b43827444b tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:03.827881 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a000de0f-12f3-4d0b-b29d-55b43827444b tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1506 microversion: 2.1 time: 0.149699 May 19 05:39:03.828464 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3413/6914] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:03 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:03.845382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4c7a2ba-03c8-4831-887b-29440e135b09 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:03.846455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c4c7a2ba-03c8-4831-887b-29440e135b09 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:03.853993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4c7a2ba-03c8-4831-887b-29440e135b09 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:03.855051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4c7a2ba-03c8-4831-887b-29440e135b09 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:03.856003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4c7a2ba-03c8-4831-887b-29440e135b09 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:03.856410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4c7a2ba-03c8-4831-887b-29440e135b09 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.332748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c4c7a2ba-03c8-4831-887b-29440e135b09 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:04.341059 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c4c7a2ba-03c8-4831-887b-29440e135b09 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1506 microversion: 2.1 time: 0.499721 May 19 05:39:04.341649 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3502/6915] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:03 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:04.357889 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "f431df28-747c-48b7-9b8e-f7ed61d12c71"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:04.358877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:04.364963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.365450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.366223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.366674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.394199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:04.399179 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] HTTP exception thrown: Flavor f431df28-747c-48b7-9b8e-f7ed61d12c71 could not be found. May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Request method failure captured: May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: request: POST /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6/action HTTP/1.1 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 65 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdfejAfQ2StN2mvd-Mt5sTbTS4zPbysrfzAFyO9jS8vOWxbMQTv0Vf2U1ZQDrpzLi1_xd_CrDxsAjCeO6PgxOmKu10US8Xt1hmwfsByWoFjsqWcQcFOeonXdovUcvA2I2yf2SBbdqrlT5aBBhfAwtEfieXPYdFTm_xtw2MZwFffX5Fg May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d972c1be122e47279db1b24f641a6047 May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: {"resize": {"flavorRef": "f431df28-747c-48b7-9b8e-f7ed61d12c71"}} May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: exception: Flavor f431df28-747c-48b7-9b8e-f7ed61d12c71 could not be found. May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'fbecc2ce-e2df-49b0-95b4-01b1392617b6', 'body': {'resize': {'flavorRef': 'f431df28-747c-48b7-9b8e-f7ed61d12c71'}}} May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1055, in _resize May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 05:39:04.401758 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f431df28-747c-48b7-9b8e-f7ed61d12c71 could not be found. May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1085, in _resize May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor f431df28-747c-48b7-9b8e-f7ed61d12c71 could not be found. May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f431df28-747c-48b7-9b8e-f7ed61d12c71 could not be found. May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Returning 400 to user: Flavor f431df28-747c-48b7-9b8e-f7ed61d12c71 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2346063a-e44c-4c9e-81e5-7cf4bb1bc17d tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "POST /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6/action" status: 400 len: 107 microversion: 2.1 time: 0.049449 May 19 05:39:04.406902 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3414/6916] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:39:04 2022] POST /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6/action => generated 107 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 05:39:04.412167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1f3a553-8f45-4687-abb7-c2c19abfccfa tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:04.412829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1f3a553-8f45-4687-abb7-c2c19abfccfa tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:04.418875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1f3a553-8f45-4687-abb7-c2c19abfccfa tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.419334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1f3a553-8f45-4687-abb7-c2c19abfccfa tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.420097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1f3a553-8f45-4687-abb7-c2c19abfccfa tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.420544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1f3a553-8f45-4687-abb7-c2c19abfccfa tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.545035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1f3a553-8f45-4687-abb7-c2c19abfccfa tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:04.552683 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1f3a553-8f45-4687-abb7-c2c19abfccfa tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1506 microversion: 2.1 time: 0.144390 May 19 05:39:04.553288 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3503/6917] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:04 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1506 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:04.569411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d90d5732-91f6-4836-a174-de8951dcf160 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:04.570031 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d90d5732-91f6-4836-a174-de8951dcf160 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:04.577408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d90d5732-91f6-4836-a174-de8951dcf160 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.577862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d90d5732-91f6-4836-a174-de8951dcf160 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.578631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d90d5732-91f6-4836-a174-de8951dcf160 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.579074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d90d5732-91f6-4836-a174-de8951dcf160 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.706545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d90d5732-91f6-4836-a174-de8951dcf160 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:04.714149 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d90d5732-91f6-4836-a174-de8951dcf160 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1506 microversion: 2.1 time: 0.148582 May 19 05:39:04.714722 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3415/6918] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:04 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:04.730504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09c036d4-161f-496a-8001-40a5f4a2ea1e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09c036d4-161f-496a-8001-40a5f4a2ea1e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Request method failure captured: May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: request: POST /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6/action HTTP/1.1 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 29 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdfejAfQ2StN2mvd-Mt5sTbTS4zPbysrfzAFyO9jS8vOWxbMQTv0Vf2U1ZQDrpzLi1_xd_CrDxsAjCeO6PgxOmKu10US8Xt1hmwfsByWoFjsqWcQcFOeonXdovUcvA2I2yf2SBbdqrlT5aBBhfAwtEfieXPYdFTm_xtw2MZwFffX5Fg May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d972c1be122e47279db1b24f641a6047 May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: {"resize": {"flavorRef": ""}} May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'fbecc2ce-e2df-49b0-95b4-01b1392617b6', 'body': {'resize': {'flavorRef': ''}}} May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise error May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi On instance['resize']: May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi '' May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.732763 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-09c036d4-161f-496a-8001-40a5f4a2ea1e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-09c036d4-161f-496a-8001-40a5f4a2ea1e tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "POST /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6/action" status: 400 len: 113 microversion: 2.1 time: 0.007742 May 19 05:39:04.738300 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3504/6919] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:39:04 2022] POST /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 05:39:04.742217 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-596a271d-39b3-4cec-9bfb-cd6832475fa9 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:04.742840 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-596a271d-39b3-4cec-9bfb-cd6832475fa9 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:04.749392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-596a271d-39b3-4cec-9bfb-cd6832475fa9 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.749849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-596a271d-39b3-4cec-9bfb-cd6832475fa9 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.750624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-596a271d-39b3-4cec-9bfb-cd6832475fa9 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.751068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-596a271d-39b3-4cec-9bfb-cd6832475fa9 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.876870 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-596a271d-39b3-4cec-9bfb-cd6832475fa9 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:04.884384 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-596a271d-39b3-4cec-9bfb-cd6832475fa9 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1506 microversion: 2.1 time: 0.145922 May 19 05:39:04.884964 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3416/6920] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:04 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:04.904395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:04.904906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:04.912259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.912721 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.913532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.913981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.926926 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] HTTP exception thrown: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Request method failure captured: May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b HTTP/1.1 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdfejAfQ2StN2mvd-Mt5sTbTS4zPbysrfzAFyO9jS8vOWxbMQTv0Vf2U1ZQDrpzLi1_xd_CrDxsAjCeO6PgxOmKu10US8Xt1hmwfsByWoFjsqWcQcFOeonXdovUcvA2I2yf2SBbdqrlT5aBBhfAwtEfieXPYdFTm_xtw2MZwFffX5Fg May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d972c1be122e47279db1b24f641a6047 May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '2abda7ed-cb0f-4872-8b1e-afc2f7f0828b'} May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:39:04.928475 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Returning 404 to user: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5325c8f0-bd85-4bab-bfa3-ab82cb51cfcc tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 404 len: 111 microversion: 2.1 time: 0.029430 May 19 05:39:04.933870 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3505/6921] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:39:04 2022] DELETE /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:39:04.939995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:04.940618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:04.946651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.947101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.948544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.948996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.964502 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] HTTP exception thrown: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Request method failure captured: May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b HTTP/1.1 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdfejAfQ2StN2mvd-Mt5sTbTS4zPbysrfzAFyO9jS8vOWxbMQTv0Vf2U1ZQDrpzLi1_xd_CrDxsAjCeO6PgxOmKu10US8Xt1hmwfsByWoFjsqWcQcFOeonXdovUcvA2I2yf2SBbdqrlT5aBBhfAwtEfieXPYdFTm_xtw2MZwFffX5Fg May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: d972c1be122e47279db1b24f641a6047 May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '2abda7ed-cb0f-4872-8b1e-afc2f7f0828b'} May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:04.966058 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Returning 404 to user: Instance 2abda7ed-cb0f-4872-8b1e-afc2f7f0828b could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-76187c95-ccc7-4a72-9168-d10ae2651b47 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b" status: 404 len: 111 microversion: 2.1 time: 0.031358 May 19 05:39:04.970829 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3417/6922] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:04 2022] GET /compute/v2.1/servers/2abda7ed-cb0f-4872-8b1e-afc2f7f0828b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:39:04.976305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a5ff9fe5-37b7-4cb0-9123-1256eb588bf5 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:04.976818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a5ff9fe5-37b7-4cb0-9123-1256eb588bf5 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:04.982956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5ff9fe5-37b7-4cb0-9123-1256eb588bf5 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.983413 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5ff9fe5-37b7-4cb0-9123-1256eb588bf5 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:04.984185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5ff9fe5-37b7-4cb0-9123-1256eb588bf5 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:04.984630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a5ff9fe5-37b7-4cb0-9123-1256eb588bf5 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:05.011775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a5ff9fe5-37b7-4cb0-9123-1256eb588bf5 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:39:05.084056 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a5ff9fe5-37b7-4cb0-9123-1256eb588bf5 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 204 len: 0 microversion: 2.1 time: 0.111262 May 19 05:39:05.084863 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3506/6923] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:39:04 2022] DELETE /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 05:39:05.098957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c95e4d75-36a7-469e-b1d8-b8564706635a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:05.099577 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c95e4d75-36a7-469e-b1d8-b8564706635a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:05.105714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c95e4d75-36a7-469e-b1d8-b8564706635a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:05.106169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c95e4d75-36a7-469e-b1d8-b8564706635a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:05.106933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c95e4d75-36a7-469e-b1d8-b8564706635a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:05.107389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c95e4d75-36a7-469e-b1d8-b8564706635a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:05.239367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c95e4d75-36a7-469e-b1d8-b8564706635a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:05.247034 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c95e4d75-36a7-469e-b1d8-b8564706635a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1512 microversion: 2.1 time: 0.152380 May 19 05:39:05.247605 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3418/6924] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:05 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:06.264670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cbf1997f-6a4d-40fd-a7dd-881f7ed6f86a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:06.265427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cbf1997f-6a4d-40fd-a7dd-881f7ed6f86a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:06.272456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbf1997f-6a4d-40fd-a7dd-881f7ed6f86a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:06.272925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbf1997f-6a4d-40fd-a7dd-881f7ed6f86a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:06.273748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbf1997f-6a4d-40fd-a7dd-881f7ed6f86a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:06.274203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cbf1997f-6a4d-40fd-a7dd-881f7ed6f86a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:06.402839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cbf1997f-6a4d-40fd-a7dd-881f7ed6f86a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd972c1be122e47279db1b24f641a6047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb0f3823fd34fe08b498f0fe550fe89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:06.410754 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cbf1997f-6a4d-40fd-a7dd-881f7ed6f86a tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 200 len: 1512 microversion: 2.1 time: 0.150440 May 19 05:39:06.411339 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3507/6925] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:06 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:06.855240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ab4777a1-e979-4611-8126-cdf43b8f96a4 req-21d7a28e-45a3-45e9-966b-aa36566c9b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbecc2ce-e2df-49b0-95b4-01b1392617b6", "name": "network-vif-deleted", "tag": "3a9b01b9-7991-47d0-8a3b-26c74dbace50"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:06.865608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ab4777a1-e979-4611-8126-cdf43b8f96a4 req-21d7a28e-45a3-45e9-966b-aa36566c9b4e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:06.866058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ab4777a1-e979-4611-8126-cdf43b8f96a4 req-21d7a28e-45a3-45e9-966b-aa36566c9b4e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:06.881369 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ab4777a1-e979-4611-8126-cdf43b8f96a4 req-21d7a28e-45a3-45e9-966b-aa36566c9b4e service nova] Creating event network-vif-deleted:3a9b01b9-7991-47d0-8a3b-26c74dbace50 for instance fbecc2ce-e2df-49b0-95b4-01b1392617b6 on n-h2-766726-30 May 19 05:39:06.887026 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ab4777a1-e979-4611-8126-cdf43b8f96a4 req-21d7a28e-45a3-45e9-966b-aa36566c9b4e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035421 May 19 05:39:06.887643 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3419/6926] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:39:07.428144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:07.428699 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] [instance: fbecc2ce-e2df-49b0-95b4-01b1392617b6] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:07.436130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:07.436590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:07.437381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:07.437833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:07.441835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:39:07.454335 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] HTTP exception thrown: Instance fbecc2ce-e2df-49b0-95b4-01b1392617b6 could not be found. May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Request method failure captured: May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 HTTP/1.1 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdfejAfQ2StN2mvd-Mt5sTbTS4zPbysrfzAFyO9jS8vOWxbMQTv0Vf2U1ZQDrpzLi1_xd_CrDxsAjCeO6PgxOmKu10US8Xt1hmwfsByWoFjsqWcQcFOeonXdovUcvA2I2yf2SBbdqrlT5aBBhfAwtEfieXPYdFTm_xtw2MZwFffX5Fg May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bcb0f3823fd34fe08b498f0fe550fe89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: bcb0f3823fd34fe08b498f0fe550fe89 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1952796746 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: d972c1be122e47279db1b24f641a6047 May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-ServersNegativeTestJSON-1952796746-project May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance fbecc2ce-e2df-49b0-95b4-01b1392617b6 could not be found. May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'fbecc2ce-e2df-49b0-95b4-01b1392617b6'} May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbecc2ce-e2df-49b0-95b4-01b1392617b6 could not be found. May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbecc2ce-e2df-49b0-95b4-01b1392617b6 could not be found. May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:39:07.455967 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbecc2ce-e2df-49b0-95b4-01b1392617b6 could not be found. May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] Returning 404 to user: Instance fbecc2ce-e2df-49b0-95b4-01b1392617b6 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-542c3d11-eacf-4ce5-871f-34326ce42852 tempest-ServersNegativeTestJSON-1952796746 tempest-ServersNegativeTestJSON-1952796746-project] 10.222.0.58 "GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6" status: 404 len: 111 microversion: 2.1 time: 0.033296 May 19 05:39:07.462744 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3508/6927] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:07 2022] GET /compute/v2.1/servers/fbecc2ce-e2df-49b0-95b4-01b1392617b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:39:38.199366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:39:38.200276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=29 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:39:38.377343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-94c212a5-acd5-4b14-bf0b-7084f456277b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Action: 'create', calling method: .version_select at 0x7fd3144ff1f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-860637871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZpZG/0yRMXtdwUioJHO94cs6bQrSTCKplgQVuHMX2wbl0e6M9oE64PogWHipJJAUqrcpJEaQpJKWL4EIPEPR2zUfrL4aZza19kiPMOgNuJUxSD+PAuBqfTbXi5XwQL9Q=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:38.391300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-94c212a5-acd5-4b14-bf0b-7084f456277b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Getting quotas for project 9eca356c40784cf896dc7b80ba55c8e9. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:39:38.396404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-94c212a5-acd5-4b14-bf0b-7084f456277b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Getting quotas for user c033828357c5423dbc968dab9f4c4a8f and project 9eca356c40784cf896dc7b80ba55c8e9. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:39:38.425839 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-94c212a5-acd5-4b14-bf0b-7084f456277b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.228865 May 19 05:39:38.426442 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3420/6928] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:39:38 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:39:38.479840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-683272079", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-860637871", "networks": [{"uuid": "ca51b03e-e520-4a24-9ee3-c60285801aae"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:38.487210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:39:38.537335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] validate_networks() for [('ca51b03e-e520-4a24-9ee3-c60285801aae', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:39:39.232637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:39:39.233839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:39:39.234343 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:39:39.234773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:39:39.235208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:39:39.254479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:39.254943 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:39.255751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:39.256200 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:39.283144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Getting quotas for project 9eca356c40784cf896dc7b80ba55c8e9. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:39:39.288439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Getting quotas for user c033828357c5423dbc968dab9f4c4a8f and project 9eca356c40784cf896dc7b80ba55c8e9. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:39:39.301192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:39:39.303511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:39:39.350189 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0bead5ef-682a-4ae0-b6e2-49ea14b03f84 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875170 May 19 05:39:39.350847 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3509/6929] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:39:39.362163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b59134b0-1e37-4f3c-86c0-3daa98b5a418 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:39.363018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b59134b0-1e37-4f3c-86c0-3daa98b5a418 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:39.417773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b59134b0-1e37-4f3c-86c0-3daa98b5a418 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:39.425503 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b59134b0-1e37-4f3c-86c0-3daa98b5a418 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1261 microversion: 2.1 time: 0.068225 May 19 05:39:39.426077 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3421/6930] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:39 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:40.442863 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0b92b925-198b-4913-b147-35730f99f4f9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:40.444185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0b92b925-198b-4913-b147-35730f99f4f9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:40.452328 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b92b925-198b-4913-b147-35730f99f4f9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:40.452895 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b92b925-198b-4913-b147-35730f99f4f9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:40.453955 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b92b925-198b-4913-b147-35730f99f4f9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:40.454664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0b92b925-198b-4913-b147-35730f99f4f9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:40.522047 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0b92b925-198b-4913-b147-35730f99f4f9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:40.530969 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0b92b925-198b-4913-b147-35730f99f4f9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1321 microversion: 2.1 time: 0.092180 May 19 05:39:40.532600 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3510/6931] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:40 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1321 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:41.550115 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a979b13e-1582-4b1c-8228-71d36564ab0e tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:41.550835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a979b13e-1582-4b1c-8228-71d36564ab0e tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:41.559860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a979b13e-1582-4b1c-8228-71d36564ab0e tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:41.560393 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a979b13e-1582-4b1c-8228-71d36564ab0e tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:41.561348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a979b13e-1582-4b1c-8228-71d36564ab0e tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:41.562024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a979b13e-1582-4b1c-8228-71d36564ab0e tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:41.807038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a979b13e-1582-4b1c-8228-71d36564ab0e tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:41.842449 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a979b13e-1582-4b1c-8228-71d36564ab0e tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1361 microversion: 2.1 time: 0.296539 May 19 05:39:41.845811 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-c4f869a4-79a3-48f2-87eb-28002c0d440b req-a15a9ffb-b92c-48d1-a7c6-30d0cc8b2013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3", "tag": "d4827510-0b02-4be0-88fb-c8ba64491d9a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:41.848153 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3422/6932] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:41 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:41.870853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c4f869a4-79a3-48f2-87eb-28002c0d440b req-a15a9ffb-b92c-48d1-a7c6-30d0cc8b2013 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:41.871422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-c4f869a4-79a3-48f2-87eb-28002c0d440b req-a15a9ffb-b92c-48d1-a7c6-30d0cc8b2013 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:41.888241 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-c4f869a4-79a3-48f2-87eb-28002c0d440b req-a15a9ffb-b92c-48d1-a7c6-30d0cc8b2013 service nova] Creating event network-changed:d4827510-0b02-4be0-88fb-c8ba64491d9a for instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 on n-h1-766726-30 May 19 05:39:41.897331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-c4f869a4-79a3-48f2-87eb-28002c0d440b req-a15a9ffb-b92c-48d1-a7c6-30d0cc8b2013 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062180 May 19 05:39:41.898430 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3511/6933] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:39:42.864899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a25f8c15-bd44-40a4-a204-517661183f07 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:42.865633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a25f8c15-bd44-40a4-a204-517661183f07 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:42.872803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a25f8c15-bd44-40a4-a204-517661183f07 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:42.873551 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a25f8c15-bd44-40a4-a204-517661183f07 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:42.874414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a25f8c15-bd44-40a4-a204-517661183f07 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:42.874858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a25f8c15-bd44-40a4-a204-517661183f07 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:43.007387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a25f8c15-bd44-40a4-a204-517661183f07 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:43.015810 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a25f8c15-bd44-40a4-a204-517661183f07 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1361 microversion: 2.1 time: 0.154738 May 19 05:39:43.016401 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3423/6934] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:42 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:44.032292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-32a78ac3-6d4e-4290-846a-94f5c756e000 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:44.033035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-32a78ac3-6d4e-4290-846a-94f5c756e000 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:44.040232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a78ac3-6d4e-4290-846a-94f5c756e000 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:44.040696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a78ac3-6d4e-4290-846a-94f5c756e000 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:44.042068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a78ac3-6d4e-4290-846a-94f5c756e000 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:44.042520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-32a78ac3-6d4e-4290-846a-94f5c756e000 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:44.170620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-32a78ac3-6d4e-4290-846a-94f5c756e000 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:44.178086 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-32a78ac3-6d4e-4290-846a-94f5c756e000 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1361 microversion: 2.1 time: 0.150080 May 19 05:39:44.178654 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3512/6935] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:44 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:45.195183 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5dcbeb93-b48d-4cd7-b73e-2e3c51c08e67 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:45.195801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5dcbeb93-b48d-4cd7-b73e-2e3c51c08e67 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:45.202795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5dcbeb93-b48d-4cd7-b73e-2e3c51c08e67 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:45.203269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5dcbeb93-b48d-4cd7-b73e-2e3c51c08e67 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:45.204035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5dcbeb93-b48d-4cd7-b73e-2e3c51c08e67 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:45.204479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5dcbeb93-b48d-4cd7-b73e-2e3c51c08e67 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:45.431782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-5dcbeb93-b48d-4cd7-b73e-2e3c51c08e67 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:45.439247 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5dcbeb93-b48d-4cd7-b73e-2e3c51c08e67 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1361 microversion: 2.1 time: 0.248027 May 19 05:39:45.439832 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3424/6936] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:45 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:46.456032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a34ec15b-0429-41b4-844e-b03abeed5c8d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:46.456672 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a34ec15b-0429-41b4-844e-b03abeed5c8d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:46.463777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a34ec15b-0429-41b4-844e-b03abeed5c8d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:46.464177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a34ec15b-0429-41b4-844e-b03abeed5c8d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:46.464974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a34ec15b-0429-41b4-844e-b03abeed5c8d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:46.465459 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a34ec15b-0429-41b4-844e-b03abeed5c8d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:46.643455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a34ec15b-0429-41b4-844e-b03abeed5c8d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:46.651598 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a34ec15b-0429-41b4-844e-b03abeed5c8d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1361 microversion: 2.1 time: 0.199617 May 19 05:39:46.652185 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3513/6937] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:46 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:47.667862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bc06c6a6-8159-477e-b5e1-1ee80e04732d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:47.668640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bc06c6a6-8159-477e-b5e1-1ee80e04732d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:47.675793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc06c6a6-8159-477e-b5e1-1ee80e04732d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:47.676246 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc06c6a6-8159-477e-b5e1-1ee80e04732d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:47.677018 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc06c6a6-8159-477e-b5e1-1ee80e04732d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:47.677489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bc06c6a6-8159-477e-b5e1-1ee80e04732d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:47.810800 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bc06c6a6-8159-477e-b5e1-1ee80e04732d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:47.819236 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bc06c6a6-8159-477e-b5e1-1ee80e04732d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1361 microversion: 2.1 time: 0.155282 May 19 05:39:47.819832 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3425/6938] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:47 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:48.111793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-918d53ae-b712-46cb-aee2-6788934afa5e req-b23519cc-593c-4730-96b4-221ff54e0c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3", "name": "network-vif-plugged", "status": "completed", "tag": "d4827510-0b02-4be0-88fb-c8ba64491d9a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:48.123964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-918d53ae-b712-46cb-aee2-6788934afa5e req-b23519cc-593c-4730-96b4-221ff54e0c61 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:48.124505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-918d53ae-b712-46cb-aee2-6788934afa5e req-b23519cc-593c-4730-96b4-221ff54e0c61 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:48.136114 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-918d53ae-b712-46cb-aee2-6788934afa5e req-b23519cc-593c-4730-96b4-221ff54e0c61 service nova] Creating event network-vif-plugged:d4827510-0b02-4be0-88fb-c8ba64491d9a for instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 on n-h1-766726-30 May 19 05:39:48.141201 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-918d53ae-b712-46cb-aee2-6788934afa5e req-b23519cc-593c-4730-96b4-221ff54e0c61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033904 May 19 05:39:48.141822 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3514/6939] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:39:48.836704 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-109cdec3-3f2a-4197-80d2-90ef89186032 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:48.837293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-109cdec3-3f2a-4197-80d2-90ef89186032 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:48.844907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-109cdec3-3f2a-4197-80d2-90ef89186032 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:48.845653 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-109cdec3-3f2a-4197-80d2-90ef89186032 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:48.846423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-109cdec3-3f2a-4197-80d2-90ef89186032 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:48.846865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-109cdec3-3f2a-4197-80d2-90ef89186032 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:48.975017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-109cdec3-3f2a-4197-80d2-90ef89186032 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:48.982590 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-109cdec3-3f2a-4197-80d2-90ef89186032 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1361 microversion: 2.1 time: 0.149901 May 19 05:39:48.983183 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3426/6940] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:48 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:49.997787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:39:49.998522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:39:50.002627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d8264a11-a0c9-4ddc-8e03-5f7be596bc68 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:50.003341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d8264a11-a0c9-4ddc-8e03-5f7be596bc68 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:50.010941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8264a11-a0c9-4ddc-8e03-5f7be596bc68 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:50.011404 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8264a11-a0c9-4ddc-8e03-5f7be596bc68 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:50.012171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8264a11-a0c9-4ddc-8e03-5f7be596bc68 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:50.012618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d8264a11-a0c9-4ddc-8e03-5f7be596bc68 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:50.144383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d8264a11-a0c9-4ddc-8e03-5f7be596bc68 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:50.152598 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d8264a11-a0c9-4ddc-8e03-5f7be596bc68 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1553 microversion: 2.1 time: 0.156753 May 19 05:39:50.153197 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3515/6941] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:49 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:50.168785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-effb52b2-b903-40e7-a070-3c436cfe07dd tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:39:50.169438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-effb52b2-b903-40e7-a070-3c436cfe07dd tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:50.172347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:39:50.177372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-effb52b2-b903-40e7-a070-3c436cfe07dd tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:50.177831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-effb52b2-b903-40e7-a070-3c436cfe07dd tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:50.178601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-effb52b2-b903-40e7-a070-3c436cfe07dd tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:50.179052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-effb52b2-b903-40e7-a070-3c436cfe07dd tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:50.305321 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-effb52b2-b903-40e7-a070-3c436cfe07dd tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:39:50.312779 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-effb52b2-b903-40e7-a070-3c436cfe07dd tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1553 microversion: 2.1 time: 0.147854 May 19 05:39:50.313380 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3427/6942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:39:50 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:39:52.996023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d4710e78-cc8e-47e9-9428-bc2ade239673 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83adecd5-6516-4e18-9f3e-071ebe193794"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:39:52.997131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d4710e78-cc8e-47e9-9428-bc2ade239673 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:39:53.003192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4710e78-cc8e-47e9-9428-bc2ade239673 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:53.003660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4710e78-cc8e-47e9-9428-bc2ade239673 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:53.004436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4710e78-cc8e-47e9-9428-bc2ade239673 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:39:53.004887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4710e78-cc8e-47e9-9428-bc2ade239673 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:39:53.238868 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d4710e78-cc8e-47e9-9428-bc2ade239673 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "POST /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247566 May 19 05:39:53.239565 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3516/6943] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 05:39:52 2022] POST /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:09.162163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fd2948b0-8572-490a-a27b-ea226c1d5fe9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:09.162656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fd2948b0-8572-490a-a27b-ea226c1d5fe9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:09.165063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:09.166142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=36 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:09.173570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd2948b0-8572-490a-a27b-ea226c1d5fe9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:09.174103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd2948b0-8572-490a-a27b-ea226c1d5fe9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:09.174877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd2948b0-8572-490a-a27b-ea226c1d5fe9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:09.175320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fd2948b0-8572-490a-a27b-ea226c1d5fe9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:09.255432 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-fd2948b0-8572-490a-a27b-ea226c1d5fe9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lazy-loading 'services' on Instance uuid b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:40:09.340582 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fd2948b0-8572-490a-a27b-ea226c1d5fe9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments/83adecd5-6516-4e18-9f3e-071ebe193794" status: 202 len: 0 microversion: 2.1 time: 0.181833 May 19 05:40:09.341219 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3428/6944] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:40:09 2022] DELETE /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments/83adecd5-6516-4e18-9f3e-071ebe193794 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:40:09.347891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:09.348712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:09.354020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-069794b0-08bd-4e37-b9ad-4b713e63c742 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:09.355702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-069794b0-08bd-4e37-b9ad-4b713e63c742 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:09.364601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-069794b0-08bd-4e37-b9ad-4b713e63c742 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:09.365168 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-069794b0-08bd-4e37-b9ad-4b713e63c742 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:09.365907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-069794b0-08bd-4e37-b9ad-4b713e63c742 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:09.366355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-069794b0-08bd-4e37-b9ad-4b713e63c742 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:09.399729 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-069794b0-08bd-4e37-b9ad-4b713e63c742 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053594 May 19 05:40:09.400317 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3517/6945] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:09 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:10.413478 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5062b7e1-c110-45d6-8ce3-5b22c70ad7bb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:10.414576 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5062b7e1-c110-45d6-8ce3-5b22c70ad7bb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:10.421676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5062b7e1-c110-45d6-8ce3-5b22c70ad7bb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:10.422139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5062b7e1-c110-45d6-8ce3-5b22c70ad7bb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:10.422918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5062b7e1-c110-45d6-8ce3-5b22c70ad7bb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:10.423364 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5062b7e1-c110-45d6-8ce3-5b22c70ad7bb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:10.453610 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5062b7e1-c110-45d6-8ce3-5b22c70ad7bb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045364 May 19 05:40:10.454181 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3429/6946] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:10 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:11.465158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e32efb31-16a2-414d-bb64-5a9db68a273d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:11.466144 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e32efb31-16a2-414d-bb64-5a9db68a273d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:11.473516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e32efb31-16a2-414d-bb64-5a9db68a273d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:11.473982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e32efb31-16a2-414d-bb64-5a9db68a273d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:11.474768 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e32efb31-16a2-414d-bb64-5a9db68a273d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:11.475223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e32efb31-16a2-414d-bb64-5a9db68a273d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:11.506387 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e32efb31-16a2-414d-bb64-5a9db68a273d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 May 19 05:40:11.506974 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3518/6947] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:11 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:12.518754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-32abf149-041a-4859-8d64-6654edd55a4b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:12.519695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-32abf149-041a-4859-8d64-6654edd55a4b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:12.526674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32abf149-041a-4859-8d64-6654edd55a4b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:12.527796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32abf149-041a-4859-8d64-6654edd55a4b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:12.528569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32abf149-041a-4859-8d64-6654edd55a4b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:12.529010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-32abf149-041a-4859-8d64-6654edd55a4b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:12.558624 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-32abf149-041a-4859-8d64-6654edd55a4b tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 May 19 05:40:12.559139 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3430/6948] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:12 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:13.570273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-28164158-156b-492d-afe9-68f79ad280e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:13.571227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-28164158-156b-492d-afe9-68f79ad280e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:13.578313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28164158-156b-492d-afe9-68f79ad280e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:13.578779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28164158-156b-492d-afe9-68f79ad280e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:13.579560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28164158-156b-492d-afe9-68f79ad280e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:13.580063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-28164158-156b-492d-afe9-68f79ad280e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:13.611039 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-28164158-156b-492d-afe9-68f79ad280e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044730 May 19 05:40:13.611613 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3519/6949] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:13 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:14.623262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-16eb8f3f-7280-4b28-9fe7-d295c6267365 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:14.624205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-16eb8f3f-7280-4b28-9fe7-d295c6267365 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:14.631255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16eb8f3f-7280-4b28-9fe7-d295c6267365 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:14.631711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16eb8f3f-7280-4b28-9fe7-d295c6267365 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:14.632488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16eb8f3f-7280-4b28-9fe7-d295c6267365 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:14.632941 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-16eb8f3f-7280-4b28-9fe7-d295c6267365 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:14.663412 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-16eb8f3f-7280-4b28-9fe7-d295c6267365 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 May 19 05:40:14.663978 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3431/6950] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:14 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:15.675116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48bae96e-eb90-4b46-bfb9-9456a6f3aab8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:15.676096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48bae96e-eb90-4b46-bfb9-9456a6f3aab8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:15.683130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48bae96e-eb90-4b46-bfb9-9456a6f3aab8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:15.683604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48bae96e-eb90-4b46-bfb9-9456a6f3aab8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:15.684395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48bae96e-eb90-4b46-bfb9-9456a6f3aab8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:15.684854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48bae96e-eb90-4b46-bfb9-9456a6f3aab8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:15.715843 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48bae96e-eb90-4b46-bfb9-9456a6f3aab8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 May 19 05:40:15.716423 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3520/6951] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:15 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:16.727480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90d85830-139b-40a5-8a05-d4b7d5d7390a tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:16.728399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-90d85830-139b-40a5-8a05-d4b7d5d7390a tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:16.735328 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90d85830-139b-40a5-8a05-d4b7d5d7390a tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:16.735777 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90d85830-139b-40a5-8a05-d4b7d5d7390a tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:16.736528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90d85830-139b-40a5-8a05-d4b7d5d7390a tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:16.736963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90d85830-139b-40a5-8a05-d4b7d5d7390a tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:16.769267 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-90d85830-139b-40a5-8a05-d4b7d5d7390a tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 May 19 05:40:16.769774 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3432/6952] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:16 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:17.782268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6352ca75-4eb0-48b5-a484-b956588b035f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:17.783600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6352ca75-4eb0-48b5-a484-b956588b035f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:17.792022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6352ca75-4eb0-48b5-a484-b956588b035f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:17.792493 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6352ca75-4eb0-48b5-a484-b956588b035f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:17.793466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6352ca75-4eb0-48b5-a484-b956588b035f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:17.793925 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6352ca75-4eb0-48b5-a484-b956588b035f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:17.830109 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6352ca75-4eb0-48b5-a484-b956588b035f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051971 May 19 05:40:17.834793 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3521/6953] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:17 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:18.846069 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c782f41-fba8-4c66-95b9-282cebff9168 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:18.847378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c782f41-fba8-4c66-95b9-282cebff9168 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:18.857252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c782f41-fba8-4c66-95b9-282cebff9168 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:18.857826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c782f41-fba8-4c66-95b9-282cebff9168 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:18.859010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c782f41-fba8-4c66-95b9-282cebff9168 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:18.859484 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c782f41-fba8-4c66-95b9-282cebff9168 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:18.891031 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c782f41-fba8-4c66-95b9-282cebff9168 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052694 May 19 05:40:18.891605 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3433/6954] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:18 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 05:40:18.901691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:18.902291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:18.909522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:18.909984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:18.910854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:18.911377 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:18.991257 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] HTTP exception thrown: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 is not attached to volume 83adecd5-6516-4e18-9f3e-071ebe193794 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Request method failure captured: May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: request: DELETE /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments/83adecd5-6516-4e18-9f3e-071ebe193794 HTTP/1.1 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdgUo98Kixr4x8y50fvLP0WyiER6UScbZX-Y-I_tkHVkvQyd8qbXRAg9YbpYyW8gxycbLnPdXjdrGNnMcciIF6GaHz3pyhCnmY6_FVOtuteKNSliHhVX63RpD0XfCmXGN6yx8FyEqn9OUqCo0PvGx6tS7rkHpijDTXqA1r8gFVo3N-g May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 9eca356c40784cf896dc7b80ba55c8e9 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 9eca356c40784cf896dc7b80ba55c8e9 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestEncryptedCinderVolumes-833542041-project May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: c033828357c5423dbc968dab9f4c4a8f May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestEncryptedCinderVolumes-833542041-project May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 is not attached to volume 83adecd5-6516-4e18-9f3e-071ebe193794 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'server_id': 'b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3', 'id': '83adecd5-6516-4e18-9f3e-071ebe193794'} May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 83adecd5-6516-4e18-9f3e-071ebe193794. May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 is not attached to volume 83adecd5-6516-4e18-9f3e-071ebe193794 May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:40:18.996532 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:40:19.001704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:40:19.001704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:40:19.001704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 is not attached to volume 83adecd5-6516-4e18-9f3e-071ebe193794 May 19 05:40:19.001704 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:19.001704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Returning 404 to user: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 is not attached to volume 83adecd5-6516-4e18-9f3e-071ebe193794 {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:40:19.001704 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-92c48471-a77c-4db9-bb61-0f1e86b015eb tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments/83adecd5-6516-4e18-9f3e-071ebe193794" status: 404 len: 154 microversion: 2.1 time: 0.100608 May 19 05:40:19.001704 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3522/6955] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:40:18 2022] DELETE /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3/os-volume_attachments/83adecd5-6516-4e18-9f3e-071ebe193794 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:40:24.479650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff0e987a-16b3-4141-9afd-cb2a132df1e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:24.480181 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff0e987a-16b3-4141-9afd-cb2a132df1e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:24.486312 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff0e987a-16b3-4141-9afd-cb2a132df1e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:24.486773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff0e987a-16b3-4141-9afd-cb2a132df1e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:24.487544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff0e987a-16b3-4141-9afd-cb2a132df1e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:24.487990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff0e987a-16b3-4141-9afd-cb2a132df1e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:24.513176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff0e987a-16b3-4141-9afd-cb2a132df1e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:40:24.594595 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff0e987a-16b3-4141-9afd-cb2a132df1e6 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 204 len: 0 microversion: 2.1 time: 0.118689 May 19 05:40:24.595750 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3434/6956] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:40:24 2022] DELETE /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 05:40:24.608381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1e11ef4a-b5b6-4495-92c1-73e930d20a17 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:24.609017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1e11ef4a-b5b6-4495-92c1-73e930d20a17 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:24.615764 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e11ef4a-b5b6-4495-92c1-73e930d20a17 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:24.616237 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e11ef4a-b5b6-4495-92c1-73e930d20a17 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:24.617028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e11ef4a-b5b6-4495-92c1-73e930d20a17 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:24.617528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1e11ef4a-b5b6-4495-92c1-73e930d20a17 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:24.748737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1e11ef4a-b5b6-4495-92c1-73e930d20a17 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:24.756519 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1e11ef4a-b5b6-4495-92c1-73e930d20a17 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1559 microversion: 2.1 time: 0.156253 May 19 05:40:24.757151 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3523/6957] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:24 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:25.774578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b056e23d-6286-42b1-a7e5-2c71f45b201c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:25.775435 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b056e23d-6286-42b1-a7e5-2c71f45b201c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:25.785046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b056e23d-6286-42b1-a7e5-2c71f45b201c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:25.788713 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b056e23d-6286-42b1-a7e5-2c71f45b201c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:25.789642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b056e23d-6286-42b1-a7e5-2c71f45b201c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:25.790300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b056e23d-6286-42b1-a7e5-2c71f45b201c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:25.936765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b056e23d-6286-42b1-a7e5-2c71f45b201c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:25.944608 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b056e23d-6286-42b1-a7e5-2c71f45b201c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1559 microversion: 2.1 time: 0.174604 May 19 05:40:25.945211 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3435/6958] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:25 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:26.773348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-42fbef44-4f60-422b-9050-fce67d022c0d req-1119a47f-06e4-45df-b158-bb104c3e6001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3", "name": "network-vif-deleted", "tag": "d4827510-0b02-4be0-88fb-c8ba64491d9a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:40:26.784285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-42fbef44-4f60-422b-9050-fce67d022c0d req-1119a47f-06e4-45df-b158-bb104c3e6001 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:26.784744 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-42fbef44-4f60-422b-9050-fce67d022c0d req-1119a47f-06e4-45df-b158-bb104c3e6001 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:26.797872 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-42fbef44-4f60-422b-9050-fce67d022c0d req-1119a47f-06e4-45df-b158-bb104c3e6001 service nova] Creating event network-vif-deleted:d4827510-0b02-4be0-88fb-c8ba64491d9a for instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 on n-h1-766726-30 May 19 05:40:26.803992 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-42fbef44-4f60-422b-9050-fce67d022c0d req-1119a47f-06e4-45df-b158-bb104c3e6001 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034439 May 19 05:40:26.804604 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3524/6959] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:26.962839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:26.963425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:26.971353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:26.971759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:26.972525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:26.972965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:27.002802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:27.003250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:27.003700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lazy-loading 'fault' on Instance uuid b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:40:27.045453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:27.053457 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6004d134-8e6b-40b7-8caf-f1c5750c9247 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 200 len: 1351 microversion: 2.1 time: 0.094577 May 19 05:40:27.054058 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3436/6960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:26 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:28.070956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:28.071644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:28.078682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:28.079153 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:28.079924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:28.080369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:28.093929 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] HTTP exception thrown: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 could not be found. May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Request method failure captured: May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 HTTP/1.1 May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdgUo98Kixr4x8y50fvLP0WyiER6UScbZX-Y-I_tkHVkvQyd8qbXRAg9YbpYyW8gxycbLnPdXjdrGNnMcciIF6GaHz3pyhCnmY6_FVOtuteKNSliHhVX63RpD0XfCmXGN6yx8FyEqn9OUqCo0PvGx6tS7rkHpijDTXqA1r8gFVo3N-g May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: 9eca356c40784cf896dc7b80ba55c8e9 May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: 9eca356c40784cf896dc7b80ba55c8e9 May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestEncryptedCinderVolumes-833542041-project May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: c033828357c5423dbc968dab9f4c4a8f May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestEncryptedCinderVolumes-833542041-project May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 could not be found. May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': 'b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3'} May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 could not be found. May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 could not be found. May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:40:28.095797 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 could not be found. May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Returning 404 to user: Instance b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-817dcd0e-8928-4bee-be92-a19f65a1d122 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3" status: 404 len: 111 microversion: 2.1 time: 0.030612 May 19 05:40:28.101433 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3525/6961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:28 2022] GET /compute/v2.1/servers/b0ed6daa-1c0c-4c52-a3d6-a09e65c6cbc3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:40:28.106458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e5b8b90-5b23-4800-b61a-7f44b1279521 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '.version_select at 0x7fd314403700>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:28.125125 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e5b8b90-5b23-4800-b61a-7f44b1279521 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-860637871" status: 202 len: 0 microversion: 2.1 time: 0.022987 May 19 05:40:28.125736 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3437/6962] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 05:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-860637871 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:40:28.144972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ff47047c-b6cb-4bc2-8879-f04252d897c5 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Action: 'create', calling method: .version_select at 0x7fd315665310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-931944008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLnJOIsN6B4Cckd0meWjWE5zhPkI+DsBvXxdURpJa8/D9A4MQfu28O384bKUmA0kzNzPNxjzZ8zMo6zYVT02+YHTVlmOxT9LN2VFGkgjq+jf5WBKWLzuSOeY9sVjQqymA=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:40:28.159862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ff47047c-b6cb-4bc2-8879-f04252d897c5 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Getting quotas for project 9eca356c40784cf896dc7b80ba55c8e9. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:40:28.165167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-ff47047c-b6cb-4bc2-8879-f04252d897c5 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Getting quotas for user c033828357c5423dbc968dab9f4c4a8f and project 9eca356c40784cf896dc7b80ba55c8e9. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:40:28.188653 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ff47047c-b6cb-4bc2-8879-f04252d897c5 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.047570 May 19 05:40:28.189284 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3526/6963] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:40:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:28.237466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1764933941", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-931944008", "networks": [{"uuid": "ca51b03e-e520-4a24-9ee3-c60285801aae"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:40:28.291153 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] validate_networks() for [('ca51b03e-e520-4a24-9ee3-c60285801aae', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:40:28.653202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:40:28.653636 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:40:28.654116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:40:28.654531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:40:28.654975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:40:28.663858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:28.664310 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:28.665140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:28.665582 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:28.681955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Getting quotas for project 9eca356c40784cf896dc7b80ba55c8e9. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:40:28.688015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Getting quotas for user c033828357c5423dbc968dab9f4c4a8f and project 9eca356c40784cf896dc7b80ba55c8e9. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:40:28.702302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:40:28.704609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:40:28.751542 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-abcfc43d-26dc-4553-814c-c466273703be tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518016 May 19 05:40:28.752196 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3438/6964] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:40:28.762787 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-40ff58e2-a458-4eb1-854e-78ed8cd521a1 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:28.763411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-40ff58e2-a458-4eb1-854e-78ed8cd521a1 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:28.819579 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-40ff58e2-a458-4eb1-854e-78ed8cd521a1 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:28.828351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-40ff58e2-a458-4eb1-854e-78ed8cd521a1 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1262 microversion: 2.1 time: 0.069980 May 19 05:40:28.828930 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3527/6965] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:28 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:29.848175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fed33997-8cc0-46ad-8a35-cc7c000b2c6d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:29.848893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fed33997-8cc0-46ad-8a35-cc7c000b2c6d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:29.856234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fed33997-8cc0-46ad-8a35-cc7c000b2c6d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:29.856806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fed33997-8cc0-46ad-8a35-cc7c000b2c6d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:29.857718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fed33997-8cc0-46ad-8a35-cc7c000b2c6d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:29.858249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fed33997-8cc0-46ad-8a35-cc7c000b2c6d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:29.933493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fed33997-8cc0-46ad-8a35-cc7c000b2c6d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:29.940958 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fed33997-8cc0-46ad-8a35-cc7c000b2c6d tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1320 microversion: 2.1 time: 0.098189 May 19 05:40:29.941594 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3439/6966] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:29 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1320 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:30.960115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ccd6d57-12c7-4eab-8ef5-5482d8db6ff4 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:30.962031 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6ccd6d57-12c7-4eab-8ef5-5482d8db6ff4 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:30.973618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ccd6d57-12c7-4eab-8ef5-5482d8db6ff4 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:30.974146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ccd6d57-12c7-4eab-8ef5-5482d8db6ff4 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:30.974902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ccd6d57-12c7-4eab-8ef5-5482d8db6ff4 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:30.975361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ccd6d57-12c7-4eab-8ef5-5482d8db6ff4 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:31.192803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6ccd6d57-12c7-4eab-8ef5-5482d8db6ff4 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:31.202315 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ccd6d57-12c7-4eab-8ef5-5482d8db6ff4 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1362 microversion: 2.1 time: 0.247624 May 19 05:40:31.202909 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3528/6967] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:30 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:31.293553 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-cc40c5a0-5a13-4b43-88e3-43f8c8ee1116 req-17e0e651-b2c3-458a-a13c-3e921aee81b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16669c73-2030-4dd0-9f9e-720670fc62ad", "tag": "a621db62-1863-411a-81f9-7601c0b587ab"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:40:31.302842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cc40c5a0-5a13-4b43-88e3-43f8c8ee1116 req-17e0e651-b2c3-458a-a13c-3e921aee81b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:31.303646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cc40c5a0-5a13-4b43-88e3-43f8c8ee1116 req-17e0e651-b2c3-458a-a13c-3e921aee81b7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:31.320643 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cc40c5a0-5a13-4b43-88e3-43f8c8ee1116 req-17e0e651-b2c3-458a-a13c-3e921aee81b7 service nova] Creating event network-changed:a621db62-1863-411a-81f9-7601c0b587ab for instance 16669c73-2030-4dd0-9f9e-720670fc62ad on n-h2-766726-30 May 19 05:40:31.331518 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-cc40c5a0-5a13-4b43-88e3-43f8c8ee1116 req-17e0e651-b2c3-458a-a13c-3e921aee81b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120380 May 19 05:40:31.332062 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3440/6968] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:32.219878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-65a2056e-7b86-41e9-a5c3-5edea3acfdc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:32.220515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-65a2056e-7b86-41e9-a5c3-5edea3acfdc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:32.227450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65a2056e-7b86-41e9-a5c3-5edea3acfdc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:32.227908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65a2056e-7b86-41e9-a5c3-5edea3acfdc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:32.228673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65a2056e-7b86-41e9-a5c3-5edea3acfdc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:32.229150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-65a2056e-7b86-41e9-a5c3-5edea3acfdc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:32.360889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-65a2056e-7b86-41e9-a5c3-5edea3acfdc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:32.368305 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-65a2056e-7b86-41e9-a5c3-5edea3acfdc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1362 microversion: 2.1 time: 0.152623 May 19 05:40:32.368881 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3529/6969] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:32 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:33.387480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3e61b5ef-d31d-4a80-a52c-65529c920263 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:33.388192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3e61b5ef-d31d-4a80-a52c-65529c920263 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:33.394879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e61b5ef-d31d-4a80-a52c-65529c920263 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:33.395343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e61b5ef-d31d-4a80-a52c-65529c920263 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:33.396148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e61b5ef-d31d-4a80-a52c-65529c920263 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:33.396587 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3e61b5ef-d31d-4a80-a52c-65529c920263 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:33.528333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3e61b5ef-d31d-4a80-a52c-65529c920263 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:33.536180 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3e61b5ef-d31d-4a80-a52c-65529c920263 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1362 microversion: 2.1 time: 0.154872 May 19 05:40:33.536875 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3441/6970] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:33 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:34.554006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9b628cbd-9c6b-46f7-ae93-d4a062157be7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:34.554631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9b628cbd-9c6b-46f7-ae93-d4a062157be7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:34.562739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b628cbd-9c6b-46f7-ae93-d4a062157be7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:34.563206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b628cbd-9c6b-46f7-ae93-d4a062157be7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:34.564089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b628cbd-9c6b-46f7-ae93-d4a062157be7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:34.564541 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9b628cbd-9c6b-46f7-ae93-d4a062157be7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:34.695367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9b628cbd-9c6b-46f7-ae93-d4a062157be7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:34.703289 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9b628cbd-9c6b-46f7-ae93-d4a062157be7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1362 microversion: 2.1 time: 0.153364 May 19 05:40:34.703860 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3530/6971] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:34 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:35.720443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-31c22029-ffe3-42ae-b70b-782bd1c64fcc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:35.721065 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-31c22029-ffe3-42ae-b70b-782bd1c64fcc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:35.728456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31c22029-ffe3-42ae-b70b-782bd1c64fcc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:35.728917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31c22029-ffe3-42ae-b70b-782bd1c64fcc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:35.730304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31c22029-ffe3-42ae-b70b-782bd1c64fcc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:35.730748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-31c22029-ffe3-42ae-b70b-782bd1c64fcc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:35.863803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-31c22029-ffe3-42ae-b70b-782bd1c64fcc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:35.871954 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-31c22029-ffe3-42ae-b70b-782bd1c64fcc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1362 microversion: 2.1 time: 0.155780 May 19 05:40:35.872566 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3442/6972] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:35 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:36.889613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d7b18f52-7142-41ab-8605-19af81468833 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:36.890250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d7b18f52-7142-41ab-8605-19af81468833 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:36.897365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7b18f52-7142-41ab-8605-19af81468833 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:36.897838 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7b18f52-7142-41ab-8605-19af81468833 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:36.898627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7b18f52-7142-41ab-8605-19af81468833 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:36.899086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d7b18f52-7142-41ab-8605-19af81468833 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:37.028049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d7b18f52-7142-41ab-8605-19af81468833 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:37.035626 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d7b18f52-7142-41ab-8605-19af81468833 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1362 microversion: 2.1 time: 0.150583 May 19 05:40:37.036222 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3531/6973] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:36 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:37.331804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5147f752-8002-4e02-953d-dc199a1ebf4b req-b2f93f02-6839-4546-bcf9-f5f5b2dd6f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16669c73-2030-4dd0-9f9e-720670fc62ad", "name": "network-vif-plugged", "status": "completed", "tag": "a621db62-1863-411a-81f9-7601c0b587ab"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:40:37.342877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5147f752-8002-4e02-953d-dc199a1ebf4b req-b2f93f02-6839-4546-bcf9-f5f5b2dd6f23 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:37.343666 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5147f752-8002-4e02-953d-dc199a1ebf4b req-b2f93f02-6839-4546-bcf9-f5f5b2dd6f23 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:37.355616 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5147f752-8002-4e02-953d-dc199a1ebf4b req-b2f93f02-6839-4546-bcf9-f5f5b2dd6f23 service nova] Creating event network-vif-plugged:a621db62-1863-411a-81f9-7601c0b587ab for instance 16669c73-2030-4dd0-9f9e-720670fc62ad on n-h2-766726-30 May 19 05:40:37.360775 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5147f752-8002-4e02-953d-dc199a1ebf4b req-b2f93f02-6839-4546-bcf9-f5f5b2dd6f23 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 May 19 05:40:37.361596 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3443/6974] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:38.052480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c96049cc-e9e4-4f3a-bc56-2a0fbdcbf076 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:38.053095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c96049cc-e9e4-4f3a-bc56-2a0fbdcbf076 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:38.060913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c96049cc-e9e4-4f3a-bc56-2a0fbdcbf076 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:38.061402 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c96049cc-e9e4-4f3a-bc56-2a0fbdcbf076 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:38.062179 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c96049cc-e9e4-4f3a-bc56-2a0fbdcbf076 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:38.062626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c96049cc-e9e4-4f3a-bc56-2a0fbdcbf076 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:38.190201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c96049cc-e9e4-4f3a-bc56-2a0fbdcbf076 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:38.197776 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c96049cc-e9e4-4f3a-bc56-2a0fbdcbf076 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1362 microversion: 2.1 time: 0.149302 May 19 05:40:38.198388 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3532/6975] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:38 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:39.212698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:39.213518 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:39.218860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4f1f91d-a260-4493-915b-e35d54bf5fd9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:39.219886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f4f1f91d-a260-4493-915b-e35d54bf5fd9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:39.222127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:39.230239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4f1f91d-a260-4493-915b-e35d54bf5fd9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:39.230686 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4f1f91d-a260-4493-915b-e35d54bf5fd9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:39.231474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4f1f91d-a260-4493-915b-e35d54bf5fd9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:39.231907 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4f1f91d-a260-4493-915b-e35d54bf5fd9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:39.234976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:39.365609 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4f1f91d-a260-4493-915b-e35d54bf5fd9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:39.373470 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4f1f91d-a260-4493-915b-e35d54bf5fd9 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1554 microversion: 2.1 time: 0.162513 May 19 05:40:39.374049 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3444/6976] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:39 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:39.389336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-847aebe9-1820-4917-95ae-f9c047083c46 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:39.389969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-847aebe9-1820-4917-95ae-f9c047083c46 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:39.391997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:39.393843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:39.400276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-847aebe9-1820-4917-95ae-f9c047083c46 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:39.400871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-847aebe9-1820-4917-95ae-f9c047083c46 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:39.402193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-847aebe9-1820-4917-95ae-f9c047083c46 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:39.402654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-847aebe9-1820-4917-95ae-f9c047083c46 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:39.405756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=77 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:39.533682 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-847aebe9-1820-4917-95ae-f9c047083c46 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:40:39.541161 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-847aebe9-1820-4917-95ae-f9c047083c46 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1554 microversion: 2.1 time: 0.155764 May 19 05:40:39.541748 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3533/6977] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:40:39 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:40:42.051304 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf4bcf1c-beb9-485c-8b9e-d59e18cc3360 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cea649b1-be3f-4cc0-b07a-c3a33176e792"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:40:42.052307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf4bcf1c-beb9-485c-8b9e-d59e18cc3360 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:42.059434 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf4bcf1c-beb9-485c-8b9e-d59e18cc3360 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:42.059885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf4bcf1c-beb9-485c-8b9e-d59e18cc3360 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:42.060640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf4bcf1c-beb9-485c-8b9e-d59e18cc3360 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:42.061097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf4bcf1c-beb9-485c-8b9e-d59e18cc3360 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:42.295533 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf4bcf1c-beb9-485c-8b9e-d59e18cc3360 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "POST /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248096 May 19 05:40:42.296168 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3445/6978] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 05:40:42 2022] POST /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:40:58.217930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-02163650-16d2-4069-99eb-8201b6bd336c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:58.218469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-02163650-16d2-4069-99eb-8201b6bd336c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:58.220781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:58.221599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=5 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:58.227337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02163650-16d2-4069-99eb-8201b6bd336c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:58.227805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02163650-16d2-4069-99eb-8201b6bd336c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:58.228582 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02163650-16d2-4069-99eb-8201b6bd336c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:58.229037 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-02163650-16d2-4069-99eb-8201b6bd336c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:58.312912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-02163650-16d2-4069-99eb-8201b6bd336c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lazy-loading 'services' on Instance uuid 16669c73-2030-4dd0-9f9e-720670fc62ad {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:40:58.384795 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-02163650-16d2-4069-99eb-8201b6bd336c tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "DELETE /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments/cea649b1-be3f-4cc0-b07a-c3a33176e792" status: 202 len: 0 microversion: 2.1 time: 0.171019 May 19 05:40:58.385420 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3534/6979] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:40:58 2022] DELETE /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments/cea649b1-be3f-4cc0-b07a-c3a33176e792 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:40:58.394526 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cb227d18-1d84-4349-8c53-5e2d552be933 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:58.395695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cb227d18-1d84-4349-8c53-5e2d552be933 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:58.399617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:58.400462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:40:58.405421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cb227d18-1d84-4349-8c53-5e2d552be933 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:58.406100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cb227d18-1d84-4349-8c53-5e2d552be933 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:58.406925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cb227d18-1d84-4349-8c53-5e2d552be933 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:58.407330 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cb227d18-1d84-4349-8c53-5e2d552be933 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:58.439633 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cb227d18-1d84-4349-8c53-5e2d552be933 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049532 May 19 05:40:58.440410 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3446/6980] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:58 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:40:59.452696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a05863d0-cc91-49a9-9089-4489a7acf313 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:40:59.453743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a05863d0-cc91-49a9-9089-4489a7acf313 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:40:59.462000 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a05863d0-cc91-49a9-9089-4489a7acf313 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:59.462461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a05863d0-cc91-49a9-9089-4489a7acf313 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:59.463245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a05863d0-cc91-49a9-9089-4489a7acf313 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:40:59.463692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a05863d0-cc91-49a9-9089-4489a7acf313 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:40:59.498161 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a05863d0-cc91-49a9-9089-4489a7acf313 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050118 May 19 05:40:59.498386 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3535/6981] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:40:59 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:00.510147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-237f3cb3-9bd8-4ae5-b232-8493e56b7c24 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:00.511627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-237f3cb3-9bd8-4ae5-b232-8493e56b7c24 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:00.519187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-237f3cb3-9bd8-4ae5-b232-8493e56b7c24 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:00.519648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-237f3cb3-9bd8-4ae5-b232-8493e56b7c24 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:00.520448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-237f3cb3-9bd8-4ae5-b232-8493e56b7c24 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:00.520893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-237f3cb3-9bd8-4ae5-b232-8493e56b7c24 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:00.553199 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-237f3cb3-9bd8-4ae5-b232-8493e56b7c24 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047090 May 19 05:41:00.553808 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3447/6982] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:41:00 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:41:01.564673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f7651b21-b9ee-496c-b101-26cb8d8b1c74 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:01.565686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f7651b21-b9ee-496c-b101-26cb8d8b1c74 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:01.572718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7651b21-b9ee-496c-b101-26cb8d8b1c74 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:01.573222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7651b21-b9ee-496c-b101-26cb8d8b1c74 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:01.574004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7651b21-b9ee-496c-b101-26cb8d8b1c74 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:01.574454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f7651b21-b9ee-496c-b101-26cb8d8b1c74 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:01.604338 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f7651b21-b9ee-496c-b101-26cb8d8b1c74 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 May 19 05:41:01.605504 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3536/6983] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:41:01 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:02.616171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-231640ed-734a-404f-9c36-fbe457120a64 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:02.617138 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-231640ed-734a-404f-9c36-fbe457120a64 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:02.624682 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-231640ed-734a-404f-9c36-fbe457120a64 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:02.625172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-231640ed-734a-404f-9c36-fbe457120a64 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:02.625951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-231640ed-734a-404f-9c36-fbe457120a64 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:02.626397 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-231640ed-734a-404f-9c36-fbe457120a64 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:02.659616 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-231640ed-734a-404f-9c36-fbe457120a64 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047428 May 19 05:41:02.660122 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3448/6984] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:41:02 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:03.671307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8c520bf6-6fda-4024-9603-80ad3620cd05 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:03.672258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8c520bf6-6fda-4024-9603-80ad3620cd05 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:03.679155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c520bf6-6fda-4024-9603-80ad3620cd05 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:03.679618 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c520bf6-6fda-4024-9603-80ad3620cd05 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:03.680443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c520bf6-6fda-4024-9603-80ad3620cd05 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:03.680900 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8c520bf6-6fda-4024-9603-80ad3620cd05 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:03.712161 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8c520bf6-6fda-4024-9603-80ad3620cd05 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 May 19 05:41:03.712723 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3537/6985] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:41:03 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:04.724420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-23831e7d-7fa8-4a65-b70f-cc3bbbf9938f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:04.725380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-23831e7d-7fa8-4a65-b70f-cc3bbbf9938f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:04.733049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23831e7d-7fa8-4a65-b70f-cc3bbbf9938f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:04.733508 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23831e7d-7fa8-4a65-b70f-cc3bbbf9938f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:04.734283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23831e7d-7fa8-4a65-b70f-cc3bbbf9938f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:04.734727 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-23831e7d-7fa8-4a65-b70f-cc3bbbf9938f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:04.764212 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-23831e7d-7fa8-4a65-b70f-cc3bbbf9938f tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 May 19 05:41:04.764787 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3449/6986] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:41:04 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:05.775968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-18935d37-a776-4931-ae92-a3b0e87e3397 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:05.776994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-18935d37-a776-4931-ae92-a3b0e87e3397 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:05.784498 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18935d37-a776-4931-ae92-a3b0e87e3397 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:05.784980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18935d37-a776-4931-ae92-a3b0e87e3397 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:05.785835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18935d37-a776-4931-ae92-a3b0e87e3397 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:05.786293 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-18935d37-a776-4931-ae92-a3b0e87e3397 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:05.820902 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-18935d37-a776-4931-ae92-a3b0e87e3397 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048906 May 19 05:41:05.821535 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3538/6987] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:41:05 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:06.832221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-aa37e4f5-1cb3-45a8-ac11-f3296ffc0420 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:06.833192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-aa37e4f5-1cb3-45a8-ac11-f3296ffc0420 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:06.840160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa37e4f5-1cb3-45a8-ac11-f3296ffc0420 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:06.840612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa37e4f5-1cb3-45a8-ac11-f3296ffc0420 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:06.841436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa37e4f5-1cb3-45a8-ac11-f3296ffc0420 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:06.841874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-aa37e4f5-1cb3-45a8-ac11-f3296ffc0420 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:06.871340 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-aa37e4f5-1cb3-45a8-ac11-f3296ffc0420 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043241 May 19 05:41:06.872111 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3450/6988] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:41:06 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:07.882325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d772dc01-92b0-4448-bbee-e6166ccadaa8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:07.883280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d772dc01-92b0-4448-bbee-e6166ccadaa8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:07.890267 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d772dc01-92b0-4448-bbee-e6166ccadaa8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:07.890739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d772dc01-92b0-4448-bbee-e6166ccadaa8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:07.891521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d772dc01-92b0-4448-bbee-e6166ccadaa8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:07.891993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d772dc01-92b0-4448-bbee-e6166ccadaa8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:07.921490 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d772dc01-92b0-4448-bbee-e6166ccadaa8 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043234 May 19 05:41:07.922057 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3539/6989] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:41:07 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 05:41:07.932010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:07.932729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:07.939772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:07.940163 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:07.940936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:07.941416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:08.017843 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] HTTP exception thrown: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad is not attached to volume cea649b1-be3f-4cc0-b07a-c3a33176e792 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Request method failure captured: May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments/cea649b1-be3f-4cc0-b07a-c3a33176e792 HTTP/1.1 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdgUo98Kixr4x8y50fvLP0WyiER6UScbZX-Y-I_tkHVkvQyd8qbXRAg9YbpYyW8gxycbLnPdXjdrGNnMcciIF6GaHz3pyhCnmY6_FVOtuteKNSliHhVX63RpD0XfCmXGN6yx8FyEqn9OUqCo0PvGx6tS7rkHpijDTXqA1r8gFVo3N-g May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 9eca356c40784cf896dc7b80ba55c8e9 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 9eca356c40784cf896dc7b80ba55c8e9 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestEncryptedCinderVolumes-833542041-project May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c033828357c5423dbc968dab9f4c4a8f May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestEncryptedCinderVolumes-833542041-project May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad is not attached to volume cea649b1-be3f-4cc0-b07a-c3a33176e792 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'server_id': '16669c73-2030-4dd0-9f9e-720670fc62ad', 'id': 'cea649b1-be3f-4cc0-b07a-c3a33176e792'} May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cea649b1-be3f-4cc0-b07a-c3a33176e792. May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad is not attached to volume cea649b1-be3f-4cc0-b07a-c3a33176e792 May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:41:08.019781 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:41:08.024964 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:41:08.024964 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:41:08.024964 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad is not attached to volume cea649b1-be3f-4cc0-b07a-c3a33176e792 May 19 05:41:08.024964 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:08.024964 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Returning 404 to user: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad is not attached to volume cea649b1-be3f-4cc0-b07a-c3a33176e792 {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:41:08.024964 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4da45ee6-9c16-4110-8c7e-f80ac54b8575 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "DELETE /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments/cea649b1-be3f-4cc0-b07a-c3a33176e792" status: 404 len: 154 microversion: 2.1 time: 0.093337 May 19 05:41:08.024964 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3451/6990] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:41:07 2022] DELETE /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad/os-volume_attachments/cea649b1-be3f-4cc0-b07a-c3a33176e792 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:41:13.445138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3786411a-1b7e-4f7f-b304-9ec863d4bd58 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:13.445707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3786411a-1b7e-4f7f-b304-9ec863d4bd58 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:13.452840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3786411a-1b7e-4f7f-b304-9ec863d4bd58 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:13.453351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3786411a-1b7e-4f7f-b304-9ec863d4bd58 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:13.454148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3786411a-1b7e-4f7f-b304-9ec863d4bd58 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:13.454607 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3786411a-1b7e-4f7f-b304-9ec863d4bd58 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:13.479926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3786411a-1b7e-4f7f-b304-9ec863d4bd58 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:41:13.558794 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3786411a-1b7e-4f7f-b304-9ec863d4bd58 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "DELETE /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 204 len: 0 microversion: 2.1 time: 0.117308 May 19 05:41:13.560099 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3540/6991] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:41:13 2022] DELETE /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:41:13.569047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b4d9da9e-6d42-4218-86ce-ce83b3044bc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:13.569733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b4d9da9e-6d42-4218-86ce-ce83b3044bc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:13.577044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b4d9da9e-6d42-4218-86ce-ce83b3044bc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:13.577525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b4d9da9e-6d42-4218-86ce-ce83b3044bc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:13.578324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b4d9da9e-6d42-4218-86ce-ce83b3044bc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:13.578758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b4d9da9e-6d42-4218-86ce-ce83b3044bc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:13.707348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b4d9da9e-6d42-4218-86ce-ce83b3044bc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:13.715253 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b4d9da9e-6d42-4218-86ce-ce83b3044bc3 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1560 microversion: 2.1 time: 0.150548 May 19 05:41:13.716370 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3452/6992] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:13 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:14.734505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-00be6886-ec61-434a-86d5-8f949f2c3760 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:14.735139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-00be6886-ec61-434a-86d5-8f949f2c3760 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:14.742055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00be6886-ec61-434a-86d5-8f949f2c3760 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:14.742519 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00be6886-ec61-434a-86d5-8f949f2c3760 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:14.743295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00be6886-ec61-434a-86d5-8f949f2c3760 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:14.743767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-00be6886-ec61-434a-86d5-8f949f2c3760 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:14.877340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-00be6886-ec61-434a-86d5-8f949f2c3760 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:14.884980 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-00be6886-ec61-434a-86d5-8f949f2c3760 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1560 microversion: 2.1 time: 0.155057 May 19 05:41:14.885675 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3541/6993] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:14 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:15.559272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bfd58311-f325-43d7-b94c-f943d13e344d req-e7686cc4-9583-4f73-ab0d-ba634cde05f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16669c73-2030-4dd0-9f9e-720670fc62ad", "name": "network-vif-deleted", "tag": "a621db62-1863-411a-81f9-7601c0b587ab"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:41:15.568613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bfd58311-f325-43d7-b94c-f943d13e344d req-e7686cc4-9583-4f73-ab0d-ba634cde05f6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:15.569099 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bfd58311-f325-43d7-b94c-f943d13e344d req-e7686cc4-9583-4f73-ab0d-ba634cde05f6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:15.581105 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bfd58311-f325-43d7-b94c-f943d13e344d req-e7686cc4-9583-4f73-ab0d-ba634cde05f6 service nova] Creating event network-vif-deleted:a621db62-1863-411a-81f9-7601c0b587ab for instance 16669c73-2030-4dd0-9f9e-720670fc62ad on n-h2-766726-30 May 19 05:41:15.586070 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bfd58311-f325-43d7-b94c-f943d13e344d req-e7686cc4-9583-4f73-ab0d-ba634cde05f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031084 May 19 05:41:15.586689 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3453/6994] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:15.904163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:15.905480 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:15.914090 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:15.914866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:15.915677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:15.916132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:15.951648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:15.952294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:15.952880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lazy-loading 'fault' on Instance uuid 16669c73-2030-4dd0-9f9e-720670fc62ad {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:41:16.002574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c033828357c5423dbc968dab9f4c4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eca356c40784cf896dc7b80ba55c8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:16.010037 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2ab41c47-1eea-4941-8939-5c506137c0fc tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 200 len: 1352 microversion: 2.1 time: 0.110301 May 19 05:41:16.010713 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3542/6995] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:15 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:17.029506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:17.030206 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] [instance: 16669c73-2030-4dd0-9f9e-720670fc62ad] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:17.036743 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:17.037298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:17.037805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:17.038239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:17.052489 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] HTTP exception thrown: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad could not be found. May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Request method failure captured: May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad HTTP/1.1 May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdgUo98Kixr4x8y50fvLP0WyiER6UScbZX-Y-I_tkHVkvQyd8qbXRAg9YbpYyW8gxycbLnPdXjdrGNnMcciIF6GaHz3pyhCnmY6_FVOtuteKNSliHhVX63RpD0XfCmXGN6yx8FyEqn9OUqCo0PvGx6tS7rkHpijDTXqA1r8gFVo3N-g May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 9eca356c40784cf896dc7b80ba55c8e9 May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eca356c40784cf896dc7b80ba55c8e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 9eca356c40784cf896dc7b80ba55c8e9 May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-833542041 May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestEncryptedCinderVolumes-833542041-project May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: c033828357c5423dbc968dab9f4c4a8f May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestEncryptedCinderVolumes-833542041-project May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad could not be found. May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '16669c73-2030-4dd0-9f9e-720670fc62ad'} May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad could not be found. May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad could not be found. May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:41:17.054158 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad could not be found. May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Returning 404 to user: Instance 16669c73-2030-4dd0-9f9e-720670fc62ad could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1742b4e0-04f8-4384-ad65-caacd4abab97 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad" status: 404 len: 111 microversion: 2.1 time: 0.031758 May 19 05:41:17.058937 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3454/6996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:17 2022] GET /compute/v2.1/servers/16669c73-2030-4dd0-9f9e-720670fc62ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:41:17.064158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f4fe776b-92e0-4f27-b7a9-a32fd54f7fd7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] Calling method '.version_select at 0x7fd3154f9670>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:17.082502 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f4fe776b-92e0-4f27-b7a9-a32fd54f7fd7 tempest-TestEncryptedCinderVolumes-833542041 tempest-TestEncryptedCinderVolumes-833542041-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-931944008" status: 202 len: 0 microversion: 2.1 time: 0.022034 May 19 05:41:17.083083 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3543/6997] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 19 05:41:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-931944008 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:41:43.962868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6de4d32-1272-4f06-a436-eee0e4d70c2c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Action: 'create', calling method: .version_select at 0x7fd31436f940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-171439976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiEDe1lenTSIK0QY9B0Nz9iyyIdPwV/s76ee3B8mNQO/z8+2svGUuYxiJ8kCksA1WQvh9ijGTh1xWEzq8dQDaT/WJWca0OvYj/dpbGKPFfOd4F/lcDBdCD+5MIIb3lZkw=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:41:43.967865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=18 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:41:43.968525 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=46 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:41:43.981378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b6de4d32-1272-4f06-a436-eee0e4d70c2c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Getting quotas for project 37ac4f4608be4250be4d19c297e4d795. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:41:43.987470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-b6de4d32-1272-4f06-a436-eee0e4d70c2c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Getting quotas for user b69188bf4c224d7e9e6575815c189947 and project 37ac4f4608be4250be4d19c297e4d795. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:41:44.012356 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6de4d32-1272-4f06-a436-eee0e4d70c2c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052898 May 19 05:41:44.013823 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3455/6998] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:41:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:44.060099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:41:44.060868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:41:44.068902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1646119790", "imageRef": "e564aa6f-6703-4ccd-b69c-8703721f5a6e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-171439976", "networks": [{"uuid": "59ff3b92-2ca1-4c4f-8b04-d62ae8f5950e"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:41:44.120556 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] validate_networks() for [('59ff3b92-2ca1-4c4f-8b04-d62ae8f5950e', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:41:44.579398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:41:44.579839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:41:44.580332 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:41:44.580779 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:41:44.581236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:41:44.590599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:44.591064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:44.591876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:44.592330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:44.609712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Getting quotas for project 37ac4f4608be4250be4d19c297e4d795. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:41:44.614931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Getting quotas for user b69188bf4c224d7e9e6575815c189947 and project 37ac4f4608be4250be4d19c297e4d795. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:41:44.626979 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:41:44.629210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e564aa6f-6703-4ccd-b69c-8703721f5a6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:41:44.673824 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4be2d843-47cb-4dcd-a4e7-c3eb1297d22f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615636 May 19 05:41:44.674482 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3544/6999] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:41:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:41:44.684613 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa9f1de8-4391-43e2-8519-8ab2c86a4e51 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:44.685274 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa9f1de8-4391-43e2-8519-8ab2c86a4e51 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:44.741185 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fa9f1de8-4391-43e2-8519-8ab2c86a4e51 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:44.747969 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fa9f1de8-4391-43e2-8519-8ab2c86a4e51 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1258 microversion: 2.1 time: 0.067443 May 19 05:41:44.748569 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3456/7000] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:44 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:45.765659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2c415b37-20b9-4e36-ade7-027522c60309 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:45.767215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2c415b37-20b9-4e36-ade7-027522c60309 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:45.778121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c415b37-20b9-4e36-ade7-027522c60309 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:45.778664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c415b37-20b9-4e36-ade7-027522c60309 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:45.779588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c415b37-20b9-4e36-ade7-027522c60309 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:45.780111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2c415b37-20b9-4e36-ade7-027522c60309 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:45.851686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2c415b37-20b9-4e36-ade7-027522c60309 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:45.860134 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2c415b37-20b9-4e36-ade7-027522c60309 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1328 microversion: 2.1 time: 0.099685 May 19 05:41:45.860881 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3545/7001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:45 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:46.878600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-bb3bb219-807c-410f-bd9d-17eb7bc38da5 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:46.879152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-bb3bb219-807c-410f-bd9d-17eb7bc38da5 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:46.887773 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb3bb219-807c-410f-bd9d-17eb7bc38da5 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:46.888226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb3bb219-807c-410f-bd9d-17eb7bc38da5 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:46.889035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb3bb219-807c-410f-bd9d-17eb7bc38da5 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:46.889499 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-bb3bb219-807c-410f-bd9d-17eb7bc38da5 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:47.032642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-bb3bb219-807c-410f-bd9d-17eb7bc38da5 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:47.040898 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-bb3bb219-807c-410f-bd9d-17eb7bc38da5 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.166742 May 19 05:41:47.042126 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3457/7002] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:46 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:48.061252 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c96ae29b-c5c5-4d2f-a906-107c6ca0f0ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:48.062042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c96ae29b-c5c5-4d2f-a906-107c6ca0f0ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:48.069780 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c96ae29b-c5c5-4d2f-a906-107c6ca0f0ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:48.070251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c96ae29b-c5c5-4d2f-a906-107c6ca0f0ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:48.071083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c96ae29b-c5c5-4d2f-a906-107c6ca0f0ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:48.071765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c96ae29b-c5c5-4d2f-a906-107c6ca0f0ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:48.226429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c96ae29b-c5c5-4d2f-a906-107c6ca0f0ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:48.234526 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c96ae29b-c5c5-4d2f-a906-107c6ca0f0ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.178526 May 19 05:41:48.235523 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3546/7003] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:48 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:49.250917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a8c43471-a64c-400d-945e-f055d6b89534 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:49.251631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a8c43471-a64c-400d-945e-f055d6b89534 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:49.258858 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8c43471-a64c-400d-945e-f055d6b89534 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:49.259320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8c43471-a64c-400d-945e-f055d6b89534 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:49.260108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8c43471-a64c-400d-945e-f055d6b89534 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:49.260556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a8c43471-a64c-400d-945e-f055d6b89534 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:49.403536 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a8c43471-a64c-400d-945e-f055d6b89534 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:49.411787 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a8c43471-a64c-400d-945e-f055d6b89534 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.164836 May 19 05:41:49.412571 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3458/7004] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:49 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:50.429964 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-290caa06-4766-4d7e-bce9-f0155ce75fdb tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:50.430729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-290caa06-4766-4d7e-bce9-f0155ce75fdb tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:50.438248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-290caa06-4766-4d7e-bce9-f0155ce75fdb tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:50.439341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-290caa06-4766-4d7e-bce9-f0155ce75fdb tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:50.440019 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-290caa06-4766-4d7e-bce9-f0155ce75fdb tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:50.440295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-290caa06-4766-4d7e-bce9-f0155ce75fdb tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:50.578515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-290caa06-4766-4d7e-bce9-f0155ce75fdb tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:50.586640 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-290caa06-4766-4d7e-bce9-f0155ce75fdb tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.160931 May 19 05:41:50.592818 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3547/7005] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:50 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:51.605614 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1e709f8-7e8f-40f0-82b3-673269a230e1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:51.606379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1e709f8-7e8f-40f0-82b3-673269a230e1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:51.614324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1e709f8-7e8f-40f0-82b3-673269a230e1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:51.614785 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1e709f8-7e8f-40f0-82b3-673269a230e1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:51.615710 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1e709f8-7e8f-40f0-82b3-673269a230e1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:51.616307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1e709f8-7e8f-40f0-82b3-673269a230e1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:51.753593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c1e709f8-7e8f-40f0-82b3-673269a230e1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:51.761516 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1e709f8-7e8f-40f0-82b3-673269a230e1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.160940 May 19 05:41:51.762116 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3459/7006] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:51 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:52.778471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1d514e6-cef3-4a6b-88ec-de8a4b1a7994 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:52.779220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1d514e6-cef3-4a6b-88ec-de8a4b1a7994 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:52.785727 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d514e6-cef3-4a6b-88ec-de8a4b1a7994 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:52.786199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d514e6-cef3-4a6b-88ec-de8a4b1a7994 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:52.786988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d514e6-cef3-4a6b-88ec-de8a4b1a7994 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:52.787448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d514e6-cef3-4a6b-88ec-de8a4b1a7994 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:52.933610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1d514e6-cef3-4a6b-88ec-de8a4b1a7994 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:52.941333 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1d514e6-cef3-4a6b-88ec-de8a4b1a7994 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.167161 May 19 05:41:52.941918 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3548/7007] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:52 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:53.959161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-73885fe1-d5f1-45ce-be6b-7ddebc670b36 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:53.959784 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-73885fe1-d5f1-45ce-be6b-7ddebc670b36 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:53.966550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73885fe1-d5f1-45ce-be6b-7ddebc670b36 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:53.967006 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73885fe1-d5f1-45ce-be6b-7ddebc670b36 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:53.967781 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73885fe1-d5f1-45ce-be6b-7ddebc670b36 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:53.968221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-73885fe1-d5f1-45ce-be6b-7ddebc670b36 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:54.113218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-73885fe1-d5f1-45ce-be6b-7ddebc670b36 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:54.122652 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-73885fe1-d5f1-45ce-be6b-7ddebc670b36 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.167702 May 19 05:41:54.123479 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3460/7008] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:53 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:54.402018 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-62a3a922-9bf0-4a3e-a498-35e38707d41b req-1ff1bf21-bae9-4244-816e-3e32de04b3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ea24b0-1f8b-4e58-89ad-a377c47c80ce", "tag": "11bcf6eb-8daa-403f-b3ba-7f1cdbfff875"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:41:54.411374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-62a3a922-9bf0-4a3e-a498-35e38707d41b req-1ff1bf21-bae9-4244-816e-3e32de04b3a0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:54.411932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-62a3a922-9bf0-4a3e-a498-35e38707d41b req-1ff1bf21-bae9-4244-816e-3e32de04b3a0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:54.425121 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-62a3a922-9bf0-4a3e-a498-35e38707d41b req-1ff1bf21-bae9-4244-816e-3e32de04b3a0 service nova] Creating event network-changed:11bcf6eb-8daa-403f-b3ba-7f1cdbfff875 for instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce on n-h1-766726-30 May 19 05:41:54.430585 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-62a3a922-9bf0-4a3e-a498-35e38707d41b req-1ff1bf21-bae9-4244-816e-3e32de04b3a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179969 May 19 05:41:54.431304 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3549/7009] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:41:55.139559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f36edae8-cc25-4585-8418-30d0e75c7cdf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:55.140191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f36edae8-cc25-4585-8418-30d0e75c7cdf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:55.142103 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:41:55.148252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36edae8-cc25-4585-8418-30d0e75c7cdf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:55.148711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36edae8-cc25-4585-8418-30d0e75c7cdf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:55.149520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36edae8-cc25-4585-8418-30d0e75c7cdf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:55.149972 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f36edae8-cc25-4585-8418-30d0e75c7cdf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:55.281414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f36edae8-cc25-4585-8418-30d0e75c7cdf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:55.288974 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f36edae8-cc25-4585-8418-30d0e75c7cdf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.153398 May 19 05:41:55.289621 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3461/7010] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:55 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:56.303190 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:41:56.303891 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:41:56.309214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c1c09536-b2dd-42c8-8629-f67746fdaf2e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:56.309898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c1c09536-b2dd-42c8-8629-f67746fdaf2e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:56.317219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1c09536-b2dd-42c8-8629-f67746fdaf2e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:56.317686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1c09536-b2dd-42c8-8629-f67746fdaf2e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:56.318469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1c09536-b2dd-42c8-8629-f67746fdaf2e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:56.318926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1c09536-b2dd-42c8-8629-f67746fdaf2e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:56.446260 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c1c09536-b2dd-42c8-8629-f67746fdaf2e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:56.454471 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c1c09536-b2dd-42c8-8629-f67746fdaf2e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.152333 May 19 05:41:56.455062 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3550/7011] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:56 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:57.474377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7f7dfd4e-ef27-427c-980b-19c200dae3ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:57.475002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7f7dfd4e-ef27-427c-980b-19c200dae3ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:57.482510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f7dfd4e-ef27-427c-980b-19c200dae3ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:57.482963 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f7dfd4e-ef27-427c-980b-19c200dae3ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:57.483758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f7dfd4e-ef27-427c-980b-19c200dae3ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:57.484199 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7f7dfd4e-ef27-427c-980b-19c200dae3ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:57.609570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7f7dfd4e-ef27-427c-980b-19c200dae3ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:57.616981 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7f7dfd4e-ef27-427c-980b-19c200dae3ee tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.146824 May 19 05:41:57.617587 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3462/7012] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:57 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:58.635401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e9e5b38-8cef-4a5d-b742-70e6f360252c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:58.636095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3e9e5b38-8cef-4a5d-b742-70e6f360252c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:58.644548 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e9e5b38-8cef-4a5d-b742-70e6f360252c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:58.645184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e9e5b38-8cef-4a5d-b742-70e6f360252c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:58.645966 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e9e5b38-8cef-4a5d-b742-70e6f360252c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:58.646415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e9e5b38-8cef-4a5d-b742-70e6f360252c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:58.786290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3e9e5b38-8cef-4a5d-b742-70e6f360252c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:58.794823 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3e9e5b38-8cef-4a5d-b742-70e6f360252c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.164115 May 19 05:41:58.804159 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3551/7013] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:58 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:41:58.816584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d3d73b71-f0b2-4714-99e5-6d373c51231b req-1fda43b5-4fb3-425a-8353-db32f43b6617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ea24b0-1f8b-4e58-89ad-a377c47c80ce", "name": "network-vif-plugged", "status": "completed", "tag": "11bcf6eb-8daa-403f-b3ba-7f1cdbfff875"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:41:58.825178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d3d73b71-f0b2-4714-99e5-6d373c51231b req-1fda43b5-4fb3-425a-8353-db32f43b6617 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:58.825634 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d3d73b71-f0b2-4714-99e5-6d373c51231b req-1fda43b5-4fb3-425a-8353-db32f43b6617 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:58.842837 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d3d73b71-f0b2-4714-99e5-6d373c51231b req-1fda43b5-4fb3-425a-8353-db32f43b6617 service nova] Creating event network-vif-plugged:11bcf6eb-8daa-403f-b3ba-7f1cdbfff875 for instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce on n-h1-766726-30 May 19 05:41:58.857033 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d3d73b71-f0b2-4714-99e5-6d373c51231b req-1fda43b5-4fb3-425a-8353-db32f43b6617 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111312 May 19 05:41:58.857674 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3463/7014] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:41:59.812290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a3afc33-de97-43bf-8a56-23d6610e6d39 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:41:59.812928 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2a3afc33-de97-43bf-8a56-23d6610e6d39 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:41:59.819960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a3afc33-de97-43bf-8a56-23d6610e6d39 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:59.820432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a3afc33-de97-43bf-8a56-23d6610e6d39 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:59.821318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a3afc33-de97-43bf-8a56-23d6610e6d39 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:41:59.821777 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2a3afc33-de97-43bf-8a56-23d6610e6d39 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:41:59.947234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2a3afc33-de97-43bf-8a56-23d6610e6d39 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:41:59.954791 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2a3afc33-de97-43bf-8a56-23d6610e6d39 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1358 microversion: 2.1 time: 0.147138 May 19 05:41:59.955379 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3552/7015] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:41:59 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:00.974038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7e718bba-59d4-40cf-9a44-8fee3185d953 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:00.974741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7e718bba-59d4-40cf-9a44-8fee3185d953 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:00.981732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e718bba-59d4-40cf-9a44-8fee3185d953 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:00.982179 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e718bba-59d4-40cf-9a44-8fee3185d953 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:00.982936 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e718bba-59d4-40cf-9a44-8fee3185d953 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:00.983372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7e718bba-59d4-40cf-9a44-8fee3185d953 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:01.112213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7e718bba-59d4-40cf-9a44-8fee3185d953 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:01.119742 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7e718bba-59d4-40cf-9a44-8fee3185d953 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1549 microversion: 2.1 time: 0.151366 May 19 05:42:01.120322 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3464/7016] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:00 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:01.135770 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6a6a74f2-72ed-4e84-8c8b-f4cdf28ebbea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:01.136395 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6a6a74f2-72ed-4e84-8c8b-f4cdf28ebbea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:01.143350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a6a74f2-72ed-4e84-8c8b-f4cdf28ebbea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:01.143844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a6a74f2-72ed-4e84-8c8b-f4cdf28ebbea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:01.144615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a6a74f2-72ed-4e84-8c8b-f4cdf28ebbea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:01.145064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a6a74f2-72ed-4e84-8c8b-f4cdf28ebbea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:01.274526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6a6a74f2-72ed-4e84-8c8b-f4cdf28ebbea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:01.282735 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6a6a74f2-72ed-4e84-8c8b-f4cdf28ebbea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1549 microversion: 2.1 time: 0.150915 May 19 05:42:01.283326 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3553/7017] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:01 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:01.298442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a568904a-cf72-49a7-984c-cedd7368cf5b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:01.301847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a568904a-cf72-49a7-984c-cedd7368cf5b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:01.302618 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a568904a-cf72-49a7-984c-cedd7368cf5b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Searching by: {'deleted': False, 'project_id': '37ac4f4608be4250be4d19c297e4d795'} {{(pid=124819) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 05:42:01.307908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a568904a-cf72-49a7-984c-cedd7368cf5b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:01.308359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a568904a-cf72-49a7-984c-cedd7368cf5b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:01.309186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a568904a-cf72-49a7-984c-cedd7368cf5b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:01.309626 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a568904a-cf72-49a7-984c-cedd7368cf5b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:01.337005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.multi_cell_list [None req-a568904a-cf72-49a7-984c-cedd7368cf5b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124819) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 05:42:01.364024 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a568904a-cf72-49a7-984c-cedd7368cf5b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069423 May 19 05:42:01.364606 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3465/7018] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 19 05:42:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:42:01.374897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-efb1d5be-2e4c-4294-8a2d-e8c8e9a49b09 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:01.375540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-efb1d5be-2e4c-4294-8a2d-e8c8e9a49b09 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:01.381647 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efb1d5be-2e4c-4294-8a2d-e8c8e9a49b09 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:01.382127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efb1d5be-2e4c-4294-8a2d-e8c8e9a49b09 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:01.382907 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efb1d5be-2e4c-4294-8a2d-e8c8e9a49b09 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:01.383366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-efb1d5be-2e4c-4294-8a2d-e8c8e9a49b09 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:01.507437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-efb1d5be-2e4c-4294-8a2d-e8c8e9a49b09 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:01.515545 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-efb1d5be-2e4c-4294-8a2d-e8c8e9a49b09 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1549 microversion: 2.1 time: 0.144650 May 19 05:42:01.516137 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3554/7019] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:01 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:04.070415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d254a3e2-e46f-4b13-b2e3-a64bfb3eccac tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84ace70b-46c1-444c-9ed3-e9a4845b99e6"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:42:04.071500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d254a3e2-e46f-4b13-b2e3-a64bfb3eccac tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:04.078441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d254a3e2-e46f-4b13-b2e3-a64bfb3eccac tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:04.078898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d254a3e2-e46f-4b13-b2e3-a64bfb3eccac tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:04.079698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d254a3e2-e46f-4b13-b2e3-a64bfb3eccac tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:04.080141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d254a3e2-e46f-4b13-b2e3-a64bfb3eccac tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:04.474034 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d254a3e2-e46f-4b13-b2e3-a64bfb3eccac tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "POST /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407500 May 19 05:42:04.474839 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3466/7020] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 19 05:42:04 2022] POST /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:42:20.467540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7956ee60-39db-4f57-852a-570898c2a082 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:20.468447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7956ee60-39db-4f57-852a-570898c2a082 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:20.471596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:42:20.472393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=58 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:42:20.478133 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7956ee60-39db-4f57-852a-570898c2a082 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:20.478534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7956ee60-39db-4f57-852a-570898c2a082 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:20.479307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7956ee60-39db-4f57-852a-570898c2a082 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:20.479752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7956ee60-39db-4f57-852a-570898c2a082 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:20.609572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7956ee60-39db-4f57-852a-570898c2a082 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:20.618143 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7956ee60-39db-4f57-852a-570898c2a082 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1595 microversion: 2.1 time: 0.154595 May 19 05:42:20.618819 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3555/7021] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:20 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:22.513732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:42:22.515454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:42:22.516040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:42:22.521188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6c6cc426-e1aa-4077-a385-055f606fecf4 req-a7ba8ec2-778a-4d77-baf1-8b93b512baf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ea24b0-1f8b-4e58-89ad-a377c47c80ce", "tag": "11bcf6eb-8daa-403f-b3ba-7f1cdbfff875"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:42:22.533190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6c6cc426-e1aa-4077-a385-055f606fecf4 req-a7ba8ec2-778a-4d77-baf1-8b93b512baf2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:22.533648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6c6cc426-e1aa-4077-a385-055f606fecf4 req-a7ba8ec2-778a-4d77-baf1-8b93b512baf2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:22.548793 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6c6cc426-e1aa-4077-a385-055f606fecf4 req-a7ba8ec2-778a-4d77-baf1-8b93b512baf2 service nova] Creating event network-changed:11bcf6eb-8daa-403f-b3ba-7f1cdbfff875 for instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce on n-h1-766726-30 May 19 05:42:22.554583 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6c6cc426-e1aa-4077-a385-055f606fecf4 req-a7ba8ec2-778a-4d77-baf1-8b93b512baf2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042738 May 19 05:42:22.555588 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3467/7022] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:42:23.855239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82551565-42d6-4692-bee4-066f8103068b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1007686465"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:42:23.855890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82551565-42d6-4692-bee4-066f8103068b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:23.863386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82551565-42d6-4692-bee4-066f8103068b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:23.863944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82551565-42d6-4692-bee4-066f8103068b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:23.864814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82551565-42d6-4692-bee4-066f8103068b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:23.865380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82551565-42d6-4692-bee4-066f8103068b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:24.008311 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.network.security_group_api [None req-82551565-42d6-4692-bee4-066f8103068b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Adding security group f5141703-45e3-4132-ab66-d4cb504fa9b9 to port 11bcf6eb-8daa-403f-b3ba-7f1cdbfff875 May 19 05:42:24.385148 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82551565-42d6-4692-bee4-066f8103068b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "POST /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/action" status: 202 len: 0 microversion: 2.1 time: 0.534121 May 19 05:42:24.386456 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3556/7023] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:42:23 2022] POST /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:42:24.397871 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a0a7768b-93f6-4f95-80b8-3df1f1882f7a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:24.398617 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a0a7768b-93f6-4f95-80b8-3df1f1882f7a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:24.409428 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0a7768b-93f6-4f95-80b8-3df1f1882f7a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:24.410619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0a7768b-93f6-4f95-80b8-3df1f1882f7a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:24.411415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0a7768b-93f6-4f95-80b8-3df1f1882f7a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:24.411851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a0a7768b-93f6-4f95-80b8-3df1f1882f7a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:24.571555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-471d4c7a-47c9-4c65-b4e9-b0a40e55433b req-eb1c3731-3e4e-42b2-9a05-8014e852af6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ea24b0-1f8b-4e58-89ad-a377c47c80ce", "tag": "11bcf6eb-8daa-403f-b3ba-7f1cdbfff875"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:42:24.582700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-471d4c7a-47c9-4c65-b4e9-b0a40e55433b req-eb1c3731-3e4e-42b2-9a05-8014e852af6f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:24.583822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-471d4c7a-47c9-4c65-b4e9-b0a40e55433b req-eb1c3731-3e4e-42b2-9a05-8014e852af6f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:24.589416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a0a7768b-93f6-4f95-80b8-3df1f1882f7a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:24.598379 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-471d4c7a-47c9-4c65-b4e9-b0a40e55433b req-eb1c3731-3e4e-42b2-9a05-8014e852af6f service nova] Creating event network-changed:11bcf6eb-8daa-403f-b3ba-7f1cdbfff875 for instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce on n-h1-766726-30 May 19 05:42:24.600655 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a0a7768b-93f6-4f95-80b8-3df1f1882f7a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1761 microversion: 2.1 time: 0.210008 May 19 05:42:24.601751 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3468/7024] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:24 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1761 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:24.606787 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-471d4c7a-47c9-4c65-b4e9-b0a40e55433b req-eb1c3731-3e4e-42b2-9a05-8014e852af6f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038872 May 19 05:42:24.607795 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3557/7025] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:42:37.604454 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c0cf4b85-eca5-453c-a756-35ed869bde0e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:42:37.605449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c0cf4b85-eca5-453c-a756-35ed869bde0e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:37.608338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=4 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:42:37.609100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:42:37.616037 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0cf4b85-eca5-453c-a756-35ed869bde0e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:37.616830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0cf4b85-eca5-453c-a756-35ed869bde0e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:37.617628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0cf4b85-eca5-453c-a756-35ed869bde0e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:37.618066 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0cf4b85-eca5-453c-a756-35ed869bde0e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:37.687862 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c0cf4b85-eca5-453c-a756-35ed869bde0e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "POST /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/action" status: 202 len: 0 microversion: 2.1 time: 0.087100 May 19 05:42:37.691444 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3469/7026] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:42:37 2022] POST /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:42:37.694872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:42:37.695754 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:42:37.699919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3bb63600-4633-4a81-bb18-7e179222b3bf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:37.700651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3bb63600-4633-4a81-bb18-7e179222b3bf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:37.707658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3bb63600-4633-4a81-bb18-7e179222b3bf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:37.708123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3bb63600-4633-4a81-bb18-7e179222b3bf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:37.708902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3bb63600-4633-4a81-bb18-7e179222b3bf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:37.709373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3bb63600-4633-4a81-bb18-7e179222b3bf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:37.861978 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3bb63600-4633-4a81-bb18-7e179222b3bf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:37.873229 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3bb63600-4633-4a81-bb18-7e179222b3bf tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1753 microversion: 2.1 time: 0.179911 May 19 05:42:37.873906 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3558/7027] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:37 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:38.891672 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-78a93743-9962-4bb8-8762-f4b52e75aeea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:38.892372 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-78a93743-9962-4bb8-8762-f4b52e75aeea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:38.898611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78a93743-9962-4bb8-8762-f4b52e75aeea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:38.899060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78a93743-9962-4bb8-8762-f4b52e75aeea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:38.899818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78a93743-9962-4bb8-8762-f4b52e75aeea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:38.900250 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-78a93743-9962-4bb8-8762-f4b52e75aeea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:39.056294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-78a93743-9962-4bb8-8762-f4b52e75aeea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:39.065789 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-78a93743-9962-4bb8-8762-f4b52e75aeea tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1758 microversion: 2.1 time: 0.179298 May 19 05:42:39.066377 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3470/7028] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:38 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:40.083412 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03e47447-902b-496e-8f0f-e11a55eabd94 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:40.084070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-03e47447-902b-496e-8f0f-e11a55eabd94 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:40.091082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03e47447-902b-496e-8f0f-e11a55eabd94 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:40.091551 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03e47447-902b-496e-8f0f-e11a55eabd94 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:40.092339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03e47447-902b-496e-8f0f-e11a55eabd94 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:40.093049 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-03e47447-902b-496e-8f0f-e11a55eabd94 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:40.235495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03e47447-902b-496e-8f0f-e11a55eabd94 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:40.243435 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-03e47447-902b-496e-8f0f-e11a55eabd94 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1758 microversion: 2.1 time: 0.163969 May 19 05:42:40.244008 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3559/7029] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:40 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:41.260633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d4b29bd-7e19-49dd-a69a-12f642a35577 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:41.261923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1d4b29bd-7e19-49dd-a69a-12f642a35577 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:41.269692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d4b29bd-7e19-49dd-a69a-12f642a35577 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:41.270152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d4b29bd-7e19-49dd-a69a-12f642a35577 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:41.270957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d4b29bd-7e19-49dd-a69a-12f642a35577 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:41.271400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d4b29bd-7e19-49dd-a69a-12f642a35577 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:41.416986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1d4b29bd-7e19-49dd-a69a-12f642a35577 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:41.425151 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d4b29bd-7e19-49dd-a69a-12f642a35577 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1758 microversion: 2.1 time: 0.168536 May 19 05:42:41.425737 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3471/7030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:41 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:42.442405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-42dee860-52cc-4eeb-aaff-aa1158941966 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:42.443038 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-42dee860-52cc-4eeb-aaff-aa1158941966 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:42.450008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42dee860-52cc-4eeb-aaff-aa1158941966 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:42.450473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42dee860-52cc-4eeb-aaff-aa1158941966 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:42.451250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42dee860-52cc-4eeb-aaff-aa1158941966 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:42.451705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-42dee860-52cc-4eeb-aaff-aa1158941966 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:42.596437 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-42dee860-52cc-4eeb-aaff-aa1158941966 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:42.604554 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-42dee860-52cc-4eeb-aaff-aa1158941966 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1758 microversion: 2.1 time: 0.166115 May 19 05:42:42.605167 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3560/7031] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:42 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:43.621947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cf278877-447d-489c-97e7-89eb73d9c4e2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:43.622665 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cf278877-447d-489c-97e7-89eb73d9c4e2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:43.629750 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf278877-447d-489c-97e7-89eb73d9c4e2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:43.630207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf278877-447d-489c-97e7-89eb73d9c4e2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:43.630978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf278877-447d-489c-97e7-89eb73d9c4e2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:43.631425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cf278877-447d-489c-97e7-89eb73d9c4e2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:43.770811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cf278877-447d-489c-97e7-89eb73d9c4e2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:43.779495 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cf278877-447d-489c-97e7-89eb73d9c4e2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1758 microversion: 2.1 time: 0.161530 May 19 05:42:43.780288 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3472/7032] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:43 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:44.796191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df851e99-3671-488d-8307-4a934d7a2cce tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:44.797408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df851e99-3671-488d-8307-4a934d7a2cce tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:44.807099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df851e99-3671-488d-8307-4a934d7a2cce tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:44.807560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df851e99-3671-488d-8307-4a934d7a2cce tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:44.808347 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df851e99-3671-488d-8307-4a934d7a2cce tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:44.808794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df851e99-3671-488d-8307-4a934d7a2cce tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:44.962058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-df851e99-3671-488d-8307-4a934d7a2cce tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:44.971277 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df851e99-3671-488d-8307-4a934d7a2cce tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1758 microversion: 2.1 time: 0.178991 May 19 05:42:44.972067 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3561/7033] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:44 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:45.987766 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c5574a3a-1282-42ed-b7e2-78bd10b505dd tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:45.988374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c5574a3a-1282-42ed-b7e2-78bd10b505dd tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:45.995288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5574a3a-1282-42ed-b7e2-78bd10b505dd tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:45.995740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5574a3a-1282-42ed-b7e2-78bd10b505dd tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:45.996506 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5574a3a-1282-42ed-b7e2-78bd10b505dd tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:45.996946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5574a3a-1282-42ed-b7e2-78bd10b505dd tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:46.136874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5574a3a-1282-42ed-b7e2-78bd10b505dd tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:46.144967 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c5574a3a-1282-42ed-b7e2-78bd10b505dd tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1758 microversion: 2.1 time: 0.161147 May 19 05:42:46.145574 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3473/7034] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:45 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:47.162027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-252e0391-580e-4253-a133-6bd55d3cf6df tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:47.162664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-252e0391-580e-4253-a133-6bd55d3cf6df tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:47.169775 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-252e0391-580e-4253-a133-6bd55d3cf6df tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:47.170244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-252e0391-580e-4253-a133-6bd55d3cf6df tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:47.171023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-252e0391-580e-4253-a133-6bd55d3cf6df tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:47.171479 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-252e0391-580e-4253-a133-6bd55d3cf6df tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:47.318236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-252e0391-580e-4253-a133-6bd55d3cf6df tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:47.326750 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-252e0391-580e-4253-a133-6bd55d3cf6df tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1758 microversion: 2.1 time: 0.168568 May 19 05:42:47.327345 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3562/7035] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:47 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:48.344491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2bd5c02e-9859-49a2-a15e-b4c93fb6e690 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:48.345135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2bd5c02e-9859-49a2-a15e-b4c93fb6e690 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:48.352307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bd5c02e-9859-49a2-a15e-b4c93fb6e690 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:48.352765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bd5c02e-9859-49a2-a15e-b4c93fb6e690 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:48.353572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bd5c02e-9859-49a2-a15e-b4c93fb6e690 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:48.354019 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2bd5c02e-9859-49a2-a15e-b4c93fb6e690 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:48.493348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2bd5c02e-9859-49a2-a15e-b4c93fb6e690 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:48.502093 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2bd5c02e-9859-49a2-a15e-b4c93fb6e690 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1758 microversion: 2.1 time: 0.161884 May 19 05:42:48.502675 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3474/7036] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:48 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:42:49.519278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3a8326a3-7803-43ce-8583-cd007c96a537 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:42:49.519916 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3a8326a3-7803-43ce-8583-cd007c96a537 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:42:49.527130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a8326a3-7803-43ce-8583-cd007c96a537 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:49.527602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a8326a3-7803-43ce-8583-cd007c96a537 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:49.528388 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a8326a3-7803-43ce-8583-cd007c96a537 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:42:49.528849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3a8326a3-7803-43ce-8583-cd007c96a537 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:42:49.668023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3a8326a3-7803-43ce-8583-cd007c96a537 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:42:49.676727 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3a8326a3-7803-43ce-8583-cd007c96a537 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1761 microversion: 2.1 time: 0.161440 May 19 05:42:49.677346 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3563/7037] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:42:49 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1761 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:43:09.889793 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:43:09.890437 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:43:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:43:22.944426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-595d527d-ea24-4342-981c-ba77254466f2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1007686465"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:43:22.945148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-595d527d-ea24-4342-981c-ba77254466f2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:22.947041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=12 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:43:22.947869 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:43:22.954116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-595d527d-ea24-4342-981c-ba77254466f2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:22.955111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-595d527d-ea24-4342-981c-ba77254466f2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:22.956213 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-595d527d-ea24-4342-981c-ba77254466f2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:22.956668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-595d527d-ea24-4342-981c-ba77254466f2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:23.087622 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.network.security_group_api [None req-595d527d-ea24-4342-981c-ba77254466f2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Removing security group f5141703-45e3-4132-ab66-d4cb504fa9b9 from port 11bcf6eb-8daa-403f-b3ba-7f1cdbfff875 May 19 05:43:23.456497 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-595d527d-ea24-4342-981c-ba77254466f2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "POST /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/action" status: 202 len: 0 microversion: 2.1 time: 0.516322 May 19 05:43:23.457662 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3475/7038] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:43:22 2022] POST /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:43:23.461717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=12 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:43:23.462399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=36 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:43:23.468321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e0510d28-4f03-47cc-b678-a7a76caf2234 req-76ea17d9-b061-4427-9092-614573bd8bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ea24b0-1f8b-4e58-89ad-a377c47c80ce", "tag": "11bcf6eb-8daa-403f-b3ba-7f1cdbfff875"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:43:23.476716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e0510d28-4f03-47cc-b678-a7a76caf2234 req-76ea17d9-b061-4427-9092-614573bd8bd9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:23.477494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e0510d28-4f03-47cc-b678-a7a76caf2234 req-76ea17d9-b061-4427-9092-614573bd8bd9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:23.490899 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e0510d28-4f03-47cc-b678-a7a76caf2234 req-76ea17d9-b061-4427-9092-614573bd8bd9 service nova] Creating event network-changed:11bcf6eb-8daa-403f-b3ba-7f1cdbfff875 for instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce on n-h1-766726-30 May 19 05:43:23.508112 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e0510d28-4f03-47cc-b678-a7a76caf2234 req-76ea17d9-b061-4427-9092-614573bd8bd9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045362 May 19 05:43:23.511870 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3564/7039] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:24.642696 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d5de8010-b63c-4a09-ae7d-bb88e5f6f29e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:24.643289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d5de8010-b63c-4a09-ae7d-bb88e5f6f29e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:24.649452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5de8010-b63c-4a09-ae7d-bb88e5f6f29e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:24.649909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5de8010-b63c-4a09-ae7d-bb88e5f6f29e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:24.650688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5de8010-b63c-4a09-ae7d-bb88e5f6f29e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:24.651128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d5de8010-b63c-4a09-ae7d-bb88e5f6f29e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:24.733654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-d5de8010-b63c-4a09-ae7d-bb88e5f6f29e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lazy-loading 'services' on Instance uuid 84ea24b0-1f8b-4e58-89ad-a377c47c80ce {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:43:24.822671 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d5de8010-b63c-4a09-ae7d-bb88e5f6f29e tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "DELETE /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments/84ace70b-46c1-444c-9ed3-e9a4845b99e6" status: 202 len: 0 microversion: 2.1 time: 0.185797 May 19 05:43:24.823669 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3476/7040] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:43:24 2022] DELETE /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments/84ace70b-46c1-444c-9ed3-e9a4845b99e6 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:43:24.834387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a14c987a-dffb-4fac-af2b-6e6c1df500e7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:24.835417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a14c987a-dffb-4fac-af2b-6e6c1df500e7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:24.842426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a14c987a-dffb-4fac-af2b-6e6c1df500e7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:24.843173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a14c987a-dffb-4fac-af2b-6e6c1df500e7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:24.844356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a14c987a-dffb-4fac-af2b-6e6c1df500e7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:24.844984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a14c987a-dffb-4fac-af2b-6e6c1df500e7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:24.877372 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a14c987a-dffb-4fac-af2b-6e6c1df500e7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048730 May 19 05:43:24.877957 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3565/7041] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:24 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:25.536580 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-10b91319-1bc5-472e-83d6-7207715d5f45 req-b70397e4-85d8-4a33-801f-ffc192aec021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ea24b0-1f8b-4e58-89ad-a377c47c80ce", "tag": "11bcf6eb-8daa-403f-b3ba-7f1cdbfff875"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:43:25.545366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-10b91319-1bc5-472e-83d6-7207715d5f45 req-b70397e4-85d8-4a33-801f-ffc192aec021 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:25.545807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-10b91319-1bc5-472e-83d6-7207715d5f45 req-b70397e4-85d8-4a33-801f-ffc192aec021 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:25.561800 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-10b91319-1bc5-472e-83d6-7207715d5f45 req-b70397e4-85d8-4a33-801f-ffc192aec021 service nova] Creating event network-changed:11bcf6eb-8daa-403f-b3ba-7f1cdbfff875 for instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce on n-h1-766726-30 May 19 05:43:25.566954 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-10b91319-1bc5-472e-83d6-7207715d5f45 req-b70397e4-85d8-4a33-801f-ffc192aec021 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035049 May 19 05:43:25.567889 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3477/7042] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:25.889689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a22e5835-e129-4268-ae48-92e1269f7cc3 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:25.890903 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a22e5835-e129-4268-ae48-92e1269f7cc3 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:25.898427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a22e5835-e129-4268-ae48-92e1269f7cc3 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:25.899520 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a22e5835-e129-4268-ae48-92e1269f7cc3 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:25.902082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a22e5835-e129-4268-ae48-92e1269f7cc3 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:25.902549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a22e5835-e129-4268-ae48-92e1269f7cc3 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:25.936905 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a22e5835-e129-4268-ae48-92e1269f7cc3 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051497 May 19 05:43:25.937535 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3566/7043] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:25 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:26.949624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-42d0938d-5f04-4ff7-a471-aebf2abbb89c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:26.950627 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-42d0938d-5f04-4ff7-a471-aebf2abbb89c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:26.958338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42d0938d-5f04-4ff7-a471-aebf2abbb89c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:26.958787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42d0938d-5f04-4ff7-a471-aebf2abbb89c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:26.959550 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42d0938d-5f04-4ff7-a471-aebf2abbb89c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:26.959985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-42d0938d-5f04-4ff7-a471-aebf2abbb89c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:26.989399 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-42d0938d-5f04-4ff7-a471-aebf2abbb89c tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 May 19 05:43:26.989961 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3478/7044] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:26 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:43:28.000300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-89ce2ef8-4118-497d-a8f2-a064c6f3078a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:28.001938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-89ce2ef8-4118-497d-a8f2-a064c6f3078a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:28.009370 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ce2ef8-4118-497d-a8f2-a064c6f3078a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:28.009843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ce2ef8-4118-497d-a8f2-a064c6f3078a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:28.010698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ce2ef8-4118-497d-a8f2-a064c6f3078a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:28.011158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-89ce2ef8-4118-497d-a8f2-a064c6f3078a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:28.042179 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-89ce2ef8-4118-497d-a8f2-a064c6f3078a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 May 19 05:43:28.042771 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3567/7045] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:27 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:29.058621 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-258a5877-98b3-408b-99a3-ee233d099026 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:29.059569 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-258a5877-98b3-408b-99a3-ee233d099026 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:29.067578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-258a5877-98b3-408b-99a3-ee233d099026 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:29.068119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-258a5877-98b3-408b-99a3-ee233d099026 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:29.068891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-258a5877-98b3-408b-99a3-ee233d099026 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:29.069363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-258a5877-98b3-408b-99a3-ee233d099026 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:29.098600 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-258a5877-98b3-408b-99a3-ee233d099026 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048004 May 19 05:43:29.099163 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3479/7046] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:29 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:30.110542 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7601cdf7-c3cf-4a4e-9065-4a4fc442b7b2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:30.111473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7601cdf7-c3cf-4a4e-9065-4a4fc442b7b2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:30.118561 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7601cdf7-c3cf-4a4e-9065-4a4fc442b7b2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:30.119028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7601cdf7-c3cf-4a4e-9065-4a4fc442b7b2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:30.119841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7601cdf7-c3cf-4a4e-9065-4a4fc442b7b2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:30.120291 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7601cdf7-c3cf-4a4e-9065-4a4fc442b7b2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:30.149809 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7601cdf7-c3cf-4a4e-9065-4a4fc442b7b2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043390 May 19 05:43:30.150383 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3568/7047] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:30 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:31.161654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e11baf1-205a-4098-b30f-4a491e800713 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:31.162612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e11baf1-205a-4098-b30f-4a491e800713 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:31.169552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e11baf1-205a-4098-b30f-4a491e800713 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:31.169999 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e11baf1-205a-4098-b30f-4a491e800713 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:31.170758 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e11baf1-205a-4098-b30f-4a491e800713 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:31.171191 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e11baf1-205a-4098-b30f-4a491e800713 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:31.200468 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e11baf1-205a-4098-b30f-4a491e800713 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042940 May 19 05:43:31.201040 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3480/7048] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:31 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:43:32.212041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ec8a6f9f-6347-40bc-be39-9c181f9efeb7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:32.213021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ec8a6f9f-6347-40bc-be39-9c181f9efeb7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:32.220864 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec8a6f9f-6347-40bc-be39-9c181f9efeb7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:32.221331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec8a6f9f-6347-40bc-be39-9c181f9efeb7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:32.222110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec8a6f9f-6347-40bc-be39-9c181f9efeb7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:32.222559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec8a6f9f-6347-40bc-be39-9c181f9efeb7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:32.252713 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ec8a6f9f-6347-40bc-be39-9c181f9efeb7 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 May 19 05:43:32.253368 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3569/7049] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:32 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:33.264129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c984a2c-8282-403b-8a89-939628870f4a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:33.265113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c984a2c-8282-403b-8a89-939628870f4a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:33.272913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c984a2c-8282-403b-8a89-939628870f4a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:33.273396 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c984a2c-8282-403b-8a89-939628870f4a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:33.274165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c984a2c-8282-403b-8a89-939628870f4a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:33.274607 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c984a2c-8282-403b-8a89-939628870f4a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:33.304068 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c984a2c-8282-403b-8a89-939628870f4a tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 May 19 05:43:33.304659 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3481/7050] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:33 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:34.315662 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d6bfcda4-fee3-4328-b37a-afbc1c96ff0b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:34.316603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d6bfcda4-fee3-4328-b37a-afbc1c96ff0b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:34.323915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6bfcda4-fee3-4328-b37a-afbc1c96ff0b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:34.324240 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6bfcda4-fee3-4328-b37a-afbc1c96ff0b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:34.325014 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6bfcda4-fee3-4328-b37a-afbc1c96ff0b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:34.325490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d6bfcda4-fee3-4328-b37a-afbc1c96ff0b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:34.359368 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d6bfcda4-fee3-4328-b37a-afbc1c96ff0b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047730 May 19 05:43:34.360062 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3570/7051] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 19 05:43:34 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 05:43:34.370917 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:34.371583 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:34.378975 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:34.379436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:34.380215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:34.380688 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:34.455906 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] HTTP exception thrown: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce is not attached to volume 84ace70b-46c1-444c-9ed3-e9a4845b99e6 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Request method failure captured: May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: request: DELETE /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments/84ace70b-46c1-444c-9ed3-e9a4845b99e6 HTTP/1.1 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdiJehGt7VVrevxio3EvMnE8rz3n-ZaxcJrZ4fgcPVIij64rEk1fk4U4e7sQyB3ViU_uMCzaONOY5J1RunDCAjVOmLOlO_YRkKBbdbVaqKNQwM-ABKWKemN58npkZzC3f38oC0YwhhcoGj8hNgSrawmkYkevdj2dyb-DIROqwDexJho May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 37ac4f4608be4250be4d19c297e4d795 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestMinimumBasicScenario-1513015606 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/37ac4f4608be4250be4d19c297e4d795"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37ac4f4608be4250be4d19c297e4d795"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37ac4f4608be4250be4d19c297e4d795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_37ac4f4608be4250be4d19c297e4d795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestMinimumBasicScenario-1513015606 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 37ac4f4608be4250be4d19c297e4d795 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1513015606 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestMinimumBasicScenario-1513015606-project May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: b69188bf4c224d7e9e6575815c189947 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestMinimumBasicScenario-1513015606-project May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce is not attached to volume 84ace70b-46c1-444c-9ed3-e9a4845b99e6 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'server_id': '84ea24b0-1f8b-4e58-89ad-a377c47c80ce', 'id': '84ace70b-46c1-444c-9ed3-e9a4845b99e6'} May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 84ace70b-46c1-444c-9ed3-e9a4845b99e6. May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce is not attached to volume 84ace70b-46c1-444c-9ed3-e9a4845b99e6 May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:43:34.457564 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:43:34.462309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:43:34.462309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:43:34.462309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce is not attached to volume 84ace70b-46c1-444c-9ed3-e9a4845b99e6 May 19 05:43:34.462309 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:34.462309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Returning 404 to user: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce is not attached to volume 84ace70b-46c1-444c-9ed3-e9a4845b99e6 {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:43:34.462309 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6d1b2cf7-835d-4bb2-a351-57e000bd73d2 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "DELETE /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments/84ace70b-46c1-444c-9ed3-e9a4845b99e6" status: 404 len: 154 microversion: 2.1 time: 0.092910 May 19 05:43:34.462309 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3482/7052] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 19 05:43:34 2022] DELETE /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce/os-volume_attachments/84ace70b-46c1-444c-9ed3-e9a4845b99e6 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:43:39.788242 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7289654a-8b5a-4731-ae8b-3ebbf04281cc tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:39.788782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7289654a-8b5a-4731-ae8b-3ebbf04281cc tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:39.795914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7289654a-8b5a-4731-ae8b-3ebbf04281cc tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:39.796373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7289654a-8b5a-4731-ae8b-3ebbf04281cc tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:39.797186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7289654a-8b5a-4731-ae8b-3ebbf04281cc tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:39.797636 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7289654a-8b5a-4731-ae8b-3ebbf04281cc tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:39.826234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7289654a-8b5a-4731-ae8b-3ebbf04281cc tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:43:39.917655 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7289654a-8b5a-4731-ae8b-3ebbf04281cc tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "DELETE /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 204 len: 0 microversion: 2.1 time: 0.132571 May 19 05:43:39.918233 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3571/7053] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:43:39 2022] DELETE /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:43:39.927600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fb88cb6f-acd4-4ec2-80e1-750ed5e9ab93 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:39.928884 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fb88cb6f-acd4-4ec2-80e1-750ed5e9ab93 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:39.936476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb88cb6f-acd4-4ec2-80e1-750ed5e9ab93 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:39.937212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb88cb6f-acd4-4ec2-80e1-750ed5e9ab93 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:39.938235 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb88cb6f-acd4-4ec2-80e1-750ed5e9ab93 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:39.938882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fb88cb6f-acd4-4ec2-80e1-750ed5e9ab93 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:40.353729 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fb88cb6f-acd4-4ec2-80e1-750ed5e9ab93 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:43:40.361614 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fb88cb6f-acd4-4ec2-80e1-750ed5e9ab93 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1555 microversion: 2.1 time: 0.438663 May 19 05:43:40.362849 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3483/7054] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:43:39 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1555 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:43:41.379193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4f6fb140-3f89-4349-816b-01649a8dd874 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:41.380138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4f6fb140-3f89-4349-816b-01649a8dd874 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:41.388020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f6fb140-3f89-4349-816b-01649a8dd874 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:41.388496 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f6fb140-3f89-4349-816b-01649a8dd874 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:41.389312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f6fb140-3f89-4349-816b-01649a8dd874 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:41.389773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4f6fb140-3f89-4349-816b-01649a8dd874 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:41.528251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4f6fb140-3f89-4349-816b-01649a8dd874 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:43:41.537046 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4f6fb140-3f89-4349-816b-01649a8dd874 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1555 microversion: 2.1 time: 0.162143 May 19 05:43:41.537663 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3572/7055] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:43:41 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:43:42.326040 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2d3208c2-0a71-4152-8b3d-c898bef28317 req-aca9c7d4-5be9-4dfa-b44d-5a04c7471f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ea24b0-1f8b-4e58-89ad-a377c47c80ce", "name": "network-vif-deleted", "tag": "11bcf6eb-8daa-403f-b3ba-7f1cdbfff875"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:43:42.335605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2d3208c2-0a71-4152-8b3d-c898bef28317 req-aca9c7d4-5be9-4dfa-b44d-5a04c7471f00 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:42.336063 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2d3208c2-0a71-4152-8b3d-c898bef28317 req-aca9c7d4-5be9-4dfa-b44d-5a04c7471f00 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:42.349019 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2d3208c2-0a71-4152-8b3d-c898bef28317 req-aca9c7d4-5be9-4dfa-b44d-5a04c7471f00 service nova] Creating event network-vif-deleted:11bcf6eb-8daa-403f-b3ba-7f1cdbfff875 for instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce on n-h1-766726-30 May 19 05:43:42.354157 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2d3208c2-0a71-4152-8b3d-c898bef28317 req-aca9c7d4-5be9-4dfa-b44d-5a04c7471f00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031749 May 19 05:43:42.354807 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3484/7056] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:43:42.555245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:42.555833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:42.562934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:42.563461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:42.564776 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:42.565264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:42.595884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:42.596351 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:42.596821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lazy-loading 'fault' on Instance uuid 84ea24b0-1f8b-4e58-89ad-a377c47c80ce {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:43:42.640193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69188bf4c224d7e9e6575815c189947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ac4f4608be4250be4d19c297e4d795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:43:42.648133 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86889a8c-e1ab-4bfd-8761-ecdb5588c1d1 tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 200 len: 1348 microversion: 2.1 time: 0.096898 May 19 05:43:42.648736 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3573/7057] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:43:42 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:43:43.667630 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:43.668341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] [instance: 84ea24b0-1f8b-4e58-89ad-a377c47c80ce] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:43.675453 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:43.675911 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:43.676690 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:43.677166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:43.690648 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] HTTP exception thrown: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce could not be found. May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Request method failure captured: May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce HTTP/1.1 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdiJehGt7VVrevxio3EvMnE8rz3n-ZaxcJrZ4fgcPVIij64rEk1fk4U4e7sQyB3ViU_uMCzaONOY5J1RunDCAjVOmLOlO_YRkKBbdbVaqKNQwM-ABKWKemN58npkZzC3f38oC0YwhhcoGj8hNgSrawmkYkevdj2dyb-DIROqwDexJho May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 37ac4f4608be4250be4d19c297e4d795 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestMinimumBasicScenario-1513015606 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/37ac4f4608be4250be4d19c297e4d795"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37ac4f4608be4250be4d19c297e4d795"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37ac4f4608be4250be4d19c297e4d795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_37ac4f4608be4250be4d19c297e4d795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestMinimumBasicScenario-1513015606 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 37ac4f4608be4250be4d19c297e4d795 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1513015606 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestMinimumBasicScenario-1513015606-project May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: b69188bf4c224d7e9e6575815c189947 May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestMinimumBasicScenario-1513015606-project May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce could not be found. May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '84ea24b0-1f8b-4e58-89ad-a377c47c80ce'} May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce could not be found. May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce could not be found. May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:43:43.692323 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce could not be found. May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Returning 404 to user: Instance 84ea24b0-1f8b-4e58-89ad-a377c47c80ce could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c1a6ab95-d5a0-421b-b687-8ba29e4a6a5f tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce" status: 404 len: 111 microversion: 2.1 time: 0.031736 May 19 05:43:43.697793 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3485/7058] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:43:43 2022] GET /compute/v2.1/servers/84ea24b0-1f8b-4e58-89ad-a377c47c80ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:43:43.703671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ece57851-bb15-4080-80ce-7f590af2396b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] Calling method '.version_select at 0x7fd314ba8670>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:43.723384 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ece57851-bb15-4080-80ce-7f590af2396b tempest-TestMinimumBasicScenario-1513015606 tempest-TestMinimumBasicScenario-1513015606-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-171439976" status: 202 len: 0 microversion: 2.1 time: 0.023517 May 19 05:43:43.723977 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3574/7059] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 19 05:43:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-171439976 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:43:52.365457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-06c96725-d2cc-4968-9c19-1efe4bca4265 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: .version_select at 0x7fd315a6d280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-418810661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3u3N/JGg1Y5/xwZlX2HRyuoYDgzYSuZ4iId9B3+qZfk94rxkR4th08LbzYg/c9dBvQUHwno1mhZJVSKzB4qEKPUylkRMtQzi65GfbxoX3j7UGbpXW/aAFcylkF5u7HUg=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:43:52.380873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-06c96725-d2cc-4968-9c19-1efe4bca4265 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:43:52.386107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-06c96725-d2cc-4968-9c19-1efe4bca4265 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:43:52.408729 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-06c96725-d2cc-4968-9c19-1efe4bca4265 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.203971 May 19 05:43:52.409371 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3486/7060] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:43:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:43:58.181604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-217364193", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "4022916a-909f-4ae9-9e9a-a759a8e80ed0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-418810661", "security_groups": [{"name": "tempest-secgroup-smoke-929965039"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:43:58.198733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:43:58.199516 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:43:58.303170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] validate_networks() for [('4022916a-909f-4ae9-9e9a-a759a8e80ed0', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:43:58.779372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:43:58.780121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:43:58.780700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:43:58.781231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:43:58.781741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:43:58.801525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:58.802198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:58.803105 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:43:58.803897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:43:58.834751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:43:58.841879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:43:58.857989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:43:58.860603 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:43:58.921993 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-48d348fa-26b7-4600-afc9-4828734c4e9b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.743850 May 19 05:43:58.922541 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3575/7061] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:43:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:43:58.931426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:43:58.938752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6bece11f-911c-4262-8ea4-9118fefa23a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:43:58.940560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6bece11f-911c-4262-8ea4-9118fefa23a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:43:58.948933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:43:59.030505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6bece11f-911c-4262-8ea4-9118fefa23a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:43:59.038543 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6bece11f-911c-4262-8ea4-9118fefa23a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1265 microversion: 2.1 time: 0.110187 May 19 05:43:59.039149 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3487/7062] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:43:58 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:00.058290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d24a7120-4620-4e4b-b2bd-719d8e5515ad tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:00.059547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d24a7120-4620-4e4b-b2bd-719d8e5515ad tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:00.085308 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d24a7120-4620-4e4b-b2bd-719d8e5515ad tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:00.086306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d24a7120-4620-4e4b-b2bd-719d8e5515ad tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:00.087326 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d24a7120-4620-4e4b-b2bd-719d8e5515ad tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:00.087972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d24a7120-4620-4e4b-b2bd-719d8e5515ad tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:00.238132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d24a7120-4620-4e4b-b2bd-719d8e5515ad tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:00.256042 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d24a7120-4620-4e4b-b2bd-719d8e5515ad tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1325 microversion: 2.1 time: 0.203351 May 19 05:44:00.258643 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3576/7063] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:00 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:01.276494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-de9e7c60-8b50-4195-93b8-b98682516e57 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:01.277189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-de9e7c60-8b50-4195-93b8-b98682516e57 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:01.290017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de9e7c60-8b50-4195-93b8-b98682516e57 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:01.290489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de9e7c60-8b50-4195-93b8-b98682516e57 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:01.291556 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de9e7c60-8b50-4195-93b8-b98682516e57 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:01.292033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de9e7c60-8b50-4195-93b8-b98682516e57 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:01.514559 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-de9e7c60-8b50-4195-93b8-b98682516e57 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:01.526213 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-de9e7c60-8b50-4195-93b8-b98682516e57 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1390 microversion: 2.1 time: 0.254822 May 19 05:44:01.527191 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3488/7064] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:01 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:01.670342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-37ad2a1e-17e9-4d89-87a6-5eb621a229a7 req-ffee8d26-95ce-47dc-aea4-771c5b11e0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76b7c110-93d5-4bdc-9327-e3be9511eccc", "tag": "4f002334-0ae8-4919-9da4-e21305a77c4d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:01.680356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-37ad2a1e-17e9-4d89-87a6-5eb621a229a7 req-ffee8d26-95ce-47dc-aea4-771c5b11e0b6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:01.681127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-37ad2a1e-17e9-4d89-87a6-5eb621a229a7 req-ffee8d26-95ce-47dc-aea4-771c5b11e0b6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:01.693321 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-37ad2a1e-17e9-4d89-87a6-5eb621a229a7 req-ffee8d26-95ce-47dc-aea4-771c5b11e0b6 service nova] Creating event network-changed:4f002334-0ae8-4919-9da4-e21305a77c4d for instance 76b7c110-93d5-4bdc-9327-e3be9511eccc on n-h2-766726-30 May 19 05:44:01.698308 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-37ad2a1e-17e9-4d89-87a6-5eb621a229a7 req-ffee8d26-95ce-47dc-aea4-771c5b11e0b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031693 May 19 05:44:01.698937 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3577/7065] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:44:02.543644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-09ce019e-857b-4ae5-9fbf-30bd99d032f0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:02.544264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-09ce019e-857b-4ae5-9fbf-30bd99d032f0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:02.551943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09ce019e-857b-4ae5-9fbf-30bd99d032f0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:02.552400 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09ce019e-857b-4ae5-9fbf-30bd99d032f0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:02.553198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09ce019e-857b-4ae5-9fbf-30bd99d032f0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:02.553645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09ce019e-857b-4ae5-9fbf-30bd99d032f0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:02.681542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-09ce019e-857b-4ae5-9fbf-30bd99d032f0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:02.689024 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-09ce019e-857b-4ae5-9fbf-30bd99d032f0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1390 microversion: 2.1 time: 0.149412 May 19 05:44:02.689635 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3489/7066] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:02 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:03.708125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5055eade-d4a4-45ea-ab92-7c7d03a35314 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:03.708842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5055eade-d4a4-45ea-ab92-7c7d03a35314 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:03.715145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5055eade-d4a4-45ea-ab92-7c7d03a35314 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:03.715601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5055eade-d4a4-45ea-ab92-7c7d03a35314 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:03.716371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5055eade-d4a4-45ea-ab92-7c7d03a35314 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:03.717439 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5055eade-d4a4-45ea-ab92-7c7d03a35314 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:03.855401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5055eade-d4a4-45ea-ab92-7c7d03a35314 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:03.863995 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5055eade-d4a4-45ea-ab92-7c7d03a35314 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1390 microversion: 2.1 time: 0.161184 May 19 05:44:03.864587 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3578/7067] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:03 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:04.880732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6a0e2f1b-ce52-4394-94b9-d9c05906714a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:04.881392 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6a0e2f1b-ce52-4394-94b9-d9c05906714a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:04.888356 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a0e2f1b-ce52-4394-94b9-d9c05906714a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:04.888809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a0e2f1b-ce52-4394-94b9-d9c05906714a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:04.889611 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a0e2f1b-ce52-4394-94b9-d9c05906714a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:04.890057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a0e2f1b-ce52-4394-94b9-d9c05906714a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:05.019895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6a0e2f1b-ce52-4394-94b9-d9c05906714a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:05.028411 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6a0e2f1b-ce52-4394-94b9-d9c05906714a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1390 microversion: 2.1 time: 0.152246 May 19 05:44:05.028988 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3490/7068] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:04 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:06.045261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4a4c3080-ada9-4d95-b0f3-96917e72f879 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:06.046011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4a4c3080-ada9-4d95-b0f3-96917e72f879 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:06.052854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a4c3080-ada9-4d95-b0f3-96917e72f879 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:06.053342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a4c3080-ada9-4d95-b0f3-96917e72f879 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:06.054118 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a4c3080-ada9-4d95-b0f3-96917e72f879 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:06.054571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a4c3080-ada9-4d95-b0f3-96917e72f879 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:06.197737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4a4c3080-ada9-4d95-b0f3-96917e72f879 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:06.205187 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4a4c3080-ada9-4d95-b0f3-96917e72f879 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1390 microversion: 2.1 time: 0.163888 May 19 05:44:06.206405 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3579/7069] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:06 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:07.223125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f27adc9e-2ef1-4d57-b41b-4296b7ba8bf9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:07.223749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f27adc9e-2ef1-4d57-b41b-4296b7ba8bf9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:07.230867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f27adc9e-2ef1-4d57-b41b-4296b7ba8bf9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:07.231327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f27adc9e-2ef1-4d57-b41b-4296b7ba8bf9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:07.232101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f27adc9e-2ef1-4d57-b41b-4296b7ba8bf9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:07.232544 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f27adc9e-2ef1-4d57-b41b-4296b7ba8bf9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:07.366708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f27adc9e-2ef1-4d57-b41b-4296b7ba8bf9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:07.374200 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f27adc9e-2ef1-4d57-b41b-4296b7ba8bf9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1390 microversion: 2.1 time: 0.155201 May 19 05:44:07.374778 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3491/7070] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:07 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:08.196257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-404b27eb-b032-4554-b621-c3e2e53e41ad req-86ed65d6-ec93-433d-92bc-4c24c9d7f939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76b7c110-93d5-4bdc-9327-e3be9511eccc", "name": "network-vif-plugged", "status": "completed", "tag": "4f002334-0ae8-4919-9da4-e21305a77c4d"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:08.206278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-404b27eb-b032-4554-b621-c3e2e53e41ad req-86ed65d6-ec93-433d-92bc-4c24c9d7f939 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:08.206741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-404b27eb-b032-4554-b621-c3e2e53e41ad req-86ed65d6-ec93-433d-92bc-4c24c9d7f939 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:08.218351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-404b27eb-b032-4554-b621-c3e2e53e41ad req-86ed65d6-ec93-433d-92bc-4c24c9d7f939 service nova] Creating event network-vif-plugged:4f002334-0ae8-4919-9da4-e21305a77c4d for instance 76b7c110-93d5-4bdc-9327-e3be9511eccc on n-h2-766726-30 May 19 05:44:08.223351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-404b27eb-b032-4554-b621-c3e2e53e41ad req-86ed65d6-ec93-433d-92bc-4c24c9d7f939 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030983 May 19 05:44:08.223960 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3580/7071] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:44:08.390854 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1faba041-5843-47d0-b461-c575e15c58b4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:08.391472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1faba041-5843-47d0-b461-c575e15c58b4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:08.399023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1faba041-5843-47d0-b461-c575e15c58b4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:08.399470 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1faba041-5843-47d0-b461-c575e15c58b4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:08.400233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1faba041-5843-47d0-b461-c575e15c58b4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:08.400679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1faba041-5843-47d0-b461-c575e15c58b4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:08.531030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1faba041-5843-47d0-b461-c575e15c58b4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:08.538545 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1faba041-5843-47d0-b461-c575e15c58b4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1390 microversion: 2.1 time: 0.151638 May 19 05:44:08.539121 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3492/7072] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:08 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:09.552452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:44:09.553312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:44:09.558258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ec111eae-7471-4f27-9c98-29ae0de4034a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:09.558986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ec111eae-7471-4f27-9c98-29ae0de4034a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:09.569268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec111eae-7471-4f27-9c98-29ae0de4034a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:09.570679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec111eae-7471-4f27-9c98-29ae0de4034a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:09.571495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec111eae-7471-4f27-9c98-29ae0de4034a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:09.571957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ec111eae-7471-4f27-9c98-29ae0de4034a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:09.703297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ec111eae-7471-4f27-9c98-29ae0de4034a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:09.711398 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ec111eae-7471-4f27-9c98-29ae0de4034a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1562 microversion: 2.1 time: 0.159901 May 19 05:44:09.711981 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3581/7073] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:09 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:09.727824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-07d8cb01-e7f2-4d4e-b517-7da702f85263 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:09.728446 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-07d8cb01-e7f2-4d4e-b517-7da702f85263 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:09.730441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:44:09.736853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07d8cb01-e7f2-4d4e-b517-7da702f85263 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:09.737347 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07d8cb01-e7f2-4d4e-b517-7da702f85263 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:09.738118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07d8cb01-e7f2-4d4e-b517-7da702f85263 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:09.738560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-07d8cb01-e7f2-4d4e-b517-7da702f85263 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:09.873137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-07d8cb01-e7f2-4d4e-b517-7da702f85263 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:09.881135 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-07d8cb01-e7f2-4d4e-b517-7da702f85263 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1562 microversion: 2.1 time: 0.157301 May 19 05:44:09.881884 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3493/7074] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:09 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:11.718097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b79c54a-acfe-4dfc-ac31-8f057f7285dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:11.719195 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b79c54a-acfe-4dfc-ac31-8f057f7285dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:11.719846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-1cf8367e-4cdf-48f4-84d9-7e233e316aeb req-918f21e2-1593-457f-a7d3-f3d182d21562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76b7c110-93d5-4bdc-9327-e3be9511eccc", "tag": "4f002334-0ae8-4919-9da4-e21305a77c4d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:11.728121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b79c54a-acfe-4dfc-ac31-8f057f7285dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:11.728815 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b79c54a-acfe-4dfc-ac31-8f057f7285dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:11.729913 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1cf8367e-4cdf-48f4-84d9-7e233e316aeb req-918f21e2-1593-457f-a7d3-f3d182d21562 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:11.730066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b79c54a-acfe-4dfc-ac31-8f057f7285dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:11.730438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b79c54a-acfe-4dfc-ac31-8f057f7285dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:11.730806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-1cf8367e-4cdf-48f4-84d9-7e233e316aeb req-918f21e2-1593-457f-a7d3-f3d182d21562 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:11.746081 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-1cf8367e-4cdf-48f4-84d9-7e233e316aeb req-918f21e2-1593-457f-a7d3-f3d182d21562 service nova] Creating event network-changed:4f002334-0ae8-4919-9da4-e21305a77c4d for instance 76b7c110-93d5-4bdc-9327-e3be9511eccc on n-h2-766726-30 May 19 05:44:11.751584 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-1cf8367e-4cdf-48f4-84d9-7e233e316aeb req-918f21e2-1593-457f-a7d3-f3d182d21562 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036055 May 19 05:44:11.752286 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3494/7075] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:44:11.967781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b79c54a-acfe-4dfc-ac31-8f057f7285dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:11.976030 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b79c54a-acfe-4dfc-ac31-8f057f7285dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1562 microversion: 2.1 time: 0.262990 May 19 05:44:11.989786 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3582/7076] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:11 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1562 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:35.291579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=17 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:44:35.292244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=38 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:44:35.296537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c0fdf75a-9a54-4165-8d00-4e36b02c1c82 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:35.297585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c0fdf75a-9a54-4165-8d00-4e36b02c1c82 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:35.305280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0fdf75a-9a54-4165-8d00-4e36b02c1c82 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:35.305734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0fdf75a-9a54-4165-8d00-4e36b02c1c82 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:35.306503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0fdf75a-9a54-4165-8d00-4e36b02c1c82 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:35.306946 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c0fdf75a-9a54-4165-8d00-4e36b02c1c82 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:35.356710 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c0fdf75a-9a54-4165-8d00-4e36b02c1c82 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action" status: 200 len: 24571 microversion: 2.1 time: 0.067250 May 19 05:44:35.357402 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3495/7077] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:44:35 2022] POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action => generated 24571 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:44:41.705753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9bd47bad-6861-4fc2-8222-a94434a6c215 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:41.706350 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9bd47bad-6861-4fc2-8222-a94434a6c215 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:41.708482 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:44:41.709219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=36 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:44:41.715988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd47bad-6861-4fc2-8222-a94434a6c215 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:41.716730 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd47bad-6861-4fc2-8222-a94434a6c215 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:41.717625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd47bad-6861-4fc2-8222-a94434a6c215 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:41.718086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9bd47bad-6861-4fc2-8222-a94434a6c215 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:41.783609 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9bd47bad-6861-4fc2-8222-a94434a6c215 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action" status: 202 len: 0 microversion: 2.1 time: 0.081863 May 19 05:44:41.784238 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3583/7078] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:44:41 2022] POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:44:41.793473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-431e29fd-81a0-4759-91d5-78e1fd794133 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:41.794176 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-431e29fd-81a0-4759-91d5-78e1fd794133 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:41.802882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-431e29fd-81a0-4759-91d5-78e1fd794133 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:41.803344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-431e29fd-81a0-4759-91d5-78e1fd794133 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:41.804130 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-431e29fd-81a0-4759-91d5-78e1fd794133 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:41.804578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-431e29fd-81a0-4759-91d5-78e1fd794133 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:41.939067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-431e29fd-81a0-4759-91d5-78e1fd794133 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:41.946864 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-431e29fd-81a0-4759-91d5-78e1fd794133 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1685 microversion: 2.1 time: 0.157631 May 19 05:44:41.947433 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3496/7079] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:41 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:42.965985 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-23f51d75-f879-4396-804d-140cd2e5c5c7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:42.966984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-23f51d75-f879-4396-804d-140cd2e5c5c7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:42.973867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23f51d75-f879-4396-804d-140cd2e5c5c7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:42.974335 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23f51d75-f879-4396-804d-140cd2e5c5c7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:42.975116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23f51d75-f879-4396-804d-140cd2e5c5c7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:42.975572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-23f51d75-f879-4396-804d-140cd2e5c5c7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:43.110158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-23f51d75-f879-4396-804d-140cd2e5c5c7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:43.117789 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-23f51d75-f879-4396-804d-140cd2e5c5c7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1665 microversion: 2.1 time: 0.157241 May 19 05:44:43.118357 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3584/7080] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:42 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:44.201664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a502de4-5000-409e-9933-4db0321e4bff tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:44.202591 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2a502de4-5000-409e-9933-4db0321e4bff tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:44.210930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a502de4-5000-409e-9933-4db0321e4bff tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:44.211384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a502de4-5000-409e-9933-4db0321e4bff tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:44.212156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a502de4-5000-409e-9933-4db0321e4bff tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:44.212596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2a502de4-5000-409e-9933-4db0321e4bff tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:44.259143 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a502de4-5000-409e-9933-4db0321e4bff tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action" status: 200 len: 32652 microversion: 2.1 time: 0.061322 May 19 05:44:44.259773 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3497/7081] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:44:44 2022] POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action => generated 32652 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:44:44.271247 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2f6e4894-450c-4a34-ada6-ee36dbfd4921 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:44.271799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2f6e4894-450c-4a34-ada6-ee36dbfd4921 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:44.278738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f6e4894-450c-4a34-ada6-ee36dbfd4921 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:44.279199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f6e4894-450c-4a34-ada6-ee36dbfd4921 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:44.279996 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f6e4894-450c-4a34-ada6-ee36dbfd4921 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:44.280443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f6e4894-450c-4a34-ada6-ee36dbfd4921 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:44.346280 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2f6e4894-450c-4a34-ada6-ee36dbfd4921 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action" status: 202 len: 0 microversion: 2.1 time: 0.079324 May 19 05:44:44.346928 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3585/7082] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:44:44 2022] POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:44:44.356291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4020c5d7-1fd3-44bf-8a30-93757c020176 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:44.357134 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4020c5d7-1fd3-44bf-8a30-93757c020176 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:44.364977 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4020c5d7-1fd3-44bf-8a30-93757c020176 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:44.365459 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4020c5d7-1fd3-44bf-8a30-93757c020176 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:44.366244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4020c5d7-1fd3-44bf-8a30-93757c020176 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:44.366691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4020c5d7-1fd3-44bf-8a30-93757c020176 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:44.513900 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4020c5d7-1fd3-44bf-8a30-93757c020176 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:44.526089 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4020c5d7-1fd3-44bf-8a30-93757c020176 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1672 microversion: 2.1 time: 0.173908 May 19 05:44:44.526696 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3498/7083] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:44 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:45.546163 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9df1be80-4cea-410a-b1e0-c739b9703de6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:45.546873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9df1be80-4cea-410a-b1e0-c739b9703de6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:45.553167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9df1be80-4cea-410a-b1e0-c739b9703de6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:45.553630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9df1be80-4cea-410a-b1e0-c739b9703de6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:45.554398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9df1be80-4cea-410a-b1e0-c739b9703de6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:45.554844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9df1be80-4cea-410a-b1e0-c739b9703de6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:45.687817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9df1be80-4cea-410a-b1e0-c739b9703de6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:45.695984 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9df1be80-4cea-410a-b1e0-c739b9703de6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1680 microversion: 2.1 time: 0.154996 May 19 05:44:45.696568 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3586/7084] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:45 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:45.785016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f5b4a7f2-7979-4786-b57c-4bd72f5916fd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:45.786015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f5b4a7f2-7979-4786-b57c-4bd72f5916fd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:45.793877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f5b4a7f2-7979-4786-b57c-4bd72f5916fd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:45.794333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f5b4a7f2-7979-4786-b57c-4bd72f5916fd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:45.795107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f5b4a7f2-7979-4786-b57c-4bd72f5916fd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:45.795555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f5b4a7f2-7979-4786-b57c-4bd72f5916fd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:45.844476 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f5b4a7f2-7979-4786-b57c-4bd72f5916fd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action" status: 200 len: 38303 microversion: 2.1 time: 0.063261 May 19 05:44:45.845165 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3499/7085] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:44:45 2022] POST /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc/action => generated 38303 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:44:46.799465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ba73fcf4-485d-47e1-9266-1fa084a955e4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:46.799995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba73fcf4-485d-47e1-9266-1fa084a955e4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:46.802338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-350b07cc-ac1d-4599-b8d4-2c95b827196c req-028e2e6a-6671-4295-bf24-23fdf23d37b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76b7c110-93d5-4bdc-9327-e3be9511eccc", "tag": "4f002334-0ae8-4919-9da4-e21305a77c4d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:46.808048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba73fcf4-485d-47e1-9266-1fa084a955e4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:46.808763 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba73fcf4-485d-47e1-9266-1fa084a955e4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:46.809637 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba73fcf4-485d-47e1-9266-1fa084a955e4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:46.810091 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ba73fcf4-485d-47e1-9266-1fa084a955e4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:46.814353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-350b07cc-ac1d-4599-b8d4-2c95b827196c req-028e2e6a-6671-4295-bf24-23fdf23d37b4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:46.815152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-350b07cc-ac1d-4599-b8d4-2c95b827196c req-028e2e6a-6671-4295-bf24-23fdf23d37b4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:46.828326 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-350b07cc-ac1d-4599-b8d4-2c95b827196c req-028e2e6a-6671-4295-bf24-23fdf23d37b4 service nova] Creating event network-changed:4f002334-0ae8-4919-9da4-e21305a77c4d for instance 76b7c110-93d5-4bdc-9327-e3be9511eccc on n-h2-766726-30 May 19 05:44:46.833939 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-350b07cc-ac1d-4599-b8d4-2c95b827196c req-028e2e6a-6671-4295-bf24-23fdf23d37b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036283 May 19 05:44:46.834881 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3500/7086] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:44:46.838497 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ba73fcf4-485d-47e1-9266-1fa084a955e4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:44:46.934390 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ba73fcf4-485d-47e1-9266-1fa084a955e4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 204 len: 0 microversion: 2.1 time: 0.138861 May 19 05:44:46.935738 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3587/7087] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:44:46 2022] DELETE /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:44:46.946309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6b60af1-572c-4c84-bf22-7ece9b824bdd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:46.947020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b6b60af1-572c-4c84-bf22-7ece9b824bdd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:46.954468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6b60af1-572c-4c84-bf22-7ece9b824bdd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:46.954927 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6b60af1-572c-4c84-bf22-7ece9b824bdd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:46.955709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6b60af1-572c-4c84-bf22-7ece9b824bdd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:46.956360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6b60af1-572c-4c84-bf22-7ece9b824bdd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:47.184290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b6b60af1-572c-4c84-bf22-7ece9b824bdd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:47.192221 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6b60af1-572c-4c84-bf22-7ece9b824bdd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1686 microversion: 2.1 time: 0.251441 May 19 05:44:47.192917 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3501/7088] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:46 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1686 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:48.211428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-37af6114-0934-4940-a3dd-29a2f51abd90 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:48.212348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-37af6114-0934-4940-a3dd-29a2f51abd90 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:48.223719 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37af6114-0934-4940-a3dd-29a2f51abd90 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:48.224184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37af6114-0934-4940-a3dd-29a2f51abd90 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:48.225197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37af6114-0934-4940-a3dd-29a2f51abd90 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:48.226073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-37af6114-0934-4940-a3dd-29a2f51abd90 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:48.597868 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-37af6114-0934-4940-a3dd-29a2f51abd90 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:48.606250 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-37af6114-0934-4940-a3dd-29a2f51abd90 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 200 len: 1686 microversion: 2.1 time: 0.399209 May 19 05:44:48.606844 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3588/7089] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:48 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 1686 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:44:49.023910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bbfb783c-8cae-433e-acca-ef616844890a req-d447fa18-11bd-4065-91af-b0ef8f9d19ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76b7c110-93d5-4bdc-9327-e3be9511eccc", "name": "network-vif-deleted", "tag": "4f002334-0ae8-4919-9da4-e21305a77c4d"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:49.033424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bbfb783c-8cae-433e-acca-ef616844890a req-d447fa18-11bd-4065-91af-b0ef8f9d19ad service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:49.033877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bbfb783c-8cae-433e-acca-ef616844890a req-d447fa18-11bd-4065-91af-b0ef8f9d19ad service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:49.046502 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bbfb783c-8cae-433e-acca-ef616844890a req-d447fa18-11bd-4065-91af-b0ef8f9d19ad service nova] Creating event network-vif-deleted:4f002334-0ae8-4919-9da4-e21305a77c4d for instance 76b7c110-93d5-4bdc-9327-e3be9511eccc on n-h2-766726-30 May 19 05:44:49.051429 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bbfb783c-8cae-433e-acca-ef616844890a req-d447fa18-11bd-4065-91af-b0ef8f9d19ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031769 May 19 05:44:49.052025 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3502/7090] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:44:49.624103 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:49.624734 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 76b7c110-93d5-4bdc-9327-e3be9511eccc] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:49.632405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:49.632873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:49.633694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:49.634148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:49.647958 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] HTTP exception thrown: Instance 76b7c110-93d5-4bdc-9327-e3be9511eccc could not be found. May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Request method failure captured: May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc HTTP/1.1 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdkX6Q-mHJHc-Qf4dH9OyPZeYKkTAwwAkZHuSFjw1ifeHS0owpYaW-O2ut81RUXMcNyEzMnh3k8Xq9imMzE-MGBKWhUF_3lv7wUFKNnOUnJVxSM2enVNbzWJluamSO0KE75ANYPbZOZxbRYCCqI0K5-EJC1osydmnlQ1xZBDQZoDqoU May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: f34ee9fba7ea4656831eb1f98bd79813 May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 76b7c110-93d5-4bdc-9327-e3be9511eccc could not be found. May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '76b7c110-93d5-4bdc-9327-e3be9511eccc'} May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76b7c110-93d5-4bdc-9327-e3be9511eccc could not be found. May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76b7c110-93d5-4bdc-9327-e3be9511eccc could not be found. May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:44:49.649756 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76b7c110-93d5-4bdc-9327-e3be9511eccc could not be found. May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Returning 404 to user: Instance 76b7c110-93d5-4bdc-9327-e3be9511eccc could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3ceb2d15-28a2-49fd-b1db-c3b1f725fe8b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc" status: 404 len: 111 microversion: 2.1 time: 0.031124 May 19 05:44:49.655354 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3589/7091] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:49 2022] GET /compute/v2.1/servers/76b7c110-93d5-4bdc-9327-e3be9511eccc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:44:52.882996 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-817e1cef-a8e1-44d3-95d0-a9c2c70bd62a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '.version_select at 0x7fd3144033a0>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:52.904931 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-817e1cef-a8e1-44d3-95d0-a9c2c70bd62a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-418810661" status: 202 len: 0 microversion: 2.1 time: 0.027829 May 19 05:44:52.906601 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3503/7092] 10.222.0.58 () {58 vars in 1280 bytes} [Thu May 19 05:44:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-418810661 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:44:52.935361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35730dbf-38ad-4597-aa93-c4ee35a1ad16 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: .version_select at 0x7fd314b2c430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-630713999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSGh6ApUMq4Pf//cf7wG4ACbWqfpuniWn3Ek5qgQHP8w5iTE4TK25ibVHg+xaSh3fgwvz9n41OY7wo59JcRKV4AZJ08hlhb/qFID7F8//mYwVS64pY3VkdLAGbNbXOb9Q=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:52.951673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-35730dbf-38ad-4597-aa93-c4ee35a1ad16 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:44:52.957010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-35730dbf-38ad-4597-aa93-c4ee35a1ad16 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:44:52.980491 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-35730dbf-38ad-4597-aa93-c4ee35a1ad16 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049582 May 19 05:44:52.981164 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3590/7093] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:44:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:44:58.776709 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1829126599", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "55101a21-f455-4a7f-9ec0-69dd31501e6d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-630713999", "security_groups": [{"name": "tempest-secgroup-smoke-1151800566"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:44:58.904348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] validate_networks() for [('55101a21-f455-4a7f-9ec0-69dd31501e6d', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:44:59.038959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=34 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:44:59.374203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:44:59.375172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:44:59.375926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:44:59.376338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:44:59.376749 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:44:59.385695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:59.386145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:59.386942 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:44:59.387379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:44:59.404345 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:44:59.409679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:44:59.422471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:44:59.424848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:44:59.472588 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1be72137-455a-466c-b4ae-f91c7e8444f3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700843 May 19 05:44:59.474166 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3504/7094] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:44:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:44:59.485331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-03446e1f-a812-4d99-b920-78f1c2509311 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:44:59.486060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-03446e1f-a812-4d99-b920-78f1c2509311 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:44:59.544652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-03446e1f-a812-4d99-b920-78f1c2509311 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:44:59.553308 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-03446e1f-a812-4d99-b920-78f1c2509311 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1266 microversion: 2.1 time: 0.072921 May 19 05:44:59.554013 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3591/7095] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:44:59 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:45:00.571535 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-09f922c5-2ac8-428a-81c5-27ee83e7507a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:00.572182 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-09f922c5-2ac8-428a-81c5-27ee83e7507a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:00.580129 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09f922c5-2ac8-428a-81c5-27ee83e7507a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:00.580588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09f922c5-2ac8-428a-81c5-27ee83e7507a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:00.581417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09f922c5-2ac8-428a-81c5-27ee83e7507a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:00.581845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-09f922c5-2ac8-428a-81c5-27ee83e7507a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:00.695990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-09f922c5-2ac8-428a-81c5-27ee83e7507a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:00.740783 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-09f922c5-2ac8-428a-81c5-27ee83e7507a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1318 microversion: 2.1 time: 0.161505 May 19 05:45:00.744076 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3505/7096] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:00 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:01.760389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ac932d87-3a62-4034-9730-14dd2f7300ce tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:01.762225 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ac932d87-3a62-4034-9730-14dd2f7300ce tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:01.764717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:01.772568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac932d87-3a62-4034-9730-14dd2f7300ce tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:01.773274 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac932d87-3a62-4034-9730-14dd2f7300ce tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:01.774348 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac932d87-3a62-4034-9730-14dd2f7300ce tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:01.775316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ac932d87-3a62-4034-9730-14dd2f7300ce tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:01.992410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ac932d87-3a62-4034-9730-14dd2f7300ce tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:02.003871 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ac932d87-3a62-4034-9730-14dd2f7300ce tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1392 microversion: 2.1 time: 0.247711 May 19 05:45:02.004834 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3592/7097] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:01 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:02.310301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-9818efcd-eb44-4258-a138-22edb43d12df req-614f33f9-3542-4902-be05-2541c4649720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9c472a-616d-46a7-bd9d-d74623921504", "tag": "a620a559-328d-47b6-bbde-699aae5e9225"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:45:02.329276 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9818efcd-eb44-4258-a138-22edb43d12df req-614f33f9-3542-4902-be05-2541c4649720 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:02.332985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-9818efcd-eb44-4258-a138-22edb43d12df req-614f33f9-3542-4902-be05-2541c4649720 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:02.354989 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-9818efcd-eb44-4258-a138-22edb43d12df req-614f33f9-3542-4902-be05-2541c4649720 service nova] Creating event network-changed:a620a559-328d-47b6-bbde-699aae5e9225 for instance 7c9c472a-616d-46a7-bd9d-d74623921504 on n-h2-766726-30 May 19 05:45:02.360297 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-9818efcd-eb44-4258-a138-22edb43d12df req-614f33f9-3542-4902-be05-2541c4649720 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053734 May 19 05:45:02.360993 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3506/7098] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:45:03.025569 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-254c8336-87f6-4b38-bcdf-8807b802606b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:03.026210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-254c8336-87f6-4b38-bcdf-8807b802606b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:03.033365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-254c8336-87f6-4b38-bcdf-8807b802606b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:03.033837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-254c8336-87f6-4b38-bcdf-8807b802606b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:03.034622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-254c8336-87f6-4b38-bcdf-8807b802606b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:03.035077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-254c8336-87f6-4b38-bcdf-8807b802606b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:03.167430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-254c8336-87f6-4b38-bcdf-8807b802606b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:03.174962 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-254c8336-87f6-4b38-bcdf-8807b802606b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1392 microversion: 2.1 time: 0.153370 May 19 05:45:03.175537 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3593/7099] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:03 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:04.193238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7dbab8b8-e6f8-416f-95da-21ec093257e0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:04.193877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7dbab8b8-e6f8-416f-95da-21ec093257e0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:04.200180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dbab8b8-e6f8-416f-95da-21ec093257e0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:04.200628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dbab8b8-e6f8-416f-95da-21ec093257e0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:04.201412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dbab8b8-e6f8-416f-95da-21ec093257e0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:04.201850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7dbab8b8-e6f8-416f-95da-21ec093257e0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:04.343247 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7dbab8b8-e6f8-416f-95da-21ec093257e0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:04.350720 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7dbab8b8-e6f8-416f-95da-21ec093257e0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1392 microversion: 2.1 time: 0.162725 May 19 05:45:04.351294 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3507/7100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:04 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:05.367753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9c5f3e64-8e67-413e-8e8d-69da07eeaf14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:05.368382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9c5f3e64-8e67-413e-8e8d-69da07eeaf14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:05.375330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c5f3e64-8e67-413e-8e8d-69da07eeaf14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:05.375797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c5f3e64-8e67-413e-8e8d-69da07eeaf14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:05.376575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c5f3e64-8e67-413e-8e8d-69da07eeaf14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:05.377033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9c5f3e64-8e67-413e-8e8d-69da07eeaf14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:05.505481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9c5f3e64-8e67-413e-8e8d-69da07eeaf14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:05.513246 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9c5f3e64-8e67-413e-8e8d-69da07eeaf14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1392 microversion: 2.1 time: 0.149949 May 19 05:45:05.513796 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3594/7101] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:05 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:06.530874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-11fed1a9-c700-4ae7-9bc5-f3dc093348ed tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:06.531497 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-11fed1a9-c700-4ae7-9bc5-f3dc093348ed tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:06.534381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:06.540377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11fed1a9-c700-4ae7-9bc5-f3dc093348ed tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:06.540829 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11fed1a9-c700-4ae7-9bc5-f3dc093348ed tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:06.541639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11fed1a9-c700-4ae7-9bc5-f3dc093348ed tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:06.542084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-11fed1a9-c700-4ae7-9bc5-f3dc093348ed tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:06.678711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-11fed1a9-c700-4ae7-9bc5-f3dc093348ed tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:06.686711 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-11fed1a9-c700-4ae7-9bc5-f3dc093348ed tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1392 microversion: 2.1 time: 0.159813 May 19 05:45:06.687302 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3508/7102] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:06 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:07.703221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-523638d1-6301-4c7e-a0ae-468d7e652a48 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:07.703881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-523638d1-6301-4c7e-a0ae-468d7e652a48 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:07.711036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-523638d1-6301-4c7e-a0ae-468d7e652a48 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:07.711503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-523638d1-6301-4c7e-a0ae-468d7e652a48 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:07.712414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-523638d1-6301-4c7e-a0ae-468d7e652a48 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:07.712906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-523638d1-6301-4c7e-a0ae-468d7e652a48 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:07.843184 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-523638d1-6301-4c7e-a0ae-468d7e652a48 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:07.850727 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-523638d1-6301-4c7e-a0ae-468d7e652a48 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1392 microversion: 2.1 time: 0.151424 May 19 05:45:07.851307 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3595/7103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:07 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:08.353919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6e1cd9cc-1c15-4f55-9595-b3daeb09d836 req-2a2da8ef-ea38-4e0d-ab12-19b53160c213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9c472a-616d-46a7-bd9d-d74623921504", "name": "network-vif-plugged", "status": "completed", "tag": "a620a559-328d-47b6-bbde-699aae5e9225"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:45:08.362795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6e1cd9cc-1c15-4f55-9595-b3daeb09d836 req-2a2da8ef-ea38-4e0d-ab12-19b53160c213 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:08.363240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6e1cd9cc-1c15-4f55-9595-b3daeb09d836 req-2a2da8ef-ea38-4e0d-ab12-19b53160c213 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:08.375519 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6e1cd9cc-1c15-4f55-9595-b3daeb09d836 req-2a2da8ef-ea38-4e0d-ab12-19b53160c213 service nova] Creating event network-vif-plugged:a620a559-328d-47b6-bbde-699aae5e9225 for instance 7c9c472a-616d-46a7-bd9d-d74623921504 on n-h2-766726-30 May 19 05:45:08.380578 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6e1cd9cc-1c15-4f55-9595-b3daeb09d836 req-2a2da8ef-ea38-4e0d-ab12-19b53160c213 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030451 May 19 05:45:08.381249 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3509/7104] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:45:08.868167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b450d83e-a176-417d-b9a9-a0d4cc30fd91 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:08.868823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b450d83e-a176-417d-b9a9-a0d4cc30fd91 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:08.875913 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b450d83e-a176-417d-b9a9-a0d4cc30fd91 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:08.876374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b450d83e-a176-417d-b9a9-a0d4cc30fd91 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:08.877170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b450d83e-a176-417d-b9a9-a0d4cc30fd91 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:08.877623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b450d83e-a176-417d-b9a9-a0d4cc30fd91 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:09.013468 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b450d83e-a176-417d-b9a9-a0d4cc30fd91 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:09.020999 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b450d83e-a176-417d-b9a9-a0d4cc30fd91 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1392 microversion: 2.1 time: 0.157362 May 19 05:45:09.021619 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3596/7105] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:08 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:10.035987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:10.036754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:10.041220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-12f7579d-d3a4-44f0-bc9c-cd83d2967f36 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:10.041962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-12f7579d-d3a4-44f0-bc9c-cd83d2967f36 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:10.049527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12f7579d-d3a4-44f0-bc9c-cd83d2967f36 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:10.049982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12f7579d-d3a4-44f0-bc9c-cd83d2967f36 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:10.050752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12f7579d-d3a4-44f0-bc9c-cd83d2967f36 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:10.051836 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-12f7579d-d3a4-44f0-bc9c-cd83d2967f36 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:10.186423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-12f7579d-d3a4-44f0-bc9c-cd83d2967f36 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:10.194592 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-12f7579d-d3a4-44f0-bc9c-cd83d2967f36 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1564 microversion: 2.1 time: 0.160465 May 19 05:45:10.195179 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3510/7106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:10 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:10.210417 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4331427e-f69e-4140-9afc-4f4c881969a3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:10.211035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4331427e-f69e-4140-9afc-4f4c881969a3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:10.212880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:10.219183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4331427e-f69e-4140-9afc-4f4c881969a3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:10.219645 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4331427e-f69e-4140-9afc-4f4c881969a3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:10.220420 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4331427e-f69e-4140-9afc-4f4c881969a3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:10.220866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4331427e-f69e-4140-9afc-4f4c881969a3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:10.355317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4331427e-f69e-4140-9afc-4f4c881969a3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:10.362895 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4331427e-f69e-4140-9afc-4f4c881969a3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1564 microversion: 2.1 time: 0.156361 May 19 05:45:10.363471 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3597/7107] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:10 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:11.957110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-3fba20b5-1bb5-4f6f-973a-df8121c89af8 req-a9e85d47-cbe3-4fd9-acbe-8d636ef10354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9c472a-616d-46a7-bd9d-d74623921504", "tag": "a620a559-328d-47b6-bbde-699aae5e9225"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:45:11.960864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b764a935-e32c-4181-84fc-2d0b73f193fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:11.961527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b764a935-e32c-4181-84fc-2d0b73f193fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:11.969894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:11.975814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b764a935-e32c-4181-84fc-2d0b73f193fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:11.976359 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b764a935-e32c-4181-84fc-2d0b73f193fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:11.977221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b764a935-e32c-4181-84fc-2d0b73f193fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:11.977340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3fba20b5-1bb5-4f6f-973a-df8121c89af8 req-a9e85d47-cbe3-4fd9-acbe-8d636ef10354 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:11.977671 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b764a935-e32c-4181-84fc-2d0b73f193fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:11.977840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-3fba20b5-1bb5-4f6f-973a-df8121c89af8 req-a9e85d47-cbe3-4fd9-acbe-8d636ef10354 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:11.991694 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-3fba20b5-1bb5-4f6f-973a-df8121c89af8 req-a9e85d47-cbe3-4fd9-acbe-8d636ef10354 service nova] Creating event network-changed:a620a559-328d-47b6-bbde-699aae5e9225 for instance 7c9c472a-616d-46a7-bd9d-d74623921504 on n-h2-766726-30 May 19 05:45:11.997722 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-3fba20b5-1bb5-4f6f-973a-df8121c89af8 req-a9e85d47-cbe3-4fd9-acbe-8d636ef10354 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044235 May 19 05:45:11.998557 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3598/7108] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:45:12.208045 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b764a935-e32c-4181-84fc-2d0b73f193fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:12.217929 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b764a935-e32c-4181-84fc-2d0b73f193fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1564 microversion: 2.1 time: 0.267233 May 19 05:45:12.218528 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3511/7109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:11 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1564 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:35.449731 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=38 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:35.450481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:35.454685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b73193fc-22f8-4f33-ba50-b2ca17058ec0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:45:35.455704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b73193fc-22f8-4f33-ba50-b2ca17058ec0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:35.463143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b73193fc-22f8-4f33-ba50-b2ca17058ec0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:35.463602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b73193fc-22f8-4f33-ba50-b2ca17058ec0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:35.464373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b73193fc-22f8-4f33-ba50-b2ca17058ec0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:35.464822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-b73193fc-22f8-4f33-ba50-b2ca17058ec0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:35.514194 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b73193fc-22f8-4f33-ba50-b2ca17058ec0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504/action" status: 200 len: 24568 microversion: 2.1 time: 0.066292 May 19 05:45:35.514837 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3599/7110] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:45:35 2022] POST /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504/action => generated 24568 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:45:41.929452 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e98af30-1130-4fa5-ba2d-b091b88d705a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:45:41.930463 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e98af30-1130-4fa5-ba2d-b091b88d705a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:41.932498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=7 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:41.933172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=36 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:45:41.939159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e98af30-1130-4fa5-ba2d-b091b88d705a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:41.939605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e98af30-1130-4fa5-ba2d-b091b88d705a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:41.940367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e98af30-1130-4fa5-ba2d-b091b88d705a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:41.940803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e98af30-1130-4fa5-ba2d-b091b88d705a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:42.015672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e98af30-1130-4fa5-ba2d-b091b88d705a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504/action" status: 202 len: 0 microversion: 2.1 time: 0.090965 May 19 05:45:42.019596 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3512/7111] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:45:41 2022] POST /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:45:42.025494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-01bf043b-b563-402c-8e09-cf850f9315e9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:42.026210 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-01bf043b-b563-402c-8e09-cf850f9315e9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:42.033850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01bf043b-b563-402c-8e09-cf850f9315e9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:42.034325 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01bf043b-b563-402c-8e09-cf850f9315e9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:42.035096 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01bf043b-b563-402c-8e09-cf850f9315e9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:42.036100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-01bf043b-b563-402c-8e09-cf850f9315e9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:42.223908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-01bf043b-b563-402c-8e09-cf850f9315e9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:42.231487 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-01bf043b-b563-402c-8e09-cf850f9315e9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1674 microversion: 2.1 time: 0.210371 May 19 05:45:42.232302 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3600/7112] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:42 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:43.249316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a5f4ec96-c862-44c2-a331-f4fd98cc9bc8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:43.250024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a5f4ec96-c862-44c2-a331-f4fd98cc9bc8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:43.257837 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5f4ec96-c862-44c2-a331-f4fd98cc9bc8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:43.258293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5f4ec96-c862-44c2-a331-f4fd98cc9bc8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:43.259060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5f4ec96-c862-44c2-a331-f4fd98cc9bc8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:43.259502 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a5f4ec96-c862-44c2-a331-f4fd98cc9bc8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:43.389159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a5f4ec96-c862-44c2-a331-f4fd98cc9bc8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:43.397351 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a5f4ec96-c862-44c2-a331-f4fd98cc9bc8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1679 microversion: 2.1 time: 0.152339 May 19 05:45:43.397931 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3513/7113] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:43 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:44.414934 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31c24cb8-f879-4e21-9ccf-cb39e05f458f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:44.415536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-31c24cb8-f879-4e21-9ccf-cb39e05f458f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:44.423549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31c24cb8-f879-4e21-9ccf-cb39e05f458f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:44.424004 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31c24cb8-f879-4e21-9ccf-cb39e05f458f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:44.424795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31c24cb8-f879-4e21-9ccf-cb39e05f458f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:44.425300 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31c24cb8-f879-4e21-9ccf-cb39e05f458f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:44.560596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31c24cb8-f879-4e21-9ccf-cb39e05f458f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:44.568263 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-31c24cb8-f879-4e21-9ccf-cb39e05f458f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1679 microversion: 2.1 time: 0.157408 May 19 05:45:44.568850 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3601/7114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:44 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:45.587522 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b0352d79-76a3-45e7-ab31-5acb28caa900 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:45.588196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b0352d79-76a3-45e7-ab31-5acb28caa900 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:45.597145 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0352d79-76a3-45e7-ab31-5acb28caa900 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:45.597600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0352d79-76a3-45e7-ab31-5acb28caa900 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:45.598467 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0352d79-76a3-45e7-ab31-5acb28caa900 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:45.598908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b0352d79-76a3-45e7-ab31-5acb28caa900 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:45.732874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b0352d79-76a3-45e7-ab31-5acb28caa900 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:45.740415 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b0352d79-76a3-45e7-ab31-5acb28caa900 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1679 microversion: 2.1 time: 0.157608 May 19 05:45:45.740995 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3514/7115] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:45 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:46.761164 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af41b84a-efd8-46e4-9cc6-972fa3615ef7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:46.761818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af41b84a-efd8-46e4-9cc6-972fa3615ef7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:46.767879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af41b84a-efd8-46e4-9cc6-972fa3615ef7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:46.768339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af41b84a-efd8-46e4-9cc6-972fa3615ef7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:46.769147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af41b84a-efd8-46e4-9cc6-972fa3615ef7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:46.769599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af41b84a-efd8-46e4-9cc6-972fa3615ef7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:46.912095 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-af41b84a-efd8-46e4-9cc6-972fa3615ef7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:46.919734 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af41b84a-efd8-46e4-9cc6-972fa3615ef7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1679 microversion: 2.1 time: 0.166049 May 19 05:45:46.920310 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3602/7116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:46 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:47.937644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-db3ebf98-9b72-43e3-aa5a-a68cbfaf2e96 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:47.938306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-db3ebf98-9b72-43e3-aa5a-a68cbfaf2e96 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:47.945377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db3ebf98-9b72-43e3-aa5a-a68cbfaf2e96 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:47.945834 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db3ebf98-9b72-43e3-aa5a-a68cbfaf2e96 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:47.946608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db3ebf98-9b72-43e3-aa5a-a68cbfaf2e96 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:47.947054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-db3ebf98-9b72-43e3-aa5a-a68cbfaf2e96 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:48.076691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-db3ebf98-9b72-43e3-aa5a-a68cbfaf2e96 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:48.084254 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-db3ebf98-9b72-43e3-aa5a-a68cbfaf2e96 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1679 microversion: 2.1 time: 0.150862 May 19 05:45:48.084833 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3515/7117] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:47 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:49.102889 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c1fea3f1-3d64-404a-bd4b-e66d0f279bf6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:49.103601 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c1fea3f1-3d64-404a-bd4b-e66d0f279bf6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:49.110651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1fea3f1-3d64-404a-bd4b-e66d0f279bf6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:49.111115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1fea3f1-3d64-404a-bd4b-e66d0f279bf6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:49.112036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1fea3f1-3d64-404a-bd4b-e66d0f279bf6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:49.112602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1fea3f1-3d64-404a-bd4b-e66d0f279bf6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:49.250106 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c1fea3f1-3d64-404a-bd4b-e66d0f279bf6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:49.258430 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c1fea3f1-3d64-404a-bd4b-e66d0f279bf6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1679 microversion: 2.1 time: 0.159670 May 19 05:45:49.259013 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3603/7118] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:49 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:50.276123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9a61a682-adcd-4241-9bfb-508a3f4d57cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:50.276745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9a61a682-adcd-4241-9bfb-508a3f4d57cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:50.284034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a61a682-adcd-4241-9bfb-508a3f4d57cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:50.284488 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a61a682-adcd-4241-9bfb-508a3f4d57cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:50.285294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a61a682-adcd-4241-9bfb-508a3f4d57cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:50.285740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a61a682-adcd-4241-9bfb-508a3f4d57cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:50.420958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9a61a682-adcd-4241-9bfb-508a3f4d57cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:50.429468 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9a61a682-adcd-4241-9bfb-508a3f4d57cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1679 microversion: 2.1 time: 0.157267 May 19 05:45:50.430053 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3516/7119] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:50 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:51.447194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-86f77fa9-aba6-44e1-b265-d34581b9410d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:51.447821 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-86f77fa9-aba6-44e1-b265-d34581b9410d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:51.454679 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86f77fa9-aba6-44e1-b265-d34581b9410d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:51.455226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86f77fa9-aba6-44e1-b265-d34581b9410d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:51.456006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86f77fa9-aba6-44e1-b265-d34581b9410d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:51.456491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-86f77fa9-aba6-44e1-b265-d34581b9410d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:51.588975 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-86f77fa9-aba6-44e1-b265-d34581b9410d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:51.596876 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-86f77fa9-aba6-44e1-b265-d34581b9410d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1679 microversion: 2.1 time: 0.153674 May 19 05:45:51.597486 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3604/7120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:51 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:52.614311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-de11ea91-bfd2-4e0d-8999-be71f00027d4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:52.614934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-de11ea91-bfd2-4e0d-8999-be71f00027d4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:52.621529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de11ea91-bfd2-4e0d-8999-be71f00027d4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:52.621985 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de11ea91-bfd2-4e0d-8999-be71f00027d4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:52.622753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de11ea91-bfd2-4e0d-8999-be71f00027d4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:52.623192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-de11ea91-bfd2-4e0d-8999-be71f00027d4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:52.756192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-de11ea91-bfd2-4e0d-8999-be71f00027d4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:52.763791 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-de11ea91-bfd2-4e0d-8999-be71f00027d4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1679 microversion: 2.1 time: 0.154020 May 19 05:45:52.764360 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3517/7121] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:52 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:45:53.781233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-680e0afd-521f-471c-ad30-175442ccecaf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:45:53.781869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-680e0afd-521f-471c-ad30-175442ccecaf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:45:53.789472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-680e0afd-521f-471c-ad30-175442ccecaf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:53.789946 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-680e0afd-521f-471c-ad30-175442ccecaf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:53.790753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-680e0afd-521f-471c-ad30-175442ccecaf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:45:53.791209 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-680e0afd-521f-471c-ad30-175442ccecaf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:45:53.922961 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-680e0afd-521f-471c-ad30-175442ccecaf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:45:53.931217 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-680e0afd-521f-471c-ad30-175442ccecaf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1682 microversion: 2.1 time: 0.154076 May 19 05:45:53.931794 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3605/7122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:45:53 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:18.117701 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fe67b511-2c89-4433-b14e-c99684e673c0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:46:18.118697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fe67b511-2c89-4433-b14e-c99684e673c0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:18.121939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=12 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:18.122620 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:18.128806 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe67b511-2c89-4433-b14e-c99684e673c0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:18.129298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe67b511-2c89-4433-b14e-c99684e673c0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:18.130097 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe67b511-2c89-4433-b14e-c99684e673c0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:18.130545 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fe67b511-2c89-4433-b14e-c99684e673c0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:18.191069 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fe67b511-2c89-4433-b14e-c99684e673c0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504/action" status: 200 len: 69080 microversion: 2.1 time: 0.078102 May 19 05:46:18.192071 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3518/7123] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:46:18 2022] POST /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504/action => generated 69080 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:46:25.172540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aab6434b-12f1-4d88-a040-82e77dc41c19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:25.173069 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aab6434b-12f1-4d88-a040-82e77dc41c19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:25.184558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=14 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:25.185428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=40 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:25.189772 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aab6434b-12f1-4d88-a040-82e77dc41c19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:25.190448 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aab6434b-12f1-4d88-a040-82e77dc41c19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:25.191264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aab6434b-12f1-4d88-a040-82e77dc41c19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:25.191723 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aab6434b-12f1-4d88-a040-82e77dc41c19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:25.219131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aab6434b-12f1-4d88-a040-82e77dc41c19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:46:25.238260 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6174deba-fde2-4636-92f9-06d47a1e5fd2 req-706f7efe-94cc-4173-803a-f493e5761d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9c472a-616d-46a7-bd9d-d74623921504", "tag": "a620a559-328d-47b6-bbde-699aae5e9225"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:46:25.249906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6174deba-fde2-4636-92f9-06d47a1e5fd2 req-706f7efe-94cc-4173-803a-f493e5761d18 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:25.250745 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6174deba-fde2-4636-92f9-06d47a1e5fd2 req-706f7efe-94cc-4173-803a-f493e5761d18 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:25.262878 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6174deba-fde2-4636-92f9-06d47a1e5fd2 req-706f7efe-94cc-4173-803a-f493e5761d18 service nova] Creating event network-changed:a620a559-328d-47b6-bbde-699aae5e9225 for instance 7c9c472a-616d-46a7-bd9d-d74623921504 on n-h2-766726-30 May 19 05:46:25.268713 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6174deba-fde2-4636-92f9-06d47a1e5fd2 req-706f7efe-94cc-4173-803a-f493e5761d18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093917 May 19 05:46:25.270215 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3519/7124] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:46:25.313432 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aab6434b-12f1-4d88-a040-82e77dc41c19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 204 len: 0 microversion: 2.1 time: 0.144424 May 19 05:46:25.314395 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3606/7125] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:46:25 2022] DELETE /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:46:25.325426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a3181770-5055-41ba-b87c-56a0f808ed9d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:25.326489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a3181770-5055-41ba-b87c-56a0f808ed9d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:25.336419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3181770-5055-41ba-b87c-56a0f808ed9d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:25.337259 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3181770-5055-41ba-b87c-56a0f808ed9d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:25.337848 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3181770-5055-41ba-b87c-56a0f808ed9d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:25.338353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a3181770-5055-41ba-b87c-56a0f808ed9d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:25.479095 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a3181770-5055-41ba-b87c-56a0f808ed9d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:25.486647 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a3181770-5055-41ba-b87c-56a0f808ed9d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1688 microversion: 2.1 time: 0.166949 May 19 05:46:25.487230 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3520/7126] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:25 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:26.504958 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-06bf6eca-fdf0-42bd-9fdc-ea0f816fd735 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:26.505613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-06bf6eca-fdf0-42bd-9fdc-ea0f816fd735 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:26.512528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06bf6eca-fdf0-42bd-9fdc-ea0f816fd735 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:26.512988 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06bf6eca-fdf0-42bd-9fdc-ea0f816fd735 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:26.513792 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06bf6eca-fdf0-42bd-9fdc-ea0f816fd735 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:26.514239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-06bf6eca-fdf0-42bd-9fdc-ea0f816fd735 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:26.662434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-06bf6eca-fdf0-42bd-9fdc-ea0f816fd735 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:26.670085 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-06bf6eca-fdf0-42bd-9fdc-ea0f816fd735 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1688 microversion: 2.1 time: 0.169542 May 19 05:46:26.670668 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3607/7127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:26 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:27.387886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-028483e2-5485-4354-a37b-8df9fcfe4ea0 req-a7795548-7490-4f32-b39e-4ca4ec3d5f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9c472a-616d-46a7-bd9d-d74623921504", "name": "network-vif-deleted", "tag": "a620a559-328d-47b6-bbde-699aae5e9225"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:46:27.397424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-028483e2-5485-4354-a37b-8df9fcfe4ea0 req-a7795548-7490-4f32-b39e-4ca4ec3d5f1f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:27.397875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-028483e2-5485-4354-a37b-8df9fcfe4ea0 req-a7795548-7490-4f32-b39e-4ca4ec3d5f1f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:27.409974 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-028483e2-5485-4354-a37b-8df9fcfe4ea0 req-a7795548-7490-4f32-b39e-4ca4ec3d5f1f service nova] Creating event network-vif-deleted:a620a559-328d-47b6-bbde-699aae5e9225 for instance 7c9c472a-616d-46a7-bd9d-d74623921504 on n-h2-766726-30 May 19 05:46:27.414814 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-028483e2-5485-4354-a37b-8df9fcfe4ea0 req-a7795548-7490-4f32-b39e-4ca4ec3d5f1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030651 May 19 05:46:27.415411 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3521/7128] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:46:27.687930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:27.688571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:27.700146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:27.700620 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:27.701544 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:27.702003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:27.736193 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:27.736659 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:27.737145 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lazy-loading 'fault' on Instance uuid 7c9c472a-616d-46a7-bd9d-d74623921504 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:46:27.785850 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:27.795503 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0df106da-04ab-471d-bc4f-3e129cd26dd4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 200 len: 1356 microversion: 2.1 time: 0.111484 May 19 05:46:27.796252 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3608/7129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:27 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:28.814742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:28.815450 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 7c9c472a-616d-46a7-bd9d-d74623921504] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:28.824210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:28.824683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:28.825517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:28.825968 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:28.839408 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] HTTP exception thrown: Instance 7c9c472a-616d-46a7-bd9d-d74623921504 could not be found. May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Request method failure captured: May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 HTTP/1.1 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdkX6Q-mHJHc-Qf4dH9OyPZeYKkTAwwAkZHuSFjw1ifeHS0owpYaW-O2ut81RUXMcNyEzMnh3k8Xq9imMzE-MGBKWhUF_3lv7wUFKNnOUnJVxSM2enVNbzWJluamSO0KE75ANYPbZOZxbRYCCqI0K5-EJC1osydmnlQ1xZBDQZoDqoU May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f34ee9fba7ea4656831eb1f98bd79813 May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 7c9c472a-616d-46a7-bd9d-d74623921504 could not be found. May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '7c9c472a-616d-46a7-bd9d-d74623921504'} May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9c472a-616d-46a7-bd9d-d74623921504 could not be found. May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9c472a-616d-46a7-bd9d-d74623921504 could not be found. May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:46:28.841033 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9c472a-616d-46a7-bd9d-d74623921504 could not be found. May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Returning 404 to user: Instance 7c9c472a-616d-46a7-bd9d-d74623921504 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f34f9fbd-d4cd-49e3-aead-cf4c29e5fff6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504" status: 404 len: 111 microversion: 2.1 time: 0.033349 May 19 05:46:28.844813 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3522/7130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:28 2022] GET /compute/v2.1/servers/7c9c472a-616d-46a7-bd9d-d74623921504 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:46:31.041387 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:46:31.042368 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:46:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:46:32.365600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9e2e8516-e48d-40d8-b61b-cdff5edf913a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '.version_select at 0x7fd314b65790>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:32.392586 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9e2e8516-e48d-40d8-b61b-cdff5edf913a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-630713999" status: 202 len: 0 microversion: 2.1 time: 0.031195 May 19 05:46:32.393517 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3609/7131] 10.222.0.58 () {58 vars in 1280 bytes} [Thu May 19 05:46:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-630713999 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:46:32.421366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-05348a2e-1d1e-49d6-8c03-4c74bbc2533d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: .version_select at 0x7fd31436fdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1108844827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjpxHZUkfBwtkXzZJrh4yUQbZ9jbT7ReBs8iwxmbI4h34flH92eE5Lhzqs2rA7AhbhansX4E6XSULgMxaClT+A/Akh9DOYGHSaljC/Cibaxzv69ltjxYGwmXAfVEEPC7g=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:46:32.439253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-05348a2e-1d1e-49d6-8c03-4c74bbc2533d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:46:32.445935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-05348a2e-1d1e-49d6-8c03-4c74bbc2533d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:46:32.470113 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-05348a2e-1d1e-49d6-8c03-4c74bbc2533d tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052630 May 19 05:46:32.470736 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3523/7132] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:46:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:46:37.705652 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1489148903", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "b5b32dfb-dc7a-4eb2-a007-670e95af061a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1108844827", "security_groups": [{"name": "tempest-secgroup-smoke-1761794190"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:46:37.789924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:37.814591 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] validate_networks() for [('b5b32dfb-dc7a-4eb2-a007-670e95af061a', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:46:38.246371 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:46:38.246820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:46:38.247414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:46:38.247728 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:46:38.248155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:46:38.258428 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:38.259152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:38.260131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:38.260685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:38.281703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:46:38.288970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:46:38.305051 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:46:38.307589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:46:38.374359 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eb5a6d9b-8c21-434a-aff6-f52267a79ded tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.677588 May 19 05:46:38.380734 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3610/7133] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:46:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:46:38.386042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ea096824-3c46-41fa-88f4-e8c9eb47ed9f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:38.386824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ea096824-3c46-41fa-88f4-e8c9eb47ed9f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:38.476563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ea096824-3c46-41fa-88f4-e8c9eb47ed9f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:38.485685 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ea096824-3c46-41fa-88f4-e8c9eb47ed9f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1267 microversion: 2.1 time: 0.103924 May 19 05:46:38.496876 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3524/7134] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:38 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:46:39.510410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5e2211eb-5e27-44be-a0c3-f0997d010307 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:39.511197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5e2211eb-5e27-44be-a0c3-f0997d010307 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:39.524800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e2211eb-5e27-44be-a0c3-f0997d010307 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:39.528063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e2211eb-5e27-44be-a0c3-f0997d010307 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:39.530491 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e2211eb-5e27-44be-a0c3-f0997d010307 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:39.534280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5e2211eb-5e27-44be-a0c3-f0997d010307 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:39.647460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5e2211eb-5e27-44be-a0c3-f0997d010307 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:39.659138 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5e2211eb-5e27-44be-a0c3-f0997d010307 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1337 microversion: 2.1 time: 0.155807 May 19 05:46:39.662195 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3611/7135] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:39 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1337 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:40.680935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c2fe0d51-1801-4428-83c9-893d91639755 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:40.682475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c2fe0d51-1801-4428-83c9-893d91639755 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:40.690168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=16 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:40.695875 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2fe0d51-1801-4428-83c9-893d91639755 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:40.697187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2fe0d51-1801-4428-83c9-893d91639755 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:40.698381 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2fe0d51-1801-4428-83c9-893d91639755 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:40.699340 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c2fe0d51-1801-4428-83c9-893d91639755 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:41.042100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c2fe0d51-1801-4428-83c9-893d91639755 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:41.059242 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c2fe0d51-1801-4428-83c9-893d91639755 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1393 microversion: 2.1 time: 0.384861 May 19 05:46:41.065394 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3525/7136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:40 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1393 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:41.611986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-104609ca-04f9-42e4-84b8-1a9ac5694266 req-34b83b68-cb6d-4925-870c-892d3da2b8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0764fc81-97db-4fbe-a028-cae4917b7776", "tag": "7161695d-0654-41ca-a770-41df47851127"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:46:41.625646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-104609ca-04f9-42e4-84b8-1a9ac5694266 req-34b83b68-cb6d-4925-870c-892d3da2b8f7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:41.626515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-104609ca-04f9-42e4-84b8-1a9ac5694266 req-34b83b68-cb6d-4925-870c-892d3da2b8f7 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:41.643137 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-104609ca-04f9-42e4-84b8-1a9ac5694266 req-34b83b68-cb6d-4925-870c-892d3da2b8f7 service nova] Creating event network-changed:7161695d-0654-41ca-a770-41df47851127 for instance 0764fc81-97db-4fbe-a028-cae4917b7776 on n-h2-766726-30 May 19 05:46:41.648745 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-104609ca-04f9-42e4-84b8-1a9ac5694266 req-34b83b68-cb6d-4925-870c-892d3da2b8f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044498 May 19 05:46:41.649419 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3612/7137] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:46:42.084306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-40d3fc4e-75f2-42ec-8d9b-fd9233348105 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:42.084921 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-40d3fc4e-75f2-42ec-8d9b-fd9233348105 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:42.092046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40d3fc4e-75f2-42ec-8d9b-fd9233348105 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:42.092501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40d3fc4e-75f2-42ec-8d9b-fd9233348105 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:42.093292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40d3fc4e-75f2-42ec-8d9b-fd9233348105 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:42.093733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-40d3fc4e-75f2-42ec-8d9b-fd9233348105 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:42.230332 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-40d3fc4e-75f2-42ec-8d9b-fd9233348105 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:42.238486 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-40d3fc4e-75f2-42ec-8d9b-fd9233348105 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1393 microversion: 2.1 time: 0.158176 May 19 05:46:42.239075 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3526/7138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:42 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:43.257314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0f7f296b-c0f5-4e5f-8dfa-a32f5ea1b875 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:43.258181 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0f7f296b-c0f5-4e5f-8dfa-a32f5ea1b875 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:43.264613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7f296b-c0f5-4e5f-8dfa-a32f5ea1b875 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:43.265333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7f296b-c0f5-4e5f-8dfa-a32f5ea1b875 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:43.266139 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7f296b-c0f5-4e5f-8dfa-a32f5ea1b875 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:43.266605 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0f7f296b-c0f5-4e5f-8dfa-a32f5ea1b875 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:43.402977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0f7f296b-c0f5-4e5f-8dfa-a32f5ea1b875 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:43.410984 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0f7f296b-c0f5-4e5f-8dfa-a32f5ea1b875 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1393 microversion: 2.1 time: 0.159457 May 19 05:46:43.411567 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3613/7139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:43 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:44.427703 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3bd6b90a-498d-4253-b163-09447f2b8898 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:44.428320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3bd6b90a-498d-4253-b163-09447f2b8898 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:44.435269 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bd6b90a-498d-4253-b163-09447f2b8898 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:44.435717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bd6b90a-498d-4253-b163-09447f2b8898 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:44.436483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bd6b90a-498d-4253-b163-09447f2b8898 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:44.436922 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3bd6b90a-498d-4253-b163-09447f2b8898 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:44.564639 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3bd6b90a-498d-4253-b163-09447f2b8898 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:44.572118 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3bd6b90a-498d-4253-b163-09447f2b8898 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1393 microversion: 2.1 time: 0.148410 May 19 05:46:44.572693 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3527/7140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:44 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1393 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:45.592167 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1a794c74-2a1a-4499-812e-ab25a04535bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:45.592906 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1a794c74-2a1a-4499-812e-ab25a04535bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:45.600509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a794c74-2a1a-4499-812e-ab25a04535bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:45.600968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a794c74-2a1a-4499-812e-ab25a04535bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:45.601765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a794c74-2a1a-4499-812e-ab25a04535bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:45.602211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1a794c74-2a1a-4499-812e-ab25a04535bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:45.736287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1a794c74-2a1a-4499-812e-ab25a04535bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:45.744479 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1a794c74-2a1a-4499-812e-ab25a04535bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1393 microversion: 2.1 time: 0.156495 May 19 05:46:45.745058 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3614/7141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:45 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:46.762267 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-634c79b8-6efa-4ebb-af3e-e30e6dd08006 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:46.762897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-634c79b8-6efa-4ebb-af3e-e30e6dd08006 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:46.770197 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-634c79b8-6efa-4ebb-af3e-e30e6dd08006 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:46.770659 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-634c79b8-6efa-4ebb-af3e-e30e6dd08006 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:46.771440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-634c79b8-6efa-4ebb-af3e-e30e6dd08006 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:46.771886 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-634c79b8-6efa-4ebb-af3e-e30e6dd08006 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:46.868685 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fdafb93c-393f-41fd-8e9e-fe5e6711365c req-4519dd2f-b91b-4213-a9de-ba56b950ec57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0764fc81-97db-4fbe-a028-cae4917b7776", "name": "network-vif-plugged", "status": "completed", "tag": "7161695d-0654-41ca-a770-41df47851127"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:46:46.880594 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fdafb93c-393f-41fd-8e9e-fe5e6711365c req-4519dd2f-b91b-4213-a9de-ba56b950ec57 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:46.881250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fdafb93c-393f-41fd-8e9e-fe5e6711365c req-4519dd2f-b91b-4213-a9de-ba56b950ec57 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:46.894008 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fdafb93c-393f-41fd-8e9e-fe5e6711365c req-4519dd2f-b91b-4213-a9de-ba56b950ec57 service nova] Creating event network-vif-plugged:7161695d-0654-41ca-a770-41df47851127 for instance 0764fc81-97db-4fbe-a028-cae4917b7776 on n-h2-766726-30 May 19 05:46:46.899456 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fdafb93c-393f-41fd-8e9e-fe5e6711365c req-4519dd2f-b91b-4213-a9de-ba56b950ec57 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034781 May 19 05:46:46.900261 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3615/7142] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:46:46.909684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-634c79b8-6efa-4ebb-af3e-e30e6dd08006 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:46.917842 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-634c79b8-6efa-4ebb-af3e-e30e6dd08006 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1393 microversion: 2.1 time: 0.159878 May 19 05:46:46.925869 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3528/7143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:46 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:47.935935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8851c5cd-75da-4866-913b-e73ccc570d19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:47.936565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8851c5cd-75da-4866-913b-e73ccc570d19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:47.943989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8851c5cd-75da-4866-913b-e73ccc570d19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:47.944457 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8851c5cd-75da-4866-913b-e73ccc570d19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:47.945273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8851c5cd-75da-4866-913b-e73ccc570d19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:47.945732 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8851c5cd-75da-4866-913b-e73ccc570d19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:48.082800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8851c5cd-75da-4866-913b-e73ccc570d19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:48.090726 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8851c5cd-75da-4866-913b-e73ccc570d19 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1393 microversion: 2.1 time: 0.159124 May 19 05:46:48.091312 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3616/7144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:47 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:49.108026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-49a9d20c-abdf-4eb3-b87a-b63a4c2b349e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:49.108642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-49a9d20c-abdf-4eb3-b87a-b63a4c2b349e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:49.111375 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:49.112112 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:49.118036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49a9d20c-abdf-4eb3-b87a-b63a4c2b349e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:49.118489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49a9d20c-abdf-4eb3-b87a-b63a4c2b349e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:49.119257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49a9d20c-abdf-4eb3-b87a-b63a4c2b349e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:49.119695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-49a9d20c-abdf-4eb3-b87a-b63a4c2b349e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:49.249859 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-49a9d20c-abdf-4eb3-b87a-b63a4c2b349e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:49.257906 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-49a9d20c-abdf-4eb3-b87a-b63a4c2b349e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1565 microversion: 2.1 time: 0.154149 May 19 05:46:49.258484 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3529/7145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:49 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:49.275304 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-464eb152-d20d-4d5d-8070-dc1ff2dd14bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:49.275945 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-464eb152-d20d-4d5d-8070-dc1ff2dd14bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:49.277938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:49.278619 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:46:49.285981 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-464eb152-d20d-4d5d-8070-dc1ff2dd14bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:49.286447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-464eb152-d20d-4d5d-8070-dc1ff2dd14bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:49.287232 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-464eb152-d20d-4d5d-8070-dc1ff2dd14bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:49.287712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-464eb152-d20d-4d5d-8070-dc1ff2dd14bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:49.427762 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-464eb152-d20d-4d5d-8070-dc1ff2dd14bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:49.435375 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-464eb152-d20d-4d5d-8070-dc1ff2dd14bb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1565 microversion: 2.1 time: 0.164716 May 19 05:46:49.435969 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3617/7146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:49 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:46:51.310608 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ac4d9a8-7aa8-4ff4-a2c2-804fd1cc1849 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:46:51.311990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9ac4d9a8-7aa8-4ff4-a2c2-804fd1cc1849 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:46:51.312995 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-65d5c1d6-8da4-4ccf-8eb6-34d288467abc req-b213c034-07bf-4383-82cc-ecd4ddc1e417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0764fc81-97db-4fbe-a028-cae4917b7776", "tag": "7161695d-0654-41ca-a770-41df47851127"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:46:51.321187 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ac4d9a8-7aa8-4ff4-a2c2-804fd1cc1849 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:51.321853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ac4d9a8-7aa8-4ff4-a2c2-804fd1cc1849 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:51.322223 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-65d5c1d6-8da4-4ccf-8eb6-34d288467abc req-b213c034-07bf-4383-82cc-ecd4ddc1e417 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:51.322689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-65d5c1d6-8da4-4ccf-8eb6-34d288467abc req-b213c034-07bf-4383-82cc-ecd4ddc1e417 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:51.323282 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ac4d9a8-7aa8-4ff4-a2c2-804fd1cc1849 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:46:51.323966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9ac4d9a8-7aa8-4ff4-a2c2-804fd1cc1849 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:46:51.335402 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-65d5c1d6-8da4-4ccf-8eb6-34d288467abc req-b213c034-07bf-4383-82cc-ecd4ddc1e417 service nova] Creating event network-changed:7161695d-0654-41ca-a770-41df47851127 for instance 0764fc81-97db-4fbe-a028-cae4917b7776 on n-h2-766726-30 May 19 05:46:51.341298 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-65d5c1d6-8da4-4ccf-8eb6-34d288467abc req-b213c034-07bf-4383-82cc-ecd4ddc1e417 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032123 May 19 05:46:51.342197 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3618/7147] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:46:51.548366 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9ac4d9a8-7aa8-4ff4-a2c2-804fd1cc1849 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:46:51.557116 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ac4d9a8-7aa8-4ff4-a2c2-804fd1cc1849 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1565 microversion: 2.1 time: 0.250628 May 19 05:46:51.558512 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3530/7148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:46:51 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1565 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:12.795924 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:47:12.796702 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=38 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:47:12.800808 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-70dcf5ba-1f6d-4f81-9f50-79a6275a8fd3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:47:12.801851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-70dcf5ba-1f6d-4f81-9f50-79a6275a8fd3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:12.809584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70dcf5ba-1f6d-4f81-9f50-79a6275a8fd3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:12.810043 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70dcf5ba-1f6d-4f81-9f50-79a6275a8fd3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:12.810818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70dcf5ba-1f6d-4f81-9f50-79a6275a8fd3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:12.811261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70dcf5ba-1f6d-4f81-9f50-79a6275a8fd3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:12.861877 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-70dcf5ba-1f6d-4f81-9f50-79a6275a8fd3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776/action" status: 200 len: 24572 microversion: 2.1 time: 0.067614 May 19 05:47:12.862499 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3619/7149] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:47:12 2022] POST /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776/action => generated 24572 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:47:23.975984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:47:23.977020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:23.979445 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:47:23.980100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=36 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:47:23.986568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:23.987028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:23.987809 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:23.988254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:24.027940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:24.034249 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Old instance type m1.heat2, new instance type m1.heat {{(pid=124819) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 05:47:24.041113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:47:24.041546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:47:24.042025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:47:24.042439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:47:24.042857 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:47:24.105560 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [60b054fc-875c-4035-941a-ea23b453aade] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 05:47:25.112025 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [60b054fc-875c-4035-941a-ea23b453aade] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 59238. May 19 05:47:25.116373 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-eecbf4ce-9986-4b69-a0c9-b1ff2764dc28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776/action" status: 202 len: 0 microversion: 2.1 time: 1.144427 May 19 05:47:25.117002 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3531/7150] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:47:23 2022] POST /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776/action => generated 0 bytes in 1146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:47:25.125854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-069767f2-8c53-466a-b719-70c5551ef609 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:25.126571 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-069767f2-8c53-466a-b719-70c5551ef609 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:25.129276 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:47:25.129947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:47:25.136801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-069767f2-8c53-466a-b719-70c5551ef609 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:25.137278 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-069767f2-8c53-466a-b719-70c5551ef609 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:25.138185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-069767f2-8c53-466a-b719-70c5551ef609 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:25.138761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-069767f2-8c53-466a-b719-70c5551ef609 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:25.277214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-069767f2-8c53-466a-b719-70c5551ef609 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:25.285019 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-069767f2-8c53-466a-b719-70c5551ef609 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1692 microversion: 2.1 time: 0.163661 May 19 05:47:25.285698 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3620/7151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:25 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:47:26.304167 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c7d8950b-aa00-4a17-aa09-30f52301e466 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:26.309110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c7d8950b-aa00-4a17-aa09-30f52301e466 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:26.315402 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7d8950b-aa00-4a17-aa09-30f52301e466 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:26.315863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7d8950b-aa00-4a17-aa09-30f52301e466 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:26.316683 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7d8950b-aa00-4a17-aa09-30f52301e466 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:26.317172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c7d8950b-aa00-4a17-aa09-30f52301e466 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:26.452051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c7d8950b-aa00-4a17-aa09-30f52301e466 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:26.460250 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c7d8950b-aa00-4a17-aa09-30f52301e466 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1692 microversion: 2.1 time: 0.160357 May 19 05:47:26.460833 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3532/7152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:26 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:27.478408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-94ccd7ca-c175-4cfe-a7c8-80d29d65c501 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:27.479042 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-94ccd7ca-c175-4cfe-a7c8-80d29d65c501 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:27.486071 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94ccd7ca-c175-4cfe-a7c8-80d29d65c501 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:27.486539 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94ccd7ca-c175-4cfe-a7c8-80d29d65c501 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:27.487318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94ccd7ca-c175-4cfe-a7c8-80d29d65c501 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:27.487773 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-94ccd7ca-c175-4cfe-a7c8-80d29d65c501 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:27.621837 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-94ccd7ca-c175-4cfe-a7c8-80d29d65c501 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:27.629351 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-94ccd7ca-c175-4cfe-a7c8-80d29d65c501 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.155513 May 19 05:47:27.629930 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3621/7153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:27 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:28.645612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-699d78cb-96e4-4621-9833-d6e455407826 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:28.646237 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-699d78cb-96e4-4621-9833-d6e455407826 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:28.653248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-699d78cb-96e4-4621-9833-d6e455407826 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:28.653706 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-699d78cb-96e4-4621-9833-d6e455407826 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:28.654476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-699d78cb-96e4-4621-9833-d6e455407826 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:28.654916 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-699d78cb-96e4-4621-9833-d6e455407826 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:28.784193 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-699d78cb-96e4-4621-9833-d6e455407826 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:28.792189 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-699d78cb-96e4-4621-9833-d6e455407826 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.150506 May 19 05:47:28.792956 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3533/7154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:28 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:29.809901 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-954da69d-4ad5-442a-9ba8-313270ede0f1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:29.810553 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-954da69d-4ad5-442a-9ba8-313270ede0f1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:29.817532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-954da69d-4ad5-442a-9ba8-313270ede0f1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:29.817977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-954da69d-4ad5-442a-9ba8-313270ede0f1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:29.819397 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-954da69d-4ad5-442a-9ba8-313270ede0f1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:29.819847 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-954da69d-4ad5-442a-9ba8-313270ede0f1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:29.952435 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-954da69d-4ad5-442a-9ba8-313270ede0f1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:29.959999 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-954da69d-4ad5-442a-9ba8-313270ede0f1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.154017 May 19 05:47:29.960570 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3622/7155] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:29 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:30.977872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1522918a-3487-4770-9d7d-f078f4c76ddd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:30.978491 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1522918a-3487-4770-9d7d-f078f4c76ddd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:30.985471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1522918a-3487-4770-9d7d-f078f4c76ddd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:30.985926 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1522918a-3487-4770-9d7d-f078f4c76ddd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:30.986694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1522918a-3487-4770-9d7d-f078f4c76ddd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:30.987139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1522918a-3487-4770-9d7d-f078f4c76ddd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:31.117091 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1522918a-3487-4770-9d7d-f078f4c76ddd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:31.124625 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1522918a-3487-4770-9d7d-f078f4c76ddd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.151276 May 19 05:47:31.125226 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3534/7156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:30 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:32.140885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-12d124a4-98f3-4f34-8ab8-f52ceb1da9e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:32.141535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-12d124a4-98f3-4f34-8ab8-f52ceb1da9e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:32.148434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12d124a4-98f3-4f34-8ab8-f52ceb1da9e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:32.148894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12d124a4-98f3-4f34-8ab8-f52ceb1da9e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:32.149703 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12d124a4-98f3-4f34-8ab8-f52ceb1da9e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:32.150154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12d124a4-98f3-4f34-8ab8-f52ceb1da9e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:32.279653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-12d124a4-98f3-4f34-8ab8-f52ceb1da9e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:32.287180 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-12d124a4-98f3-4f34-8ab8-f52ceb1da9e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.150207 May 19 05:47:32.287783 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3623/7157] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:32 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:33.304898 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d32ff5ad-cd91-413c-8e23-addbf527435e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:33.305571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d32ff5ad-cd91-413c-8e23-addbf527435e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:33.312475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d32ff5ad-cd91-413c-8e23-addbf527435e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:33.312931 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d32ff5ad-cd91-413c-8e23-addbf527435e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:33.313730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d32ff5ad-cd91-413c-8e23-addbf527435e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:33.314172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d32ff5ad-cd91-413c-8e23-addbf527435e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:33.450218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d32ff5ad-cd91-413c-8e23-addbf527435e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:33.457893 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d32ff5ad-cd91-413c-8e23-addbf527435e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.157666 May 19 05:47:33.458472 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3535/7158] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:33 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:34.475828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d3b0bf84-ebe2-4124-a107-a87bec801ad5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:34.476458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d3b0bf84-ebe2-4124-a107-a87bec801ad5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:34.483405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3b0bf84-ebe2-4124-a107-a87bec801ad5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:34.483870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3b0bf84-ebe2-4124-a107-a87bec801ad5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:34.484650 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3b0bf84-ebe2-4124-a107-a87bec801ad5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:34.485157 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d3b0bf84-ebe2-4124-a107-a87bec801ad5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:34.617673 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d3b0bf84-ebe2-4124-a107-a87bec801ad5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:34.625167 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d3b0bf84-ebe2-4124-a107-a87bec801ad5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.153304 May 19 05:47:34.625774 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3624/7159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:34 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:35.641501 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9c44331d-6ed5-4d20-a3ba-011cdc6db226 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:35.642110 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9c44331d-6ed5-4d20-a3ba-011cdc6db226 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:35.649933 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c44331d-6ed5-4d20-a3ba-011cdc6db226 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:35.650391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c44331d-6ed5-4d20-a3ba-011cdc6db226 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:35.651168 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c44331d-6ed5-4d20-a3ba-011cdc6db226 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:35.651619 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9c44331d-6ed5-4d20-a3ba-011cdc6db226 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:35.788711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9c44331d-6ed5-4d20-a3ba-011cdc6db226 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:35.796320 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9c44331d-6ed5-4d20-a3ba-011cdc6db226 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.158813 May 19 05:47:35.796938 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3536/7160] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:35 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:36.814462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8742e126-329e-4eb5-9b86-20cc00498468 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:36.815135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8742e126-329e-4eb5-9b86-20cc00498468 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:36.822829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8742e126-329e-4eb5-9b86-20cc00498468 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:36.823302 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8742e126-329e-4eb5-9b86-20cc00498468 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:36.824166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8742e126-329e-4eb5-9b86-20cc00498468 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:36.824706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8742e126-329e-4eb5-9b86-20cc00498468 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:36.954848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8742e126-329e-4eb5-9b86-20cc00498468 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:36.963235 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8742e126-329e-4eb5-9b86-20cc00498468 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.152806 May 19 05:47:36.963815 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3625/7161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:36 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:37.979771 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-50de6697-9ff5-4e2b-8713-c52a608170b9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:37.980868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-50de6697-9ff5-4e2b-8713-c52a608170b9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:37.987867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50de6697-9ff5-4e2b-8713-c52a608170b9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:37.988320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50de6697-9ff5-4e2b-8713-c52a608170b9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:37.989116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50de6697-9ff5-4e2b-8713-c52a608170b9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:37.989562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-50de6697-9ff5-4e2b-8713-c52a608170b9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:38.121498 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-50de6697-9ff5-4e2b-8713-c52a608170b9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:38.128977 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-50de6697-9ff5-4e2b-8713-c52a608170b9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.153209 May 19 05:47:38.129577 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3537/7162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:37 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:39.146651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6f4a79fd-2250-4630-be88-7aa82305e744 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:39.147926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6f4a79fd-2250-4630-be88-7aa82305e744 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:39.154974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f4a79fd-2250-4630-be88-7aa82305e744 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:39.155444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f4a79fd-2250-4630-be88-7aa82305e744 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:39.156235 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f4a79fd-2250-4630-be88-7aa82305e744 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:39.156695 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6f4a79fd-2250-4630-be88-7aa82305e744 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:39.292894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6f4a79fd-2250-4630-be88-7aa82305e744 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:39.300495 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6f4a79fd-2250-4630-be88-7aa82305e744 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.157852 May 19 05:47:39.301091 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3626/7163] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:39 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:40.317804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dbb20070-7e61-4509-9047-3da102e77e1e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:40.318424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dbb20070-7e61-4509-9047-3da102e77e1e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:40.326169 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbb20070-7e61-4509-9047-3da102e77e1e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:40.328490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbb20070-7e61-4509-9047-3da102e77e1e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:40.328490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbb20070-7e61-4509-9047-3da102e77e1e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:40.328490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dbb20070-7e61-4509-9047-3da102e77e1e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:40.462208 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dbb20070-7e61-4509-9047-3da102e77e1e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:40.470292 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dbb20070-7e61-4509-9047-3da102e77e1e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.156624 May 19 05:47:40.470893 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3538/7164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:40 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:41.487546 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e84141bf-172f-4b5c-bd6a-00ef2bf87553 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:41.488183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e84141bf-172f-4b5c-bd6a-00ef2bf87553 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:41.495244 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e84141bf-172f-4b5c-bd6a-00ef2bf87553 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:41.495716 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e84141bf-172f-4b5c-bd6a-00ef2bf87553 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:41.496505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e84141bf-172f-4b5c-bd6a-00ef2bf87553 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:41.496972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e84141bf-172f-4b5c-bd6a-00ef2bf87553 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:41.629674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e84141bf-172f-4b5c-bd6a-00ef2bf87553 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:41.637215 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e84141bf-172f-4b5c-bd6a-00ef2bf87553 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.153707 May 19 05:47:41.637789 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3627/7165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:41 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:42.654218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-300302be-96d7-4ec3-a9d0-b23b0a0630a2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:42.654838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-300302be-96d7-4ec3-a9d0-b23b0a0630a2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:42.661775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-300302be-96d7-4ec3-a9d0-b23b0a0630a2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:42.662226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-300302be-96d7-4ec3-a9d0-b23b0a0630a2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:42.662987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-300302be-96d7-4ec3-a9d0-b23b0a0630a2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:42.663427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-300302be-96d7-4ec3-a9d0-b23b0a0630a2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:42.791597 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-300302be-96d7-4ec3-a9d0-b23b0a0630a2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:42.799080 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-300302be-96d7-4ec3-a9d0-b23b0a0630a2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.148777 May 19 05:47:42.799655 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3539/7166] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:42 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:43.815827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-31892aaf-a5dd-40f0-b890-f5d5b546f4a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:43.816466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-31892aaf-a5dd-40f0-b890-f5d5b546f4a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:43.823588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31892aaf-a5dd-40f0-b890-f5d5b546f4a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:43.824054 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31892aaf-a5dd-40f0-b890-f5d5b546f4a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:43.825025 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31892aaf-a5dd-40f0-b890-f5d5b546f4a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:43.825566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-31892aaf-a5dd-40f0-b890-f5d5b546f4a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:43.993518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-31892aaf-a5dd-40f0-b890-f5d5b546f4a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:44.001176 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-31892aaf-a5dd-40f0-b890-f5d5b546f4a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1697 microversion: 2.1 time: 0.189346 May 19 05:47:44.001758 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3628/7167] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:43 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:44.654127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bbe24d96-85a5-4bdb-97cf-63b54842a200 req-4c434cd2-cde7-4214-8cf4-a8b62e1974cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0764fc81-97db-4fbe-a028-cae4917b7776", "name": "network-vif-unplugged", "status": "completed", "tag": "7161695d-0654-41ca-a770-41df47851127"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:47:44.662670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bbe24d96-85a5-4bdb-97cf-63b54842a200 req-4c434cd2-cde7-4214-8cf4-a8b62e1974cf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:44.663127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bbe24d96-85a5-4bdb-97cf-63b54842a200 req-4c434cd2-cde7-4214-8cf4-a8b62e1974cf service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:44.675748 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bbe24d96-85a5-4bdb-97cf-63b54842a200 req-4c434cd2-cde7-4214-8cf4-a8b62e1974cf service nova] Creating event network-vif-unplugged:7161695d-0654-41ca-a770-41df47851127 for instance 0764fc81-97db-4fbe-a028-cae4917b7776 on n-h1-766726-30 May 19 05:47:44.682287 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [req-bbe24d96-85a5-4bdb-97cf-63b54842a200 req-4c434cd2-cde7-4214-8cf4-a8b62e1974cf service nova] Instance 0764fc81-97db-4fbe-a028-cae4917b7776 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124819) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:47:44.693779 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bbe24d96-85a5-4bdb-97cf-63b54842a200 req-4c434cd2-cde7-4214-8cf4-a8b62e1974cf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102685 May 19 05:47:44.695793 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3540/7168] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:47:45.019438 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2f82b637-9347-4748-aa20-3e12d9de54c1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:45.020085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2f82b637-9347-4748-aa20-3e12d9de54c1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:45.028993 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f82b637-9347-4748-aa20-3e12d9de54c1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:45.029573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f82b637-9347-4748-aa20-3e12d9de54c1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:45.030363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f82b637-9347-4748-aa20-3e12d9de54c1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:45.030803 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f82b637-9347-4748-aa20-3e12d9de54c1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:45.180905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2f82b637-9347-4748-aa20-3e12d9de54c1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:45.188978 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2f82b637-9347-4748-aa20-3e12d9de54c1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1696 microversion: 2.1 time: 0.173964 May 19 05:47:45.189672 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3629/7169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:45 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:46.208429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-72a196ac-11f1-40c1-acb7-8458bf275929 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:46.209166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72a196ac-11f1-40c1-acb7-8458bf275929 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:46.215962 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72a196ac-11f1-40c1-acb7-8458bf275929 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:46.216416 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72a196ac-11f1-40c1-acb7-8458bf275929 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:46.217475 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72a196ac-11f1-40c1-acb7-8458bf275929 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:46.217923 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72a196ac-11f1-40c1-acb7-8458bf275929 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:46.353186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-72a196ac-11f1-40c1-acb7-8458bf275929 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:46.360796 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-72a196ac-11f1-40c1-acb7-8458bf275929 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1694 microversion: 2.1 time: 0.157682 May 19 05:47:46.361412 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3541/7170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:46 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:46.711875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6eb85d4f-9fc1-4ae7-97fd-696f6adc0a6b req-360f3b45-e28d-456a-9e01-a348ab51ad16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0764fc81-97db-4fbe-a028-cae4917b7776", "tag": "7161695d-0654-41ca-a770-41df47851127"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:47:46.720939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6eb85d4f-9fc1-4ae7-97fd-696f6adc0a6b req-360f3b45-e28d-456a-9e01-a348ab51ad16 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:46.721427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6eb85d4f-9fc1-4ae7-97fd-696f6adc0a6b req-360f3b45-e28d-456a-9e01-a348ab51ad16 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:46.733187 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6eb85d4f-9fc1-4ae7-97fd-696f6adc0a6b req-360f3b45-e28d-456a-9e01-a348ab51ad16 service nova] Creating event network-changed:7161695d-0654-41ca-a770-41df47851127 for instance 0764fc81-97db-4fbe-a028-cae4917b7776 on n-h1-766726-30 May 19 05:47:46.738337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [req-6eb85d4f-9fc1-4ae7-97fd-696f6adc0a6b req-360f3b45-e28d-456a-9e01-a348ab51ad16 service nova] Instance 0764fc81-97db-4fbe-a028-cae4917b7776 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-766726-30', 'n-h2-766726-30'} {{(pid=124818) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 05:47:46.750089 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6eb85d4f-9fc1-4ae7-97fd-696f6adc0a6b req-360f3b45-e28d-456a-9e01-a348ab51ad16 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041977 May 19 05:47:46.750757 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3630/7171] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:47:47.377624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-60c9d2f3-29a5-4205-9f16-c2298ebf6bf1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:47.378896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-60c9d2f3-29a5-4205-9f16-c2298ebf6bf1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:47.386783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60c9d2f3-29a5-4205-9f16-c2298ebf6bf1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:47.387248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60c9d2f3-29a5-4205-9f16-c2298ebf6bf1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:47.388038 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60c9d2f3-29a5-4205-9f16-c2298ebf6bf1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:47.388486 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-60c9d2f3-29a5-4205-9f16-c2298ebf6bf1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:47.519934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-60c9d2f3-29a5-4205-9f16-c2298ebf6bf1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:47.528409 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-60c9d2f3-29a5-4205-9f16-c2298ebf6bf1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1691 microversion: 2.1 time: 0.154998 May 19 05:47:47.529002 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3542/7172] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:47 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:47.545465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e06e95ee-1629-4e52-9a17-4ce177cf106e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:47:47.546117 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e06e95ee-1629-4e52-9a17-4ce177cf106e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:47.552449 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e06e95ee-1629-4e52-9a17-4ce177cf106e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:47.552927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e06e95ee-1629-4e52-9a17-4ce177cf106e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:47.553753 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e06e95ee-1629-4e52-9a17-4ce177cf106e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:47.554248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e06e95ee-1629-4e52-9a17-4ce177cf106e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:47.614730 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e06e95ee-1629-4e52-9a17-4ce177cf106e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776/action" status: 204 len: 0 microversion: 2.1 time: 0.073561 May 19 05:47:47.615385 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3631/7173] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:47:47 2022] POST /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:47:47.624158 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-85d632db-afed-4f29-875a-d18fd65637cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:47.624787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-85d632db-afed-4f29-875a-d18fd65637cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:47.630883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85d632db-afed-4f29-875a-d18fd65637cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:47.631336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85d632db-afed-4f29-875a-d18fd65637cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:47.632616 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85d632db-afed-4f29-875a-d18fd65637cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:47.633060 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-85d632db-afed-4f29-875a-d18fd65637cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:47.839959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-85d632db-afed-4f29-875a-d18fd65637cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:47.847769 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-85d632db-afed-4f29-875a-d18fd65637cd tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1691 microversion: 2.1 time: 0.227428 May 19 05:47:47.848381 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3543/7174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:47 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1691 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:47.865987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f34b04ef-fc5b-44a6-95d6-e2ac06fbeb18 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:47.867362 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f34b04ef-fc5b-44a6-95d6-e2ac06fbeb18 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:47.873865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f34b04ef-fc5b-44a6-95d6-e2ac06fbeb18 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:47.874340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f34b04ef-fc5b-44a6-95d6-e2ac06fbeb18 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:47.875130 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f34b04ef-fc5b-44a6-95d6-e2ac06fbeb18 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:47.875587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f34b04ef-fc5b-44a6-95d6-e2ac06fbeb18 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:48.093045 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f34b04ef-fc5b-44a6-95d6-e2ac06fbeb18 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:48.101581 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f34b04ef-fc5b-44a6-95d6-e2ac06fbeb18 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1691 microversion: 2.1 time: 0.240036 May 19 05:47:48.102120 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3632/7175] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:47 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1691 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:49.119860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8f7dcd65-1dae-4edc-bf8f-d4e49e22a844 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:47:49.120490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8f7dcd65-1dae-4edc-bf8f-d4e49e22a844 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:47:49.127839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f7dcd65-1dae-4edc-bf8f-d4e49e22a844 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:49.128299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f7dcd65-1dae-4edc-bf8f-d4e49e22a844 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:49.129093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f7dcd65-1dae-4edc-bf8f-d4e49e22a844 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:49.129555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f7dcd65-1dae-4edc-bf8f-d4e49e22a844 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:49.258987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8f7dcd65-1dae-4edc-bf8f-d4e49e22a844 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:47:49.266555 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8f7dcd65-1dae-4edc-bf8f-d4e49e22a844 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1683 microversion: 2.1 time: 0.150677 May 19 05:47:49.267146 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3544/7176] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:47:49 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:47:52.177797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-e0826313-e8e6-4649-ab9c-03feb8cc60e8 req-bca89b18-f6a5-4bdd-85d1-87051cff58eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0764fc81-97db-4fbe-a028-cae4917b7776", "name": "network-vif-plugged", "status": "completed", "tag": "7161695d-0654-41ca-a770-41df47851127"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:47:52.186789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e0826313-e8e6-4649-ab9c-03feb8cc60e8 req-bca89b18-f6a5-4bdd-85d1-87051cff58eb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:47:52.187251 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-e0826313-e8e6-4649-ab9c-03feb8cc60e8 req-bca89b18-f6a5-4bdd-85d1-87051cff58eb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:47:52.198881 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-e0826313-e8e6-4649-ab9c-03feb8cc60e8 req-bca89b18-f6a5-4bdd-85d1-87051cff58eb service nova] Creating event network-vif-plugged:7161695d-0654-41ca-a770-41df47851127 for instance 0764fc81-97db-4fbe-a028-cae4917b7776 on n-h1-766726-30 May 19 05:47:52.204241 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-e0826313-e8e6-4649-ab9c-03feb8cc60e8 req-bca89b18-f6a5-4bdd-85d1-87051cff58eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091568 May 19 05:47:52.204885 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3633/7177] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:48:15.454546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b66fc46d-3e76-4bfa-9dc7-db21ace74bec tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:48:15.455480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b66fc46d-3e76-4bfa-9dc7-db21ace74bec tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:15.457815 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=32 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:15.458472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:15.464760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b66fc46d-3e76-4bfa-9dc7-db21ace74bec tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:15.465240 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b66fc46d-3e76-4bfa-9dc7-db21ace74bec tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:15.466273 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b66fc46d-3e76-4bfa-9dc7-db21ace74bec tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:15.466714 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b66fc46d-3e76-4bfa-9dc7-db21ace74bec tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:15.522248 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b66fc46d-3e76-4bfa-9dc7-db21ace74bec tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776/action" status: 200 len: 24580 microversion: 2.1 time: 0.071607 May 19 05:48:15.523434 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3545/7178] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:48:15 2022] POST /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776/action => generated 24580 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:48:22.820848 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2f017a96-e6da-4fbd-b0da-c401e7c239f5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:22.821511 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2f017a96-e6da-4fbd-b0da-c401e7c239f5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:22.823465 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-ebec2523-5d44-4142-9879-1197fe74967a req-a1c646b9-f56a-4f95-a03f-cfdd0217d00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0764fc81-97db-4fbe-a028-cae4917b7776", "tag": "7161695d-0654-41ca-a770-41df47851127"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:48:22.824905 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=28 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:22.825807 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:22.832174 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f017a96-e6da-4fbd-b0da-c401e7c239f5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:22.832690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f017a96-e6da-4fbd-b0da-c401e7c239f5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:22.833816 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f017a96-e6da-4fbd-b0da-c401e7c239f5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:22.834284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2f017a96-e6da-4fbd-b0da-c401e7c239f5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:22.835414 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ebec2523-5d44-4142-9879-1197fe74967a req-a1c646b9-f56a-4f95-a03f-cfdd0217d00a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:22.836295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-ebec2523-5d44-4142-9879-1197fe74967a req-a1c646b9-f56a-4f95-a03f-cfdd0217d00a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:22.849103 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-ebec2523-5d44-4142-9879-1197fe74967a req-a1c646b9-f56a-4f95-a03f-cfdd0217d00a service nova] Creating event network-changed:7161695d-0654-41ca-a770-41df47851127 for instance 0764fc81-97db-4fbe-a028-cae4917b7776 on n-h1-766726-30 May 19 05:48:22.855425 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-ebec2523-5d44-4142-9879-1197fe74967a req-a1c646b9-f56a-4f95-a03f-cfdd0217d00a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036422 May 19 05:48:22.857268 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3546/7179] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:48:22.863361 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2f017a96-e6da-4fbd-b0da-c401e7c239f5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:48:22.945352 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2f017a96-e6da-4fbd-b0da-c401e7c239f5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 204 len: 0 microversion: 2.1 time: 0.128254 May 19 05:48:22.945888 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3634/7180] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:48:22 2022] DELETE /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:48:22.956915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-306694b2-f82b-4975-8dd9-6d99edcf1fb7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:22.958295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-306694b2-f82b-4975-8dd9-6d99edcf1fb7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:22.965677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-306694b2-f82b-4975-8dd9-6d99edcf1fb7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:22.966137 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-306694b2-f82b-4975-8dd9-6d99edcf1fb7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:22.967173 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-306694b2-f82b-4975-8dd9-6d99edcf1fb7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:22.967805 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-306694b2-f82b-4975-8dd9-6d99edcf1fb7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:23.106817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-306694b2-f82b-4975-8dd9-6d99edcf1fb7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:23.114440 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-306694b2-f82b-4975-8dd9-6d99edcf1fb7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1689 microversion: 2.1 time: 0.162987 May 19 05:48:23.115018 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3547/7181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:22 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:24.133138 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-066401ee-ea49-4688-a49c-ce73b2b6efe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:24.133783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-066401ee-ea49-4688-a49c-ce73b2b6efe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:24.140879 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-066401ee-ea49-4688-a49c-ce73b2b6efe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:24.141385 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-066401ee-ea49-4688-a49c-ce73b2b6efe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:24.142170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-066401ee-ea49-4688-a49c-ce73b2b6efe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:24.142626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-066401ee-ea49-4688-a49c-ce73b2b6efe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:24.281169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-066401ee-ea49-4688-a49c-ce73b2b6efe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:24.288892 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-066401ee-ea49-4688-a49c-ce73b2b6efe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1689 microversion: 2.1 time: 0.160727 May 19 05:48:24.289501 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3635/7182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:24 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:24.870644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-c2cbdb16-2237-41a9-aea7-1c7609eea179 req-71a42005-f81f-44b1-a838-6685a6b8bba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0764fc81-97db-4fbe-a028-cae4917b7776", "name": "network-vif-deleted", "tag": "7161695d-0654-41ca-a770-41df47851127"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:48:24.879674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c2cbdb16-2237-41a9-aea7-1c7609eea179 req-71a42005-f81f-44b1-a838-6685a6b8bba4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:24.880123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c2cbdb16-2237-41a9-aea7-1c7609eea179 req-71a42005-f81f-44b1-a838-6685a6b8bba4 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:24.891849 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-c2cbdb16-2237-41a9-aea7-1c7609eea179 req-71a42005-f81f-44b1-a838-6685a6b8bba4 service nova] Creating event network-vif-deleted:7161695d-0654-41ca-a770-41df47851127 for instance 0764fc81-97db-4fbe-a028-cae4917b7776 on n-h1-766726-30 May 19 05:48:24.896483 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-c2cbdb16-2237-41a9-aea7-1c7609eea179 req-71a42005-f81f-44b1-a838-6685a6b8bba4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029634 May 19 05:48:24.897104 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3548/7183] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:48:25.306671 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:25.307303 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:25.314285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:25.314748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:25.315533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:25.315987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:25.355384 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:25.355861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:25.356342 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lazy-loading 'fault' on Instance uuid 0764fc81-97db-4fbe-a028-cae4917b7776 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:48:25.398809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:25.405901 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d4fe1b64-8ed4-4c0d-bc1d-ca5f234fe72f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 200 len: 1357 microversion: 2.1 time: 0.103581 May 19 05:48:25.406237 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3636/7184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:25 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:26.424344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:26.425044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 0764fc81-97db-4fbe-a028-cae4917b7776] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:26.431980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:26.432427 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:26.433215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:26.433655 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:26.446862 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] HTTP exception thrown: Instance 0764fc81-97db-4fbe-a028-cae4917b7776 could not be found. May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Request method failure captured: May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 HTTP/1.1 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdkX6Q-mHJHc-Qf4dH9OyPZeYKkTAwwAkZHuSFjw1ifeHS0owpYaW-O2ut81RUXMcNyEzMnh3k8Xq9imMzE-MGBKWhUF_3lv7wUFKNnOUnJVxSM2enVNbzWJluamSO0KE75ANYPbZOZxbRYCCqI0K5-EJC1osydmnlQ1xZBDQZoDqoU May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f34ee9fba7ea4656831eb1f98bd79813 May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 0764fc81-97db-4fbe-a028-cae4917b7776 could not be found. May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '0764fc81-97db-4fbe-a028-cae4917b7776'} May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0764fc81-97db-4fbe-a028-cae4917b7776 could not be found. May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0764fc81-97db-4fbe-a028-cae4917b7776 could not be found. May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:48:26.448473 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0764fc81-97db-4fbe-a028-cae4917b7776 could not be found. May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Returning 404 to user: Instance 0764fc81-97db-4fbe-a028-cae4917b7776 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ce5e3a76-01ba-469b-8c43-46baa1fb3c0b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776" status: 404 len: 111 microversion: 2.1 time: 0.030787 May 19 05:48:26.452050 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3549/7185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:26 2022] GET /compute/v2.1/servers/0764fc81-97db-4fbe-a028-cae4917b7776 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:48:29.373588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be20ae5e-5ba7-485a-8859-fa109dbf03bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '.version_select at 0x7fd314b170d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:29.395738 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be20ae5e-5ba7-485a-8859-fa109dbf03bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1108844827" status: 202 len: 0 microversion: 2.1 time: 0.026028 May 19 05:48:29.397366 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3637/7186] 10.222.0.58 () {58 vars in 1283 bytes} [Thu May 19 05:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1108844827 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:48:29.422102 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-18cd45bb-6117-458c-928b-81a1b7161111 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: .version_select at 0x7fd315a6d430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-241747561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyhI/8Nwa0ygB2IfQv7p/b4f09iTyqtE3J2lAMDFRWi5xKOTQL5bsSG4NGaVlfgDw9cdECzp4o75ThPJjVL/glubZTwixSLC118B1qMeJcXN3LalXXKfoBr3AG/uga7Cw=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:48:29.438969 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-18cd45bb-6117-458c-928b-81a1b7161111 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:48:29.444380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-18cd45bb-6117-458c-928b-81a1b7161111 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:48:29.468479 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-18cd45bb-6117-458c-928b-81a1b7161111 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050277 May 19 05:48:29.469124 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3550/7187] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:48:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:48:34.844336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1328357553", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "25082880-a9f1-4c57-9161-170a435409c0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-241747561", "security_groups": [{"name": "tempest-secgroup-smoke-2055501138"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:48:34.971152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] validate_networks() for [('25082880-a9f1-4c57-9161-170a435409c0', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:48:35.404159 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:35.479534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:48:35.480170 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:48:35.480818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:48:35.482134 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:48:35.482577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:48:35.492899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:35.493394 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:35.494220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:35.494681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:35.517514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:48:35.523122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:48:35.536214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:48:35.539123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:48:35.590086 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0a886ad0-9364-408a-861a-9d8a1eb34370 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.750995 May 19 05:48:35.591366 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3638/7188] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:48:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:48:35.603124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-be233029-cd9c-4c12-a679-4417bdd858f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:35.604549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-be233029-cd9c-4c12-a679-4417bdd858f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:35.676154 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-be233029-cd9c-4c12-a679-4417bdd858f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:35.684869 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-be233029-cd9c-4c12-a679-4417bdd858f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1266 microversion: 2.1 time: 0.087149 May 19 05:48:35.685827 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3551/7189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:35 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:36.703557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5df9530f-ad5b-42df-9e0c-a19d90875030 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:36.704322 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5df9530f-ad5b-42df-9e0c-a19d90875030 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:36.713855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5df9530f-ad5b-42df-9e0c-a19d90875030 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:36.714321 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5df9530f-ad5b-42df-9e0c-a19d90875030 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:36.716416 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5df9530f-ad5b-42df-9e0c-a19d90875030 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:36.717626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5df9530f-ad5b-42df-9e0c-a19d90875030 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:36.814087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5df9530f-ad5b-42df-9e0c-a19d90875030 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:36.824478 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5df9530f-ad5b-42df-9e0c-a19d90875030 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1324 microversion: 2.1 time: 0.125382 May 19 05:48:36.825106 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3639/7190] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:36 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1324 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:37.842603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6a099664-093b-4614-b944-6af4bc0702b2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:37.843303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6a099664-093b-4614-b944-6af4bc0702b2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:37.847098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=16 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:37.852831 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a099664-093b-4614-b944-6af4bc0702b2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:37.853819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a099664-093b-4614-b944-6af4bc0702b2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:37.854899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a099664-093b-4614-b944-6af4bc0702b2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:37.855725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6a099664-093b-4614-b944-6af4bc0702b2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:38.092257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6a099664-093b-4614-b944-6af4bc0702b2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:38.101597 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6a099664-093b-4614-b944-6af4bc0702b2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1392 microversion: 2.1 time: 0.263193 May 19 05:48:38.102503 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3552/7191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:37 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:38.508998 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-6149cc21-d64a-4947-b169-5f8c2edefb7f req-5e1ffa98-d879-4d44-bcfb-9fece66abd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11042d7e-b052-4b56-9e7a-9b4eed030d2a", "tag": "daa6fa57-4efb-44bb-8517-c3dd12aad2e4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:48:38.538473 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6149cc21-d64a-4947-b169-5f8c2edefb7f req-5e1ffa98-d879-4d44-bcfb-9fece66abd59 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:38.539229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-6149cc21-d64a-4947-b169-5f8c2edefb7f req-5e1ffa98-d879-4d44-bcfb-9fece66abd59 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:38.558219 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-6149cc21-d64a-4947-b169-5f8c2edefb7f req-5e1ffa98-d879-4d44-bcfb-9fece66abd59 service nova] Creating event network-changed:daa6fa57-4efb-44bb-8517-c3dd12aad2e4 for instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a on n-h2-766726-30 May 19 05:48:38.563502 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-6149cc21-d64a-4947-b169-5f8c2edefb7f req-5e1ffa98-d879-4d44-bcfb-9fece66abd59 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064329 May 19 05:48:38.564120 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3640/7192] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:48:39.118748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4a8e9b3c-082b-4f11-a01f-faf9bcac89bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:39.119296 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4a8e9b3c-082b-4f11-a01f-faf9bcac89bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:39.126325 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a8e9b3c-082b-4f11-a01f-faf9bcac89bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:39.126788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a8e9b3c-082b-4f11-a01f-faf9bcac89bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:39.127566 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a8e9b3c-082b-4f11-a01f-faf9bcac89bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:39.128012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4a8e9b3c-082b-4f11-a01f-faf9bcac89bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:39.265899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4a8e9b3c-082b-4f11-a01f-faf9bcac89bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:39.274182 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4a8e9b3c-082b-4f11-a01f-faf9bcac89bf tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1392 microversion: 2.1 time: 0.159501 May 19 05:48:39.274762 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3553/7193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:39 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:40.291630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-949258ef-937e-4067-af81-a4a86ff52c14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:40.292357 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-949258ef-937e-4067-af81-a4a86ff52c14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:40.300677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-949258ef-937e-4067-af81-a4a86ff52c14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:40.300917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-949258ef-937e-4067-af81-a4a86ff52c14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:40.301745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-949258ef-937e-4067-af81-a4a86ff52c14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:40.302201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-949258ef-937e-4067-af81-a4a86ff52c14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:40.435552 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-949258ef-937e-4067-af81-a4a86ff52c14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:40.443347 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-949258ef-937e-4067-af81-a4a86ff52c14 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1392 microversion: 2.1 time: 0.156719 May 19 05:48:40.443950 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3641/7194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:40 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:41.460596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-969b825e-cbfd-4740-83dd-288c6035830e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:41.461850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-969b825e-cbfd-4740-83dd-288c6035830e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:41.469481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969b825e-cbfd-4740-83dd-288c6035830e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:41.470361 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969b825e-cbfd-4740-83dd-288c6035830e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:41.471352 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969b825e-cbfd-4740-83dd-288c6035830e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:41.471868 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-969b825e-cbfd-4740-83dd-288c6035830e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:41.608447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-969b825e-cbfd-4740-83dd-288c6035830e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:41.616907 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-969b825e-cbfd-4740-83dd-288c6035830e tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1392 microversion: 2.1 time: 0.160542 May 19 05:48:41.617517 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3554/7195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:41 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:42.634521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f1acd86-aaf1-48ab-9880-36f71c78cf5f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:42.635161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5f1acd86-aaf1-48ab-9880-36f71c78cf5f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:42.642126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f1acd86-aaf1-48ab-9880-36f71c78cf5f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:42.642592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f1acd86-aaf1-48ab-9880-36f71c78cf5f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:42.643366 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f1acd86-aaf1-48ab-9880-36f71c78cf5f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:42.643845 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f1acd86-aaf1-48ab-9880-36f71c78cf5f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:42.776458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5f1acd86-aaf1-48ab-9880-36f71c78cf5f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:42.784035 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5f1acd86-aaf1-48ab-9880-36f71c78cf5f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1392 microversion: 2.1 time: 0.154132 May 19 05:48:42.784611 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3642/7196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:42 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:43.363290 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d03bc202-3e38-4925-81ea-2ad1fc4cec62 req-7936f566-5c48-47c5-bd9c-fe665b6b2a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11042d7e-b052-4b56-9e7a-9b4eed030d2a", "name": "network-vif-plugged", "status": "completed", "tag": "daa6fa57-4efb-44bb-8517-c3dd12aad2e4"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:48:43.373306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d03bc202-3e38-4925-81ea-2ad1fc4cec62 req-7936f566-5c48-47c5-bd9c-fe665b6b2a19 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:43.374041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d03bc202-3e38-4925-81ea-2ad1fc4cec62 req-7936f566-5c48-47c5-bd9c-fe665b6b2a19 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:43.385850 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d03bc202-3e38-4925-81ea-2ad1fc4cec62 req-7936f566-5c48-47c5-bd9c-fe665b6b2a19 service nova] Creating event network-vif-plugged:daa6fa57-4efb-44bb-8517-c3dd12aad2e4 for instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a on n-h2-766726-30 May 19 05:48:43.391547 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d03bc202-3e38-4925-81ea-2ad1fc4cec62 req-7936f566-5c48-47c5-bd9c-fe665b6b2a19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 May 19 05:48:43.392499 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3555/7197] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:48:43.801524 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-7ab63dab-a56f-4094-86ce-b869b16956fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:43.802111 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-7ab63dab-a56f-4094-86ce-b869b16956fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:43.809802 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ab63dab-a56f-4094-86ce-b869b16956fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:43.810268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ab63dab-a56f-4094-86ce-b869b16956fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:43.811050 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ab63dab-a56f-4094-86ce-b869b16956fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:43.811503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-7ab63dab-a56f-4094-86ce-b869b16956fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:43.946855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-7ab63dab-a56f-4094-86ce-b869b16956fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:43.954638 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-7ab63dab-a56f-4094-86ce-b869b16956fc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1392 microversion: 2.1 time: 0.157209 May 19 05:48:43.955214 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3643/7198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:43 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:44.975164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a602e5a0-919d-4028-808d-1354e6c7bbe1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:44.975850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a602e5a0-919d-4028-808d-1354e6c7bbe1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:44.982198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a602e5a0-919d-4028-808d-1354e6c7bbe1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:44.982647 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a602e5a0-919d-4028-808d-1354e6c7bbe1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:44.983404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a602e5a0-919d-4028-808d-1354e6c7bbe1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:44.983866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a602e5a0-919d-4028-808d-1354e6c7bbe1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:45.114481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a602e5a0-919d-4028-808d-1354e6c7bbe1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:45.122627 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a602e5a0-919d-4028-808d-1354e6c7bbe1 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1563 microversion: 2.1 time: 0.152647 May 19 05:48:45.123234 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3556/7199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:44 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:45.138692 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d1453f59-6fb3-475e-8a29-3d06bb7593dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:45.139430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d1453f59-6fb3-475e-8a29-3d06bb7593dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:45.146567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1453f59-6fb3-475e-8a29-3d06bb7593dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:45.147035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1453f59-6fb3-475e-8a29-3d06bb7593dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:45.147880 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1453f59-6fb3-475e-8a29-3d06bb7593dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:45.148334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d1453f59-6fb3-475e-8a29-3d06bb7593dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:45.279292 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d1453f59-6fb3-475e-8a29-3d06bb7593dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:45.286873 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d1453f59-6fb3-475e-8a29-3d06bb7593dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1563 microversion: 2.1 time: 0.152228 May 19 05:48:45.287459 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3644/7200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:45 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:48:46.851252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-82e22312-37bf-4452-a28a-e3aaf25a7477 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:48:46.852140 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-82e22312-37bf-4452-a28a-e3aaf25a7477 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:48:46.853956 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5425b80f-5aee-4d8d-b969-554cb95adbaf req-da1ce332-745b-4073-8139-8d6f9b36dae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11042d7e-b052-4b56-9e7a-9b4eed030d2a", "tag": "daa6fa57-4efb-44bb-8517-c3dd12aad2e4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:48:46.857331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:46.858071 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:46.858470 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:46.860338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:48:46.863070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82e22312-37bf-4452-a28a-e3aaf25a7477 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:46.863579 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82e22312-37bf-4452-a28a-e3aaf25a7477 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:46.864426 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82e22312-37bf-4452-a28a-e3aaf25a7477 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:46.864973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-82e22312-37bf-4452-a28a-e3aaf25a7477 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:46.868085 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5425b80f-5aee-4d8d-b969-554cb95adbaf req-da1ce332-745b-4073-8139-8d6f9b36dae6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:48:46.868555 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5425b80f-5aee-4d8d-b969-554cb95adbaf req-da1ce332-745b-4073-8139-8d6f9b36dae6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:48:46.884246 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5425b80f-5aee-4d8d-b969-554cb95adbaf req-da1ce332-745b-4073-8139-8d6f9b36dae6 service nova] Creating event network-changed:daa6fa57-4efb-44bb-8517-c3dd12aad2e4 for instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a on n-h2-766726-30 May 19 05:48:46.889616 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5425b80f-5aee-4d8d-b969-554cb95adbaf req-da1ce332-745b-4073-8139-8d6f9b36dae6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040449 May 19 05:48:46.890603 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3645/7201] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:48:47.382170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-82e22312-37bf-4452-a28a-e3aaf25a7477 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:48:47.390908 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-82e22312-37bf-4452-a28a-e3aaf25a7477 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1563 microversion: 2.1 time: 0.544011 May 19 05:48:47.391865 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3557/7202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:48:46 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1563 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:10.637540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:49:10.638399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=36 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:49:10.684698 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca12c9fb-d682-4121-9fc8-e84e0e771402 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:49:10.685827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca12c9fb-d682-4121-9fc8-e84e0e771402 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:10.692980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca12c9fb-d682-4121-9fc8-e84e0e771402 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:10.693602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca12c9fb-d682-4121-9fc8-e84e0e771402 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:10.694533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca12c9fb-d682-4121-9fc8-e84e0e771402 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:10.695020 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ca12c9fb-d682-4121-9fc8-e84e0e771402 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:10.746789 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ca12c9fb-d682-4121-9fc8-e84e0e771402 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action" status: 200 len: 24563 microversion: 2.1 time: 0.115559 May 19 05:49:10.747453 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3646/7203] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:49:10 2022] POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action => generated 24563 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:49:17.108730 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5d839b4-8522-4351-8b11-5889bc6a8e7c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:49:17.111127 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:49:17.111774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=32 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:49:17.117980 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5d839b4-8522-4351-8b11-5889bc6a8e7c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:17.118436 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5d839b4-8522-4351-8b11-5889bc6a8e7c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:17.141166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e5d839b4-8522-4351-8b11-5889bc6a8e7c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Going to try to stop instance {{(pid=124819) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 05:49:17.183125 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e5d839b4-8522-4351-8b11-5889bc6a8e7c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action" status: 202 len: 0 microversion: 2.1 time: 0.078338 May 19 05:49:17.183735 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3558/7204] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:49:17 2022] POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:49:17.192686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-87679594-9f83-47f3-8dea-ca2a88d5cfe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:17.193445 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-87679594-9f83-47f3-8dea-ca2a88d5cfe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:17.202666 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87679594-9f83-47f3-8dea-ca2a88d5cfe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:17.203239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87679594-9f83-47f3-8dea-ca2a88d5cfe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:17.204233 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87679594-9f83-47f3-8dea-ca2a88d5cfe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:17.204648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-87679594-9f83-47f3-8dea-ca2a88d5cfe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:17.346760 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-87679594-9f83-47f3-8dea-ca2a88d5cfe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:17.355090 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-87679594-9f83-47f3-8dea-ca2a88d5cfe6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1692 microversion: 2.1 time: 0.166748 May 19 05:49:17.355661 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3647/7205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:17 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:49:18.373707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9a6f67f8-436a-480e-a3ca-06b38e8536dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:18.374510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9a6f67f8-436a-480e-a3ca-06b38e8536dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:18.381215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a6f67f8-436a-480e-a3ca-06b38e8536dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:18.381667 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a6f67f8-436a-480e-a3ca-06b38e8536dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:18.382430 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a6f67f8-436a-480e-a3ca-06b38e8536dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:18.382863 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9a6f67f8-436a-480e-a3ca-06b38e8536dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:18.513820 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9a6f67f8-436a-480e-a3ca-06b38e8536dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:18.521301 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9a6f67f8-436a-480e-a3ca-06b38e8536dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1692 microversion: 2.1 time: 0.153181 May 19 05:49:18.521894 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3559/7206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:18 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:19.539436 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-10f99f0c-4ad6-4acb-9e21-73d48289e808 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:19.539977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-10f99f0c-4ad6-4acb-9e21-73d48289e808 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:19.547583 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10f99f0c-4ad6-4acb-9e21-73d48289e808 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:19.548057 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10f99f0c-4ad6-4acb-9e21-73d48289e808 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:19.548841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10f99f0c-4ad6-4acb-9e21-73d48289e808 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:19.549349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-10f99f0c-4ad6-4acb-9e21-73d48289e808 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:19.680794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-10f99f0c-4ad6-4acb-9e21-73d48289e808 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:19.688468 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-10f99f0c-4ad6-4acb-9e21-73d48289e808 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1692 microversion: 2.1 time: 0.153231 May 19 05:49:19.689047 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3648/7207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:19 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:20.708664 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6c2ceea1-2ce5-4404-9a18-083fea2090f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:20.709324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6c2ceea1-2ce5-4404-9a18-083fea2090f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:20.716367 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2ceea1-2ce5-4404-9a18-083fea2090f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:20.717155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2ceea1-2ce5-4404-9a18-083fea2090f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:20.717947 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2ceea1-2ce5-4404-9a18-083fea2090f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:20.718387 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6c2ceea1-2ce5-4404-9a18-083fea2090f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:20.847856 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6c2ceea1-2ce5-4404-9a18-083fea2090f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:20.855942 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6c2ceea1-2ce5-4404-9a18-083fea2090f9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1692 microversion: 2.1 time: 0.154416 May 19 05:49:20.856521 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3560/7208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:20 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:21.873434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8e86c315-9667-4222-8c05-635074e44648 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:21.874061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8e86c315-9667-4222-8c05-635074e44648 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:21.880911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e86c315-9667-4222-8c05-635074e44648 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:21.881403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e86c315-9667-4222-8c05-635074e44648 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:21.882175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e86c315-9667-4222-8c05-635074e44648 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:21.882622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8e86c315-9667-4222-8c05-635074e44648 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:22.017570 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8e86c315-9667-4222-8c05-635074e44648 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:22.025266 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8e86c315-9667-4222-8c05-635074e44648 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1692 microversion: 2.1 time: 0.155744 May 19 05:49:22.025842 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3649/7209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:21 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:23.042207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a7ba9ded-4bd9-4207-864c-6ec3c93628e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:23.042822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a7ba9ded-4bd9-4207-864c-6ec3c93628e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:23.049219 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ba9ded-4bd9-4207-864c-6ec3c93628e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:23.049674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ba9ded-4bd9-4207-864c-6ec3c93628e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:23.050433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ba9ded-4bd9-4207-864c-6ec3c93628e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:23.050872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a7ba9ded-4bd9-4207-864c-6ec3c93628e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:23.183568 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a7ba9ded-4bd9-4207-864c-6ec3c93628e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:23.191066 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a7ba9ded-4bd9-4207-864c-6ec3c93628e6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1692 microversion: 2.1 time: 0.152839 May 19 05:49:23.191639 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3561/7210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:23 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:49:24.207885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9ed90b6f-5ab7-434c-9ed1-81841d6d0236 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:24.208518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9ed90b6f-5ab7-434c-9ed1-81841d6d0236 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:24.216147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ed90b6f-5ab7-434c-9ed1-81841d6d0236 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:24.216613 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ed90b6f-5ab7-434c-9ed1-81841d6d0236 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:24.217668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ed90b6f-5ab7-434c-9ed1-81841d6d0236 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:24.218125 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9ed90b6f-5ab7-434c-9ed1-81841d6d0236 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:24.355076 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9ed90b6f-5ab7-434c-9ed1-81841d6d0236 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:24.362644 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9ed90b6f-5ab7-434c-9ed1-81841d6d0236 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1692 microversion: 2.1 time: 0.158666 May 19 05:49:24.363219 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3650/7211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:24 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:25.379593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13c7f009-5292-44dd-9e90-f9285c7ba611 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:25.380731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13c7f009-5292-44dd-9e90-f9285c7ba611 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:25.388959 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c7f009-5292-44dd-9e90-f9285c7ba611 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:25.389433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c7f009-5292-44dd-9e90-f9285c7ba611 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:25.390196 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c7f009-5292-44dd-9e90-f9285c7ba611 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:25.390633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13c7f009-5292-44dd-9e90-f9285c7ba611 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:25.519135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-13c7f009-5292-44dd-9e90-f9285c7ba611 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:25.526698 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13c7f009-5292-44dd-9e90-f9285c7ba611 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1692 microversion: 2.1 time: 0.151024 May 19 05:49:25.527270 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3562/7212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:25 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:26.544289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1941808b-bf8e-4980-8dd7-6d6b91cd8ea9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:26.544921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1941808b-bf8e-4980-8dd7-6d6b91cd8ea9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:26.552001 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1941808b-bf8e-4980-8dd7-6d6b91cd8ea9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:26.552467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1941808b-bf8e-4980-8dd7-6d6b91cd8ea9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:26.553287 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1941808b-bf8e-4980-8dd7-6d6b91cd8ea9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:26.553743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1941808b-bf8e-4980-8dd7-6d6b91cd8ea9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:26.685005 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1941808b-bf8e-4980-8dd7-6d6b91cd8ea9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:26.692826 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1941808b-bf8e-4980-8dd7-6d6b91cd8ea9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1692 microversion: 2.1 time: 0.153042 May 19 05:49:26.694216 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3651/7213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:26 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:27.710349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-840a6ba6-bbe9-4fe6-825d-65e8514d03a0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:27.710979 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-840a6ba6-bbe9-4fe6-825d-65e8514d03a0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:27.718468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840a6ba6-bbe9-4fe6-825d-65e8514d03a0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:27.718943 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840a6ba6-bbe9-4fe6-825d-65e8514d03a0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:27.719711 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840a6ba6-bbe9-4fe6-825d-65e8514d03a0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:27.720189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-840a6ba6-bbe9-4fe6-825d-65e8514d03a0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:27.929539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-840a6ba6-bbe9-4fe6-825d-65e8514d03a0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:27.937107 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-840a6ba6-bbe9-4fe6-825d-65e8514d03a0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1669 microversion: 2.1 time: 0.230802 May 19 05:49:27.937686 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3563/7214] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:27 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1669 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:29.025714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0352aaba-c366-4ca7-9b46-ead0dc06af62 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:49:29.026690 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0352aaba-c366-4ca7-9b46-ead0dc06af62 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:29.033750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0352aaba-c366-4ca7-9b46-ead0dc06af62 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:29.034214 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0352aaba-c366-4ca7-9b46-ead0dc06af62 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:29.034999 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0352aaba-c366-4ca7-9b46-ead0dc06af62 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:29.035455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0352aaba-c366-4ca7-9b46-ead0dc06af62 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:29.087225 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0352aaba-c366-4ca7-9b46-ead0dc06af62 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action" status: 200 len: 35649 microversion: 2.1 time: 0.065269 May 19 05:49:29.088229 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3652/7215] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:49:29 2022] POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action => generated 35649 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:49:29.099041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ec959c8d-9de8-41fc-a027-d9974d39f369 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:49:29.106650 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec959c8d-9de8-41fc-a027-d9974d39f369 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:29.107111 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec959c8d-9de8-41fc-a027-d9974d39f369 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:29.129740 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ec959c8d-9de8-41fc-a027-d9974d39f369 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Going to try to start instance {{(pid=124819) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 05:49:29.172167 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ec959c8d-9de8-41fc-a027-d9974d39f369 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action" status: 202 len: 0 microversion: 2.1 time: 0.076828 May 19 05:49:29.172781 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3564/7216] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:49:29 2022] POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:49:29.181545 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-dc30f6c6-8cc1-4c9d-804f-6ca333f3955b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:29.182820 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-dc30f6c6-8cc1-4c9d-804f-6ca333f3955b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:29.190178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc30f6c6-8cc1-4c9d-804f-6ca333f3955b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:29.191307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc30f6c6-8cc1-4c9d-804f-6ca333f3955b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:29.192102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc30f6c6-8cc1-4c9d-804f-6ca333f3955b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:29.192974 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-dc30f6c6-8cc1-4c9d-804f-6ca333f3955b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:29.413886 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-dc30f6c6-8cc1-4c9d-804f-6ca333f3955b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:29.422214 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-dc30f6c6-8cc1-4c9d-804f-6ca333f3955b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1678 microversion: 2.1 time: 0.244952 May 19 05:49:29.422798 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3653/7217] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:29 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:30.441316 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3b9cfd1f-abf0-428c-bba7-9242a8d31316 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:49:30.442020 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3b9cfd1f-abf0-428c-bba7-9242a8d31316 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:30.448793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b9cfd1f-abf0-428c-bba7-9242a8d31316 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:30.449275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b9cfd1f-abf0-428c-bba7-9242a8d31316 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:30.450042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b9cfd1f-abf0-428c-bba7-9242a8d31316 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:30.450476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3b9cfd1f-abf0-428c-bba7-9242a8d31316 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:30.583873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3b9cfd1f-abf0-428c-bba7-9242a8d31316 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:49:30.596315 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3b9cfd1f-abf0-428c-bba7-9242a8d31316 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1682 microversion: 2.1 time: 0.160176 May 19 05:49:30.596901 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3565/7218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:49:30 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:49:54.828844 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-359d8abb-c88b-4156-a810-60788473b9d0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:49:54.829823 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-359d8abb-c88b-4156-a810-60788473b9d0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:49:54.832421 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=16 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:49:54.833150 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=44 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:49:54.840796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-359d8abb-c88b-4156-a810-60788473b9d0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:54.841297 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-359d8abb-c88b-4156-a810-60788473b9d0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:54.842346 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-359d8abb-c88b-4156-a810-60788473b9d0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:49:54.842799 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-359d8abb-c88b-4156-a810-60788473b9d0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:49:54.892975 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-359d8abb-c88b-4156-a810-60788473b9d0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action" status: 200 len: 60205 microversion: 2.1 time: 0.068150 May 19 05:49:54.893689 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3654/7219] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:49:54 2022] POST /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a/action => generated 60205 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:50:01.874994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d5605a8-ce03-49d4-a704-cb6c623d23cc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:01.875534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1d5605a8-ce03-49d4-a704-cb6c623d23cc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:01.878056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=16 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:01.878178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-40a14864-2944-4b46-9382-dff41a3585e0 req-3ccb769e-ba5f-462c-8350-d4e52df315e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11042d7e-b052-4b56-9e7a-9b4eed030d2a", "tag": "daa6fa57-4efb-44bb-8517-c3dd12aad2e4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:01.878865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:01.884835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d5605a8-ce03-49d4-a704-cb6c623d23cc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:01.885320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d5605a8-ce03-49d4-a704-cb6c623d23cc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:01.886109 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d5605a8-ce03-49d4-a704-cb6c623d23cc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:01.886731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d5605a8-ce03-49d4-a704-cb6c623d23cc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:01.889509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-40a14864-2944-4b46-9382-dff41a3585e0 req-3ccb769e-ba5f-462c-8350-d4e52df315e2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:01.890236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-40a14864-2944-4b46-9382-dff41a3585e0 req-3ccb769e-ba5f-462c-8350-d4e52df315e2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:01.901875 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-40a14864-2944-4b46-9382-dff41a3585e0 req-3ccb769e-ba5f-462c-8350-d4e52df315e2 service nova] Creating event network-changed:daa6fa57-4efb-44bb-8517-c3dd12aad2e4 for instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a on n-h2-766726-30 May 19 05:50:01.907225 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-40a14864-2944-4b46-9382-dff41a3585e0 req-3ccb769e-ba5f-462c-8350-d4e52df315e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033305 May 19 05:50:01.908179 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3655/7220] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:50:01.916469 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1d5605a8-ce03-49d4-a704-cb6c623d23cc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:50:02.029183 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d5605a8-ce03-49d4-a704-cb6c623d23cc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 204 len: 0 microversion: 2.1 time: 0.151863 May 19 05:50:02.030061 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3566/7221] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:50:01 2022] DELETE /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:50:02.043602 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1de3f43f-f92c-4e13-9068-dd43fc808f28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:02.044644 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1de3f43f-f92c-4e13-9068-dd43fc808f28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:02.054465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1de3f43f-f92c-4e13-9068-dd43fc808f28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:02.055197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1de3f43f-f92c-4e13-9068-dd43fc808f28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:02.056028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1de3f43f-f92c-4e13-9068-dd43fc808f28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:02.056798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1de3f43f-f92c-4e13-9068-dd43fc808f28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:02.236387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1de3f43f-f92c-4e13-9068-dd43fc808f28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:02.244361 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1de3f43f-f92c-4e13-9068-dd43fc808f28 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1688 microversion: 2.1 time: 0.207619 May 19 05:50:02.245508 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3656/7222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:02 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1688 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:03.263078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-743e55fa-6fbe-4f1d-9a6e-785283a8c5eb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:03.263795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-743e55fa-6fbe-4f1d-9a6e-785283a8c5eb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:03.270725 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-743e55fa-6fbe-4f1d-9a6e-785283a8c5eb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:03.271184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-743e55fa-6fbe-4f1d-9a6e-785283a8c5eb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:03.271960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-743e55fa-6fbe-4f1d-9a6e-785283a8c5eb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:03.272412 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-743e55fa-6fbe-4f1d-9a6e-785283a8c5eb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:03.651370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-743e55fa-6fbe-4f1d-9a6e-785283a8c5eb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:03.660033 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-743e55fa-6fbe-4f1d-9a6e-785283a8c5eb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1688 microversion: 2.1 time: 0.401057 May 19 05:50:03.660637 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3567/7223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:03 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1688 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:04.327841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-a5a082e9-2387-4774-80be-31a0a2afcdc7 req-4e5944d8-2375-48f6-a899-e600c5a8e099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11042d7e-b052-4b56-9e7a-9b4eed030d2a", "name": "network-vif-deleted", "tag": "daa6fa57-4efb-44bb-8517-c3dd12aad2e4"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:04.339463 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a5a082e9-2387-4774-80be-31a0a2afcdc7 req-4e5944d8-2375-48f6-a899-e600c5a8e099 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:04.339921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-a5a082e9-2387-4774-80be-31a0a2afcdc7 req-4e5944d8-2375-48f6-a899-e600c5a8e099 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:04.351815 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-a5a082e9-2387-4774-80be-31a0a2afcdc7 req-4e5944d8-2375-48f6-a899-e600c5a8e099 service nova] Creating event network-vif-deleted:daa6fa57-4efb-44bb-8517-c3dd12aad2e4 for instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a on n-h2-766726-30 May 19 05:50:04.357557 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-a5a082e9-2387-4774-80be-31a0a2afcdc7 req-4e5944d8-2375-48f6-a899-e600c5a8e099 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034161 May 19 05:50:04.358358 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3657/7224] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:50:04.678548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:04.679268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:04.686824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:04.687431 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:04.688652 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:04.688776 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:04.724456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:04.724910 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:04.725573 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lazy-loading 'fault' on Instance uuid 11042d7e-b052-4b56-9e7a-9b4eed030d2a {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:50:04.773751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:04.781585 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b9198c4f-013c-48f5-8752-710f9d07d1d8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 200 len: 1356 microversion: 2.1 time: 0.107001 May 19 05:50:04.782583 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3568/7225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:04 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:50:05.799633 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:05.800367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: 11042d7e-b052-4b56-9e7a-9b4eed030d2a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:05.807743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:05.808194 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:05.808977 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:05.809464 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:05.823361 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] HTTP exception thrown: Instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a could not be found. May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Request method failure captured: May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a HTTP/1.1 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdkX6Q-mHJHc-Qf4dH9OyPZeYKkTAwwAkZHuSFjw1ifeHS0owpYaW-O2ut81RUXMcNyEzMnh3k8Xq9imMzE-MGBKWhUF_3lv7wUFKNnOUnJVxSM2enVNbzWJluamSO0KE75ANYPbZOZxbRYCCqI0K5-EJC1osydmnlQ1xZBDQZoDqoU May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: f34ee9fba7ea4656831eb1f98bd79813 May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a could not be found. May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '11042d7e-b052-4b56-9e7a-9b4eed030d2a'} May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a could not be found. May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a could not be found. May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:50:05.824986 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a could not be found. May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Returning 404 to user: Instance 11042d7e-b052-4b56-9e7a-9b4eed030d2a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-936e8f06-9b1b-42ed-bb17-3a266b0578a6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a" status: 404 len: 111 microversion: 2.1 time: 0.031293 May 19 05:50:05.828805 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3658/7226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:05 2022] GET /compute/v2.1/servers/11042d7e-b052-4b56-9e7a-9b4eed030d2a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:50:08.750537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2a584f51-2a67-487d-9b82-66152d1a30a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '.version_select at 0x7fd315c7bf70>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:08.769419 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2a584f51-2a67-487d-9b82-66152d1a30a9 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-241747561" status: 202 len: 0 microversion: 2.1 time: 0.022757 May 19 05:50:08.770010 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3569/7227] 10.222.0.58 () {58 vars in 1280 bytes} [Thu May 19 05:50:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-241747561 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:50:08.801427 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c58b1266-2ebe-484c-9147-61fa83276e46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: .version_select at 0x7fd314df5af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-728801144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGw70/4gg6wtT258HT1t7UAh0sp7sWV4zcnY/Mk8de1tciD9jp+wSfacYRKk6V3yY5o63Q/Ckt9c86FN7S69NsIuh6k51dzBpPt5mSNeEZJBapEkfEXnWhHzSyWpBoKfQ=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:08.817507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c58b1266-2ebe-484c-9147-61fa83276e46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:50:08.822687 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-c58b1266-2ebe-484c-9147-61fa83276e46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:50:08.846355 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c58b1266-2ebe-484c-9147-61fa83276e46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.048932 May 19 05:50:08.847174 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3659/7228] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:50:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:50:14.532606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-361337652", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "networks": [{"uuid": "44531b8e-9594-4349-80db-ec35a6266244"}], "key_name": "tempest-TestNetworkAdvancedServerOps-728801144", "security_groups": [{"name": "tempest-secgroup-smoke-719564245"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:14.670656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] validate_networks() for [('44531b8e-9594-4349-80db-ec35a6266244', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:50:14.778546 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:15.214030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:50:15.214485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:50:15.214960 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:50:15.215374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:50:15.215783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:50:15.229472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:15.229752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:15.230752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:15.231373 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:15.252002 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:50:15.257767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Getting quotas for user f34ee9fba7ea4656831eb1f98bd79813 and project fb20fe586e054aa48ca6eb2f391aef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:50:15.272077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:50:15.274509 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:50:15.339565 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-71eca426-f2ac-42e3-8e6f-98ff2c27e86a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.811860 May 19 05:50:15.340782 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3570/7229] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:50:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:50:15.350908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f9a40d86-8112-462d-bf21-eb2daa1709c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:15.352258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f9a40d86-8112-462d-bf21-eb2daa1709c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:15.419686 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f9a40d86-8112-462d-bf21-eb2daa1709c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:15.433316 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f9a40d86-8112-462d-bf21-eb2daa1709c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1265 microversion: 2.1 time: 0.085583 May 19 05:50:15.443043 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3660/7230] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:15 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:16.450562 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9697b000-7024-482f-8d9a-947998211e22 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:16.451202 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9697b000-7024-482f-8d9a-947998211e22 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:16.469124 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9697b000-7024-482f-8d9a-947998211e22 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:16.469598 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9697b000-7024-482f-8d9a-947998211e22 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:16.470399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9697b000-7024-482f-8d9a-947998211e22 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:16.470851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9697b000-7024-482f-8d9a-947998211e22 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:16.601047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9697b000-7024-482f-8d9a-947998211e22 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:16.612663 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9697b000-7024-482f-8d9a-947998211e22 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1325 microversion: 2.1 time: 0.166703 May 19 05:50:16.613812 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3571/7231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:16 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1325 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:17.627623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=16 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:17.632709 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cd19163d-6110-47ed-a2a6-d308002320bc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:17.633410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cd19163d-6110-47ed-a2a6-d308002320bc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:17.641041 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd19163d-6110-47ed-a2a6-d308002320bc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:17.641866 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd19163d-6110-47ed-a2a6-d308002320bc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:17.642941 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd19163d-6110-47ed-a2a6-d308002320bc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:17.643595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cd19163d-6110-47ed-a2a6-d308002320bc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:17.877100 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cd19163d-6110-47ed-a2a6-d308002320bc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:17.886087 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cd19163d-6110-47ed-a2a6-d308002320bc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1390 microversion: 2.1 time: 0.258708 May 19 05:50:17.887203 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3661/7232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:17 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1390 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:18.224064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-988d8bf2-1be6-45d0-acee-34396cee1e85 req-ef8cb500-23e7-4365-a899-4525bbacd204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7", "tag": "69c53c8e-04f4-43ec-87c6-8f75858b316a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:18.237001 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-988d8bf2-1be6-45d0-acee-34396cee1e85 req-ef8cb500-23e7-4365-a899-4525bbacd204 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:18.237753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-988d8bf2-1be6-45d0-acee-34396cee1e85 req-ef8cb500-23e7-4365-a899-4525bbacd204 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:18.251431 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-988d8bf2-1be6-45d0-acee-34396cee1e85 req-ef8cb500-23e7-4365-a899-4525bbacd204 service nova] Creating event network-changed:69c53c8e-04f4-43ec-87c6-8f75858b316a for instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 on n-h2-766726-30 May 19 05:50:18.257566 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-988d8bf2-1be6-45d0-acee-34396cee1e85 req-ef8cb500-23e7-4365-a899-4525bbacd204 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037248 May 19 05:50:18.258754 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3572/7233] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:50:18.904215 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-279bcab2-09ab-49e8-ae7a-d74d73bc7f46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:18.904854 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-279bcab2-09ab-49e8-ae7a-d74d73bc7f46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:18.912219 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-279bcab2-09ab-49e8-ae7a-d74d73bc7f46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:18.912632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-279bcab2-09ab-49e8-ae7a-d74d73bc7f46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:18.913453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-279bcab2-09ab-49e8-ae7a-d74d73bc7f46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:18.913915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-279bcab2-09ab-49e8-ae7a-d74d73bc7f46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:19.049712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-279bcab2-09ab-49e8-ae7a-d74d73bc7f46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:19.057407 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-279bcab2-09ab-49e8-ae7a-d74d73bc7f46 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1390 microversion: 2.1 time: 0.157650 May 19 05:50:19.057991 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3662/7234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:18 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:20.075588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d8c30a8-acf0-4812-bc5d-8abea92d0c9c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:20.076215 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2d8c30a8-acf0-4812-bc5d-8abea92d0c9c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:20.082599 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d8c30a8-acf0-4812-bc5d-8abea92d0c9c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:20.083061 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d8c30a8-acf0-4812-bc5d-8abea92d0c9c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:20.083838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d8c30a8-acf0-4812-bc5d-8abea92d0c9c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:20.084291 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d8c30a8-acf0-4812-bc5d-8abea92d0c9c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:20.502624 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d8c30a8-acf0-4812-bc5d-8abea92d0c9c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:20.510152 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d8c30a8-acf0-4812-bc5d-8abea92d0c9c tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1390 microversion: 2.1 time: 0.439775 May 19 05:50:20.510737 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3573/7235] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:20 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1390 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:21.527447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4a69db41-d0d0-4d20-b75f-3fb66b47add7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:21.528083 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4a69db41-d0d0-4d20-b75f-3fb66b47add7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:21.534862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a69db41-d0d0-4d20-b75f-3fb66b47add7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:21.535339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a69db41-d0d0-4d20-b75f-3fb66b47add7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:21.536126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a69db41-d0d0-4d20-b75f-3fb66b47add7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:21.536596 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4a69db41-d0d0-4d20-b75f-3fb66b47add7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:21.665575 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4a69db41-d0d0-4d20-b75f-3fb66b47add7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:21.673088 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4a69db41-d0d0-4d20-b75f-3fb66b47add7 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1390 microversion: 2.1 time: 0.150119 May 19 05:50:21.673682 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3663/7236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:21 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:22.690363 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-98627ba4-433c-4392-8dcf-42f2b522760f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:22.691015 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-98627ba4-433c-4392-8dcf-42f2b522760f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:22.697374 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98627ba4-433c-4392-8dcf-42f2b522760f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:22.698441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98627ba4-433c-4392-8dcf-42f2b522760f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:22.699220 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98627ba4-433c-4392-8dcf-42f2b522760f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:22.699670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98627ba4-433c-4392-8dcf-42f2b522760f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:22.834705 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-98627ba4-433c-4392-8dcf-42f2b522760f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:22.842951 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-98627ba4-433c-4392-8dcf-42f2b522760f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1390 microversion: 2.1 time: 0.156741 May 19 05:50:22.843535 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3574/7237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:22 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:50:23.815881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-5dbfc781-8502-4716-819b-fb64db7b2fae req-6be26d33-2a7b-40e4-b203-df0fb50f8be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7", "name": "network-vif-plugged", "status": "completed", "tag": "69c53c8e-04f4-43ec-87c6-8f75858b316a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:23.826809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5dbfc781-8502-4716-819b-fb64db7b2fae req-6be26d33-2a7b-40e4-b203-df0fb50f8be8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:23.827651 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-5dbfc781-8502-4716-819b-fb64db7b2fae req-6be26d33-2a7b-40e4-b203-df0fb50f8be8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:23.839715 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-5dbfc781-8502-4716-819b-fb64db7b2fae req-6be26d33-2a7b-40e4-b203-df0fb50f8be8 service nova] Creating event network-vif-plugged:69c53c8e-04f4-43ec-87c6-8f75858b316a for instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 on n-h2-766726-30 May 19 05:50:23.845542 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-5dbfc781-8502-4716-819b-fb64db7b2fae req-6be26d33-2a7b-40e4-b203-df0fb50f8be8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033433 May 19 05:50:23.846153 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3664/7238] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:50:23.860100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7b8ebf98-51c2-437a-9c91-a47ff94af9af tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:23.860981 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7b8ebf98-51c2-437a-9c91-a47ff94af9af tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:23.871090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b8ebf98-51c2-437a-9c91-a47ff94af9af tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:23.871775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b8ebf98-51c2-437a-9c91-a47ff94af9af tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:23.872755 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b8ebf98-51c2-437a-9c91-a47ff94af9af tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:23.873429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7b8ebf98-51c2-437a-9c91-a47ff94af9af tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:24.068984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7b8ebf98-51c2-437a-9c91-a47ff94af9af tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:24.076989 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7b8ebf98-51c2-437a-9c91-a47ff94af9af tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1390 microversion: 2.1 time: 0.220715 May 19 05:50:24.078947 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3575/7239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:23 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1390 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:50:25.099465 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-95c7eeb2-7415-4321-9b6f-50e776083a9a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:25.101007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-95c7eeb2-7415-4321-9b6f-50e776083a9a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:25.103828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:25.110017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c7eeb2-7415-4321-9b6f-50e776083a9a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:25.110486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c7eeb2-7415-4321-9b6f-50e776083a9a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:25.111281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c7eeb2-7415-4321-9b6f-50e776083a9a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:25.111733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c7eeb2-7415-4321-9b6f-50e776083a9a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:25.248846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-95c7eeb2-7415-4321-9b6f-50e776083a9a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:25.256665 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-95c7eeb2-7415-4321-9b6f-50e776083a9a tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1390 microversion: 2.1 time: 0.163122 May 19 05:50:25.257475 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3665/7240] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:25 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:26.274264 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d613c54-5959-4c5f-84e7-ac726e242658 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:26.274894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2d613c54-5959-4c5f-84e7-ac726e242658 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:26.278230 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:26.278914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:26.284903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d613c54-5959-4c5f-84e7-ac726e242658 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:26.285391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d613c54-5959-4c5f-84e7-ac726e242658 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:26.286192 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d613c54-5959-4c5f-84e7-ac726e242658 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:26.286644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d613c54-5959-4c5f-84e7-ac726e242658 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:26.419720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d613c54-5959-4c5f-84e7-ac726e242658 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:26.427375 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d613c54-5959-4c5f-84e7-ac726e242658 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1562 microversion: 2.1 time: 0.157096 May 19 05:50:26.427965 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3576/7241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:26 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:26.443236 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c5a50b76-0e0d-4346-908c-c32e67e4050b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:26.443865 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c5a50b76-0e0d-4346-908c-c32e67e4050b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:26.445737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:26.451743 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5a50b76-0e0d-4346-908c-c32e67e4050b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:26.452203 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5a50b76-0e0d-4346-908c-c32e67e4050b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:26.452973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5a50b76-0e0d-4346-908c-c32e67e4050b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:26.453446 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c5a50b76-0e0d-4346-908c-c32e67e4050b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:26.585634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c5a50b76-0e0d-4346-908c-c32e67e4050b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:26.594092 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c5a50b76-0e0d-4346-908c-c32e67e4050b tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1562 microversion: 2.1 time: 0.154803 May 19 05:50:26.594664 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3666/7242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:26 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:28.618429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ae92abbb-4133-4eb3-8768-d13ed6125551 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:28.619194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ae92abbb-4133-4eb3-8768-d13ed6125551 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:28.620714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-77e253fd-792d-4fc9-b7c8-9c13a1f186e1 req-adcd93d6-b9ce-4def-ab64-48ca1e6799a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7", "tag": "69c53c8e-04f4-43ec-87c6-8f75858b316a"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:28.627876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae92abbb-4133-4eb3-8768-d13ed6125551 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:28.628437 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae92abbb-4133-4eb3-8768-d13ed6125551 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:28.629389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae92abbb-4133-4eb3-8768-d13ed6125551 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:28.629832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ae92abbb-4133-4eb3-8768-d13ed6125551 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:28.630515 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-77e253fd-792d-4fc9-b7c8-9c13a1f186e1 req-adcd93d6-b9ce-4def-ab64-48ca1e6799a3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:28.630986 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-77e253fd-792d-4fc9-b7c8-9c13a1f186e1 req-adcd93d6-b9ce-4def-ab64-48ca1e6799a3 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:28.648276 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-77e253fd-792d-4fc9-b7c8-9c13a1f186e1 req-adcd93d6-b9ce-4def-ab64-48ca1e6799a3 service nova] Creating event network-changed:69c53c8e-04f4-43ec-87c6-8f75858b316a for instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 on n-h2-766726-30 May 19 05:50:28.653504 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-77e253fd-792d-4fc9-b7c8-9c13a1f186e1 req-adcd93d6-b9ce-4def-ab64-48ca1e6799a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037047 May 19 05:50:28.654311 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3667/7243] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:50:28.846355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ae92abbb-4133-4eb3-8768-d13ed6125551 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:28.855001 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ae92abbb-4133-4eb3-8768-d13ed6125551 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1681 microversion: 2.1 time: 0.240997 May 19 05:50:28.855948 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3577/7244] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:28 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:50.083290 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=5 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:50.084039 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=34 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:50.088654 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aca3c725-8d6f-4357-af22-d139a437d32f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:50.089705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aca3c725-8d6f-4357-af22-d139a437d32f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:50.096883 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aca3c725-8d6f-4357-af22-d139a437d32f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:50.097368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aca3c725-8d6f-4357-af22-d139a437d32f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:50.098140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aca3c725-8d6f-4357-af22-d139a437d32f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:50.098592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aca3c725-8d6f-4357-af22-d139a437d32f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:50.149834 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aca3c725-8d6f-4357-af22-d139a437d32f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action" status: 200 len: 24576 microversion: 2.1 time: 0.068206 May 19 05:50:50.150507 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3668/7245] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:50:50 2022] POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action => generated 24576 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:50:56.597369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-194a30fb-b807-455f-9ac2-2fb8ef4347c8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:56.597924 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-194a30fb-b807-455f-9ac2-2fb8ef4347c8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:56.599976 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:56.600644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=40 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:50:56.607638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-194a30fb-b807-455f-9ac2-2fb8ef4347c8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:56.608108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-194a30fb-b807-455f-9ac2-2fb8ef4347c8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:56.608882 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-194a30fb-b807-455f-9ac2-2fb8ef4347c8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:56.609353 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-194a30fb-b807-455f-9ac2-2fb8ef4347c8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:56.633774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-194a30fb-b807-455f-9ac2-2fb8ef4347c8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lazy-loading 'flavor' on Instance uuid ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:50:56.702582 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-194a30fb-b807-455f-9ac2-2fb8ef4347c8 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action" status: 202 len: 0 microversion: 2.1 time: 0.109380 May 19 05:50:56.703219 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3578/7246] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:50:56 2022] POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:50:56.711971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0cbda57e-d842-4b2c-a2ab-4f15a419b7d3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:56.713500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0cbda57e-d842-4b2c-a2ab-4f15a419b7d3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:56.721349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0cbda57e-d842-4b2c-a2ab-4f15a419b7d3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:56.722196 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0cbda57e-d842-4b2c-a2ab-4f15a419b7d3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:56.722595 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0cbda57e-d842-4b2c-a2ab-4f15a419b7d3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:56.723048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0cbda57e-d842-4b2c-a2ab-4f15a419b7d3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:56.852218 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0cbda57e-d842-4b2c-a2ab-4f15a419b7d3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:56.863853 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0cbda57e-d842-4b2c-a2ab-4f15a419b7d3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1689 microversion: 2.1 time: 0.156310 May 19 05:50:56.864428 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3669/7247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:56 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:57.882772 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-29dfa9a7-26d9-4c42-a691-0bf65ec5dcfb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:57.883422 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-29dfa9a7-26d9-4c42-a691-0bf65ec5dcfb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:57.889826 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29dfa9a7-26d9-4c42-a691-0bf65ec5dcfb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:57.890284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29dfa9a7-26d9-4c42-a691-0bf65ec5dcfb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:57.891052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29dfa9a7-26d9-4c42-a691-0bf65ec5dcfb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:57.891494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-29dfa9a7-26d9-4c42-a691-0bf65ec5dcfb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:58.310307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-29dfa9a7-26d9-4c42-a691-0bf65ec5dcfb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:58.318324 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-29dfa9a7-26d9-4c42-a691-0bf65ec5dcfb tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1672 microversion: 2.1 time: 0.440763 May 19 05:50:58.318905 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3579/7248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:57 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1672 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:50:59.403783 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1c422b0f-3ffd-4c99-b7ef-bf96e9312f43 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:59.404725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1c422b0f-3ffd-4c99-b7ef-bf96e9312f43 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:59.412423 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c422b0f-3ffd-4c99-b7ef-bf96e9312f43 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:59.412888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c422b0f-3ffd-4c99-b7ef-bf96e9312f43 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:59.413689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c422b0f-3ffd-4c99-b7ef-bf96e9312f43 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:59.414140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-1c422b0f-3ffd-4c99-b7ef-bf96e9312f43 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:59.465660 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1c422b0f-3ffd-4c99-b7ef-bf96e9312f43 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action" status: 200 len: 35038 microversion: 2.1 time: 0.066071 May 19 05:50:59.466776 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3670/7249] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:50:59 2022] POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action => generated 35038 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:50:59.477539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-80f6a72d-b701-4041-863f-825af4229af2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:50:59.478086 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-80f6a72d-b701-4041-863f-825af4229af2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:59.485824 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80f6a72d-b701-4041-863f-825af4229af2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:59.486277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80f6a72d-b701-4041-863f-825af4229af2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:59.487044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80f6a72d-b701-4041-863f-825af4229af2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:59.487512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-80f6a72d-b701-4041-863f-825af4229af2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:59.554948 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-80f6a72d-b701-4041-863f-825af4229af2 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action" status: 202 len: 0 microversion: 2.1 time: 0.080886 May 19 05:50:59.558803 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3580/7250] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:50:59 2022] POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:50:59.564648 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-cc02d6b2-9310-402b-9335-e9b782ed59dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:50:59.565414 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-cc02d6b2-9310-402b-9335-e9b782ed59dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:50:59.575355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc02d6b2-9310-402b-9335-e9b782ed59dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:59.575927 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc02d6b2-9310-402b-9335-e9b782ed59dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:59.576797 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc02d6b2-9310-402b-9335-e9b782ed59dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:50:59.577284 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-cc02d6b2-9310-402b-9335-e9b782ed59dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:50:59.750505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-cc02d6b2-9310-402b-9335-e9b782ed59dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:50:59.758214 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-cc02d6b2-9310-402b-9335-e9b782ed59dc tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1678 microversion: 2.1 time: 0.198071 May 19 05:50:59.758794 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3671/7251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:50:59 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:00.777741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e6576a58-8a3b-43f4-8867-e756bd66b1e3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:00.778376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e6576a58-8a3b-43f4-8867-e756bd66b1e3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:00.785530 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6576a58-8a3b-43f4-8867-e756bd66b1e3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:00.785998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6576a58-8a3b-43f4-8867-e756bd66b1e3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:00.786853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6576a58-8a3b-43f4-8867-e756bd66b1e3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:00.787303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e6576a58-8a3b-43f4-8867-e756bd66b1e3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:00.922395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e6576a58-8a3b-43f4-8867-e756bd66b1e3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:00.930538 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e6576a58-8a3b-43f4-8867-e756bd66b1e3 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1678 microversion: 2.1 time: 0.157764 May 19 05:51:00.931167 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3581/7252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:00 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:01.948355 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-80e4c865-31ac-4a28-9454-34f53a9a2e34 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:01.948921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-80e4c865-31ac-4a28-9454-34f53a9a2e34 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:01.956077 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80e4c865-31ac-4a28-9454-34f53a9a2e34 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:01.956572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80e4c865-31ac-4a28-9454-34f53a9a2e34 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:01.957381 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80e4c865-31ac-4a28-9454-34f53a9a2e34 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:01.957839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-80e4c865-31ac-4a28-9454-34f53a9a2e34 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:02.093123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-80e4c865-31ac-4a28-9454-34f53a9a2e34 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:02.100785 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-80e4c865-31ac-4a28-9454-34f53a9a2e34 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1681 microversion: 2.1 time: 0.156510 May 19 05:51:02.112260 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3672/7253] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:01 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:02.196529 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-03cf7a2d-cb34-4483-b2e9-6c037c8d61e5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:51:02.198106 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-03cf7a2d-cb34-4483-b2e9-6c037c8d61e5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:02.205067 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03cf7a2d-cb34-4483-b2e9-6c037c8d61e5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:02.205494 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03cf7a2d-cb34-4483-b2e9-6c037c8d61e5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:02.206350 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03cf7a2d-cb34-4483-b2e9-6c037c8d61e5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:02.206862 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-03cf7a2d-cb34-4483-b2e9-6c037c8d61e5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:02.250384 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-03cf7a2d-cb34-4483-b2e9-6c037c8d61e5 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action" status: 200 len: 35038 microversion: 2.1 time: 0.057655 May 19 05:51:02.251035 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3582/7254] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:51:02 2022] POST /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7/action => generated 35038 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 05:51:03.306963 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-72115849-975c-494c-957f-23c353b19ca0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:03.307472 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72115849-975c-494c-957f-23c353b19ca0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:03.309214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-0ea867fc-e81a-4ea4-a0f4-180e4bf3f398 req-a6d503b2-56d5-4bd5-8e0d-8ab652a807a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7", "tag": "69c53c8e-04f4-43ec-87c6-8f75858b316a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:51:03.314804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72115849-975c-494c-957f-23c353b19ca0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:03.315506 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72115849-975c-494c-957f-23c353b19ca0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:03.316443 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72115849-975c-494c-957f-23c353b19ca0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:03.316914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-72115849-975c-494c-957f-23c353b19ca0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:03.319596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0ea867fc-e81a-4ea4-a0f4-180e4bf3f398 req-a6d503b2-56d5-4bd5-8e0d-8ab652a807a0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:03.320146 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-0ea867fc-e81a-4ea4-a0f4-180e4bf3f398 req-a6d503b2-56d5-4bd5-8e0d-8ab652a807a0 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:03.346014 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-0ea867fc-e81a-4ea4-a0f4-180e4bf3f398 req-a6d503b2-56d5-4bd5-8e0d-8ab652a807a0 service nova] Creating event network-changed:69c53c8e-04f4-43ec-87c6-8f75858b316a for instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 on n-h2-766726-30 May 19 05:51:03.346259 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-72115849-975c-494c-957f-23c353b19ca0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:51:03.351653 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-0ea867fc-e81a-4ea4-a0f4-180e4bf3f398 req-a6d503b2-56d5-4bd5-8e0d-8ab652a807a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046657 May 19 05:51:03.352268 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3583/7255] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:51:03.441895 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-72115849-975c-494c-957f-23c353b19ca0 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 204 len: 0 microversion: 2.1 time: 0.138650 May 19 05:51:03.443390 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3673/7256] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:51:03 2022] DELETE /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:51:03.453734 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4e3d880b-25cc-4cb9-aa19-f8f6a8fb80c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:03.454447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4e3d880b-25cc-4cb9-aa19-f8f6a8fb80c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:03.460860 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e3d880b-25cc-4cb9-aa19-f8f6a8fb80c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:03.461358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e3d880b-25cc-4cb9-aa19-f8f6a8fb80c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:03.462150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e3d880b-25cc-4cb9-aa19-f8f6a8fb80c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:03.463333 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4e3d880b-25cc-4cb9-aa19-f8f6a8fb80c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:03.617313 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4e3d880b-25cc-4cb9-aa19-f8f6a8fb80c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:03.625088 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4e3d880b-25cc-4cb9-aa19-f8f6a8fb80c6 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1687 microversion: 2.1 time: 0.176555 May 19 05:51:03.625700 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3584/7257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:03 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:04.644135 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-93a70bd6-03c3-42d2-87fa-4127619a157f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:04.644809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-93a70bd6-03c3-42d2-87fa-4127619a157f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:04.652379 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93a70bd6-03c3-42d2-87fa-4127619a157f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:04.652846 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93a70bd6-03c3-42d2-87fa-4127619a157f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:04.653667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93a70bd6-03c3-42d2-87fa-4127619a157f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:04.654116 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-93a70bd6-03c3-42d2-87fa-4127619a157f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:04.820489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-93a70bd6-03c3-42d2-87fa-4127619a157f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:04.828685 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-93a70bd6-03c3-42d2-87fa-4127619a157f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1687 microversion: 2.1 time: 0.188996 May 19 05:51:04.829299 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3674/7258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:04 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:05.610090 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-69e25eb9-e9c9-429f-a765-4c749152c7b7 req-e7a86a98-85b0-46a6-bb69-5fe09aa143e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7", "name": "network-vif-deleted", "tag": "69c53c8e-04f4-43ec-87c6-8f75858b316a"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:51:05.619489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-69e25eb9-e9c9-429f-a765-4c749152c7b7 req-e7a86a98-85b0-46a6-bb69-5fe09aa143e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:05.619939 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-69e25eb9-e9c9-429f-a765-4c749152c7b7 req-e7a86a98-85b0-46a6-bb69-5fe09aa143e1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:05.632058 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-69e25eb9-e9c9-429f-a765-4c749152c7b7 req-e7a86a98-85b0-46a6-bb69-5fe09aa143e1 service nova] Creating event network-vif-deleted:69c53c8e-04f4-43ec-87c6-8f75858b316a for instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 on n-h2-766726-30 May 19 05:51:05.637637 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-69e25eb9-e9c9-429f-a765-4c749152c7b7 req-e7a86a98-85b0-46a6-bb69-5fe09aa143e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031221 May 19 05:51:05.638244 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3585/7259] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:51:05.847577 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:05.848317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:05.856006 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:05.856462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:05.857289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:05.857740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:05.890070 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:05.890537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:05.891010 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lazy-loading 'fault' on Instance uuid ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:51:05.934804 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ee9fba7ea4656831eb1f98bd79813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb20fe586e054aa48ca6eb2f391aef69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:05.943155 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-352f47fd-5c5c-4637-bf0e-1c2833c3e73f tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 200 len: 1355 microversion: 2.1 time: 0.099968 May 19 05:51:05.943745 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3675/7260] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:05 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 1355 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:06.964104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:06.964811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] [instance: ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:06.971421 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:06.971874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:06.972637 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:06.973100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:06.987030 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] HTTP exception thrown: Instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 could not be found. May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Request method failure captured: May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 HTTP/1.1 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdkX6Q-mHJHc-Qf4dH9OyPZeYKkTAwwAkZHuSFjw1ifeHS0owpYaW-O2ut81RUXMcNyEzMnh3k8Xq9imMzE-MGBKWhUF_3lv7wUFKNnOUnJVxSM2enVNbzWJluamSO0KE75ANYPbZOZxbRYCCqI0K5-EJC1osydmnlQ1xZBDQZoDqoU May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fb20fe586e054aa48ca6eb2f391aef69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: fb20fe586e054aa48ca6eb2f391aef69 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-397812875 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: f34ee9fba7ea4656831eb1f98bd79813 May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestNetworkAdvancedServerOps-397812875-project May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 could not be found. May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': 'ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7'} May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 could not be found. May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 could not be found. May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:51:06.988752 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 could not be found. May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Returning 404 to user: Instance ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d61d7686-9113-404a-95ef-f3eeefe92482 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7" status: 404 len: 111 microversion: 2.1 time: 0.031859 May 19 05:51:06.992423 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3586/7261] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:06 2022] GET /compute/v2.1/servers/ca32d42a-2b5d-4f39-95df-0fd7f5a66fd7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:51:10.173152 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ede4659c-cb7c-4405-9a6d-2871af349af4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] Calling method '.version_select at 0x7fd3160a9d30>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:10.192632 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ede4659c-cb7c-4405-9a6d-2871af349af4 tempest-TestNetworkAdvancedServerOps-397812875 tempest-TestNetworkAdvancedServerOps-397812875-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-728801144" status: 202 len: 0 microversion: 2.1 time: 0.023381 May 19 05:51:10.193248 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3676/7262] 10.222.0.58 () {58 vars in 1280 bytes} [Thu May 19 05:51:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-728801144 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:51:21.470245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=18 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:51:21.471787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:51:21.674865 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-506e2bf0-5c03-4b78-9d6c-56703db0a3bf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Action: 'create', calling method: .version_select at 0x7fd31b863a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-977090853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9r641SCaFX2NhwdO4M48+2XbNR985xyrZsId0iQ0+V5vlMVA75WpHiVOAePTIxFv2pzXdbWsltwMsF35shK//JZJJViQlH//MBLcNGWRHlrFd3mHFp5V4L7gbW2T0JrQ=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:51:21.690098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-506e2bf0-5c03-4b78-9d6c-56703db0a3bf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Getting quotas for project da66e528ba9a476195feb5b930ead704. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:51:21.696411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-506e2bf0-5c03-4b78-9d6c-56703db0a3bf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Getting quotas for user 098da32b9a6042e7a194646bc55b3b68 and project da66e528ba9a476195feb5b930ead704. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:51:21.724139 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-506e2bf0-5c03-4b78-9d6c-56703db0a3bf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.256934 May 19 05:51:21.725763 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3587/7263] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:51:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:51:22.652017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:51:22.653229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:51:22.658115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1418534653", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-977090853", "security_groups": [{"name": "tempest-secgroup-smoke-2073575745"}], "networks": [{"uuid": "9f25975c-fa8a-465d-9545-04bb7574801d"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:51:22.777957 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] validate_networks() for [('9f25975c-fa8a-465d-9545-04bb7574801d', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:51:23.163061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:51:23.163528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:51:23.164016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:51:23.164442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:51:23.164894 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:51:23.175257 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:23.176073 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:23.177015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:23.177615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:23.196353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Getting quotas for project da66e528ba9a476195feb5b930ead704. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:51:23.202504 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Getting quotas for user 098da32b9a6042e7a194646bc55b3b68 and project da66e528ba9a476195feb5b930ead704. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:51:23.215643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:51:23.218189 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:51:23.263693 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af284a31-81c4-4f0b-a2e7-fbf50e750690 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.614027 May 19 05:51:23.264405 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3677/7264] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:51:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:51:23.275424 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c9bed488-a7d5-48d0-b90f-539287b359cf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:23.276042 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c9bed488-a7d5-48d0-b90f-539287b359cf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:23.331663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c9bed488-a7d5-48d0-b90f-539287b359cf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:23.344239 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c9bed488-a7d5-48d0-b90f-539287b359cf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1246 microversion: 2.1 time: 0.070636 May 19 05:51:23.344239 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3588/7265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:23 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:24.359301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fd6d3cfa-62d1-4e99-ab26-d42483ce67b2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:24.360046 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fd6d3cfa-62d1-4e99-ab26-d42483ce67b2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:24.424191 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fd6d3cfa-62d1-4e99-ab26-d42483ce67b2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:24.430982 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fd6d3cfa-62d1-4e99-ab26-d42483ce67b2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1246 microversion: 2.1 time: 0.076420 May 19 05:51:24.431575 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3678/7266] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:24 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:25.448791 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ffa1d624-4dc1-461d-af65-204b3032f9b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:25.449807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ffa1d624-4dc1-461d-af65-204b3032f9b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:25.520341 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ffa1d624-4dc1-461d-af65-204b3032f9b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:25.528933 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ffa1d624-4dc1-461d-af65-204b3032f9b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1246 microversion: 2.1 time: 0.085425 May 19 05:51:25.529600 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3589/7267] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:25 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:26.546177 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3b16101a-9ece-4a05-8337-7622400467ce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:26.546818 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3b16101a-9ece-4a05-8337-7622400467ce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:26.553973 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b16101a-9ece-4a05-8337-7622400467ce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:26.554450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b16101a-9ece-4a05-8337-7622400467ce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:26.555239 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b16101a-9ece-4a05-8337-7622400467ce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:26.555701 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3b16101a-9ece-4a05-8337-7622400467ce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:26.625169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3b16101a-9ece-4a05-8337-7622400467ce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:26.633464 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3b16101a-9ece-4a05-8337-7622400467ce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1250 microversion: 2.1 time: 0.090668 May 19 05:51:26.633850 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3679/7268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:26 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1250 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:27.650408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a6da7d16-e975-42e1-8622-3618a8a5e76e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:27.651155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a6da7d16-e975-42e1-8622-3618a8a5e76e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:27.658236 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6da7d16-e975-42e1-8622-3618a8a5e76e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:27.658692 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6da7d16-e975-42e1-8622-3618a8a5e76e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:27.659472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6da7d16-e975-42e1-8622-3618a8a5e76e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:27.659915 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a6da7d16-e975-42e1-8622-3618a8a5e76e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:27.741293 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a6da7d16-e975-42e1-8622-3618a8a5e76e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:27.749284 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a6da7d16-e975-42e1-8622-3618a8a5e76e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1304 microversion: 2.1 time: 0.103405 May 19 05:51:27.749866 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3590/7269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:27 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:28.766380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ff238ced-928d-4560-b3b0-fd1db11ec9e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:28.768140 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ff238ced-928d-4560-b3b0-fd1db11ec9e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:28.782162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff238ced-928d-4560-b3b0-fd1db11ec9e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:28.782630 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff238ced-928d-4560-b3b0-fd1db11ec9e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:28.783424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff238ced-928d-4560-b3b0-fd1db11ec9e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:28.783873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ff238ced-928d-4560-b3b0-fd1db11ec9e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:28.965264 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ff238ced-928d-4560-b3b0-fd1db11ec9e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:28.973241 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ff238ced-928d-4560-b3b0-fd1db11ec9e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1372 microversion: 2.1 time: 0.211303 May 19 05:51:28.973828 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3680/7270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:28 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:29.134224 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3ac66ff3-2d78-4f3d-b502-da87d82c96a9 req-9c9bd41d-6230-4005-923a-dab350afffd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c89f2f-dea5-4750-abb2-dcce1070732a", "tag": "a7ebea92-e62c-4761-8962-20b08c50df8e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:51:29.142782 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3ac66ff3-2d78-4f3d-b502-da87d82c96a9 req-9c9bd41d-6230-4005-923a-dab350afffd1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:29.143232 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3ac66ff3-2d78-4f3d-b502-da87d82c96a9 req-9c9bd41d-6230-4005-923a-dab350afffd1 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:29.160638 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3ac66ff3-2d78-4f3d-b502-da87d82c96a9 req-9c9bd41d-6230-4005-923a-dab350afffd1 service nova] Creating event network-changed:a7ebea92-e62c-4761-8962-20b08c50df8e for instance 20c89f2f-dea5-4750-abb2-dcce1070732a on n-h2-766726-30 May 19 05:51:29.167285 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3ac66ff3-2d78-4f3d-b502-da87d82c96a9 req-9c9bd41d-6230-4005-923a-dab350afffd1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099621 May 19 05:51:29.168025 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3591/7271] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:51:29.990277 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-47a95dcc-32d0-42f3-95aa-1517156c0fd2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:29.990899 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-47a95dcc-32d0-42f3-95aa-1517156c0fd2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:29.998301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47a95dcc-32d0-42f3-95aa-1517156c0fd2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:29.998759 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47a95dcc-32d0-42f3-95aa-1517156c0fd2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:29.999526 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47a95dcc-32d0-42f3-95aa-1517156c0fd2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:29.999972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-47a95dcc-32d0-42f3-95aa-1517156c0fd2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:30.133576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-47a95dcc-32d0-42f3-95aa-1517156c0fd2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:30.141535 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-47a95dcc-32d0-42f3-95aa-1517156c0fd2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1372 microversion: 2.1 time: 0.155195 May 19 05:51:30.142101 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3681/7272] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:29 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:31.159894 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-98940faa-23a7-448f-881e-efd2c97d590b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:31.160606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-98940faa-23a7-448f-881e-efd2c97d590b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:31.167548 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98940faa-23a7-448f-881e-efd2c97d590b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:31.168007 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98940faa-23a7-448f-881e-efd2c97d590b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:31.168774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98940faa-23a7-448f-881e-efd2c97d590b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:31.169271 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-98940faa-23a7-448f-881e-efd2c97d590b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:31.317429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-98940faa-23a7-448f-881e-efd2c97d590b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:31.325147 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-98940faa-23a7-448f-881e-efd2c97d590b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1372 microversion: 2.1 time: 0.170394 May 19 05:51:31.325768 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3592/7273] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:31 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:51:32.341059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0cc30336-7fe2-4fbf-979f-ae4a48761f8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:32.342336 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0cc30336-7fe2-4fbf-979f-ae4a48761f8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:32.349494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0cc30336-7fe2-4fbf-979f-ae4a48761f8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:32.350281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0cc30336-7fe2-4fbf-979f-ae4a48761f8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:32.351074 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0cc30336-7fe2-4fbf-979f-ae4a48761f8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:32.351525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0cc30336-7fe2-4fbf-979f-ae4a48761f8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:32.486676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0cc30336-7fe2-4fbf-979f-ae4a48761f8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:32.494818 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0cc30336-7fe2-4fbf-979f-ae4a48761f8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1372 microversion: 2.1 time: 0.157633 May 19 05:51:32.495413 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3682/7274] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:32 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:33.512253 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4dda5c1c-8ade-4314-afd0-0485eb62a732 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:33.512864 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4dda5c1c-8ade-4314-afd0-0485eb62a732 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:33.519847 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4dda5c1c-8ade-4314-afd0-0485eb62a732 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:33.520292 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4dda5c1c-8ade-4314-afd0-0485eb62a732 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:33.521046 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4dda5c1c-8ade-4314-afd0-0485eb62a732 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:33.521512 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4dda5c1c-8ade-4314-afd0-0485eb62a732 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:33.655633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4dda5c1c-8ade-4314-afd0-0485eb62a732 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:33.663144 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4dda5c1c-8ade-4314-afd0-0485eb62a732 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1372 microversion: 2.1 time: 0.155334 May 19 05:51:33.663721 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3593/7275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:33 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:34.131172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fb8b088f-1a2d-410e-b0d7-a6597c9f1ac0 req-8a36de21-c1f5-4c7e-8bc8-5e5d5a103fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c89f2f-dea5-4750-abb2-dcce1070732a", "name": "network-vif-plugged", "status": "completed", "tag": "a7ebea92-e62c-4761-8962-20b08c50df8e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:51:34.134796 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:51:34.141558 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fb8b088f-1a2d-410e-b0d7-a6597c9f1ac0 req-8a36de21-c1f5-4c7e-8bc8-5e5d5a103fe5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:34.142023 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fb8b088f-1a2d-410e-b0d7-a6597c9f1ac0 req-8a36de21-c1f5-4c7e-8bc8-5e5d5a103fe5 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:34.153544 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fb8b088f-1a2d-410e-b0d7-a6597c9f1ac0 req-8a36de21-c1f5-4c7e-8bc8-5e5d5a103fe5 service nova] Creating event network-vif-plugged:a7ebea92-e62c-4761-8962-20b08c50df8e for instance 20c89f2f-dea5-4750-abb2-dcce1070732a on n-h2-766726-30 May 19 05:51:34.158489 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fb8b088f-1a2d-410e-b0d7-a6597c9f1ac0 req-8a36de21-c1f5-4c7e-8bc8-5e5d5a103fe5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031319 May 19 05:51:34.159438 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3683/7276] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:51:34.679149 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-51a8e503-262b-468b-b279-57ce449a8478 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:34.679832 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-51a8e503-262b-468b-b279-57ce449a8478 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:34.686790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51a8e503-262b-468b-b279-57ce449a8478 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:34.687243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51a8e503-262b-468b-b279-57ce449a8478 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:34.688016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51a8e503-262b-468b-b279-57ce449a8478 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:34.688457 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-51a8e503-262b-468b-b279-57ce449a8478 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:34.820515 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-51a8e503-262b-468b-b279-57ce449a8478 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:34.828680 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-51a8e503-262b-468b-b279-57ce449a8478 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1372 microversion: 2.1 time: 0.153505 May 19 05:51:34.829327 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3594/7277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:34 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:35.843782 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=8 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:51:35.848706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6ddb9bac-56a3-4d76-b93b-6878b1823a9a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:35.849453 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6ddb9bac-56a3-4d76-b93b-6878b1823a9a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:35.856064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ddb9bac-56a3-4d76-b93b-6878b1823a9a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:35.856527 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ddb9bac-56a3-4d76-b93b-6878b1823a9a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:35.857334 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ddb9bac-56a3-4d76-b93b-6878b1823a9a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:35.857789 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6ddb9bac-56a3-4d76-b93b-6878b1823a9a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:35.990256 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6ddb9bac-56a3-4d76-b93b-6878b1823a9a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:35.998857 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6ddb9bac-56a3-4d76-b93b-6878b1823a9a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1555 microversion: 2.1 time: 0.156073 May 19 05:51:35.999455 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3684/7278] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:35 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:36.015670 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a98e09e8-63e7-4918-bdce-85e17c07fa95 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:51:36.016295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a98e09e8-63e7-4918-bdce-85e17c07fa95 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:51:36.018309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=8 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:51:36.024801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a98e09e8-63e7-4918-bdce-85e17c07fa95 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:36.025283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a98e09e8-63e7-4918-bdce-85e17c07fa95 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:36.026056 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a98e09e8-63e7-4918-bdce-85e17c07fa95 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:36.026500 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a98e09e8-63e7-4918-bdce-85e17c07fa95 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:36.155510 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a98e09e8-63e7-4918-bdce-85e17c07fa95 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:51:36.163009 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a98e09e8-63e7-4918-bdce-85e17c07fa95 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1555 microversion: 2.1 time: 0.151328 May 19 05:51:36.163585 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3595/7279] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:51:36 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:51:37.816664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-8069e357-7e6b-4cc0-82fb-44e86b42ebb6 req-0aee66a0-ad65-4473-b489-61d89faeafdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c89f2f-dea5-4750-abb2-dcce1070732a", "tag": "a7ebea92-e62c-4761-8962-20b08c50df8e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:51:37.826044 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8069e357-7e6b-4cc0-82fb-44e86b42ebb6 req-0aee66a0-ad65-4473-b489-61d89faeafdc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:51:37.826490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-8069e357-7e6b-4cc0-82fb-44e86b42ebb6 req-0aee66a0-ad65-4473-b489-61d89faeafdc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:51:37.838076 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-8069e357-7e6b-4cc0-82fb-44e86b42ebb6 req-0aee66a0-ad65-4473-b489-61d89faeafdc service nova] Creating event network-changed:a7ebea92-e62c-4761-8962-20b08c50df8e for instance 20c89f2f-dea5-4750-abb2-dcce1070732a on n-h2-766726-30 May 19 05:51:37.843376 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-8069e357-7e6b-4cc0-82fb-44e86b42ebb6 req-0aee66a0-ad65-4473-b489-61d89faeafdc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030395 May 19 05:51:37.844671 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3685/7280] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:53:09.906387 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:53:09.906979 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:53:30.111147 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99e79aa7-a0e7-43bd-8544-8a0b9dce8b08] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 05:53:30.112177 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:53:30.112984 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=32 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:53:30.117041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0f2fb53b-3709-42b2-8ba1-9b00ef2e542f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:53:30.117606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0f2fb53b-3709-42b2-8ba1-9b00ef2e542f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:30.124753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f2fb53b-3709-42b2-8ba1-9b00ef2e542f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:30.125239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f2fb53b-3709-42b2-8ba1-9b00ef2e542f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:30.126012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f2fb53b-3709-42b2-8ba1-9b00ef2e542f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:30.126456 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f2fb53b-3709-42b2-8ba1-9b00ef2e542f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:30.149152 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.objects.instance [None req-0f2fb53b-3709-42b2-8ba1-9b00ef2e542f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lazy-loading 'flavor' on Instance uuid 20c89f2f-dea5-4750-abb2-dcce1070732a {{(pid=124819) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:53:30.417611 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0f2fb53b-3709-42b2-8ba1-9b00ef2e542f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "POST /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a/action" status: 202 len: 0 microversion: 2.1 time: 0.307895 May 19 05:53:30.418415 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3596/7281] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:53:30 2022] POST /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:53:30.424922 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [01022541-891f-4ef1-a973-f7b4510bbfd8] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 05:53:30.428736 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2869c6-282b-4cce-84de-e63fb06fc5d4] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 05:53:30.428736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:53:30.428736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=36 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:53:30.435099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0c8ddaad-0ccc-4aa6-8eca-c6584937d515 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:30.435840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0c8ddaad-0ccc-4aa6-8eca-c6584937d515 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:30.447969 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c8ddaad-0ccc-4aa6-8eca-c6584937d515 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:30.448469 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c8ddaad-0ccc-4aa6-8eca-c6584937d515 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:30.449316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c8ddaad-0ccc-4aa6-8eca-c6584937d515 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:30.452534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0c8ddaad-0ccc-4aa6-8eca-c6584937d515 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:30.589285 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0c8ddaad-0ccc-4aa6-8eca-c6584937d515 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:30.597737 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0c8ddaad-0ccc-4aa6-8eca-c6584937d515 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.174666 May 19 05:53:30.598312 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3686/7282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:30 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:53:31.618885 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3529677c-2944-48a9-8c57-8b6ebafc897f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:31.619600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3529677c-2944-48a9-8c57-8b6ebafc897f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:31.627384 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3529677c-2944-48a9-8c57-8b6ebafc897f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:31.627838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3529677c-2944-48a9-8c57-8b6ebafc897f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:31.628605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3529677c-2944-48a9-8c57-8b6ebafc897f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:31.629064 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3529677c-2944-48a9-8c57-8b6ebafc897f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:31.632548 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] [99e79aa7-a0e7-43bd-8544-8a0b9dce8b08] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 59948. May 19 05:53:31.767231 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3529677c-2944-48a9-8c57-8b6ebafc897f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:31.774845 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3529677c-2944-48a9-8c57-8b6ebafc897f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.162713 May 19 05:53:31.775431 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3597/7283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:31 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:32.792458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aebc524c-ba64-4118-832a-96227c9cb549 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:32.793034 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aebc524c-ba64-4118-832a-96227c9cb549 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:32.803399 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aebc524c-ba64-4118-832a-96227c9cb549 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:32.803872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aebc524c-ba64-4118-832a-96227c9cb549 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:32.804656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aebc524c-ba64-4118-832a-96227c9cb549 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:32.805132 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aebc524c-ba64-4118-832a-96227c9cb549 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:32.810016 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2869c6-282b-4cce-84de-e63fb06fc5d4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 59954. May 19 05:53:32.810893 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] [01022541-891f-4ef1-a973-f7b4510bbfd8] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 59952. May 19 05:53:32.937533 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aebc524c-ba64-4118-832a-96227c9cb549 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:32.945065 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aebc524c-ba64-4118-832a-96227c9cb549 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.156661 May 19 05:53:32.945681 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3687/7284] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:32 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:33.962899 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b1a0dde4-d95e-46bd-b6be-278647149d28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:33.963511 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b1a0dde4-d95e-46bd-b6be-278647149d28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:33.971164 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1a0dde4-d95e-46bd-b6be-278647149d28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:33.971610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1a0dde4-d95e-46bd-b6be-278647149d28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:33.972377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1a0dde4-d95e-46bd-b6be-278647149d28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:33.972817 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b1a0dde4-d95e-46bd-b6be-278647149d28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:34.104017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b1a0dde4-d95e-46bd-b6be-278647149d28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:34.111629 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b1a0dde4-d95e-46bd-b6be-278647149d28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.152663 May 19 05:53:34.112194 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3598/7285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:33 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:35.128676 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6a95be67-0725-4a5d-b9c6-e0b36cd24236 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:35.129265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6a95be67-0725-4a5d-b9c6-e0b36cd24236 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:35.136253 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a95be67-0725-4a5d-b9c6-e0b36cd24236 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:35.136720 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a95be67-0725-4a5d-b9c6-e0b36cd24236 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:35.138172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a95be67-0725-4a5d-b9c6-e0b36cd24236 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:35.138631 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6a95be67-0725-4a5d-b9c6-e0b36cd24236 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:35.272123 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6a95be67-0725-4a5d-b9c6-e0b36cd24236 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:35.279616 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6a95be67-0725-4a5d-b9c6-e0b36cd24236 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.155170 May 19 05:53:35.280194 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3688/7286] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:35 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:36.296697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-90fc2bd1-ee36-4f9d-810c-d1267c3fc010 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:36.297357 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-90fc2bd1-ee36-4f9d-810c-d1267c3fc010 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:36.304211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90fc2bd1-ee36-4f9d-810c-d1267c3fc010 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:36.304751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90fc2bd1-ee36-4f9d-810c-d1267c3fc010 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:36.305552 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90fc2bd1-ee36-4f9d-810c-d1267c3fc010 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:36.306022 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-90fc2bd1-ee36-4f9d-810c-d1267c3fc010 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:36.441039 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-90fc2bd1-ee36-4f9d-810c-d1267c3fc010 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:36.448600 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-90fc2bd1-ee36-4f9d-810c-d1267c3fc010 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.156513 May 19 05:53:36.449192 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3599/7287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:36 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:37.466885 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-36b97731-4c09-493a-9952-fe4fc3f0f813 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:37.467522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-36b97731-4c09-493a-9952-fe4fc3f0f813 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:37.474566 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36b97731-4c09-493a-9952-fe4fc3f0f813 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:37.475036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36b97731-4c09-493a-9952-fe4fc3f0f813 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:37.475814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36b97731-4c09-493a-9952-fe4fc3f0f813 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:37.476272 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-36b97731-4c09-493a-9952-fe4fc3f0f813 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:37.614029 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-36b97731-4c09-493a-9952-fe4fc3f0f813 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:37.621590 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-36b97731-4c09-493a-9952-fe4fc3f0f813 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.159198 May 19 05:53:37.622181 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3689/7288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:37 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:38.638543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-1d7bc152-536e-4f15-8b8b-c6635ffa752c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:38.639165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-1d7bc152-536e-4f15-8b8b-c6635ffa752c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:38.646222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d7bc152-536e-4f15-8b8b-c6635ffa752c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:38.646677 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d7bc152-536e-4f15-8b8b-c6635ffa752c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:38.647438 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d7bc152-536e-4f15-8b8b-c6635ffa752c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:38.647879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-1d7bc152-536e-4f15-8b8b-c6635ffa752c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:38.775209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-1d7bc152-536e-4f15-8b8b-c6635ffa752c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:38.783314 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-1d7bc152-536e-4f15-8b8b-c6635ffa752c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.149200 May 19 05:53:38.783889 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3600/7289] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:38 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:39.800564 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-95c7ecf4-f854-4bad-8935-6c41a090db1d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:39.801220 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-95c7ecf4-f854-4bad-8935-6c41a090db1d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:39.808192 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c7ecf4-f854-4bad-8935-6c41a090db1d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:39.808658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c7ecf4-f854-4bad-8935-6c41a090db1d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:39.809461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c7ecf4-f854-4bad-8935-6c41a090db1d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:39.809914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-95c7ecf4-f854-4bad-8935-6c41a090db1d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:39.940842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-95c7ecf4-f854-4bad-8935-6c41a090db1d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:39.948447 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-95c7ecf4-f854-4bad-8935-6c41a090db1d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.151788 May 19 05:53:39.949020 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3690/7290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:39 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:40.966732 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2959b066-e0dd-4fd1-93b5-17181210b270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:40.967378 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2959b066-e0dd-4fd1-93b5-17181210b270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:40.974441 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2959b066-e0dd-4fd1-93b5-17181210b270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:40.974895 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2959b066-e0dd-4fd1-93b5-17181210b270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:40.975695 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2959b066-e0dd-4fd1-93b5-17181210b270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:40.976139 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2959b066-e0dd-4fd1-93b5-17181210b270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:41.103928 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2959b066-e0dd-4fd1-93b5-17181210b270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:41.111491 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2959b066-e0dd-4fd1-93b5-17181210b270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1701 microversion: 2.1 time: 0.149405 May 19 05:53:41.112069 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3601/7291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:40 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1701 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:42.129950 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c4a1672f-f867-48fa-9f56-ef7dc71e9979 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:42.130667 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c4a1672f-f867-48fa-9f56-ef7dc71e9979 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:42.138819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4a1672f-f867-48fa-9f56-ef7dc71e9979 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:42.139288 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4a1672f-f867-48fa-9f56-ef7dc71e9979 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:42.140067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4a1672f-f867-48fa-9f56-ef7dc71e9979 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:42.140517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c4a1672f-f867-48fa-9f56-ef7dc71e9979 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:42.269827 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c4a1672f-f867-48fa-9f56-ef7dc71e9979 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:42.278712 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c4a1672f-f867-48fa-9f56-ef7dc71e9979 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1701 microversion: 2.1 time: 0.153245 May 19 05:53:42.279461 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3691/7292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:42 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:43.295646 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2c157bfc-e013-434f-a354-d4f8e9d52393 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:43.296265 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2c157bfc-e013-434f-a354-d4f8e9d52393 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:43.303289 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c157bfc-e013-434f-a354-d4f8e9d52393 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:43.303765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c157bfc-e013-434f-a354-d4f8e9d52393 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:43.304543 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c157bfc-e013-434f-a354-d4f8e9d52393 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:43.304990 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2c157bfc-e013-434f-a354-d4f8e9d52393 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:43.452679 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2c157bfc-e013-434f-a354-d4f8e9d52393 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:43.460766 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2c157bfc-e013-434f-a354-d4f8e9d52393 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1696 microversion: 2.1 time: 0.168933 May 19 05:53:43.461377 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3602/7293] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:43 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:44.478984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-aba18e9f-0fff-46cc-8940-3a1f2104fa28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:44.479806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-aba18e9f-0fff-46cc-8940-3a1f2104fa28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:44.487241 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aba18e9f-0fff-46cc-8940-3a1f2104fa28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:44.487707 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aba18e9f-0fff-46cc-8940-3a1f2104fa28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:44.488495 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aba18e9f-0fff-46cc-8940-3a1f2104fa28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:44.488944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-aba18e9f-0fff-46cc-8940-3a1f2104fa28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:44.640059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-aba18e9f-0fff-46cc-8940-3a1f2104fa28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:44.651801 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-aba18e9f-0fff-46cc-8940-3a1f2104fa28 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1696 microversion: 2.1 time: 0.176691 May 19 05:53:44.652739 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3692/7294] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:44 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:44.970116 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-fe556357-97a6-4ca1-9b7b-535e07713322 req-a90db74e-74e8-41a2-a242-c850a5b53b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c89f2f-dea5-4750-abb2-dcce1070732a", "name": "network-vif-plugged", "status": "completed", "tag": "a7ebea92-e62c-4761-8962-20b08c50df8e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:53:44.982058 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fe556357-97a6-4ca1-9b7b-535e07713322 req-a90db74e-74e8-41a2-a242-c850a5b53b90 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:44.982798 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-fe556357-97a6-4ca1-9b7b-535e07713322 req-a90db74e-74e8-41a2-a242-c850a5b53b90 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:44.995835 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-fe556357-97a6-4ca1-9b7b-535e07713322 req-a90db74e-74e8-41a2-a242-c850a5b53b90 service nova] Creating event network-vif-plugged:a7ebea92-e62c-4761-8962-20b08c50df8e for instance 20c89f2f-dea5-4750-abb2-dcce1070732a on n-h2-766726-30 May 19 05:53:45.001338 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-fe556357-97a6-4ca1-9b7b-535e07713322 req-a90db74e-74e8-41a2-a242-c850a5b53b90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100989 May 19 05:53:45.001960 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3603/7295] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:53:45.670068 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9628d533-93cf-43a3-9e46-658fcdd0cfe2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:45.670712 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9628d533-93cf-43a3-9e46-658fcdd0cfe2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:45.678340 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9628d533-93cf-43a3-9e46-658fcdd0cfe2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:45.679072 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9628d533-93cf-43a3-9e46-658fcdd0cfe2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:45.680147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9628d533-93cf-43a3-9e46-658fcdd0cfe2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:45.681359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9628d533-93cf-43a3-9e46-658fcdd0cfe2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:45.879606 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9628d533-93cf-43a3-9e46-658fcdd0cfe2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:45.887914 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9628d533-93cf-43a3-9e46-658fcdd0cfe2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1696 microversion: 2.1 time: 0.222444 May 19 05:53:45.888510 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3693/7296] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:45 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1696 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:46.907075 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-34a75f8f-fc15-43cc-a397-32806b5946f5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:46.907783 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-34a75f8f-fc15-43cc-a397-32806b5946f5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:46.914493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34a75f8f-fc15-43cc-a397-32806b5946f5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:46.915244 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34a75f8f-fc15-43cc-a397-32806b5946f5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:46.916211 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34a75f8f-fc15-43cc-a397-32806b5946f5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:46.916843 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-34a75f8f-fc15-43cc-a397-32806b5946f5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:47.070932 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-34a75f8f-fc15-43cc-a397-32806b5946f5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:47.079637 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-34a75f8f-fc15-43cc-a397-32806b5946f5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1696 microversion: 2.1 time: 0.177686 May 19 05:53:47.080248 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3604/7297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:46 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:48.097910 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5f0d1228-a16f-4e7a-a075-6f60bb59bb4e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:48.098547 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5f0d1228-a16f-4e7a-a075-6f60bb59bb4e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:48.108143 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f0d1228-a16f-4e7a-a075-6f60bb59bb4e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:48.108621 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f0d1228-a16f-4e7a-a075-6f60bb59bb4e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:48.109455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f0d1228-a16f-4e7a-a075-6f60bb59bb4e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:48.109911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5f0d1228-a16f-4e7a-a075-6f60bb59bb4e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:48.273704 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5f0d1228-a16f-4e7a-a075-6f60bb59bb4e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:48.282226 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5f0d1228-a16f-4e7a-a075-6f60bb59bb4e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1696 microversion: 2.1 time: 0.188613 May 19 05:53:48.283002 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3694/7298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:48 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:49.301737 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-86496a0c-f6f0-4405-8935-bdf95da17615 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:49.302759 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-86496a0c-f6f0-4405-8935-bdf95da17615 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:49.312572 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86496a0c-f6f0-4405-8935-bdf95da17615 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:49.313142 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86496a0c-f6f0-4405-8935-bdf95da17615 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:49.314188 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86496a0c-f6f0-4405-8935-bdf95da17615 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:49.314823 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-86496a0c-f6f0-4405-8935-bdf95da17615 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:49.490839 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-86496a0c-f6f0-4405-8935-bdf95da17615 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:49.499113 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-86496a0c-f6f0-4405-8935-bdf95da17615 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1696 microversion: 2.1 time: 0.203138 May 19 05:53:49.514060 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3605/7299] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:49 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1696 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:50.521932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-749d8437-47c3-4117-8d13-2697190d41a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:50.522610 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-749d8437-47c3-4117-8d13-2697190d41a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:50.531341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-749d8437-47c3-4117-8d13-2697190d41a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:50.531819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-749d8437-47c3-4117-8d13-2697190d41a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:50.533109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-749d8437-47c3-4117-8d13-2697190d41a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:50.533109 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-749d8437-47c3-4117-8d13-2697190d41a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:50.700149 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-749d8437-47c3-4117-8d13-2697190d41a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:50.709380 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-749d8437-47c3-4117-8d13-2697190d41a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1696 microversion: 2.1 time: 0.193160 May 19 05:53:50.710889 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3695/7300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:50 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:51.729955 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-d8b2b40d-d9ec-4332-97ec-733293c7decf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:51.730588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-d8b2b40d-d9ec-4332-97ec-733293c7decf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:51.738311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8b2b40d-d9ec-4332-97ec-733293c7decf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:51.738810 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8b2b40d-d9ec-4332-97ec-733293c7decf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:51.739574 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8b2b40d-d9ec-4332-97ec-733293c7decf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:51.740030 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-d8b2b40d-d9ec-4332-97ec-733293c7decf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:51.893309 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-d8b2b40d-d9ec-4332-97ec-733293c7decf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:51.903054 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-d8b2b40d-d9ec-4332-97ec-733293c7decf tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1696 microversion: 2.1 time: 0.176890 May 19 05:53:51.903889 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3606/7301] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:51 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:52.919862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6c396da4-918b-42a6-b9c5-ea23cb6f1270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:52.920518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6c396da4-918b-42a6-b9c5-ea23cb6f1270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:52.927688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c396da4-918b-42a6-b9c5-ea23cb6f1270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:52.928156 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c396da4-918b-42a6-b9c5-ea23cb6f1270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:52.928960 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c396da4-918b-42a6-b9c5-ea23cb6f1270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:52.929444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6c396da4-918b-42a6-b9c5-ea23cb6f1270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:53.129871 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6c396da4-918b-42a6-b9c5-ea23cb6f1270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:53.138038 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6c396da4-918b-42a6-b9c5-ea23cb6f1270 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1678 microversion: 2.1 time: 0.222164 May 19 05:53:53.138639 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3696/7302] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:52 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:54.155334 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cdfda2bc-ba39-4245-a3e1-bbe9e243b7f6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:54.155951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cdfda2bc-ba39-4245-a3e1-bbe9e243b7f6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:54.162668 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cdfda2bc-ba39-4245-a3e1-bbe9e243b7f6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:54.163121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cdfda2bc-ba39-4245-a3e1-bbe9e243b7f6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:54.163883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cdfda2bc-ba39-4245-a3e1-bbe9e243b7f6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:54.164327 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cdfda2bc-ba39-4245-a3e1-bbe9e243b7f6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:54.298223 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cdfda2bc-ba39-4245-a3e1-bbe9e243b7f6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:54.305872 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cdfda2bc-ba39-4245-a3e1-bbe9e243b7f6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1678 microversion: 2.1 time: 0.154487 May 19 05:53:54.306464 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3607/7303] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:54 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:55.323684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bfd6665a-74d9-46ba-9bc7-250ba00adf73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:55.324312 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bfd6665a-74d9-46ba-9bc7-250ba00adf73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:55.332048 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bfd6665a-74d9-46ba-9bc7-250ba00adf73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:55.332521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bfd6665a-74d9-46ba-9bc7-250ba00adf73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:55.333341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bfd6665a-74d9-46ba-9bc7-250ba00adf73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:55.333798 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bfd6665a-74d9-46ba-9bc7-250ba00adf73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:55.461451 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bfd6665a-74d9-46ba-9bc7-250ba00adf73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:55.469242 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bfd6665a-74d9-46ba-9bc7-250ba00adf73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1621 microversion: 2.1 time: 0.149599 May 19 05:53:55.469820 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3697/7304] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:55 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1621 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:55.488945 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a956147a-ab10-42f5-9852-796aea7ddcc5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:53:55.489555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a956147a-ab10-42f5-9852-796aea7ddcc5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:55.497299 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a956147a-ab10-42f5-9852-796aea7ddcc5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:55.497752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a956147a-ab10-42f5-9852-796aea7ddcc5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:55.498524 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a956147a-ab10-42f5-9852-796aea7ddcc5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:55.498965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a956147a-ab10-42f5-9852-796aea7ddcc5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:55.588621 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a956147a-ab10-42f5-9852-796aea7ddcc5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "POST /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a/action" status: 202 len: 0 microversion: 2.1 time: 0.104963 May 19 05:53:55.589153 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3608/7305] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:53:55 2022] POST /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 05:53:55.597532 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8211a698-a44a-4695-8441-b9a3ba449113 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:55.598166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8211a698-a44a-4695-8441-b9a3ba449113 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:55.604173 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8211a698-a44a-4695-8441-b9a3ba449113 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:55.604638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8211a698-a44a-4695-8441-b9a3ba449113 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:55.605531 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8211a698-a44a-4695-8441-b9a3ba449113 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:55.605991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8211a698-a44a-4695-8441-b9a3ba449113 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:55.743919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8211a698-a44a-4695-8441-b9a3ba449113 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:55.752148 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8211a698-a44a-4695-8441-b9a3ba449113 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1629 microversion: 2.1 time: 0.158484 May 19 05:53:55.752732 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3698/7306] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:55 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1629 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:56.770493 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8f42051f-56e1-4801-afe1-5ac22bc4db73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:56.771017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8f42051f-56e1-4801-afe1-5ac22bc4db73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:56.777306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f42051f-56e1-4801-afe1-5ac22bc4db73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:56.777762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f42051f-56e1-4801-afe1-5ac22bc4db73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:56.779051 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f42051f-56e1-4801-afe1-5ac22bc4db73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:56.779490 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8f42051f-56e1-4801-afe1-5ac22bc4db73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:56.931226 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-b759b48d-6268-4ae1-b41a-628e7a4bf759 req-d6c94dcb-7933-46ee-bb78-7e0af74077cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c89f2f-dea5-4750-abb2-dcce1070732a", "name": "network-vif-unplugged", "status": "completed", "tag": "a7ebea92-e62c-4761-8962-20b08c50df8e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:53:56.942574 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b759b48d-6268-4ae1-b41a-628e7a4bf759 req-d6c94dcb-7933-46ee-bb78-7e0af74077cd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:56.943027 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-b759b48d-6268-4ae1-b41a-628e7a4bf759 req-d6c94dcb-7933-46ee-bb78-7e0af74077cd service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:56.955580 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-b759b48d-6268-4ae1-b41a-628e7a4bf759 req-d6c94dcb-7933-46ee-bb78-7e0af74077cd service nova] Creating event network-vif-unplugged:a7ebea92-e62c-4761-8962-20b08c50df8e for instance 20c89f2f-dea5-4750-abb2-dcce1070732a on n-h2-766726-30 May 19 05:53:56.961112 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-b759b48d-6268-4ae1-b41a-628e7a4bf759 req-d6c94dcb-7933-46ee-bb78-7e0af74077cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033574 May 19 05:53:56.961708 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3699/7307] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:53:57.002338 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8f42051f-56e1-4801-afe1-5ac22bc4db73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:57.010164 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8f42051f-56e1-4801-afe1-5ac22bc4db73 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.244637 May 19 05:53:57.010836 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3609/7308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:56 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:58.029337 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a99e5404-08b9-4bbe-9e84-3898071887e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:58.030099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a99e5404-08b9-4bbe-9e84-3898071887e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:58.037688 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a99e5404-08b9-4bbe-9e84-3898071887e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:58.038378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a99e5404-08b9-4bbe-9e84-3898071887e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:58.039169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a99e5404-08b9-4bbe-9e84-3898071887e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:58.039869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a99e5404-08b9-4bbe-9e84-3898071887e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:58.189382 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a99e5404-08b9-4bbe-9e84-3898071887e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:58.197602 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a99e5404-08b9-4bbe-9e84-3898071887e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.173053 May 19 05:53:58.198334 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3700/7309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:58 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:53:59.215610 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-66430c22-cfa6-4c0f-9d88-c81c9cd5ce53 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:53:59.216760 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-66430c22-cfa6-4c0f-9d88-c81c9cd5ce53 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:53:59.224203 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66430c22-cfa6-4c0f-9d88-c81c9cd5ce53 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:59.224662 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66430c22-cfa6-4c0f-9d88-c81c9cd5ce53 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:59.225476 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66430c22-cfa6-4c0f-9d88-c81c9cd5ce53 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:53:59.226094 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-66430c22-cfa6-4c0f-9d88-c81c9cd5ce53 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:53:59.232026 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:53:59.375320 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-66430c22-cfa6-4c0f-9d88-c81c9cd5ce53 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:53:59.383189 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-66430c22-cfa6-4c0f-9d88-c81c9cd5ce53 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.171830 May 19 05:53:59.384059 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3610/7310] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:53:59 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:54:00.400828 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8fde546f-85b2-451d-8481-c0146bbef219 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:54:00.401617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8fde546f-85b2-451d-8481-c0146bbef219 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:54:00.408893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8fde546f-85b2-451d-8481-c0146bbef219 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:00.409383 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8fde546f-85b2-451d-8481-c0146bbef219 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:00.410180 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8fde546f-85b2-451d-8481-c0146bbef219 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:00.410635 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8fde546f-85b2-451d-8481-c0146bbef219 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:00.574136 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8fde546f-85b2-451d-8481-c0146bbef219 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:54:00.576923 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=91 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:54:00.584251 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8fde546f-85b2-451d-8481-c0146bbef219 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.187217 May 19 05:54:00.584774 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3701/7311] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:54:00 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:54:01.606557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7085217e-2916-4eb5-874f-a78b1252a812 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:54:01.606557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7085217e-2916-4eb5-874f-a78b1252a812 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:54:01.606557 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=33 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:54:01.610248 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7085217e-2916-4eb5-874f-a78b1252a812 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:01.610707 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7085217e-2916-4eb5-874f-a78b1252a812 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:01.611780 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7085217e-2916-4eb5-874f-a78b1252a812 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:01.612284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7085217e-2916-4eb5-874f-a78b1252a812 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:01.764717 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7085217e-2916-4eb5-874f-a78b1252a812 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:54:01.774407 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7085217e-2916-4eb5-874f-a78b1252a812 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.177101 May 19 05:54:01.775010 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3611/7312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:54:01 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:54:02.794296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f1d40f93-8553-4042-81a0-dc6db489f972 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:54:02.796169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f1d40f93-8553-4042-81a0-dc6db489f972 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:54:02.799315 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=33 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:54:02.805185 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d40f93-8553-4042-81a0-dc6db489f972 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:02.805708 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d40f93-8553-4042-81a0-dc6db489f972 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:02.806505 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d40f93-8553-4042-81a0-dc6db489f972 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:02.806990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f1d40f93-8553-4042-81a0-dc6db489f972 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:02.949588 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f1d40f93-8553-4042-81a0-dc6db489f972 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:54:02.958004 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f1d40f93-8553-4042-81a0-dc6db489f972 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.169977 May 19 05:54:02.958814 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3702/7313] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:54:02 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:54:03.976178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-370b312a-c38d-4d8c-916f-fb10a18debe9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:54:03.976795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-370b312a-c38d-4d8c-916f-fb10a18debe9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:54:03.984081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-370b312a-c38d-4d8c-916f-fb10a18debe9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:03.984539 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-370b312a-c38d-4d8c-916f-fb10a18debe9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:03.985348 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-370b312a-c38d-4d8c-916f-fb10a18debe9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:03.985788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-370b312a-c38d-4d8c-916f-fb10a18debe9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:04.127306 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-370b312a-c38d-4d8c-916f-fb10a18debe9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:54:04.135318 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-370b312a-c38d-4d8c-916f-fb10a18debe9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.162946 May 19 05:54:04.135907 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3612/7314] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:54:03 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:54:05.152433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ad1cfbfd-3fe8-496b-af35-7e1687f4c520 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:54:05.155033 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ad1cfbfd-3fe8-496b-af35-7e1687f4c520 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:54:05.162281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad1cfbfd-3fe8-496b-af35-7e1687f4c520 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:05.162750 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad1cfbfd-3fe8-496b-af35-7e1687f4c520 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:05.163535 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad1cfbfd-3fe8-496b-af35-7e1687f4c520 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:05.163987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ad1cfbfd-3fe8-496b-af35-7e1687f4c520 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:05.300810 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ad1cfbfd-3fe8-496b-af35-7e1687f4c520 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:54:05.308865 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ad1cfbfd-3fe8-496b-af35-7e1687f4c520 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.160594 May 19 05:54:05.309974 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3703/7315] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:54:05 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:54:06.327648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c32295b1-5a6f-4160-925a-46aeb892f6e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:54:06.328303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c32295b1-5a6f-4160-925a-46aeb892f6e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:54:06.335474 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c32295b1-5a6f-4160-925a-46aeb892f6e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:06.335930 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c32295b1-5a6f-4160-925a-46aeb892f6e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:06.336700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c32295b1-5a6f-4160-925a-46aeb892f6e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:06.337161 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c32295b1-5a6f-4160-925a-46aeb892f6e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:06.470052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c32295b1-5a6f-4160-925a-46aeb892f6e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:54:06.477617 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c32295b1-5a6f-4160-925a-46aeb892f6e9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.154480 May 19 05:54:06.478208 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3613/7316] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:54:06 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:54:07.494829 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be86987f-3463-4be2-b135-00b1df561d12 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:54:07.495455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be86987f-3463-4be2-b135-00b1df561d12 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:54:07.502452 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be86987f-3463-4be2-b135-00b1df561d12 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:07.502911 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be86987f-3463-4be2-b135-00b1df561d12 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:07.503681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be86987f-3463-4be2-b135-00b1df561d12 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:07.504127 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be86987f-3463-4be2-b135-00b1df561d12 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:07.637681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be86987f-3463-4be2-b135-00b1df561d12 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:54:07.645141 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be86987f-3463-4be2-b135-00b1df561d12 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1687 microversion: 2.1 time: 0.154184 May 19 05:54:07.645711 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3704/7317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:54:07 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:54:08.662555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c17c18ab-d54b-4ca8-96e1-b30a5293afc9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:54:08.663174 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c17c18ab-d54b-4ca8-96e1-b30a5293afc9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:54:08.670821 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c17c18ab-d54b-4ca8-96e1-b30a5293afc9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:08.671268 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c17c18ab-d54b-4ca8-96e1-b30a5293afc9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:08.672035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c17c18ab-d54b-4ca8-96e1-b30a5293afc9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:08.672472 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c17c18ab-d54b-4ca8-96e1-b30a5293afc9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:08.803768 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c17c18ab-d54b-4ca8-96e1-b30a5293afc9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:54:08.811399 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c17c18ab-d54b-4ca8-96e1-b30a5293afc9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1674 microversion: 2.1 time: 0.152774 May 19 05:54:08.811977 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3614/7318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:54:08 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:54:11.011997 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-be2e4db5-164a-4013-bcf1-f817df6ec64e req-08f4d1f9-d9a3-4e01-ac98-7c54476cda7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c89f2f-dea5-4750-abb2-dcce1070732a", "name": "network-vif-plugged", "status": "completed", "tag": "a7ebea92-e62c-4761-8962-20b08c50df8e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:54:11.021102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-be2e4db5-164a-4013-bcf1-f817df6ec64e req-08f4d1f9-d9a3-4e01-ac98-7c54476cda7c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:54:11.021590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-be2e4db5-164a-4013-bcf1-f817df6ec64e req-08f4d1f9-d9a3-4e01-ac98-7c54476cda7c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:54:11.033346 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-be2e4db5-164a-4013-bcf1-f817df6ec64e req-08f4d1f9-d9a3-4e01-ac98-7c54476cda7c service nova] Creating event network-vif-plugged:a7ebea92-e62c-4761-8962-20b08c50df8e for instance 20c89f2f-dea5-4750-abb2-dcce1070732a on n-h2-766726-30 May 19 05:54:11.038463 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-be2e4db5-164a-4013-bcf1-f817df6ec64e req-08f4d1f9-d9a3-4e01-ac98-7c54476cda7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030243 May 19 05:54:11.039074 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3705/7319] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:55:25.783744 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=7 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:55:25.784918 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=28 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:55:25.786500 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=7 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:55:25.787254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=21 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:55:25.788883 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-13ac8c24-953e-4617-b384-a7bac20ee09a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:25.789429 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13ac8c24-953e-4617-b384-a7bac20ee09a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:25.796401 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13ac8c24-953e-4617-b384-a7bac20ee09a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:25.796853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13ac8c24-953e-4617-b384-a7bac20ee09a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:25.797648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13ac8c24-953e-4617-b384-a7bac20ee09a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:25.798084 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-13ac8c24-953e-4617-b384-a7bac20ee09a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:25.826741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-13ac8c24-953e-4617-b384-a7bac20ee09a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Going to try to terminate instance {{(pid=124819) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 05:55:25.881809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-610ba153-f44c-4177-a180-9c611a2f498c req-a305e76c-948b-4835-b77e-c523fd3fcaa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c89f2f-dea5-4750-abb2-dcce1070732a", "tag": "a7ebea92-e62c-4761-8962-20b08c50df8e"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:55:25.907806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-610ba153-f44c-4177-a180-9c611a2f498c req-a305e76c-948b-4835-b77e-c523fd3fcaa8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:25.907806 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-610ba153-f44c-4177-a180-9c611a2f498c req-a305e76c-948b-4835-b77e-c523fd3fcaa8 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:25.923388 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-13ac8c24-953e-4617-b384-a7bac20ee09a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 204 len: 0 microversion: 2.1 time: 0.141584 May 19 05:55:25.924382 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3615/7320] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 05:55:25 2022] DELETE /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 05:55:25.927438 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-610ba153-f44c-4177-a180-9c611a2f498c req-a305e76c-948b-4835-b77e-c523fd3fcaa8 service nova] Creating event network-changed:a7ebea92-e62c-4761-8962-20b08c50df8e for instance 20c89f2f-dea5-4750-abb2-dcce1070732a on n-h2-766726-30 May 19 05:55:25.932903 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-610ba153-f44c-4177-a180-9c611a2f498c req-a305e76c-948b-4835-b77e-c523fd3fcaa8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148801 May 19 05:55:25.933738 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3706/7321] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 05:55:25.938272 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8a803880-f85e-4ec7-8899-ec2494d77e07 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:25.939258 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8a803880-f85e-4ec7-8899-ec2494d77e07 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:25.945516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a803880-f85e-4ec7-8899-ec2494d77e07 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:25.945965 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a803880-f85e-4ec7-8899-ec2494d77e07 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:25.946738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a803880-f85e-4ec7-8899-ec2494d77e07 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:25.947190 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8a803880-f85e-4ec7-8899-ec2494d77e07 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:26.136302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8a803880-f85e-4ec7-8899-ec2494d77e07 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:26.144087 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8a803880-f85e-4ec7-8899-ec2494d77e07 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.215503 May 19 05:55:26.144665 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3616/7322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:25 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 05:55:27.163745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ab4ef0a7-1806-4bf5-ba3d-21f9326a1396 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:27.164461 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ab4ef0a7-1806-4bf5-ba3d-21f9326a1396 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:27.170781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab4ef0a7-1806-4bf5-ba3d-21f9326a1396 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:27.171172 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab4ef0a7-1806-4bf5-ba3d-21f9326a1396 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:27.171944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab4ef0a7-1806-4bf5-ba3d-21f9326a1396 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:27.172386 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ab4ef0a7-1806-4bf5-ba3d-21f9326a1396 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:27.875967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ab4ef0a7-1806-4bf5-ba3d-21f9326a1396 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:27.883461 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ab4ef0a7-1806-4bf5-ba3d-21f9326a1396 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 200 len: 1680 microversion: 2.1 time: 0.724751 May 19 05:55:27.884812 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3707/7323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:27 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 1680 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:55:28.197631 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b074ccea-d829-4270-ab82-53f3815bba46 req-9eedfc25-94b7-46f6-9732-f339acf06e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c89f2f-dea5-4750-abb2-dcce1070732a", "name": "network-vif-deleted", "tag": "a7ebea92-e62c-4761-8962-20b08c50df8e"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:55:28.209673 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b074ccea-d829-4270-ab82-53f3815bba46 req-9eedfc25-94b7-46f6-9732-f339acf06e17 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:28.210057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b074ccea-d829-4270-ab82-53f3815bba46 req-9eedfc25-94b7-46f6-9732-f339acf06e17 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:28.221810 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b074ccea-d829-4270-ab82-53f3815bba46 req-9eedfc25-94b7-46f6-9732-f339acf06e17 service nova] Creating event network-vif-deleted:a7ebea92-e62c-4761-8962-20b08c50df8e for instance 20c89f2f-dea5-4750-abb2-dcce1070732a on n-h2-766726-30 May 19 05:55:28.227918 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b074ccea-d829-4270-ab82-53f3815bba46 req-9eedfc25-94b7-46f6-9732-f339acf06e17 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034460 May 19 05:55:28.228542 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3617/7324] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:55:28.901061 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:28.901715 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 20c89f2f-dea5-4750-abb2-dcce1070732a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:28.909643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:28.910104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:28.910881 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:28.911331 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:28.925357 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.wsgi [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] HTTP exception thrown: Instance 20c89f2f-dea5-4750-abb2-dcce1070732a could not be found. May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Request method failure captured: May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: request: GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a HTTP/1.1 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: Accept: application/json May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: Accept-Encoding: identity May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: Connection: close May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: Content-Length: 0 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: Content-Type: application/json May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: Host: 10.222.0.58 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: Openstack-System-Scope: None May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: User-Agent: python-urllib3/1.26.9 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Auth-Token: gAAAAABihdrU8CJ_81H4CpyNEQKJpEm9k4feUZY7xr8OoqKqzd97TXZHlMVISNXzaKmjCf3K4_RWBjnYlh4kAFs2E62JnAjYGPTr0OqOBm5QwTLFYCVXXuPYoNWUk8_WI0m_iUyrIDwtxmE3NuEzBofvSs0s8IQv4_7DAzjCDb_5od8ZnrNtyPY May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Id: None May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Domain-Name: None May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Identity-Status: Confirmed May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Is-Admin-Project: True May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Id: default May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Domain-Name: Default May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Id: da66e528ba9a476195feb5b930ead704 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Project-Name: tempest-TestShelveInstance-1441310845 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Role: reader,member May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Roles: reader,member May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da66e528ba9a476195feb5b930ead704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da66e528ba9a476195feb5b930ead704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da66e528ba9a476195feb5b930ead704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da66e528ba9a476195feb5b930ead704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant: tempest-TestShelveInstance-1441310845 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Id: da66e528ba9a476195feb5b930ead704 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-Tenant-Name: tempest-TestShelveInstance-1441310845 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-User: tempest-TestShelveInstance-1441310845-project May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Id: default May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-User-Domain-Name: Default May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-User-Id: 098da32b9a6042e7a194646bc55b3b68 May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: X-User-Name: tempest-TestShelveInstance-1441310845-project May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: method: > May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: exception: Instance 20c89f2f-dea5-4750-abb2-dcce1070732a could not be found. May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: action_args: {'id': '20c89f2f-dea5-4750-abb2-dcce1070732a'} May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c89f2f-dea5-4750-abb2-dcce1070732a could not be found. May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c89f2f-dea5-4750-abb2-dcce1070732a could not be found. May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 05:55:28.926989 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c89f2f-dea5-4750-abb2-dcce1070732a could not be found. May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: ERROR nova.api.openstack.wsgi May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Returning 404 to user: Instance 20c89f2f-dea5-4750-abb2-dcce1070732a could not be found. {{(pid=124818) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-35d11422-27d3-4e1c-95d2-c96f57300f21 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a" status: 404 len: 111 microversion: 2.1 time: 0.031333 May 19 05:55:28.930920 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3708/7325] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:28 2022] GET /compute/v2.1/servers/20c89f2f-dea5-4750-abb2-dcce1070732a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 05:55:29.085648 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8ee875e4-ed0b-4511-a55c-7c10fa6026ab tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '.version_select at 0x7fd31b804310>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:29.105177 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8ee875e4-ed0b-4511-a55c-7c10fa6026ab tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-977090853" status: 202 len: 0 microversion: 2.1 time: 0.024045 May 19 05:55:29.109168 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3618/7326] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 19 05:55:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-977090853 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 05:55:29.127411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2a01d654-69f8-47a7-a4aa-e5c29cde6a0e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Action: 'create', calling method: .version_select at 0x7fd314a71a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1963667414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsxATL9n55HE+S0BJC5kDvVnkJ2sgUxo9BU4Z28w5BLYMFjcAl0nb/mLtRB7WFqKoKYpy6frLAgikQlfgPTuxsTlpFqo6amLi4dhWu9sfIstQBzHQ2zcBCaCXDREbnCdQ=="}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:55:29.141991 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-2a01d654-69f8-47a7-a4aa-e5c29cde6a0e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Getting quotas for project da66e528ba9a476195feb5b930ead704. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:55:29.147344 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-2a01d654-69f8-47a7-a4aa-e5c29cde6a0e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Getting quotas for user 098da32b9a6042e7a194646bc55b3b68 and project da66e528ba9a476195feb5b930ead704. Resources: {'key_pairs'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:55:29.178044 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2a01d654-69f8-47a7-a4aa-e5c29cde6a0e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054051 May 19 05:55:29.178906 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3709/7327] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 05:55:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:55:49.394623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1715390897", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1963667414", "security_groups": [{"name": "tempest-secgroup-smoke-1637822746"}], "networks": [{"uuid": "9f25975c-fa8a-465d-9545-04bb7574801d"}], "block_device_mapping_v2": [{"uuid": "661b3e0e-ab7f-4847-87a6-24f676df781d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:55:49.403897 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:55:49.404742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:55:49.507077 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] validate_networks() for [('9f25975c-fa8a-465d-9545-04bb7574801d', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 05:55:49.919379 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 05:55:49.919802 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 05:55:49.920283 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 05:55:49.920741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 05:55:49.921256 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 05:55:49.933252 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:49.934218 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:49.935024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:49.935468 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:49.955447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Getting quotas for project da66e528ba9a476195feb5b930ead704. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 05:55:49.960724 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Getting quotas for user 098da32b9a6042e7a194646bc55b3b68 and project da66e528ba9a476195feb5b930ead704. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 05:55:50.020891 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 05:55:50.023212 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='661b3e0e-ab7f-4847-87a6-24f676df781d',volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 05:55:50.152676 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-72f44bbf-4a82-457c-b973-a58a3af13448 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762148 May 19 05:55:50.153410 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3619/7328] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 05:55:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 05:55:50.163748 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-b499ecd1-f86b-47f1-a764-3465986bf0bb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:50.164540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-b499ecd1-f86b-47f1-a764-3465986bf0bb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:50.166665 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=10 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:55:50.169110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:55:50.169758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:55:50.224861 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-b499ecd1-f86b-47f1-a764-3465986bf0bb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:50.232261 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-b499ecd1-f86b-47f1-a764-3465986bf0bb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1089 microversion: 2.1 time: 0.072799 May 19 05:55:50.232845 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3710/7329] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:50 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:55:51.250481 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f69e0ab9-51a5-4c01-94ff-203ae166744c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:51.251107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f69e0ab9-51a5-4c01-94ff-203ae166744c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:51.307914 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f69e0ab9-51a5-4c01-94ff-203ae166744c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:51.314837 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f69e0ab9-51a5-4c01-94ff-203ae166744c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1089 microversion: 2.1 time: 0.069559 May 19 05:55:51.315423 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3620/7330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:51 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:55:52.332411 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ca095401-aa3b-48f9-92f0-cb528419f7a2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:52.333186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ca095401-aa3b-48f9-92f0-cb528419f7a2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:52.391752 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-ca095401-aa3b-48f9-92f0-cb528419f7a2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:52.398581 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ca095401-aa3b-48f9-92f0-cb528419f7a2 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1089 microversion: 2.1 time: 0.070766 May 19 05:55:52.399170 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3711/7331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:52 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:55:53.415951 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-03fdf61f-3c30-499c-872e-755b5a47fd88 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:53.416575 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-03fdf61f-3c30-499c-872e-755b5a47fd88 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:53.471560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-03fdf61f-3c30-499c-872e-755b5a47fd88 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:53.478363 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-03fdf61f-3c30-499c-872e-755b5a47fd88 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1089 microversion: 2.1 time: 0.066444 May 19 05:55:53.478946 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3621/7332] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:53 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:55:54.495706 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-88298f72-5cbc-45e3-82c7-8451de693587 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:54.496904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-88298f72-5cbc-45e3-82c7-8451de693587 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:54.504875 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88298f72-5cbc-45e3-82c7-8451de693587 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:54.505360 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88298f72-5cbc-45e3-82c7-8451de693587 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:54.506148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88298f72-5cbc-45e3-82c7-8451de693587 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:54.506593 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-88298f72-5cbc-45e3-82c7-8451de693587 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:54.565874 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-88298f72-5cbc-45e3-82c7-8451de693587 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:54.573477 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-88298f72-5cbc-45e3-82c7-8451de693587 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1139 microversion: 2.1 time: 0.081681 May 19 05:55:54.574055 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3712/7333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:54 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:55:55.590925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6df529ee-fc2d-48f2-9ab0-5ccaa80ae34c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:55.591565 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6df529ee-fc2d-48f2-9ab0-5ccaa80ae34c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:55.609471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6df529ee-fc2d-48f2-9ab0-5ccaa80ae34c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:55.610184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6df529ee-fc2d-48f2-9ab0-5ccaa80ae34c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:55.611160 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6df529ee-fc2d-48f2-9ab0-5ccaa80ae34c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:55.611765 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6df529ee-fc2d-48f2-9ab0-5ccaa80ae34c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:55.684233 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6df529ee-fc2d-48f2-9ab0-5ccaa80ae34c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:55.692429 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6df529ee-fc2d-48f2-9ab0-5ccaa80ae34c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1205 microversion: 2.1 time: 0.106144 May 19 05:55:55.693025 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3622/7334] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:55 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:55:56.691563 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fb01ba12-9889-4472-bc74-8650e255665f req-f5a9579a-3de6-4937-ab36-e07f7388365e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a785bcf-806e-46cd-845f-338836aba0d5", "tag": "74c614f4-e25d-4fbf-8bcb-b5afb35255cc"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:55:56.711807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f4e477ea-54cb-41f0-8a68-2bd40e42a248 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:56.713118 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f4e477ea-54cb-41f0-8a68-2bd40e42a248 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:56.718626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fb01ba12-9889-4472-bc74-8650e255665f req-f5a9579a-3de6-4937-ab36-e07f7388365e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:56.722843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fb01ba12-9889-4472-bc74-8650e255665f req-f5a9579a-3de6-4937-ab36-e07f7388365e service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:56.732194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4e477ea-54cb-41f0-8a68-2bd40e42a248 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:56.733028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4e477ea-54cb-41f0-8a68-2bd40e42a248 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:56.734684 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4e477ea-54cb-41f0-8a68-2bd40e42a248 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:56.737449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f4e477ea-54cb-41f0-8a68-2bd40e42a248 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:56.758345 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-fb01ba12-9889-4472-bc74-8650e255665f req-f5a9579a-3de6-4937-ab36-e07f7388365e service nova] Creating event network-changed:74c614f4-e25d-4fbf-8bcb-b5afb35255cc for instance 9a785bcf-806e-46cd-845f-338836aba0d5 on n-h1-766726-30 May 19 05:55:56.769264 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fb01ba12-9889-4472-bc74-8650e255665f req-f5a9579a-3de6-4937-ab36-e07f7388365e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082154 May 19 05:55:56.770573 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3713/7335] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:55:56.997995 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f4e477ea-54cb-41f0-8a68-2bd40e42a248 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:57.006203 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f4e477ea-54cb-41f0-8a68-2bd40e42a248 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1273 microversion: 2.1 time: 0.299947 May 19 05:55:57.006931 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3623/7336] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:56 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:55:58.025488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2de38e12-b9ed-4fb1-a1bc-9850dad2286d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:58.026208 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2de38e12-b9ed-4fb1-a1bc-9850dad2286d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:58.033122 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2de38e12-b9ed-4fb1-a1bc-9850dad2286d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:58.033585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2de38e12-b9ed-4fb1-a1bc-9850dad2286d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:58.034356 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2de38e12-b9ed-4fb1-a1bc-9850dad2286d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:58.034805 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2de38e12-b9ed-4fb1-a1bc-9850dad2286d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:58.167458 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-2de38e12-b9ed-4fb1-a1bc-9850dad2286d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:58.175633 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2de38e12-b9ed-4fb1-a1bc-9850dad2286d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1273 microversion: 2.1 time: 0.155417 May 19 05:55:58.176221 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3714/7337] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:58 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:55:59.192113 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b7347c5c-d6b4-4595-848f-f6142cf7f30b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:55:59.192739 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b7347c5c-d6b4-4595-848f-f6142cf7f30b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:55:59.199830 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7347c5c-d6b4-4595-848f-f6142cf7f30b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:59.200349 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7347c5c-d6b4-4595-848f-f6142cf7f30b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:59.201151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7347c5c-d6b4-4595-848f-f6142cf7f30b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:55:59.201606 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b7347c5c-d6b4-4595-848f-f6142cf7f30b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:55:59.338277 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b7347c5c-d6b4-4595-848f-f6142cf7f30b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:55:59.346486 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b7347c5c-d6b4-4595-848f-f6142cf7f30b tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1273 microversion: 2.1 time: 0.158346 May 19 05:55:59.347063 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3624/7338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:55:59 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:00.365268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6800d33-0022-4298-9dad-a46073a7b0a7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:00.365908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6800d33-0022-4298-9dad-a46073a7b0a7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:00.374587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6800d33-0022-4298-9dad-a46073a7b0a7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:00.375058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6800d33-0022-4298-9dad-a46073a7b0a7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:00.375856 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6800d33-0022-4298-9dad-a46073a7b0a7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:00.376316 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6800d33-0022-4298-9dad-a46073a7b0a7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:00.510980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e6800d33-0022-4298-9dad-a46073a7b0a7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:00.518630 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6800d33-0022-4298-9dad-a46073a7b0a7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1273 microversion: 2.1 time: 0.158600 May 19 05:56:00.519220 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3715/7339] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:00 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:01.535492 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-da77d067-d2cc-42cb-9234-5a140390d9d5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:01.536034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-da77d067-d2cc-42cb-9234-5a140390d9d5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:01.537934 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:56:01.544059 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da77d067-d2cc-42cb-9234-5a140390d9d5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:01.544513 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da77d067-d2cc-42cb-9234-5a140390d9d5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:01.545302 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da77d067-d2cc-42cb-9234-5a140390d9d5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:01.545741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-da77d067-d2cc-42cb-9234-5a140390d9d5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:01.681462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-da77d067-d2cc-42cb-9234-5a140390d9d5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:01.690279 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-da77d067-d2cc-42cb-9234-5a140390d9d5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1273 microversion: 2.1 time: 0.158766 May 19 05:56:01.691167 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3625/7340] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:01 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:02.707484 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-317d627e-2b78-44af-89d8-9142215a721e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:02.708121 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-317d627e-2b78-44af-89d8-9142215a721e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:02.711003 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=4 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:56:02.717295 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317d627e-2b78-44af-89d8-9142215a721e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:02.717761 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317d627e-2b78-44af-89d8-9142215a721e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:02.718549 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317d627e-2b78-44af-89d8-9142215a721e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:02.719002 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317d627e-2b78-44af-89d8-9142215a721e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:02.855932 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-317d627e-2b78-44af-89d8-9142215a721e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:02.863661 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-317d627e-2b78-44af-89d8-9142215a721e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1273 microversion: 2.1 time: 0.160089 May 19 05:56:02.864151 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3716/7341] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:02 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:03.881262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0f79477c-71f2-40f4-90b9-cd7c0a426c5f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:03.881893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0f79477c-71f2-40f4-90b9-cd7c0a426c5f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:03.884588 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=10 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:56:03.890281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f79477c-71f2-40f4-90b9-cd7c0a426c5f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:03.890736 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f79477c-71f2-40f4-90b9-cd7c0a426c5f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:03.891505 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f79477c-71f2-40f4-90b9-cd7c0a426c5f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:03.891983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0f79477c-71f2-40f4-90b9-cd7c0a426c5f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:04.028528 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0f79477c-71f2-40f4-90b9-cd7c0a426c5f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:04.036275 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0f79477c-71f2-40f4-90b9-cd7c0a426c5f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1273 microversion: 2.1 time: 0.158987 May 19 05:56:04.036855 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3626/7342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:03 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:05.053572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-c1c4e3e8-a652-4723-869b-d4862d6c3ecd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:05.054211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-c1c4e3e8-a652-4723-869b-d4862d6c3ecd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:05.063714 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1c4e3e8-a652-4723-869b-d4862d6c3ecd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:05.064147 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1c4e3e8-a652-4723-869b-d4862d6c3ecd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:05.064962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1c4e3e8-a652-4723-869b-d4862d6c3ecd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:05.066415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-c1c4e3e8-a652-4723-869b-d4862d6c3ecd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:05.201689 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-c1c4e3e8-a652-4723-869b-d4862d6c3ecd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:05.209330 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-c1c4e3e8-a652-4723-869b-d4862d6c3ecd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1273 microversion: 2.1 time: 0.159706 May 19 05:56:05.209908 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3717/7343] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:05 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:06.227919 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e0e3cef3-dc27-46e8-bd41-4e4df67af8fc tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:06.228549 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e0e3cef3-dc27-46e8-bd41-4e4df67af8fc tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:06.237047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0e3cef3-dc27-46e8-bd41-4e4df67af8fc tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:06.237531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0e3cef3-dc27-46e8-bd41-4e4df67af8fc tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:06.238295 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0e3cef3-dc27-46e8-bd41-4e4df67af8fc tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:06.238731 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e0e3cef3-dc27-46e8-bd41-4e4df67af8fc tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:06.369148 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e0e3cef3-dc27-46e8-bd41-4e4df67af8fc tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:06.376897 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e0e3cef3-dc27-46e8-bd41-4e4df67af8fc tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1261 microversion: 2.1 time: 0.153307 May 19 05:56:06.377519 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3627/7344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:06 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:07.393522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-728aaee9-1078-44ab-9e5d-9682109d8dce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:07.394186 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-728aaee9-1078-44ab-9e5d-9682109d8dce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:07.401155 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-728aaee9-1078-44ab-9e5d-9682109d8dce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:07.401622 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-728aaee9-1078-44ab-9e5d-9682109d8dce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:07.403066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-728aaee9-1078-44ab-9e5d-9682109d8dce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:07.403513 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-728aaee9-1078-44ab-9e5d-9682109d8dce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:07.534148 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-728aaee9-1078-44ab-9e5d-9682109d8dce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:07.541745 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-728aaee9-1078-44ab-9e5d-9682109d8dce tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1261 microversion: 2.1 time: 0.152230 May 19 05:56:07.542345 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3718/7345] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:07 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:08.559036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-dee09e98-4ed1-465c-9980-d6c3378e8c51 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:08.559656 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-dee09e98-4ed1-465c-9980-d6c3378e8c51 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:08.566590 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dee09e98-4ed1-465c-9980-d6c3378e8c51 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:08.567044 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dee09e98-4ed1-465c-9980-d6c3378e8c51 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:08.567807 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dee09e98-4ed1-465c-9980-d6c3378e8c51 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:08.568245 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-dee09e98-4ed1-465c-9980-d6c3378e8c51 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:08.701833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-dee09e98-4ed1-465c-9980-d6c3378e8c51 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:08.709312 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-dee09e98-4ed1-465c-9980-d6c3378e8c51 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1261 microversion: 2.1 time: 0.154720 May 19 05:56:08.709892 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3628/7346] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:08 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:09.726510 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e6a5a06c-3628-4593-ac20-9e3f527c1bae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:09.727166 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e6a5a06c-3628-4593-ac20-9e3f527c1bae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:09.734067 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6a5a06c-3628-4593-ac20-9e3f527c1bae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:09.734528 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6a5a06c-3628-4593-ac20-9e3f527c1bae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:09.735296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6a5a06c-3628-4593-ac20-9e3f527c1bae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:09.735741 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e6a5a06c-3628-4593-ac20-9e3f527c1bae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:09.863055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e6a5a06c-3628-4593-ac20-9e3f527c1bae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:09.871099 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e6a5a06c-3628-4593-ac20-9e3f527c1bae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1261 microversion: 2.1 time: 0.147987 May 19 05:56:09.871692 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3719/7347] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:09 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:10.888560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-7802f333-a77a-4911-8c1b-52ed3244e569 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:10.889125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-7802f333-a77a-4911-8c1b-52ed3244e569 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:10.896144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7802f333-a77a-4911-8c1b-52ed3244e569 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:10.896602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7802f333-a77a-4911-8c1b-52ed3244e569 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:10.897406 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7802f333-a77a-4911-8c1b-52ed3244e569 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:10.897855 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-7802f333-a77a-4911-8c1b-52ed3244e569 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:11.029983 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-7802f333-a77a-4911-8c1b-52ed3244e569 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:11.037683 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-7802f333-a77a-4911-8c1b-52ed3244e569 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1261 microversion: 2.1 time: 0.153765 May 19 05:56:11.038265 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3629/7348] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:10 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:12.055197 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-8bf1a0b2-7217-4005-bfe5-49e11962804e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:12.055830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-8bf1a0b2-7217-4005-bfe5-49e11962804e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:12.066398 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bf1a0b2-7217-4005-bfe5-49e11962804e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:12.066859 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bf1a0b2-7217-4005-bfe5-49e11962804e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:12.067668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bf1a0b2-7217-4005-bfe5-49e11962804e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:12.068126 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-8bf1a0b2-7217-4005-bfe5-49e11962804e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:12.201162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-8bf1a0b2-7217-4005-bfe5-49e11962804e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:12.208663 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-8bf1a0b2-7217-4005-bfe5-49e11962804e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1261 microversion: 2.1 time: 0.157398 May 19 05:56:12.209246 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3720/7349] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:12 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:13.225793 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff1fba48-9469-4271-b150-9b1d41a2b162 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:13.226408 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff1fba48-9469-4271-b150-9b1d41a2b162 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:13.233994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff1fba48-9469-4271-b150-9b1d41a2b162 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:13.234442 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff1fba48-9469-4271-b150-9b1d41a2b162 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:13.235207 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff1fba48-9469-4271-b150-9b1d41a2b162 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:13.235642 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff1fba48-9469-4271-b150-9b1d41a2b162 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:13.367874 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff1fba48-9469-4271-b150-9b1d41a2b162 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:13.375387 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff1fba48-9469-4271-b150-9b1d41a2b162 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1261 microversion: 2.1 time: 0.153574 May 19 05:56:13.376214 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3630/7350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:13 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:14.391507 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5707f6df-ea08-48c7-ae20-c2e4f6b25aa1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:14.392137 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5707f6df-ea08-48c7-ae20-c2e4f6b25aa1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:14.399262 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5707f6df-ea08-48c7-ae20-c2e4f6b25aa1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:14.399725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5707f6df-ea08-48c7-ae20-c2e4f6b25aa1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:14.400499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5707f6df-ea08-48c7-ae20-c2e4f6b25aa1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:14.400953 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5707f6df-ea08-48c7-ae20-c2e4f6b25aa1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:14.534064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5707f6df-ea08-48c7-ae20-c2e4f6b25aa1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:14.541475 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5707f6df-ea08-48c7-ae20-c2e4f6b25aa1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1261 microversion: 2.1 time: 0.153865 May 19 05:56:14.542073 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3721/7351] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:14 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:14.855144 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-a84c1bcd-97a6-4e84-a37e-02db029d60a1 req-de64f9c6-cf53-48c8-a299-5a2ceb77b015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a785bcf-806e-46cd-845f-338836aba0d5", "name": "network-vif-plugged", "status": "completed", "tag": "74c614f4-e25d-4fbf-8bcb-b5afb35255cc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:56:14.864720 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a84c1bcd-97a6-4e84-a37e-02db029d60a1 req-de64f9c6-cf53-48c8-a299-5a2ceb77b015 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:14.865121 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-a84c1bcd-97a6-4e84-a37e-02db029d60a1 req-de64f9c6-cf53-48c8-a299-5a2ceb77b015 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:14.879923 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-a84c1bcd-97a6-4e84-a37e-02db029d60a1 req-de64f9c6-cf53-48c8-a299-5a2ceb77b015 service nova] Creating event network-vif-plugged:74c614f4-e25d-4fbf-8bcb-b5afb35255cc for instance 9a785bcf-806e-46cd-845f-338836aba0d5 on n-h1-766726-30 May 19 05:56:14.885495 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-a84c1bcd-97a6-4e84-a37e-02db029d60a1 req-de64f9c6-cf53-48c8-a299-5a2ceb77b015 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034060 May 19 05:56:14.886772 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3631/7352] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:56:15.559736 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eede3996-2e06-44b9-bbab-61474d5f8c35 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:15.560369 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eede3996-2e06-44b9-bbab-61474d5f8c35 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:15.567429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eede3996-2e06-44b9-bbab-61474d5f8c35 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:15.567898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eede3996-2e06-44b9-bbab-61474d5f8c35 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:15.568684 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eede3996-2e06-44b9-bbab-61474d5f8c35 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:15.569175 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eede3996-2e06-44b9-bbab-61474d5f8c35 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:15.702944 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eede3996-2e06-44b9-bbab-61474d5f8c35 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:15.711141 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eede3996-2e06-44b9-bbab-61474d5f8c35 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1261 microversion: 2.1 time: 0.156008 May 19 05:56:15.711717 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3722/7353] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:15 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:16.731225 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-abf5a7f2-03b5-4dc6-a29f-08493bc36257 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:16.731929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-abf5a7f2-03b5-4dc6-a29f-08493bc36257 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:16.740440 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f2-03b5-4dc6-a29f-08493bc36257 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:16.740887 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f2-03b5-4dc6-a29f-08493bc36257 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:16.741680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f2-03b5-4dc6-a29f-08493bc36257 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:16.742119 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f2-03b5-4dc6-a29f-08493bc36257 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:16.871433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-abf5a7f2-03b5-4dc6-a29f-08493bc36257 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:16.879246 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-abf5a7f2-03b5-4dc6-a29f-08493bc36257 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1445 microversion: 2.1 time: 0.153871 May 19 05:56:16.879819 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3632/7354] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:16 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:16.895058 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe5f8cf6-fc30-4772-85aa-578091822d68 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:56:16.895724 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fe5f8cf6-fc30-4772-85aa-578091822d68 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:56:16.903154 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe5f8cf6-fc30-4772-85aa-578091822d68 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:16.903624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe5f8cf6-fc30-4772-85aa-578091822d68 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:16.904406 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe5f8cf6-fc30-4772-85aa-578091822d68 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:16.904890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe5f8cf6-fc30-4772-85aa-578091822d68 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:17.038396 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-fe5f8cf6-fc30-4772-85aa-578091822d68 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:56:17.046451 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fe5f8cf6-fc30-4772-85aa-578091822d68 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1445 microversion: 2.1 time: 0.155201 May 19 05:56:17.047046 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3723/7355] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:56:16 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:56:18.966822 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-cd501604-fe71-4d3c-b5e4-2b165b05befc req-7ecdc07f-9f20-449d-b04a-4366d740611f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a785bcf-806e-46cd-845f-338836aba0d5", "tag": "74c614f4-e25d-4fbf-8bcb-b5afb35255cc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:56:18.976542 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cd501604-fe71-4d3c-b5e4-2b165b05befc req-7ecdc07f-9f20-449d-b04a-4366d740611f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:56:18.977104 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-cd501604-fe71-4d3c-b5e4-2b165b05befc req-7ecdc07f-9f20-449d-b04a-4366d740611f service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:56:18.989876 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-cd501604-fe71-4d3c-b5e4-2b165b05befc req-7ecdc07f-9f20-449d-b04a-4366d740611f service nova] Creating event network-changed:74c614f4-e25d-4fbf-8bcb-b5afb35255cc for instance 9a785bcf-806e-46cd-845f-338836aba0d5 on n-h1-766726-30 May 19 05:56:18.996946 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-cd501604-fe71-4d3c-b5e4-2b165b05befc req-7ecdc07f-9f20-449d-b04a-4366d740611f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034099 May 19 05:56:18.998748 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3633/7356] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:56:31.057704 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:56:31.058148 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:58:09.093027 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:58:09.093777 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 05:58:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:58:09.841971 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:58:09.842614 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:58:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:58:09.915752 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 05:58:09.915752 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 05:58:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 05:58:16.211065 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [01022541-891f-4ef1-a973-f7b4510bbfd8] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 05:58:16.211875 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2869c6-282b-4cce-84de-e63fb06fc5d4] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 05:58:16.212737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=32 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:58:16.213795 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=68 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:58:16.273294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-27ab4001-11ad-43f2-b62a-692e5dd27e8c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:58:16.273851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-27ab4001-11ad-43f2-b62a-692e5dd27e8c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:16.279918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27ab4001-11ad-43f2-b62a-692e5dd27e8c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:16.280375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27ab4001-11ad-43f2-b62a-692e5dd27e8c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:16.281178 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27ab4001-11ad-43f2-b62a-692e5dd27e8c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:16.281627 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-27ab4001-11ad-43f2-b62a-692e5dd27e8c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:16.306898 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-27ab4001-11ad-43f2-b62a-692e5dd27e8c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lazy-loading 'flavor' on Instance uuid 9a785bcf-806e-46cd-845f-338836aba0d5 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 05:58:16.380254 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-27ab4001-11ad-43f2-b62a-692e5dd27e8c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "POST /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5/action" status: 202 len: 0 microversion: 2.1 time: 0.170826 May 19 05:58:16.380852 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3724/7357] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:58:16 2022] POST /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:58:16.387186 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11f4aea6-c176-403c-9633-d60098efd474] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 05:58:16.387999 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99e79aa7-a0e7-43bd-8544-8a0b9dce8b08] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 05:58:16.388660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:58:16.389448 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=66 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:58:16.394126 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48d90e5c-d67b-405e-aa99-fea6688a738a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:16.394838 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-48d90e5c-d67b-405e-aa99-fea6688a738a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:16.404178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48d90e5c-d67b-405e-aa99-fea6688a738a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:16.404638 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48d90e5c-d67b-405e-aa99-fea6688a738a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:16.405458 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48d90e5c-d67b-405e-aa99-fea6688a738a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:16.405906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48d90e5c-d67b-405e-aa99-fea6688a738a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:16.540122 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-48d90e5c-d67b-405e-aa99-fea6688a738a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:16.548408 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-48d90e5c-d67b-405e-aa99-fea6688a738a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.162972 May 19 05:58:16.548981 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3634/7358] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:16 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:17.570793 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-bc0247c6-bfc8-4fbc-b9b3-25fb2775f069 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:17.571536 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-bc0247c6-bfc8-4fbc-b9b3-25fb2775f069 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:17.580876 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc0247c6-bfc8-4fbc-b9b3-25fb2775f069 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:17.581306 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc0247c6-bfc8-4fbc-b9b3-25fb2775f069 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:17.582087 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc0247c6-bfc8-4fbc-b9b3-25fb2775f069 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:17.582540 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-bc0247c6-bfc8-4fbc-b9b3-25fb2775f069 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:17.586486 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] [01022541-891f-4ef1-a973-f7b4510bbfd8] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60508. May 19 05:58:17.590718 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2869c6-282b-4cce-84de-e63fb06fc5d4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60510. May 19 05:58:17.723055 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-bc0247c6-bfc8-4fbc-b9b3-25fb2775f069 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:17.730768 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-bc0247c6-bfc8-4fbc-b9b3-25fb2775f069 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.165893 May 19 05:58:17.732038 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3725/7359] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:17 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:18.749034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2f025abd-919d-46a1-a99b-f4e491027081 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:18.749674 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2f025abd-919d-46a1-a99b-f4e491027081 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:18.762348 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] [11f4aea6-c176-403c-9633-d60098efd474] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60514. May 19 05:58:18.770068 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] [99e79aa7-a0e7-43bd-8544-8a0b9dce8b08] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60516. May 19 05:58:18.772767 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f025abd-919d-46a1-a99b-f4e491027081 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:18.773238 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f025abd-919d-46a1-a99b-f4e491027081 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:18.774017 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f025abd-919d-46a1-a99b-f4e491027081 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:18.774455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2f025abd-919d-46a1-a99b-f4e491027081 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:18.911521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2f025abd-919d-46a1-a99b-f4e491027081 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:18.919999 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2f025abd-919d-46a1-a99b-f4e491027081 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.174942 May 19 05:58:18.920580 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3635/7360] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:18 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:19.936926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9f7bd24e-26e4-4695-9886-cb312d5316dd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:19.937585 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9f7bd24e-26e4-4695-9886-cb312d5316dd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:19.944598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f7bd24e-26e4-4695-9886-cb312d5316dd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:19.945064 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f7bd24e-26e4-4695-9886-cb312d5316dd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:19.945870 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f7bd24e-26e4-4695-9886-cb312d5316dd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:19.946319 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f7bd24e-26e4-4695-9886-cb312d5316dd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:20.077940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9f7bd24e-26e4-4695-9886-cb312d5316dd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:20.085558 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9f7bd24e-26e4-4695-9886-cb312d5316dd tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.153216 May 19 05:58:20.086131 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3726/7361] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:19 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:21.103068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-fa6b99da-9ed6-44e6-8f59-b1c3efc61854 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:21.103687 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-fa6b99da-9ed6-44e6-8f59-b1c3efc61854 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:21.110570 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6b99da-9ed6-44e6-8f59-b1c3efc61854 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:21.111016 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6b99da-9ed6-44e6-8f59-b1c3efc61854 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:21.111774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6b99da-9ed6-44e6-8f59-b1c3efc61854 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:21.112205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-fa6b99da-9ed6-44e6-8f59-b1c3efc61854 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:21.239085 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-fa6b99da-9ed6-44e6-8f59-b1c3efc61854 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:21.246569 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-fa6b99da-9ed6-44e6-8f59-b1c3efc61854 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.147503 May 19 05:58:21.247820 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3636/7362] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:21 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:22.264425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-479c72c5-25f6-4ed4-907a-40c96209e698 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:22.265059 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-479c72c5-25f6-4ed4-907a-40c96209e698 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:22.272089 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-479c72c5-25f6-4ed4-907a-40c96209e698 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:22.272557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-479c72c5-25f6-4ed4-907a-40c96209e698 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:22.273372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-479c72c5-25f6-4ed4-907a-40c96209e698 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:22.273822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-479c72c5-25f6-4ed4-907a-40c96209e698 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:22.406794 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-479c72c5-25f6-4ed4-907a-40c96209e698 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:22.415333 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-479c72c5-25f6-4ed4-907a-40c96209e698 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.154385 May 19 05:58:22.416049 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3727/7363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:22 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:23.432389 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e2314404-5a14-41b0-bb24-73067b2aa91f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:23.433009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e2314404-5a14-41b0-bb24-73067b2aa91f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:23.440623 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2314404-5a14-41b0-bb24-73067b2aa91f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:23.441098 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2314404-5a14-41b0-bb24-73067b2aa91f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:23.441866 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2314404-5a14-41b0-bb24-73067b2aa91f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:23.442308 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e2314404-5a14-41b0-bb24-73067b2aa91f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:23.579243 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e2314404-5a14-41b0-bb24-73067b2aa91f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:23.586862 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e2314404-5a14-41b0-bb24-73067b2aa91f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.158345 May 19 05:58:23.587377 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3637/7364] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:23 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:24.603224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a00b378f-e891-4d04-93c9-cead2541f2eb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:24.603840 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a00b378f-e891-4d04-93c9-cead2541f2eb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:24.611634 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a00b378f-e891-4d04-93c9-cead2541f2eb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:24.612097 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a00b378f-e891-4d04-93c9-cead2541f2eb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:24.612867 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a00b378f-e891-4d04-93c9-cead2541f2eb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:24.613345 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a00b378f-e891-4d04-93c9-cead2541f2eb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:24.742617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a00b378f-e891-4d04-93c9-cead2541f2eb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:24.750246 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a00b378f-e891-4d04-93c9-cead2541f2eb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.150971 May 19 05:58:24.750830 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3728/7365] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:24 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:25.767092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-45a42730-80a1-4e34-86ff-26a45aae571e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:25.767712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-45a42730-80a1-4e34-86ff-26a45aae571e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:25.774651 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45a42730-80a1-4e34-86ff-26a45aae571e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:25.775101 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45a42730-80a1-4e34-86ff-26a45aae571e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:25.775896 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45a42730-80a1-4e34-86ff-26a45aae571e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:25.776376 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-45a42730-80a1-4e34-86ff-26a45aae571e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:25.913905 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-45a42730-80a1-4e34-86ff-26a45aae571e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:25.922758 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-45a42730-80a1-4e34-86ff-26a45aae571e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.159545 May 19 05:58:25.923338 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3638/7366] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:25 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:26.940430 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-22481b52-c8ea-4f74-a960-68a48dedbe7c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:26.941060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-22481b52-c8ea-4f74-a960-68a48dedbe7c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:26.948060 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22481b52-c8ea-4f74-a960-68a48dedbe7c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:26.948522 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22481b52-c8ea-4f74-a960-68a48dedbe7c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:26.949323 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22481b52-c8ea-4f74-a960-68a48dedbe7c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:26.949826 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-22481b52-c8ea-4f74-a960-68a48dedbe7c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:27.175234 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-22481b52-c8ea-4f74-a960-68a48dedbe7c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:27.182883 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-22481b52-c8ea-4f74-a960-68a48dedbe7c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.246427 May 19 05:58:27.183776 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3729/7367] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:26 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:28.200978 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-59b375fd-83c5-469d-89cb-cf460ecfb73c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:28.201622 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-59b375fd-83c5-469d-89cb-cf460ecfb73c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:28.208600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59b375fd-83c5-469d-89cb-cf460ecfb73c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:28.209054 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59b375fd-83c5-469d-89cb-cf460ecfb73c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:28.209846 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59b375fd-83c5-469d-89cb-cf460ecfb73c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:28.210286 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-59b375fd-83c5-469d-89cb-cf460ecfb73c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:28.339804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-59b375fd-83c5-469d-89cb-cf460ecfb73c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:28.347566 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-59b375fd-83c5-469d-89cb-cf460ecfb73c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.151200 May 19 05:58:28.348142 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3639/7368] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:28 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:29.364296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-317a32f4-411b-4e0a-8ead-d608a891032e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:29.364926 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-317a32f4-411b-4e0a-8ead-d608a891032e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:29.372353 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317a32f4-411b-4e0a-8ead-d608a891032e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:29.372904 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317a32f4-411b-4e0a-8ead-d608a891032e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:29.373831 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317a32f4-411b-4e0a-8ead-d608a891032e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:29.374481 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-317a32f4-411b-4e0a-8ead-d608a891032e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:29.512952 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-317a32f4-411b-4e0a-8ead-d608a891032e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:29.520593 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-317a32f4-411b-4e0a-8ead-d608a891032e tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.160244 May 19 05:58:29.521191 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3730/7369] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:29 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:30.538370 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-14bee106-760d-499d-9195-bf42f57f1374 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:30.539033 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-14bee106-760d-499d-9195-bf42f57f1374 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:30.546698 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14bee106-760d-499d-9195-bf42f57f1374 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:30.547147 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14bee106-760d-499d-9195-bf42f57f1374 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:30.547908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14bee106-760d-499d-9195-bf42f57f1374 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:30.548344 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-14bee106-760d-499d-9195-bf42f57f1374 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:30.679368 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-14bee106-760d-499d-9195-bf42f57f1374 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:30.692427 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-14bee106-760d-499d-9195-bf42f57f1374 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.157887 May 19 05:58:30.693010 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3640/7370] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:30 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:31.709745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0209118f-41ed-4709-985d-b2191e2fe4d8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:31.710393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0209118f-41ed-4709-985d-b2191e2fe4d8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:31.717697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0209118f-41ed-4709-985d-b2191e2fe4d8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:31.718162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0209118f-41ed-4709-985d-b2191e2fe4d8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:31.718938 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0209118f-41ed-4709-985d-b2191e2fe4d8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:31.719387 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0209118f-41ed-4709-985d-b2191e2fe4d8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:31.853970 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0209118f-41ed-4709-985d-b2191e2fe4d8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:31.862312 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0209118f-41ed-4709-985d-b2191e2fe4d8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.156539 May 19 05:58:31.862895 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3731/7371] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:31 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:32.879198 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-28dbe795-add8-4a10-846a-1a481b2531f7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:32.879794 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-28dbe795-add8-4a10-846a-1a481b2531f7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:32.886756 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28dbe795-add8-4a10-846a-1a481b2531f7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:32.887209 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28dbe795-add8-4a10-846a-1a481b2531f7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:32.888571 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28dbe795-add8-4a10-846a-1a481b2531f7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:32.889010 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-28dbe795-add8-4a10-846a-1a481b2531f7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:33.016873 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-28dbe795-add8-4a10-846a-1a481b2531f7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:33.024393 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-28dbe795-add8-4a10-846a-1a481b2531f7 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1571 microversion: 2.1 time: 0.149332 May 19 05:58:33.024965 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3641/7372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:32 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1571 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:33.040405 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fc3a233a-0807-4fd3-bfd8-a51f5ada6f20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:58:33.040990 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fc3a233a-0807-4fd3-bfd8-a51f5ada6f20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:33.048368 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc3a233a-0807-4fd3-bfd8-a51f5ada6f20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:33.048830 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc3a233a-0807-4fd3-bfd8-a51f5ada6f20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:33.049632 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc3a233a-0807-4fd3-bfd8-a51f5ada6f20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:33.050081 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fc3a233a-0807-4fd3-bfd8-a51f5ada6f20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:33.193808 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fc3a233a-0807-4fd3-bfd8-a51f5ada6f20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "POST /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5/action" status: 202 len: 0 microversion: 2.1 time: 0.157197 May 19 05:58:33.194437 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3732/7373] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 05:58:33 2022] POST /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 05:58:33.202466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-f7a34248-02c7-4f3c-b01d-0d95e95dfd3f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:33.203082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-f7a34248-02c7-4f3c-b01d-0d95e95dfd3f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:33.209049 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7a34248-02c7-4f3c-b01d-0d95e95dfd3f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:33.209538 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7a34248-02c7-4f3c-b01d-0d95e95dfd3f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:33.210303 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7a34248-02c7-4f3c-b01d-0d95e95dfd3f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:33.210742 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-f7a34248-02c7-4f3c-b01d-0d95e95dfd3f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:33.351593 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-f7a34248-02c7-4f3c-b01d-0d95e95dfd3f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:33.362278 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-f7a34248-02c7-4f3c-b01d-0d95e95dfd3f tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1519 microversion: 2.1 time: 0.163600 May 19 05:58:33.363087 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3642/7374] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:33 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:33.445882 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-fd1014ea-5e4d-4747-9e59-1ce03aca9915 req-8fe404fc-3d65-41b3-914e-4e5a5c8c8e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a785bcf-806e-46cd-845f-338836aba0d5", "name": "network-vif-unplugged", "status": "completed", "tag": "74c614f4-e25d-4fbf-8bcb-b5afb35255cc"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:58:33.454917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fd1014ea-5e4d-4747-9e59-1ce03aca9915 req-8fe404fc-3d65-41b3-914e-4e5a5c8c8e47 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:33.455486 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-fd1014ea-5e4d-4747-9e59-1ce03aca9915 req-8fe404fc-3d65-41b3-914e-4e5a5c8c8e47 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:33.470902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.compute.server_external_events [req-fd1014ea-5e4d-4747-9e59-1ce03aca9915 req-8fe404fc-3d65-41b3-914e-4e5a5c8c8e47 service nova] Unable to find a host for instance 9a785bcf-806e-46cd-845f-338836aba0d5. Dropping event network-vif-unplugged {{(pid=124818) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 05:58:33.471974 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-fd1014ea-5e4d-4747-9e59-1ce03aca9915 req-8fe404fc-3d65-41b3-914e-4e5a5c8c8e47 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030167 May 19 05:58:33.472698 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3733/7375] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 05:58:34.380057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8e989f73-9324-4709-873d-2c782f25f3fb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:34.380877 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8e989f73-9324-4709-873d-2c782f25f3fb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:34.387958 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e989f73-9324-4709-873d-2c782f25f3fb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:34.388411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e989f73-9324-4709-873d-2c782f25f3fb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:34.389210 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e989f73-9324-4709-873d-2c782f25f3fb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:34.389660 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8e989f73-9324-4709-873d-2c782f25f3fb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:34.523697 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8e989f73-9324-4709-873d-2c782f25f3fb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:34.532045 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8e989f73-9324-4709-873d-2c782f25f3fb tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1521 microversion: 2.1 time: 0.156199 May 19 05:58:34.532624 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3643/7376] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:34 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:35.549994 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-0e584a6c-f8ed-49b3-be79-2773fb5d38e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:35.550623 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-0e584a6c-f8ed-49b3-be79-2773fb5d38e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:35.557600 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e584a6c-f8ed-49b3-be79-2773fb5d38e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:35.558063 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e584a6c-f8ed-49b3-be79-2773fb5d38e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:35.558833 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e584a6c-f8ed-49b3-be79-2773fb5d38e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:35.559305 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-0e584a6c-f8ed-49b3-be79-2773fb5d38e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:35.689432 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-0e584a6c-f8ed-49b3-be79-2773fb5d38e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:35.697120 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-0e584a6c-f8ed-49b3-be79-2773fb5d38e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1521 microversion: 2.1 time: 0.151028 May 19 05:58:35.697704 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3734/7377] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:35 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:36.715141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ec54b1f2-a596-4f16-bc93-f7f4873b6d20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:36.716439 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ec54b1f2-a596-4f16-bc93-f7f4873b6d20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:36.723957 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec54b1f2-a596-4f16-bc93-f7f4873b6d20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:36.724411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec54b1f2-a596-4f16-bc93-f7f4873b6d20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:36.725262 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec54b1f2-a596-4f16-bc93-f7f4873b6d20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:36.725735 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ec54b1f2-a596-4f16-bc93-f7f4873b6d20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:36.862628 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ec54b1f2-a596-4f16-bc93-f7f4873b6d20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:36.870326 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ec54b1f2-a596-4f16-bc93-f7f4873b6d20 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1521 microversion: 2.1 time: 0.159458 May 19 05:58:36.870908 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3644/7378] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:36 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:37.887008 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e8d4713-f068-4d4d-9b90-056eed91383c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:37.887642 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6e8d4713-f068-4d4d-9b90-056eed91383c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:37.895494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8d4713-f068-4d4d-9b90-056eed91383c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:37.895947 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8d4713-f068-4d4d-9b90-056eed91383c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:37.896738 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8d4713-f068-4d4d-9b90-056eed91383c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:37.897212 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e8d4713-f068-4d4d-9b90-056eed91383c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:38.026674 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6e8d4713-f068-4d4d-9b90-056eed91383c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:38.034417 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e8d4713-f068-4d4d-9b90-056eed91383c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1521 microversion: 2.1 time: 0.151338 May 19 05:58:38.034996 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3735/7379] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:37 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:39.050929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e9ffd1f8-f5fd-44cc-bd72-1311e7750c0a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:39.051658 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e9ffd1f8-f5fd-44cc-bd72-1311e7750c0a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:39.058764 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9ffd1f8-f5fd-44cc-bd72-1311e7750c0a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:39.059796 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9ffd1f8-f5fd-44cc-bd72-1311e7750c0a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:39.060563 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9ffd1f8-f5fd-44cc-bd72-1311e7750c0a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:39.061004 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e9ffd1f8-f5fd-44cc-bd72-1311e7750c0a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:39.194088 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e9ffd1f8-f5fd-44cc-bd72-1311e7750c0a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:39.201775 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e9ffd1f8-f5fd-44cc-bd72-1311e7750c0a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1521 microversion: 2.1 time: 0.154795 May 19 05:58:39.202351 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3645/7380] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:39 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:40.219664 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-05c2e810-61e2-467f-90e9-88488591b8d1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:40.220318 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-05c2e810-61e2-467f-90e9-88488591b8d1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:40.227590 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05c2e810-61e2-467f-90e9-88488591b8d1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:40.228062 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05c2e810-61e2-467f-90e9-88488591b8d1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:40.228860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05c2e810-61e2-467f-90e9-88488591b8d1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:40.229339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-05c2e810-61e2-467f-90e9-88488591b8d1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:40.369011 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-05c2e810-61e2-467f-90e9-88488591b8d1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:40.376753 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-05c2e810-61e2-467f-90e9-88488591b8d1 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1521 microversion: 2.1 time: 0.161558 May 19 05:58:40.377727 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3736/7381] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:40 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:41.394186 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ff1a81e7-b4fb-4e7e-aa9e-a2865c3f34a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:41.394790 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ff1a81e7-b4fb-4e7e-aa9e-a2865c3f34a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:41.401893 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff1a81e7-b4fb-4e7e-aa9e-a2865c3f34a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:41.402346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff1a81e7-b4fb-4e7e-aa9e-a2865c3f34a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:41.403633 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff1a81e7-b4fb-4e7e-aa9e-a2865c3f34a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:41.404078 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ff1a81e7-b4fb-4e7e-aa9e-a2865c3f34a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:41.531201 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ff1a81e7-b4fb-4e7e-aa9e-a2865c3f34a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:41.538703 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ff1a81e7-b4fb-4e7e-aa9e-a2865c3f34a8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1521 microversion: 2.1 time: 0.148564 May 19 05:58:41.539277 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3646/7382] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:41 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:42.555892 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-70c239e8-2661-43a1-9a7f-dafaa85c5679 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:42.556460 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-70c239e8-2661-43a1-9a7f-dafaa85c5679 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:42.563375 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70c239e8-2661-43a1-9a7f-dafaa85c5679 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:42.563832 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70c239e8-2661-43a1-9a7f-dafaa85c5679 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:42.564626 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70c239e8-2661-43a1-9a7f-dafaa85c5679 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:42.565099 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-70c239e8-2661-43a1-9a7f-dafaa85c5679 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:42.701758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-70c239e8-2661-43a1-9a7f-dafaa85c5679 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:42.710471 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-70c239e8-2661-43a1-9a7f-dafaa85c5679 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1521 microversion: 2.1 time: 0.157709 May 19 05:58:42.711546 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3737/7383] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:42 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:43.728418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-725899c5-7aac-4ddf-a5e2-fc8d30a1c035 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:43.728986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-725899c5-7aac-4ddf-a5e2-fc8d30a1c035 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:43.736909 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-725899c5-7aac-4ddf-a5e2-fc8d30a1c035 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:43.737410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-725899c5-7aac-4ddf-a5e2-fc8d30a1c035 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:43.738205 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-725899c5-7aac-4ddf-a5e2-fc8d30a1c035 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:43.738654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-725899c5-7aac-4ddf-a5e2-fc8d30a1c035 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:43.893532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-725899c5-7aac-4ddf-a5e2-fc8d30a1c035 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:43.905173 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-725899c5-7aac-4ddf-a5e2-fc8d30a1c035 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1521 microversion: 2.1 time: 0.180811 May 19 05:58:43.906138 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3647/7384] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:43 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:44.923454 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6375a0a3-62a4-41bd-b305-44e859fc6d22 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:44.924229 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6375a0a3-62a4-41bd-b305-44e859fc6d22 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:44.932638 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6375a0a3-62a4-41bd-b305-44e859fc6d22 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:44.933224 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6375a0a3-62a4-41bd-b305-44e859fc6d22 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:44.934199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6375a0a3-62a4-41bd-b305-44e859fc6d22 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:44.934737 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6375a0a3-62a4-41bd-b305-44e859fc6d22 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:44.941365 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:58:45.437007 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6375a0a3-62a4-41bd-b305-44e859fc6d22 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:45.444586 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6375a0a3-62a4-41bd-b305-44e859fc6d22 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.525872 May 19 05:58:45.445188 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3738/7385] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:44 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:45.672738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-3d1a1b77-0908-4cce-9e97-807e84612d55 req-4ca06a3f-bcb7-4cc8-a828-3f3e4bea91d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a785bcf-806e-46cd-845f-338836aba0d5", "tag": "74c614f4-e25d-4fbf-8bcb-b5afb35255cc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:58:45.682053 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3d1a1b77-0908-4cce-9e97-807e84612d55 req-4ca06a3f-bcb7-4cc8-a828-3f3e4bea91d9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:45.682774 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-3d1a1b77-0908-4cce-9e97-807e84612d55 req-4ca06a3f-bcb7-4cc8-a828-3f3e4bea91d9 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:45.695185 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-3d1a1b77-0908-4cce-9e97-807e84612d55 req-4ca06a3f-bcb7-4cc8-a828-3f3e4bea91d9 service nova] Creating event network-changed:74c614f4-e25d-4fbf-8bcb-b5afb35255cc for instance 9a785bcf-806e-46cd-845f-338836aba0d5 on n-h2-766726-30 May 19 05:58:45.700415 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-3d1a1b77-0908-4cce-9e97-807e84612d55 req-4ca06a3f-bcb7-4cc8-a828-3f3e4bea91d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109905 May 19 05:58:45.701228 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3648/7386] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:58:46.462410 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-77e3d8c4-d370-4acf-bc3d-25c51f5b0bb5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:46.463211 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-77e3d8c4-d370-4acf-bc3d-25c51f5b0bb5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:46.465915 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=33 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:58:46.471201 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77e3d8c4-d370-4acf-bc3d-25c51f5b0bb5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:46.471660 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77e3d8c4-d370-4acf-bc3d-25c51f5b0bb5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:46.472425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77e3d8c4-d370-4acf-bc3d-25c51f5b0bb5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:46.472873 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-77e3d8c4-d370-4acf-bc3d-25c51f5b0bb5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:46.686942 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-77e3d8c4-d370-4acf-bc3d-25c51f5b0bb5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:46.695458 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-77e3d8c4-d370-4acf-bc3d-25c51f5b0bb5 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.236986 May 19 05:58:46.696238 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3739/7387] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:46 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:47.713383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-adf260d7-9d33-4bf2-a6d5-9b980badb744 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:47.714125 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-adf260d7-9d33-4bf2-a6d5-9b980badb744 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:47.717578 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=31 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:58:47.723537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adf260d7-9d33-4bf2-a6d5-9b980badb744 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:47.723994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adf260d7-9d33-4bf2-a6d5-9b980badb744 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:47.724804 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adf260d7-9d33-4bf2-a6d5-9b980badb744 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:47.725288 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-adf260d7-9d33-4bf2-a6d5-9b980badb744 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:47.729398 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=87 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 05:58:47.859175 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-adf260d7-9d33-4bf2-a6d5-9b980badb744 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:47.866769 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-adf260d7-9d33-4bf2-a6d5-9b980badb744 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.158010 May 19 05:58:47.867342 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3649/7388] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:47 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:48.884246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-63ac87d5-11b9-4bc0-a3fb-943ca5924a18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:48.884887 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-63ac87d5-11b9-4bc0-a3fb-943ca5924a18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:48.891567 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63ac87d5-11b9-4bc0-a3fb-943ca5924a18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:48.892032 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63ac87d5-11b9-4bc0-a3fb-943ca5924a18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:48.892814 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63ac87d5-11b9-4bc0-a3fb-943ca5924a18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:48.893301 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63ac87d5-11b9-4bc0-a3fb-943ca5924a18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:49.020378 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-63ac87d5-11b9-4bc0-a3fb-943ca5924a18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:49.027904 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-63ac87d5-11b9-4bc0-a3fb-943ca5924a18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.148554 May 19 05:58:49.028484 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3740/7389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:48 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:50.045105 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-281540f0-f4c2-47b2-b486-b4b23cff2457 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:50.045733 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-281540f0-f4c2-47b2-b486-b4b23cff2457 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:50.052391 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-281540f0-f4c2-47b2-b486-b4b23cff2457 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:50.052850 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-281540f0-f4c2-47b2-b486-b4b23cff2457 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:50.054005 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-281540f0-f4c2-47b2-b486-b4b23cff2457 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:50.054455 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-281540f0-f4c2-47b2-b486-b4b23cff2457 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:50.186108 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-281540f0-f4c2-47b2-b486-b4b23cff2457 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:50.193892 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-281540f0-f4c2-47b2-b486-b4b23cff2457 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.152949 May 19 05:58:50.194476 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3650/7390] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:50 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:51.211568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3ae99f63-7888-4c51-9ed9-e5689ae91e75 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:51.212227 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3ae99f63-7888-4c51-9ed9-e5689ae91e75 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:51.219517 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ae99f63-7888-4c51-9ed9-e5689ae91e75 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:51.219982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ae99f63-7888-4c51-9ed9-e5689ae91e75 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:51.220758 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ae99f63-7888-4c51-9ed9-e5689ae91e75 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:51.221320 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3ae99f63-7888-4c51-9ed9-e5689ae91e75 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:51.349307 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3ae99f63-7888-4c51-9ed9-e5689ae91e75 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:51.356960 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3ae99f63-7888-4c51-9ed9-e5689ae91e75 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.149367 May 19 05:58:51.357589 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3741/7391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:51 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:52.374464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ced14a32-e36f-44c3-9a6e-f0bf09ca7916 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:52.375081 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ced14a32-e36f-44c3-9a6e-f0bf09ca7916 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:52.382123 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ced14a32-e36f-44c3-9a6e-f0bf09ca7916 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:52.382596 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ced14a32-e36f-44c3-9a6e-f0bf09ca7916 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:52.383358 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ced14a32-e36f-44c3-9a6e-f0bf09ca7916 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:52.383813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ced14a32-e36f-44c3-9a6e-f0bf09ca7916 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:52.518399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ced14a32-e36f-44c3-9a6e-f0bf09ca7916 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:52.525900 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ced14a32-e36f-44c3-9a6e-f0bf09ca7916 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.155996 May 19 05:58:52.526488 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3651/7392] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:52 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:53.543897 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-12d58052-02a5-4e28-bc3f-e4f9b66f119a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:53.544534 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-12d58052-02a5-4e28-bc3f-e4f9b66f119a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:53.553725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12d58052-02a5-4e28-bc3f-e4f9b66f119a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:53.554199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12d58052-02a5-4e28-bc3f-e4f9b66f119a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:53.554984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12d58052-02a5-4e28-bc3f-e4f9b66f119a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:53.555442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-12d58052-02a5-4e28-bc3f-e4f9b66f119a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:53.699841 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-12d58052-02a5-4e28-bc3f-e4f9b66f119a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:53.707551 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-12d58052-02a5-4e28-bc3f-e4f9b66f119a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.168302 May 19 05:58:53.708201 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3742/7393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:53 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:54.725602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3c9de8bd-ffd2-4372-841a-573a7ce6fc71 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:54.726318 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-3c9de8bd-ffd2-4372-841a-573a7ce6fc71 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:54.733876 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c9de8bd-ffd2-4372-841a-573a7ce6fc71 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:54.734255 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c9de8bd-ffd2-4372-841a-573a7ce6fc71 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:54.735021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c9de8bd-ffd2-4372-841a-573a7ce6fc71 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:54.735462 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-3c9de8bd-ffd2-4372-841a-573a7ce6fc71 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:54.868908 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-3c9de8bd-ffd2-4372-841a-573a7ce6fc71 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:54.876508 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3c9de8bd-ffd2-4372-841a-573a7ce6fc71 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.154862 May 19 05:58:54.877100 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3652/7394] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:54 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:55.894107 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-98ac2946-dab0-4475-8b7b-97c54762f0b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:55.894749 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-98ac2946-dab0-4475-8b7b-97c54762f0b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:55.901747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98ac2946-dab0-4475-8b7b-97c54762f0b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:55.902207 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98ac2946-dab0-4475-8b7b-97c54762f0b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:55.903489 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98ac2946-dab0-4475-8b7b-97c54762f0b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:55.903935 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-98ac2946-dab0-4475-8b7b-97c54762f0b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:56.039765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-98ac2946-dab0-4475-8b7b-97c54762f0b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:56.047356 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-98ac2946-dab0-4475-8b7b-97c54762f0b8 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.157296 May 19 05:58:56.047927 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3743/7395] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:55 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:56.328849 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-5a7c2669-de9f-482f-a867-b3a9a8c1a258 req-bd7ca552-854b-4372-b84c-bc2c7fa8de74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a785bcf-806e-46cd-845f-338836aba0d5", "name": "network-vif-plugged", "status": "completed", "tag": "74c614f4-e25d-4fbf-8bcb-b5afb35255cc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 05:58:56.337301 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5a7c2669-de9f-482f-a867-b3a9a8c1a258 req-bd7ca552-854b-4372-b84c-bc2c7fa8de74 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:56.338032 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-5a7c2669-de9f-482f-a867-b3a9a8c1a258 req-bd7ca552-854b-4372-b84c-bc2c7fa8de74 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:56.349784 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-5a7c2669-de9f-482f-a867-b3a9a8c1a258 req-bd7ca552-854b-4372-b84c-bc2c7fa8de74 service nova] Creating event network-vif-plugged:74c614f4-e25d-4fbf-8bcb-b5afb35255cc for instance 9a785bcf-806e-46cd-845f-338836aba0d5 on n-h2-766726-30 May 19 05:58:56.354799 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-5a7c2669-de9f-482f-a867-b3a9a8c1a258 req-bd7ca552-854b-4372-b84c-bc2c7fa8de74 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084667 May 19 05:58:56.355387 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3653/7396] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 05:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 05:58:57.064930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-4aeb01e2-3fa5-4256-9a80-017440adfbf6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:57.065587 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-4aeb01e2-3fa5-4256-9a80-017440adfbf6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:57.072745 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aeb01e2-3fa5-4256-9a80-017440adfbf6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:57.073248 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aeb01e2-3fa5-4256-9a80-017440adfbf6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:57.074036 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aeb01e2-3fa5-4256-9a80-017440adfbf6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:57.074494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-4aeb01e2-3fa5-4256-9a80-017440adfbf6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:57.205403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-4aeb01e2-3fa5-4256-9a80-017440adfbf6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:57.213311 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-4aeb01e2-3fa5-4256-9a80-017440adfbf6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1577 microversion: 2.1 time: 0.152089 May 19 05:58:57.213897 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3744/7397] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:57 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 05:58:58.231808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ef39712b-6e5e-4671-a4fb-da002b763b18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 05:58:58.232516 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ef39712b-6e5e-4671-a4fb-da002b763b18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 05:58:58.238787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef39712b-6e5e-4671-a4fb-da002b763b18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:58.239239 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef39712b-6e5e-4671-a4fb-da002b763b18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:58.240009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef39712b-6e5e-4671-a4fb-da002b763b18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 05:58:58.240449 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ef39712b-6e5e-4671-a4fb-da002b763b18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 05:58:58.383464 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-ef39712b-6e5e-4671-a4fb-da002b763b18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 05:58:58.391665 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ef39712b-6e5e-4671-a4fb-da002b763b18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1564 microversion: 2.1 time: 0.165561 May 19 05:58:58.392242 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3654/7398] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 05:58:58 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:11.905433 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=11 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:11.906525 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=40 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:11.910752 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-d536bf6a-a856-4bc8-a2d5-9cb4870c21e6 req-33ba0bcd-f08f-4608-a8bc-31b707b4e5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a785bcf-806e-46cd-845f-338836aba0d5", "tag": "74c614f4-e25d-4fbf-8bcb-b5afb35255cc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:00:11.914778 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=11 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:11.915554 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=31 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:11.917862 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-26dfd0c9-8628-4abe-9cec-be90118a8ac6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:11.918441 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-26dfd0c9-8628-4abe-9cec-be90118a8ac6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:11.927680 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d536bf6a-a856-4bc8-a2d5-9cb4870c21e6 req-33ba0bcd-f08f-4608-a8bc-31b707b4e5a2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:11.928128 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-d536bf6a-a856-4bc8-a2d5-9cb4870c21e6 req-33ba0bcd-f08f-4608-a8bc-31b707b4e5a2 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:11.933206 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26dfd0c9-8628-4abe-9cec-be90118a8ac6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:11.933680 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26dfd0c9-8628-4abe-9cec-be90118a8ac6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:11.934466 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26dfd0c9-8628-4abe-9cec-be90118a8ac6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:11.934921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-26dfd0c9-8628-4abe-9cec-be90118a8ac6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:11.947848 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-d536bf6a-a856-4bc8-a2d5-9cb4870c21e6 req-33ba0bcd-f08f-4608-a8bc-31b707b4e5a2 service nova] Creating event network-changed:74c614f4-e25d-4fbf-8bcb-b5afb35255cc for instance 9a785bcf-806e-46cd-845f-338836aba0d5 on n-h2-766726-30 May 19 06:00:11.953119 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-d536bf6a-a856-4bc8-a2d5-9cb4870c21e6 req-33ba0bcd-f08f-4608-a8bc-31b707b4e5a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052417 May 19 06:00:11.954593 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3655/7399] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:00:11.963521 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-26dfd0c9-8628-4abe-9cec-be90118a8ac6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:00:12.052370 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-26dfd0c9-8628-4abe-9cec-be90118a8ac6 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 204 len: 0 microversion: 2.1 time: 0.154634 May 19 06:00:12.056869 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3745/7400] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 06:00:11 2022] DELETE /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:00:12.066603 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c442a3df-a3ad-4cf6-aa7d-1c088cb095d9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:12.067615 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c442a3df-a3ad-4cf6-aa7d-1c088cb095d9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:12.074948 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c442a3df-a3ad-4cf6-aa7d-1c088cb095d9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:12.075762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c442a3df-a3ad-4cf6-aa7d-1c088cb095d9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:12.076689 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c442a3df-a3ad-4cf6-aa7d-1c088cb095d9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:12.077257 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c442a3df-a3ad-4cf6-aa7d-1c088cb095d9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:12.233311 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c442a3df-a3ad-4cf6-aa7d-1c088cb095d9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:12.241045 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c442a3df-a3ad-4cf6-aa7d-1c088cb095d9 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.182193 May 19 06:00:12.241639 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3656/7401] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:12 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:13.259722 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-383e254a-9731-4dc7-805c-83759b1acb62 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:13.260490 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-383e254a-9731-4dc7-805c-83759b1acb62 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:13.268066 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-383e254a-9731-4dc7-805c-83759b1acb62 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:13.268537 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-383e254a-9731-4dc7-805c-83759b1acb62 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:13.269363 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-383e254a-9731-4dc7-805c-83759b1acb62 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:13.269822 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-383e254a-9731-4dc7-805c-83759b1acb62 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:13.406559 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-383e254a-9731-4dc7-805c-83759b1acb62 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:13.414793 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-383e254a-9731-4dc7-805c-83759b1acb62 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1570 microversion: 2.1 time: 0.159359 May 19 06:00:13.415309 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3746/7402] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:13 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:00:13.985795 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-56b92840-8ca7-4207-a5d1-48716f15afb0 req-e5bc3de4-78d8-4426-968e-7a6c3687dd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a785bcf-806e-46cd-845f-338836aba0d5", "name": "network-vif-deleted", "tag": "74c614f4-e25d-4fbf-8bcb-b5afb35255cc"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:00:13.997489 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-56b92840-8ca7-4207-a5d1-48716f15afb0 req-e5bc3de4-78d8-4426-968e-7a6c3687dd09 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:13.997940 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-56b92840-8ca7-4207-a5d1-48716f15afb0 req-e5bc3de4-78d8-4426-968e-7a6c3687dd09 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:14.010222 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-56b92840-8ca7-4207-a5d1-48716f15afb0 req-e5bc3de4-78d8-4426-968e-7a6c3687dd09 service nova] Creating event network-vif-deleted:74c614f4-e25d-4fbf-8bcb-b5afb35255cc for instance 9a785bcf-806e-46cd-845f-338836aba0d5 on n-h2-766726-30 May 19 06:00:14.015100 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-56b92840-8ca7-4207-a5d1-48716f15afb0 req-e5bc3de4-78d8-4426-968e-7a6c3687dd09 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033179 May 19 06:00:14.015701 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3657/7403] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:00:14.431968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-29468cb8-997b-43c7-abed-1a932eae119c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:14.432691 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-29468cb8-997b-43c7-abed-1a932eae119c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:14.440425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29468cb8-997b-43c7-abed-1a932eae119c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:14.440967 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29468cb8-997b-43c7-abed-1a932eae119c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:14.441843 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29468cb8-997b-43c7-abed-1a932eae119c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:14.442373 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-29468cb8-997b-43c7-abed-1a932eae119c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:14.507560 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-29468cb8-997b-43c7-abed-1a932eae119c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:14.515232 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-29468cb8-997b-43c7-abed-1a932eae119c tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1220 microversion: 2.1 time: 0.087227 May 19 06:00:14.516715 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3747/7404] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:14 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:15.532496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-e5e902a1-8c49-436c-b36c-79be2aa56a8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:15.533226 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-e5e902a1-8c49-436c-b36c-79be2aa56a8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:15.540399 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5e902a1-8c49-436c-b36c-79be2aa56a8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:15.540851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5e902a1-8c49-436c-b36c-79be2aa56a8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:15.541644 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5e902a1-8c49-436c-b36c-79be2aa56a8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:15.542100 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-e5e902a1-8c49-436c-b36c-79be2aa56a8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:15.606012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-e5e902a1-8c49-436c-b36c-79be2aa56a8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:15.613783 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-e5e902a1-8c49-436c-b36c-79be2aa56a8d tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1220 microversion: 2.1 time: 0.085681 May 19 06:00:15.614451 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3658/7405] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:15 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:16.630801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5c48a460-bce2-4932-9e51-200b1ca64059 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:16.631434 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5c48a460-bce2-4932-9e51-200b1ca64059 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:16.638408 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c48a460-bce2-4932-9e51-200b1ca64059 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:16.638877 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c48a460-bce2-4932-9e51-200b1ca64059 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:16.639656 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c48a460-bce2-4932-9e51-200b1ca64059 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:16.640110 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5c48a460-bce2-4932-9e51-200b1ca64059 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:16.702565 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5c48a460-bce2-4932-9e51-200b1ca64059 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:16.710330 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5c48a460-bce2-4932-9e51-200b1ca64059 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1220 microversion: 2.1 time: 0.083564 May 19 06:00:16.710916 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3748/7406] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:16 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:17.727718 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-befe0305-6275-431c-acaf-ec1618b8c02a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:17.728694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-befe0305-6275-431c-acaf-ec1618b8c02a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:17.735973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-befe0305-6275-431c-acaf-ec1618b8c02a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:17.736496 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-befe0305-6275-431c-acaf-ec1618b8c02a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:17.737360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-befe0305-6275-431c-acaf-ec1618b8c02a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:17.737867 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-befe0305-6275-431c-acaf-ec1618b8c02a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:17.803355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-befe0305-6275-431c-acaf-ec1618b8c02a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:17.811683 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-befe0305-6275-431c-acaf-ec1618b8c02a tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1220 microversion: 2.1 time: 0.087753 May 19 06:00:17.812584 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3659/7407] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:17 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:18.828102 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-3e404d3b-588d-4be9-90c2-2ec649649891 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:18.829447 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-3e404d3b-588d-4be9-90c2-2ec649649891 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:18.836980 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e404d3b-588d-4be9-90c2-2ec649649891 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:18.837568 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e404d3b-588d-4be9-90c2-2ec649649891 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:18.838364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e404d3b-588d-4be9-90c2-2ec649649891 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:18.839017 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-3e404d3b-588d-4be9-90c2-2ec649649891 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:18.908509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-3e404d3b-588d-4be9-90c2-2ec649649891 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:18.916631 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-3e404d3b-588d-4be9-90c2-2ec649649891 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1220 microversion: 2.1 time: 0.092568 May 19 06:00:18.917444 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3749/7408] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:18 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:19.934541 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-cc0de7cc-4eee-4096-b5e7-151d1c0a6cde tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:19.935171 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-cc0de7cc-4eee-4096-b5e7-151d1c0a6cde tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:19.941466 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc0de7cc-4eee-4096-b5e7-151d1c0a6cde tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:19.941929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc0de7cc-4eee-4096-b5e7-151d1c0a6cde tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:19.942708 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc0de7cc-4eee-4096-b5e7-151d1c0a6cde tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:19.943151 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-cc0de7cc-4eee-4096-b5e7-151d1c0a6cde tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:20.006141 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-cc0de7cc-4eee-4096-b5e7-151d1c0a6cde tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:20.013933 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-cc0de7cc-4eee-4096-b5e7-151d1c0a6cde tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1220 microversion: 2.1 time: 0.083725 May 19 06:00:20.014813 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3660/7409] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:19 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:21.030919 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-eefa5864-53eb-47bd-89ec-7b4865b91261 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:21.031509 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-eefa5864-53eb-47bd-89ec-7b4865b91261 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:21.038972 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eefa5864-53eb-47bd-89ec-7b4865b91261 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:21.039455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eefa5864-53eb-47bd-89ec-7b4865b91261 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:21.040280 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eefa5864-53eb-47bd-89ec-7b4865b91261 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:21.040735 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-eefa5864-53eb-47bd-89ec-7b4865b91261 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:21.106725 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-eefa5864-53eb-47bd-89ec-7b4865b91261 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:21.114777 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-eefa5864-53eb-47bd-89ec-7b4865b91261 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1220 microversion: 2.1 time: 0.087880 May 19 06:00:21.115378 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3750/7410] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:21 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:22.132324 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-56abac05-1be2-4c43-ac4b-40da87984f18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:22.132950 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-56abac05-1be2-4c43-ac4b-40da87984f18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:22.140221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56abac05-1be2-4c43-ac4b-40da87984f18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:22.140676 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56abac05-1be2-4c43-ac4b-40da87984f18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:22.141517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56abac05-1be2-4c43-ac4b-40da87984f18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:22.141966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-56abac05-1be2-4c43-ac4b-40da87984f18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:22.203835 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-56abac05-1be2-4c43-ac4b-40da87984f18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:22.211543 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-56abac05-1be2-4c43-ac4b-40da87984f18 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1220 microversion: 2.1 time: 0.083236 May 19 06:00:22.212508 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3661/7411] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:22 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:23.227933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:23.228467 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:23.235694 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:23.236161 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:23.236940 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:23.237424 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:23.270474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:23.270939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:23.271401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lazy-loading 'fault' on Instance uuid 9a785bcf-806e-46cd-845f-338836aba0d5 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:00:23.316245 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098da32b9a6042e7a194646bc55b3b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da66e528ba9a476195feb5b930ead704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:23.324712 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e49b671-3afa-461a-97ef-25655a92c7ae tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 200 len: 1225 microversion: 2.1 time: 0.100775 May 19 06:00:23.325496 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3751/7412] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:23 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:24.342789 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:24.343420 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] [instance: 9a785bcf-806e-46cd-845f-338836aba0d5] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:24.351074 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:24.351534 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:24.352307 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:24.352754 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:24.365996 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] HTTP exception thrown: Instance 9a785bcf-806e-46cd-845f-338836aba0d5 could not be found. May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Request method failure captured: May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 HTTP/1.1 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihdrU8CJ_81H4CpyNEQKJpEm9k4feUZY7xr8OoqKqzd97TXZHlMVISNXzaKmjCf3K4_RWBjnYlh4kAFs2E62JnAjYGPTr0OqOBm5QwTLFYCVXXuPYoNWUk8_WI0m_iUyrIDwtxmE3NuEzBofvSs0s8IQv4_7DAzjCDb_5od8ZnrNtyPY May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: da66e528ba9a476195feb5b930ead704 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestShelveInstance-1441310845 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/da66e528ba9a476195feb5b930ead704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da66e528ba9a476195feb5b930ead704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/da66e528ba9a476195feb5b930ead704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_da66e528ba9a476195feb5b930ead704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestShelveInstance-1441310845 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: da66e528ba9a476195feb5b930ead704 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestShelveInstance-1441310845 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestShelveInstance-1441310845-project May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: 098da32b9a6042e7a194646bc55b3b68 May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestShelveInstance-1441310845-project May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 9a785bcf-806e-46cd-845f-338836aba0d5 could not be found. May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '9a785bcf-806e-46cd-845f-338836aba0d5'} May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a785bcf-806e-46cd-845f-338836aba0d5 could not be found. May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a785bcf-806e-46cd-845f-338836aba0d5 could not be found. May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:00:24.367645 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a785bcf-806e-46cd-845f-338836aba0d5 could not be found. May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Returning 404 to user: Instance 9a785bcf-806e-46cd-845f-338836aba0d5 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b97d8bb3-d6cd-4994-89fd-a3efc7f8da33 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5" status: 404 len: 111 microversion: 2.1 time: 0.030353 May 19 06:00:24.372801 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3662/7413] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:24 2022] GET /compute/v2.1/servers/9a785bcf-806e-46cd-845f-338836aba0d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:00:24.537390 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6e02981f-da8d-46aa-8672-8bf93e9029e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] Calling method '.version_select at 0x7fd314b11940>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:24.575798 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6e02981f-da8d-46aa-8672-8bf93e9029e0 tempest-TestShelveInstance-1441310845 tempest-TestShelveInstance-1441310845-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1963667414" status: 202 len: 0 microversion: 2.1 time: 0.040895 May 19 06:00:24.576919 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3752/7414] 10.222.0.58 () {58 vars in 1253 bytes} [Thu May 19 06:00:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1963667414 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:00:42.020052 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=16 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:42.020803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=36 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:42.200813 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-3eea7823-a388-4bcc-aa8a-b12e62f9e668 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Action: 'create', calling method: .version_select at 0x7fd31b804310>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-315568684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2yNE0P0nfMeut92RLiCHnSlucueWqN5ATXKJcmc+sBDpWJqBEPnFEBYhOO/7SfjEOld0wEUAkG8GD4QHtEUylXQM4eqv3JwBneCe1KMVfdYN9p0Y27QI4XH7xNmXzc2Q=="}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:00:42.219284 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3eea7823-a388-4bcc-aa8a-b12e62f9e668 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Getting quotas for project 1bfe5ef752e146298465d8e3d56cf43e. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:00:42.226808 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-3eea7823-a388-4bcc-aa8a-b12e62f9e668 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Getting quotas for user ff2208476e8649e8b40f69329abfb845 and project 1bfe5ef752e146298465d8e3d56cf43e. Resources: {'key_pairs'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:00:42.259060 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-3eea7823-a388-4bcc-aa8a-b12e62f9e668 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.244995 May 19 06:00:42.259766 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3663/7415] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 19 06:00:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:00:43.231021 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:43.231912 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:43.236951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1151540125", "imageRef": "a784e77f-4241-416d-b5b0-40834f7e24eb", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-315568684", "security_groups": [{"name": "tempest-secgroup-smoke-950877843"}], "networks": [{"uuid": "9c594b86-8116-4d94-9e78-1406fb869d27"}]}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:00:43.443456 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.network.neutron [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] validate_networks() for [('9c594b86-8116-4d94-9e78-1406fb869d27', None, None, None, None, None)] {{(pid=124818) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:00:43.827893 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Flavor limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:00:43.828339 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Image limits 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:00:43.828835 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Flavor pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:00:43.829296 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Image pref 0:0:0 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:00:43.829755 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.virt.hardware [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124818) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:00:43.839115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:43.839514 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:43.840333 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:43.840801 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:43.858187 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Getting quotas for project 1bfe5ef752e146298465d8e3d56cf43e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:00:43.864199 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.quota [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Getting quotas for user ff2208476e8649e8b40f69329abfb845 and project 1bfe5ef752e146298465d8e3d56cf43e. Resources: {'ram', 'instances', 'cores'} {{(pid=124818) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:00:43.877294 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Going to run 1 instances... {{(pid=124818) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:00:43.879615 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a784e77f-4241-416d-b5b0-40834f7e24eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124818) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:00:43.927879 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-2b7d71ba-6cb3-45d3-b7b7-16e21e05831a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.699902 May 19 06:00:43.933495 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3753/7416] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 06:00:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:00:43.940024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9ee70a72-263a-4b2e-b07d-a5ffcf7fc298 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:43.940803 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9ee70a72-263a-4b2e-b07d-a5ffcf7fc298 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:44.123360 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-9ee70a72-263a-4b2e-b07d-a5ffcf7fc298 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:44.131854 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9ee70a72-263a-4b2e-b07d-a5ffcf7fc298 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1248 microversion: 2.1 time: 0.197067 May 19 06:00:44.132697 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3664/7417] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:43 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1248 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:45.150884 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-5ece2292-8147-4356-b518-413a7567e2c0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:45.151450 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-5ece2292-8147-4356-b518-413a7567e2c0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:45.158949 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ece2292-8147-4356-b518-413a7567e2c0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:45.159425 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ece2292-8147-4356-b518-413a7567e2c0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:45.160238 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ece2292-8147-4356-b518-413a7567e2c0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:45.160697 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-5ece2292-8147-4356-b518-413a7567e2c0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:45.268917 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-5ece2292-8147-4356-b518-413a7567e2c0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:45.278192 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-5ece2292-8147-4356-b518-413a7567e2c0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1306 microversion: 2.1 time: 0.132474 May 19 06:00:45.279114 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3754/7418] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:45 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1306 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:46.296034 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2d01ce1b-70b0-412c-b178-9194ae4a424f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:46.297070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2d01ce1b-70b0-412c-b178-9194ae4a424f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:46.305585 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d01ce1b-70b0-412c-b178-9194ae4a424f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:46.306165 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d01ce1b-70b0-412c-b178-9194ae4a424f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:46.307036 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d01ce1b-70b0-412c-b178-9194ae4a424f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:46.307485 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2d01ce1b-70b0-412c-b178-9194ae4a424f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:46.742753 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2d01ce1b-70b0-412c-b178-9194ae4a424f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:46.751033 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2d01ce1b-70b0-412c-b178-9194ae4a424f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1373 microversion: 2.1 time: 0.459039 May 19 06:00:46.751939 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3665/7419] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:46 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1373 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:46.891082 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-14e860a9-c109-4683-895b-ecb9e49c4733 req-3143db25-1496-4d2c-a816-088eeca0de1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cb9518-4c36-4552-a905-a2483c2cc795", "tag": "cb0e5339-fd51-4ca4-8653-a91ff1b174fe"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:00:46.909625 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-14e860a9-c109-4683-895b-ecb9e49c4733 req-3143db25-1496-4d2c-a816-088eeca0de1c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:46.910171 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-14e860a9-c109-4683-895b-ecb9e49c4733 req-3143db25-1496-4d2c-a816-088eeca0de1c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:46.933717 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-14e860a9-c109-4683-895b-ecb9e49c4733 req-3143db25-1496-4d2c-a816-088eeca0de1c service nova] Creating event network-changed:cb0e5339-fd51-4ca4-8653-a91ff1b174fe for instance 13cb9518-4c36-4552-a905-a2483c2cc795 on n-h2-766726-30 May 19 06:00:46.939363 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-14e860a9-c109-4683-895b-ecb9e49c4733 req-3143db25-1496-4d2c-a816-088eeca0de1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052640 May 19 06:00:46.940389 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3755/7420] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:00:47.768527 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-133095e9-45cc-4998-b59a-4b8145f96a34 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:47.769172 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-133095e9-45cc-4998-b59a-4b8145f96a34 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:47.776093 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-133095e9-45cc-4998-b59a-4b8145f96a34 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:47.776547 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-133095e9-45cc-4998-b59a-4b8145f96a34 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:47.777343 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-133095e9-45cc-4998-b59a-4b8145f96a34 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:47.777787 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-133095e9-45cc-4998-b59a-4b8145f96a34 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:47.907107 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-133095e9-45cc-4998-b59a-4b8145f96a34 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:47.914646 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-133095e9-45cc-4998-b59a-4b8145f96a34 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1373 microversion: 2.1 time: 0.150586 May 19 06:00:47.915237 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3666/7421] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:47 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:48.933653 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-08eefb6d-c88c-4768-9972-9d60ccab1c8c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:48.934455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-08eefb6d-c88c-4768-9972-9d60ccab1c8c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:48.941599 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08eefb6d-c88c-4768-9972-9d60ccab1c8c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:48.942086 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08eefb6d-c88c-4768-9972-9d60ccab1c8c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:48.942869 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08eefb6d-c88c-4768-9972-9d60ccab1c8c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:48.943317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-08eefb6d-c88c-4768-9972-9d60ccab1c8c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:49.081330 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-08eefb6d-c88c-4768-9972-9d60ccab1c8c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:49.089224 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-08eefb6d-c88c-4768-9972-9d60ccab1c8c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1373 microversion: 2.1 time: 0.161163 May 19 06:00:49.089831 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3756/7422] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:48 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:50.105812 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-a704d97f-0eba-4525-940c-93f0028408a7 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:50.106444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-a704d97f-0eba-4525-940c-93f0028408a7 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:50.112925 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a704d97f-0eba-4525-940c-93f0028408a7 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:50.113418 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a704d97f-0eba-4525-940c-93f0028408a7 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:50.114194 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a704d97f-0eba-4525-940c-93f0028408a7 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:50.114640 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-a704d97f-0eba-4525-940c-93f0028408a7 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:50.248444 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-a704d97f-0eba-4525-940c-93f0028408a7 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:50.256888 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-a704d97f-0eba-4525-940c-93f0028408a7 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1373 microversion: 2.1 time: 0.154959 May 19 06:00:50.257510 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3667/7423] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:50 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:50.876313 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-92656f03-55f1-4e4c-bd90-c3c2661bb291 req-3816ef7a-155e-41f1-81e2-a9437dd94955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cb9518-4c36-4552-a905-a2483c2cc795", "name": "network-vif-plugged", "status": "completed", "tag": "cb0e5339-fd51-4ca4-8653-a91ff1b174fe"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:00:50.886557 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-92656f03-55f1-4e4c-bd90-c3c2661bb291 req-3816ef7a-155e-41f1-81e2-a9437dd94955 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:50.887231 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-92656f03-55f1-4e4c-bd90-c3c2661bb291 req-3816ef7a-155e-41f1-81e2-a9437dd94955 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:50.901875 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-92656f03-55f1-4e4c-bd90-c3c2661bb291 req-3816ef7a-155e-41f1-81e2-a9437dd94955 service nova] Creating event network-vif-plugged:cb0e5339-fd51-4ca4-8653-a91ff1b174fe for instance 13cb9518-4c36-4552-a905-a2483c2cc795 on n-h2-766726-30 May 19 06:00:50.907443 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-92656f03-55f1-4e4c-bd90-c3c2661bb291 req-3816ef7a-155e-41f1-81e2-a9437dd94955 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035117 May 19 06:00:50.908063 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3757/7424] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:00:51.273935 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-901b5c89-d0ad-45f6-bb66-8e5c14572f6c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:51.274503 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-901b5c89-d0ad-45f6-bb66-8e5c14572f6c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:51.281685 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-901b5c89-d0ad-45f6-bb66-8e5c14572f6c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:51.282166 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-901b5c89-d0ad-45f6-bb66-8e5c14572f6c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:51.282974 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-901b5c89-d0ad-45f6-bb66-8e5c14572f6c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:51.283419 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-901b5c89-d0ad-45f6-bb66-8e5c14572f6c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:51.419775 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-901b5c89-d0ad-45f6-bb66-8e5c14572f6c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:51.427858 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-901b5c89-d0ad-45f6-bb66-8e5c14572f6c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1373 microversion: 2.1 time: 0.157903 May 19 06:00:51.428462 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3668/7425] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:51 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:52.445250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-6d1ab18b-bf52-4735-be81-207571c254bf tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:52.445888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-6d1ab18b-bf52-4735-be81-207571c254bf tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:52.452158 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d1ab18b-bf52-4735-be81-207571c254bf tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:52.452670 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d1ab18b-bf52-4735-be81-207571c254bf tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:52.453471 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d1ab18b-bf52-4735-be81-207571c254bf tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:52.453921 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-6d1ab18b-bf52-4735-be81-207571c254bf tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:52.582146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-6d1ab18b-bf52-4735-be81-207571c254bf tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:52.590631 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-6d1ab18b-bf52-4735-be81-207571c254bf tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1559 microversion: 2.1 time: 0.150625 May 19 06:00:52.591212 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3758/7426] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:52 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:52.607041 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-8911f16d-9d04-4d10-a7e2-1910c6fd2b9a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:00:52.607663 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-8911f16d-9d04-4d10-a7e2-1910c6fd2b9a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:00:52.616155 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8911f16d-9d04-4d10-a7e2-1910c6fd2b9a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:52.616602 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8911f16d-9d04-4d10-a7e2-1910c6fd2b9a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:52.617404 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8911f16d-9d04-4d10-a7e2-1910c6fd2b9a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:52.617842 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-8911f16d-9d04-4d10-a7e2-1910c6fd2b9a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:52.749403 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-8911f16d-9d04-4d10-a7e2-1910c6fd2b9a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:00:52.757284 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-8911f16d-9d04-4d10-a7e2-1910c6fd2b9a tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1559 microversion: 2.1 time: 0.154043 May 19 06:00:52.758278 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3669/7427] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:00:52 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:00:54.698573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:54.699426 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=6 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:00:54.757860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-4c12c671-d315-45be-af9d-17de6b01f56e req-08dc526d-4ae2-4c90-90c0-924727b7f54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cb9518-4c36-4552-a905-a2483c2cc795", "tag": "cb0e5339-fd51-4ca4-8653-a91ff1b174fe"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:00:54.767440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4c12c671-d315-45be-af9d-17de6b01f56e req-08dc526d-4ae2-4c90-90c0-924727b7f54a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:00:54.767962 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-4c12c671-d315-45be-af9d-17de6b01f56e req-08dc526d-4ae2-4c90-90c0-924727b7f54a service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:00:54.779170 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-4c12c671-d315-45be-af9d-17de6b01f56e req-08dc526d-4ae2-4c90-90c0-924727b7f54a service nova] Creating event network-changed:cb0e5339-fd51-4ca4-8653-a91ff1b174fe for instance 13cb9518-4c36-4552-a905-a2483c2cc795 on n-h2-766726-30 May 19 06:00:54.785053 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-4c12c671-d315-45be-af9d-17de6b01f56e req-08dc526d-4ae2-4c90-90c0-924727b7f54a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091539 May 19 06:00:54.785683 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3759/7428] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:01:29.923416 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:01:29.923970 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 06:01:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:02:50.923175 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11f4aea6-c176-403c-9633-d60098efd474] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 06:02:50.924059 n-d-766726-30 devstack@n-api.service[124819]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99e79aa7-a0e7-43bd-8544-8a0b9dce8b08] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 06:02:50.924433 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:02:50.925380 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:02:50.926023 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=30 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:02:50.930275 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-5135bc86-4828-4335-a5dd-26cb62c3cdfb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-572917959"}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:02:50.931355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-5135bc86-4828-4335-a5dd-26cb62c3cdfb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:02:50.939600 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5135bc86-4828-4335-a5dd-26cb62c3cdfb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:02:50.940558 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5135bc86-4828-4335-a5dd-26cb62c3cdfb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:02:50.941411 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5135bc86-4828-4335-a5dd-26cb62c3cdfb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:02:50.941853 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-5135bc86-4828-4335-a5dd-26cb62c3cdfb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:02:51.209056 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-5135bc86-4828-4335-a5dd-26cb62c3cdfb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "POST /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795/action" status: 202 len: 0 microversion: 2.1 time: 0.287673 May 19 06:02:51.209776 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3670/7429] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 06:02:50 2022] POST /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 19 06:02:55.632688 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [01022541-891f-4ef1-a973-f7b4510bbfd8] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 06:02:55.634120 n-d-766726-30 devstack@n-api.service[124818]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c2869c6-282b-4cce-84de-e63fb06fc5d4] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 06:02:55.634729 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:02:55.635800 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=26 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:02:55.645442 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [req-9aeaac9d-eee8-41db-936b-e23590ace007 req-6b7487f4-aa3b-4901-bdf6-4686c50e36ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cb9518-4c36-4552-a905-a2483c2cc795", "name": "network-vif-plugged", "status": "completed", "tag": "cb0e5339-fd51-4ca4-8653-a91ff1b174fe"}]} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:02:55.658327 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9aeaac9d-eee8-41db-936b-e23590ace007 req-6b7487f4-aa3b-4901-bdf6-4686c50e36ed service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:02:55.659204 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [req-9aeaac9d-eee8-41db-936b-e23590ace007 req-6b7487f4-aa3b-4901-bdf6-4686c50e36ed service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:02:55.673931 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.compute.server_external_events [req-9aeaac9d-eee8-41db-936b-e23590ace007 req-6b7487f4-aa3b-4901-bdf6-4686c50e36ed service nova] Creating event network-vif-plugged:cb0e5339-fd51-4ca4-8653-a91ff1b174fe for instance 13cb9518-4c36-4552-a905-a2483c2cc795 on n-h2-766726-30 May 19 06:02:55.680460 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [req-9aeaac9d-eee8-41db-936b-e23590ace007 req-6b7487f4-aa3b-4901-bdf6-4686c50e36ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049433 May 19 06:02:55.681573 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3760/7430] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:03:03.757612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:03:03.758395 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:03:03.763675 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1974603233", "imageRef": "e8ff9b34-b518-43fe-a12e-85f45b8151c4", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-315568684", "security_groups": [{"name": "tempest-secgroup-smoke-950877843"}], "networks": [{"uuid": "9c594b86-8116-4d94-9e78-1406fb869d27"}]}} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:03:03.789865 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] [11f4aea6-c176-403c-9633-d60098efd474] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 32786. May 19 06:03:03.790611 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] [99e79aa7-a0e7-43bd-8544-8a0b9dce8b08] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 32788. May 19 06:03:03.878072 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.network.neutron [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] validate_networks() for [('9c594b86-8116-4d94-9e78-1406fb869d27', None, None, None, None, None)] {{(pid=124819) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 06:03:04.304751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Flavor limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 06:03:04.305214 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Image limits 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 06:03:04.305700 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Flavor pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 06:03:04.306120 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Image pref 0:0:0 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 06:03:04.306555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.virt.hardware [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124819) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 06:03:04.315480 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:04.316447 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:04.317300 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:04.317748 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:04.335601 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Getting quotas for project 1bfe5ef752e146298465d8e3d56cf43e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 06:03:04.340929 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.quota [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Getting quotas for user ff2208476e8649e8b40f69329abfb845 and project 1bfe5ef752e146298465d8e3d56cf43e. Resources: {'ram', 'instances', 'cores'} {{(pid=124819) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 06:03:04.353254 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Going to run 1 instances... {{(pid=124819) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 06:03:04.355751 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e8ff9b34-b518-43fe-a12e-85f45b8151c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124819) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 06:03:04.404264 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-9e59459f-c9a0-42bb-a788-1f5e0aec421d tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.648753 May 19 06:03:04.404920 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3671/7431] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 19 06:03:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 06:03:04.415878 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1b247c7b-2860-447f-b1c3-5331a4314253 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:04.416681 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-1b247c7b-2860-447f-b1c3-5331a4314253 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:04.428303 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] [01022541-891f-4ef1-a973-f7b4510bbfd8] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 32802. May 19 06:03:04.437328 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c2869c6-282b-4cce-84de-e63fb06fc5d4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 32804. May 19 06:03:04.496488 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-1b247c7b-2860-447f-b1c3-5331a4314253 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:04.504206 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1b247c7b-2860-447f-b1c3-5331a4314253 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1248 microversion: 2.1 time: 0.092203 May 19 06:03:04.504785 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3761/7432] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:04 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:05.523715 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-656f8f1a-cc94-44c2-81fe-984ec38ff892 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:05.524336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-656f8f1a-cc94-44c2-81fe-984ec38ff892 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:05.530903 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-656f8f1a-cc94-44c2-81fe-984ec38ff892 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:05.531355 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-656f8f1a-cc94-44c2-81fe-984ec38ff892 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:05.532135 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-656f8f1a-cc94-44c2-81fe-984ec38ff892 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:05.532741 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-656f8f1a-cc94-44c2-81fe-984ec38ff892 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:05.606009 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-656f8f1a-cc94-44c2-81fe-984ec38ff892 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:05.614127 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-656f8f1a-cc94-44c2-81fe-984ec38ff892 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1306 microversion: 2.1 time: 0.096873 May 19 06:03:05.614886 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3672/7433] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:05 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:06.631221 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f92c33f7-2f40-425d-b734-e13d6eaa7432 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:06.631857 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f92c33f7-2f40-425d-b734-e13d6eaa7432 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:06.635169 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:03:06.641258 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f92c33f7-2f40-425d-b734-e13d6eaa7432 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:06.641751 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f92c33f7-2f40-425d-b734-e13d6eaa7432 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:06.642529 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f92c33f7-2f40-425d-b734-e13d6eaa7432 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:06.642982 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f92c33f7-2f40-425d-b734-e13d6eaa7432 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:06.786739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f92c33f7-2f40-425d-b734-e13d6eaa7432 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:06.796468 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f92c33f7-2f40-425d-b734-e13d6eaa7432 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.169144 May 19 06:03:06.797189 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3762/7434] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:06 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:07.676092 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-b6d08871-73a4-44e5-8ca3-b26ea5d3babd req-9c647e4e-5d3b-40dd-8295-2fbb478d68dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cb9518-4c36-4552-a905-a2483c2cc795", "name": "network-vif-unplugged", "status": "completed", "tag": "cb0e5339-fd51-4ca4-8653-a91ff1b174fe"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:03:07.685788 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b6d08871-73a4-44e5-8ca3-b26ea5d3babd req-9c647e4e-5d3b-40dd-8295-2fbb478d68dc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:07.686234 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-b6d08871-73a4-44e5-8ca3-b26ea5d3babd req-9c647e4e-5d3b-40dd-8295-2fbb478d68dc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:07.710708 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-b6d08871-73a4-44e5-8ca3-b26ea5d3babd req-9c647e4e-5d3b-40dd-8295-2fbb478d68dc service nova] Creating event network-vif-unplugged:cb0e5339-fd51-4ca4-8653-a91ff1b174fe for instance 13cb9518-4c36-4552-a905-a2483c2cc795 on n-h2-766726-30 May 19 06:03:07.715742 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-b6d08871-73a4-44e5-8ca3-b26ea5d3babd req-9c647e4e-5d3b-40dd-8295-2fbb478d68dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043597 May 19 06:03:07.716437 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3673/7435] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:03:07.815765 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be679f55-d99a-435f-81a8-af939f77f2e1 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:07.817016 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be679f55-d99a-435f-81a8-af939f77f2e1 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:07.823951 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be679f55-d99a-435f-81a8-af939f77f2e1 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:07.824415 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be679f55-d99a-435f-81a8-af939f77f2e1 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:07.825222 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be679f55-d99a-435f-81a8-af939f77f2e1 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:07.825677 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be679f55-d99a-435f-81a8-af939f77f2e1 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:07.969611 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be679f55-d99a-435f-81a8-af939f77f2e1 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:07.978011 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be679f55-d99a-435f-81a8-af939f77f2e1 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.166384 May 19 06:03:07.978585 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3763/7436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:07 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:08.995589 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-b6994aac-5d4c-4498-bce3-d34cc21b8786 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:08.996298 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-b6994aac-5d4c-4498-bce3-d34cc21b8786 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:09.003880 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6994aac-5d4c-4498-bce3-d34cc21b8786 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:09.004329 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6994aac-5d4c-4498-bce3-d34cc21b8786 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:09.005170 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6994aac-5d4c-4498-bce3-d34cc21b8786 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:09.005643 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-b6994aac-5d4c-4498-bce3-d34cc21b8786 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:09.103330 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 19 06:03:09.103925 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 06:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:03:09.158586 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-b6994aac-5d4c-4498-bce3-d34cc21b8786 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:09.166892 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-b6994aac-5d4c-4498-bce3-d34cc21b8786 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.175559 May 19 06:03:09.167471 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3674/7437] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:08 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:09.852787 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:03:09.853154 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 06:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:03:10.184282 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-9f6264c3-4c20-4761-80f0-d2ce1ca54f1f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:10.184954 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-9f6264c3-4c20-4761-80f0-d2ce1ca54f1f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:10.192589 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f6264c3-4c20-4761-80f0-d2ce1ca54f1f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:10.193056 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f6264c3-4c20-4761-80f0-d2ce1ca54f1f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:10.193858 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f6264c3-4c20-4761-80f0-d2ce1ca54f1f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:10.194314 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-9f6264c3-4c20-4761-80f0-d2ce1ca54f1f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:10.338572 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-9f6264c3-4c20-4761-80f0-d2ce1ca54f1f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:10.346580 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-9f6264c3-4c20-4761-80f0-d2ce1ca54f1f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.166407 May 19 06:03:10.347552 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3764/7438] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:10 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:11.363814 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-6e19e69e-915f-47da-b0a2-88f5dc62df0b tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:11.364423 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-6e19e69e-915f-47da-b0a2-88f5dc62df0b tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:11.371369 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e19e69e-915f-47da-b0a2-88f5dc62df0b tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:11.371819 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e19e69e-915f-47da-b0a2-88f5dc62df0b tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:11.372612 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e19e69e-915f-47da-b0a2-88f5dc62df0b tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:11.373048 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-6e19e69e-915f-47da-b0a2-88f5dc62df0b tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:11.511410 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-6e19e69e-915f-47da-b0a2-88f5dc62df0b tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:11.519914 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-6e19e69e-915f-47da-b0a2-88f5dc62df0b tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.159976 May 19 06:03:11.520827 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3675/7439] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:11 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:12.541817 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-a4bc8376-5aa2-421d-965d-2bb8d8c8f482 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:12.542872 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-a4bc8376-5aa2-421d-965d-2bb8d8c8f482 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:12.553131 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4bc8376-5aa2-421d-965d-2bb8d8c8f482 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:12.553604 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4bc8376-5aa2-421d-965d-2bb8d8c8f482 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:12.554401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4bc8376-5aa2-421d-965d-2bb8d8c8f482 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:12.554849 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-a4bc8376-5aa2-421d-965d-2bb8d8c8f482 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:12.700035 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-a4bc8376-5aa2-421d-965d-2bb8d8c8f482 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:12.708697 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-a4bc8376-5aa2-421d-965d-2bb8d8c8f482 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.171333 May 19 06:03:12.709532 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3765/7440] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:12 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:03:13.726712 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-2fcb70b0-66e0-4d71-9d93-fd9e310fe2c2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:13.727377 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-2fcb70b0-66e0-4d71-9d93-fd9e310fe2c2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:13.734605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fcb70b0-66e0-4d71-9d93-fd9e310fe2c2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:13.735082 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fcb70b0-66e0-4d71-9d93-fd9e310fe2c2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:13.735845 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fcb70b0-66e0-4d71-9d93-fd9e310fe2c2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:13.736281 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-2fcb70b0-66e0-4d71-9d93-fd9e310fe2c2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:13.866159 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-2fcb70b0-66e0-4d71-9d93-fd9e310fe2c2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:13.873823 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-2fcb70b0-66e0-4d71-9d93-fd9e310fe2c2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.151649 May 19 06:03:13.874392 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3676/7441] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:13 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:14.890598 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-072968dc-2a1b-4e9d-bc9b-954eb64ecff0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:14.891162 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-072968dc-2a1b-4e9d-bc9b-954eb64ecff0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:14.894976 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell0:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:03:14.900839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-072968dc-2a1b-4e9d-bc9b-954eb64ecff0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:14.901367 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-072968dc-2a1b-4e9d-bc9b-954eb64ecff0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:14.902198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-072968dc-2a1b-4e9d-bc9b-954eb64ecff0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:14.902733 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-072968dc-2a1b-4e9d-bc9b-954eb64ecff0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:15.114415 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-8957491c-6ffb-4b17-94f4-52967f8bbaf4 req-71c7fd0a-9ab5-42d4-a2c8-966659a645bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cac5c64-0f08-4c87-b111-50dfd9672a6a", "tag": "91dd256d-d415-4b04-a453-9c408e40361f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:03:15.120520 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=2 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:03:15.121567 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell0:SELECT=6 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:03:15.121705 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-072968dc-2a1b-4e9d-bc9b-954eb64ecff0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:15.132226 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-072968dc-2a1b-4e9d-bc9b-954eb64ecff0 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.245567 May 19 06:03:15.133436 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3766/7442] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:14 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:03:15.135654 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8957491c-6ffb-4b17-94f4-52967f8bbaf4 req-71c7fd0a-9ab5-42d4-a2c8-966659a645bb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:15.136879 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-8957491c-6ffb-4b17-94f4-52967f8bbaf4 req-71c7fd0a-9ab5-42d4-a2c8-966659a645bb service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:15.150745 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-8957491c-6ffb-4b17-94f4-52967f8bbaf4 req-71c7fd0a-9ab5-42d4-a2c8-966659a645bb service nova] Creating event network-changed:91dd256d-d415-4b04-a453-9c408e40361f for instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a on n-h1-766726-30 May 19 06:03:15.155842 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-8957491c-6ffb-4b17-94f4-52967f8bbaf4 req-71c7fd0a-9ab5-42d4-a2c8-966659a645bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045875 May 19 06:03:15.156886 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3677/7443] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:03:16.149839 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-63f3c206-8a9f-41e4-800d-b65413221ff2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:16.150474 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-63f3c206-8a9f-41e4-800d-b65413221ff2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:16.157349 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63f3c206-8a9f-41e4-800d-b65413221ff2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:16.157809 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63f3c206-8a9f-41e4-800d-b65413221ff2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:16.158576 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63f3c206-8a9f-41e4-800d-b65413221ff2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:16.159022 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-63f3c206-8a9f-41e4-800d-b65413221ff2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:16.287888 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-63f3c206-8a9f-41e4-800d-b65413221ff2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:16.295329 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-63f3c206-8a9f-41e4-800d-b65413221ff2 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.149540 May 19 06:03:16.295897 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3767/7444] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:16 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:17.313517 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-4db7453d-51fd-46b8-b4fe-78342455d7ec tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:17.314222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-4db7453d-51fd-46b8-b4fe-78342455d7ec tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:17.320532 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4db7453d-51fd-46b8-b4fe-78342455d7ec tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:17.320987 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4db7453d-51fd-46b8-b4fe-78342455d7ec tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:17.321828 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4db7453d-51fd-46b8-b4fe-78342455d7ec tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:17.322222 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-4db7453d-51fd-46b8-b4fe-78342455d7ec tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:17.454221 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-4db7453d-51fd-46b8-b4fe-78342455d7ec tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:17.462577 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-4db7453d-51fd-46b8-b4fe-78342455d7ec tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.154233 May 19 06:03:17.463158 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3678/7445] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:17 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:18.479696 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-af0d7eb6-16e5-46e8-8331-37dc114c799c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:18.480250 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-af0d7eb6-16e5-46e8-8331-37dc114c799c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:18.487462 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af0d7eb6-16e5-46e8-8331-37dc114c799c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:18.487931 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af0d7eb6-16e5-46e8-8331-37dc114c799c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:18.488713 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af0d7eb6-16e5-46e8-8331-37dc114c799c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:18.489198 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-af0d7eb6-16e5-46e8-8331-37dc114c799c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:18.622908 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-af0d7eb6-16e5-46e8-8331-37dc114c799c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:18.631156 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-af0d7eb6-16e5-46e8-8331-37dc114c799c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.155494 May 19 06:03:18.631821 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3768/7446] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:18 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:19.647189 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-0c626f9e-6c36-4bb2-85e5-d7f54eeb2698 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:19.647818 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-0c626f9e-6c36-4bb2-85e5-d7f54eeb2698 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:19.654833 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c626f9e-6c36-4bb2-85e5-d7f54eeb2698 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:19.655294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c626f9e-6c36-4bb2-85e5-d7f54eeb2698 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:19.656070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c626f9e-6c36-4bb2-85e5-d7f54eeb2698 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:19.656521 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-0c626f9e-6c36-4bb2-85e5-d7f54eeb2698 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:19.785354 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-0c626f9e-6c36-4bb2-85e5-d7f54eeb2698 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:19.792856 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-0c626f9e-6c36-4bb2-85e5-d7f54eeb2698 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.149629 May 19 06:03:19.793468 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3679/7447] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:19 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:20.810668 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-d440d4c8-4461-40ae-b54d-b59d802d8ff5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:20.811281 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-d440d4c8-4461-40ae-b54d-b59d802d8ff5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:20.819389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d440d4c8-4461-40ae-b54d-b59d802d8ff5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:20.819853 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d440d4c8-4461-40ae-b54d-b59d802d8ff5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:20.820788 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d440d4c8-4461-40ae-b54d-b59d802d8ff5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:20.821268 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-d440d4c8-4461-40ae-b54d-b59d802d8ff5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:20.959261 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-d440d4c8-4461-40ae-b54d-b59d802d8ff5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:20.968395 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-d440d4c8-4461-40ae-b54d-b59d802d8ff5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.161659 May 19 06:03:20.968985 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3769/7448] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:20 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:21.054068 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-c5cfb413-2db1-4371-8cdd-307a7ccbf5a1 req-cd77933e-02a1-4023-bf07-60214d611c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cac5c64-0f08-4c87-b111-50dfd9672a6a", "name": "network-vif-plugged", "status": "completed", "tag": "91dd256d-d415-4b04-a453-9c408e40361f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:03:21.063595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c5cfb413-2db1-4371-8cdd-307a7ccbf5a1 req-cd77933e-02a1-4023-bf07-60214d611c75 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:21.064035 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-c5cfb413-2db1-4371-8cdd-307a7ccbf5a1 req-cd77933e-02a1-4023-bf07-60214d611c75 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:21.078244 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-c5cfb413-2db1-4371-8cdd-307a7ccbf5a1 req-cd77933e-02a1-4023-bf07-60214d611c75 service nova] Creating event network-vif-plugged:91dd256d-d415-4b04-a453-9c408e40361f for instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a on n-h1-766726-30 May 19 06:03:21.084051 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-c5cfb413-2db1-4371-8cdd-307a7ccbf5a1 req-cd77933e-02a1-4023-bf07-60214d611c75 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034335 May 19 06:03:21.085111 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3680/7449] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:03:21.985939 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-df146e0b-1b16-4971-a3fa-6d4c785a41e3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:21.986573 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-df146e0b-1b16-4971-a3fa-6d4c785a41e3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:21.994151 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df146e0b-1b16-4971-a3fa-6d4c785a41e3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:21.994624 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df146e0b-1b16-4971-a3fa-6d4c785a41e3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:21.995401 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df146e0b-1b16-4971-a3fa-6d4c785a41e3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:21.995855 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-df146e0b-1b16-4971-a3fa-6d4c785a41e3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:22.125718 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-df146e0b-1b16-4971-a3fa-6d4c785a41e3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:22.133780 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-df146e0b-1b16-4971-a3fa-6d4c785a41e3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1373 microversion: 2.1 time: 0.151814 May 19 06:03:22.134361 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3770/7450] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:21 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:23.151409 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-36c918cb-b96d-4fb6-8a0e-1249bb5a63b3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:23.152483 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-36c918cb-b96d-4fb6-8a0e-1249bb5a63b3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:23.159691 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36c918cb-b96d-4fb6-8a0e-1249bb5a63b3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:23.160143 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36c918cb-b96d-4fb6-8a0e-1249bb5a63b3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:23.160906 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36c918cb-b96d-4fb6-8a0e-1249bb5a63b3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:23.161383 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-36c918cb-b96d-4fb6-8a0e-1249bb5a63b3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:23.295012 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-36c918cb-b96d-4fb6-8a0e-1249bb5a63b3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:23.302672 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-36c918cb-b96d-4fb6-8a0e-1249bb5a63b3 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1558 microversion: 2.1 time: 0.155563 May 19 06:03:23.303255 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3681/7451] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:23 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:23.319289 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-82c51660-95ed-4e45-9d96-f8fed23fd8eb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:03:23.319930 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-82c51660-95ed-4e45-9d96-f8fed23fd8eb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:03:23.326984 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c51660-95ed-4e45-9d96-f8fed23fd8eb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:23.327455 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c51660-95ed-4e45-9d96-f8fed23fd8eb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:23.328254 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c51660-95ed-4e45-9d96-f8fed23fd8eb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:23.328717 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-82c51660-95ed-4e45-9d96-f8fed23fd8eb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:23.461819 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-82c51660-95ed-4e45-9d96-f8fed23fd8eb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:03:23.469331 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-82c51660-95ed-4e45-9d96-f8fed23fd8eb tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1558 microversion: 2.1 time: 0.154400 May 19 06:03:23.469919 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3771/7452] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:03:23 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:03:25.057584 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-bf5a2152-8be3-49cb-a938-616d6f842b5e req-854060f7-1ed4-4561-9368-bd663a7ba397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cac5c64-0f08-4c87-b111-50dfd9672a6a", "tag": "91dd256d-d415-4b04-a453-9c408e40361f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:03:25.067479 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bf5a2152-8be3-49cb-a938-616d6f842b5e req-854060f7-1ed4-4561-9368-bd663a7ba397 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:03:25.068150 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-bf5a2152-8be3-49cb-a938-616d6f842b5e req-854060f7-1ed4-4561-9368-bd663a7ba397 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:03:25.079556 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-bf5a2152-8be3-49cb-a938-616d6f842b5e req-854060f7-1ed4-4561-9368-bd663a7ba397 service nova] Creating event network-changed:91dd256d-d415-4b04-a453-9c408e40361f for instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a on n-h1-766726-30 May 19 06:03:25.084854 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-bf5a2152-8be3-49cb-a938-616d6f842b5e req-854060f7-1ed4-4561-9368-bd663a7ba397 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030826 May 19 06:03:25.085691 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3682/7453] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 06:04:53.490584 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=26 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:04:53.491273 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=60 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:04:53.495265 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-ee7294c6-4ddd-4471-8572-642695005487 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-941286360"}} {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:04:53.496393 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-ee7294c6-4ddd-4471-8572-642695005487 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:04:53.503246 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee7294c6-4ddd-4471-8572-642695005487 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:04:53.503740 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee7294c6-4ddd-4471-8572-642695005487 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:04:53.504518 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee7294c6-4ddd-4471-8572-642695005487 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:04:53.504968 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-ee7294c6-4ddd-4471-8572-642695005487 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:04:53.777511 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-ee7294c6-4ddd-4471-8572-642695005487 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "POST /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a/action" status: 202 len: 0 microversion: 2.1 time: 0.288664 May 19 06:04:53.778076 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3772/7454] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 19 06:04:53 2022] POST /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 06:04:59.691200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:04:59.691982 n-d-766726-30 devstack@n-api.service[124819]: DEBUG dbcounter [-] [124819] Writing DB stats nova_cell1:SELECT=52 {{(pid=124819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:04:59.801851 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-7aa6f7f1-54b7-4c27-b714-011395edb66f req-810264cd-40c9-4bd7-90be-7f7972ca7254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cac5c64-0f08-4c87-b111-50dfd9672a6a", "name": "network-vif-plugged", "status": "completed", "tag": "91dd256d-d415-4b04-a453-9c408e40361f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:04:59.810973 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7aa6f7f1-54b7-4c27-b714-011395edb66f req-810264cd-40c9-4bd7-90be-7f7972ca7254 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:04:59.811657 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-7aa6f7f1-54b7-4c27-b714-011395edb66f req-810264cd-40c9-4bd7-90be-7f7972ca7254 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:04:59.824324 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-7aa6f7f1-54b7-4c27-b714-011395edb66f req-810264cd-40c9-4bd7-90be-7f7972ca7254 service nova] Creating event network-vif-plugged:91dd256d-d415-4b04-a453-9c408e40361f for instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a on n-h1-766726-30 May 19 06:04:59.830120 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-7aa6f7f1-54b7-4c27-b714-011395edb66f req-810264cd-40c9-4bd7-90be-7f7972ca7254 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141613 May 19 06:04:59.830720 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3683/7455] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:05:07.384842 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_api:SELECT=2 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:05:07.386128 n-d-766726-30 devstack@n-api.service[124818]: DEBUG dbcounter [-] [124818] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 06:05:07.391747 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-43b1d3ca-4d77-49ff-8fca-97bef9fc9891 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:07.392617 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43b1d3ca-4d77-49ff-8fca-97bef9fc9891 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:07.400643 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43b1d3ca-4d77-49ff-8fca-97bef9fc9891 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:07.401124 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43b1d3ca-4d77-49ff-8fca-97bef9fc9891 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:07.401914 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43b1d3ca-4d77-49ff-8fca-97bef9fc9891 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:07.402359 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-43b1d3ca-4d77-49ff-8fca-97bef9fc9891 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:07.431971 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-43b1d3ca-4d77-49ff-8fca-97bef9fc9891 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:05:07.454028 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-820ebc2a-095b-44c6-8403-d82d0909578b req-ed31ba2b-bd84-4c4a-9f49-f5e9ab49dfbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cac5c64-0f08-4c87-b111-50dfd9672a6a", "tag": "91dd256d-d415-4b04-a453-9c408e40361f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:05:07.463417 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-820ebc2a-095b-44c6-8403-d82d0909578b req-ed31ba2b-bd84-4c4a-9f49-f5e9ab49dfbc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:07.463872 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-820ebc2a-095b-44c6-8403-d82d0909578b req-ed31ba2b-bd84-4c4a-9f49-f5e9ab49dfbc service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:07.476199 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-820ebc2a-095b-44c6-8403-d82d0909578b req-ed31ba2b-bd84-4c4a-9f49-f5e9ab49dfbc service nova] Creating event network-changed:91dd256d-d415-4b04-a453-9c408e40361f for instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a on n-h1-766726-30 May 19 06:05:07.481339 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-820ebc2a-095b-44c6-8403-d82d0909578b req-ed31ba2b-bd84-4c4a-9f49-f5e9ab49dfbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096610 May 19 06:05:07.482307 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3684/7456] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:05:07.518032 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-43b1d3ca-4d77-49ff-8fca-97bef9fc9891 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 204 len: 0 microversion: 2.1 time: 0.135168 May 19 06:05:07.520011 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3773/7457] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 06:05:07 2022] DELETE /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:05:07.533096 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-41aec2d9-1c33-4fe9-8fd6-0253c189d539 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:07.535180 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-41aec2d9-1c33-4fe9-8fd6-0253c189d539 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:07.545994 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41aec2d9-1c33-4fe9-8fd6-0253c189d539 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:07.547200 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41aec2d9-1c33-4fe9-8fd6-0253c189d539 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:07.548890 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41aec2d9-1c33-4fe9-8fd6-0253c189d539 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:07.550047 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-41aec2d9-1c33-4fe9-8fd6-0253c189d539 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:07.702346 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-41aec2d9-1c33-4fe9-8fd6-0253c189d539 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:05:07.710873 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-41aec2d9-1c33-4fe9-8fd6-0253c189d539 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1683 microversion: 2.1 time: 0.185889 May 19 06:05:07.711490 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3685/7458] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:05:07 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:05:08.729372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-e2a593b2-c3c0-4c23-9ab8-adc2200a1809 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:08.730009 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-e2a593b2-c3c0-4c23-9ab8-adc2200a1809 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:08.736860 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2a593b2-c3c0-4c23-9ab8-adc2200a1809 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:08.737380 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2a593b2-c3c0-4c23-9ab8-adc2200a1809 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:08.738700 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2a593b2-c3c0-4c23-9ab8-adc2200a1809 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:08.739146 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-e2a593b2-c3c0-4c23-9ab8-adc2200a1809 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:08.870444 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-e2a593b2-c3c0-4c23-9ab8-adc2200a1809 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:05:08.878006 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-e2a593b2-c3c0-4c23-9ab8-adc2200a1809 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1683 microversion: 2.1 time: 0.152968 May 19 06:05:08.878587 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3774/7459] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:05:08 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:05:09.760998 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-6103c6a9-2f53-4d9f-8a8a-335b48e8d996 req-04c57137-6432-456b-b580-78e379a3360c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cac5c64-0f08-4c87-b111-50dfd9672a6a", "name": "network-vif-deleted", "tag": "91dd256d-d415-4b04-a453-9c408e40361f"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:05:09.770888 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6103c6a9-2f53-4d9f-8a8a-335b48e8d996 req-04c57137-6432-456b-b580-78e379a3360c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:09.771336 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-6103c6a9-2f53-4d9f-8a8a-335b48e8d996 req-04c57137-6432-456b-b580-78e379a3360c service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:09.783628 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-6103c6a9-2f53-4d9f-8a8a-335b48e8d996 req-04c57137-6432-456b-b580-78e379a3360c service nova] Creating event network-vif-deleted:91dd256d-d415-4b04-a453-9c408e40361f for instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a on n-h1-766726-30 May 19 06:05:09.788534 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-6103c6a9-2f53-4d9f-8a8a-335b48e8d996 req-04c57137-6432-456b-b580-78e379a3360c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031295 May 19 06:05:09.789171 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3686/7460] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:05:09.895429 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:09.895987 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:09.902933 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:09.903403 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:09.904183 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:09.904646 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:09.937554 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:09.938028 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:09.938494 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lazy-loading 'fault' on Instance uuid 3cac5c64-0f08-4c87-b111-50dfd9672a6a {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:05:09.984026 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:05:09.992274 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-be199184-a795-48bf-b6c0-9c8bcaf04655 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 200 len: 1338 microversion: 2.1 time: 0.100895 May 19 06:05:09.992892 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3775/7461] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:05:09 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:05:11.011024 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:11.011738 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 3cac5c64-0f08-4c87-b111-50dfd9672a6a] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:11.018156 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:11.018762 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:11.019531 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:11.020025 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:11.033107 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] HTTP exception thrown: Instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a could not be found. May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Request method failure captured: May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a HTTP/1.1 May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihd0Estf-e1b7bjiUepGJ_pZS4U2DpJQJZNeYPI7eL0qN0PSnR5Gzvyo7TBiLA_vaZr1pLh3heCAAC20Bz4RFar3UzqNGoukeK_hFAnqYFn97mubu7LDqyzrj3KppF-FWKvNOrlxrV6_qeU7rZI5NSSZx5kMkYrtBQaBEMmSSNMn7oyI May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 1bfe5ef752e146298465d8e3d56cf43e May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestSnapshotPattern-809721328 May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1bfe5ef752e146298465d8e3d56cf43e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1bfe5ef752e146298465d8e3d56cf43e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1bfe5ef752e146298465d8e3d56cf43e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1bfe5ef752e146298465d8e3d56cf43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestSnapshotPattern-809721328 May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 1bfe5ef752e146298465d8e3d56cf43e May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestSnapshotPattern-809721328 May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestSnapshotPattern-809721328-project May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: ff2208476e8649e8b40f69329abfb845 May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestSnapshotPattern-809721328-project May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a could not be found. May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '3cac5c64-0f08-4c87-b111-50dfd9672a6a'} May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a could not be found. May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a could not be found. May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:05:11.035261 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a could not be found. May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Returning 404 to user: Instance 3cac5c64-0f08-4c87-b111-50dfd9672a6a could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-48a814d4-8752-446d-9cdc-eadb6ff18885 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a" status: 404 len: 111 microversion: 2.1 time: 0.030739 May 19 06:05:11.040560 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3687/7462] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:05:11 2022] GET /compute/v2.1/servers/3cac5c64-0f08-4c87-b111-50dfd9672a6a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:05:12.641592 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-fe80984a-0822-4984-8af2-aee68e8c4f49 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:12.642372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fe80984a-0822-4984-8af2-aee68e8c4f49 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:12.643280 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-2793ce11-dd3a-42f9-8ba9-c9f14b88957d req-3dfae0fd-9add-4b5e-9af9-09ea216ee1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cb9518-4c36-4552-a905-a2483c2cc795", "tag": "cb0e5339-fd51-4ca4-8653-a91ff1b174fe"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:05:12.649948 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe80984a-0822-4984-8af2-aee68e8c4f49 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:12.650503 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe80984a-0822-4984-8af2-aee68e8c4f49 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:12.651372 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe80984a-0822-4984-8af2-aee68e8c4f49 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:12.651902 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-fe80984a-0822-4984-8af2-aee68e8c4f49 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:12.652986 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2793ce11-dd3a-42f9-8ba9-c9f14b88957d req-3dfae0fd-9add-4b5e-9af9-09ea216ee1a6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:12.653471 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-2793ce11-dd3a-42f9-8ba9-c9f14b88957d req-3dfae0fd-9add-4b5e-9af9-09ea216ee1a6 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:12.664617 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-2793ce11-dd3a-42f9-8ba9-c9f14b88957d req-3dfae0fd-9add-4b5e-9af9-09ea216ee1a6 service nova] Creating event network-changed:cb0e5339-fd51-4ca4-8653-a91ff1b174fe for instance 13cb9518-4c36-4552-a905-a2483c2cc795 on n-h2-766726-30 May 19 06:05:12.669724 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-2793ce11-dd3a-42f9-8ba9-c9f14b88957d req-3dfae0fd-9add-4b5e-9af9-09ea216ee1a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030010 May 19 06:05:12.670338 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3688/7463] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:05:12.685918 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-fe80984a-0822-4984-8af2-aee68e8c4f49 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Going to try to terminate instance {{(pid=124818) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 06:05:12.788150 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-fe80984a-0822-4984-8af2-aee68e8c4f49 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 204 len: 0 microversion: 2.1 time: 0.150410 May 19 06:05:12.788754 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3776/7464] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 19 06:05:12 2022] DELETE /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 06:05:12.797694 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-c5707418-ef9f-40fc-87f8-046ac836692f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:12.798443 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-c5707418-ef9f-40fc-87f8-046ac836692f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:12.805178 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5707418-ef9f-40fc-87f8-046ac836692f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:12.805966 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5707418-ef9f-40fc-87f8-046ac836692f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:12.806747 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5707418-ef9f-40fc-87f8-046ac836692f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:12.807184 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-c5707418-ef9f-40fc-87f8-046ac836692f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:12.944555 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.policy [None req-c5707418-ef9f-40fc-87f8-046ac836692f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124819) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:05:12.952351 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-c5707418-ef9f-40fc-87f8-046ac836692f tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1684 microversion: 2.1 time: 0.158969 May 19 06:05:12.953015 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3689/7465] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:05:12 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 06:05:13.971440 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-38424c28-bcd4-48b4-b39d-f49d2f39c1a5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:13.972658 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-38424c28-bcd4-48b4-b39d-f49d2f39c1a5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:13.979657 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38424c28-bcd4-48b4-b39d-f49d2f39c1a5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:13.980115 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38424c28-bcd4-48b4-b39d-f49d2f39c1a5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:13.980890 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38424c28-bcd4-48b4-b39d-f49d2f39c1a5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:13.981364 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-38424c28-bcd4-48b4-b39d-f49d2f39c1a5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:14.149317 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-38424c28-bcd4-48b4-b39d-f49d2f39c1a5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:05:14.156799 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-38424c28-bcd4-48b4-b39d-f49d2f39c1a5 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1684 microversion: 2.1 time: 0.189673 May 19 06:05:14.157390 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3777/7466] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:05:13 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1684 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:05:14.811595 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [req-efb0bee6-ddbe-4399-b9e8-b43b34339a9d req-c87518ec-6a34-44a5-8f59-6908992b9b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cb9518-4c36-4552-a905-a2483c2cc795", "name": "network-vif-deleted", "tag": "cb0e5339-fd51-4ca4-8653-a91ff1b174fe"}]} {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 06:05:14.822956 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-efb0bee6-ddbe-4399-b9e8-b43b34339a9d req-c87518ec-6a34-44a5-8f59-6908992b9b09 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:14.823425 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [req-efb0bee6-ddbe-4399-b9e8-b43b34339a9d req-c87518ec-6a34-44a5-8f59-6908992b9b09 service nova] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:14.837028 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.compute.server_external_events [req-efb0bee6-ddbe-4399-b9e8-b43b34339a9d req-c87518ec-6a34-44a5-8f59-6908992b9b09 service nova] Creating event network-vif-deleted:cb0e5339-fd51-4ca4-8653-a91ff1b174fe for instance 13cb9518-4c36-4552-a905-a2483c2cc795 on n-h2-766726-30 May 19 06:05:14.841755 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [req-efb0bee6-ddbe-4399-b9e8-b43b34339a9d req-c87518ec-6a34-44a5-8f59-6908992b9b09 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034196 May 19 06:05:14.842365 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3690/7467] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 19 06:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 06:05:15.176389 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:15.177767 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.compute.api [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124818) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:15.186015 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:15.186499 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:15.187341 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:15.187781 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:15.222374 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:15.223104 n-d-766726-30 devstack@n-api.service[124818]: DEBUG oslo_concurrency.lockutils [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124818) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:15.223739 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.objects.instance [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lazy-loading 'fault' on Instance uuid 13cb9518-4c36-4552-a905-a2483c2cc795 {{(pid=124818) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 06:05:15.275422 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.policy [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2208476e8649e8b40f69329abfb845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe5ef752e146298465d8e3d56cf43e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124818) authorize /opt/stack/nova/nova/policy.py:199}} May 19 06:05:15.283138 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-f5fb04cc-5694-42d8-807e-abdb0c2d50aa tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 200 len: 1338 microversion: 2.1 time: 0.111545 May 19 06:05:15.283719 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3778/7468] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:05:15 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 06:05:16.301319 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '>' {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:16.302021 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.compute.api [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] [instance: 13cb9518-4c36-4552-a905-a2483c2cc795] Fetching instance by UUID {{(pid=124819) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 06:05:16.309070 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:16.309537 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:16.310294 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 06:05:16.310811 n-d-766726-30 devstack@n-api.service[124819]: DEBUG oslo_concurrency.lockutils [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Lock "c3fbadc6-eff8-4077-92b7-08b6c75fa89b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124819) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 06:05:16.324411 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.wsgi [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] HTTP exception thrown: Instance 13cb9518-4c36-4552-a905-a2483c2cc795 could not be found. May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Request method failure captured: May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: request: GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 HTTP/1.1 May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: Accept: application/json May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: Accept-Encoding: identity May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: Connection: close May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: Content-Length: 0 May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: Content-Type: application/json May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: Host: 10.222.0.58 May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: Openstack-System-Scope: None May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: User-Agent: python-urllib3/1.26.9 May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Auth-Token: gAAAAABihd0Estf-e1b7bjiUepGJ_pZS4U2DpJQJZNeYPI7eL0qN0PSnR5Gzvyo7TBiLA_vaZr1pLh3heCAAC20Bz4RFar3UzqNGoukeK_hFAnqYFn97mubu7LDqyzrj3KppF-FWKvNOrlxrV6_qeU7rZI5NSSZx5kMkYrtBQaBEMmSSNMn7oyI May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Id: None May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Domain-Name: None May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Identity-Status: Confirmed May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Is-Admin-Project: True May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Id: default May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Domain-Name: Default May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Id: 1bfe5ef752e146298465d8e3d56cf43e May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Project-Name: tempest-TestSnapshotPattern-809721328 May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Role: reader,member May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Roles: reader,member May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1bfe5ef752e146298465d8e3d56cf43e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1bfe5ef752e146298465d8e3d56cf43e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1bfe5ef752e146298465d8e3d56cf43e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1bfe5ef752e146298465d8e3d56cf43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant: tempest-TestSnapshotPattern-809721328 May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Id: 1bfe5ef752e146298465d8e3d56cf43e May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-Tenant-Name: tempest-TestSnapshotPattern-809721328 May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-User: tempest-TestSnapshotPattern-809721328-project May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Id: default May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-User-Domain-Name: Default May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-User-Id: ff2208476e8649e8b40f69329abfb845 May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: X-User-Name: tempest-TestSnapshotPattern-809721328-project May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: method: > May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: exception: Instance 13cb9518-4c36-4552-a905-a2483c2cc795 could not be found. May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: action_args: {'id': '13cb9518-4c36-4552-a905-a2483c2cc795'} May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: {{(pid=124819) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cb9518-4c36-4552-a905-a2483c2cc795 could not be found. May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cb9518-4c36-4552-a905-a2483c2cc795 could not be found. May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 06:05:16.326057 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cb9518-4c36-4552-a905-a2483c2cc795 could not be found. May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: ERROR nova.api.openstack.wsgi May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: DEBUG nova.api.openstack.wsgi [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Returning 404 to user: Instance 13cb9518-4c36-4552-a905-a2483c2cc795 could not be found. {{(pid=124819) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: INFO nova.api.openstack.requestlog [None req-ceac7ade-5559-4738-8c8a-fbee031c3d5c tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795" status: 404 len: 111 microversion: 2.1 time: 0.031462 May 19 06:05:16.330605 n-d-766726-30 devstack@n-api.service[124819]: [pid: 124819|app: 0|req: 3691/7469] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 19 06:05:16 2022] GET /compute/v2.1/servers/13cb9518-4c36-4552-a905-a2483c2cc795 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 06:05:16.486851 n-d-766726-30 devstack@n-api.service[124818]: DEBUG nova.api.openstack.wsgi [None req-1501607b-ba34-4c2a-ae2e-1f927c7ed666 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] Calling method '.version_select at 0x7fd3154f90d0>' {{(pid=124818) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 06:05:16.509283 n-d-766726-30 devstack@n-api.service[124818]: INFO nova.api.openstack.requestlog [None req-1501607b-ba34-4c2a-ae2e-1f927c7ed666 tempest-TestSnapshotPattern-809721328 tempest-TestSnapshotPattern-809721328-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-315568684" status: 202 len: 0 microversion: 2.1 time: 0.026317 May 19 06:05:16.509902 n-d-766726-30 devstack@n-api.service[124818]: [pid: 124818|app: 0|req: 3779/7470] 10.222.0.58 () {58 vars in 1253 bytes} [Thu May 19 06:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-315568684 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 06:06:29.860894 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:06:29.861504 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 06:06:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:06:31.073307 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:06:31.073911 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 06:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:08:09.114603 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:08:09.115306 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 06:08:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:08:09.934153 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:08:09.934790 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 06:08:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:08:24.411393 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:08:24.411891 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 06:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:08:34.302736 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:08:34.303763 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 06:08:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:09:49.870274 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:09:49.870959 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 06:09:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:09:51.082085 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:09:51.082547 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 06:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:11:29.122846 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:11:29.123399 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 06:11:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:11:29.942335 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:11:29.942803 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 06:11:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:11:44.419639 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:11:44.420289 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 06:11:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:11:54.312358 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:11:54.312961 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 06:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:13:09.879195 n-d-766726-30 devstack@n-api.service[124819]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:13:09.879975 n-d-766726-30 devstack@n-api.service[124819]: Thu May 19 06:13:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 06:13:11.090463 n-d-766726-30 devstack@n-api.service[124818]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 06:13:11.091061 n-d-766726-30 devstack@n-api.service[124818]: Thu May 19 06:13:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!